Hey mate, it seems that you want to reach the higher ilvl fatser, getting caught up with ilvl race can be daunting. But is there a necessity to have higher ilvl in your guild right now? Is your spot endangered? Because if you do not enjoy PvP you could just gear up with raids, after all PvP players max cap in ilvl isnt close to what PvE offers and at some point you will replace those items got with sweat and blood from PvP.
Unless you think its important to get the edge now, you could do cap for conquest with is couple of arenas (not sure about how many) and BG, in process you will master your class like you haven’t before, which will be useful even in Raids and high M+, even if you decide to never look back at PvP after you have achieved your milestone.
Any way you choose your invested time won’t go to waste in some way. There is no mandatory requirement in game though to be required to do both, just what are you looking for specifically.
GL.