I reckon that’s a good opportunity to make alchemy and collecting flowers/herbs even more interesting than my original suggestion in the feedback post I made.
Create respective flowers/plants that you require for concocting specific dyes. It would make sense that plants in a more dusty/deserty place would make more deserty colours if you wanna make it really simple etc.
Here is my feedback post if anyone is interested in more of my suggestions - Feedback & Suggestions