Yeah, that was one of the reasons why I was interested in tying ethanol instead. Unfortunately ethanol, while safer in theory, just doesn't work as well. The film it leaves on drying is a particular concern.
I mask-up and use forced ventilation even when working with "non-toxic" paints. I switch around between paint-types as needed fairly often, so toxic solvent precautions are kinda default for me. Still, I feel like If I can reduce toxicity in general where possible, that's good even in principle.
I mask up everytime because I have to, and I know a lot of others do to or have great ventilation systems (even with the water based paint) but I like to remind as often as possible to protect your lungs !