Well, the most important consideration regarding pigments is the possibility of inhaling dust particles while painting. Furthermore, allot of toxic pigments that are not used in student grade art paints can be easily found in the form of pigments.
Wearing protective mask is thus a must at least at the phase where paints are mixed. After mixing you can proceed without protection.