Face masks can be a nuisance, especially under your current circumstances, but wood dust in your lungs can not be cured and you really dont want to suffer from breathing disorders.
I am looking right now at full face powered caps. I really dont want one, as my summer temps are high 30's c. for almost 6 months each year but I also have a medical issue that makes wearing one at the moment very difficult.
I currently use disposable half masks that filter to P3 spec.
If your glasses fog, then your mask isnt fitted properly, if air can get OUT past the filter to your eyes, then dust can get IN the same way.
As a temporary measure, arrange a large fan to blow dust away from you towards a vacuum cleaner intake