If you're doing construction activity that generates dust you should be wearing a mask, regardless of which fibers are present.