I heard something last year, I don't recall where now, about ladybug dung (tiny though it may be) causing respiratory problems. In the same way dust mites do, I suppose.

We get swarms of ladybugs here in the late spring, early fall, and they're particularly fond of our house. They seem to be drawn to white and other light colors.