If it's extended family (parents, aunts, etc) who are making comments, just ignore them. If it's your family (husband or kids) who are complaining - it's time to assign everyone chores. Let them share in the work of keeping their home clean. It will help them respect you, respect their living space and teach them skills they will need in the future. Don't just assign housework to the girls, guys need to know how to keep their space clean and do basic cooking. Even very young children can do simple things like emptying small trash into a bag, setting the table for meals or gathering up dirty clothes for the laundry.
You’ll prob write it off as you just stating an example, but I like how you assume OP is a woman (with the husband and kids comment) I’m a very neat guy. Everything has a designated spot & I don’t leave clutter overnight. I love my sister, but she’s messy as hell. Her and her two kids moved in with me about a year ago and now the house is in a constant state of filth. Groceries stuffed haphazardly in fridge, old food in the sink trap, lint in the lint catcher, crumbs all over the floor and tables. Clutter everywhere. My niece and nephew leave toys everywhere (they won’t clean it, so the responsibility should fall on her to take care of it or teach them) My point is that males can be clean & women messy.