Use it or lose it
Here's a way to track, on an ongoing basis, which clothes you wear and which you tend to ignore. Turn the hangers backward over the rod for items you suspect are worn infrequently. If you pull a garment off and wear it, turn the hanger around properly. Soon it will be easy to spot clothe that aren't getting much use because their hangers will still be backwards.