I find that chaps give you what I call stickability, especially the suede type. I would think that when you're not wearing them your lower leg has more movement and to counteract this you are gripping, which causes your heels to raise and you lose your balance.
Your whole body should be relaxed but supported when you're riding. Meaning that to keep certain musles relaxed and giving they must be supported by other muscles in your body ie to have a relaxed, responsive seat and lower back, your lower tummy muscles must be working to support your seat and back. You need your legs to be relaxed, but with your weight falling through them, so that when you give a leg aid the horse feels the aid, with tense gripping legs the horse can't read the aid.
Try this, poke your finger into your thigh, then poke harder, though you can distinguish the harder poke its not clear and uncomfortable. Now try resting your finger on your thigh, then nudging. This is clear and comfortable. Thats how your legs should feel to the horse.
I would lose the chaps for a while and work on your balance, so your legs feel secure and you no longer feel the need to grip. When you feel happy that your balanced and you've lost the tendancy to grip put your chaps back on.
Lesley