When do you do exercises, do you refer back to sections in the book or examples? If so, this is a bad habit. Try to do exercises without looking back. This will force you to use your memory. Also don't be too quick to check solutions for things you're stuck on.

Everyone who does mathematics feels the way you do when learning something new. It's a normal feeling. Don't get disheartened. Push through it.