The weights are the modifiable representation. You modify them with gradient updates.