| ▲ | terhechte a day ago | |
A Mac Studio m4 max in low power mode consumes ~50-100 watt on 100% gpu consumption. On GPU idle it is ~10 watt. If we imagine improved models (e.g. qwen 3.8 is a 5b moe which is way faster to process) and improved chip performance on 2nm and half a day of usage (the AI will sleep when we sleep then): ((75 watt / 2 [faster models]) / 2 [faster chips]) / 2 [half a day of usage]) => ~ 10 watt. AI for everyone does not imply pC mAsTeRraCe for everyone. | ||
| ▲ | a day ago | parent [-] | |
| [deleted] | ||