| ▲ | Aurornis 8 days ago | |
> Yes all this has been known since the M4 came out. The memory bandwidth is too low. The M4 Max with 128GB of RAM (the part used in the comment) has over 500GB/sec of memory bandwidth. | ||
| ▲ | zackify 8 days ago | parent [-] | |
Which is incredibly slow when you’re over 20k context | ||