| ▲ | liuliu 6 hours ago | |
I am not sure where this comment is from (possibly without looking at this project?). This project is running quasi-frontier model at reasonable tps (~30) with reasonable prefill performance (~500tps) with a high-end laptop. People simply project what they see from this project to what you optimistically can expect. You can argue whether the projection is too optimistic or not, but this project definitely made me a little bit optimistic on that end. | ||