| ▲ | piva00 8 hours ago | |||||||||||||||||||||||||
You can save it to your favourites, no need to comment at all if it's not going to add to the conversation. | ||||||||||||||||||||||||||
| ▲ | hparadiz 7 hours ago | parent [-] | |||||||||||||||||||||||||
Okay here is my adding to the conversation: The current discourse about LLMs in coding especially is based on the cheapest type of inference: text. This technology was designed for images which is a much more computationally expensive task than text. If it's already profitable to use this technology for multimedia like images and videos then using it on a text based inference for code is less then 1% as computationally expensive. Furthermore in the aggregate over time the computational expensive of text based inference precipitates negatively. In other words using it to write code will inevitably become a throwaway computational task like decompressing a jpeg. And yes decompressing jpegs would lag your 386 in the early 90s. | ||||||||||||||||||||||||||
| ||||||||||||||||||||||||||