| ▲ | everforward an hour ago | |
> Surely someone is willing to take a 5000x boost in reasoning on a small research model... None of them have even tried anything resembling this AFAIK. It does not seem like something 100% obvious to them. Without knowing anything about the technology at all, if it can't be aligned I could see no one pursuing it. As far as I know, alignment is where the "don't tell the user how to make meth or generate CP" instructions end up and the last I saw eliding all the unsavory training data made materially worse LLMs. It could maybe be post-evaluated by a non-GRAM LLM? Not being aligned is probably a fatal flaw or at least a very short runway into Congress. | ||
| ▲ | jjmarr an hour ago | parent [-] | |
Many open-source models prioritize alignment less than American frontier ones and respond to those instructions. Why haven't they adopted GRAM? | ||