Remix.run Logo
pugio 4 hours ago

References:

Information hazard: https://en.wikipedia.org/wiki/Information_hazard

Babel: https://en.wikipedia.org/wiki/Tower_of_Babel

On the Calculation of Volume: https://en.wikipedia.org/wiki/On_the_Calculation_of_Volume

The revenge of NLP

The tool uses good old-fashioned regex/NLP—no LLMs—and rewrites the visible LLM Markdown without touching files on disk. I made it by analysing 10M+ words of past pi transcripts, doing frequency and pattern analysis, and iterating on rules to strip out the most egregious sloperisms. Now the circle is complete.

BEFORE

"Honestly, you're absolutely right—and that's a great question. Let me be clear: the fact that the parser works at all is actually quite remarkable. We utilize the tokenizer in order to handle the majority of edge cases, and due to the fact that it's recursive, it processes a large number of inputs. It's worth noting that this isn't really a bug—it's genuinely a deliberate design choice. In terms of raw throughput, the cache is significantly faster, and I think we should simply ship it.

That said, at the end of the day, not only is the design correct, but it is also fast. In other words, prior to refactoring, we should clearly delve into the nuanced, robust architecture. In conclusion, this is a testament to the seamless, intricate work the team has done."

AFTER

"That's a great question. That the parser works at all is remarkable. We use the tokenizer to handle most edge cases, and because it's recursive, it processes many inputs. This is a deliberate design choice. For raw throughput, the cache is faster, and we should ship it.

Not only is the design correct, but it is also fast. Before refactoring, we should delve into the nuanced, robust architecture. This is a testament to the seamless, intricate work the team has done."

iamjackg 4 minutes ago | parent | next [-]

I'd love to see that tool.

pjc50 4 hours ago | parent | prev | next [-]

I would add https://www.orwellfoundation.com/the-orwell-foundation/orwel...

("It consists in gumming together long strips of words which have already been set in order by someone else, and making the results presentable by sheer humbug" -- Orwell predicts the LLM)

and also https://www.jstor.org/stable/25515288 "The Myles na gCopaleen Catechism of Cliché" itself is rather hard to find online, but he's a very funny writer so it's worth the effort.

lostlogin 4 hours ago | parent | prev | next [-]

> Babel: https://en.wikipedia.org/wiki/Tower_of_Babel

I was hoping for a reference to the Babel Fish, whispering its translations in your ear.

ithkuil 2 hours ago | parent | prev [-]

It's not clear to me whether that tool exists or you hallucinated it into existence with this post