new | show | ask | jobs Github

stopachka 3 hours ago

Thank you! Yeah, it is surprising how magic words can impact the performance of LLMs

▲

swyx 2 hours ago | parent [-]

do you actually know or are you just guessing

▲

nezaj 2 hours ago | parent [-]

Funny enough we added this in awhile back when it seemed more conclusive that this does matter.

But I was curious and just did an adhoc eval.

Here's a version with the aesthetic line included

https://with-aes.vercel.app/

Here's a version without the line

https://wo-aes.vercel.app/

Everything else is the same. Will let y'all be the judge which is better.

Both where made in one-shot with this prompt:

Create a habit tracking app where users can create habits, mark daily completions, and visualize streaks. Include features for setting habit frequency (daily/weekly), viewing completion calendars, and tracking overall progress percentages.

▲

swyx an hour ago | parent [-]

hard to try bc with-aes has a login wall lol

	▲	nezaj an hour ago \| parent [-]
		Agreed. It is curious how the agent got nudged to add auth in that one. I did another ad-hoc but this time I added "Use guest auth" to the prompt. This way you don't need to enter an email. Full prompt below Create a habit tracking app where users can create habits, mark daily completions, and visualize streaks. Include features for setting habit frequency (daily/weekly), viewing completion calendars, and tracking overall progress percentages. Use guest auth Aesthetic version: https://with-aes-guest-auth.vercel.app/ Non-aesthetic version: https://wo-aes-guest-auth.vercel.app/ I'd give the edge to the aesthetic one.