| ▲ | theshrike79 4 days ago | |
My "tool" is just prompts saved in a text file that I feed to new models by hand. I haven't built a bespoke framework on top of it. ...yet. Crap, do I need to now? =) | ||
| ▲ | ggsp 4 days ago | parent | next [-] | |
Yeah I’ve wondered about the same myself… My evals are also a pile of text snippets, as are some of my workflows. Thought I’d have a look to see what’s out there and found Promptfoo and Inspect AI. Haven’t tried either but will for my next round of evals | ||
| ▲ | kedihacker 4 days ago | parent | prev | next [-] | |
Well you need to stop them from getting incorporated into its training data | ||
| ▲ | lobsterthief 4 days ago | parent | prev [-] | |
_Brain backlog project #77 created_ | ||