Remix.run Logo
aaaronic 3 hours ago

I'm trying something similar this semester with my course via AGENTS.md. I think this one is overly verbose and probably falls out of context windows pretty quickly, based on my experience (for me, a very terse but clear set of 30 lines performed better than providing examples and more nuanced explanations during my testing with a few models).

I have included the basic "I am a student -- help me learn, don't just do everything for me," but I also am trying out telling it to generate a .history folder with a markdown history of every prompt and a summary of the action take in response.

I _know_ there are some tools that offer the prompt history automatically, but I've told students they can use _whatever_ tool they want, but should let me know if the folder isn't showing up as they work.

The .history folder is required if they used AI and I intend to review it and try to give specific feedback to the students using it as too much of a crutch.

I just started this last Friday, so wish me luck!

wrs 2 hours ago | parent | next [-]

As a general rule with LLMs, don't just tell it to do something if you actually need to make sure it gets done. Use a hook script to make it do that, or use the history that's already there (transcripts of all sessions are retained in ~/.claude, for example). There are innumerable scripts out there to parse these, or your agent will whip one up for you in 5 minutes.

lucamark an hour ago | parent | prev | next [-]

Love it! I think the power of LLMs to acquire new skills and deepen the knowdledge is underestimated.

When used correctly, they offer a huge advantage over those who don't use them and think they understand but remain superficial. I encourage you to ask even the most obvious questions.

j_french 2 hours ago | parent | prev [-]

I wish you good luck! And add that I'd be interested to hear how you get on. I intend to adopt a similar approach with my classes in September. The . history folder is a great idea.

How do you intend to assess your students?

aaaronic 2 minutes ago | parent [-]

I told them up front this was new territory and we're all learning from it. If they're overusing it I assured them they won't be dealing with a student integrity issue, but I will be giving them feedback if they're clearly over-reliant and if they continue to do so, it could eventually impact the grade on later assignments.

I'm hoping they learn to use it as a tool instead of trying to offload all cognition to it.

This is a CS course targeted at non-majors, so thankfully the "fundamentals" aren't as critical as the overall themes and general skills.