Remix.run Logo
frostbyrne 14 hours ago

Greetings!

I've been working on something in the vein of a indie game for a little over a year now. It has been a passion project, but I'm starting to come around on showing it to people.

I am a big fan of Telltale style narrative games. I think Baldur's Gate 3 was the biggest revelation of this for me. Taking that branching dialogue and freedom of choice, and tacking it on to a fun combat system was just everything.

When text based GTRPGs started popping up, I found it hard to connect with them stylistically. I found that I needed the multimodal stimulus of visuals and audio. This led me to start building something, and it ended up being somewhat of a cross between a Telltale game, a Visual novel, and a TTRPG.

Orpheus (https://orpheus.gg) is a fully on-the-fly generated tabletop simulator, with graphics, audio (TTS), and the freedom you can usually only find at a real TTRPG table. That means you can play a sci-fi, fantasy, or even a modern setting in your campaign. The assets are made for you as needed. It runs in your browser so nothing to install or tinker with.

Getting the harness right so the AI GM can stay coherent and organized has been the biggest challenge. It took a lot of iterations to get it to a point where it could understand the scenes it was building as the player changed them.

I've built it to be played with either a keyboard or a gamepad so you can play from your couch. You can switch between them as you feel like it. There is a 3D tabletop for combat, full character sheets, dice rolling, lore tracking. I want it to be dense.

Mostly, I’m looking for people who want to try it, break it, and tell me what feels magical, confusing, boring, or broken. My biggest roadblock currently is that asset generation is relatively expensive. I'm currently mulling over whether a playtest would allow for a BYOK setup so people could try playing as much as they'd like, or if I should add turn limits.

You can join the playtest waitlist at https://orpheus.gg/ -- and I just setup a discord (https://discord.gg/pychWyzf) that I will use for early playtests. (Just me right now! Come hang out!)

vunderba 11 hours ago | parent | next [-]

I've been the DM of a weekly campaign with the same group of friends for nearly a decade now. Over the past few years, I’ve seen a lot of attempts at AI meets D&D, and most of them suffer from fairly pedestrian puzzles and stories, and don’t really compare to what a decent, semi-competent human writer can come up with.

I'd love to see a more modern day attempt at something like Bioware's Neverwinter Nights - which was designed so that someone could create a campaign, and then the game would provide the behavior, pathfinding, assets, and everything else with a virtual (or human) DM behind the scenes. You could still tell a human-driven story, but the engine would do a lot of the heavy lifting.

frostbyrne 11 hours ago | parent [-]

I agree, there is no way to perfectly capture a real table with your friends. This is more an alternative for when life gets in the way of meeting every week.

I think a lot of those attempts you mentioned try and brute force the problem or trust the AI too much on what to generate.

A lot of the same problems that AI coding agents run into also apply to this problem. You have to really manage context (avoid sending a novel at the model) and enforce strict rules in the "engine". The hard part is world building that is consistent without railroading the player and forcing specific paths. I have an agent (for lack of a better term) that manages arcs across each tier. World arcs (nations, factions), player character arcs, NPC arcs, individual scene arcs, and location arcs (towns, cities, dungeons, etc). By prompting all of these as tight, individual arcs with flavor and context peppered in as needed, you end up with stuff that is more compelling. It has to be loose enough that you don't railroad the player. When you decline that NPC's quest, down the road that might have changed the overall arc for a town in a meaningful way.

I won't pretend that I've perfected anything but I have definitely noticed a spark in its writing and world building that I personally have really enjoyed.

vunderba 10 hours ago | parent [-]

Yeah I'd agree that I think AI can at least work provided you manage the context properly, multiple top-level files establishing consistent world state, all that jazz. KoboldAI and SillyTavern both do a pretty good job of maintaining internal consistency around longform interactive fiction.

OTOH, that means that the underlying story is that much more important. I think a lot of people mistake coherence for novelty. Biggest offender is puzzles - oh god do LLMs absolutely blow dire wolf chunks at coming up with organic and interesting puzzles.

blinkbat 13 hours ago | parent | prev | next [-]

Why not generate some asset libraries to help with some of the rote generation? You could theoretically serve the same asset for a pack of rats to multiple campaigns.

frostbyrne 13 hours ago | parent [-]

Yes! I am doing a lot of this where it won't break the illusion. Not everyone needs a unique innkeeper generated in every town, but I want to avoid that "Officer Jenny" effect like in Pokemon where she looks the same in every town they visit.

I have a private vs public flag for assets that I'm considering more unique or sensitive, at the AI GM's discretion. I'm using embeddings from there to try and parse if an asset already exists in the public pool or not, and reuse it if possible. The thinking is that eventually I will have pretty decent asset coverage on most standard campaigns. I can't account for people going way off book though.

I have an asset pipeline that tries to determine player intent and pre-generate assets before they're needed. That way we can attempt to hide the "load screens" like retro games did with elevators. I have a kind of sliding scale for player coherency, and if the player has too many "misses" on the pre-generation pipeline it will increase its requirements for when it starts generating.

I may have wildly over-engineered this but I love it. =)

iugtmkbdfil834 12 hours ago | parent | prev [-]

Super cool project and I love to encourage this as I personally think llms in games have not been utilized to their potential quite yet.