I would check out react three fiber if you want to see how people are building things like this. It essentially brings a component model to three js development and creates good standards for sharable code since things are just react hooks.

Rapier was brand new when I was making things in R3F 2 years ago. Glad to see how mature it’s gotten!