Does it help to connect a different frontend app like Finamp to your jellyfin server?

Jellyfin maintains its own server-side database, the client you use is irrelevant.