does the plugin architecture come with added overhead (assuming you add a lot of elements)?

If the plugins are in Rust and tie into Bevy, then there probably is minimal overhead. That's one of the advantages of ECS. It's designed for efficiently adding additional layers of functionality.