I don't think that is heresy, essentially you are describing what MUI calls unmanaged components - if I understand you well.

These have their places, but I don't see them as an either-or replacement for managed components with associated states.