Would a lightweight motion detection algorithm work there?

Thinking of Frigate NVR that does motion > object detection > scene description

Where you build up to progressively slower and more expensive algorithms i.e. there's motion > it's a person > here's what the person is doing