Check out the Epic Kitchens project, there are labeled video data sets of cooking, doing dishes, etc.

https://github.com/epic-kitchens