You can search videos within a channel, go to the channel page and look for the magnifying glass all the way at the end of the nav bar that has

Home | Videos | Shorts | Playlists | Posts | *Magnifying glass here*

Well at least in browser its there, I can't find it on mobile for whatever reason.