Using your fork, knife, or spoon to point at a person is absolutely considered rude. Gesturing with utensils likewise (because you can shower others with cast off detritus.)
A quick Google search will turn up hundreds of results corroborating this.
Or just consider the “asshole dinner guest” trope that appears in so many TV shows and movies. They will always be talking too loudly and gesticulating/pointing with their cutlery.