I know this has to be the case but it’s scary since most of what agents do can be a black box.

It doesn’t matter what kind of box an agent is if the people using it don’t let you know how the decisions was made.