They've published several whitepapers and technical documentation on how the secure enclave works and it's been poked at by security researchers for years.

If it's not open source (with open hardware), you cannot trust it. Whitepapers are great, but who knows what's actually implemented.