From their Github, it looks like OpenCascade with Manifold for mesh boolean that they are calling MEDUSA.