I can't recall the title, but a friend was recommending to me a book in this genre. I'm probably misremembering, but here you go: a detective agency using an artificial intelligence to conjure demons.

Seems like another commenter found the author/books I was thinking about: https://news.ycombinator.com/item?id=44915297