Do you have permission from the publisher for an adaptation? If not, you're taking a legal risk basing it off the books.

It's based on it, it's not an adaptation.

Also, this would very well fit within fair use