If you didn't read it, your opinion doesn't really matter. Imagine someone talking about a restaurant, and they say to you "Ive never been there, only saw it from outside, but its terrible, dont go there"
There might be a negative association with this book because of your relationship with your mom, but it seems to me like the problem is the latter, not the former.