There are different kinds of fat. Fat types are not so much about specifically brain, it is overall body health. Explained in the note I attach.
Once you know that monounsaturated fats are bad for you, and start avoiding seed/vegetable oils, there is no point getting the same fats but from milk. But sure, 20% bad fat from milk is better than 100% of it from plant oils.