I'm torn between writing just the custom css I need vs using a framework.

I'm the long run, I've always preferred the former though, in everything. Just what I need, no opinionated framework holding me down. It takes longer up front but actually saves time down the road.