Get a circular drill bit, cut out the damaged parts, use them to template and cut new inserts, glue / secure in the holes.

Like you'd repare a hole in dry wall.