Belt sander is fastest if you have access to one.

It can also be done with a Norton stone or diamond stone. Start with coarse and set your angle. Then continue to fine.

You can color the edge with a marker so you can easily see where you're removing material.

To really refine the edge, finish by stropping on leather or even high grit sandpaper (something in the 600 to 2000 range).