Most fascinating? That is subjective and thus hard bordering on impossible to estabilish.

Pretty much every country has a fascinating history.

Aside from the obvious like China, Italy, or England or Egypt, I'd be inclined to say Ireland, Iraq, India and Iceland.

Don't know all that much about latin america countries history and most African countries history aside from the northernmost countries. I am possibly missing out on incredibly fascinating stories from those areas.