Baldness genetics is pretty complex and while the X chromosome can be involved, there are many other SNP's across various chromosomes that increase risk. Also you only have a 50% chance of receiving your maternal grandfathers X chromosome