That is why. Today Spain already has more deaths than births (about 320k births vs. 430–460k deaths per year, a natural loss of ~100–130k people annually). 

If you remove immigration, you basically see that natural decline directly in the total population. And demographics is very inertial.