Looking at your setup again... I would bet the culprit is your AGM batteries. They hate being deeply discharged, and it doesn't look like you have a dc regulator after the battery which would prevent this.