Can an AI break it’s firmware and write its own?

This would require it to think outside of its box

Does this not require w¡ll ?