Practically no one builds their own binaries or APKs either, that's not the point of FOSS.
The point is that you can at any time reproduce the resulting image or binary from the code and can choose to go the extra mile and compile it all yourself.
Using hosted images is well worth it the vast majority of the time for simplicity, but Docker also makes it trivial to compile locally as well.