They just output the most likely text. This is why "pick a random number between 1 and 25 is always the same number." But it has other consequences. I can ask it. "Search the web for restaurants in my home town" and it will happily give me the results of various "searches" it did even though it is not connected to the Internet.

It doesn't know any better, it just knows what a list of search results looks like.