Yeah, I just looked back at the chapter after the exchange and realize it's a bit more mathy than I realized (some notation and formulas and terminology), but he keeps it pretty light especially later on. Push past any detail that slows you down too much and it'll click or prove unimportant :)

I'll admit I sometimes also lose the nuance of some long-winded philosophy comparisons he makes in attempting to cover all the POVs at various times.