I put Accessibility Shortcuts into Control Center so now at night I can swipe down and click that and toggle on both grayscale and reduce white point 100% to make it dramatically darker than the default lowest brightness level.