Figured it out! This CSS scroll driven animations stuff is SO GOOD

I needed to set an animation-range-end: entry 50dvh;

This defines the end of animation timeline based on it's entry point.

Quick video explainer:

Source: x.com/wesbos/status/1821963974922961140