Dampening the growth potential after lifting is likely to occur only if you're dropping your core body temp enough to get a strong anti inflammatory response. Unless you do it often and accommodate, shivering afterwards is probably a sign you've gone that far. If the swim in the river us just refreshing and invigorating without shivering, you're probably fine. Sounds nice!