As a sugar addict, I can tell you that is very dangerous to me. May work for some, but even a hint of sweetener and I can put myself on a sugar binge that will last a day or more. Maybe someday I will regain better control, but for now, it is safer to avoid sweeteners altogether, regardless of how natural they may be.
Also because I am obese, any setback to weight loss is also dangerous. A little honey taking me from 24 BMI to 25 BMI is different from reverting fron 32 BMI to 33 BMI on the way to 26. I put in the work for each of those BMI units, and to backslide is pyschologically impactful, never mind the physical health impact.