Lol, yea.
I mean, for Damus/Primal, I would go with the couple of the composite metrics as a bundle to keep track of for the longer progress. I don't think you can come up with a single north star bullet metric. But there is somewhat clear hierarchy in the quality of the metrics, and their proximity to LTV.
Ex.
- Unique users with a click (comment, zap) are better than total clicks (comments, zaps)
- zap is better than like
For individual iterations, I'd still lean more into UX feedback and product intuition.
The composite metric might be
Distinct(npub HAVING (note + comment + like + zap)>0
You can do >1; >10; >100, and over different time frames, to measure higher, and more repetitive and lasting levels of engagement.
...
At different stages of the product, you want to use diffently advancing metrics. The simple ones are good for the start, but can be skewing you towards the cheap engagement baits. At more advanced stages, you want to counterbalance them with even more quality, and that gets progressively harder to define and measure.