Well, but that just says that one received diamonds first, so you return the favor, i.e. give him diamonds back.

That's why I would assume your explanation is the right one, because it makes the most sense.