Most of the fees in Joinmarket are mining fees as you pay all the fees of a tx with multiple inputs and outputs. The fees asked by your peers (the makers) are not the main part of what you pay, especially since you can set up a threshold for it in JAM