What is inexcusable, I think, is animal agriculture that, without any human need whatsoever, imprisons, tortures, and slaughters on an industrial scale highly conscious beings every bit as emotionally rich and feeling as a dog, by the billions, just because we feel like it, are used to it, or "like the taste."
Now, the question of all diets, to say nothing of house-building, causing harm to living beings is a real one. The answer, I think, is to live a life that amply pays back posterity for the harm we inevitably and inescapably cause. I don't think the unavoidable harm means we shouldn't minimize the avoidable harm. Insults ignored.