The racists are useful idiots here. By spreading their BS they make it socially unacceptable to call out Israel. For people with certain appearance especially, saying Israel did something wrong could be social suicide.
As long as the racists persist regular people will feel uncomfortable speaking up.
Good job racists, you are giving them the power to do all the things you fear by being dipshits.