The general idea is that vitamin A is not easily excreted and this eventually builds up in the body, especially the liver, which leads to toxic levels in the body.

However, the only studies that really show vitamin A as toxic are from synthetic vitamin A or taking large doses of vit A supplements. Vitamin A in your diet should not be something to worry about imo. Just do not eat a pound of liver a day because that might cause some problems lol