Biggest red flag is a near empty restaurant with very few staff in a busy area.
It says to me that they're struggling & probably not cycling their stock quick enough. Restaurants are typically growing or contracting (excluding the Lindy's).
I usually look for an unassuming place that is frequented by locals.