Top flight teams scramble for new venues after five stadiums banned, one being referred to as looking like a "grazing ground"