Might get away with it more often, but the defender would have to time it better. Tho in order to do that he'd need to know exactly when the ball will arrive...by turning his head around.
It might've been the right call in the essence of the rule. Maybe I'm complaining about the rule more than the call. Defensive backs really have zero shot in the NFL.