Well, as you said, the secondary players are not very good. Since that is the case, the Ravens are at a severe disadvantage during the final two minutes when teams playing from behind are even more likely to try to score quickly ie pass. That said, I'm a bit concerned about the lack of pass rush. You just can't have a sub-par secondary and front seven. If I understand correctly, any player can recover the ball, but they cannot advance it. So I guess the ball was "down" where Allen lost it which was outside of the endzone.