Christopher Boyle netted four minutes into injury time to secure Albion a 2-2 draw at 10-man play-off rivals Annan.
It was Rovers who took the lead 14 minutes in, Steven Lawless latching onto Robert Love's pass to score from 12 yards.
They held the lead until the 57th minute when Bryan Gilfillan crossed for Ian Harty to equalise for Athletic from inside the penalty area.
The turnaround was complete 20 minutes later as Harty notched his second after being played through by Mark Docherty.
That looked to be enough until 92 minutes when Annan's Andrew Aitken was dismissed for a second yellow card.
And Albion took full advantage Boyle slotting home with the last kick of the match.