Annan enjoyed the best of a five-goal thriller as they came from behind to beat Berwick 3-2 at Shielfield Park.
Ian Harty grabbed two goals, including one from the penalty spot, to help pile more misery on Rangers, who have now lost five games in a row.
It was the hosts who seized the advantage when Damon Gray scored from close range after 25 minutes but the lead was short-lived as Harty drilled in the equaliser two minutes later.
However, Ian Little ensured it was Jimmy Crease's men who held the lead at the break when he tapped in from six yards.
Aaron Muirhead met Chris Jardine's left-wing cross with a glancing header to restore parity 12 minutes after the restart.
With momentum on their side, Annan grabber the winner when Harty slammed home a penalty in the 78th minute following Stuart Callaghan's handball.