Jamie Reid's late brace earns the visitors all three points at Vale Park.
Darren Moore made one change to his side that drew away to Burton in our last league game. Jordan Shipley replaced the suspended George Byers, while Ben Garrity also returned from injury.
An early chance for the Valiants came after just three minutes, a Ronan Curtis corner from the right was cleared, but returned to the feet of Curtis, who sent in a deep cross to Lorent Tolaj, whose effort flew past the face of the goal.
In the 12th minute, Stevenage see their first chance of the game. A corner from the right was cleared as far as Jordan Houghton, who volleyed wide of goal.
Soon after, there was another chance for the visitors as forward Jamie Reid cut inside onto his right foot before crashing his effort off of Marko Marosi's right-hand post.
Vale came close to opening the scores on the half-hour mark when an inswinging corner was met by the head of Connor Hall, but it was tipped over the crossbar for another corner by Filip Marschall.
Lorent Tolaj opened the scores and his account for the season in the 36th minute when he got on the end of Shipley's clever ball around the outside of the Stevenage defence and rounded Filip Marschall, cutting inside onto his weaker right foot and slammed home from a tight angle.
Three minutes into the second half, Tolaj had a chance to double the lead for Vale when he raced onto the end of a long ball and got in behind, but Filip Marschall raced off his line to make a smart save.
Another opportunity came the way of Tolaj in the 70th minute when he took on three defenders following a loose pass. The forward cut back onto his left foot, but his shot was saved by Marschall, diving away to his right.
Stevenage levelled the scores in the 88th minute when a long throw found its way to Jamie Reid at the back post, who fired the ball into Marosi's top left-hand corner.
Just three minutes later, the visitors took the lead in the first minute of added time. Jamie Reid found space on the left-hand side of the Vale penalty area before firing into the bottom corner to claim all three points for the visitors, arguably against the run of play.
With two minutes of added time remaining, the Valiants came close to a late equaliser when Connor Hall's cross from deep was met by Mo Faal, but the forward's header was right down the throat of Marschall.
TEAM NEWS:
Port Vale: Marko Marosi, Mitch Clarke (Jordan Gabriel 74’), Connor Hall ©, Lorent Tolaj, Ronan Curtis (Mo Faal 65’), Funso Ojo (Ben Heneghan 81’), Liam Gordon (Jaheim Headley 74’), Ryan Croasdale, Jesse Debrah, Cameron Humphreys, Jordan Shipley (Ben Garrity 65’).
Unused Subs: Joe Gauci, Ben Waine
Stevenage: Filip Marschall, Luther James-Wildin, Dan Butler (Lewis Freestone 90+4), Jordan Houghton (Dan Phillips 71’), Carl Piergianni ©, Dan Kemp, Jordan Roberts (Gassan Ahadme 71’), Charlie Goode, Harvey White, Jamie Reid, Phoenix Patterson (Dan Sweeny 71’).
Unused Subs: Taye Ashby-Hammond,