Wynn ran 13 times for 96 yards with his scoring run coming late in the first quarter. Atkins made kicks from 50 and 48 yards in the second quarter, and his 28-yarder stretched the Paladins' lead to 16-3 early in the fourth.
The Mocs got back in it when Isaiah Mack forced Ridge Gibson to fumble the ball at the Furman 14. Nick Tiano tossed a 5-yard touchdown pass to Bingo Morton four plays later to make it 16-10 with 1:49 remaining.
Furman (4-4, 4-2 Southern Conference) recovered the ensuing onside kick to win for the fourth time in five games after starting the season 0-3.
Tiano was 25 of 37 for 154 yards passing for Chattanooga (6-3, 4-3).
Pittman explains how Arkansas has a 'special team'
Head coach Sam Pittman discusses his first year in Arkansas and details what having a "special team" means for the Hogs this season.
Anthony Schwartz's NFL draft profile
Check out highlights from Auburn's dynamic wide receiver Anthony Schwartz.
Kelvin Joseph's NFL draft profile
Check out highlights from cornerback Kelvin Joseph who started at LSU before transferring to Kentucky.
Ronnie Perkins' NFL draft profile
Check out highlights from Oklahoma's standout defensive end Ronnie Perkins.
Greg Newsome's NFL draft profile
Check out highlights from Northwestern's strong cornerback Greg Newsome II.
Trey Lance looks sharp in second pro day
Trey Lance goes through some drills in his second pro day as he prepares for the NFL draft.