The Panthers improved to 5-3 on the season while Austin Peay dropped to 4-3.
Every Panther in the starting lineup either scored or drove in at least one run Sunday, led by Hogan's two hits and team-high three RBIs.
Senior Justin Malone earned his second save of the weekend by pitching a perfect ninth inning to thwart the Governors' comeback attempt.
"I'm thrilled with the effort today to pick up a really big series win over a tough ball club," Panthers head coach Greg Frady said of the Governors, who returned eight starters from a team that reached the NCAA tournament last season. "We had contributions from a lot of different people and some of our young guys are really starting to develop."
With GSU up 1-0 and APSU threatening to score with the bases loaded in the second, second baseman Roy Seltenrijch kept the visitors off the board with an impressive inning-ending assist that had bounced off first baseman Brandon Williams' glove. The Panthers capitalized on the momentum in their next at-bats.
Hogan led off the bottom of the inning with a solo blast over the wall in center field for his first career home run. Scott Sarratt followed with a double and scored two batters later when Seltenrijch doubled himself as GSU went ahead, 3-0.
The Governors briefly pulled back even in the fourth inning off Claburn after a two-run single and a wild pitch that tied the game, 3-3, but the Panthers quickly jumped back out in front thanks to a six-run bottom of the fourth that featured six hits and two Governor errors. Kody Adams' two-run single broke the tie early in the inning, then Brandon Williams and Hogan each added run-scoring singles to pace the attack as GSU pushed ahead, 9-3.
Stanley and sophomore Jason Boulais maintained the lead with three scoreless innings of relief before the Governors began their comeback attempt in the eighth. APSU scored four times in the eighth, aided by a three-run double from Jordan Hankins as the visitors pulled within two at 9-7.
APSU would not come any closer however as Malone entered in the ninth and struck out two batters before ending the game himself on a groundout to pick up his school-record 14th career save.
Hogan, a linebacker on the Panther football team, is 6-for-12 at the plate with three RBIs to begin his first year on the diamond.
GSU begins a four-game road trip Wednesday by taking on USC Upstate (5-1) at 4 p.m. in Spartanburg, S.C. The Panthers then travel to DeLand, Fla., playing three games over the weekend at the Bright House Invitational at Stetson University.