In 2014, Windham served as a graduate assistant for the Penn State Nittany Lions. He assisted defensive coordinator Bob Shoop and defensive line coach Sean Spencer and helped the team lead the Big 10 in scoring defense with 27 touchdowns, 18 field goals and 18.6 yards per game along with winning the 2014 Pinstripe Bowl.[3]
From 2016 to 2017, Windham served as a defensive quality control coach for the Georgia Bulldogs. He helped the team win the 2016 Liberty Bowl in 2016. During the 2017 season, he helped the defense hold 10-of-13 opponents to 14 points or less along with being a part of the staff advancing to the 2018 College Football Playoff National Championship.[6]
On January 30, 2018, Windham was named as the inside linebackers coach for the Kent State Golden Flashes.[7] During the season, he helped the team secure their first bowl win against Utah State in the 2018 Frisco Bowl, beating the Aggies 51-41.[8]
In 2019, Windham was promoted as the safeties coach.[8]
On December 21, 2020, Windham was named as the linebackers coach at South Alabama, joining Kane Wommack's new coaching staff.[9]
On December 27, 2023, Windham was one of four coaches let go from the coaching staff after the team won the 2023 68 Ventures Bowl.[10] On January 24, 2024, Windham would be named as the linebackers coach for the Arkansas State Red Wolves.[3] However, two days later on January 26, he was brought back by South Alabama and was promoted as the defensive coordinator and safeties coach.[11]