Fishman gained notoriety and is most known for his actions in the 1964 game against the Naval Academy, an intense in-state rival. Rough play marked the game, and Fishman responded on two occasions with an extended middle-finger to taunts from the stands, some of which Maryland receiver Darryl Hill described as anti-Semitic.[9] Afterward, with respect to his rough play, Navy head coach Wayne Hardin called Fishman, "a disgrace to the game."[10] Maryland head coach Tom Nugent conceded that Fishman may have been "a little wild-eyed," but added, "I can't chastise him publicly. I didn't see him do anything deliberate."[10] From the Pentagon, Navy officials cited Fishman's use of the middle finger as the main reason for their refusal to renew the series for 40 years.[11] Several times, University of Maryland officials asked Fishman to apologize for the gesture, but he refused and said, "What for? It's a game. It's a silly game. It's football, it's not a diplomatic blunder."[12]
Fishman was the only Jew on the team at the time, and became close friends with Darryl Hill after he transferred from Navy.[13] Hill was the first black player on any ACC football team. Fishman said, "He being the only black and me being the only Jew, we used to call ourselves 'The Onlys.'"[14] Shortly after Hill's arrival, Fishman cut a deal with Hill, offering to help him survive his redshirt season in exchange for tutoring in economics.[15] Fishman was fiercely protective of his friend, Hill, who was the subject of mistreatment from the fans and opposing players. Against South Carolina, which had threatened a boycott of the game because of Hill's participation, Maryland led 13–0 at halftime. As the team walked to the locker room, a fan poured a drink onto Hill. Fishman responded by hitting the man with his helmet.[16]AtWake Forest, Hill was knocked unconscious by a late hit, and Fishman applied the oxygen mask when the medics refused.[17]
