Compared to other shows, HBO’s Game of Thrones is notorious for disposing of its characters on a whim. But in Freddie Stroma‘s situation, there’s another reason why he won’t be reprising his role as Samwell Tarly’s brother, Dickon.

According to a report by IGN.com’s Terri Schwartz, Stroma will not return for Season 7 because of his commitment to the ABC series Time After Time. Stroma played Cormac McLaggen in three Harry Potter movies.

“I was shooting this, so my character—I wouldn’t be able to go back now,” Stroma said, per Schwartz’s report. “It was still fun. I got to be in that wrold. I’ve watched all of it. It’s just an incredible TV show.”

Stroma made his appearance in Blood of My Blood, the sixth episode of Season 6. Despite having only a small role, Stroma still valued being a part of one of the most popular television universes.

“Even just to get such a toe in there is fun,” Stroma said. “Just to be on set and kind of feel like I was in that world, I was a fan sitting there at the table doing that scene.”

As for Stroma’s replacement, nothing has been confirmed; however, according to Game of Thrones community Watchers on the Wall (h/t IGN)Tom Hopper will take over as Dickon. HBO has neither confirmed nor denied the rumor. Hopper played Billy Bones in 24 episodes of Black Sails.

Season 7 of Game of Thrones is slated for a summer 2017 release.