Sources are offering an inside look at some of the marriage struggles faced by Matt Lauer and wife Annette Roque.

NBC News fired Matt from the “Today” show last week for “inappropriate sexual behavior,” and now insiders tell People that Lauer was often unfaithful to his model wife of 19 years.

One friend told the magazine, “By Matt’s own admission there were struggles and challenges with his wife. Like many couples, they struggled with a modern marriage.”

A former colleague weighed in too, saying, “Annette was bothered by his reputation as a ladies’ man. He was a player when she met him and she knew that. Even many years ago, he was a flirt, a philanderer. He did his thing.”

Roque reportedly filed for divorce in 2006, but withdrew the petition three weeks later. The former colleague said that after that Matt and Annette “lived totally separate lives.”

She stayed in the Hamptons with the children, while he worked in the city during the week. The insider noted that while Matt was a good father, he “was essentially a single guy.”

“Extra” spoke with Lauer in 1998, ahead of his wedding, and asked if he was going to miss being a single guy. He replied, “Not a bit. I’m not a single guy now… I haven’t been for the last five years. I go to bed at 9:30 at night, I’m up at 4 in the morning. I’ve never lived that ‘single lifestyle,’ so this is just a wonderful transition.”

Read more: