Steve Harvey popped up in the news recently after a leaked memo to his incoming staff at his newly-relocated talk instructed them to basically say nothing at all to the comedian and TV host. While fans and onlookers were taken aback by Harvey’s “don’t talk to me” rules in the memo, he’s not apologizing for speaking his mind.

Entertainment Tonight’s Kevin Frazier exclusively reports:

“I could not find a way to walk from the stage to my dressing room, to sit in my makeup chair, to walk from my dressing room to the stage or to just sit and have lunch without somebody just walking in,” he explained. “I’ve always had a policy where, you know, you can come and talk to me — so many people are great around here, but some of them just started taking advantage of it.”

“Look man, I’m in my makeup chair, they walk in the room. I’m having lunch, they walk in, they don’t knock,” he continued. “I’m in the hallway, I’m getting ambushed by people with friends that come to the show and having me sign this and do this. I just said, ‘Wait a minute.’ And in hindsight, I probably should’ve handled it a little bit differently.”

Harvey continued on, telling ET that he sent the email “asking everyone to simply honor and respect” his privacy.

Harvey compared the life on set as a “prison” and he was simply trying to convey he needed a little peace when he steps outside his dressing room for air.

Perhaps the stress of running a TV show and other media ventures has become a chore for the 60-year-old Harvey, but at least he acknowledged that he was a little gruff in his approach in asking for peace.

Was Steve Harvey out of line for the memo? Sound off in the comments.