Alec Baldwin Reveals Why He Called Paul McCartney an 'Asshole' During a Yoga Class

Alec Baldwin hasn't minced words when it comes to Paul McCartney!

On the Wednesday, May episode of the Our Way with Paul Anka and Skip Bronson podcast, the former 30 Rock star, 66, opened up about the time he jokingly called the Beatles musician, 81, an "asshole."

While discussing his experience living in Los Angeles, Baldwin spoke about a yoga class he'd attend with a group of well-known friends.

"I used to take a yoga class with Lorne [Michaels], John Eastman, who's Paul's brother in-law, John Alexander, the painter, Lorne and I, there were five of us. We would take a yoga class. We called ourselves the 'yoga boys,'" he began.

Baldwin continued: "And the only one who was really adept at yoga was McCartney. He would do a handstand or a headstand and he had the most lithe body you've ever seen — and back then he was in his late '60s — and he was so fit. One time he does a headstand before he leaves, and he gets up and whispers to me, he goes, 'I'm gonna go take my daughter to lunch. I'll see you guys later.'"

The Blue Jasmine actor then joked he had some choice words for McCartney.

"I looked up at him after he does the headstand and I go, 'You're an asshole.' And I never thought I'd call one of The Beatles an asshole, but he was just always showing us up with his physical skills! He was a very fit guy," Baldwin concluded.

However, his days in L.A. are limited, as he revealed he's in the process of moving his family to Vermont.

Never miss a story — sign up for PEOPLE's free daily newsletter to stay up-to-date on the best of what PEOPLE has to offer​​, from celebrity news to compelling human interest stories. 

During the episode, the three-time Emmy winner also opened up about being 39 years sober.

“I don't discuss this a lot,” Baldwin admitted when asked about whether he drinks alcohol. “I discuss it every now and then when it makes sense. I'm 39 years sober. I got sober Feb. 23, 1985.”

While discussing his move from his native New York City to L.A. in 1983, he told hosts Paul Anka and Skip Bronson, “I had a white-hot problem every day for two years. I think I snorted a line of cocaine from here to Saturn.”

Baldwin said he and his friends “did one on the rings of Saturn, then we came home — we took it back home. I mean, cocaine was like coffee back then. Everybody was doing it all day long.”

He added: “Because I stopped doing drugs, my drinking increased, which they tell you is going to happen. And that did happen. I just started drinking.”