Michael Phelps Wishes a Happy Mother's Day to His Wife Nicole as They Pose with All Four Sons

Michael Phelps is feeling grateful for his wife Nicole on Mother's Day.

On Sunday, May 12, the Olympic swimmer, 38, celebrated his wife on Mother's Day alongside their four sons, Nico, 3 months, Maverick, 3, and Beckett, 5, and Boomer, 7, sharing photos of the family as they went on different vacations together.

In one photo, the family of six poses together outside a stone staircase, with Nicole holding their newborn son Nico in a sling. "Happy Mother’s Day moms! 🤗 😘," Phelps wrote in the caption.

Never miss a story — sign up for PEOPLE's free daily newsletter to stay up-to-date on the best of what PEOPLE has to offer, from juicy celebrity news to compelling human interest stories.

In March, Phelps and his crew celebrated their first Easter as a family of six.

While the couple didn't share photos of all their boys, Nicole posted a sweet moment on her Instagram Story.

The boy mom of four leaned over her littlest guy, catching his eye with her Easter bunny ear headband.

Earlier this year, Nicole shared a sweet photo on her Instagram Story of her baby boy with a little friendship bracelet on his wrist. "Booms made his brother the sweetest bracelet," the newly-minted mom of four shared.

In February, the two celebrated how Nico was fitting in with his big brothers.

"The boys can’t get enough of their newest brother and want nothing more than to love on him, care for him (and mama) and just be near," they wrote.

"I wasn’t sure what life would be like with a newbie and one more babe…. it’s like a puzzle piece we didn’t know was missing 🩵."