Howard Stern with his parents.Photo: Ari Mintz/ Newsday RM via Getty

Rockville Centre, N.Y.: Howard Stern and his parents Ben and Ray in the backyard of their home

Howard Sternis mourning the loss of his father.

“I lost my father recently, he was 99 years old,” Stern told the outlet.

Ben’s death announcement was partnered with a creative project that Howard is working on in honor of his late father. Specifically, Howard is planning to paint barns with a tie to his dad.

“Next up: Corwith Barns,” he explained of his project. “I’ve done a bunch of smaller paintings of the barns but this one is a larger size. The barns are no longer there but I photographed them many times, and I’m doing a big painting that hopefully captures every broken board on that fading structure.”

“Not sure how old those barns were, but I feel like painting the barns is honoring him and all those growing older and then gone,” he added.

Ben Stern.Bryan Bedder/Getty

Howard Stern’s father, Ben Stern

Ben was a recording engineer who contributed to some of Howard’s projects, includingThe Howard Stern Show, U.S. Open Sores, and Howard Stern on Demand,according toDistractify.

“My dad is in the audience and he would sit you down — I’m speaking for my father now — he would sit you down and say to you, ‘Look, you’re my son, but you’re a nudnik.’ Do you know what a nudnik is?” Howard told a performer onAmerica’s Got Talent.

Never miss a story — sign up forPEOPLE’s free daily newsletterto stay up-to-date on the best of what PEOPLE has to offer, from juicy celebrity news to compelling human interest stories.

The camera then panned to Ben, who laughed. “Dad, tell the guy — tell him he’s got to get a real job,” he continued, as Ben grabbed a microphone.

Ben then addressed the performer. “Well, look, I look at things, and after completely analyzing it, that was the answer.”

Ben joined the performer on stage before recounting what he used to tell Howard as a child: “Don’t be stupid, you moron.”

After Howard announced his death, fans and friends sent heartfelt messages in honor of Ben.

“R.I.P. Ben Stern. My condolences to Howard, @BethStern, Ray, & the entire Stern family. Ben was a damn nice guy, & I’m deeply sorry for your loss. #BenStern,” John Melendez, who formerly appeared as “Stuttering John” onThe Howard Stern Show,tweeted.

source: people.com