Pierce Brosnan's sons Dylan Brosnan and Paris Brosnan made the most out of their latest visit to one of their dad's movie sets.

Dylan, 28, and Paris 24, whom Pierce, 72, shares with with his filmmaker and philanthropist wife Keely Shaye, recently spent several weeks on the set of Pierce's new Western The Unholy Trinity. The siblings eventually found themselves encouraged to take their first feature-length film roles by director Richard Gray. (Pierce is also a father to three children whom he shared with his first wife, the late actress Cassandra Harris: Christopher, 52, Sean, 41, and late daughter Charlotte, who died of ovarian cancer in 2013.)

"He invited us out to come and hang out with him, and it was gonna be a great father and son trip, and we're gonna get to spend some quality time together and see a new place and be on set, which are fond memories for us," Paris tells PEOPLE, when the three Brosnans sat down to talk about the movie recently. "I remember being on lots of sets with Dad and Dylan, which is always a good time." 

"It kind of naturally and organically came about that we would be able to participate in the movie," he adds. "There were some little openings for us to get in there and dip our toes in the water."

The Unholy Trinity stars Pierce as a Montana sheriff named Gabriel in the 1870s who gets caught up in a heated situation involving lead character Henry (Brandon Lessard). Samuel L. Jackson also stars as a smooth-talking villain in search of lost treasure. Dylan portrays a pastor in the movie, while Paris plays the son of one of Gabriel's rivals in town.

"I gave very little advice and they asked for very little advice," Pierce tells PEOPLE of guiding Paris and Dylan in their acting debuts. "I think both men knew instinctively what to do, and Richard Gray is such a delightful fellow as the director, and he was so enthusiastic, and it's a very important film for him. 'Show up on time, know your line , know your lines, and be brilliant. Be relaxed and have fun and go play.' 

"It's the most magical gift to have," he adds of working with his sons. "We just had a great time."

Dylan, who has worked on documentaries as a production assistant in the past, is not quite sure where he'll take his career next, but Paris is currently filming another movie, Overhill Manor.

All three Brosnan men say they enjoyed sharing a motor home during the month Paris and Dylan spent on set. "It made me realize that I do love acting and I would like to keep pursuing a career in it," Paris says.

"It was just really nice to go spend time with Dad and Paris and be a part of that," Dylan adds.

The Unholy Trinity is now in theaters.