The Duke of Edinburgh told Queen Elizabeth II that the couple's exit showed "a complete lack of respect."
The Duke of Cambridge refuses to invite his brother to his 40th birthday in June.
The Duke of York settled his sexual abuse case out of court with a reported amount of £12 million.
Senior aides plan to use "six-foot privacy screens or a football-style tunnel" to shield her from the photographers.
The monarch does not want to "risk all of that walking and sitting at the Commonwealth Day service in order to be able to go to Prince Philip's memorial."
"The Duke will not be returning to the UK in late March, but hopes to visit his grandmother as soon as possible."
The royals think it's unlikely "he'll come back because it would undermine his position that it's too much of a threat."
The wife of a king is always known as a queen, but the husband of a queen is usually not being styled as the king in England.
The 95-year-old, who marked her reign's 70th anniversary on Sunday, February 6, hosted a tea party at Sandringham on Saturday.
At the time of Prince Philip's death, it was being claimed that Andrew was using his father's death as an opportunity to return to his royal life.
The British monarch traditionally visits the estate this time of the year to mark the death anniversary of her father King George VI.
Prince Harry will be declining his father's offer as his wife would not be comfortable with the idea.
The 95-year-old was of the opinion that bending the restrictions for her would be unfair to the many people who had also lost loved ones during the crisis.
Downing Street staff allegedly boozed "excessively" at two leaving parties the night before Prince Philip's funeral.
Queen Elizabeth II joined the joint christening of August and Zara Tindall's son Lucas Philip at the Royal Chapel of All Saints in Windsor.
Despite the challenges, the 95-year-old is "not one to wallow in self-pity and kept her chin up."
The monarch avoids travelling in helicopters, especially in winter, and never boards one after dark.
The Duke of Edinburgh died in Windsor Castle at the age of 99 on April 9, 2021.
The monarch spoke about Prince Philip's "mischievous, enquiring twinkle" that was "as bright at the end" as when she first set eyes on him.
She is yet to meet her great-granddaughter Lilibet Diana, whom Prince Harry and Meghan Markle have named after her.
New documentary says Prince Philip knew what it was like to be a member of a "dysfunctional family" and didn't want the same to happen to his grandsons.
Early this summer, she started inviting friends to Windsor for lunches and dinners, and would enjoy watching TV with them late into the evening.