Boyle gave the statement shortly after landing in Canada with his wife, Caitlan Coleman, and three young children.
The couple was rescued Wednesday, five years after they had been abducted by the Taliban-linked extremist network while in Afghanistan as part of a backpacking trip. Coleman was pregnant at the time and had four children in captivity. The birth of the fourth child had not been publicly known before Boyle appeared before journalists at the Toronto airport.
"It will be of incredible importance to my family that we are able to build a secure sanctuary for our three surviving children to call a home," he said in his later statement at the airport. "To try to regain some portion of the childhood that they have lost."
Pakistani security forces extracted the family from where it was held in captivity in the country's northwest, near the Afghanistan border. The rescue operation came following years' long accusations leveled by the US against the Pakistani government, saying it was not doing enough to combat groups such as the Haqqani network.
"The stupidity and evil of the Haqqani network's kidnapping of a pilgrim and his heavily pregnant wife engaged in helping ordinary villagers in Taliban-controlled regions of Afghanistan was eclipsed only by the stupidity and evil of authorizing the murder of my infant daughter," he said, adding one of his children suffered health problems during their captivity and their Pakistani rescuers needed to force-feed him.
Boyle said his wife was raped by a guard who was assisted by his superiors. He asked for the Afghan government to bring them to justice.
"God willing, this litany of stupidity will be the epitaph of the Haqqani network," he said.
The journey home was complicated by Boyle's refusal to board a US military aircraft in Pakistan, according to two US officials who spoke on condition of anonymity. Boyle instead asked to be flown to Canada.
Boyle's father said his son did not want to board the plane because it was headed to Bagram Air Base and the family wanted to return directly to North America. Another US official said Boyle was nervous about being in "custody" given his family ties.
He was once married to Zaynab Khadr, the older sister of former Guantanamo Bay detainee Omar Khadr and the daughter of a senior al-Qaeda financier. Her father, the late Ahmed Said Khadr, and the family stayed with Osama bin Laden briefly when Omar Khadr was a boy.
The Canadian-born Omar Khadr was 15 when he was captured by US troops following a firefight and was taken to the US detention center at Guantanamo Bay. Officials had discounted any link between that background and Boyle's capture, with one official describing it in 2014 as a "horrible coincidence."
Boyle and Coleman's families were repeatedly questioned during the couple's years in captivity why their relatives would go backpacking in such a dangerous area, especially considering Coleman was pregnant at the time.
At his impromptu press conference, Boyle claimed he went to Afghanistan to help villagers "who live deep inside Taliban-controlled Afghanistan where no NGO, no aid worker and no government has ever successfully been able to bring the necessary help."
Reuters contributed to this report.