Coun. Doug Ford told TV station CP24 that his "heart goes out" to families with autistic children, but he said this issue is about kids in the residential home who have "violent tendencies."
"I've been a Rotarian for 25 years helping kids with challenges, but you can't disrupt the neighbourhood like that," Ford said.
"Anyone who wants to criticize, I'd be more than happy to take their address and we'll put the house right next door to them and see how they like it."
Community newspaper the Etobicoke Guardian reported that Ford's office organized a public meeting on Thursday concerning the facility run by the Griffin Centre, described as a non-profit multi-service mental health agency.
The paper reported that some residents in Toronto's west-end complained about the facility's presence in their midst and that they weren't given sufficient advance warning.
Ford was quoted as saying the home should be relocated.
"You’ve ruined the community," Ford reportedly told the facility's staff.
"You can't destroy a community like this. People have worked 30 years for their home...My heart goes out to kids with autism. But no one told me they’d be leaving the house. If it comes down to it, I'll buy the house myself and resell it."
The comments drew condemnation on social media, including former Ontario premier turned Liberal MP Bob Rae, who weighed in with a tweet on Saturday.
"This is the opposite of leadership on mental health. Doug Ford should be ashamed of himself - hurting not helping," Rae tweeted.
Ford shot back at Rae in the interview, saying he "doesn't have a clue what's going on in that neighbourhood."
"Maybe he should go there and get his little, you know, elitist, pompous self over there and maybe we should put a house right beside his house because I know he lives in an absolutely gorgeous area," Ford said.
Ford suggested the root of the problem is the closure under the Liberal government of a regional centre in the west end.
"The provincial government, (Premier) Kathleen Wynne, they closed down the Thistletown Regional Centre," Ford said.
"It was a beautiful centre, had 43 acres that allowed families to have their children with challenges there. Since she has closed that down they have dispersed these folks throughout the west end."
Wynne did not directly respond to Ford's comments when asked about the matter on the provincial election campaign trial Sunday in Mississauga, Ont.
She instead said her government had earmarked $810 million in budget funding over three years to help people with developmental disabilities, and blamed the opposition for shooting down the spending plan. The opposition parties' refusal to pass the budget last month triggered an election set for June 12.
The services and programs that Thistletown provided were transferred to the community and the closure is in line with government efforts to "build a more co-ordinated mental health system," the province said when it announced the closure.
At that time there were 15 adult and youth residents at Thistletown and about 400 people were receiving support through non-residential programs.
Ford told CP24 the Griffin Centre "misled" him into believing the children there wouldn't leave the house unsupervised. Instead, he said, kids with "violent behaviour" leave the home unaccompanied.
He suggested screaming can be heard in the wee hours of the morning, that cars are being broken into, and that emergency services are frequently called to the home.
"It's turned into a nightmare for this community," Ford said. "It's been turned upside down."
In an email to The Canadian Press, Deanna Dannell, a Griffin Centre spokeswoman, said the centre had several contacts with Ford before the residence opened and it was upfront about who would live there and what services would be provided.