A second woman was found dead inside an apartment building on the same street.
"All the information we have at hand would link these two crimes," police commissioner Mick Fuller said at a press conference.
He said the suspect was a "lone actor" with a history of mental health issues.
He was known to police but "his history was unremarkable compared to the gravity of the crimes he committed", Mr Fuller said.
The police commissioner said the suspect had some ideologies related to terrorism, but had no apparent links to other terrorist organisations.