Abdul Nacer Benbrika was jailed for 15 years in 2009 and is eligible for release from next month.
But Home Affairs Minister Peter Dutton said it was "appropriate" to revoke his citizenship to protect Australians.
The move makes Benbrika the first person to be stripped of Australian citizenship while still in the country.
His lawyer has declined to comment on the government's decision, ABC News reports.
