Prime minister says withdrawal will not cause the PPP-led federal government to collapse.