No public officials have spoken at the New York site on the 11th anniversary of the worst attack on US soil.