The UN nuclear watchdog says Iran has stopped a team of inspectors from visiting a key military site.