Palestinian inmates began leaving Israeli jails early Tuesday, setting in motion the historic swap that will trade more than 1,000 Palestinian prisoners for one captured Israeli soldier.