Hi everyone
After upgrading from vmware 3.5 to vsphere 4.1, we are experiencing lots of vmotion failures ( VM tools are up to date and VM's HW are at level 7).
The error message is :
a general system error occurred source detected that destination failed to resume We used shared FC storage. When I look at the hostd.log file on source host, the following is present - [2011-12-05 10:35:43.622 F59C6B90 verbose 'vm:/vmfs/volumes/499f2c25-3f00c77e-fa22-0017a4770404/Bfsmss01/Bfsmss01.vmx' opID=task-internal-1-44179c5-fe-9d-9-4d] VMotionInitiateSrc: end ReadSynchronized [2011-12-05 10:35:43.622 F59C6B90 verbose 'vm:/vmfs/volumes/499f2c25-3f00c77e-fa22-0017a4770404/Bfsmss01/Bfsmss01.vmx' opID=task-internal-1-44179c5-fe-9d-9-4d] VMotionInitiateSrc: begin Commit [2011-12-05 10:35:43.623 F5E49B90 info 'vm:/vmfs/volumes/499f2c25-3f00c77e-fa22-0017a4770404/Bfsmss01/Bfsmss01.vmx'] Disconnect check in progress. [2011-12-05 10:35:43.623 F59C6B90 verbose 'vm:/vmfs/volumes/499f2c25-3f00c77e-fa22-0017a4770404/Bfsmss01/Bfsmss01.vmx' opID=task-internal-1-44179c5-fe-9d-9-4d] VMotionInitiateSrc: end Commit [2011-12-05 10:35:43.623 F59C6B90 verbose 'VMotionSrc (1323081330934517)' opID=task-internal-1-44179c5-fe-9d-9-4d] Migration changed state from BEGIN to MIGRATING [2011-12-05 10:35:43.629 F5BDCB90 verbose 'vm:/vmfs/volumes/499f2c25-3f00c77e-fa22-0017a4770404/Bfsmss01/Bfsmss01.vmx'] VMotionCmdCb [1323081330934517] 'start': done [2011-12-05 10:35:48.320 F5985B90 verbose 'App'] Looking up object with name = "haTask-ha-host-vim.HostSystem.acquireCimServicesTicket-382669" failed. [2011-12-05 10:35:48.320 F5985B90 verbose 'App'] Looking up object with name = "haTask-ha-host-vim.HostSystem.acquireCimServicesTicket-382669" failed. [2011-12-05 10:35:49.305 F5746B90 verbose 'ha-license-manager' opID=HB-host-200@31807-6d] Load: Loading existing file: /etc/vmware/license.cfg [2011-12-05 10:35:49.320 F5746B90 verbose 'App' opID=HB-host-200@31807-6d] ha-license-manager:Validate -> Valid license detected for "VMware ESX Server 4.0" (lastError=0, desc.IsValid:Yes) [2011-12-05 10:36:21.037 F5746B90 verbose 'vm:/vmfs/volumes/499f2c25-3f00c77e-fa22-0017a4770404/Bfsmss01/Bfsmss01.vmx'] Tools are auto-upgrade capable [2011-12-05 10:36:21.037 F5746B90 verbose 'vm:/vmfs/volumes/499f2c25-3f00c77e-fa22-0017a4770404/Bfsmss01/Bfsmss01.vmx'] Tools guest daemon status changed to: 0 [2011-12-05 10:36:29.638 F5746B90 verbose 'vm:/vmfs/volumes/499f2c25-3f00c77e-fa22-0017a4770404/Bfsmss01/Bfsmss01.vmx'] VMotionLastStatusCb: Failed with error 7: Source detected that destination failed to resume. [2011-12-05 10:36:29.638 F5746B90 verbose 'vm:/vmfs/volumes/499f2c25-3f00c77e-fa22-0017a4770404/Bfsmss01/Bfsmss01.vmx'] VMotionResolveCheck: Operation in progress [2011-12-05 10:36:29.638 F5746B90 verbose 'vm:/vmfs/volumes/499f2c25-3f00c77e-fa22-0017a4770404/Bfsmss01/Bfsmss01.vmx'] VMotionStatusCb: Completed [2011-12-05 10:36:29.638 F5746B90 verbose 'vm:/vmfs/volumes/499f2c25-3f00c77e-fa22-0017a4770404/Bfsmss01/Bfsmss01.vmx'] VMotionResolveCheck: Firing ResolveCb [2011-12-05 10:36:29.638 F5746B90 info 'VMotionSrc (1323081330934517)'] ResolveCb: VMX reports needsUnregister = false for migrateType MIGRATE_TYPE_VMOTION [2011-12-05 10:36:29.638 F5746B90 info 'VMotionSrc (1323081330934517)'] ResolveCb: Failed with fault: (vmodl.fault.SystemError) { dynamicType = <unset>, faultCause = (vmodl.MethodFault) null, reason = "Source detected that destination failed to resume.", msg = "", } [2011-12-05 10:36:29.638 F5746B90 verbose 'VMotionSrc (1323081330934517)'] Migration changed state from MIGRATING to DONE
I can maually migrate the VM to another host.
This is happening for multiple VMs to multiple hosts - it appears to be random, but it is happening very frequently.
Any advice on this is greatly appreciated
Thanks