シンvmdkをサイズそのままでコピーする

VMware ESXi 6.5 を入れて色々と触れる時間もなく、久しぶりにシンvmdkを cp -rp でコピーするとあーサイズがシックになってるわと改めて認識する次第です。

Thin 16GB 分の ***.vmdk —-> cp -rp でコピー —-> 50GB 分の ***.vmdk

あー、ですよねー。ってことで、

Thin 16GB 分の ***.vmdk —-> vmkfstools -i “src/絶対パス/***.vmdk” -d thin “dst/絶対パス”  —-> 16GB 分の ***.vmdk

DST側のディレクトリは事前に必要です。そして、その中に関連ファイルがあってはいけません。(エラーメッセージみてもよくわからずハマりました)

【コマンド例】

———————————————————————————————————–

vmkfstools -i “/vmfs/volumes/datastore1/WS2016/WS2016.vmdk” -d thin “/vmfs/volumes/datastore1/WS2016/

————————————————————————————————————]

検証環境

+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

[root@sephirothic:/vmfs/volumes/5ac62190-84d99ab4-d35c-6805ca1f91c6] vmkfstools -i “/vmfs/volumes/5ac62190-84d99ab4-d35c-6805ca1f91c6/Windows Server 20
16/Windows Server 2016.vmdk” -d thin “/vmfs/volumes/5ac62190-84d99ab4-d35c-6805ca1f91c6/Windows Server 2016 – 1/Windows Server 2016.vmdk”
Destination disk format: VMFS thin-provisioned
Cloning disk ‘/vmfs/volumes/5ac62190-84d99ab4-d35c-6805ca1f91c6/Windows Server 2016/Windows Server 2016.vmdk’…
Clone: 100% done.
[root@sephirothic:/vmfs/volumes/5ac62190-84d99ab4-d35c-6805ca1f91c6] ls
Windows Server 2012 R2 Windows Server 2016 Windows Server 2016 – 1
[root@sephirothic:/vmfs/volumes/5ac62190-84d99ab4-d35c-6805ca1f91c6] cd Windows\ Server\ 2016
Windows Server 2016 – 1/ Windows Server 2016/
[root@sephirothic:/vmfs/volumes/5ac62190-84d99ab4-d35c-6805ca1f91c6] cd Windows\ Server\ 2016\ -\ 1/
[root@sephirothic:/vmfs/volumes/5ac62190-84d99ab4-d35c-6805ca1f91c6/Windows Server 2016 – 1] ls
Windows Server 2016-flat.vmdk Windows Server 2016.vmdk

+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

他のファイルは、cp -rp でサクッとコピーですね!

# それはそうと、シン・シックって書くと、シン・エヴァンゲリオンみたいで少しテンションあがったのは内緒ですw

 

■ 参考情報

仮想ディスクまたは RDM のクローン作成または変換

https://docs.vmware.com/jp/VMware-vSphere/6.5/com.vmware.vsphere.storage.doc/GUID-01D3CF47-A84A-4988-8103-A0487D6441AA.html

 

ストレージ/LUNデバイスへのパスが「無効」となるログ抜粋

 

ESXi 6.5.0 (Build 5310538) 上のゲストOS Windows Server 2012 R2 (20180107時点FullPatch)の全ファイルをネットワークドライブから全スキャンしてHash生成してたら、見事にESXiごとフリーズしました。

旧ドライバだからなのかな…?  ログ抜粋からのメモ。

 

/var/log/vmkwarning.log

———————————————————————————————————————-

2018-01-06T14:12:17.359Z cpu0:65536)WARNING: RamDisk: 112: Module state.tgz is already mounted. Skipping.
2018-01-06T14:12:20.725Z cpu7:65968)WARNING: VMK_PCI: 740: device 0000:00:14.0 failed to allocate 8 MSIX interrupts
2018-01-06T14:12:20.725Z cpu7:65968)WARNING: LinPCI: LinuxPCI_EnableMSIX:862: 0000:00:14.0: Interrupt allocation failed with Not supported
2018-01-06T14:12:22.002Z cpu3:65966)WARNING: LinScsiLLD: scsi_add_host:573: vmkAdapter (usb-storage) sgMaxEntries rounded to 255. Reported size was 65535
2018-01-06T14:12:24.741Z cpu7:65870)WARNING: NetDVS: 681: portAlias is NULL
2018-01-06T14:12:24.854Z cpu0:66073)WARNING: Tcpip: 1282: failed to unset gateway (error = 0x31)
2018-01-06T14:12:39Z mark: storage-path-claim-completed
2018-01-06T14:12:36.967Z cpu7:66320)WARNING: APEI: 289: Could not initialize HEST
2018-01-06T14:12:37.051Z cpu7:66363)WARNING: FTCpt: 875: Using IPv4 address to start server listener
2018-01-06T14:22:27.161Z cpu5:67980)WARNING: NetDVS: 681: portAlias is NULL
2018-01-07T07:59:35.222Z cpu1:67970)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T07:59:39.331Z cpu5:65566)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T07:59:42.977Z cpu1:65562)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T07:59:46.615Z cpu4:65565)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T07:59:54.858Z cpu5:65566)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T07:59:58.479Z cpu5:65566)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:00:02.100Z cpu7:65568)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:00:10.035Z cpu4:65565)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:00:13.647Z cpu1:65562)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:00:17.277Z cpu7:65568)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:00:24.753Z cpu6:65567)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:00:28.343Z cpu1:65562)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:00:31.941Z cpu6:65567)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:00:50.339Z cpu4:65565)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:00:53.977Z cpu1:65562)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:00:57.587Z cpu1:65562)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:01:05.974Z cpu1:65562)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:01:09.587Z cpu1:66035)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:01:13.216Z cpu0:65631)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:01:21.534Z cpu1:65562)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:01:25.163Z cpu4:65850)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:01:28.793Z cpu4:67972)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:01:36.727Z cpu4:65565)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:01:40.348Z cpu4:65937)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:01:43.986Z cpu4:65927)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:01:51.929Z cpu7:65568)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:01:55.567Z cpu7:65943)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:01:59.205Z cpu7:65850)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:02:07.139Z cpu0:65561)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:02:10.752Z cpu4:66035)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:02:14.406Z cpu4:65565)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:02:22.349Z cpu4:65565)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:02:25.970Z cpu4:65565)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:02:29.600Z cpu4:65565)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:02:37.967Z cpu4:65565)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:02:41.580Z cpu7:65568)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:02:45.235Z cpu7:65568)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:02:53.127Z cpu6:65567)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:02:56.790Z cpu0:65561)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:03:00.461Z cpu4:65565)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:03:04.177Z cpu4:67964)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:03:07.829Z cpu7:67967)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:03:11.459Z cpu7:65848)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:03:19.947Z cpu6:65567)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:03:23.568Z cpu6:65567)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:03:27.189Z cpu6:65567)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:03:35.148Z cpu7:65568)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:03:38.839Z cpu7:67967)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:03:42.495Z cpu7:67970)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:03:46.190Z cpu4:65554)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:03:49.924Z cpu7:67964)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:03:53.608Z cpu0:67964)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:03:57.268Z cpu0:67970)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:04:00.967Z cpu4:65850)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:04:04.639Z cpu6:65720)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:04:08.368Z cpu7:65568)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:04:12.527Z cpu4:65720)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:04:16.227Z cpu6:65554)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:04:19.884Z cpu6:65933)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:04:23.545Z cpu4:67964)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:04:32.088Z cpu0:65561)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:04:35.717Z cpu4:65848)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:04:39.380Z cpu1:66035)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:04:46.631Z cpu7:67967)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:04:50.285Z cpu1:66035)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:04:53.932Z cpu6:67973)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:05:02.500Z cpu0:65720)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:05:06.137Z cpu0:65927)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:05:09.817Z cpu7:65947)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:05:17.593Z cpu4:65565)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:05:21.230Z cpu7:66035)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:05:24.839Z cpu0:65561)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:05:32.811Z cpu4:65565)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:05:36.441Z cpu4:65937)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:05:40.104Z cpu7:65850)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:05:48.330Z cpu7:65568)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:05:51.959Z cpu5:65720)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:05:55.614Z cpu7:65568)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:06:03.523Z cpu0:65561)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:06:07.136Z cpu0:65561)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:06:10.807Z cpu5:65566)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:06:18.733Z cpu4:65565)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:06:22.354Z cpu0:65561)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:06:25.992Z cpu1:65562)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:06:34.418Z cpu2:65563)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:06:38.047Z cpu4:65565)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:06:41.719Z cpu2:65563)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:06:49.103Z cpu2:65563)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:06:52.699Z cpu4:67969)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:06:56.312Z cpu2:65563)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:07:04.713Z cpu2:65563)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:07:08.309Z cpu2:65563)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:07:11.922Z cpu5:65566)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:07:19.906Z cpu4:65565)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:07:23.519Z cpu2:65563)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:07:27.199Z cpu0:65561)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:07:35.133Z cpu4:65565)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:07:38.729Z cpu4:65927)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:07:42.384Z cpu4:65565)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:07:50.359Z cpu5:65566)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:07:53.989Z cpu4:65565)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:07:57.660Z cpu5:65566)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:08:05.903Z cpu7:65568)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:08:09.499Z cpu7:67972)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:08:13.112Z cpu0:65561)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:08:21.113Z cpu4:65565)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:08:24.709Z cpu7:65568)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:08:28.322Z cpu0:65561)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:08:36.856Z cpu0:65561)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:08:40.494Z cpu0:65561)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:08:44.165Z cpu1:65562)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:08:51.958Z cpu1:65562)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:08:55.570Z cpu1:67969)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:08:59.200Z cpu4:65565)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:09:07.118Z cpu2:65563)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:09:10.755Z cpu7:65568)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:09:14.452Z cpu0:65561)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:09:22.319Z cpu0:65561)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:09:25.940Z cpu0:65561)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:09:29.579Z cpu7:65568)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:09:37.546Z cpu0:65561)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:09:41.167Z cpu7:65568)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:09:44.780Z cpu0:65561)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:09:53.156Z cpu0:65561)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:09:56.769Z cpu4:65565)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:10:00.424Z cpu4:65565)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:10:08.308Z cpu5:65566)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:10:11.912Z cpu5:65566)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:10:15.525Z cpu1:65562)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:10:23.518Z cpu4:65565)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:10:27.114Z cpu4:65565)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:10:30.727Z cpu0:65561)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:10:38.761Z cpu0:65561)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:10:42.382Z cpu7:65568)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:10:46.028Z cpu2:65563)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:10:54.321Z cpu7:65568)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:10:57.917Z cpu4:65565)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:11:01.563Z cpu5:65566)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:11:09.514Z cpu6:65567)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:11:13.135Z cpu5:65566)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:11:16.798Z cpu5:65566)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:11:24.699Z cpu5:65566)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:11:28.295Z cpu5:65566)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:11:31.900Z cpu5:65566)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:11:39.901Z cpu5:65566)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:11:43.497Z cpu5:65566)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:11:47.102Z cpu0:65561)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:11:55.494Z cpu0:65561)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:11:59.124Z cpu5:65566)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:12:02.787Z cpu0:65561)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:12:10.721Z cpu1:65562)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:12:14.334Z cpu6:65567)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:12:17.963Z cpu6:65567)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:12:25.923Z cpu2:65563)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:12:29.535Z cpu4:65565)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:12:33.157Z cpu2:65563)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:12:41.108Z cpu2:65563)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:12:44.704Z cpu4:65565)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:12:48.308Z cpu4:65565)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:12:56.718Z cpu1:65562)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:13:00.314Z cpu7:65568)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:13:03.927Z cpu7:65568)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:13:12.311Z cpu1:65562)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:13:15.907Z cpu2:65563)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:13:19.545Z cpu1:65562)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:13:27.513Z cpu4:65565)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:13:31.109Z cpu1:65562)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:13:34.714Z cpu7:65568)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:13:42.689Z cpu6:65567)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:13:46.285Z cpu4:65565)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:13:49.890Z cpu6:65567)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:13:58.308Z cpu7:65568)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:14:01.904Z cpu7:65568)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:14:05.517Z cpu1:65562)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:14:13.484Z cpu7:65568)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:14:17.080Z cpu7:65568)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:14:20.685Z cpu7:65568)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:14:28.703Z cpu4:65565)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:14:32.332Z cpu7:65568)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:14:36.004Z cpu6:65567)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:14:43.946Z cpu6:65567)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:14:47.567Z cpu6:65567)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:14:51.189Z cpu6:65567)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:14:59.098Z cpu7:65568)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:15:02.727Z cpu4:65565)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:15:06.382Z cpu4:65565)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:15:14.433Z cpu1:65562)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:15:18.029Z cpu7:65568)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:15:18.029Z cpu4:67345)WARNING: Partition: 1158: Partition table read from device t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ failed: I/O error
2018-01-07T08:16:20.992Z cpu5:67964)WARNING: VSCSI: 3488: handle 8199(vscsi0:3):WaitForCIF: Issuing reset; number of CIF:2
2018-01-07T08:16:20.992Z cpu5:67964)WARNING: VSCSI: 2645: handle 8199(vscsi0:3):Ignoring double reset
2018-01-07T08:16:59.564Z cpu4:65790)WARNING: LinScsi: SCSILinuxAbortCommands:1909: Failed, Driver ahci, for vmhba33
2018-01-07T08:16:59.567Z cpu7:65583)WARNING: LinScsi: SCSILinuxAbortCommand:2042: The driver failed to call done from itsabort handler and yet it returned SUCCESS
2018-01-07T08:16:59.567Z cpu7:65583)WARNING: LinScsi: SCSILinuxAbortCommands:1909: Failed, Driver ahci, for vmhba33
2018-01-07T08:17:52.387Z cpu0:65561)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:18:07.213Z cpu7:65583)WARNING: LinScsi: SCSILinuxAbortCommands:1909: Failed, Driver ahci, for vmhba33
2018-01-07T08:18:07.303Z cpu7:65721)WARNING: LinScsi: SCSILinuxAbortCommand:2042: The driver failed to call done from itsabort handler and yet it returned SUCCESS
2018-01-07T08:18:07.303Z cpu7:65721)WARNING: LinScsi: SCSILinuxAbortCommands:1909: Failed, Driver ahci, for vmhba33
2018-01-07T08:18:07.303Z cpu7:65721)WARNING: VSCSIFs: 367: handle 8199(vscsi0:3):Failed reset of virtual target 1311648, (initiator 0x430359dc8c80, 0): Failure
2018-01-07T08:18:38.384Z cpu2:65563)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:19:14.975Z cpu7:65721)WARNING: LinScsi: SCSILinuxAbortCommands:1909: Failed, Driver ahci, for vmhba33
2018-01-07T08:19:14.975Z cpu7:65721)WARNING: VSCSIFs: 367: handle 8199(vscsi0:3):Failed reset of virtual target 1311648, (initiator 0x430359dc8c80, 0): Failure
2018-01-07T08:20:22.639Z cpu7:65721)WARNING: LinScsi: SCSILinuxAbortCommands:1909: Failed, Driver ahci, for vmhba33
2018-01-07T08:20:22.639Z cpu7:65721)WARNING: VSCSIFs: 367: handle 8199(vscsi0:3):Failed reset of virtual target 1311648, (initiator 0x430359dc8c80, 0): Failure
2018-01-07T08:21:30.276Z cpu0:65721)WARNING: LinScsi: SCSILinuxAbortCommands:1909: Failed, Driver ahci, for vmhba33
2018-01-07T08:21:30.276Z cpu0:65721)WARNING: VSCSIFs: 367: handle 8199(vscsi0:3):Failed reset of virtual target 1311648, (initiator 0x430359dc8c80, 0): Failure
2018-01-07T08:22:37.949Z cpu3:65721)WARNING: LinScsi: SCSILinuxAbortCommands:1909: Failed, Driver ahci, for vmhba33
2018-01-07T08:22:37.949Z cpu3:65721)WARNING: VSCSIFs: 367: handle 8199(vscsi0:3):Failed reset of virtual target 1311648, (initiator 0x430359dc8c80, 0): Failure
2018-01-07T08:22:52.383Z cpu2:65563)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:23:32.384Z cpu1:65562)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:23:45.654Z cpu1:65721)WARNING: LinScsi: SCSILinuxAbortCommands:1909: Failed, Driver ahci, for vmhba33
2018-01-07T08:23:45.654Z cpu1:65721)WARNING: VSCSIFs: 367: handle 8199(vscsi0:3):Failed reset of virtual target 1311648, (initiator 0x430359dc8c80, 0): Failure
2018-01-07T08:24:53.283Z cpu4:65721)WARNING: LinScsi: SCSILinuxAbortCommands:1909: Failed, Driver ahci, for vmhba33
2018-01-07T08:24:53.283Z cpu4:65721)WARNING: VSCSIFs: 367: handle 8199(vscsi0:3):Failed reset of virtual target 1311648, (initiator 0x430359dc8c80, 0): Failure
2018-01-07T08:26:00.993Z cpu4:65721)WARNING: LinScsi: SCSILinuxAbortCommands:1909: Failed, Driver ahci, for vmhba33
2018-01-07T08:26:00.993Z cpu4:65721)WARNING: VSCSIFs: 367: handle 8199(vscsi0:3):Failed reset of virtual target 1311648, (initiator 0x430359dc8c80, 0): Failure
2018-01-07T08:27:08.694Z cpu4:65721)WARNING: LinScsi: SCSILinuxAbortCommands:1909: Failed, Driver ahci, for vmhba33
2018-01-07T08:27:08.694Z cpu4:65721)WARNING: VSCSIFs: 367: handle 8199(vscsi0:3):Failed reset of virtual target 1311648, (initiator 0x430359dc8c80, 0): Failure
2018-01-07T08:27:52.377Z cpu0:65561)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:28:16.303Z cpu0:65721)WARNING: LinScsi: SCSILinuxAbortCommands:1909: Failed, Driver ahci, for vmhba33
2018-01-07T08:28:16.303Z cpu0:65721)WARNING: VSCSIFs: 367: handle 8199(vscsi0:3):Failed reset of virtual target 1311648, (initiator 0x430359dc8c80, 0): Failure
2018-01-07T08:28:32.379Z cpu0:65561)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:29:24.006Z cpu4:65721)WARNING: LinScsi: SCSILinuxAbortCommands:1909: Failed, Driver ahci, for vmhba33
2018-01-07T08:29:24.006Z cpu4:65721)WARNING: VSCSIFs: 367: handle 8199(vscsi0:3):Failed reset of virtual target 1311648, (initiator 0x430359dc8c80, 0): Failure
2018-01-07T08:30:31.620Z cpu4:65721)WARNING: LinScsi: SCSILinuxAbortCommands:1909: Failed, Driver ahci, for vmhba33
2018-01-07T08:30:31.620Z cpu4:65721)WARNING: VSCSIFs: 367: handle 8199(vscsi0:3):Failed reset of virtual target 1311648, (initiator 0x430359dc8c80, 0): Failure
2018-01-07T08:31:39.222Z cpu4:65721)WARNING: LinScsi: SCSILinuxAbortCommands:1909: Failed, Driver ahci, for vmhba33
2018-01-07T08:31:39.222Z cpu4:65721)WARNING: VSCSIFs: 367: handle 8199(vscsi0:3):Failed reset of virtual target 1311648, (initiator 0x430359dc8c80, 0): Failure
2018-01-07T08:32:46.892Z cpu4:65721)WARNING: LinScsi: SCSILinuxAbortCommands:1909: Failed, Driver ahci, for vmhba33
2018-01-07T08:32:46.892Z cpu4:65721)WARNING: VSCSIFs: 367: handle 8199(vscsi0:3):Failed reset of virtual target 1311648, (initiator 0x430359dc8c80, 0): Failure
2018-01-07T08:32:52.373Z cpu0:65561)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:33:32.374Z cpu0:65561)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:33:54.604Z cpu5:65721)WARNING: LinScsi: SCSILinuxAbortCommands:1909: Failed, Driver ahci, for vmhba33
2018-01-07T08:33:54.604Z cpu5:65721)WARNING: VSCSIFs: 367: handle 8199(vscsi0:3):Failed reset of virtual target 1311648, (initiator 0x430359dc8c80, 0): Failure
2018-01-07T08:35:02.169Z cpu5:65721)WARNING: LinScsi: SCSILinuxAbortCommands:1909: Failed, Driver ahci, for vmhba33
2018-01-07T08:35:02.169Z cpu5:65721)WARNING: VSCSIFs: 367: handle 8199(vscsi0:3):Failed reset of virtual target 1311648, (initiator 0x430359dc8c80, 0): Failure
2018-01-07T08:36:09.902Z cpu5:65721)WARNING: LinScsi: SCSILinuxAbortCommands:1909: Failed, Driver ahci, for vmhba33
2018-01-07T08:36:09.902Z cpu5:65721)WARNING: VSCSIFs: 367: handle 8199(vscsi0:3):Failed reset of virtual target 1311648, (initiator 0x430359dc8c80, 0): Failure
2018-01-07T08:37:17.540Z cpu6:65721)WARNING: LinScsi: SCSILinuxAbortCommands:1909: Failed, Driver ahci, for vmhba33
2018-01-07T08:37:17.540Z cpu6:65721)WARNING: VSCSIFs: 367: handle 8199(vscsi0:3):Failed reset of virtual target 1311648, (initiator 0x430359dc8c80, 0): Failure
2018-01-07T08:37:52.370Z cpu2:65563)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:38:25.229Z cpu0:65721)WARNING: LinScsi: SCSILinuxAbortCommands:1909: Failed, Driver ahci, for vmhba33
2018-01-07T08:38:25.229Z cpu0:65721)WARNING: VSCSIFs: 367: handle 8199(vscsi0:3):Failed reset of virtual target 1311648, (initiator 0x430359dc8c80, 0): Failure
2018-01-07T08:38:32.372Z cpu2:65563)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device “t10.ATA_____ST3000DM0012D1ER166__________________________________Z502FRWQ” state in doubt; requested fast path state update…
2018-01-07T08:39:32.874Z cpu6:65721)WARNING: LinScsi: SCSILinuxAbortCommands:1909: Failed, Driver ahci, for vmhba33
2018-01-07T08:39:32.874Z cpu6:65721)WARNING: VSCSIFs: 367: handle 8199(vscsi0:3):Failed reset of virtual target 1311648, (initiator 0x430359dc8c80, 0): Failure
2018-01-07T08:40:40.565Z cpu1:65721)WARNING: LinScsi: SCSILinuxAbortCommands:1909: Failed, Driver ahci, for vmhba33
2018-01-07T08:40:40.565Z cpu1:65721)WARNING: VSCSIFs: 367: handle 8199(vscsi0:3):Failed reset of virtual target 1311648, (initiator 0x430359dc8c80, 0): Failure


 

/var/log/vobd.log


2018-01-07T07:59:47.293Z: [vmfsCorrelator] 64054893561us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T07:59:47.293Z: [vmfsCorrelator] 64053798958us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T07:59:50.538Z: [vmfsCorrelator] 64058138628us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64058137977 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T07:59:50.538Z: [vmfsCorrelator] 64057043977us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:00:02.539Z: [vmfsCorrelator] 64070139010us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:00:02.539Z: [vmfsCorrelator] 64069044142us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:00:05.673Z: [vmfsCorrelator] 64073273843us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64073273196 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:00:05.673Z: [vmfsCorrelator] 64072178957us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:00:17.675Z: [vmfsCorrelator] 64085275212us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:00:17.675Z: [vmfsCorrelator] 64084180088us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:00:20.917Z: [vmfsCorrelator] 64088517442us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64088516780 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:00:20.917Z: [vmfsCorrelator] 64087422256us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:00:32.918Z: [vmfsCorrelator] 64100518793us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:00:32.918Z: [vmfsCorrelator] 64099423397us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:00:46.419Z: [vmfsCorrelator] 64114020654us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64114020005 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:00:46.420Z: [vmfsCorrelator] 64112925041us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:00:58.421Z: [vmfsCorrelator] 64126022024us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:00:58.421Z: [vmfsCorrelator] 64124926184us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:01:01.788Z: [vmfsCorrelator] 64129389248us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64129388592 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:01:01.788Z: [vmfsCorrelator] 64128293382us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:01:14.037Z: [vmfsCorrelator] 64141638847us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:01:14.037Z: [vmfsCorrelator] 64140542795us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:01:17.389Z: [vmfsCorrelator] 64144991216us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64144990547 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:01:17.390Z: [vmfsCorrelator] 64143895081us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:01:29.389Z: [vmfsCorrelator] 64156990751us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:01:29.389Z: [vmfsCorrelator] 64155894402us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:01:32.624Z: [vmfsCorrelator] 64160226460us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64160225795 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:01:32.625Z: [vmfsCorrelator] 64159130063us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:01:44.626Z: [vmfsCorrelator] 64172227811us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:01:44.626Z: [vmfsCorrelator] 64171131177us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:01:47.984Z: [vmfsCorrelator] 64175586719us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64175586069 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:01:47.985Z: [vmfsCorrelator] 64174490059us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:01:59.986Z: [vmfsCorrelator] 64187588012us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:01:59.986Z: [vmfsCorrelator] 64186491112us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:02:03.228Z: [vmfsCorrelator] 64190830336us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64190829648 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:02:03.228Z: [vmfsCorrelator] 64189733417us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:02:15.228Z: [vmfsCorrelator] 64202831011us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:02:15.228Z: [vmfsCorrelator] 64201733869us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:02:18.579Z: [vmfsCorrelator] 64206182221us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64206181574 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:02:18.579Z: [vmfsCorrelator] 64205085005us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:02:30.580Z: [vmfsCorrelator] 64218182574us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:02:30.580Z: [vmfsCorrelator] 64217085168us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:02:33.789Z: [vmfsCorrelator] 64221392476us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64221391824 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:02:33.789Z: [vmfsCorrelator] 64220295006us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:02:45.790Z: [vmfsCorrelator] 64233393009us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:02:45.790Z: [vmfsCorrelator] 64232295347us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:02:49.033Z: [vmfsCorrelator] 64236636056us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64236635406 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:02:49.033Z: [vmfsCorrelator] 64235538322us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:03:12.532Z: [vmfsCorrelator] 64260135582us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:03:12.532Z: [vmfsCorrelator] 64259037441us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:03:15.894Z: [vmfsCorrelator] 64263497807us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64263497114 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:03:15.894Z: [vmfsCorrelator] 64262399624us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:03:27.893Z: [vmfsCorrelator] 64275497118us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:03:27.893Z: [vmfsCorrelator] 64274398700us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:03:31.154Z: [vmfsCorrelator] 64278757996us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64278757362 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:03:31.154Z: [vmfsCorrelator] 64277659526us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:04:08.036Z: [vmfsCorrelator] 64315640820us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:04:08.036Z: [vmfsCorrelator] 64314541710us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:04:08.474Z: [vmfsCorrelator] 64316078281us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64316077947 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:04:08.474Z: [vmfsCorrelator] 64314979182us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:04:24.599Z: [vmfsCorrelator] 64332203995us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:04:24.599Z: [vmfsCorrelator] 64331104601us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:04:27.743Z: [vmfsCorrelator] 64335348446us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64335347792 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:04:27.743Z: [vmfsCorrelator] 64334249023us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:04:39.744Z: [vmfsCorrelator] 64347349021us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:04:39.744Z: [vmfsCorrelator] 64346249365us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:04:42.887Z: [vmfsCorrelator] 64350492036us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64350491375 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:04:42.887Z: [vmfsCorrelator] 64349392326us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:04:54.887Z: [vmfsCorrelator] 64362492058us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:04:54.887Z: [vmfsCorrelator] 64361392158us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:04:58.138Z: [vmfsCorrelator] 64365743940us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64365743304 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:04:58.138Z: [vmfsCorrelator] 64364643974us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:05:10.139Z: [vmfsCorrelator] 64377745028us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:05:10.139Z: [vmfsCorrelator] 64376644853us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:05:13.282Z: [vmfsCorrelator] 64380887513us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64380886862 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:05:13.282Z: [vmfsCorrelator] 64379787295us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:05:25.282Z: [vmfsCorrelator] 64392888016us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:05:25.282Z: [vmfsCorrelator] 64391787606us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:05:28.433Z: [vmfsCorrelator] 64396039419us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64396038768 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:05:28.433Z: [vmfsCorrelator] 64394938927us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:05:41.033Z: [vmfsCorrelator] 64408639076us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:05:41.033Z: [vmfsCorrelator] 64407538382us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:05:44.393Z: [vmfsCorrelator] 64411999768us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64411999131 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:05:44.393Z: [vmfsCorrelator] 64410899000us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:05:56.394Z: [vmfsCorrelator] 64424001008us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:05:56.395Z: [vmfsCorrelator] 64422900042us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:05:59.537Z: [vmfsCorrelator] 64427143330us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64427142655 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:05:59.537Z: [vmfsCorrelator] 64426042303us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:06:11.537Z: [vmfsCorrelator] 64439144009us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:06:11.537Z: [vmfsCorrelator] 64438042784us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:06:14.822Z: [vmfsCorrelator] 64442428583us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64442427939 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:06:14.822Z: [vmfsCorrelator] 64441327307us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:06:26.822Z: [vmfsCorrelator] 64454428800us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:06:26.822Z: [vmfsCorrelator] 64453327289us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:06:30.082Z: [vmfsCorrelator] 64457688830us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64457688178 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:06:30.082Z: [vmfsCorrelator] 64456587288us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:06:42.083Z: [vmfsCorrelator] 64469690016us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:06:42.083Z: [vmfsCorrelator] 64468588247us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:06:45.317Z: [vmfsCorrelator] 64472924068us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64472923425 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:06:45.317Z: [vmfsCorrelator] 64471822252us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:06:57.316Z: [vmfsCorrelator] 64484923875us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:06:57.316Z: [vmfsCorrelator] 64483821850us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:07:00.560Z: [vmfsCorrelator] 64488167645us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64488167025 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:07:00.560Z: [vmfsCorrelator] 64487065568us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:07:12.561Z: [vmfsCorrelator] 64500169011us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:07:12.561Z: [vmfsCorrelator] 64499066736us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:07:15.812Z: [vmfsCorrelator] 64503419595us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64503418924 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:07:15.812Z: [vmfsCorrelator] 64502317253us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:07:27.812Z: [vmfsCorrelator] 64515420010us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:07:27.812Z: [vmfsCorrelator] 64514317451us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:07:31.155Z: [vmfsCorrelator] 64518763159us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64518762519 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:07:31.155Z: [vmfsCorrelator] 64517660544us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:07:43.156Z: [vmfsCorrelator] 64530764012us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:07:43.156Z: [vmfsCorrelator] 64529661193us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:07:46.415Z: [vmfsCorrelator] 64534023419us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64534022769 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:07:46.415Z: [vmfsCorrelator] 64532920538us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:07:58.414Z: [vmfsCorrelator] 64546022883us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:07:58.414Z: [vmfsCorrelator] 64544919785us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:08:01.667Z: [vmfsCorrelator] 64549275344us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64549274683 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:08:01.667Z: [vmfsCorrelator] 64548172193us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:08:14.030Z: [vmfsCorrelator] 64561638911us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:08:14.030Z: [vmfsCorrelator] 64560535587us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:08:17.160Z: [vmfsCorrelator] 64564768947us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64564768301 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:08:17.160Z: [vmfsCorrelator] 64563665535us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:08:29.160Z: [vmfsCorrelator] 64576769591us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:08:29.160Z: [vmfsCorrelator] 64575665967us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:08:32.520Z: [vmfsCorrelator] 64580129212us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64580128565 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:08:32.520Z: [vmfsCorrelator] 64579025563us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:08:44.519Z: [vmfsCorrelator] 64592128790us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:08:44.519Z: [vmfsCorrelator] 64591024930us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:08:47.747Z: [vmfsCorrelator] 64595356109us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64595355473 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:08:47.747Z: [vmfsCorrelator] 64594252164us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:08:59.747Z: [vmfsCorrelator] 64607357010us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:08:59.747Z: [vmfsCorrelator] 64606252848us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:09:02.990Z: [vmfsCorrelator] 64610599720us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64610599056 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:09:02.990Z: [vmfsCorrelator] 64609495521us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:09:14.989Z: [vmfsCorrelator] 64622599148us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:09:14.989Z: [vmfsCorrelator] 64621494761us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:09:18.342Z: [vmfsCorrelator] 64625951642us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64625950996 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:09:18.342Z: [vmfsCorrelator] 64624847185us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:09:30.341Z: [vmfsCorrelator] 64637951588us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:09:30.341Z: [vmfsCorrelator] 64636846909us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:09:33.702Z: [vmfsCorrelator] 64641311897us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64641311250 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:09:33.702Z: [vmfsCorrelator] 64640207172us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:09:45.703Z: [vmfsCorrelator] 64653313037us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:09:45.703Z: [vmfsCorrelator] 64652208108us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:09:49.053Z: [vmfsCorrelator] 64656663812us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64656663178 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:09:49.053Z: [vmfsCorrelator] 64655558831us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:10:01.054Z: [vmfsCorrelator] 64668665010us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:10:01.054Z: [vmfsCorrelator] 64667559798us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:10:04.205Z: [vmfsCorrelator] 64671815717us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64671815078 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:10:04.205Z: [vmfsCorrelator] 64670710480us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:10:16.204Z: [vmfsCorrelator] 64683815366us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:10:16.204Z: [vmfsCorrelator] 64682709908us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:10:19.457Z: [vmfsCorrelator] 64687067635us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64687066995 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:10:19.457Z: [vmfsCorrelator] 64685962127us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:10:31.457Z: [vmfsCorrelator] 64699068015us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:10:31.457Z: [vmfsCorrelator] 64697962284us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:10:34.592Z: [vmfsCorrelator] 64702202858us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64702202237 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:10:34.592Z: [vmfsCorrelator] 64701097092us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:10:47.027Z: [vmfsCorrelator] 64714638830us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:10:47.027Z: [vmfsCorrelator] 64713532885us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:10:50.252Z: [vmfsCorrelator] 64717863195us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64717862536 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:10:50.252Z: [vmfsCorrelator] 64716757150us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:11:02.252Z: [vmfsCorrelator] 64729863594us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:11:02.252Z: [vmfsCorrelator] 64728757336us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:11:05.495Z: [vmfsCorrelator] 64733106765us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64733106106 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:11:05.495Z: [vmfsCorrelator] 64732000476us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:11:17.496Z: [vmfsCorrelator] 64745108014us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:11:17.496Z: [vmfsCorrelator] 64744001510us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:11:20.847Z: [vmfsCorrelator] 64748458691us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64748458036 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:11:20.847Z: [vmfsCorrelator] 64747352105us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:11:32.846Z: [vmfsCorrelator] 64760458572us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:11:32.846Z: [vmfsCorrelator] 64759351780us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:11:36.090Z: [vmfsCorrelator] 64763702269us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64763701618 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:11:36.090Z: [vmfsCorrelator] 64762595432us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:11:48.091Z: [vmfsCorrelator] 64775703597us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:11:48.091Z: [vmfsCorrelator] 64774596533us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:11:51.333Z: [vmfsCorrelator] 64778945853us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64778945198 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:11:51.333Z: [vmfsCorrelator] 64777838728us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:12:03.334Z: [vmfsCorrelator] 64790947038us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:12:03.334Z: [vmfsCorrelator] 64789839721us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:12:06.585Z: [vmfsCorrelator] 64794197762us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64794197114 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:12:06.585Z: [vmfsCorrelator] 64793090372us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:12:18.586Z: [vmfsCorrelator] 64806199014us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:12:18.586Z: [vmfsCorrelator] 64805091425us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:12:21.945Z: [vmfsCorrelator] 64809558029us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64809557381 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:12:21.945Z: [vmfsCorrelator] 64808450376us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:12:33.946Z: [vmfsCorrelator] 64821559397us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:12:33.946Z: [vmfsCorrelator] 64820451546us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:12:37.305Z: [vmfsCorrelator] 64824918292us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64824917629 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:12:37.305Z: [vmfsCorrelator] 64823810392us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:12:49.305Z: [vmfsCorrelator] 64836919008us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:12:49.305Z: [vmfsCorrelator] 64835810927us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:12:52.657Z: [vmfsCorrelator] 64840270232us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64840269569 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:12:52.657Z: [vmfsCorrelator] 64839162092us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:13:05.024Z: [vmfsCorrelator] 64852638129us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:13:05.024Z: [vmfsCorrelator] 64851529838us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:13:08.283Z: [vmfsCorrelator] 64855897183us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64855896531 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:13:08.283Z: [vmfsCorrelator] 64854788799us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:13:20.283Z: [vmfsCorrelator] 64867897603us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:13:20.283Z: [vmfsCorrelator] 64866789026us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:13:23.527Z: [vmfsCorrelator] 64871140768us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64871140113 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:13:23.527Z: [vmfsCorrelator] 64870032141us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:13:35.528Z: [vmfsCorrelator] 64883142012us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:13:35.528Z: [vmfsCorrelator] 64882033195us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:13:38.778Z: [vmfsCorrelator] 64886392679us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64886392034 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:13:38.778Z: [vmfsCorrelator] 64885283807us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:13:50.778Z: [vmfsCorrelator] 64898392343us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:13:50.778Z: [vmfsCorrelator] 64897283283us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:13:54.130Z: [vmfsCorrelator] 64901744615us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64901743963 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:13:54.130Z: [vmfsCorrelator] 64900635503us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:14:06.130Z: [vmfsCorrelator] 64913745012us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:14:06.130Z: [vmfsCorrelator] 64912635700us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:14:09.373Z: [vmfsCorrelator] 64916988191us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64916987528 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:14:09.373Z: [vmfsCorrelator] 64915878833us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:14:21.374Z: [vmfsCorrelator] 64928989010us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:14:21.374Z: [vmfsCorrelator] 64927879474us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:14:24.592Z: [vmfsCorrelator] 64932206761us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64932206122 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:14:24.592Z: [vmfsCorrelator] 64931097160us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:14:36.592Z: [vmfsCorrelator] 64944207526us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:14:36.592Z: [vmfsCorrelator] 64943097746us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:14:39.843Z: [vmfsCorrelator] 64947458692us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64947458022 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:14:39.843Z: [vmfsCorrelator] 64946348860us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:14:51.844Z: [vmfsCorrelator] 64959460011us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:14:51.844Z: [vmfsCorrelator] 64958349969us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:14:55.095Z: [vmfsCorrelator] 64962710609us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64962709955 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:14:55.095Z: [vmfsCorrelator] 64961600517us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:15:07.095Z: [vmfsCorrelator] 64974711005us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:15:07.095Z: [vmfsCorrelator] 64973600719us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:15:10.447Z: [vmfsCorrelator] 64978062547us: [vob.vmfs.heartbeat.recovered] Reclaimed heartbeat for volume 57f89240-4f257198-6df0-6805ca2f98a6 (Datastore-HDD3T-20161008): [Timeout] [HB state abcdef02 offset 3252224 gen 993 stampUS 64978061867 uuid 5a50d951-126d9cd2-e334-6805ca2f98a6 jrnl <FB 174400> drv 14.81]
2018-01-07T08:15:10.447Z: [vmfsCorrelator] 64976952219us: [esx.problem.vmfs.heartbeat.recovered] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:15:22.448Z: [vmfsCorrelator] 64990063880us: [vob.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008
2018-01-07T08:15:22.448Z: [vmfsCorrelator] 64988953339us: [esx.problem.vmfs.heartbeat.timedout] 57f89240-4f257198-6df0-6805ca2f98a6 Datastore-HDD3T-20161008


 

■ 関連情報

 

ESXiで「state in doubt; requested fast path state update」エラー (2110650)

https://kb.vmware.com/s/article/2110650

 

ストレージ/LUN デバイスへのパスが無効と判断されるしくみ (2068353)

https://kb.vmware.com/s/article/2068353

 

ESXi 6.5: フリーズは vmw-ahci から sata-ahci に変更して改善する。

VMware ESXi 6.5 を使うと仮想マシンやホストが数分でフリーズして全く使えなくなる件。

5.5 -> 6.0 -> 6.5 とアップグレードして現象に陥る(;´Д`) オプション色々といじるも直らず新規インストールしても同様で改善されず。

ESXi 6.5 フリーズ

テストとして、新規ゲスト Windows Server 2016 を作成している途中、インストールに30分以上掛かっている異常に気づく。HDDからのISO読み込みとはいえインストール先はSSDなのにこれはおかしい。(いつもは5分以内に終わる)

ってことで、SSD performance 関連で調べると ESXi 6.5 から採用されている vmw-ahci との相性問題で超低速になるとの記事を見つける。なるほど。

そこで、vmw-ahci を無効化(disable)にして、以前の sata-ahci に変更してみる。

[root@sephirothic:~] esxcli software vib list | grep ahci
sata-ahci 3.0-22vmw.650.0.0.4564106 VMW VMwareCertified 2017-05-27
vmw-ahci 1.0.0-34vmw.650.0.14.5146846 VMW VMwareCertified 2017-05-27

[root@sephirothic:~] esxcli system module set –enabled=false –module=vmw_ahci

※ ハイフンは2つ(;´Д`)

再起動後のアクセス。Web Consoleへのアクセスが早くなった気がする。( ゚д゚ )キタ?

なんかいいかんじ。ESXi乗っけているUSBは? あー、こちらも新しいドライバ、vmkusbがロードされてる。ってことで、流れ(は森内)に乗って新しいドライバを無効化してみる。

再起動後、vmkusb から usb-storageに変更されている( ´∀`)bグッ!

多発してた、「NMP device “mpx.vmhba37:C0:T0:L0” state in doubt; requested fast path state update…」が終息している。これは・・・直ったか?!

 

追記:2017/08/05

完全に直った!やはり、新ドライバvmkusbが原因だった模様。安定的に稼働中。

 

参考情報:

ESXi 6.5 vmw_ahci SSD extreme high latency and vm freeze issues

https://kb.vmware.com/selfservice/search.do?cmd=displayKC&docType=kc&docTypeID=DT_KB_1_1&externalId=2147650