The pfSense Store

Author Topic: ESXi 6.5.0 Guest OS errors...  (Read 1646 times)

0 Members and 1 Guest are viewing this topic.

Offline C0RR0SIVE

  • Jr. Member
  • **
  • Posts: 69
  • Karma: +8/-0
    • View Profile
ESXi 6.5.0 Guest OS errors...
« on: October 06, 2017, 05:29:25 pm »
I know this is a bit outside the realm of the PFSense project, but suddenly today after updating to the snapshot built Fri Oct 06 15:36:09 CDT 2017 (has been probably a week since the last time I updated) I have started noticing a message in ESXi 6.5 regarding the Guest OS not being correct.  ESXi doesn't have any options for "FreeBSD 11.1-RELEASE-p1"

Is this something that can be resolved in PFSense, or is this something introduced with FreeBSD that is going to drive me up a wall?  Highly unlikely that ESXi is going to be updated to reflect every OS patch/version of FreeBSD..?

Also, I thought 2.4.0 was going to be FreeBSD 11.0 and not 11.1, and that 2.4.1 would be 11.1?
« Last Edit: October 06, 2017, 09:05:15 pm by C0RR0SIVE »

Offline johnpoz

  • Hero Member
  • *****
  • Posts: 14420
  • Karma: +1335/-200
  • Not a pfSense employee, they cannot fire me...
    • View Profile
Re: ESXi 6.5.0 Guest OS errors...
« Reply #1 on: October 07, 2017, 04:55:02 am »
what build version of esxi 6.5 are you running?

I am running
built on Tue Oct 03 13:49:31 CDT 2017
FreeBSD 11.1-RELEASE-p1

Which is 11.1 and not seeing any such issue. I will update to the latest snap.. But my guess is your running a OLD build of 6.5.. Current is build 6765664, came out oct 5th..  I am running build previous. 6.5.0 Update 1 (Build 5969303).

What VM version your running 8, 11, 13?
- An intelligent man is sometimes forced to be drunk to spend time with his fools.
- Please don't PM me for personal help
- if you want to say thanks applaud or https://www.freebsdfoundation.org/donate/
1x SG-2440 2.3.4_p1 (work)
1x SG-4860 2.4.2-RELEASE (home)

Offline johnpoz

  • Hero Member
  • *****
  • Posts: 14420
  • Karma: +1335/-200
  • Not a pfSense employee, they cannot fire me...
    • View Profile
Re: ESXi 6.5.0 Guest OS errors...
« Reply #2 on: October 07, 2017, 05:04:44 am »
Ok updated to current snap

2.4.0-RC (amd64)
built on Fri Oct 06 15:36:09 CDT 2017
FreeBSD 11.1-RELEASE-p1

The system is on the latest version.
Version information updated at Sat Oct 7 5:01:59 CDT 2017 

Not seeing this is my esxi 6.5.. Do you have the open-vm-tools package installed?
- An intelligent man is sometimes forced to be drunk to spend time with his fools.
- Please don't PM me for personal help
- if you want to say thanks applaud or https://www.freebsdfoundation.org/donate/
1x SG-2440 2.3.4_p1 (work)
1x SG-4860 2.4.2-RELEASE (home)

Offline C0RR0SIVE

  • Jr. Member
  • **
  • Posts: 69
  • Karma: +8/-0
    • View Profile
Re: ESXi 6.5.0 Guest OS errors...
« Reply #3 on: October 07, 2017, 02:10:08 pm »
ESXi Build 5310538, guess I will update that when I am able and see how it goes. 

Strange this has never happened before, even on severely out-dated builds till the more recent PFSense snapshots...  Yes, Open-VM-Tools is installed.

Will post back soon, hopefully...  Rather dislike touching that ESXi install.

UPDATE #1:
OK, I am back...  No dice... Updated and made sure everything is on the latest code from what I can tell.

ESXi 6.5.0 Update 1 (Build 6765664)
All three PFSense virtual machines are on VM Version 13
PFSense has been updated to 2.4.0.r.20171007.0850
Open-VM-Tools is 10.1.0,1
Guest OS is set to "Other > FreeBSD (64bit)"


ESXi is seeing that the OS reports back as "FreeBSD 11.1-RELEASE-p1" instead of "FreeBSD(64bit)"....  This is a rather recent change (like in the last week, in PFSense wasn't happening on a snapshot from a week or so ago), and affects 3 different virtual machines, so why would this impact just me, and not others?

Update #2:
Have been noticing performance issues with all three of those VM's now, various glitches where it hangs purely at random before it has ever mounted the file system?  Set to Other 64bit and that seems to have gone away, however, the message is still there.
« Last Edit: October 07, 2017, 03:37:48 pm by C0RR0SIVE »

Offline jimp

  • Administrator
  • Hero Member
  • *****
  • Posts: 21379
  • Karma: +1432/-26
    • View Profile
Re: ESXi 6.5.0 Guest OS errors...
« Reply #4 on: October 10, 2017, 07:48:26 am »
I'm on 6.5.0 (Build 5310538) and though I do see that guest OS difference message, I don't have any problems with VMs underperforming or hanging.
Need help fast? Commercial Support!

Co-Author of pfSense: The Definitive Guide. - Check the Doc Wiki for FAQs.

Do not PM for help!

Offline jasonsansone

  • Newbie
  • *
  • Posts: 12
  • Karma: +1/-0
    • View Profile
    • Sansone Howell
Re: ESXi 6.5.0 Guest OS errors...
« Reply #5 on: October 10, 2017, 09:24:13 am »
I am on ESXi 6.5.0  (Build 6765664).  I have to use the old Kernel (Option 5 in GRUB at Boot).  I am currently on the newest Snapshot, built on Mon Oct 09 17:58:12 CDT 2017.  The following picture shows what happens if I try to boot normally.  The system hangs at "Stopped at via_bitblt_text..."

Offline connorxxl

  • Newbie
  • *
  • Posts: 15
  • Karma: +0/-0
    • View Profile
Re: ESXi 6.5.0 Guest OS errors...
« Reply #6 on: October 10, 2017, 10:52:11 am »
Same here, ESXi 6.5.0 latest patch level, and getting same message with 2.4.0 RC builds. Interestingly the VM sometimes doesn't boot (same error as mentioned above by jasonsansone), however a reboot usually helps...

Offline jimp

  • Administrator
  • Hero Member
  • *****
  • Posts: 21379
  • Karma: +1432/-26
    • View Profile
Re: ESXi 6.5.0 Guest OS errors...
« Reply #7 on: October 10, 2017, 10:57:36 am »
i just updated my lab box to 6.5.0 Update 1 (Build 6765664) and all of my 2.4/2.4.1 VMs powered up fine. No errors.
Need help fast? Commercial Support!

Co-Author of pfSense: The Definitive Guide. - Check the Doc Wiki for FAQs.

Do not PM for help!

Offline jasonsansone

  • Newbie
  • *
  • Posts: 12
  • Karma: +1/-0
    • View Profile
    • Sansone Howell
Re: ESXi 6.5.0 Guest OS errors...
« Reply #8 on: October 10, 2017, 12:37:47 pm »
Any other log, pic, or info I can provide to help?

Offline jimp

  • Administrator
  • Hero Member
  • *****
  • Posts: 21379
  • Karma: +1432/-26
    • View Profile
Re: ESXi 6.5.0 Guest OS errors...
« Reply #9 on: October 10, 2017, 12:40:07 pm »
Was this a new 2.4.0 install or an upgrade? If it was a new install, what filesystem and partition options were used?
Need help fast? Commercial Support!

Co-Author of pfSense: The Definitive Guide. - Check the Doc Wiki for FAQs.

Do not PM for help!

Offline jasonsansone

  • Newbie
  • *
  • Posts: 12
  • Karma: +1/-0
    • View Profile
    • Sansone Howell
Re: ESXi 6.5.0 Guest OS errors...
« Reply #10 on: October 10, 2017, 12:42:35 pm »
I installed 2.4 RC new when it was first released and then restored a config in order to take advantage of ZFS. Itís ZFS on Bios.  I have updated each successive snapshot since the initial RC release.

Offline jimp

  • Administrator
  • Hero Member
  • *****
  • Posts: 21379
  • Karma: +1432/-26
    • View Profile
Re: ESXi 6.5.0 Guest OS errors...
« Reply #11 on: October 10, 2017, 12:46:21 pm »
I have a mix here, some upgrades, some new installs, most on UFS, one or two on ZFS, I think they're all on GPT/BIOS though. None have issues.

Any special hardware involved in the hypervisor? Passing anything through? Any special options enabled?
Need help fast? Commercial Support!

Co-Author of pfSense: The Definitive Guide. - Check the Doc Wiki for FAQs.

Do not PM for help!

Offline jasonsansone

  • Newbie
  • *
  • Posts: 12
  • Karma: +1/-0
    • View Profile
    • Sansone Howell
Re: ESXi 6.5.0 Guest OS errors...
« Reply #12 on: October 10, 2017, 01:02:25 pm »
Nothing special. Itís a Lenovo Thinkstation C20. Dual Xeon Quad Core with 48GB ECC DDR3. No pci passthrough although VT-d is fully enabled for other guest VMís. No tweaks or special options in the guest or host.

Offline jimp

  • Administrator
  • Hero Member
  • *****
  • Posts: 21379
  • Karma: +1432/-26
    • View Profile
Re: ESXi 6.5.0 Guest OS errors...
« Reply #13 on: October 10, 2017, 02:34:04 pm »
Looks like it could be a FreeBSD issue: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=220923 and/or https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=217282

Seems intermittent and doesn't appear to happen to everyone, not many hits out there for it.

Maybe something in the video/console settings of the virtual hardware itself.
Need help fast? Commercial Support!

Co-Author of pfSense: The Definitive Guide. - Check the Doc Wiki for FAQs.

Do not PM for help!

Offline johnpoz

  • Hero Member
  • *****
  • Posts: 14420
  • Karma: +1335/-200
  • Not a pfSense employee, they cannot fire me...
    • View Profile
Re: ESXi 6.5.0 Guest OS errors...
« Reply #14 on: October 10, 2017, 03:09:39 pm »
@Jimp

So you stated "I'm on 6.5.0 (Build 5310538) and though I do see that guest OS difference message"

Then you updated to "6.5.0 Update 1 (Build 6765664)"  Did this make the OS message go away?
- An intelligent man is sometimes forced to be drunk to spend time with his fools.
- Please don't PM me for personal help
- if you want to say thanks applaud or https://www.freebsdfoundation.org/donate/
1x SG-2440 2.3.4_p1 (work)
1x SG-4860 2.4.2-RELEASE (home)