[1/2] i386/acpi: fix inconsistent QEMU/OVMF device paths

Message ID	20200730155755.188845-1-mst@redhat.com
State	New
Headers	show Return-Path: <SRS0=WSdW=BJ=nongnu.org=qemu-devel-bounces+qemu-devel=archiver.kernel.org@kernel.org> DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 927A1206F5 Date: Thu, 30 Jul 2020 11:58:38 -0400 From: "Michael S. Tsirkin" <mst@redhat.com> To: qemu-devel@nongnu.org Subject: [PATCH 1/2] i386/acpi: fix inconsistent QEMU/OVMF device paths Message-ID: <20200730155755.188845-1-mst@redhat.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Received-SPF: pass client-ip=205.139.110.61; envelope-from=mst@redhat.com; helo=us-smtp-delivery-1.mimecast.com Precedence: list Cc: vit9696 <vit9696@protonmail.com>, Eduardo Habkost <ehabkost@redhat.com>, Paolo Bonzini <pbonzini@redhat.com>, Igor Mammedov <imammedo@redhat.com>, Laszlo Ersek <lersek@redhat.com>, Richard Henderson <rth@twiddle.net> Errors-To: qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Sender: "Qemu-devel" <qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org>
Series	[1/2] i386/acpi: fix inconsistent QEMU/OVMF device paths \| expand [1/2] i386/acpi: fix inconsistent QEMU/OVMF device paths [2/2] arm/acpi: fix an out of spec _UID for PCI root

Michael S. Tsirkin July 30, 2020, 3:58 p.m. UTC

macOS uses ACPI UIDs to build the DevicePath for NVRAM boot options,
while OVMF firmware gets them via an internal channel through QEMU.
Due to a bug in QEMU ACPI currently UEFI firmware and ACPI have
different values, and this makes the underlying operating system
unable to report its boot option.

The particular node in question is the primary PciRoot (PCI0 in ACPI),
which for some reason gets assigned 1 in ACPI UID and 0 in the
DevicePath. This is due to the _UID assigned to it by build_dsdt in
hw/i386/acpi-build.c Which does not correspond to the primary PCI
identifier given by pcibus_num in hw/pci/pci.c

Reference with the device paths, OVMF startup logs, and ACPI table
dumps (SysReport):
https://github.com/acidanthera/bugtracker/issues/1050

In UEFI v2.8, section "10.4.2 Rules with ACPI _HID and _UID" ends with
the paragraph,

    Root PCI bridges will use the plug and play ID of PNP0A03, This will
    be stored in the ACPI Device Path _HID field, or in the Expanded
    ACPI Device Path _CID field to match the ACPI name space. The _UID
    in the ACPI Device Path structure must match the _UID in the ACPI
    name space.

(See especially the last sentence.)

Considering *extra* root bridges / root buses (with bus number > 0),
QEMU's ACPI generator actually does the right thing; since QEMU commit
c96d9286a6d7 ("i386/acpi-build: more traditional _UID and _HID for PXB
root buses", 2015-06-11).

However, the _UID values for root bridge zero (on both i440fx and q35)
have always been "wrong" (from UEFI perspective), going back in QEMU to
commit 74523b850189 ("i386: add ACPI table files from seabios",
2013-10-14).

Even in SeaBIOS, these _UID values have always been 1; see commit
a4d357638c57 ("Port rombios32 code from bochs-bios.", 2008-03-08) for
i440fx, and commit ecbe3fd61511 ("seabios: q35: add dsdt", 2012-12-01)
for q35.

Suggested-by: Laszlo Ersek <lersek@redhat.com>
Tested-by: vit9696 <vit9696@protonmail.com>
Signed-off-by: Michael S. Tsirkin <mst@redhat.com>
---
 hw/i386/acpi-build.c | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)

Thomas Lamprecht Feb. 27, 2021, 7:41 p.m. UTC | #1

On 30.07.20 17:58, Michael S. Tsirkin wrote:
> macOS uses ACPI UIDs to build the DevicePath for NVRAM boot options,

> while OVMF firmware gets them via an internal channel through QEMU.

> Due to a bug in QEMU ACPI currently UEFI firmware and ACPI have

> different values, and this makes the underlying operating system

> unable to report its boot option.

> 

> The particular node in question is the primary PciRoot (PCI0 in ACPI),

> which for some reason gets assigned 1 in ACPI UID and 0 in the

> DevicePath. This is due to the _UID assigned to it by build_dsdt in

> hw/i386/acpi-build.c Which does not correspond to the primary PCI

> identifier given by pcibus_num in hw/pci/pci.c

> 

> Reference with the device paths, OVMF startup logs, and ACPI table

> dumps (SysReport):

> https://github.com/acidanthera/bugtracker/issues/1050

> 

> In UEFI v2.8, section "10.4.2 Rules with ACPI _HID and _UID" ends with

> the paragraph,

> 

>     Root PCI bridges will use the plug and play ID of PNP0A03, This will

>     be stored in the ACPI Device Path _HID field, or in the Expanded

>     ACPI Device Path _CID field to match the ACPI name space. The _UID

>     in the ACPI Device Path structure must match the _UID in the ACPI

>     name space.

> 

> (See especially the last sentence.)

> 

> Considering *extra* root bridges / root buses (with bus number > 0),

> QEMU's ACPI generator actually does the right thing; since QEMU commit

> c96d9286a6d7 ("i386/acpi-build: more traditional _UID and _HID for PXB

> root buses", 2015-06-11).

> 

> However, the _UID values for root bridge zero (on both i440fx and q35)

> have always been "wrong" (from UEFI perspective), going back in QEMU to

> commit 74523b850189 ("i386: add ACPI table files from seabios",

> 2013-10-14).

> 

> Even in SeaBIOS, these _UID values have always been 1; see commit

> a4d357638c57 ("Port rombios32 code from bochs-bios.", 2008-03-08) for

> i440fx, and commit ecbe3fd61511 ("seabios: q35: add dsdt", 2012-12-01)

> for q35.

> 

> Suggested-by: Laszlo Ersek <lersek@redhat.com>

> Tested-by: vit9696 <vit9696@protonmail.com>

> Signed-off-by: Michael S. Tsirkin <mst@redhat.com>

> ---

>  hw/i386/acpi-build.c | 4 ++--

>  1 file changed, 2 insertions(+), 2 deletions(-)

> 

> diff --git a/hw/i386/acpi-build.c b/hw/i386/acpi-build.c

> index b7bcbbbb2a..7a5a8b3521 100644

> --- a/hw/i386/acpi-build.c

> +++ b/hw/i386/acpi-build.c

> @@ -1497,7 +1497,7 @@ build_dsdt(GArray *table_data, BIOSLinker *linker,

>          dev = aml_device("PCI0");

>          aml_append(dev, aml_name_decl("_HID", aml_eisaid("PNP0A03")));

>          aml_append(dev, aml_name_decl("_ADR", aml_int(0)));

> -        aml_append(dev, aml_name_decl("_UID", aml_int(1)));

> +        aml_append(dev, aml_name_decl("_UID", aml_int(0)));

>          aml_append(sb_scope, dev);

>          aml_append(dsdt, sb_scope);

>  

> @@ -1512,7 +1512,7 @@ build_dsdt(GArray *table_data, BIOSLinker *linker,

>          aml_append(dev, aml_name_decl("_HID", aml_eisaid("PNP0A08")));

>          aml_append(dev, aml_name_decl("_CID", aml_eisaid("PNP0A03")));

>          aml_append(dev, aml_name_decl("_ADR", aml_int(0)));

> -        aml_append(dev, aml_name_decl("_UID", aml_int(1)));

> +        aml_append(dev, aml_name_decl("_UID", aml_int(0)));

>          aml_append(dev, build_q35_osc_method());

>          aml_append(sb_scope, dev);

>          aml_append(dsdt, sb_scope);

> 


This "breaks" Windows guests created/installed before this change in the sense
of Windows gets confused and declares that most of the devices changed and thus
it has new entries for them in the device manager where settings of the old one
do not apply anymore.

We were made aware of this by our users when making QEMU 5.2.0 available on
a more used repository of us. Users complained that their static network
configuration got thrown out in Windows 2016 or 2019 server VMs, and Windows tried
to use DHCP (which was not available in their environments) and thus their Windows
VMs had no network connectivity at all anymore.

It's currently not yet quite 100% clear to me with what QEMU version the Windows VM
must be installed with, from reading the patch I have to believe it must be before
that, but we got mixed reports and a colleague could not replicate it from upgrade
of 4.0 to 5.2 (I did /not/ confirm that one). Anyway, just writing this all to avoid
people seeing different results and brushing this off.

So here's my personal reproducer, as said, I think that one should be able to just
use QEMU 5.1 to install a Windows guest and start it with 5.2 afterwards to see this
issue, but YMMV.

Note. I always used the exact same QEMU command (see below) for installation,
reproducing and bisect.

1. Installed Windows 2016 1616 VM using QEMU 3.0.1
   - VirtIO net/scsi driver from VirtIO win 190
2. Setup static network in the VM and shutdown
3. Started VM with 5.2.0 -> Network gone, new "Ethernet #2" adapter shows up instead

Starting the  "Device Manager" and enabling "View -> Show hidden devices" showed
me a greyed out device duplicate for basically anything attached, SCSI disk, Basic
Display Adapter, CDROM device, ..., and the Network device.

The first difference I could find was the "Device instance path" one can find in
the "Details" tab of the devices' "Properties" window.

# old, from initial installation on QEMU 3.0.1
PCI\VEN_1AF4&DEV_1000&SUBSYS_00011AF4&REV_00\3&13C0B0C5&0&90

# new, from boot with QEMU 5.2
PCI\VEN_1AF4&DEV_1000&SUBSYS_00011AF4&REV_00\3&267A616A&0&90

They match until almost the end, not sure how important that is, but it caught my
eye (I'm really no windows guy since a decade so please excuse my terrible
debugging/exploring skills there. The rest of those properties looked pretty
much identical.

I then started a bisect, always just restarting the guest with the new QEMU build
and checking "Device Manager" and network settings to see if good/bad. That worked
pretty well and I came to this commit. See the bisect log attached at the end of
this mail.

So, from reading the commit message I figure that this change is wanted, what are
the implications of just reverting it? (which works out in bringing back the
old state in Windows + working static network config again).

Or any other way/idea to address this in a sane way so that those picky Windows
guests can be handled more graciously?

I guess also that there could be more subtle effects from this patch here, the
network one may have just had quite visible effects to pop up as first issue...

Thanks if you read so far!

cheers,
Thomas


= QEMU Command =

(This was generated by our (Proxmox VE) stack, I only cleaned it up a bit to allow
easier manual running it)

./qemu-system-x86_64 \
  -name win2016 \
  -chardev 'socket,id=qmp,path=/var/run/qemu-server/11765.qmp,server,nowait' \
  -mon 'chardev=qmp,mode=control' \
  -smbios 'type=1,uuid=6324fb28-e98a-44cf-85db-694d1b3405f5' \
  -smp '2,sockets=1,cores=2,maxcpus=2' \
  -nodefaults \
  -boot 'menu=on,strict=on,reboot-timeout=1000' \
  -vnc unix:/var/run/qemu-server/11765.vnc,password \
  -no-hpet \
  -cpu 'host,hv_ipi,hv_relaxed,hv_reset,hv_runtime,hv_spinlocks=0x1fff,hv_stimer,hv_synic,hv_time,hv_vapic,hv_vpindex,+kvm_pv_eoi,+kvm_pv_unhalt,+md-clear,+pcid,+spec-ctrl' \
  -m 2048 \
  -device 'pci-bridge,id=pci.1,chassis_nr=1,bus=pci.0,addr=0x1e' \
  -device 'pci-bridge,id=pci.2,chassis_nr=2,bus=pci.0,addr=0x1f' \
  -device 'vmgenid,guid=2e56e6ca-2cf8-4f1d-8cc3-9b19a2510c01' \
  -device 'piix3-usb-uhci,id=uhci,bus=pci.0,addr=0x1.0x2' \
  -device 'usb-tablet,id=tablet,bus=uhci.0,port=1' \
  -device 'VGA,id=vga,bus=pci.0,addr=0x2,edid=off' \
  -chardev 'socket,path=/var/run/qemu-server/11765.qga,server,nowait,id=qga0' \
  -device 'virtio-serial,id=qga0,bus=pci.0,addr=0x8' \
  -device 'virtserialport,chardev=qga0,name=org.qemu.guest_agent.0' \
  -device 'virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x3' \
  -iscsi 'initiator-name=iqn.1993-08.org.debian:01:468faae9322b' \
  -drive 'file=/mnt/pve/iso/template/iso/virtio-win-0.1.190.iso,if=none,id=drive-ide0,media=cdrom,aio=threads' \
  -device 'ide-cd,bus=ide.0,unit=0,drive=drive-ide0,id=ide0,bootindex=200' \
  -drive 'file=/mnt/pve/iso/template/iso/Win2016-1616-evaluation.ISO,if=none,id=drive-ide2,media=cdrom,aio=threads' \
  -device 'ide-cd,bus=ide.1,unit=0,drive=drive-ide2,id=ide2,bootindex=201' \
  -device 'virtio-scsi-pci,id=scsihw0,bus=pci.0,addr=0x5' \
  -drive 'file=/dev/WDnvme/vm-11765-disk-0,if=none,id=drive-scsi0,format=raw,cache=none,aio=native,detect-zeroes=on' \
  -device 'scsi-hd,bus=scsihw0.0,channel=0,scsi-id=0,lun=0,drive=drive-scsi0,id=scsi0,rotation_rate=1,bootindex=100' \
  -netdev 'type=tap,id=net0,ifname=tap11765i0,script=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on' \
  -device 'virtio-net-pci,mac=02:98:90:43:42:1D,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300' \
  -rtc 'driftfix=slew,base=localtime' \
  -machine 'type=pc' \
  -global 'kvm-pit.lost_tick_policy=discard'


= bisect log =

git bisect start
# bad: [553032db17440f8de011390e5a1cfddd13751b0b] Update version for v5.2.0 release
git bisect bad 553032db17440f8de011390e5a1cfddd13751b0b
# good: [d0ed6a69d399ae193959225cdeaa9382746c91cc] Update version for v5.1.0 release
git bisect good d0ed6a69d399ae193959225cdeaa9382746c91cc
# bad: [ed799805d00ccdda45eb8441c7d929624d9e98a6] qom: Add kernel-doc markup to introduction doc comment
git bisect bad ed799805d00ccdda45eb8441c7d929624d9e98a6
# bad: [e4d8b7c1a95fffcfa4bdab9aa7ffd1cf590cdcf5] Merge remote-tracking branch 'remotes/nvme/tags/pull-nvme-20200902' into staging
git bisect bad e4d8b7c1a95fffcfa4bdab9aa7ffd1cf590cdcf5
# bad: [af1dfe1ec0864e6700237a43cc36018176f9eba9] acpi: update expected DSDT files with _UID changes
git bisect bad af1dfe1ec0864e6700237a43cc36018176f9eba9
# good: [d7df0ceee0fd2e512cd214a9074ebeeb40da3099] Merge remote-tracking branch 'remotes/philmd-gitlab/tags/sd-next-20200821' into staging
git bisect good d7df0ceee0fd2e512cd214a9074ebeeb40da3099
# good: [df82aa7fe10e46b675678977999d49bd586538f8] Merge remote-tracking branch 'remotes/edgar/tags/edgar/xilinx-next-2020-08-24.for-upstream' into staging
git bisect good df82aa7fe10e46b675678977999d49bd586538f8
# good: [e39a8320b088dd5efc9ebaafe387e52b3d962665] target/riscv: Support the Virtual Instruction fault
git bisect good e39a8320b088dd5efc9ebaafe387e52b3d962665
# good: [a6841a2de66fa44fe52ed996b70f9fb9f7bd6ca7] qcow2: Add subcluster support to qcow2_co_pwrite_zeroes()
git bisect good a6841a2de66fa44fe52ed996b70f9fb9f7bd6ca7
# good: [2f8cd515477edab1cbf38ecbdbfa2cac13ce1550] hw/display/artist: Fix invalidation of lines near screen border
git bisect good 2f8cd515477edab1cbf38ecbdbfa2cac13ce1550
# good: [a5d3cfa2dc775e5d99f013703b8508f1d989d588] iotests: Add tests for qcow2 images with extended L2 entries
git bisect good a5d3cfa2dc775e5d99f013703b8508f1d989d588
# good: [8e49197ca5e76fdb8928833b2649ef13fc5aab2f] Merge remote-tracking branch 'remotes/hdeller/tags/target-hppa-v3-pull-request' into staging
git bisect good 8e49197ca5e76fdb8928833b2649ef13fc5aab2f
# bad: [af1b80ae56c9495999e8ccf7b70ef894378de642] i386/acpi: fix inconsistent QEMU/OVMF device paths
git bisect bad af1b80ae56c9495999e8ccf7b70ef894378de642
# good: [42a62c20925e02aef0d849f92a0e9540888e79ae] acpi: allow DSDT changes
git bisect good 42a62c20925e02aef0d849f92a0e9540888e79ae
# first bad commit: [af1b80ae56c9495999e8ccf7b70ef894378de642] i386/acpi: fix inconsistent QEMU/OVMF device paths

vit9696 Feb. 28, 2021, 9:11 a.m. UTC | #2

Hi Thomas,

For us this breaks the ability to control the boot options between the operating system and the OVMF. It happens because the operating system builds the DPs based on ACPI (in fact the only source available to it), while OVMF uses another source. The previous behaviour also violates the specification, so I do not believe there is room for reverting it. I believe it is also not possible to update QEMU to internally use the 1 UID, since it may conflict with the case when there are multiple PCI bus.

In my opinion, the most logical workaround is to provide in-guest steps to update VM configuration to account for this.

Best regards,
Vitaly

> 27 февр. 2021 г., в 22:41, Thomas Lamprecht <t.lamprecht@proxmox.com> написал(а):

> 

> 

> On 30.07.20 17:58, Michael S. Tsirkin wrote:

>> macOS uses ACPI UIDs to build the DevicePath for NVRAM boot options,

>> while OVMF firmware gets them via an internal channel through QEMU.

>> Due to a bug in QEMU ACPI currently UEFI firmware and ACPI have

>> different values, and this makes the underlying operating system

>> unable to report its boot option.

>> 

>> The particular node in question is the primary PciRoot (PCI0 in ACPI),

>> which for some reason gets assigned 1 in ACPI UID and 0 in the

>> DevicePath. This is due to the _UID assigned to it by build_dsdt in

>> hw/i386/acpi-build.c Which does not correspond to the primary PCI

>> identifier given by pcibus_num in hw/pci/pci.c

>> 

>> Reference with the device paths, OVMF startup logs, and ACPI table

>> dumps (SysReport):

>> https://github.com/acidanthera/bugtracker/issues/1050

>> 

>> In UEFI v2.8, section "10.4.2 Rules with ACPI _HID and _UID" ends with

>> the paragraph,

>> 

>>    Root PCI bridges will use the plug and play ID of PNP0A03, This will

>>    be stored in the ACPI Device Path _HID field, or in the Expanded

>>    ACPI Device Path _CID field to match the ACPI name space. The _UID

>>    in the ACPI Device Path structure must match the _UID in the ACPI

>>    name space.

>> 

>> (See especially the last sentence.)

>> 

>> Considering *extra* root bridges / root buses (with bus number > 0),

>> QEMU's ACPI generator actually does the right thing; since QEMU commit

>> c96d9286a6d7 ("i386/acpi-build: more traditional _UID and _HID for PXB

>> root buses", 2015-06-11).

>> 

>> However, the _UID values for root bridge zero (on both i440fx and q35)

>> have always been "wrong" (from UEFI perspective), going back in QEMU to

>> commit 74523b850189 ("i386: add ACPI table files from seabios",

>> 2013-10-14).

>> 

>> Even in SeaBIOS, these _UID values have always been 1; see commit

>> a4d357638c57 ("Port rombios32 code from bochs-bios.", 2008-03-08) for

>> i440fx, and commit ecbe3fd61511 ("seabios: q35: add dsdt", 2012-12-01)

>> for q35.

>> 

>> Suggested-by: Laszlo Ersek <lersek@redhat.com>

>> Tested-by: vit9696 <vit9696@protonmail.com>

>> Signed-off-by: Michael S. Tsirkin <mst@redhat.com>

>> ---

>> hw/i386/acpi-build.c | 4 ++--

>> 1 file changed, 2 insertions(+), 2 deletions(-)

>> 

>> diff --git a/hw/i386/acpi-build.c b/hw/i386/acpi-build.c

>> index b7bcbbbb2a..7a5a8b3521 100644

>> --- a/hw/i386/acpi-build.c

>> +++ b/hw/i386/acpi-build.c

>> @@ -1497,7 +1497,7 @@ build_dsdt(GArray *table_data, BIOSLinker *linker,

>>         dev = aml_device("PCI0");

>>         aml_append(dev, aml_name_decl("_HID", aml_eisaid("PNP0A03")));

>>         aml_append(dev, aml_name_decl("_ADR", aml_int(0)));

>> -        aml_append(dev, aml_name_decl("_UID", aml_int(1)));

>> +        aml_append(dev, aml_name_decl("_UID", aml_int(0)));

>>         aml_append(sb_scope, dev);

>>         aml_append(dsdt, sb_scope);

>> 

>> @@ -1512,7 +1512,7 @@ build_dsdt(GArray *table_data, BIOSLinker *linker,

>>         aml_append(dev, aml_name_decl("_HID", aml_eisaid("PNP0A08")));

>>         aml_append(dev, aml_name_decl("_CID", aml_eisaid("PNP0A03")));

>>         aml_append(dev, aml_name_decl("_ADR", aml_int(0)));

>> -        aml_append(dev, aml_name_decl("_UID", aml_int(1)));

>> +        aml_append(dev, aml_name_decl("_UID", aml_int(0)));

>>         aml_append(dev, build_q35_osc_method());

>>         aml_append(sb_scope, dev);

>>         aml_append(dsdt, sb_scope);

>> 

> 

> This "breaks" Windows guests created/installed before this change in the sense

> of Windows gets confused and declares that most of the devices changed and thus

> it has new entries for them in the device manager where settings of the old one

> do not apply anymore.

> 

> We were made aware of this by our users when making QEMU 5.2.0 available on

> a more used repository of us. Users complained that their static network

> configuration got thrown out in Windows 2016 or 2019 server VMs, and Windows tried

> to use DHCP (which was not available in their environments) and thus their Windows

> VMs had no network connectivity at all anymore.

> 

> It's currently not yet quite 100% clear to me with what QEMU version the Windows VM

> must be installed with, from reading the patch I have to believe it must be before

> that, but we got mixed reports and a colleague could not replicate it from upgrade

> of 4.0 to 5.2 (I did /not/ confirm that one). Anyway, just writing this all to avoid

> people seeing different results and brushing this off.

> 

> So here's my personal reproducer, as said, I think that one should be able to just

> use QEMU 5.1 to install a Windows guest and start it with 5.2 afterwards to see this

> issue, but YMMV.

> 

> Note. I always used the exact same QEMU command (see below) for installation,

> reproducing and bisect.

> 

> 1. Installed Windows 2016 1616 VM using QEMU 3.0.1

>   - VirtIO net/scsi driver from VirtIO win 190

> 2. Setup static network in the VM and shutdown

> 3. Started VM with 5.2.0 -> Network gone, new "Ethernet #2" adapter shows up instead

> 

> Starting the  "Device Manager" and enabling "View -> Show hidden devices" showed

> me a greyed out device duplicate for basically anything attached, SCSI disk, Basic

> Display Adapter, CDROM device, ..., and the Network device.

> 

> The first difference I could find was the "Device instance path" one can find in

> the "Details" tab of the devices' "Properties" window.

> 

> # old, from initial installation on QEMU 3.0.1

> PCI\VEN_1AF4&DEV_1000&SUBSYS_00011AF4&REV_00\3&13C0B0C5&0&90

> 

> # new, from boot with QEMU 5.2

> PCI\VEN_1AF4&DEV_1000&SUBSYS_00011AF4&REV_00\3&267A616A&0&90

> 

> They match until almost the end, not sure how important that is, but it caught my

> eye (I'm really no windows guy since a decade so please excuse my terrible

> debugging/exploring skills there. The rest of those properties looked pretty

> much identical.

> 

> I then started a bisect, always just restarting the guest with the new QEMU build

> and checking "Device Manager" and network settings to see if good/bad. That worked

> pretty well and I came to this commit. See the bisect log attached at the end of

> this mail.

> 

> So, from reading the commit message I figure that this change is wanted, what are

> the implications of just reverting it? (which works out in bringing back the

> old state in Windows + working static network config again).

> 

> Or any other way/idea to address this in a sane way so that those picky Windows

> guests can be handled more graciously?

> 

> I guess also that there could be more subtle effects from this patch here, the

> network one may have just had quite visible effects to pop up as first issue...

> 

> Thanks if you read so far!

> 

> cheers,

> Thomas

> 

> 

> = QEMU Command =

> 

> (This was generated by our (Proxmox VE) stack, I only cleaned it up a bit to allow

> easier manual running it)

> 

> ./qemu-system-x86_64 \

>  -name win2016 \

>  -chardev 'socket,id=qmp,path=/var/run/qemu-server/11765.qmp,server,nowait' \

>  -mon 'chardev=qmp,mode=control' \

>  -smbios 'type=1,uuid=6324fb28-e98a-44cf-85db-694d1b3405f5' \

>  -smp '2,sockets=1,cores=2,maxcpus=2' \

>  -nodefaults \

>  -boot 'menu=on,strict=on,reboot-timeout=1000' \

>  -vnc unix:/var/run/qemu-server/11765.vnc,password \

>  -no-hpet \

>  -cpu 'host,hv_ipi,hv_relaxed,hv_reset,hv_runtime,hv_spinlocks=0x1fff,hv_stimer,hv_synic,hv_time,hv_vapic,hv_vpindex,+kvm_pv_eoi,+kvm_pv_unhalt,+md-clear,+pcid,+spec-ctrl' \

>  -m 2048 \

>  -device 'pci-bridge,id=pci.1,chassis_nr=1,bus=pci.0,addr=0x1e' \

>  -device 'pci-bridge,id=pci.2,chassis_nr=2,bus=pci.0,addr=0x1f' \

>  -device 'vmgenid,guid=2e56e6ca-2cf8-4f1d-8cc3-9b19a2510c01' \

>  -device 'piix3-usb-uhci,id=uhci,bus=pci.0,addr=0x1.0x2' \

>  -device 'usb-tablet,id=tablet,bus=uhci.0,port=1' \

>  -device 'VGA,id=vga,bus=pci.0,addr=0x2,edid=off' \

>  -chardev 'socket,path=/var/run/qemu-server/11765.qga,server,nowait,id=qga0' \

>  -device 'virtio-serial,id=qga0,bus=pci.0,addr=0x8' \

>  -device 'virtserialport,chardev=qga0,name=org.qemu.guest_agent.0' \

>  -device 'virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x3' \

>  -iscsi 'initiator-name=iqn.1993-08.org.debian:01:468faae9322b' \

>  -drive 'file=/mnt/pve/iso/template/iso/virtio-win-0.1.190.iso,if=none,id=drive-ide0,media=cdrom,aio=threads' \

>  -device 'ide-cd,bus=ide.0,unit=0,drive=drive-ide0,id=ide0,bootindex=200' \

>  -drive 'file=/mnt/pve/iso/template/iso/Win2016-1616-evaluation.ISO,if=none,id=drive-ide2,media=cdrom,aio=threads' \

>  -device 'ide-cd,bus=ide.1,unit=0,drive=drive-ide2,id=ide2,bootindex=201' \

>  -device 'virtio-scsi-pci,id=scsihw0,bus=pci.0,addr=0x5' \

>  -drive 'file=/dev/WDnvme/vm-11765-disk-0,if=none,id=drive-scsi0,format=raw,cache=none,aio=native,detect-zeroes=on' \

>  -device 'scsi-hd,bus=scsihw0.0,channel=0,scsi-id=0,lun=0,drive=drive-scsi0,id=scsi0,rotation_rate=1,bootindex=100' \

>  -netdev 'type=tap,id=net0,ifname=tap11765i0,script=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on' \

>  -device 'virtio-net-pci,mac=02:98:90:43:42:1D,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300' \

>  -rtc 'driftfix=slew,base=localtime' \

>  -machine 'type=pc' \

>  -global 'kvm-pit.lost_tick_policy=discard'

> 

> 

> = bisect log =

> 

> git bisect start

> # bad: [553032db17440f8de011390e5a1cfddd13751b0b] Update version for v5.2.0 release

> git bisect bad 553032db17440f8de011390e5a1cfddd13751b0b

> # good: [d0ed6a69d399ae193959225cdeaa9382746c91cc] Update version for v5.1.0 release

> git bisect good d0ed6a69d399ae193959225cdeaa9382746c91cc

> # bad: [ed799805d00ccdda45eb8441c7d929624d9e98a6] qom: Add kernel-doc markup to introduction doc comment

> git bisect bad ed799805d00ccdda45eb8441c7d929624d9e98a6

> # bad: [e4d8b7c1a95fffcfa4bdab9aa7ffd1cf590cdcf5] Merge remote-tracking branch 'remotes/nvme/tags/pull-nvme-20200902' into staging

> git bisect bad e4d8b7c1a95fffcfa4bdab9aa7ffd1cf590cdcf5

> # bad: [af1dfe1ec0864e6700237a43cc36018176f9eba9] acpi: update expected DSDT files with _UID changes

> git bisect bad af1dfe1ec0864e6700237a43cc36018176f9eba9

> # good: [d7df0ceee0fd2e512cd214a9074ebeeb40da3099] Merge remote-tracking branch 'remotes/philmd-gitlab/tags/sd-next-20200821' into staging

> git bisect good d7df0ceee0fd2e512cd214a9074ebeeb40da3099

> # good: [df82aa7fe10e46b675678977999d49bd586538f8] Merge remote-tracking branch 'remotes/edgar/tags/edgar/xilinx-next-2020-08-24.for-upstream' into staging

> git bisect good df82aa7fe10e46b675678977999d49bd586538f8

> # good: [e39a8320b088dd5efc9ebaafe387e52b3d962665] target/riscv: Support the Virtual Instruction fault

> git bisect good e39a8320b088dd5efc9ebaafe387e52b3d962665

> # good: [a6841a2de66fa44fe52ed996b70f9fb9f7bd6ca7] qcow2: Add subcluster support to qcow2_co_pwrite_zeroes()

> git bisect good a6841a2de66fa44fe52ed996b70f9fb9f7bd6ca7

> # good: [2f8cd515477edab1cbf38ecbdbfa2cac13ce1550] hw/display/artist: Fix invalidation of lines near screen border

> git bisect good 2f8cd515477edab1cbf38ecbdbfa2cac13ce1550

> # good: [a5d3cfa2dc775e5d99f013703b8508f1d989d588] iotests: Add tests for qcow2 images with extended L2 entries

> git bisect good a5d3cfa2dc775e5d99f013703b8508f1d989d588

> # good: [8e49197ca5e76fdb8928833b2649ef13fc5aab2f] Merge remote-tracking branch 'remotes/hdeller/tags/target-hppa-v3-pull-request' into staging

> git bisect good 8e49197ca5e76fdb8928833b2649ef13fc5aab2f

> # bad: [af1b80ae56c9495999e8ccf7b70ef894378de642] i386/acpi: fix inconsistent QEMU/OVMF device paths

> git bisect bad af1b80ae56c9495999e8ccf7b70ef894378de642

> # good: [42a62c20925e02aef0d849f92a0e9540888e79ae] acpi: allow DSDT changes

> git bisect good 42a62c20925e02aef0d849f92a0e9540888e79ae

> # first bad commit: [af1b80ae56c9495999e8ccf7b70ef894378de642] i386/acpi: fix inconsistent QEMU/OVMF device paths
<html><head><meta http-equiv="Content-Type" content="text/html; charset=UTF-8"/></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">Hi Thomas,<div class=""><br class=""/></div><div class="">For us this breaks the ability to control the boot options between the operating system and the OVMF. It happens because the operating system builds the DPs based on ACPI (in fact the only source available to it), while OVMF uses another source. The previous behaviour also violates the specification, so I do not believe there is room for reverting it. I believe it is also not possible to update QEMU to internally use the 1 UID, since it may conflict with the case when there are multiple PCI bus.</div><div class=""><br class=""/></div><div class="">In my opinion, the most logical workaround is to provide in-guest steps to update VM configuration to account for this.</div><div class=""><br class=""/></div><div class="">Best regards,</div><div class="">Vitaly<br class=""/><div><br class=""/><blockquote type="cite" class=""><div class="">27 февр. 2021 г., в 22:41, Thomas Lamprecht &lt;<a href="mailto:t.lamprecht@proxmox.com" class="">t.lamprecht@proxmox.com</a>&gt; написал(а):</div><br class="Apple-interchange-newline"/><div class=""><meta charset="UTF-8" class=""/><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">On 30.07.20 17:58, Michael S. Tsirkin wrote:</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><blockquote type="cite" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; text-decoration: none;" class="">macOS uses ACPI UIDs to build the DevicePath for NVRAM boot options,<br class=""/>while OVMF firmware gets them via an internal channel through QEMU.<br class=""/>Due to a bug in QEMU ACPI currently UEFI firmware and ACPI have<br class=""/>different values, and this makes the underlying operating system<br class=""/>unable to report its boot option.<br class=""/><br class=""/>The particular node in question is the primary PciRoot (PCI0 in ACPI),<br class=""/>which for some reason gets assigned 1 in ACPI UID and 0 in the<br class=""/>DevicePath. This is due to the _UID assigned to it by build_dsdt in<br class=""/>hw/i386/acpi-build.c Which does not correspond to the primary PCI<br class=""/>identifier given by pcibus_num in hw/pci/pci.c<br class=""/><br class=""/>Reference with the device paths, OVMF startup logs, and ACPI table<br class=""/>dumps (SysReport):<br class=""/><a href="https://github.com/acidanthera/bugtracker/issues/1050" class="">https://github.com/acidanthera/bugtracker/issues/1050</a><br class=""/><br class=""/>In UEFI v2.8, section &#34;10.4.2 Rules with ACPI _HID and _UID&#34; ends with<br class=""/>the paragraph,<br class=""/><br class=""/>   Root PCI bridges will use the plug and play ID of PNP0A03, This will<br class=""/>   be stored in the ACPI Device Path _HID field, or in the Expanded<br class=""/>   ACPI Device Path _CID field to match the ACPI name space. The _UID<br class=""/>   in the ACPI Device Path structure must match the _UID in the ACPI<br class=""/>   name space.<br class=""/><br class=""/>(See especially the last sentence.)<br class=""/><br class=""/>Considering *extra* root bridges / root buses (with bus number &gt; 0),<br class=""/>QEMU&#39;s ACPI generator actually does the right thing; since QEMU commit<br class=""/>c96d9286a6d7 (&#34;i386/acpi-build: more traditional _UID and _HID for PXB<br class=""/>root buses&#34;, 2015-06-11).<br class=""/><br class=""/>However, the _UID values for root bridge zero (on both i440fx and q35)<br class=""/>have always been &#34;wrong&#34; (from UEFI perspective), going back in QEMU to<br class=""/>commit 74523b850189 (&#34;i386: add ACPI table files from seabios&#34;,<br class=""/>2013-10-14).<br class=""/><br class=""/>Even in SeaBIOS, these _UID values have always been 1; see commit<br class=""/>a4d357638c57 (&#34;Port rombios32 code from bochs-bios.&#34;, 2008-03-08) for<br class=""/>i440fx, and commit ecbe3fd61511 (&#34;seabios: q35: add dsdt&#34;, 2012-12-01)<br class=""/>for q35.<br class=""/><br class=""/>Suggested-by: Laszlo Ersek &lt;lersek@redhat.com&gt;<br class=""/>Tested-by: vit9696 &lt;vit9696@protonmail.com&gt;<br class=""/>Signed-off-by: Michael S. Tsirkin &lt;mst@redhat.com&gt;<br class=""/>---<br class=""/>hw/i386/acpi-build.c | 4 ++--<br class=""/>1 file changed, 2 insertions(+), 2 deletions(-)<br class=""/><br class=""/>diff --git a/hw/i386/acpi-build.c b/hw/i386/acpi-build.c<br class=""/>index b7bcbbbb2a..7a5a8b3521 100644<br class=""/>--- a/hw/i386/acpi-build.c<br class=""/>+++ b/hw/i386/acpi-build.c<br class=""/>@@ -1497,7 +1497,7 @@ build_dsdt(GArray *table_data, BIOSLinker *linker,<br class=""/>        dev = aml_device(&#34;PCI0&#34;);<br class=""/>        aml_append(dev, aml_name_decl(&#34;_HID&#34;, aml_eisaid(&#34;PNP0A03&#34;)));<br class=""/>        aml_append(dev, aml_name_decl(&#34;_ADR&#34;, aml_int(0)));<br class=""/>-        aml_append(dev, aml_name_decl(&#34;_UID&#34;, aml_int(1)));<br class=""/>+        aml_append(dev, aml_name_decl(&#34;_UID&#34;, aml_int(0)));<br class=""/>        aml_append(sb_scope, dev);<br class=""/>        aml_append(dsdt, sb_scope);<br class=""/><br class=""/>@@ -1512,7 +1512,7 @@ build_dsdt(GArray *table_data, BIOSLinker *linker,<br class=""/>        aml_append(dev, aml_name_decl(&#34;_HID&#34;, aml_eisaid(&#34;PNP0A08&#34;)));<br class=""/>        aml_append(dev, aml_name_decl(&#34;_CID&#34;, aml_eisaid(&#34;PNP0A03&#34;)));<br class=""/>        aml_append(dev, aml_name_decl(&#34;_ADR&#34;, aml_int(0)));<br class=""/>-        aml_append(dev, aml_name_decl(&#34;_UID&#34;, aml_int(1)));<br class=""/>+        aml_append(dev, aml_name_decl(&#34;_UID&#34;, aml_int(0)));<br class=""/>        aml_append(dev, build_q35_osc_method());<br class=""/>        aml_append(sb_scope, dev);<br class=""/>        aml_append(dsdt, sb_scope);<br class=""/><br class=""/></blockquote><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">This &#34;breaks&#34; Windows guests created/installed before this change in the sense</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">of Windows gets confused and declares that most of the devices changed and thus</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">it has new entries for them in the device manager where settings of the old one</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">do not apply anymore.</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">We were made aware of this by our users when making QEMU 5.2.0 available on</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">a more used repository of us. Users complained that their static network</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">configuration got thrown out in Windows 2016 or 2019 server VMs, and Windows tried</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">to use DHCP (which was not available in their environments) and thus their Windows</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">VMs had no network connectivity at all anymore.</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">It&#39;s currently not yet quite 100% clear to me with what QEMU version the Windows VM</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">must be installed with, from reading the patch I have to believe it must be before</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">that, but we got mixed reports and a colleague could not replicate it from upgrade</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">of 4.0 to 5.2 (I did /not/ confirm that one). Anyway, just writing this all to avoid</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">people seeing different results and brushing this off.</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">So here&#39;s my personal reproducer, as said, I think that one should be able to just</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">use QEMU 5.1 to install a Windows guest and start it with 5.2 afterwards to see this</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">issue, but YMMV.</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">Note. I always used the exact same QEMU command (see below) for installation,</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">reproducing and bisect.</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">1. Installed Windows 2016 1616 VM using QEMU 3.0.1</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">  - VirtIO net/scsi driver from VirtIO win 190</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">2. Setup static network in the VM and shutdown</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">3. Started VM with 5.2.0 -&gt; Network gone, new &#34;Ethernet #2&#34; adapter shows up instead</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">Starting the  &#34;Device Manager&#34; and enabling &#34;View -&gt; Show hidden devices&#34; showed</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">me a greyed out device duplicate for basically anything attached, SCSI disk, Basic</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">Display Adapter, CDROM device, ..., and the Network device.</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">The first difference I could find was the &#34;Device instance path&#34; one can find in</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">the &#34;Details&#34; tab of the devices&#39; &#34;Properties&#34; window.</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""># old, from initial installation on QEMU 3.0.1</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">PCI\VEN_1AF4&amp;DEV_1000&amp;SUBSYS_00011AF4&amp;REV_00\3&amp;13C0B0C5&amp;0&amp;90</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""># new, from boot with QEMU 5.2</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">PCI\VEN_1AF4&amp;DEV_1000&amp;SUBSYS_00011AF4&amp;REV_00\3&amp;267A616A&amp;0&amp;90</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">They match until almost the end, not sure how important that is, but it caught my</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">eye (I&#39;m really no windows guy since a decade so please excuse my terrible</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">debugging/exploring skills there. The rest of those properties looked pretty</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">much identical.</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">I then started a bisect, always just restarting the guest with the new QEMU build</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">and checking &#34;Device Manager&#34; and network settings to see if good/bad. That worked</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">pretty well and I came to this commit. See the bisect log attached at the end of</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">this mail.</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">So, from reading the commit message I figure that this change is wanted, what are</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">the implications of just reverting it? (which works out in bringing back the</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">old state in Windows + working static network config again).</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">Or any other way/idea to address this in a sane way so that those picky Windows</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">guests can be handled more graciously?</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">I guess also that there could be more subtle effects from this patch here, the</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">network one may have just had quite visible effects to pop up as first issue...</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">Thanks if you read so far!</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">cheers,</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">Thomas</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">= QEMU Command =</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">(This was generated by our (Proxmox VE) stack, I only cleaned it up a bit to allow</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">easier manual running it)</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">./qemu-system-x86_64 \</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""> -name win2016 \</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""> -chardev &#39;socket,id=qmp,path=/var/run/qemu-server/11765.qmp,server,nowait&#39; \</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""> -mon &#39;chardev=qmp,mode=control&#39; \</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""> -smbios &#39;type=1,uuid=6324fb28-e98a-44cf-85db-694d1b3405f5&#39; \</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""> -smp &#39;2,sockets=1,cores=2,maxcpus=2&#39; \</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""> -nodefaults \</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""> -boot &#39;menu=on,strict=on,reboot-timeout=1000&#39; \</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""> -vnc unix:/var/run/qemu-server/11765.vnc,password \</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""> -no-hpet \</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""> -cpu &#39;host,hv_ipi,hv_relaxed,hv_reset,hv_runtime,hv_spinlocks=0x1fff,hv_stimer,hv_synic,hv_time,hv_vapic,hv_vpindex,+kvm_pv_eoi,+kvm_pv_unhalt,+md-clear,+pcid,+spec-ctrl&#39; \</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""> -m 2048 \</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""> -device &#39;pci-bridge,id=pci.1,chassis_nr=1,bus=pci.0,addr=0x1e&#39; \</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""> -device &#39;pci-bridge,id=pci.2,chassis_nr=2,bus=pci.0,addr=0x1f&#39; \</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""> -device &#39;vmgenid,guid=2e56e6ca-2cf8-4f1d-8cc3-9b19a2510c01&#39; \</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""> -device &#39;piix3-usb-uhci,id=uhci,bus=pci.0,addr=0x1.0x2&#39; \</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""> -device &#39;usb-tablet,id=tablet,bus=uhci.0,port=1&#39; \</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""> -device &#39;VGA,id=vga,bus=pci.0,addr=0x2,edid=off&#39; \</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""> -chardev &#39;socket,path=/var/run/qemu-server/11765.qga,server,nowait,id=qga0&#39; \</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""> -device &#39;virtio-serial,id=qga0,bus=pci.0,addr=0x8&#39; \</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""> -device &#39;virtserialport,chardev=qga0,name=org.qemu.guest_agent.0&#39; \</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""> -device &#39;virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x3&#39; \</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""> -iscsi &#39;initiator-name=iqn.1993-08.org.debian:01:468faae9322b&#39; \</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""> -drive &#39;file=/mnt/pve/iso/template/iso/virtio-win-0.1.190.iso,if=none,id=drive-ide0,media=cdrom,aio=threads&#39; \</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""> -device &#39;ide-cd,bus=ide.0,unit=0,drive=drive-ide0,id=ide0,bootindex=200&#39; \</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""> -drive &#39;file=/mnt/pve/iso/template/iso/Win2016-1616-evaluation.ISO,if=none,id=drive-ide2,media=cdrom,aio=threads&#39; \</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""> -device &#39;ide-cd,bus=ide.1,unit=0,drive=drive-ide2,id=ide2,bootindex=201&#39; \</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""> -device &#39;virtio-scsi-pci,id=scsihw0,bus=pci.0,addr=0x5&#39; \</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""> -drive &#39;file=/dev/WDnvme/vm-11765-disk-0,if=none,id=drive-scsi0,format=raw,cache=none,aio=native,detect-zeroes=on&#39; \</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""> -device &#39;scsi-hd,bus=scsihw0.0,channel=0,scsi-id=0,lun=0,drive=drive-scsi0,id=scsi0,rotation_rate=1,bootindex=100&#39; \</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""> -netdev &#39;type=tap,id=net0,ifname=tap11765i0,script=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on&#39; \</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""> -device &#39;virtio-net-pci,mac=02:98:90:43:42:1D,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300&#39; \</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""> -rtc &#39;driftfix=slew,base=localtime&#39; \</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""> -machine &#39;type=pc&#39; \</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""> -global &#39;kvm-pit.lost_tick_policy=discard&#39;</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">= bisect log =</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">git bisect start</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""># bad: [553032db17440f8de011390e5a1cfddd13751b0b] Update version for v5.2.0 release</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">git bisect bad 553032db17440f8de011390e5a1cfddd13751b0b</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""># good: [d0ed6a69d399ae193959225cdeaa9382746c91cc] Update version for v5.1.0 release</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">git bisect good d0ed6a69d399ae193959225cdeaa9382746c91cc</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""># bad: [ed799805d00ccdda45eb8441c7d929624d9e98a6] qom: Add kernel-doc markup to introduction doc comment</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">git bisect bad ed799805d00ccdda45eb8441c7d929624d9e98a6</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""># bad: [e4d8b7c1a95fffcfa4bdab9aa7ffd1cf590cdcf5] Merge remote-tracking branch &#39;remotes/nvme/tags/pull-nvme-20200902&#39; into staging</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">git bisect bad e4d8b7c1a95fffcfa4bdab9aa7ffd1cf590cdcf5</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""># bad: [af1dfe1ec0864e6700237a43cc36018176f9eba9] acpi: update expected DSDT files with _UID changes</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">git bisect bad af1dfe1ec0864e6700237a43cc36018176f9eba9</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""># good: [d7df0ceee0fd2e512cd214a9074ebeeb40da3099] Merge remote-tracking branch &#39;remotes/philmd-gitlab/tags/sd-next-20200821&#39; into staging</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">git bisect good d7df0ceee0fd2e512cd214a9074ebeeb40da3099</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""># good: [df82aa7fe10e46b675678977999d49bd586538f8] Merge remote-tracking branch &#39;remotes/edgar/tags/edgar/xilinx-next-2020-08-24.for-upstream&#39; into staging</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">git bisect good df82aa7fe10e46b675678977999d49bd586538f8</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""># good: [e39a8320b088dd5efc9ebaafe387e52b3d962665] target/riscv: Support the Virtual Instruction fault</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">git bisect good e39a8320b088dd5efc9ebaafe387e52b3d962665</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""># good: [a6841a2de66fa44fe52ed996b70f9fb9f7bd6ca7] qcow2: Add subcluster support to qcow2_co_pwrite_zeroes()</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">git bisect good a6841a2de66fa44fe52ed996b70f9fb9f7bd6ca7</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""># good: [2f8cd515477edab1cbf38ecbdbfa2cac13ce1550] hw/display/artist: Fix invalidation of lines near screen border</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">git bisect good 2f8cd515477edab1cbf38ecbdbfa2cac13ce1550</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""># good: [a5d3cfa2dc775e5d99f013703b8508f1d989d588] iotests: Add tests for qcow2 images with extended L2 entries</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">git bisect good a5d3cfa2dc775e5d99f013703b8508f1d989d588</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""># good: [8e49197ca5e76fdb8928833b2649ef13fc5aab2f] Merge remote-tracking branch &#39;remotes/hdeller/tags/target-hppa-v3-pull-request&#39; into staging</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">git bisect good 8e49197ca5e76fdb8928833b2649ef13fc5aab2f</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""># bad: [af1b80ae56c9495999e8ccf7b70ef894378de642] i386/acpi: fix inconsistent QEMU/OVMF device paths</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">git bisect bad af1b80ae56c9495999e8ccf7b70ef894378de642</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""># good: [42a62c20925e02aef0d849f92a0e9540888e79ae] acpi: allow DSDT changes</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">git bisect good 42a62c20925e02aef0d849f92a0e9540888e79ae</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""/><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""># first bad commit: [af1b80ae56c9495999e8ccf7b70ef894378de642] i386/acpi: fix inconsistent QEMU/OVMF device paths</span></div></blockquote></div><br class=""/></div></body></html>

Thomas Lamprecht Feb. 28, 2021, 10:43 a.m. UTC | #3

Hi Vitaly,

On 28.02.21 10:11, vit9696 wrote:
> For us this breaks the ability to control the boot options between the operating system and the OVMF. It happens because the operating system builds the DPs based on ACPI (in fact the only source available to it), while OVMF uses another source. The previous behaviour also violates the specification, so I do not believe there is room for reverting it. I believe it is also not possible to update QEMU to internally use the 1 UID, since it may conflict with the case when there are multiple PCI bus.

I think you may have misunderstood me a little bit, I did not ask for this to
be reverted in upstream QEMU, it's quite clear to me that this should be the
new default behaviour and should have been since ever.

Albeit, I must ask what makes macOS special to not be allowed doing things that
Windows and Linux guest can do just fine?

I mainly asked for other drawbacks of such a revert as it is currently the
straight forward stop gap solution for us as downstream. What we probably will
do, is keeping this as default to the new standard behavior and adding a switch
to revert to the old one - our QEMU integration library in Proxmox VE can then
set this for old VMs and use the new standard for new ones on VM start, that
way we keep backward compatible - as only Windows VMs seems to be affected we
can even do this only for those (we have a OS type config property from which
we can derive this).

>

> In my opinion, the most logical workaround is to provide in-guest steps to update VM configuration to account for this.

Often the Hypervisor admin and Guest admin are not the same, so this is only
a small band-aid and for most helping only after the fact.

We also have quite easy to setup clustering so this means that such affected
VMs will seemingly break on migration to an update node for lots of users - for
us an unacceptable situation to expose our users with and honestly, I have a
hard time seeing me and colleagues to wish spending our nerves to direct
hundreds of reports to the documented solution (some will certainly find it on
their own, but whatever one does, lots won't) and dealing with their,
relatable, fit they'll throw and me having to hold back telling them off to
just use Linux instead ;-)

And I think that other integrator will get some reports too, and FWICT there's
no outside way an user can use to revert to the old behavior.
Note that QEMU 5.2 is not yet released in some major distributions, e.g.,
Debian will ship it with Bullseye which release is still months away, latest
Fedora (33) is shipping QEMU 5.1, so RHEL/CentOS are probably using something
even older and Ubuntu will only add it in 21.04, also two months away.

Currently, QEMU 5.2 which introduces this change, is only released in some is
released in faster moving targets, where Windows VMs are more often for
non-server workloads (educated guess) which again correlates with higher
probability to use of DHCP and not static address assignment (again, educated
guess) - which is the most obvious and noticeable thing we and our users saw
break.

Which brings me again to my other point, there may be lots of other things
breaking in a more subtle way, we do not know but can tell there's lots of
device reshuffling going on when checking out the Windows Device Manager I
cannot immagine that the loss of network configuration is the only thing that
breaks is the only thing that breaks.

So why all this fuss and wall of text? Because I think that this will affect
lots of users, most of them in distros which will only ship the problematic
QEMU version later this year. How many affected there will be: no idea, but we
got quite some reports (compared to usual small stuff breakage) with only
rolling this QEMU version out *partially*, to only some parts of our user base.

That's why I personally think it may be worth to think about adding a switch to
QEMU directly to keep the backwards compatible, albeit standard incompatible
behavior either as opt-in or opt-out to new standard-conform behavior. And
while I thought opt-out is the way to go when starting out this message, I now
rather think opt-in to new is, at least if rustling bells of users with
Windows + static IPs is thought to be worth to avoid. As said, if there's quorum
against this, we can live fine with keeping that switch as downstream patch but
I'd like to avoid that and certainly won't just rush forward shipping it but
wait until next week, maybe there are some other opinions or better ideas.

cheers,
Thomas

Michael S. Tsirkin Feb. 28, 2021, 8:43 p.m. UTC | #4

On Sat, Feb 27, 2021 at 08:41:11PM +0100, Thomas Lamprecht wrote:
> On 30.07.20 17:58, Michael S. Tsirkin wrote:

> > macOS uses ACPI UIDs to build the DevicePath for NVRAM boot options,

> > while OVMF firmware gets them via an internal channel through QEMU.

> > Due to a bug in QEMU ACPI currently UEFI firmware and ACPI have

> > different values, and this makes the underlying operating system

> > unable to report its boot option.

> > 

> > The particular node in question is the primary PciRoot (PCI0 in ACPI),

> > which for some reason gets assigned 1 in ACPI UID and 0 in the

> > DevicePath. This is due to the _UID assigned to it by build_dsdt in

> > hw/i386/acpi-build.c Which does not correspond to the primary PCI

> > identifier given by pcibus_num in hw/pci/pci.c

> > 

> > Reference with the device paths, OVMF startup logs, and ACPI table

> > dumps (SysReport):

> > https://github.com/acidanthera/bugtracker/issues/1050

> > 

> > In UEFI v2.8, section "10.4.2 Rules with ACPI _HID and _UID" ends with

> > the paragraph,

> > 

> >     Root PCI bridges will use the plug and play ID of PNP0A03, This will

> >     be stored in the ACPI Device Path _HID field, or in the Expanded

> >     ACPI Device Path _CID field to match the ACPI name space. The _UID

> >     in the ACPI Device Path structure must match the _UID in the ACPI

> >     name space.

> > 

> > (See especially the last sentence.)

> > 

> > Considering *extra* root bridges / root buses (with bus number > 0),

> > QEMU's ACPI generator actually does the right thing; since QEMU commit

> > c96d9286a6d7 ("i386/acpi-build: more traditional _UID and _HID for PXB

> > root buses", 2015-06-11).

> > 

> > However, the _UID values for root bridge zero (on both i440fx and q35)

> > have always been "wrong" (from UEFI perspective), going back in QEMU to

> > commit 74523b850189 ("i386: add ACPI table files from seabios",

> > 2013-10-14).

> > 

> > Even in SeaBIOS, these _UID values have always been 1; see commit

> > a4d357638c57 ("Port rombios32 code from bochs-bios.", 2008-03-08) for

> > i440fx, and commit ecbe3fd61511 ("seabios: q35: add dsdt", 2012-12-01)

> > for q35.

> > 

> > Suggested-by: Laszlo Ersek <lersek@redhat.com>

> > Tested-by: vit9696 <vit9696@protonmail.com>

> > Signed-off-by: Michael S. Tsirkin <mst@redhat.com>

> > ---

> >  hw/i386/acpi-build.c | 4 ++--

> >  1 file changed, 2 insertions(+), 2 deletions(-)

> > 

> > diff --git a/hw/i386/acpi-build.c b/hw/i386/acpi-build.c

> > index b7bcbbbb2a..7a5a8b3521 100644

> > --- a/hw/i386/acpi-build.c

> > +++ b/hw/i386/acpi-build.c

> > @@ -1497,7 +1497,7 @@ build_dsdt(GArray *table_data, BIOSLinker *linker,

> >          dev = aml_device("PCI0");

> >          aml_append(dev, aml_name_decl("_HID", aml_eisaid("PNP0A03")));

> >          aml_append(dev, aml_name_decl("_ADR", aml_int(0)));

> > -        aml_append(dev, aml_name_decl("_UID", aml_int(1)));

> > +        aml_append(dev, aml_name_decl("_UID", aml_int(0)));

> >          aml_append(sb_scope, dev);

> >          aml_append(dsdt, sb_scope);

> >  

> > @@ -1512,7 +1512,7 @@ build_dsdt(GArray *table_data, BIOSLinker *linker,

> >          aml_append(dev, aml_name_decl("_HID", aml_eisaid("PNP0A08")));

> >          aml_append(dev, aml_name_decl("_CID", aml_eisaid("PNP0A03")));

> >          aml_append(dev, aml_name_decl("_ADR", aml_int(0)));

> > -        aml_append(dev, aml_name_decl("_UID", aml_int(1)));

> > +        aml_append(dev, aml_name_decl("_UID", aml_int(0)));

> >          aml_append(dev, build_q35_osc_method());

> >          aml_append(sb_scope, dev);

> >          aml_append(dsdt, sb_scope);

> > 

> 

> This "breaks" Windows guests created/installed before this change in the sense

> of Windows gets confused and declares that most of the devices changed and thus

> it has new entries for them in the device manager where settings of the old one

> do not apply anymore.

> 

> We were made aware of this by our users when making QEMU 5.2.0 available on

> a more used repository of us. Users complained that their static network

> configuration got thrown out in Windows 2016 or 2019 server VMs, and Windows tried

> to use DHCP (which was not available in their environments) and thus their Windows

> VMs had no network connectivity at all anymore.

> 

> It's currently not yet quite 100% clear to me with what QEMU version the Windows VM

> must be installed with, from reading the patch I have to believe it must be before

> that, but we got mixed reports and a colleague could not replicate it from upgrade

> of 4.0 to 5.2 (I did /not/ confirm that one). Anyway, just writing this all to avoid

> people seeing different results and brushing this off.

> 

> So here's my personal reproducer, as said, I think that one should be able to just

> use QEMU 5.1 to install a Windows guest and start it with 5.2 afterwards to see this

> issue, but YMMV.

> 

> Note. I always used the exact same QEMU command (see below) for installation,

> reproducing and bisect.

> 

> 1. Installed Windows 2016 1616 VM using QEMU 3.0.1

>    - VirtIO net/scsi driver from VirtIO win 190

> 2. Setup static network in the VM and shutdown

> 3. Started VM with 5.2.0 -> Network gone, new "Ethernet #2" adapter shows up instead

> 

> Starting the  "Device Manager" and enabling "View -> Show hidden devices" showed

> me a greyed out device duplicate for basically anything attached, SCSI disk, Basic

> Display Adapter, CDROM device, ..., and the Network device.

> 

> The first difference I could find was the "Device instance path" one can find in

> the "Details" tab of the devices' "Properties" window.

> 

> # old, from initial installation on QEMU 3.0.1

> PCI\VEN_1AF4&DEV_1000&SUBSYS_00011AF4&REV_00\3&13C0B0C5&0&90

> 

> # new, from boot with QEMU 5.2

> PCI\VEN_1AF4&DEV_1000&SUBSYS_00011AF4&REV_00\3&267A616A&0&90

> 

> They match until almost the end, not sure how important that is, but it caught my

> eye (I'm really no windows guy since a decade so please excuse my terrible

> debugging/exploring skills there. The rest of those properties looked pretty

> much identical.

> 

> I then started a bisect, always just restarting the guest with the new QEMU build

> and checking "Device Manager" and network settings to see if good/bad. That worked

> pretty well and I came to this commit. See the bisect log attached at the end of

> this mail.

> 

> So, from reading the commit message I figure that this change is wanted, what are

> the implications of just reverting it? (which works out in bringing back the

> old state in Windows + working static network config again).

> 

> Or any other way/idea to address this in a sane way so that those picky Windows

> guests can be handled more graciously?


Sure. The way to do that is to tie old behaviour to old machine
versions. We'll need it in stable too ...

Igor want to cook up a patch?


> I guess also that there could be more subtle effects from this patch here, the

> network one may have just had quite visible effects to pop up as first issue...

> 

> Thanks if you read so far!

> 

> cheers,

> Thomas

> 

> 

> = QEMU Command =

> 

> (This was generated by our (Proxmox VE) stack, I only cleaned it up a bit to allow

> easier manual running it)

> 

> ./qemu-system-x86_64 \

>   -name win2016 \

>   -chardev 'socket,id=qmp,path=/var/run/qemu-server/11765.qmp,server,nowait' \

>   -mon 'chardev=qmp,mode=control' \

>   -smbios 'type=1,uuid=6324fb28-e98a-44cf-85db-694d1b3405f5' \

>   -smp '2,sockets=1,cores=2,maxcpus=2' \

>   -nodefaults \

>   -boot 'menu=on,strict=on,reboot-timeout=1000' \

>   -vnc unix:/var/run/qemu-server/11765.vnc,password \

>   -no-hpet \

>   -cpu 'host,hv_ipi,hv_relaxed,hv_reset,hv_runtime,hv_spinlocks=0x1fff,hv_stimer,hv_synic,hv_time,hv_vapic,hv_vpindex,+kvm_pv_eoi,+kvm_pv_unhalt,+md-clear,+pcid,+spec-ctrl' \

>   -m 2048 \

>   -device 'pci-bridge,id=pci.1,chassis_nr=1,bus=pci.0,addr=0x1e' \

>   -device 'pci-bridge,id=pci.2,chassis_nr=2,bus=pci.0,addr=0x1f' \

>   -device 'vmgenid,guid=2e56e6ca-2cf8-4f1d-8cc3-9b19a2510c01' \

>   -device 'piix3-usb-uhci,id=uhci,bus=pci.0,addr=0x1.0x2' \

>   -device 'usb-tablet,id=tablet,bus=uhci.0,port=1' \

>   -device 'VGA,id=vga,bus=pci.0,addr=0x2,edid=off' \

>   -chardev 'socket,path=/var/run/qemu-server/11765.qga,server,nowait,id=qga0' \

>   -device 'virtio-serial,id=qga0,bus=pci.0,addr=0x8' \

>   -device 'virtserialport,chardev=qga0,name=org.qemu.guest_agent.0' \

>   -device 'virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x3' \

>   -iscsi 'initiator-name=iqn.1993-08.org.debian:01:468faae9322b' \

>   -drive 'file=/mnt/pve/iso/template/iso/virtio-win-0.1.190.iso,if=none,id=drive-ide0,media=cdrom,aio=threads' \

>   -device 'ide-cd,bus=ide.0,unit=0,drive=drive-ide0,id=ide0,bootindex=200' \

>   -drive 'file=/mnt/pve/iso/template/iso/Win2016-1616-evaluation.ISO,if=none,id=drive-ide2,media=cdrom,aio=threads' \

>   -device 'ide-cd,bus=ide.1,unit=0,drive=drive-ide2,id=ide2,bootindex=201' \

>   -device 'virtio-scsi-pci,id=scsihw0,bus=pci.0,addr=0x5' \

>   -drive 'file=/dev/WDnvme/vm-11765-disk-0,if=none,id=drive-scsi0,format=raw,cache=none,aio=native,detect-zeroes=on' \

>   -device 'scsi-hd,bus=scsihw0.0,channel=0,scsi-id=0,lun=0,drive=drive-scsi0,id=scsi0,rotation_rate=1,bootindex=100' \

>   -netdev 'type=tap,id=net0,ifname=tap11765i0,script=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on' \

>   -device 'virtio-net-pci,mac=02:98:90:43:42:1D,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300' \

>   -rtc 'driftfix=slew,base=localtime' \

>   -machine 'type=pc' \

>   -global 'kvm-pit.lost_tick_policy=discard'

> 

> 

> = bisect log =

> 

> git bisect start

> # bad: [553032db17440f8de011390e5a1cfddd13751b0b] Update version for v5.2.0 release

> git bisect bad 553032db17440f8de011390e5a1cfddd13751b0b

> # good: [d0ed6a69d399ae193959225cdeaa9382746c91cc] Update version for v5.1.0 release

> git bisect good d0ed6a69d399ae193959225cdeaa9382746c91cc

> # bad: [ed799805d00ccdda45eb8441c7d929624d9e98a6] qom: Add kernel-doc markup to introduction doc comment

> git bisect bad ed799805d00ccdda45eb8441c7d929624d9e98a6

> # bad: [e4d8b7c1a95fffcfa4bdab9aa7ffd1cf590cdcf5] Merge remote-tracking branch 'remotes/nvme/tags/pull-nvme-20200902' into staging

> git bisect bad e4d8b7c1a95fffcfa4bdab9aa7ffd1cf590cdcf5

> # bad: [af1dfe1ec0864e6700237a43cc36018176f9eba9] acpi: update expected DSDT files with _UID changes

> git bisect bad af1dfe1ec0864e6700237a43cc36018176f9eba9

> # good: [d7df0ceee0fd2e512cd214a9074ebeeb40da3099] Merge remote-tracking branch 'remotes/philmd-gitlab/tags/sd-next-20200821' into staging

> git bisect good d7df0ceee0fd2e512cd214a9074ebeeb40da3099

> # good: [df82aa7fe10e46b675678977999d49bd586538f8] Merge remote-tracking branch 'remotes/edgar/tags/edgar/xilinx-next-2020-08-24.for-upstream' into staging

> git bisect good df82aa7fe10e46b675678977999d49bd586538f8

> # good: [e39a8320b088dd5efc9ebaafe387e52b3d962665] target/riscv: Support the Virtual Instruction fault

> git bisect good e39a8320b088dd5efc9ebaafe387e52b3d962665

> # good: [a6841a2de66fa44fe52ed996b70f9fb9f7bd6ca7] qcow2: Add subcluster support to qcow2_co_pwrite_zeroes()

> git bisect good a6841a2de66fa44fe52ed996b70f9fb9f7bd6ca7

> # good: [2f8cd515477edab1cbf38ecbdbfa2cac13ce1550] hw/display/artist: Fix invalidation of lines near screen border

> git bisect good 2f8cd515477edab1cbf38ecbdbfa2cac13ce1550

> # good: [a5d3cfa2dc775e5d99f013703b8508f1d989d588] iotests: Add tests for qcow2 images with extended L2 entries

> git bisect good a5d3cfa2dc775e5d99f013703b8508f1d989d588

> # good: [8e49197ca5e76fdb8928833b2649ef13fc5aab2f] Merge remote-tracking branch 'remotes/hdeller/tags/target-hppa-v3-pull-request' into staging

> git bisect good 8e49197ca5e76fdb8928833b2649ef13fc5aab2f

> # bad: [af1b80ae56c9495999e8ccf7b70ef894378de642] i386/acpi: fix inconsistent QEMU/OVMF device paths

> git bisect bad af1b80ae56c9495999e8ccf7b70ef894378de642

> # good: [42a62c20925e02aef0d849f92a0e9540888e79ae] acpi: allow DSDT changes

> git bisect good 42a62c20925e02aef0d849f92a0e9540888e79ae

> # first bad commit: [af1b80ae56c9495999e8ccf7b70ef894378de642] i386/acpi: fix inconsistent QEMU/OVMF device paths

Michael S. Tsirkin Feb. 28, 2021, 8:45 p.m. UTC | #5

On Sun, Feb 28, 2021 at 11:43:55AM +0100, Thomas Lamprecht wrote:
> Hi Vitaly,

> 

> On 28.02.21 10:11, vit9696 wrote:

> > For us this breaks the ability to control the boot options between the operating system and the OVMF. It happens because the operating system builds the DPs based on ACPI (in fact the only source available to it), while OVMF uses another source. The previous behaviour also violates the specification, so I do not believe there is room for reverting it. I believe it is also not possible to update QEMU to internally use the 1 UID, since it may conflict with the case when there are multiple PCI bus.

> 

> I think you may have misunderstood me a little bit, I did not ask for this to

> be reverted in upstream QEMU, it's quite clear to me that this should be the

> new default behaviour and should have been since ever.


We do make an effort to avoid guest visible changes within machine
version though. this is what we should do here I think.

-- 
MST

Xingtao Yao (Fujitsu)" via Feb. 28, 2021, 9:28 p.m. UTC | #6

<html><head></head><body>    <div>Thomas,&nbsp;macOS is not really "special" here, it is rather that you will not frequently use boot options in a VM. One of the most popular uses for boot options is to switch between the operating systems, but for virtual machines it&nbsp;is rarely&nbsp;the case. However, macOS does indeed&nbsp;use boot options for itself. One example is to install updates. As long as the created boot option is not valid an automated reboot during the update installation may result in the wrong bootloader being chosen or in&nbsp;a stall within<caret></caret> the firmware UI awaiting manual boot option selection.</div><div><br></div><div>Michael, does your suggestion mean that the default approach will be to keep the new behaviour, but if you manually specify an older q35 machine version it will provide the original behaviour. If so, it seems fair to me.</div><div><br></div><div>Best regards,</div><div>Vitaly<br><div><br></div>On Sun, Feb 28, 2021 at 13:43, Thomas Lamprecht &lt;<a href="mailto:t.lamprecht@proxmox.com" class="">t.lamprecht@proxmox.com</a>&gt; wrote:<blockquote class="protonmail_quote" type="cite">  Hi Vitaly,<br><br>On 28.02.21 10:11, vit9696 wrote:<br>&gt; For us this breaks the ability to control the boot options between the operating system and the OVMF. It happens because the operating system builds the DPs based on ACPI (in fact the only source available to it), while OVMF uses another source. The previous behaviour also violates the specification, so I do not believe there is room for reverting it. I believe it is also not possible to update QEMU to internally use the 1 UID, since it may conflict with the case when there are multiple PCI bus.<br><br>I think you may have misunderstood me a little bit, I did not ask for this to<br>be reverted in upstream QEMU, it's quite clear to me that this should be the<br>new default behaviour and should have been since ever.<br><br>Albeit, I must ask what makes macOS special to not be allowed doing things that<br>Windows and Linux guest can do just fine?<br><br>I mainly asked for other drawbacks of such a revert as it is currently the<br>straight forward stop gap solution for us as downstream. What we probably will<br>do, is keeping this as default to the new standard behavior and adding a switch<br>to revert to the old one - our QEMU integration library in Proxmox VE can then<br>set this for old VMs and use the new standard for new ones on VM start, that<br>way we keep backward compatible - as only Windows VMs seems to be affected we<br>can even do this only for those (we have a OS type config property from which<br>we can derive this).<br><br>&gt;<br>&gt; In my opinion, the most logical workaround is to provide in-guest steps to update VM configuration to account for this.<br><br>Often the Hypervisor admin and Guest admin are not the same, so this is only<br>a small band-aid and for most helping only after the fact.<br><br>We also have quite easy to setup clustering so this means that such affected<br>VMs will seemingly break on migration to an update node for lots of users - for<br>us an unacceptable situation to expose our users with and honestly, I have a<br>hard time seeing me and colleagues to wish spending our nerves to direct<br>hundreds of reports to the documented solution (some will certainly find it on<br>their own, but whatever one does, lots won't) and dealing with their,<br>relatable, fit they'll throw and me having to hold back telling them off to<br>just use Linux instead ;-)<br><br>And I think that other integrator will get some reports too, and FWICT there's<br>no outside way an user can use to revert to the old behavior.<br>Note that QEMU 5.2 is not yet released in some major distributions, e.g.,<br>Debian will ship it with Bullseye which release is still months away, latest<br>Fedora (33) is shipping QEMU 5.1, so RHEL/CentOS are probably using something<br>even older and Ubuntu will only add it in 21.04, also two months away.<br><br>Currently, QEMU 5.2 which introduces this change, is only released in some is<br>released in faster moving targets, where Windows VMs are more often for<br>non-server workloads (educated guess) which again correlates with higher<br>probability to use of DHCP and not static address assignment (again, educated<br>guess) - which is the most obvious and noticeable thing we and our users saw<br>break.<br><br>Which brings me again to my other point, there may be lots of other things<br>breaking in a more subtle way, we do not know but can tell there's lots of<br>device reshuffling going on when checking out the Windows Device Manager I<br>cannot immagine that the loss of network configuration is the only thing that<br>breaks is the only thing that breaks.<br><br>So why all this fuss and wall of text? Because I think that this will affect<br>lots of users, most of them in distros which will only ship the problematic<br>QEMU version later this year. How many affected there will be: no idea, but we<br>got quite some reports (compared to usual small stuff breakage) with only<br>rolling this QEMU version out *partially*, to only some parts of our user base.<br><br>That's why I personally think it may be worth to think about adding a switch to<br>QEMU directly to keep the backwards compatible, albeit standard incompatible<br>behavior either as opt-in or opt-out to new standard-conform behavior. And<br>while I thought opt-out is the way to go when starting out this message, I now<br>rather think opt-in to new is, at least if rustling bells of users with<br>Windows + static IPs is thought to be worth to avoid. As said, if there's quorum<br>against this, we can live fine with keeping that switch as downstream patch but<br>I'd like to avoid that and certainly won't just rush forward shipping it but<br>wait until next week, maybe there are some other opinions or better ideas.<br><br>cheers,<br>Thomas<br><br></blockquote><div><br></div><div><br></div></div></body></html>

Michael S. Tsirkin Feb. 28, 2021, 9:37 p.m. UTC | #7

On Sun, Feb 28, 2021 at 09:28:26PM +0000, vit9696 wrote:
> Thomas, macOS is not really "special" here, it is rather that you will not

> frequently use boot options in a VM. One of the most popular uses for boot

> options is to switch between the operating systems, but for virtual machines

> it is rarely the case. However, macOS does indeed use boot options for itself.

> One example is to install updates. As long as the created boot option is not

> valid an automated reboot during the update installation may result in the

> wrong bootloader being chosen or in a stall within the firmware UI awaiting

> manual boot option selection.

> 

> Michael, does your suggestion mean that the default approach will be to keep

> the new behaviour, but if you manually specify an older q35 machine version it

> will provide the original behaviour. If so, it seems fair to me.

> 

> Best regards,

> Vitaly


Exactly. Vitaly, could you cook up a patch like this?

-- 
MST

Xingtao Yao (Fujitsu)" via Feb. 28, 2021, 9:52 p.m. UTC | #8

<html><head></head><body>    <div>I am afraid I may not be available for this till the next weekend, but if the time permits then, I can have a look. Actually have another patch to upstream.<caret></caret></div><div><br></div>On Mon, Mar 1, 2021 at 00:37, Michael S. Tsirkin &lt;<a href="mailto:mst@redhat.com" class="">mst@redhat.com</a>&gt; wrote:<blockquote class="protonmail_quote" type="cite">  On Sun, Feb 28, 2021 at 09:28:26PM +0000, vit9696 wrote:<br>&gt; Thomas, macOS is not really "special" here, it is rather that you will not<br>&gt; frequently use boot options in a VM. One of the most popular uses for boot<br>&gt; options is to switch between the operating systems, but for virtual machines<br>&gt; it is rarely the case. However, macOS does indeed use boot options for itself.<br>&gt; One example is to install updates. As long as the created boot option is not<br>&gt; valid an automated reboot during the update installation may result in the<br>&gt; wrong bootloader being chosen or in a stall within the firmware UI awaiting<br>&gt; manual boot option selection.<br>&gt;<br>&gt; Michael, does your suggestion mean that the default approach will be to keep<br>&gt; the new behaviour, but if you manually specify an older q35 machine version it<br>&gt; will provide the original behaviour. If so, it seems fair to me.<br>&gt;<br>&gt; Best regards,<br>&gt; Vitaly<br><br>Exactly. Vitaly, could you cook up a patch like this?<br><br>--<br>MST<br><br></blockquote><div><br></div><div><br></div></body></html>

Thomas Lamprecht March 1, 2021, 7:12 a.m. UTC | #9

On 28.02.21 21:43, Michael S. Tsirkin wrote:
> Sure. The way to do that is to tie old behaviour to old machine

> versions. We'll need it in stable too ...

Yeah, using machine types is how its meant to be with solving migration
breakage, sure.
But that means we have to permanently pin the VM, and any backup restored from
that to that machine type *forever*. That'd be new for us as we always could
allow a newer machine type for a fresh start (i.e., non migration or the like)
here, and mean that lots of other improvements guarded by a newer machine type
for those VMs will.

Why not a switch + machine type, solves migration and any special cases of it
but also allows machine updates but also to keep the old behavior?

And yeah, stable is wanted, but extrapolating from the current stable releases
frequency, where normally there's maximal one after 5-6 months from the .0
release, means that this will probably still hit all those distributions I
mentioned or is there something more soon planned?

Also, is there any regression testing infrastructure around to avoid such
changes in the future? This change got undetected for 7 months, which can be
pretty the norm for QEMU releases, so some earlier safety net would be good? Is
there anything which dumps various default machine HW layouts and uses them for
an ABI check of some sorts?

Michael S. Tsirkin March 1, 2021, 7:20 a.m. UTC | #10

On Mon, Mar 01, 2021 at 08:12:35AM +0100, Thomas Lamprecht wrote:
> On 28.02.21 21:43, Michael S. Tsirkin wrote:

> > Sure. The way to do that is to tie old behaviour to old machine

> > versions. We'll need it in stable too ...

> 

> Yeah, using machine types is how its meant to be with solving migration

> breakage, sure.

> But that means we have to permanently pin the VM, and any backup restored from

> that to that machine type *forever*. That'd be new for us as we always could

> allow a newer machine type for a fresh start (i.e., non migration or the like)

> here, and mean that lots of other improvements guarded by a newer machine type

> for those VMs will.


If you don't do that, that is a bug as any virtual hardware
can change across machine types.

> Why not a switch + machine type, solves migration and any special cases of it

> but also allows machine updates but also to keep the old behavior?


I am not really sure what you mean here, sound like a new feature -
at a guess it will take a while to formulate and is unlikely
to be backported to stable and so help with historical
releases.

> And yeah, stable is wanted, but extrapolating from the current stable releases

> frequency, where normally there's maximal one after 5-6 months from the .0

> release, means that this will probably still hit all those distributions I

> mentioned or is there something more soon planned?

> 

> Also, is there any regression testing infrastructure around to avoid such

> changes in the future? This change got undetected for 7 months, which can be

> pretty the norm for QEMU releases, so some earlier safety net would be good? Is

> there anything which dumps various default machine HW layouts and uses them for

> an ABI check of some sorts?


There are various testing efforts the reason this got undetected is
because it does not affect linux guests, and even for windows
they kind of recover, there's just some boot slowdown around reconfiguration.
Not easy to detect automatically given windows has lots of random
downtime during boot around updates etc etc.

-- 
MST

Thomas Lamprecht March 1, 2021, 7:45 a.m. UTC | #11

On 01.03.21 08:20, Michael S. Tsirkin wrote:
> On Mon, Mar 01, 2021 at 08:12:35AM +0100, Thomas Lamprecht wrote:

>> On 28.02.21 21:43, Michael S. Tsirkin wrote:

>>> Sure. The way to do that is to tie old behaviour to old machine

>>> versions. We'll need it in stable too ...

>>

>> Yeah, using machine types is how its meant to be with solving migration

>> breakage, sure.

>> But that means we have to permanently pin the VM, and any backup restored from

>> that to that machine type *forever*. That'd be new for us as we always could

>> allow a newer machine type for a fresh start (i.e., non migration or the like)

>> here, and mean that lots of other improvements guarded by a newer machine type

>> for those VMs will.

> 

> If you don't do that, that is a bug as any virtual hardware

> can change across machine types.

For us a feature, for fresh starts one gets the current virtual HW but for
live migration or our live snapshot code it stays compatible. Works quite
well here for many years, as we can simply test the HW changes on existing
VMs - which failed here due to lack of static IPs in the test bed. So yes,
it has its problems as it is not really  what an OS considers as HW change
so big that it makes it a new device, mostly Windows is a PITA here as seen
in this issue.

I mean, QEMU deprecates very old machines at some point anyway, so even then
it is impossible to keep to the old machine forever, but otoh redoing some
changes after a decade or two can be fine, I guess?

> 

>> And yeah, stable is wanted, but extrapolating from the current stable releases

>> frequency, where normally there's maximal one after 5-6 months from the .0

>> release, means that this will probably still hit all those distributions I

>> mentioned or is there something more soon planned?

>>

>> Also, is there any regression testing infrastructure around to avoid such

>> changes in the future? This change got undetected for 7 months, which can be

>> pretty the norm for QEMU releases, so some earlier safety net would be good? Is

>> there anything which dumps various default machine HW layouts and uses them for

>> an ABI check of some sorts?

> 

> There are various testing efforts the reason this got undetected is

> because it does not affect linux guests, and even for windows

> they kind of recover, there's just some boot slowdown around reconfiguration.

> Not easy to detect automatically given windows has lots of random

> downtime during boot around updates etc etc.

> 

No, Windows does not reconfigure, this is a permanent change, one is just lucky
if one has a DHCP server around in the network accessible for the guest.
As static addresses setup on that virtual NIC before that config is gone,
no recovery whatsoever until manual intervention.

I meant more of a "dump HW layout to .txt file, commit to git, and ensure
there's no diff without and machine version bump" (very boiled down), e.g., like
ABI checks for kernel builds are often done by distros - albeit those are easier
as its quite clear what and how the kernel ABI can be used.

Igor Mammedov March 1, 2021, 1:28 p.m. UTC | #12

On Sun, 28 Feb 2021 15:43:40 -0500
"Michael S. Tsirkin" <mst@redhat.com> wrote:

> On Sat, Feb 27, 2021 at 08:41:11PM +0100, Thomas Lamprecht wrote:

> > On 30.07.20 17:58, Michael S. Tsirkin wrote:  

> > > macOS uses ACPI UIDs to build the DevicePath for NVRAM boot options,

> > > while OVMF firmware gets them via an internal channel through QEMU.

> > > Due to a bug in QEMU ACPI currently UEFI firmware and ACPI have

> > > different values, and this makes the underlying operating system

> > > unable to report its boot option.

> > > 

> > > The particular node in question is the primary PciRoot (PCI0 in ACPI),

> > > which for some reason gets assigned 1 in ACPI UID and 0 in the

> > > DevicePath. This is due to the _UID assigned to it by build_dsdt in

> > > hw/i386/acpi-build.c Which does not correspond to the primary PCI

> > > identifier given by pcibus_num in hw/pci/pci.c

> > > 

> > > Reference with the device paths, OVMF startup logs, and ACPI table

> > > dumps (SysReport):

> > > https://github.com/acidanthera/bugtracker/issues/1050

> > > 

> > > In UEFI v2.8, section "10.4.2 Rules with ACPI _HID and _UID" ends with

> > > the paragraph,

> > > 

> > >     Root PCI bridges will use the plug and play ID of PNP0A03, This will

> > >     be stored in the ACPI Device Path _HID field, or in the Expanded

> > >     ACPI Device Path _CID field to match the ACPI name space. The _UID

> > >     in the ACPI Device Path structure must match the _UID in the ACPI

> > >     name space.

> > > 

> > > (See especially the last sentence.)

> > > 

> > > Considering *extra* root bridges / root buses (with bus number > 0),

> > > QEMU's ACPI generator actually does the right thing; since QEMU commit

> > > c96d9286a6d7 ("i386/acpi-build: more traditional _UID and _HID for PXB

> > > root buses", 2015-06-11).

> > > 

> > > However, the _UID values for root bridge zero (on both i440fx and q35)

> > > have always been "wrong" (from UEFI perspective), going back in QEMU to

> > > commit 74523b850189 ("i386: add ACPI table files from seabios",

> > > 2013-10-14).

> > > 

> > > Even in SeaBIOS, these _UID values have always been 1; see commit

> > > a4d357638c57 ("Port rombios32 code from bochs-bios.", 2008-03-08) for

> > > i440fx, and commit ecbe3fd61511 ("seabios: q35: add dsdt", 2012-12-01)

> > > for q35.

> > > 

> > > Suggested-by: Laszlo Ersek <lersek@redhat.com>

> > > Tested-by: vit9696 <vit9696@protonmail.com>

> > > Signed-off-by: Michael S. Tsirkin <mst@redhat.com>

> > > ---

> > >  hw/i386/acpi-build.c | 4 ++--

> > >  1 file changed, 2 insertions(+), 2 deletions(-)

> > > 

> > > diff --git a/hw/i386/acpi-build.c b/hw/i386/acpi-build.c

> > > index b7bcbbbb2a..7a5a8b3521 100644

> > > --- a/hw/i386/acpi-build.c

> > > +++ b/hw/i386/acpi-build.c

> > > @@ -1497,7 +1497,7 @@ build_dsdt(GArray *table_data, BIOSLinker *linker,

> > >          dev = aml_device("PCI0");

> > >          aml_append(dev, aml_name_decl("_HID", aml_eisaid("PNP0A03")));

> > >          aml_append(dev, aml_name_decl("_ADR", aml_int(0)));

> > > -        aml_append(dev, aml_name_decl("_UID", aml_int(1)));

> > > +        aml_append(dev, aml_name_decl("_UID", aml_int(0)));

> > >          aml_append(sb_scope, dev);

> > >          aml_append(dsdt, sb_scope);

> > >  

> > > @@ -1512,7 +1512,7 @@ build_dsdt(GArray *table_data, BIOSLinker *linker,

> > >          aml_append(dev, aml_name_decl("_HID", aml_eisaid("PNP0A08")));

> > >          aml_append(dev, aml_name_decl("_CID", aml_eisaid("PNP0A03")));

> > >          aml_append(dev, aml_name_decl("_ADR", aml_int(0)));

> > > -        aml_append(dev, aml_name_decl("_UID", aml_int(1)));

> > > +        aml_append(dev, aml_name_decl("_UID", aml_int(0)));

> > >          aml_append(dev, build_q35_osc_method());

> > >          aml_append(sb_scope, dev);

> > >          aml_append(dsdt, sb_scope);

> > >   

> > 

> > This "breaks" Windows guests created/installed before this change in the sense

> > of Windows gets confused and declares that most of the devices changed and thus

> > it has new entries for them in the device manager where settings of the old one

> > do not apply anymore.

> > 

> > We were made aware of this by our users when making QEMU 5.2.0 available on

> > a more used repository of us. Users complained that their static network

> > configuration got thrown out in Windows 2016 or 2019 server VMs, and Windows tried

> > to use DHCP (which was not available in their environments) and thus their Windows

> > VMs had no network connectivity at all anymore.

> > 

> > It's currently not yet quite 100% clear to me with what QEMU version the Windows VM

> > must be installed with, from reading the patch I have to believe it must be before

> > that, but we got mixed reports and a colleague could not replicate it from upgrade

> > of 4.0 to 5.2 (I did /not/ confirm that one). Anyway, just writing this all to avoid

> > people seeing different results and brushing this off.

> > 

> > So here's my personal reproducer, as said, I think that one should be able to just

> > use QEMU 5.1 to install a Windows guest and start it with 5.2 afterwards to see this

> > issue, but YMMV.

> > 

> > Note. I always used the exact same QEMU command (see below) for installation,

> > reproducing and bisect.

> > 

> > 1. Installed Windows 2016 1616 VM using QEMU 3.0.1

> >    - VirtIO net/scsi driver from VirtIO win 190

> > 2. Setup static network in the VM and shutdown

> > 3. Started VM with 5.2.0 -> Network gone, new "Ethernet #2" adapter shows up instead

> > 

> > Starting the  "Device Manager" and enabling "View -> Show hidden devices" showed

> > me a greyed out device duplicate for basically anything attached, SCSI disk, Basic

> > Display Adapter, CDROM device, ..., and the Network device.

> > 

> > The first difference I could find was the "Device instance path" one can find in

> > the "Details" tab of the devices' "Properties" window.

> > 

> > # old, from initial installation on QEMU 3.0.1

> > PCI\VEN_1AF4&DEV_1000&SUBSYS_00011AF4&REV_00\3&13C0B0C5&0&90

> > 

> > # new, from boot with QEMU 5.2

> > PCI\VEN_1AF4&DEV_1000&SUBSYS_00011AF4&REV_00\3&267A616A&0&90

> > 

> > They match until almost the end, not sure how important that is, but it caught my

> > eye (I'm really no windows guy since a decade so please excuse my terrible

> > debugging/exploring skills there. The rest of those properties looked pretty

> > much identical.

> > 

> > I then started a bisect, always just restarting the guest with the new QEMU build

> > and checking "Device Manager" and network settings to see if good/bad. That worked

> > pretty well and I came to this commit. See the bisect log attached at the end of

> > this mail.

> > 

> > So, from reading the commit message I figure that this change is wanted, what are

> > the implications of just reverting it? (which works out in bringing back the

> > old state in Windows + working static network config again).

> > 

> > Or any other way/idea to address this in a sane way so that those picky Windows

> > guests can be handled more graciously?  

> 

> Sure. The way to do that is to tie old behaviour to old machine

> versions. We'll need it in stable too ...

> 

> Igor want to cook up a patch?


It might be too late for that,
I mean VMs installed on qemu-5.2 will use new ACPI tables on all
machine types and reverting behavior back for old machine types
will cause the same headache for them.

The difference is that probably there are a lot less new
Windows installations than the old ones (especially with static IP assignment),
so it could be better to restore bug for old machine types to
avoid guest reconfiguration.

How about:
 * buggy ACPI for 5.1 machine types and older
 * fixed ACPI for 5.2 and newer?


> > I guess also that there could be more subtle effects from this patch here, the

> > network one may have just had quite visible effects to pop up as first issue...

> > 

> > Thanks if you read so far!

> > 

> > cheers,

> > Thomas

> > 

> > 

> > = QEMU Command =

> > 

> > (This was generated by our (Proxmox VE) stack, I only cleaned it up a bit to allow

> > easier manual running it)

> > 

> > ./qemu-system-x86_64 \

> >   -name win2016 \

> >   -chardev 'socket,id=qmp,path=/var/run/qemu-server/11765.qmp,server,nowait' \

> >   -mon 'chardev=qmp,mode=control' \

> >   -smbios 'type=1,uuid=6324fb28-e98a-44cf-85db-694d1b3405f5' \

> >   -smp '2,sockets=1,cores=2,maxcpus=2' \

> >   -nodefaults \

> >   -boot 'menu=on,strict=on,reboot-timeout=1000' \

> >   -vnc unix:/var/run/qemu-server/11765.vnc,password \

> >   -no-hpet \

> >   -cpu 'host,hv_ipi,hv_relaxed,hv_reset,hv_runtime,hv_spinlocks=0x1fff,hv_stimer,hv_synic,hv_time,hv_vapic,hv_vpindex,+kvm_pv_eoi,+kvm_pv_unhalt,+md-clear,+pcid,+spec-ctrl' \

> >   -m 2048 \

> >   -device 'pci-bridge,id=pci.1,chassis_nr=1,bus=pci.0,addr=0x1e' \

> >   -device 'pci-bridge,id=pci.2,chassis_nr=2,bus=pci.0,addr=0x1f' \

> >   -device 'vmgenid,guid=2e56e6ca-2cf8-4f1d-8cc3-9b19a2510c01' \

> >   -device 'piix3-usb-uhci,id=uhci,bus=pci.0,addr=0x1.0x2' \

> >   -device 'usb-tablet,id=tablet,bus=uhci.0,port=1' \

> >   -device 'VGA,id=vga,bus=pci.0,addr=0x2,edid=off' \

> >   -chardev 'socket,path=/var/run/qemu-server/11765.qga,server,nowait,id=qga0' \

> >   -device 'virtio-serial,id=qga0,bus=pci.0,addr=0x8' \

> >   -device 'virtserialport,chardev=qga0,name=org.qemu.guest_agent.0' \

> >   -device 'virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x3' \

> >   -iscsi 'initiator-name=iqn.1993-08.org.debian:01:468faae9322b' \

> >   -drive 'file=/mnt/pve/iso/template/iso/virtio-win-0.1.190.iso,if=none,id=drive-ide0,media=cdrom,aio=threads' \

> >   -device 'ide-cd,bus=ide.0,unit=0,drive=drive-ide0,id=ide0,bootindex=200' \

> >   -drive 'file=/mnt/pve/iso/template/iso/Win2016-1616-evaluation.ISO,if=none,id=drive-ide2,media=cdrom,aio=threads' \

> >   -device 'ide-cd,bus=ide.1,unit=0,drive=drive-ide2,id=ide2,bootindex=201' \

> >   -device 'virtio-scsi-pci,id=scsihw0,bus=pci.0,addr=0x5' \

> >   -drive 'file=/dev/WDnvme/vm-11765-disk-0,if=none,id=drive-scsi0,format=raw,cache=none,aio=native,detect-zeroes=on' \

> >   -device 'scsi-hd,bus=scsihw0.0,channel=0,scsi-id=0,lun=0,drive=drive-scsi0,id=scsi0,rotation_rate=1,bootindex=100' \

> >   -netdev 'type=tap,id=net0,ifname=tap11765i0,script=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on' \

> >   -device 'virtio-net-pci,mac=02:98:90:43:42:1D,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300' \

> >   -rtc 'driftfix=slew,base=localtime' \

> >   -machine 'type=pc' \

> >   -global 'kvm-pit.lost_tick_policy=discard'

> > 

> > 

> > = bisect log =

> > 

> > git bisect start

> > # bad: [553032db17440f8de011390e5a1cfddd13751b0b] Update version for v5.2.0 release

> > git bisect bad 553032db17440f8de011390e5a1cfddd13751b0b

> > # good: [d0ed6a69d399ae193959225cdeaa9382746c91cc] Update version for v5.1.0 release

> > git bisect good d0ed6a69d399ae193959225cdeaa9382746c91cc

> > # bad: [ed799805d00ccdda45eb8441c7d929624d9e98a6] qom: Add kernel-doc markup to introduction doc comment

> > git bisect bad ed799805d00ccdda45eb8441c7d929624d9e98a6

> > # bad: [e4d8b7c1a95fffcfa4bdab9aa7ffd1cf590cdcf5] Merge remote-tracking branch 'remotes/nvme/tags/pull-nvme-20200902' into staging

> > git bisect bad e4d8b7c1a95fffcfa4bdab9aa7ffd1cf590cdcf5

> > # bad: [af1dfe1ec0864e6700237a43cc36018176f9eba9] acpi: update expected DSDT files with _UID changes

> > git bisect bad af1dfe1ec0864e6700237a43cc36018176f9eba9

> > # good: [d7df0ceee0fd2e512cd214a9074ebeeb40da3099] Merge remote-tracking branch 'remotes/philmd-gitlab/tags/sd-next-20200821' into staging

> > git bisect good d7df0ceee0fd2e512cd214a9074ebeeb40da3099

> > # good: [df82aa7fe10e46b675678977999d49bd586538f8] Merge remote-tracking branch 'remotes/edgar/tags/edgar/xilinx-next-2020-08-24.for-upstream' into staging

> > git bisect good df82aa7fe10e46b675678977999d49bd586538f8

> > # good: [e39a8320b088dd5efc9ebaafe387e52b3d962665] target/riscv: Support the Virtual Instruction fault

> > git bisect good e39a8320b088dd5efc9ebaafe387e52b3d962665

> > # good: [a6841a2de66fa44fe52ed996b70f9fb9f7bd6ca7] qcow2: Add subcluster support to qcow2_co_pwrite_zeroes()

> > git bisect good a6841a2de66fa44fe52ed996b70f9fb9f7bd6ca7

> > # good: [2f8cd515477edab1cbf38ecbdbfa2cac13ce1550] hw/display/artist: Fix invalidation of lines near screen border

> > git bisect good 2f8cd515477edab1cbf38ecbdbfa2cac13ce1550

> > # good: [a5d3cfa2dc775e5d99f013703b8508f1d989d588] iotests: Add tests for qcow2 images with extended L2 entries

> > git bisect good a5d3cfa2dc775e5d99f013703b8508f1d989d588

> > # good: [8e49197ca5e76fdb8928833b2649ef13fc5aab2f] Merge remote-tracking branch 'remotes/hdeller/tags/target-hppa-v3-pull-request' into staging

> > git bisect good 8e49197ca5e76fdb8928833b2649ef13fc5aab2f

> > # bad: [af1b80ae56c9495999e8ccf7b70ef894378de642] i386/acpi: fix inconsistent QEMU/OVMF device paths

> > git bisect bad af1b80ae56c9495999e8ccf7b70ef894378de642

> > # good: [42a62c20925e02aef0d849f92a0e9540888e79ae] acpi: allow DSDT changes

> > git bisect good 42a62c20925e02aef0d849f92a0e9540888e79ae

> > # first bad commit: [af1b80ae56c9495999e8ccf7b70ef894378de642] i386/acpi: fix inconsistent QEMU/OVMF device paths  

> 

>

Igor Mammedov March 1, 2021, 2:20 p.m. UTC | #13

On Mon, 1 Mar 2021 08:45:53 +0100
Thomas Lamprecht <t.lamprecht@proxmox.com> wrote:

> On 01.03.21 08:20, Michael S. Tsirkin wrote:

> > On Mon, Mar 01, 2021 at 08:12:35AM +0100, Thomas Lamprecht wrote:  

> >> On 28.02.21 21:43, Michael S. Tsirkin wrote:  

> >>> Sure. The way to do that is to tie old behaviour to old machine

> >>> versions. We'll need it in stable too ...  

> >>

> >> Yeah, using machine types is how its meant to be with solving migration

> >> breakage, sure.

> >> But that means we have to permanently pin the VM, and any backup restored from

> >> that to that machine type *forever*. That'd be new for us as we always could

> >> allow a newer machine type for a fresh start (i.e., non migration or the like)

> >> here, and mean that lots of other improvements guarded by a newer machine type

> >> for those VMs will.  

> > 

> > If you don't do that, that is a bug as any virtual hardware

> > can change across machine types.  

> 

> For us a feature, for fresh starts one gets the current virtual HW but for

> live migration or our live snapshot code it stays compatible. Works quite

> well here for many years, as we can simply test the HW changes on existing

> VMs - which failed here due to lack of static IPs in the test bed. So yes,

> it has its problems as it is not really  what an OS considers as HW change

> so big that it makes it a new device, mostly Windows is a PITA here as seen

> in this issue.

> 

> I mean, QEMU deprecates very old machines at some point anyway, so even then

> it is impossible to keep to the old machine forever, but otoh redoing some

> changes after a decade or two can be fine, I guess?

> 

> >   

> >> And yeah, stable is wanted, but extrapolating from the current stable releases

> >> frequency, where normally there's maximal one after 5-6 months from the .0

> >> release, means that this will probably still hit all those distributions I

> >> mentioned or is there something more soon planned?

> >>

> >> Also, is there any regression testing infrastructure around to avoid such

> >> changes in the future? This change got undetected for 7 months, which can be

> >> pretty the norm for QEMU releases, so some earlier safety net would be good? Is

> >> there anything which dumps various default machine HW layouts and uses them for

> >> an ABI check of some sorts?  

> > 

> > There are various testing efforts the reason this got undetected is

> > because it does not affect linux guests, and even for windows

> > they kind of recover, there's just some boot slowdown around reconfiguration.

> > Not easy to detect automatically given windows has lots of random

> > downtime during boot around updates etc etc.

> >   

> 

> No, Windows does not reconfigure, this is a permanent change, one is just lucky

> if one has a DHCP server around in the network accessible for the guest.

> As static addresses setup on that virtual NIC before that config is gone,

> no recovery whatsoever until manual intervention.

Static IP's are the pain guest admin picked up to deal with so he might have to
reconfigure guest OS when it decides to rename NICs. In this case moving
to new QEMU is alike to updating BIOS which fixed PCI description.
(On QEMU side we try to avoid breaking changes, but sometime it happens anyway
and it's up guest admin to fix OS quirks)

> I meant more of a "dump HW layout to .txt file, commit to git, and ensure

> there's no diff without and machine version bump" (very boiled down), e.g., like

> ABI checks for kernel builds are often done by distros - albeit those are easier

> as its quite clear what and how the kernel ABI can be used.

ACPI tables are not considered as ABI change in QEMU, technically tables that QEMU
generates are firmware and not version-ed (same like we don't tie anything to
specific firmware versions). 

However we rarely do version ACPI changes (only when it breaks something or
we suspect it would break and we can't accept that breakage), this time it took
a lot of time to find out that. We try to minimize such cases as every
versioning knob adds up to maintenance.

For ACPI tables changes, QEMU has bios-tables-test, but it lets us to catch
unintended changes only.
Technically it's possible to keep master tables for old machine versions
and test against it. But I'm not sure if we should do that, because some
(most) changes are harmless or useful and should apply to all machine
versions.
So we will end up in the same situation, where we decide if a change
should be versioned or not.

Thomas Lamprecht March 1, 2021, 2:27 p.m. UTC | #14

On 01.03.21 15:20, Igor Mammedov wrote:
> On Mon, 1 Mar 2021 08:45:53 +0100

> Thomas Lamprecht <t.lamprecht@proxmox.com> wrote:

>> On 01.03.21 08:20, Michael S. Tsirkin wrote:

>>> There are various testing efforts the reason this got undetected is

>>> because it does not affect linux guests, and even for windows

>>> they kind of recover, there's just some boot slowdown around reconfiguration.

>>> Not easy to detect automatically given windows has lots of random

>>> downtime during boot around updates etc etc.

>>>   

>>

>> No, Windows does not reconfigure, this is a permanent change, one is just lucky

>> if one has a DHCP server around in the network accessible for the guest.

>> As static addresses setup on that virtual NIC before that config is gone,

>> no recovery whatsoever until manual intervention.

> Static IP's are the pain guest admin picked up to deal with so he might have to

> reconfigure guest OS when it decides to rename NICs. In this case moving

> to new QEMU is alike to updating BIOS which fixed PCI description.

> (On QEMU side we try to avoid breaking changes, but sometime it happens anyway

> and it's up guest admin to fix OS quirks)

> 


heh, I agree, but users see it very differently, QEMU got updated, something
stopped working/changed/... -> QEMU at fault.

>> I meant more of a "dump HW layout to .txt file, commit to git, and ensure

>> there's no diff without and machine version bump" (very boiled down), e.g., like

>> ABI checks for kernel builds are often done by distros - albeit those are easier

>> as its quite clear what and how the kernel ABI can be used.

> ACPI tables are not considered as ABI change in QEMU, technically tables that QEMU

> generates are firmware and not version-ed (same like we don't tie anything to

> specific firmware versions). 

> 

> However we rarely do version ACPI changes (only when it breaks something or

> we suspect it would break and we can't accept that breakage), this time it took

> a lot of time to find out that. We try to minimize such cases as every

> versioning knob adds up to maintenance.

> 

> For ACPI tables changes, QEMU has bios-tables-test, but it lets us to catch

> unintended changes only.

> Technically it's possible to keep master tables for old machine versions

> and test against it. But I'm not sure if we should do that, because some

> (most) changes are harmless or useful and should apply to all machine

> versions.

> So we will end up in the same situation, where we decide if a change

> should be versioned or not.

> 

> 


OK, fair enough. Many thanks for providing some rationale!

Michael S. Tsirkin March 1, 2021, 3:31 p.m. UTC | #15

On Mon, Mar 01, 2021 at 08:45:53AM +0100, Thomas Lamprecht wrote:
> On 01.03.21 08:20, Michael S. Tsirkin wrote:

> > On Mon, Mar 01, 2021 at 08:12:35AM +0100, Thomas Lamprecht wrote:

> >> On 28.02.21 21:43, Michael S. Tsirkin wrote:

> >>> Sure. The way to do that is to tie old behaviour to old machine

> >>> versions. We'll need it in stable too ...

> >>

> >> Yeah, using machine types is how its meant to be with solving migration

> >> breakage, sure.

> >> But that means we have to permanently pin the VM, and any backup restored from

> >> that to that machine type *forever*. That'd be new for us as we always could

> >> allow a newer machine type for a fresh start (i.e., non migration or the like)

> >> here, and mean that lots of other improvements guarded by a newer machine type

> >> for those VMs will.

> > 

> > If you don't do that, that is a bug as any virtual hardware

> > can change across machine types.

> 

> For us a feature, for fresh starts one gets the current virtual HW but for

> live migration or our live snapshot code it stays compatible. Works quite

> well here for many years, as we can simply test the HW changes on existing

> VMs - which failed here due to lack of static IPs in the test bed. So yes,

> it has its problems as it is not really  what an OS considers as HW change

> so big that it makes it a new device, mostly Windows is a PITA here as seen

> in this issue.

> 

> I mean, QEMU deprecates very old machines at some point anyway, so even then

> it is impossible to keep to the old machine forever, but otoh redoing some

> changes after a decade or two can be fine, I guess?

> 

> > 

> >> And yeah, stable is wanted, but extrapolating from the current stable releases

> >> frequency, where normally there's maximal one after 5-6 months from the .0

> >> release, means that this will probably still hit all those distributions I

> >> mentioned or is there something more soon planned?

> >>

> >> Also, is there any regression testing infrastructure around to avoid such

> >> changes in the future? This change got undetected for 7 months, which can be

> >> pretty the norm for QEMU releases, so some earlier safety net would be good? Is

> >> there anything which dumps various default machine HW layouts and uses them for

> >> an ABI check of some sorts?

> > 

> > There are various testing efforts the reason this got undetected is

> > because it does not affect linux guests, and even for windows

> > they kind of recover, there's just some boot slowdown around reconfiguration.

> > Not easy to detect automatically given windows has lots of random

> > downtime during boot around updates etc etc.

> > 

> 

> No, Windows does not reconfigure, this is a permanent change, one is just lucky

> if one has a DHCP server around in the network accessible for the guest.

> As static addresses setup on that virtual NIC before that config is gone,

> no recovery whatsoever until manual intervention.


Right, it so happened no one tested with a static IP.

> I meant more of a "dump HW layout to .txt file, commit to git, and ensure

> there's no diff without and machine version bump" (very boiled down), e.g., like

> ABI checks for kernel builds are often done by distros - albeit those are easier

> as its quite clear what and how the kernel ABI can be used.


Exactly. We have such tests for ACPI which is what changed here.  We
just *do* change ACPI once in a while - it is code after all, and it is
normally fine to change as long as changes are not material.  So what do
we do  when we change it?  All we have right now is inspecting
it manually.

-- 
MST

Michael S. Tsirkin March 1, 2021, 4:14 p.m. UTC | #16

On Mon, Mar 01, 2021 at 02:28:19PM +0100, Igor Mammedov wrote:
> On Sun, 28 Feb 2021 15:43:40 -0500

> "Michael S. Tsirkin" <mst@redhat.com> wrote:

> 

> > On Sat, Feb 27, 2021 at 08:41:11PM +0100, Thomas Lamprecht wrote:

> > > On 30.07.20 17:58, Michael S. Tsirkin wrote:  

> > > > macOS uses ACPI UIDs to build the DevicePath for NVRAM boot options,

> > > > while OVMF firmware gets them via an internal channel through QEMU.

> > > > Due to a bug in QEMU ACPI currently UEFI firmware and ACPI have

> > > > different values, and this makes the underlying operating system

> > > > unable to report its boot option.

> > > > 

> > > > The particular node in question is the primary PciRoot (PCI0 in ACPI),

> > > > which for some reason gets assigned 1 in ACPI UID and 0 in the

> > > > DevicePath. This is due to the _UID assigned to it by build_dsdt in

> > > > hw/i386/acpi-build.c Which does not correspond to the primary PCI

> > > > identifier given by pcibus_num in hw/pci/pci.c

> > > > 

> > > > Reference with the device paths, OVMF startup logs, and ACPI table

> > > > dumps (SysReport):

> > > > https://github.com/acidanthera/bugtracker/issues/1050

> > > > 

> > > > In UEFI v2.8, section "10.4.2 Rules with ACPI _HID and _UID" ends with

> > > > the paragraph,

> > > > 

> > > >     Root PCI bridges will use the plug and play ID of PNP0A03, This will

> > > >     be stored in the ACPI Device Path _HID field, or in the Expanded

> > > >     ACPI Device Path _CID field to match the ACPI name space. The _UID

> > > >     in the ACPI Device Path structure must match the _UID in the ACPI

> > > >     name space.

> > > > 

> > > > (See especially the last sentence.)

> > > > 

> > > > Considering *extra* root bridges / root buses (with bus number > 0),

> > > > QEMU's ACPI generator actually does the right thing; since QEMU commit

> > > > c96d9286a6d7 ("i386/acpi-build: more traditional _UID and _HID for PXB

> > > > root buses", 2015-06-11).

> > > > 

> > > > However, the _UID values for root bridge zero (on both i440fx and q35)

> > > > have always been "wrong" (from UEFI perspective), going back in QEMU to

> > > > commit 74523b850189 ("i386: add ACPI table files from seabios",

> > > > 2013-10-14).

> > > > 

> > > > Even in SeaBIOS, these _UID values have always been 1; see commit

> > > > a4d357638c57 ("Port rombios32 code from bochs-bios.", 2008-03-08) for

> > > > i440fx, and commit ecbe3fd61511 ("seabios: q35: add dsdt", 2012-12-01)

> > > > for q35.

> > > > 

> > > > Suggested-by: Laszlo Ersek <lersek@redhat.com>

> > > > Tested-by: vit9696 <vit9696@protonmail.com>

> > > > Signed-off-by: Michael S. Tsirkin <mst@redhat.com>

> > > > ---

> > > >  hw/i386/acpi-build.c | 4 ++--

> > > >  1 file changed, 2 insertions(+), 2 deletions(-)

> > > > 

> > > > diff --git a/hw/i386/acpi-build.c b/hw/i386/acpi-build.c

> > > > index b7bcbbbb2a..7a5a8b3521 100644

> > > > --- a/hw/i386/acpi-build.c

> > > > +++ b/hw/i386/acpi-build.c

> > > > @@ -1497,7 +1497,7 @@ build_dsdt(GArray *table_data, BIOSLinker *linker,

> > > >          dev = aml_device("PCI0");

> > > >          aml_append(dev, aml_name_decl("_HID", aml_eisaid("PNP0A03")));

> > > >          aml_append(dev, aml_name_decl("_ADR", aml_int(0)));

> > > > -        aml_append(dev, aml_name_decl("_UID", aml_int(1)));

> > > > +        aml_append(dev, aml_name_decl("_UID", aml_int(0)));

> > > >          aml_append(sb_scope, dev);

> > > >          aml_append(dsdt, sb_scope);

> > > >  

> > > > @@ -1512,7 +1512,7 @@ build_dsdt(GArray *table_data, BIOSLinker *linker,

> > > >          aml_append(dev, aml_name_decl("_HID", aml_eisaid("PNP0A08")));

> > > >          aml_append(dev, aml_name_decl("_CID", aml_eisaid("PNP0A03")));

> > > >          aml_append(dev, aml_name_decl("_ADR", aml_int(0)));

> > > > -        aml_append(dev, aml_name_decl("_UID", aml_int(1)));

> > > > +        aml_append(dev, aml_name_decl("_UID", aml_int(0)));

> > > >          aml_append(dev, build_q35_osc_method());

> > > >          aml_append(sb_scope, dev);

> > > >          aml_append(dsdt, sb_scope);

> > > >   

> > > 

> > > This "breaks" Windows guests created/installed before this change in the sense

> > > of Windows gets confused and declares that most of the devices changed and thus

> > > it has new entries for them in the device manager where settings of the old one

> > > do not apply anymore.

> > > 

> > > We were made aware of this by our users when making QEMU 5.2.0 available on

> > > a more used repository of us. Users complained that their static network

> > > configuration got thrown out in Windows 2016 or 2019 server VMs, and Windows tried

> > > to use DHCP (which was not available in their environments) and thus their Windows

> > > VMs had no network connectivity at all anymore.

> > > 

> > > It's currently not yet quite 100% clear to me with what QEMU version the Windows VM

> > > must be installed with, from reading the patch I have to believe it must be before

> > > that, but we got mixed reports and a colleague could not replicate it from upgrade

> > > of 4.0 to 5.2 (I did /not/ confirm that one). Anyway, just writing this all to avoid

> > > people seeing different results and brushing this off.

> > > 

> > > So here's my personal reproducer, as said, I think that one should be able to just

> > > use QEMU 5.1 to install a Windows guest and start it with 5.2 afterwards to see this

> > > issue, but YMMV.

> > > 

> > > Note. I always used the exact same QEMU command (see below) for installation,

> > > reproducing and bisect.

> > > 

> > > 1. Installed Windows 2016 1616 VM using QEMU 3.0.1

> > >    - VirtIO net/scsi driver from VirtIO win 190

> > > 2. Setup static network in the VM and shutdown

> > > 3. Started VM with 5.2.0 -> Network gone, new "Ethernet #2" adapter shows up instead

> > > 

> > > Starting the  "Device Manager" and enabling "View -> Show hidden devices" showed

> > > me a greyed out device duplicate for basically anything attached, SCSI disk, Basic

> > > Display Adapter, CDROM device, ..., and the Network device.

> > > 

> > > The first difference I could find was the "Device instance path" one can find in

> > > the "Details" tab of the devices' "Properties" window.

> > > 

> > > # old, from initial installation on QEMU 3.0.1

> > > PCI\VEN_1AF4&DEV_1000&SUBSYS_00011AF4&REV_00\3&13C0B0C5&0&90

> > > 

> > > # new, from boot with QEMU 5.2

> > > PCI\VEN_1AF4&DEV_1000&SUBSYS_00011AF4&REV_00\3&267A616A&0&90

> > > 

> > > They match until almost the end, not sure how important that is, but it caught my

> > > eye (I'm really no windows guy since a decade so please excuse my terrible

> > > debugging/exploring skills there. The rest of those properties looked pretty

> > > much identical.

> > > 

> > > I then started a bisect, always just restarting the guest with the new QEMU build

> > > and checking "Device Manager" and network settings to see if good/bad. That worked

> > > pretty well and I came to this commit. See the bisect log attached at the end of

> > > this mail.

> > > 

> > > So, from reading the commit message I figure that this change is wanted, what are

> > > the implications of just reverting it? (which works out in bringing back the

> > > old state in Windows + working static network config again).

> > > 

> > > Or any other way/idea to address this in a sane way so that those picky Windows

> > > guests can be handled more graciously?  

> > 

> > Sure. The way to do that is to tie old behaviour to old machine

> > versions. We'll need it in stable too ...

> > 

> > Igor want to cook up a patch?

> 

> It might be too late for that,

> I mean VMs installed on qemu-5.2 will use new ACPI tables on all

> machine types and reverting behavior back for old machine types

> will cause the same headache for them.

> 

> The difference is that probably there are a lot less new

> Windows installations than the old ones (especially with static IP assignment),

> so it could be better to restore bug for old machine types to

> avoid guest reconfiguration.


Yes. And new installations using e.g. libvirt will always use the
latest machine type available.

> How about:

>  * buggy ACPI for 5.1 machine types and older

>  * fixed ACPI for 5.2 and newer?


Exactly.

> 

> > > I guess also that there could be more subtle effects from this patch here, the

> > > network one may have just had quite visible effects to pop up as first issue...

> > > 

> > > Thanks if you read so far!

> > > 

> > > cheers,

> > > Thomas

> > > 

> > > 

> > > = QEMU Command =

> > > 

> > > (This was generated by our (Proxmox VE) stack, I only cleaned it up a bit to allow

> > > easier manual running it)

> > > 

> > > ./qemu-system-x86_64 \

> > >   -name win2016 \

> > >   -chardev 'socket,id=qmp,path=/var/run/qemu-server/11765.qmp,server,nowait' \

> > >   -mon 'chardev=qmp,mode=control' \

> > >   -smbios 'type=1,uuid=6324fb28-e98a-44cf-85db-694d1b3405f5' \

> > >   -smp '2,sockets=1,cores=2,maxcpus=2' \

> > >   -nodefaults \

> > >   -boot 'menu=on,strict=on,reboot-timeout=1000' \

> > >   -vnc unix:/var/run/qemu-server/11765.vnc,password \

> > >   -no-hpet \

> > >   -cpu 'host,hv_ipi,hv_relaxed,hv_reset,hv_runtime,hv_spinlocks=0x1fff,hv_stimer,hv_synic,hv_time,hv_vapic,hv_vpindex,+kvm_pv_eoi,+kvm_pv_unhalt,+md-clear,+pcid,+spec-ctrl' \

> > >   -m 2048 \

> > >   -device 'pci-bridge,id=pci.1,chassis_nr=1,bus=pci.0,addr=0x1e' \

> > >   -device 'pci-bridge,id=pci.2,chassis_nr=2,bus=pci.0,addr=0x1f' \

> > >   -device 'vmgenid,guid=2e56e6ca-2cf8-4f1d-8cc3-9b19a2510c01' \

> > >   -device 'piix3-usb-uhci,id=uhci,bus=pci.0,addr=0x1.0x2' \

> > >   -device 'usb-tablet,id=tablet,bus=uhci.0,port=1' \

> > >   -device 'VGA,id=vga,bus=pci.0,addr=0x2,edid=off' \

> > >   -chardev 'socket,path=/var/run/qemu-server/11765.qga,server,nowait,id=qga0' \

> > >   -device 'virtio-serial,id=qga0,bus=pci.0,addr=0x8' \

> > >   -device 'virtserialport,chardev=qga0,name=org.qemu.guest_agent.0' \

> > >   -device 'virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x3' \

> > >   -iscsi 'initiator-name=iqn.1993-08.org.debian:01:468faae9322b' \

> > >   -drive 'file=/mnt/pve/iso/template/iso/virtio-win-0.1.190.iso,if=none,id=drive-ide0,media=cdrom,aio=threads' \

> > >   -device 'ide-cd,bus=ide.0,unit=0,drive=drive-ide0,id=ide0,bootindex=200' \

> > >   -drive 'file=/mnt/pve/iso/template/iso/Win2016-1616-evaluation.ISO,if=none,id=drive-ide2,media=cdrom,aio=threads' \

> > >   -device 'ide-cd,bus=ide.1,unit=0,drive=drive-ide2,id=ide2,bootindex=201' \

> > >   -device 'virtio-scsi-pci,id=scsihw0,bus=pci.0,addr=0x5' \

> > >   -drive 'file=/dev/WDnvme/vm-11765-disk-0,if=none,id=drive-scsi0,format=raw,cache=none,aio=native,detect-zeroes=on' \

> > >   -device 'scsi-hd,bus=scsihw0.0,channel=0,scsi-id=0,lun=0,drive=drive-scsi0,id=scsi0,rotation_rate=1,bootindex=100' \

> > >   -netdev 'type=tap,id=net0,ifname=tap11765i0,script=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on' \

> > >   -device 'virtio-net-pci,mac=02:98:90:43:42:1D,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300' \

> > >   -rtc 'driftfix=slew,base=localtime' \

> > >   -machine 'type=pc' \

> > >   -global 'kvm-pit.lost_tick_policy=discard'

> > > 

> > > 

> > > = bisect log =

> > > 

> > > git bisect start

> > > # bad: [553032db17440f8de011390e5a1cfddd13751b0b] Update version for v5.2.0 release

> > > git bisect bad 553032db17440f8de011390e5a1cfddd13751b0b

> > > # good: [d0ed6a69d399ae193959225cdeaa9382746c91cc] Update version for v5.1.0 release

> > > git bisect good d0ed6a69d399ae193959225cdeaa9382746c91cc

> > > # bad: [ed799805d00ccdda45eb8441c7d929624d9e98a6] qom: Add kernel-doc markup to introduction doc comment

> > > git bisect bad ed799805d00ccdda45eb8441c7d929624d9e98a6

> > > # bad: [e4d8b7c1a95fffcfa4bdab9aa7ffd1cf590cdcf5] Merge remote-tracking branch 'remotes/nvme/tags/pull-nvme-20200902' into staging

> > > git bisect bad e4d8b7c1a95fffcfa4bdab9aa7ffd1cf590cdcf5

> > > # bad: [af1dfe1ec0864e6700237a43cc36018176f9eba9] acpi: update expected DSDT files with _UID changes

> > > git bisect bad af1dfe1ec0864e6700237a43cc36018176f9eba9

> > > # good: [d7df0ceee0fd2e512cd214a9074ebeeb40da3099] Merge remote-tracking branch 'remotes/philmd-gitlab/tags/sd-next-20200821' into staging

> > > git bisect good d7df0ceee0fd2e512cd214a9074ebeeb40da3099

> > > # good: [df82aa7fe10e46b675678977999d49bd586538f8] Merge remote-tracking branch 'remotes/edgar/tags/edgar/xilinx-next-2020-08-24.for-upstream' into staging

> > > git bisect good df82aa7fe10e46b675678977999d49bd586538f8

> > > # good: [e39a8320b088dd5efc9ebaafe387e52b3d962665] target/riscv: Support the Virtual Instruction fault

> > > git bisect good e39a8320b088dd5efc9ebaafe387e52b3d962665

> > > # good: [a6841a2de66fa44fe52ed996b70f9fb9f7bd6ca7] qcow2: Add subcluster support to qcow2_co_pwrite_zeroes()

> > > git bisect good a6841a2de66fa44fe52ed996b70f9fb9f7bd6ca7

> > > # good: [2f8cd515477edab1cbf38ecbdbfa2cac13ce1550] hw/display/artist: Fix invalidation of lines near screen border

> > > git bisect good 2f8cd515477edab1cbf38ecbdbfa2cac13ce1550

> > > # good: [a5d3cfa2dc775e5d99f013703b8508f1d989d588] iotests: Add tests for qcow2 images with extended L2 entries

> > > git bisect good a5d3cfa2dc775e5d99f013703b8508f1d989d588

> > > # good: [8e49197ca5e76fdb8928833b2649ef13fc5aab2f] Merge remote-tracking branch 'remotes/hdeller/tags/target-hppa-v3-pull-request' into staging

> > > git bisect good 8e49197ca5e76fdb8928833b2649ef13fc5aab2f

> > > # bad: [af1b80ae56c9495999e8ccf7b70ef894378de642] i386/acpi: fix inconsistent QEMU/OVMF device paths

> > > git bisect bad af1b80ae56c9495999e8ccf7b70ef894378de642

> > > # good: [42a62c20925e02aef0d849f92a0e9540888e79ae] acpi: allow DSDT changes

> > > git bisect good 42a62c20925e02aef0d849f92a0e9540888e79ae

> > > # first bad commit: [af1b80ae56c9495999e8ccf7b70ef894378de642] i386/acpi: fix inconsistent QEMU/OVMF device paths  

> > 

> >

Laszlo Ersek March 1, 2021, 4:28 p.m. UTC | #17

On 03/01/21 17:14, Michael S. Tsirkin wrote:
> On Mon, Mar 01, 2021 at 02:28:19PM +0100, Igor Mammedov wrote:

>> How about:

>>  * buggy ACPI for 5.1 machine types and older

>>  * fixed ACPI for 5.2 and newer?

> 

> Exactly.

Sounds OK to me as well (even though it's quite unfortunate that this is
one of those exceptions that require us to version the ACPI generator).

Thanks
Laszlo

Igor Mammedov March 1, 2021, 7:08 p.m. UTC | #18

On Mon, 1 Mar 2021 17:28:05 +0100
Laszlo Ersek <lersek@redhat.com> wrote:

> On 03/01/21 17:14, Michael S. Tsirkin wrote:

> > On Mon, Mar 01, 2021 at 02:28:19PM +0100, Igor Mammedov wrote:  

> 

> >> How about:

> >>  * buggy ACPI for 5.1 machine types and older

> >>  * fixed ACPI for 5.2 and newer?  

> > 

> > Exactly.  

> 

> Sounds OK to me as well (even though it's quite unfortunate that this is

> one of those exceptions that require us to version the ACPI generator).

it is unfortunate, and I do resist to such changes usually.
in this case, I fill avoiding complaints/bug reports justifies such exception.


> Thanks

> Laszlo

> 

>

vit9696 March 1, 2021, 8:06 p.m. UTC | #19

I provided the initial version of the patch to the mailing list:
[PATCH] i386/acpi: restore device paths for pre-5.1 vms

Unfortunately I do not have easy access to a VM where I can test it at the moment. Please make sure that it works for you and reply with `Tested-by`.

Thanks,
Vitaly

> 1 марта 2021 г., в 22:08, Igor Mammedov <imammedo@redhat.com> написал(а):

> 

> 

> On Mon, 1 Mar 2021 17:28:05 +0100

> Laszlo Ersek <lersek@redhat.com> wrote:

> 

>> On 03/01/21 17:14, Michael S. Tsirkin wrote:

>>> On Mon, Mar 01, 2021 at 02:28:19PM +0100, Igor Mammedov wrote:

>> 

>>>> How about:

>>>> * buggy ACPI for 5.1 machine types and older

>>>> * fixed ACPI for 5.2 and newer?

>>> 

>>> Exactly.

>> 

>> Sounds OK to me as well (even though it's quite unfortunate that this is

>> one of those exceptions that require us to version the ACPI generator).

> it is unfortunate, and I do resist to such changes usually.

> in this case, I fill avoiding complaints/bug reports justifies such exception.

> 

> 

>> Thanks

>> Laszlo

>> 

>> 

>

Igor Mammedov March 1, 2021, 8:16 p.m. UTC | #20

On Mon, 1 Mar 2021 15:27:38 +0100
Thomas Lamprecht <t.lamprecht@proxmox.com> wrote:

> On 01.03.21 15:20, Igor Mammedov wrote:

> > On Mon, 1 Mar 2021 08:45:53 +0100

> > Thomas Lamprecht <t.lamprecht@proxmox.com> wrote:  

> >> On 01.03.21 08:20, Michael S. Tsirkin wrote:  

> >>> There are various testing efforts the reason this got undetected is

> >>> because it does not affect linux guests, and even for windows

> >>> they kind of recover, there's just some boot slowdown around reconfiguration.

> >>> Not easy to detect automatically given windows has lots of random

> >>> downtime during boot around updates etc etc.

> >>>     

> >>

> >> No, Windows does not reconfigure, this is a permanent change, one is just lucky

> >> if one has a DHCP server around in the network accessible for the guest.

> >> As static addresses setup on that virtual NIC before that config is gone,

> >> no recovery whatsoever until manual intervention.  

> > Static IP's are the pain guest admin picked up to deal with so he might have to

> > reconfigure guest OS when it decides to rename NICs. In this case moving

> > to new QEMU is alike to updating BIOS which fixed PCI description.

> > (On QEMU side we try to avoid breaking changes, but sometime it happens anyway

> > and it's up guest admin to fix OS quirks)

> >   

> 

> heh, I agree, but users see it very differently, QEMU got updated, something

> stopped working/changed/... -> QEMU at fault.

lets try to workaround it as Michael have suggested, i.e. old behavior for old
machine types.

> >> I meant more of a "dump HW layout to .txt file, commit to git, and ensure

> >> there's no diff without and machine version bump" (very boiled down), e.g., like

> >> ABI checks for kernel builds are often done by distros - albeit those are easier

> >> as its quite clear what and how the kernel ABI can be used.  

> > ACPI tables are not considered as ABI change in QEMU, technically tables that QEMU

> > generates are firmware and not version-ed (same like we don't tie anything to

> > specific firmware versions). 

> > 

> > However we rarely do version ACPI changes (only when it breaks something or

> > we suspect it would break and we can't accept that breakage), this time it took

> > a lot of time to find out that. We try to minimize such cases as every

> > versioning knob adds up to maintenance.

> > 

> > For ACPI tables changes, QEMU has bios-tables-test, but it lets us to catch

> > unintended changes only.

> > Technically it's possible to keep master tables for old machine versions

> > and test against it. But I'm not sure if we should do that, because some

> > (most) changes are harmless or useful and should apply to all machine

> > versions.

> > So we will end up in the same situation, where we decide if a change

> > should be versioned or not.


If you can come up with a test case for this issue, patches are welcome.

We probably should test PCI device enumeration on Windows,
as it's what's broken. Testing that in qtest (make check) is out of question,
but there are acceptance tests which run various guest OSes and provide tools
to interact with guest. Perhaps adding test there could work.
Though I don't know if there are Windows based guest images available for it.

I guess it's something to discuss with guys who work on CI/testing
infrastructure (CCed).
 
> OK, fair enough. Many thanks for providing some rationale!

> 

>

Laszlo Ersek March 2, 2021, 8:40 a.m. UTC | #21

On 03/01/21 20:08, Igor Mammedov wrote:
> On Mon, 1 Mar 2021 17:28:05 +0100

> Laszlo Ersek <lersek@redhat.com> wrote:

> 

>> On 03/01/21 17:14, Michael S. Tsirkin wrote:

>>> On Mon, Mar 01, 2021 at 02:28:19PM +0100, Igor Mammedov wrote:  

>>

>>>> How about:

>>>>  * buggy ACPI for 5.1 machine types and older

>>>>  * fixed ACPI for 5.2 and newer?  

>>>

>>> Exactly.  

>>

>> Sounds OK to me as well (even though it's quite unfortunate that this is

>> one of those exceptions that require us to version the ACPI generator).

> it is unfortunate, and I do resist to such changes usually.

> in this case, I fill avoiding complaints/bug reports justifies such exception.


Right, thanks.
Laszlo

[1/2] i386/acpi: fix inconsistent QEMU/OVMF device paths

Commit Message

Comments

Patch