Test GPU (Sapphire Radeon RX 550 2GB)

[geerlingguy]

I just ordered the Sapphire Radeon Pulse RX 550 2GB card after this recommendation by Djhg2000, and I'd like to see if it uses UEFI, works without BIOS/IO BAR space, and might have a better chance of working on the Pi.

Because it definitely requires more power, I'm going to try it in a 1x to 16x riser with external power, which I'm still waiting to test later. Will definitely need to expand the BAR space, maybe beyond 1 GB this time :O

References:

• Gist: Increase the BAR memory address space for PCIe devices on the Raspberry Pi Compute Module 4 (see also: raspberrypi/linux@54db4b2)
• Pi Forums: BAR space for PCIe allocation on CM4?

[dtischler]

Will be curious if you can allocate enough BAR for this card. Looking forward to finding out! :-)

[geerlingguy]

Ha, well I half wonder if I'll need a CM4 8GB... which I have not ordered (I have a couple more 4GB models on the way but they aren't shipping for a couple weeks!).

[geerlingguy]

Over in the raspberrypi/linux project, it looks like this commit (raspberrypi/linux@54db4b2) has increased the default BAR allocation to 1GB by default—nice!

[geerlingguy]

It has arrived.

But I have been full bore on a few other things today, so it will have to wait. I set it next to the CM4 IO Board so it can start getting 'familiar' with it.

[philmb3487]

Cards for the Mac market also shouldn't have that I/O section, because they don't use the whole BIOS system at all - and not even the x86 set but that was a long time ago. So Mac branded cards (they do exist..) are also an option.

[clarkalastair]

Some amd cards can be flashed to Mac / efi mode too, if you’re that way inclined.

[Rucadi]

Cards for the Mac market also shouldn't have that I/O section, because they don't use the whole BIOS system at all - and not even the x86 set but that was a long time ago. So Mac branded cards (they do exist..) are also an option.

Hi,

I think that potentially you can patch the driver to ignore this problem.

The problem resides in the line 1423 of the file drivers/gpu/drm/radeon/radeon_device.c
Using the latest driver version is:

rdev->rio_mem = pci_iomap(rdev->pdev, i, rdev->rio_mem_size);

The pci_iomap is returning NULL, however, I think that you don't really need to do the iomap, since it's only needed in the case of AMD legacy cards.

In fact, I think you could just continue executing by erasing the if:
(although this is not causing the driver to not initialize as far as I can see)
if (rdev->rio_mem == NULL)
DRM_ERROR("Unable to find PCI I/O BAR\n");

and as far as I can see, the code is already prepared to have rio_mem to NULL, as you can see on

amdgpu_atmbios.c:1988
int amdgpu_atombios_init(struct amdgpu_device *adev)

It fallbacks to the MMIO (as the I/O BAR region that the driver would use is also mapped in the BAR)

/* needed for iio ops */
if (adev->rio_mem) {
	atom_card_info->ioreg_read = cail_ioreg_read;
	atom_card_info->ioreg_write = cail_ioreg_write;
} else {
	DRM_DEBUG("PCI I/O BAR is not found. Using MMIO to access ATOM BIOS\n");
	atom_card_info->ioreg_read = cail_reg_read;
	atom_card_info->ioreg_write = cail_reg_write;
}

Also, I can see that this check is not only here, but in various places.

I can't test it myself, but I think it's worth a try.

However, I think the problem it's more likely located in:

radeon_get_bios on radeon_bios.c

It's absolutely returning true that function, since in the log I can see that it's expecting an evergreen GPU, but failing at it.

That check is donde in this part of code:

if (!memcmp(rdev->bios + tmp, "ATOM", 4) ||
    !memcmp(rdev->bios + tmp, "MOTA", 4)) {
	rdev->is_atom_bios = true;
} else {
	rdev->is_atom_bios = false;
}

is is_atom_bios is true, the code at evergreen.c will continue initializing.

The problem is that is_atom_bios is set to false, so I think it's reading garbage. (I would love to debug it).

Also, I'm pretty sure that it's not failing early because if it detects an incorrect BIOS signature or is unable to allocate the bios map, it returns false in a previous if, and it causes a return code of -EINVAL;

I don't know if this is useful or my conclusions are utter garbage, since I'm by no means an expert in this topic.

[philmb3487]

@Rucadi Good analysis – in practice i fear it won't be this easy.
But it might just be. It's worth also checking how the Raptor Talos II folks are handling this case.

[geerlingguy]

Hmm, first plugins aren't going super well...

[    1.010470] brcm-pcie fd500000.pcie: host bridge /scb/pcie@7d500000 ranges:
[    1.010490] brcm-pcie fd500000.pcie:   No bus range found for /scb/pcie@7d500000, using [bus 00-ff]
[    1.010547] brcm-pcie fd500000.pcie:      MEM 0x0600000000..0x067fffffff -> 0x00c0000000
[    1.010601] brcm-pcie fd500000.pcie:   IB MEM 0x0000000000..0x00ffffffff -> 0x0100000000
[    1.329328] brcm-pcie fd500000.pcie: link down

And some plugging and unplugging and rebooting later, and sometimes it just halts boot as it hits the following:

I have a couple other powered PCIe adapters I may try. And maybe just for grins, try out the plain unpowered adapter too... at least I know it works with all my other devices.

[geerlingguy]

Well that's better... so far so good with the plain (unpowered) adapter:

$ sudo lspci -vvv
...
01:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Lexa PRO [Radeon RX 550/550X] (rev c7) (prog-if 00 [VGA controller])
	Subsystem: Sapphire Technology Limited Lexa PRO [Radeon RX 550/550X] (Lexa PRO [Radeon RX 550])
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Interrupt: pin A routed to IRQ 255
	Region 0: Memory at 640000000 (64-bit, prefetchable) [disabled] [size=256M]
	Region 2: Memory at 650000000 (64-bit, prefetchable) [disabled] [size=2M]
	Region 4: I/O ports at <unassigned> [disabled]
	Region 5: Memory at 600000000 (32-bit, non-prefetchable) [disabled] [size=256K]
	[virtual] Expansion ROM at 600040000 [disabled] [size=128K]
	Capabilities: [48] Vendor Specific Information: Len=08 <?>
	Capabilities: [50] Power Management version 3
		Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0-,D1+,D2+,D3hot+,D3cold+)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [58] Express (v2) Legacy Endpoint, MSI 00
		DevCap:	MaxPayload 256 bytes, PhantFunc 0, Latency L0s <4us, L1 unlimited
			ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop+
			MaxPayload 128 bytes, MaxReadReq 512 bytes
		DevSta:	CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr- TransPend-
		LnkCap:	Port #0, Speed 8GT/s, Width x8, ASPM L1, Exit Latency L0s <64ns, L1 <1us
			ClockPM+ Surprise- LLActRep- BwNot- ASPMOptComp+
		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Not Supported, TimeoutDis-, LTR+, OBFF Not Supported
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled
		LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
		Address: 0000000000000000  Data: 0000
	Capabilities: [100 v1] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150 v2] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UESvrt:	DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		CEMsk:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		AERCap:	First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
	Capabilities: [200 v1] #15
	Capabilities: [270 v1] #19
	Capabilities: [2b0 v1] Address Translation Service (ATS)
		ATSCap:	Invalidate Queue Depth: 00
		ATSCtl:	Enable-, Smallest Translation Unit: 00
	Capabilities: [2c0 v1] Page Request Interface (PRI)
		PRICtl: Enable- Reset-
		PRISta: RF- UPRGI- Stopped+
		Page Request Capacity: 00000020, Page Request Allocation: 00000000
	Capabilities: [2d0 v1] Process Address Space ID (PASID)
		PASIDCap: Exec+ Priv+, Max PASID Width: 10
		PASIDCtl: Enable- Exec- Priv-
	Capabilities: [320 v1] Latency Tolerance Reporting
		Max snoop latency: 0ns
		Max no snoop latency: 0ns
	Capabilities: [328 v1] Alternative Routing-ID Interpretation (ARI)
		ARICap:	MFVC- ACS-, Next Function: 1
		ARICtl:	MFVC- ACS-, Function Group: 0
	Capabilities: [370 v1] L1 PM Substates
		L1SubCap: PCI-PM_L1.2+ PCI-PM_L1.1+ ASPM_L1.2+ ASPM_L1.1+ L1_PM_Substates+
			  PortCommonModeRestoreTime=0us PortTPowerOnTime=170us
		L1SubCtl1: PCI-PM_L1.2- PCI-PM_L1.1- ASPM_L1.2- ASPM_L1.1-
			   T_CommonMode=0us LTR1.2_Threshold=0ns
		L1SubCtl2: T_PwrOn=10us

01:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Baffin HDMI/DP Audio [Radeon RX 550 640SP / RX 560/560X]
	Subsystem: Sapphire Technology Limited Baffin HDMI/DP Audio [Radeon RX 550 640SP / RX 560/560X]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Interrupt: pin B routed to IRQ 255
	Region 0: Memory at 600060000 (64-bit, non-prefetchable) [disabled] [size=16K]
	Capabilities: [48] Vendor Specific Information: Len=08 <?>
	Capabilities: [50] Power Management version 3
		Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [58] Express (v2) Legacy Endpoint, MSI 00
		DevCap:	MaxPayload 256 bytes, PhantFunc 0, Latency L0s <4us, L1 unlimited
			ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop+
			MaxPayload 128 bytes, MaxReadReq 512 bytes
		DevSta:	CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr- TransPend-
		LnkCap:	Port #0, Speed 8GT/s, Width x8, ASPM L1, Exit Latency L0s <64ns, L1 <1us
			ClockPM+ Surprise- LLActRep- BwNot- ASPMOptComp+
		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Not Supported, TimeoutDis-, LTR+, OBFF Not Supported
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled
		LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
		Address: 0000000000000000  Data: 0000
	Capabilities: [100 v1] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150 v2] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UESvrt:	DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		CEMsk:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		AERCap:	First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
	Capabilities: [328 v1] Alternative Routing-ID Interpretation (ARI)
		ARICap:	MFVC- ACS-, Next Function: 0
		ARICtl:	MFVC- ACS-, Function Group: 0

[dtischler]

No kernel / boot errors reaching this point, when using the unpowered adapter?

[geerlingguy]

And dmesg logs:

[    1.011261] brcm-pcie fd500000.pcie: host bridge /scb/pcie@7d500000 ranges:
[    1.011281] brcm-pcie fd500000.pcie:   No bus range found for /scb/pcie@7d500000, using [bus 00-ff]
[    1.011338] brcm-pcie fd500000.pcie:      MEM 0x0600000000..0x067fffffff -> 0x00c0000000
[    1.011392] brcm-pcie fd500000.pcie:   IB MEM 0x0000000000..0x00ffffffff -> 0x0100000000
[    1.059289] brcm-pcie fd500000.pcie: link up, 5 GT/s x1 (SSC)
[    1.059578] brcm-pcie fd500000.pcie: PCI host bridge to bus 0000:00
[    1.059593] pci_bus 0000:00: root bus resource [bus 00-ff]
[    1.059610] pci_bus 0000:00: root bus resource [mem 0x600000000-0x67fffffff] (bus address [0xc0000000-0x13fffffff])
[    1.059663] pci 0000:00:00.0: [14e4:2711] type 01 class 0x060400
[    1.059884] pci 0000:00:00.0: PME# supported from D0 D3hot
[    1.063495] pci 0000:00:00.0: bridge configuration invalid ([bus ff-ff]), reconfiguring
[    1.063695] pci 0000:01:00.0: [1002:699f] type 00 class 0x030000
[    1.063809] pci 0000:01:00.0: reg 0x10: [mem 0x00000000-0x0fffffff 64bit pref]
[    1.063851] pci 0000:01:00.0: reg 0x18: [mem 0x00000000-0x001fffff 64bit pref]
[    1.063879] pci 0000:01:00.0: reg 0x20: [io  0x0000-0x00ff]
[    1.063907] pci 0000:01:00.0: reg 0x24: [mem 0x00000000-0x0003ffff]
[    1.063935] pci 0000:01:00.0: reg 0x30: [mem 0x00000000-0x0001ffff pref]
[    1.063965] pci 0000:01:00.0: enabling Extended Tags
[    1.064241] pci 0000:01:00.0: supports D1 D2
[    1.064253] pci 0000:01:00.0: PME# supported from D1 D2 D3hot D3cold
[    1.064317] pci 0000:01:00.0: 4.000 Gb/s available PCIe bandwidth, limited by 5 GT/s x1 link at 0000:00:00.0 (capable of 63.008 Gb/s with 8 GT/s x8 link)
[    1.064459] pci 0000:01:00.0: vgaarb: VGA device added: decodes=io+mem,owns=none,locks=none
[    1.064545] pci 0000:01:00.1: [1002:aae0] type 00 class 0x040300
[    1.064635] pci 0000:01:00.1: reg 0x10: [mem 0x00000000-0x00003fff 64bit]
[    1.064745] pci 0000:01:00.1: enabling Extended Tags
[    1.064937] pci 0000:01:00.1: supports D1 D2
[    1.068388] pci_bus 0000:01: busn_res: [bus 01-ff] end is updated to 01
[    1.068430] pci 0000:00:00.0: BAR 9: assigned [mem 0x640000000-0x657ffffff 64bit pref]
[    1.068444] pci 0000:00:00.0: BAR 8: assigned [mem 0x600000000-0x6000fffff]
[    1.068463] pci 0000:01:00.0: BAR 0: assigned [mem 0x640000000-0x64fffffff 64bit pref]
[    1.068501] pci 0000:01:00.0: BAR 2: assigned [mem 0x650000000-0x6501fffff 64bit pref]
[    1.068536] pci 0000:01:00.0: BAR 5: assigned [mem 0x600000000-0x60003ffff]
[    1.068556] pci 0000:01:00.0: BAR 6: assigned [mem 0x600040000-0x60005ffff pref]
[    1.068571] pci 0000:01:00.1: BAR 0: assigned [mem 0x600060000-0x600063fff 64bit]
[    1.068607] pci 0000:01:00.0: BAR 4: no space for [io  size 0x0100]
[    1.068618] pci 0000:01:00.0: BAR 4: failed to assign [io  size 0x0100]
[    1.068632] pci 0000:00:00.0: PCI bridge to [bus 01]
[    1.068650] pci 0000:00:00.0:   bridge window [mem 0x600000000-0x6000fffff]
[    1.068666] pci 0000:00:00.0:   bridge window [mem 0x640000000-0x657ffffff 64bit pref]
[    1.068767] pci 0000:01:00.1: D0 power state depends on 0000:01:00.0

Always with that silly i/o bar. Well, let's go recompile cross-compile the kernel and see what the amdgpu driver gives us...

And to @dtischler - no, no issues so far. My power supply seems to be happy to put out enough juice at least to get things started (and get the fan on the card moving).

[geerlingguy]

All right, recompiled the kernel, now where does that get us:

[    4.194363] amdgpu 0000:01:00.0: remove_conflicting_pci_framebuffers: bar 5: 0x600000000 -> 0x60003ffff
[    4.194377] amdgpu 0000:01:00.0: remove_conflicting_pci_framebuffers: passed res_id (0) is not a memory bar
[    4.194435] pci 0000:00:00.0: enabling device (0000 -> 0002)
[    4.194464] amdgpu 0000:01:00.0: enabling device (0000 -> 0002)
[    4.344078] brcmfmac: brcmf_fw_alloc_request: using brcm/brcmfmac43456-sdio for chip BCM4345/9
[    4.357361] brcmfmac: brcmf_c_preinit_dcmds: Firmware: BCM4345/9 wl0: May 14 2020 17:26:08 version 7.84.17.1 (r871554) FWID 01-3d9e1d87
[    4.360945] [drm] initializing kernel modesetting (POLARIS12 0x1002:0x699F 0x1DA2:0xE367 0xC7).
[    4.360991] [drm] register mmio base: 0x00000000
[    4.361000] [drm] register mmio size: 262144
[    4.361009] [drm] PCI I/O BAR is not found.
[    4.361021] [drm] PCIE atomic ops is not supported
[    4.361044] [drm] add ip block number 0 <vi_common>
[    4.361053] [drm] add ip block number 1 <gmc_v8_0>
[    4.361062] [drm] add ip block number 2 <tonga_ih>
[    4.361070] [drm] add ip block number 3 <gfx_v8_0>
[    4.361078] [drm] add ip block number 4 <sdma_v3_0>
[    4.361087] [drm] add ip block number 5 <powerplay>
[    4.361096] [drm] add ip block number 6 <dm>
[    4.361104] [drm] add ip block number 7 <uvd_v6_0>
[    4.361112] [drm] add ip block number 8 <vce_v3_0>
[    4.609386] ATOM BIOS: 113-36764-U61
[    4.609527] [drm] UVD is enabled in VM mode
[    4.609536] [drm] UVD ENC is enabled in VM mode
[    4.609549] [drm] VCE enabled in VM mode
[    4.609574] [drm] GPU posting now...
[    4.729868] [drm] vm size is 64 GB, 2 levels, block size is 10-bit, fragment size is 9-bit
[    4.729982] amdgpu 0000:01:00.0: Direct firmware load for amdgpu/polaris12_mc.bin failed with error -2
[    4.729997] mc: Failed to load firmware "amdgpu/polaris12_mc.bin"
[    4.730341] [drm:gmc_v8_0_sw_init [amdgpu]] *ERROR* Failed to load mc firmware!
[    4.730641] [drm:amdgpu_device_init [amdgpu]] *ERROR* sw_init of IP block <gmc_v8_0> failed -2
[    4.730653] amdgpu 0000:01:00.0: amdgpu_device_ip_init failed
[    4.730666] amdgpu 0000:01:00.0: Fatal error during GPU init
[    4.730676] [drm] amdgpu: finishing device.
[    4.730763] ------------[ cut here ]------------
[    4.730773] sysfs group 'fw_version' not found for kobject '0000:01:00.0'
[    4.730821] WARNING: CPU: 2 PID: 163 at fs/sysfs/group.c:280 sysfs_remove_group+0x94/0xa0
[    4.730826] Modules linked in: amdgpu(+) brcmfmac brcmutil sha256_generic libsha256 i2c_algo_bit ttm vc4 cec cfg80211 v3d drm_kms_helper gpu_sched rfkill bcm2835_codec(C) bcm2835_isp(C) bcm2835_v4l2(C) v4l2_mem2mem raspberrypi_hwmon bcm2835_mmal_vchiq(C) snd_soc_core videobuf2_vmalloc videobuf2_dma_contig videobuf2_memops drm snd_bcm2835(C) snd_compress videobuf2_v4l2 snd_pcm_dmaengine videobuf2_common backlight drm_panel_orientation_quirks snd_pcm videodev mc snd_timer vc_sm_cma(C) snd syscopyarea sysfillrect sysimgblt fb_sys_fops rpivid_mem uio_pdrv_genirq uio i2c_dev ip_tables x_tables ipv6
[    4.730931] CPU: 2 PID: 163 Comm: systemd-udevd Tainted: G         C        5.4.74-v8gpu+ #1
[    4.730936] Hardware name: Raspberry Pi Compute Module 4 Rev 1.0 (DT)
[    4.730944] pstate: 80000005 (Nzcv daif -PAN -UAO)
[    4.730953] pc : sysfs_remove_group+0x94/0xa0
[    4.730961] lr : sysfs_remove_group+0x94/0xa0
[    4.730966] sp : ffffffc01165b790
[    4.730971] x29: ffffffc01165b790 x28: 0000000000000000 
[    4.730981] x27: 0000000000000000 x26: ffffffc0092ad198 
[    4.730990] x25: ffffff80f0474d70 x24: ffffffc00921d440 
[    4.730998] x23: ffffffc0092ad000 x22: 00000000ffffffff 
[    4.731005] x21: ffffff80f66468a0 x20: ffffffc0091cb6a8 
[    4.731013] x19: 0000000000000000 x18: 0000000000000004 
[    4.731021] x17: 0000000000000fff x16: 0000000000000009 
[    4.731028] x15: ffffff80f6d0b890 x14: ffffff80ef04cca8 
[    4.731035] x13: 0000000000000000 x12: ffffffc010fa5000 
[    4.731043] x11: ffffffc010ea1000 x10: ffffffc010fa5958 
[    4.731051] x9 : 0000000000000000 x8 : 0000000000000003 
[    4.731058] x7 : 0000000000000163 x6 : ffffffc01165b480 
[    4.731066] x5 : 0000000000000001 x4 : ffffff80f79c3150 
[    4.731074] x3 : 0000000000000006 x2 : 0000000000000007 
[    4.731081] x1 : e6d12f7aeb88b200 x0 : 0000000000000000 
[    4.731090] Call trace:
[    4.731099]  sysfs_remove_group+0x94/0xa0
[    4.731401]  amdgpu_ucode_sysfs_fini+0x28/0x38 [amdgpu]
[    4.731692]  amdgpu_device_fini+0x424/0x46c [amdgpu]
[    4.731988]  amdgpu_driver_unload_kms+0x54/0xa8 [amdgpu]
[    4.732297]  amdgpu_driver_load_kms+0x11c/0x178 [amdgpu]
[    4.732405]  drm_dev_register+0x144/0x1c8 [drm]
[    4.732738]  amdgpu_pci_probe+0xe0/0x178 [amdgpu]
[    4.732760]  pci_device_probe+0xb8/0x180
[    4.732769]  really_probe+0xe0/0x330
[    4.732776]  driver_probe_device+0x5c/0xf0
[    4.732783]  device_driver_attach+0x74/0x80
[    4.732790]  __driver_attach+0x64/0xe0
[    4.732800]  bus_for_each_dev+0x84/0xd8
[    4.732806]  driver_attach+0x30/0x40
[    4.732812]  bus_add_driver+0x188/0x1e8
[    4.732819]  driver_register+0x64/0x110
[    4.732828]  __pci_register_driver+0x58/0x68
[    4.733152]  amdgpu_init+0x70/0x7c [amdgpu]
[    4.733165]  do_one_initcall+0x54/0x2b8
[    4.733174]  do_init_module+0x5c/0x230
[    4.733181]  load_module+0x1ddc/0x2078
[    4.733188]  __do_sys_finit_module+0xd0/0xe8
[    4.733195]  __arm64_sys_finit_module+0x28/0x38
[    4.733207]  el0_svc_common.constprop.1+0x98/0x1a0
[    4.733215]  el0_svc_handler+0x34/0xa0
[    4.733223]  el0_svc+0x8/0x204
[    4.733231] ---[ end trace d9b9d6fba13c699e ]---