<div dir="ltr">
<div class="gmail-gE gmail-iv gmail-gt" style="padding:12px 0px 3px;font-size:12.8px;color:rgb(34,34,34);font-family:arial,sans-serif;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial"><span style="font-size:12.8px">Hi,</span></div><div class="gmail-gE gmail-iv gmail-gt" style="padding:12px 0px 3px;font-size:12.8px;color:rgb(34,34,34);font-family:arial,sans-serif;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial"><span style="font-size:12.8px">I am getting CPU stall warnings when booting up using the EFI route. I suspect the PCIe interface, as the stall warning sometimes contain the probe function. Other times is seems to get further than PCIe init, but still stall interrupt handling.</span></div><div id="gmail-:lj" class="gmail-ii gmail-gt" style="direction:ltr;margin:5px 15px 0px 0px;padding-bottom:5px;text-align:start;text-indent:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial"><div id="gmail-:mm" class="gmail-a3s gmail-aXjCH gmail-m1621adf61fb85f7d" style="overflow:hidden"><div dir="ltr"><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px">Here are some facts around my observation:</div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px"><br></div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px">I have two sdcards for my Machiattobin board. They have identical kernels (4.16 rc5) with Ubuntu 16.04 rootfs. The one sdcard uses a uboot, DT and kernel boot. The second sdcard has EDKII, grub kernel boot. The EDKII build includes the device tree DTB (and DTS which I believe is unused) from the one used on the uboot sdcard.</div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px"><br></div><div><div><span style="font-size:12.8px">EFI stub: Booting Linux Kernel...</span></div><div><span style="font-size:12.8px">EFI stub: Using DTB from configuration table</span></div><div><span style="font-size:12.8px">EFI stub: Exiting boot services and installing virtual address map...</span></div><div><span style="font-size:12.8px">[ 0.000000] Booting Linux on physical CPU 0x0000000000 [0x410fd081]</span></div><div><span style="font-size:12.8px">[ 0.000000] Linux version 4.16.0-rc5-mbcin-netronome-2-dirty (root@mcb1-cpt) (gcc version 5.4.0 20160609 (Ubuntu/Linaro 5.4.0-6ubuntu1~16.04.9)) #2 SMP PREEMPT Mon Mar 12 14:40:25 UTC 2018</span></div><div><span style="font-size:12.8px">[ 0.000000] Machine model: Marvell 8040 MACHIATOBin</span></div><div><span style="font-size:12.8px">[ 0.000000] efi: Getting EFI parameters from FDT:</span></div><div><span style="font-size:12.8px">[ 0.000000] efi: EFI v2.70 by EDK II</span></div><div><span style="font-size:12.8px">[ 0.000000] efi: SMBIOS 3.0=0xbfd00000 ACPI 2.0=0xb6760000 MEMATTR=0xb8973418 RNG=0xbffdbf98</span></div><div><span style="font-size:12.8px">[ 0.000000] random: fast init done</span></div><div><span style="font-size:12.8px">[ 0.000000] efi: seeding entropy pool</span></div></div><div><span style="font-size:12.8px">:</span></div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px"><br></div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px">(I am using the latest EDKII master, the Marvell edk2-open-platform 17.10 banch, with all the latest mv-ddr/ atf /etc....).</div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px"><br></div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px">The DT data appear there in die EFI boot, but the PCIe interface fails, and results (I believe) in the CPU stall warnings:<br><br><div>[ 717.453025] INFO: rcu_preempt self-detected stall on CPU</div><div>:</div></div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px">:</div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px">[ 717.589783] armada8k_pcie_probe+0x140/<wbr>0x240<br></div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px">:</div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px"><br></div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px">Other times, the pcie gets further:</div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px"><br><div>[ 3.312127] PCI: OF: host bridge /cp0/pcie@f2600000 ranges:</div><div>[ 3.317740] PCI: OF: IO 0xf9000000..0xf900ffff -> 0xf9000000</div><div>[ 3.323692] PCI: OF: MEM 0xc0000000..0xdfffffff -> 0xc0000000</div><div>[ 3.328915] random: crng init done</div><div>[ 4.326158] armada8k-pcie f2600000.pcie: phy link never came up</div><div>[ 4.332109] armada8k-pcie f2600000.pcie: Link not up after reconfiguration</div><div>[ 4.339056] armada8k-pcie f2600000.pcie: PCI host bridge to bus 0000:00</div><div>[ 4.345705] pci_bus 0000:00: root bus resource [bus 00-ff]</div><div>[ 4.351217] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] (bus address [0xf9000000-0xf900ffff])</div><div>[ 4.360741] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xdfffffff]</div><div>[ 4.367659] pci 0000:00:00.0: [11ab:0110] type 01 class 0x060400</div><div>[ 4.373708] pci 0000:00:00.0: reg 0x10: [mem 0x00000000-0x000fffff 64bit]</div><div>[ 4.380562] pci 0000:00:00.0: supports D1 D2</div><div>[ 4.384853] pci 0000:00:00.0: PME# supported from D0 D1 D3hot</div><div>[ 4.390697] pci 0000:00:00.0: bridge configuration invalid ([bus 00-00]), reconfiguring</div><div>[ 4.398771] pci_bus 0000:01: busn_res: [bus 01-ff] end is updated to 01</div><div>[ 4.405427] pci 0000:00:00.0: BAR 0: assigned [mem 0xc0000000-0xc00fffff 64bit]</div><div>[ 4.412776] pci 0000:00:00.0: PCI bridge to [bus 01]</div><div>[ 4.725111] pcieport 0000:00:00.0: Signaling PME with IRQ 56</div><div>[ 4.730842] pcieport 0000:00:00.0: AER enabled with IRQ 56</div><div><br></div><div>but then CPUs are still stalled on some incoming IRQ </div><br></div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px"><div>[ 87.352768] dump_backtrace+0x0/0x150</div><div>[ 87.356445] show_stack+0x14/0x20</div><div>[ 87.359773] sched_show_task+0x14c/0x170</div><div>[ 87.363711] dump_cpu_task+0x40/0x50</div><div>[ 87.367300] rcu_dump_cpu_stacks+0x94/0xd8</div><div>[ 87.371412] rcu_check_callbacks+0x7ac/<wbr>0x980</div><div>[ 87.375700] update_process_times+0x2c/0x58</div><div>[ 87.379900] tick_sched_handle.isra.5+0x30/<wbr>0x50</div><div>[ 87.384449] tick_sched_timer+0x40/0x90</div><div>[ 87.388301] __hrtimer_run_queues+0x124/<wbr>0x198</div><div>[ 87.392676] hrtimer_interrupt+0xe4/0x240</div><div>[ 87.396701] arch_timer_handler_phys+0x30/<wbr>0x40</div><div>[ 87.401163] handle_percpu_devid_irq+0x78/<wbr>0x130</div><div>[ 87.405712] generic_handle_irq+0x24/0x38</div><div>[ 87.409738] __handle_domain_irq+0x5c/0xb8</div><div>[ 87.413850] gic_handle_irq+0x58/0xb0</div><div>[ 87.417526] el1_irq+0xb0/0x128</div><div>[ 87.420678] __do_softirq+0xb0/0x228</div><div>[ 87.424267] irq_exit+0xbc/0xf0</div><div>[ 87.427421] __handle_domain_irq+0x60/0xb8</div><div>[ 87.431533] gic_handle_irq+0x58/0xb0</div><div>[ 87.435209] el1_irq+0xb0/0x128</div></div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px"><br></div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px">Is anyone aware of any issue like this?</div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px"><br></div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px">Regards,</div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px">Fred</div></div></div></div>
<br></div>