<div dir="auto"><div>Hi Marcin,<br><br><div class="gmail_quote"><div dir="ltr">On Thu, 19 Apr 2018, 6:42 PM Marcin Wojtas, <<a href="mailto:mw@semihalf.com">mw@semihalf.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi Frederik,<div><br></div><div>In the SD image you sent, grub did not work:</div><div>
<div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration-style:initial;text-decoration-color:initial">error: no such partition.</div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration-style:initial;text-decoration-color:initial">Entering rescue mode...</div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration-style:initial;text-decoration-color:initial">grub rescue></div><br class="m_-7420121060399298978gmail-Apple-interchange-newline">
I saw no kernel/dtb images as well (neither in ubuntu-18.04-kernel-4.16-efi.img, nor in mcbin-sdcard-with-root-mmcblk1p3.img). Anyway, I think I solved the problem. From UEFI, please add 'clk_ignore_unused' to the commandline during boot.</div><div><br></div><div>I noticed some strange regression in the mainline kernel - it resulted in stalls (4.17-rc1 with UEFI dtb and 17-rc1 original dtb, also same behavior when booting from u-boot). Using your UEFI image (booting from SD card
<span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">mcbin-sdcard-with-root-mmcblk1p3.img</span>) I was able to boot my original debian buster and also some v4.15-rc8 kernel to your ubuntu. However mainline 4.17-rc1 go stalls during mount (with and without PCIE plugged). Today I noticed some problems with XHCI clock patches in the mainline, so it's probably a root cause. Anyway <span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">'clk_ignore_unused'<span> helped, so please try and let know.</span></span><br></div><div><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline"><span><br></span></span></div><div><span style="text-align:start;text-indent:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline"><a href="https://pastebin.com/tiPa20cH" target="_blank" rel="noreferrer">https://pastebin.com/tiPa20cH</a><br></span></div><div><span style="text-align:start;text-indent:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline"><br></span></div><div><span style="text-align:start;text-indent:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">FYI, my x4 GT630 PCIE card was always detected with link up and your UEFI image.</span></div></div></blockquote></div></div><div dir="auto"><br></div><div dir="auto">I am so sorry about my broken image. I hope I did not waste too much of your time.</div><div dir="auto"><br></div><div dir="auto">Thank you very much</div><div dir="auto"><br></div><div dir="auto">I will retest and get back to you</div><div dir="auto"><br></div><div dir="auto"><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><span style="text-align:start;text-indent:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline"><br></span></div><div><span style="text-align:start;text-indent:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">Best regards,</span></div><div><span style="text-align:start;text-indent:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">Marcin</span></div><div><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline"><span><br></span></span></div></div><div class="gmail_extra"><br><div class="gmail_quote">2018-04-19 11:24 GMT+02:00 Marcin Wojtas <span dir="ltr"><<a href="mailto:mw@semihalf.com" target="_blank" rel="noreferrer">mw@semihalf.com</a>></span>:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi Frederik,<div><br></div><div>I'm about to burn your mmc image now and let know.</div><div><br></div><div>Best regards,</div><div>Marcin</div></div><div class="m_-7420121060399298978HOEnZb"><div class="m_-7420121060399298978h5"><div class="gmail_extra"><br><div class="gmail_quote">2018-04-19 10:42 GMT+02:00 Frederik Lotter <span dir="ltr"><<a href="mailto:frederik.lotter@netronome.com" target="_blank" rel="noreferrer">frederik.lotter@netronome.com</a>></span>:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi Marcin,<div class="gmail_extra"><br><div class="gmail_quote"><div><div class="m_-7420121060399298978m_2455324348857670973h5">On Fri, Apr 13, 2018 at 11:59 AM, Frederik Lotter <span dir="ltr"><<a href="mailto:frederik.lotter@netronome.com" target="_blank" rel="noreferrer">frederik.lotter@netronome.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi Marcin,<br><div class="gmail_extra"><br><div class="gmail_quote"><div><div class="m_-7420121060399298978m_2455324348857670973m_-3364192276356886431h5">On Wed, Mar 28, 2018 at 12:23 PM, Frederik Lotter <span dir="ltr"><<a href="mailto:frederik.lotter@netronome.com" target="_blank" rel="noreferrer">frederik.lotter@netronome.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote"><div><div class="m_-7420121060399298978m_2455324348857670973m_-3364192276356886431m_6925924317657211281gmail-h5">On Wed, Mar 28, 2018 at 12:11 PM, Marcin Wojtas <span dir="ltr"><<a href="mailto:mw@semihalf.com" target="_blank" rel="noreferrer">mw@semihalf.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote"><div><div class="m_-7420121060399298978m_2455324348857670973m_-3364192276356886431m_6925924317657211281gmail-m_2023056396497693568h5">2018-03-28 12:00 GMT+02:00 Frederik Lotter <span dir="ltr"><<a href="mailto:frederik.lotter@netronome.com" target="_blank" rel="noreferrer">frederik.lotter@netronome.com</a>></span>:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Hi Marcin,<br><div class="gmail_extra"><br><div class="gmail_quote"><div><div class="m_-7420121060399298978m_2455324348857670973m_-3364192276356886431m_6925924317657211281gmail-m_2023056396497693568m_5101687412421480057h5">On Fri, Mar 23, 2018 at 1:38 PM, Frederik Lotter <span dir="ltr"><<a href="mailto:frederik.lotter@netronome.com" target="_blank" rel="noreferrer">frederik.lotter@netronome.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote"><div><div class="m_-7420121060399298978m_2455324348857670973m_-3364192276356886431m_6925924317657211281gmail-m_2023056396497693568m_5101687412421480057m_-4325708089248667456gmail-h5">On Fri, Mar 23, 2018 at 1:02 PM, Marcin Wojtas <span dir="ltr"><<a href="mailto:mw@semihalf.com" target="_blank" rel="noreferrer">mw@semihalf.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Frederik,<br>
<div><div class="m_-7420121060399298978m_2455324348857670973m_-3364192276356886431m_6925924317657211281gmail-m_2023056396497693568m_5101687412421480057m_-4325708089248667456gmail-m_-8943391745495875236h5"><br>
<br>
2018-03-23 11:02 GMT+01:00 Marcin Wojtas <<a href="mailto:mw@semihalf.com" target="_blank" rel="noreferrer">mw@semihalf.com</a>>:<br>
> Hi Frederik,<br>
><br>
> 2018-03-23 8:07 GMT+01:00 Frederik Lotter <<a href="mailto:frederik.lotter@netronome.com" target="_blank" rel="noreferrer">frederik.lotter@netronome.com</a>>:<br>
>><br>
>><br>
>><br>
>> On Fri, Mar 16, 2018 at 5:16 PM, Marcin Wojtas <<a href="mailto:mw@semihalf.com" target="_blank" rel="noreferrer">mw@semihalf.com</a>> wrote:<br>
>>><br>
>>> Hi Frederik,<br>
>>><br>
>>> 2018-03-16 14:04 GMT+01:00 Frederik Lotter <<a href="mailto:frederik.lotter@netronome.com" target="_blank" rel="noreferrer">frederik.lotter@netronome.com</a>>:<br>
>>> ><br>
>>> > On Wed, Mar 14, 2018 at 10:56 AM, Frederik Lotter <<a href="mailto:frederik.lotter@netronome.com" target="_blank" rel="noreferrer">frederik.lotter@netronome.com</a>> wrote:<br>
>>> >><br>
>>> >> On Wed, Mar 14, 2018 at 10:13 AM, Frederik Lotter <<a href="mailto:frederik.lotter@netronome.com" target="_blank" rel="noreferrer">frederik.lotter@netronome.com</a>> wrote:<br>
>>> >>><br>
>>> >>> On Tue, Mar 13, 2018 at 6:23 PM, Marcin Wojtas <<a href="mailto:mw@semihalf.com" target="_blank" rel="noreferrer">mw@semihalf.com</a>> wrote:<br>
>>> >>>><br>
>>> >>>> Frederic,<br>
>>> >>>><br>
>>> >>>> >>> Please use the size I suggested for the 'reg' property<br>
>>> >>>> >><br>
>>> >>>> >><br>
>>> >>>> >> Sorry I missed that:<br>
>>> >>>> >><br>
>>> >>>> >> [ 1.463413] PCI: OF: host bridge /cp0/pcie@0xe0000000 ranges:<br>
>>> >>>> >> [ 1.463427] PCI: OF: IO 0xeff00000..0xeff0ffff -> 0x00000000<br>
>>> >>>> >> [ 1.463435] PCI: OF: MEM 0xc0000000..0xdfffffff -> 0xc0000000<br>
>>> >>>> >> [ 1.463442] PCI: OF: MEM 0x800000000..0x8ffffffff -> 0x800000000<br>
>>> >>>> >> [ 1.463481] pci-host-generic e0000000.pcie: ECAM at [mem<br>
>>> >>>> >> 0xe0000000-0xefefffff] for [bus 00-fe]<br>
>>> >>>> >> [ 1.463525] pci-host-generic e0000000.pcie: PCI host bridge to bus<br>
>>> >>>> >> 0000:00<br>
>>> >>>> >> [ 1.463531] pci_bus 0000:00: root bus resource [bus 00-fe]<br>
>>> >>>> >> [ 1.463536] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]<br>
>>> >>>> >> [ 1.463541] pci_bus 0000:00: root bus resource [mem<br>
>>> >>>> >> 0xc0000000-0xdfffffff]<br>
>>> >>>> >> [ 1.463547] pci_bus 0000:00: root bus resource [mem<br>
>>> >>>> >> 0x800000000-0x8ffffffff]<br>
>>> >>>> >><br>
>>> >>>> >><br>
>>> >>>> >> So I assume this works, and I am super grateful. I will test it tomorrow<br>
>>> >>>> >> with our Smart NIC.<br>
>>> >>>> >><br>
>>> >>>><br>
>>> >>>> Please also check pure branch (unmodified DT) as requested in my<br>
>>> >>>> previous email . According to the bootlog the stall was observed after<br>
>>> >>>> pcie driver init and without latest patch I mentioned. So I'd like to<br>
>>> >>>> make sure that we're on the same side here.<br>
>>> >>><br>
>>> >>><br>
>>> >>> I attached two logs files. The only difference is the one also uses an initrd.<br>
>>> >>><br>
>>> >>> I now have a pcie card in - and it looks much better.<br>
>>> >>><br>
>>> >>> I am starting to feel like this whole exercise is going to discover something unrelated and stupid I have done, so I apologize in advance. Hopefully the journey will help someone else as well.<br>
>>> >>><br>
>>> >>> Any idea what could be failing? I seem to be some issue mounting the root filesystem (or at the same time). In the initrd case it seems to complain about mmcblk0 (the onboard flash which I do not use).<br>
>>> >>><br>
>>> >>> I attach my grub file just for in case - i am new to grub (Note I hacked 4 entries towards the end).<br>
>>> >><br>
>>> >><br>
>>> >> Here are 3 more logs, I will not send more - but I thought perhaps this could complete the picture.<br>
>>> >><br>
>>> >> 1. One without a PCIe card - successful PCIe init<br>
>>> >><br>
>>> >> 2. One with a card, but with the PCIe probe causing the stall (this is not often seen)<br>
>>> >><br>
>>> >> 3. The other stall, after successful PCIe init<br>
>>> ><br>
>>> ><br>
>>> > Hi Marcin,<br>
>>> ><br>
>>> > I am sure you are quite busy, and I really appreciate all the help I got from you.<br>
>>> ><br>
>>> > Please will you have a look at the last two emails (and the attachments) I've sent you, once you have time again. If there is anything I can do that will help you, just let me know. I really need to get this working reliably for us to proceed with the EFI boot route, and since we really need to support generic netboot/ISO installs and images for CentOS and Ubuntu, I think this must be the best way forward.<br>
>>> ><br>
>>><br>
>>> I took a look at your logs and it all looks a bit strange. Is it pure<br>
>>> v4.16-rc5? If yes, can you avoid grub and boot directly from shell?<br>
>><br>
>><br>
>> Could you give me a hint how I do this? I am very new to EDK/grub?<br>
><br>
> When booting, hit escape. Go to "Boot Manager" and then to "UEFI<br>
> Shell". Navigate to partition, which comprises your Linux Image (let's<br>
> assume it's FS0):<br>
> Shell> fs0:<br>
> FS0:\> Image <commandline arguments><br>
><br>
> Example:<br>
><br>
> <a href="https://pastebin.com/rzk9uzAx" rel="noreferrer noreferrer" target="_blank">https://pastebin.com/rzk9uzAx</a></div></div></blockquote></div></div></div></div></div></blockquote><div><br></div></div></div><div>This does not work for me because EDK does not have a working alias for mmcblk1p3. In the past I had the EFI System partition last, but now I have the Linux Filesystem last (not sure if this is confusing EDK)</div><div><br></div><div><div>Mapping table</div><div> FS0: Alias(s):HD4c:;BLK5:</div><div> VenHw(0D51905B-B77E-452A-A2C0-ECA0CC8D514A,000078F20000000000)/SD(0x0)</div><div>/HD(2,GPT,82F4BCFA-CC74-4966-A5BB-3206A1D4B694,0x11000,0x64000)</div><div> FS1: Alias(s):F0:;BLK7:</div><div> VenMsg(06ED4DD0-FF78-11D3-BDC4-00A0C94053D1,0200000000000000)</div><div> BLK0: Alias(s):</div><div> VenHw(0D51905B-B77E-452A-A2C0-ECA0CC8D514A,00006EF00000000000)/eMMC(0x</div><div>0)/Ctrl(0x0)</div><div> BLK1: Alias(s):</div><div> VenHw(0D51905B-B77E-452A-A2C0-ECA0CC8D514A,00006EF00000000000)/eMMC(0x</div><div>0)/Ctrl(0x1)</div><div> BLK2: Alias(s):</div><div> VenHw(0D51905B-B77E-452A-A2C0-ECA0CC8D514A,00006EF00000000000)/eMMC(0x</div><div>0)/Ctrl(0x2)</div><div> BLK3: Alias(s):</div><div> VenHw(0D51905B-B77E-452A-A2C0-ECA0CC8D514A,000078F20000000000)/SD(0x0)</div><div><br></div><div> BLK4: Alias(s):</div><div> VenHw(0D51905B-B77E-452A-A2C0-ECA0CC8D514A,000078F20000000000)/SD(0x0)</div><div>/HD(1,GPT,3AA5DACC-F435-43FF-828F-A6374A093D21,0x1000,0x10000)</div><div> BLK6: Alias(s):</div><div> VenHw(0D51905B-B77E-452A-A2C0-ECA0CC8D514A,000078F20000000000)/SD(0x0)</div><div>/HD(3,GPT,7E0D3DE0-AD08-4599-9AA3-164B3D83EA0D,0x75000,0x6EDBDF)</div></div><div><br></div><div>The Image is on BLK6: which I cannot change to - nothing happens if I type "BLK6:".</div></div></div></div></blockquote><div><br></div></div></div><div>If Image is on EXT partition, EDK won't read it due to lack of support in generic code (FAT is preferred). Any chance you take FAT-formatted USB stick and put binaries there?</div><div><br></div></div></div></div></blockquote><div><br></div></div></div><div>OK I will do this and retest skipping grub. </div><div><br></div><div>I you can have a look at the img i've sent I would appreciate it a lot. Just to have a second pair of eyes on what is happening. </div><div><br></div><div>I will upload another image with /boot mounted on FAT.</div></div></div></div></blockquote><div><br></div><div><br></div></div></div><div>Running 'Image console=ttyS0,115200 root=/dev/mmcblk1p2 rw rootwait' directly from EDK UEFI Shell yields in exactly the same failure.</div><div><br></div><div>However, there appear to be differences (see diff.pdf)</div><div><br></div><div>Can you please help me?</div><div><br></div><div>--------------------------</div><div><br></div><div>Please find the following files attached, and on google drive:</div><div><br></div><div>edk-fail.txt - Boot log when booting directly from EDK<br></div><div>edk-fail.txt.strip - Time stripped version you can use with kdiff<br></div><div>uboot-pass.txt - <span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">Boot log when booting directly from EDK</span>
<br></div><div>uboot-pass.txt.strip - <span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">Time stripped version you can use with kdiff</span>
<br></div><div>diff.pdf - PDF of the kdiff3 output </div><div><br></div><div><a href="https://drive.google.com/drive/folders/1ra8UvI9vFXKlmgmyTd9njtr3v9ib8Ikg?usp=sharing" target="_blank" rel="noreferrer">https://drive.google.com/drive/folders/1ra8UvI9vFXKlmgmyTd9njtr3v9ib8Ikg?usp=sharing</a><br></div><div><br></div><div>--------------------------</div><div><br></div><div>The link above also contains an image you can burn on 4M sdcard. </div><div><br></div><div>Which contains:</div><div><br></div><div>- Latest EDK (branches as used on Macchiatobin website)</div><div>- Stable v4.16 Linux Kernel (using generic 'make defconfig')</div><div>- Ubuntu 18.04 squashfs based server image</div><div><br></div><div>The image has uboot on /dev/mmcblk1p1 (/boot/flash-image-uboot.img)</div><div><br></div><div>Just place with
<span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">/boot/flash-image-efi.img (dd if=/boot/
<span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">flash-image-efi.img of=/dev/mmcblk1p1)</span></span></div><div><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline"><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline"><br></span></span></div><div>If you want to use grub, note that I have modified entries under Advanced which skips the initrd.</div><div><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline"><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline"><br></span></span></div><div><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline"><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">---------------------------</span></span></div></div></div></div></blockquote><div><br></div></div></div><div>I know you must be shuffling a lot of things at once, but any chance you could have a look at this? <br></div><div><br></div><div>I would appreciate it so much.</div><div><div class="m_-7420121060399298978m_2455324348857670973h5"><div><br></div><div> <br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div><div class="m_-7420121060399298978m_2455324348857670973m_-3364192276356886431h5"><div><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div><div class="m_-7420121060399298978m_2455324348857670973m_-3364192276356886431m_6925924317657211281gmail-h5"><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div></div><div>Best regards,</div><div>Marcin</div><div><div class="m_-7420121060399298978m_2455324348857670973m_-3364192276356886431m_6925924317657211281gmail-m_2023056396497693568h5"><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><span><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div><div class="m_-7420121060399298978m_2455324348857670973m_-3364192276356886431m_6925924317657211281gmail-m_2023056396497693568m_5101687412421480057m_-4325708089248667456gmail-h5"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div><div class="m_-7420121060399298978m_2455324348857670973m_-3364192276356886431m_6925924317657211281gmail-m_2023056396497693568m_5101687412421480057m_-4325708089248667456gmail-m_-8943391745495875236h5"><br>
><br>
><br>
>><br>
>>><br>
>>><br>
>>> Can you share your grub? I'd like to test it in my setup.<br></div></div></blockquote></div></div></div></div></div></blockquote><div><br></div></span><div>I think the easiest will be if you flash this image on your sdcard. </div><div><br></div><div><a href="https://drive.google.com/open?id=1qqGfgFw-rcc1d09a2F-BoRgmBnmmqrw5" target="_blank" rel="noreferrer">https://drive.google.com/open?id=1qqGfgFw-rcc1d09a2F-BoRgmBnmmqrw5</a><br></div><div><br></div><div>So I have made the whole image from scratch:<br><br>Userspace: 18.04 Ubuntu-server squashfs</div><div>Kernel: mainline 4.16 rc7 (arm64 generic deconfig)</div><div><br></div><div>
<span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">mmcblk1p1: uboot/EDK image</span><br style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial"><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">mmcblk1p2: ESP </span><br style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial"><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">mmcblk1p3: Ubuntu userspace</span><br style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial">
<br></div><div>The way I did it was to get uboot based boot up, and then I do:<br></div><div><br>apt-get install grub-efi-arm64</div><div>update-grub (creates the grub.cfg)</div><div>grub-install /dev/mmcblk1 --removable (without removable I get some efbootmgr errors related to efivars)</div><div><br></div><div>Either I am the only one trying EFI with custom images, or I am making an obvious mistake (which is likely). However, I have done it so many times now with different permutations, that I have exhausted all possible combinations.</div><div><br></div><div>I would really appreciate it so much if you could just boot the image and inspect it locally.</div><div><br></div><div>(The flash-image.bin was build again from vanilla sources including the latest commits on the usual branches).</div><div><div class="m_-7420121060399298978m_2455324348857670973m_-3364192276356886431m_6925924317657211281gmail-m_2023056396497693568m_5101687412421480057h5"><div><br></div><div><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div><div class="m_-7420121060399298978m_2455324348857670973m_-3364192276356886431m_6925924317657211281gmail-m_2023056396497693568m_5101687412421480057m_-4325708089248667456gmail-h5"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div><div class="m_-7420121060399298978m_2455324348857670973m_-3364192276356886431m_6925924317657211281gmail-m_2023056396497693568m_5101687412421480057m_-4325708089248667456gmail-m_-8943391745495875236h5">>><br>
>><br>
>> Please find the content of my EFI partition and /boot/grub attached. I will really appreciate if you could give it a go.<br>
>><br>
>> I got this grub through apt-get for Ubuntu.<br>
><br>
> Thanks, will try it.<br>
><br>
<br>
</div></div>Where do you take your initrd images from? Any chance you expose your<br>
/boot directory as a tarball, I'd like to run your images as well.<br></blockquote><div><br></div></div></div><div>I really appreciate your effort in helping. </div><div><br></div><div>Sadly I tried to update and start fresh, so I don't currently have a working environment I can share, because I cannot get the vanilla mainline kernel to work on the board (I posted another question about this).</div><div><br></div><div>I will send you my entire setup ASAP.</div><div><div class="m_-7420121060399298978m_2455324348857670973m_-3364192276356886431m_6925924317657211281gmail-m_2023056396497693568m_5101687412421480057m_-4325708089248667456gmail-h5"><div><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><br>
Thanks,<br>
<div class="m_-7420121060399298978m_2455324348857670973m_-3364192276356886431m_6925924317657211281gmail-m_2023056396497693568m_5101687412421480057m_-4325708089248667456gmail-m_-8943391745495875236HOEnZb"><div class="m_-7420121060399298978m_2455324348857670973m_-3364192276356886431m_6925924317657211281gmail-m_2023056396497693568m_5101687412421480057m_-4325708089248667456gmail-m_-8943391745495875236h5">Marcin<br>
<br>
>><br>
>> apt-get install grub-efi-arm64<br>
>><br>
>> Info below:<br>
>><br>
>> root@localhost:/boot# apt-get install grub-efi-arm64<br>
>> Reading package lists... Done<br>
>> Building dependency tree<br>
>> Reading state information... Done<br>
>> grub-efi-arm64 is already the newest version (2.02~beta2-36ubuntu3.17).<br>
>> 0 upgraded, 0 newly installed, 0 to remove and 48 not upgraded.<br>
>> root@localhost:/boot# uname -a<br>
>> Linux localhost.localdomain 4.16.0-rc5-mbcin-netronome-2-dirty #2 SMP PREEMPT Mon Mar 12 14:40:25 UTC 2018 aarch64 aarch64 aarch64 GNU/Linux<br>
>> root@localhost:/boot# cat /etc/os-release<br>
>> NAME="Ubuntu"<br>
>> VERSION="16.04.3 LTS (Xenial Xerus)"<br>
>> ID=ubuntu<br>
>> ID_LIKE=debian<br>
>> PRETTY_NAME="Ubuntu 16.04.3 LTS"<br>
>> VERSION_ID="16.04"<br>
>> HOME_URL="<a href="http://www.ubuntu.com/" rel="noreferrer noreferrer" target="_blank">http://www.ubuntu.com/</a>"<br>
>> SUPPORT_URL="<a href="http://help.ubuntu.com/" rel="noreferrer noreferrer" target="_blank">http://help.ubuntu.com/</a>"<br>
>> BUG_REPORT_URL="<a href="http://bugs.launchpad.net/ubuntu/" rel="noreferrer noreferrer" target="_blank">http://bugs.launchpad.net/ubuntu/</a>"<br>
>> VERSION_CODENAME=xenial<br>
>> UBUNTU_CODENAME=xenial<br>
>><br>
>>><br>
>>><br>
>>> Can you please download:<br>
>>> <a href="https://d-i.debian.org/daily-images/arm64/20180314-02:10/netboot/mini.iso" rel="noreferrer noreferrer" target="_blank">https://d-i.debian.org/daily-images/arm64/20180314-02:10/netboot/mini.iso</a><br>
>>> burn on stick and install? It's very easy and I use it in my GPU setup<br>
>><br>
>><br>
>> OK I will try this but first I want to redo my environment from scratch so make sure I have not messed up anything.<br>
>><br>
>>><br>
>>> on MacchiatoBin.<br>
>>><br>
>>> Thanks,<br>
>>> Marcin<br>
>>><br>
>>> ><br>
>>> >><br>
>>> >>><br>
>>> >>>><br>
>>> >>>> ><br>
>>> >>>> > This doesn't tell you all that much, to be honest. But at least the<br>
>>> >>>> > numbers look sane now, and appear to match the UEFI configuration.<br>
>>> >>>> ><br>
>>> >>>> >> However, we are building a product that obviously requires long term<br>
>>> >>>> >> maintenance, so may I please get your input on a strategy with this?<br>
>>> >>>> >><br>
>>> >>>> >> If we decide to stick with this driver, would it be easy for things to<br>
>>> >>>> >> become disjointed?<br>
>>> >>>> >><br>
>>> >>>> >> The hope with going the EFI route is that we could boot "generic" Ubuntu and<br>
>>> >>>> >> CentOS installs, so I guess as long as we keep the DT and the EFKII snapshot<br>
>>> >>>> >> in sync on our side, the risk is low.<br>
>>> >>>> >><br>
>>> >>>> ><br>
>>> >>>> > I'm afraid you are getting caught in the middle of a philosophical<br>
>>> >>>> > debate here: many engineers that are involved with the Marvell support<br>
>>> >>>> > in Linux feel that a device tree is not something that should be<br>
>>> >>>> > supported long term, and needs to be bundled with the OS. Over the<br>
>>> >>>> > last couple of kernel releases, the Marvell 8040 support was changed<br>
>>> >>>> > in a non-backward compatible manner numerous times.<br>
>>> >>>> ><br>
>>> >>>><br>
>>> >>>> I think current DT should work with everything >= v4.12. So far<br>
>>> >>>> multiple users were able to install debian with recent fixes, I<br>
>>> >>>> suggest first making sure, what possibly can happen that your setup<br>
>>> >>>> behaves differently. Switching to a8k-ecam-pcie driver is a nice idea,<br>
>>> >>>> but I'm not sure the distros using DT have it.<br>
>>> >>>><br>
>>> >>>> > This conflicts badly with the idea that the firmware provides the<br>
>>> >>>> > hardware description (using DT or ACPI), and that the contract with<br>
>>> >>>> > the OS is kept by both sides for longer than a single release.<br>
>>> >>>> ><br>
>>> >>>> > So I cannot really answer that question, unfortunately. If you don't<br>
>>> >>>> > intend to use the onboard network controller, you could go the ACPI<br>
>>> >>>> > route, I guess.<br>
>>> >>>><br>
>>> >>>> FYI. on-board network ACPI support is being upstreamed to the Centos.<br>
>>> >>>><br>
>>> >>>> ><br>
>>> >>>> > Another problem is that none of this UEFI/ACPI support is upstream in<br>
>>> >>>> > the Tianocore project, and trying random trees left and right doesn't<br>
>>> >>>> > really help when assessing whether a platform is suitable as a long<br>
>>> >>>> > term investment.<br>
>>> >>>> ><br>
>>> >>>><br>
>>> >>>> There's only single branch recommended in the MacchiatoBin wiki, I<br>
>>> >>>> wouldn't call it 'random'. Entire branch is supposed to land<br>
>>> >>>> eventually in the Tianocore and become the only support. Before end of<br>
>>> >>>> year ~50 patches got there, still some bits are missing, but I think<br>
>>> >>>> we're not that far from desired point. I really want to push it but<br>
>>> >>>> still it requires time I'm personally short of, so I'll appreciate<br>
>>> >>>> understanding.<br>
>>> >>>><br>
>>> >>>> Thanks,<br>
>>> >>>> Marcin<br>
>>> >>>><br>
>>> >>>> ><br>
>>> >>>> ><br>
>>> >>>> >> For example, using the same DT with uboot, it fails:<br>
>>> >>>> >><br>
>>> >>>> >> [ 0.294942] sysfs: cannot create duplicate filename<br>
>>> >>>> >> '/bus/platform/devices/e0000000.pcie'<br>
>>> >>>> >> [ 0.294950] CPU: 2 PID: 1 Comm: swapper/0 Not tainted<br>
>>> >>>> >> 4.16.0-rc5-mbcin-netronome-2-dirty #2<br>
>>> >>>> >> [ 0.294952] Hardware name: Marvell 8040 MACHIATOBin (DT)<br>
>>> >>>> >> [ 0.294955] Call trace:<br>
>>> >>>> >> [ 0.294967] dump_backtrace+0x0/0x150<br>
>>> >>>> >> [ 0.294970] show_stack+0x14/0x20<br>
>>> >>>> >> [ 0.294976] dump_stack+0x98/0xbc<br>
>>> >>>> >> [ 0.294980] sysfs_warn_dup+0x60/0x78<br>
>>> >>>> >> [ 0.294983] sysfs_do_create_link_sd.isra.0+0xd8/0xe0<br>
>>> >>>> >> [ 0.294986] sysfs_create_link+0x20/0x40<br>
>>> >>>> >> [ 0.294990] bus_add_device+0x88/0x148<br>
>>> >>>> >> [ 0.294993] device_add+0x394/0x568<br>
>>> >>>> >> [ 0.294997] of_device_add+0x5c/0x70<br>
>>> >>>> >> [ 0.295000] of_platform_device_create_pdata+0x80/0xd0<br>
>>> >>>> >> [ 0.295003] of_platform_bus_create+0xdc/0x300<br>
>>> >>>> >> [ 0.295006] of_platform_bus_create+0x11c/0x300<br>
>>> >>>> >> [ 0.295008] of_platform_populate+0x4c/0xb0<br>
>>> >>>> >> [ 0.295014] of_platform_default_populate_init+0xa4/0xc0<br>
>>> >>>> >> [ 0.295017] do_one_initcall+0x38/0x120<br>
>>> >>>> >> [ 0.295020] kernel_init_freeable+0x134/0x1d4<br>
>>> >>>> >> [ 0.295025] kernel_init+0x10/0x100<br>
>>> >>>> >> [ 0.295028] ret_from_fork+0x10/0x18<br>
>>> >>>> >><br>
>>> >>>> >> So I think this confirms that the pcie setup is different between EDKII and<br>
>>> >>>> >> uboot (unless I am doing something stupid here).<br>
>>> >>>> >><br>
>>> >>>> ><br>
>>> >>>> > It looks like you have two copies of the pcie node here, no?<br>
>>> >>><br>
>>> >>><br>
>>> >><br>
>>> ><br>
>><br>
>><br>
</div></div></blockquote></div></div></div><br></div></div>
</blockquote></div></div></div><br></div></div>
</blockquote></div></div></div><br></div></div>
</blockquote></div></div></div><br></div></div>
</blockquote></div></div></div><br></div></div>
</blockquote></div></div></div><br></div></div>
</blockquote></div><br></div>
</div></div></blockquote></div><br></div>
</blockquote></div></div></div>