<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:34;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
span.EmailStyle17
{mso-style-type:personal;
font-family:"Calibri",sans-serif;
color:#1F497D;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:1225601721;
mso-list-type:hybrid;
mso-list-template-ids:-482978792 67698703 67698713 67698715 67698703 67698713 67698715 67698703 67698713 67698715;}
@list l0:level1
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level2
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level3
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l0:level4
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level5
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level6
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l0:level7
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level8
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level9
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
ol
{margin-bottom:0in;}
ul
{margin-bottom:0in;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Hi Frederik,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Network driver has two Interrupts modes:<o:p></o:p></span></p>
<p class="MsoListParagraph" style="text-indent:-.25in;mso-list:l0 level1 lfo1"><![if !supportLists]><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><span style="mso-list:Ignore">1.<span style="font:7.0pt "Times New Roman"">
</span></span></span><![endif]><span dir="LTR"></span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Single queue mode:<o:p></o:p></span></p>
<p class="MsoListParagraph" style="margin-left:1.0in;text-indent:-.25in;mso-list:l0 level2 lfo1">
<![if !supportLists]><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><span style="mso-list:Ignore">a.<span style="font:7.0pt "Times New Roman"">
</span></span></span><![endif]><span dir="LTR"></span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Only one CPU/interrupt handle RX traffic<o:p></o:p></span></p>
<p class="MsoListParagraph" style="margin-left:1.0in;text-indent:-.25in;mso-list:l0 level2 lfo1">
<![if !supportLists]><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><span style="mso-list:Ignore">b.<span style="font:7.0pt "Times New Roman"">
</span></span></span><![endif]><span dir="LTR"></span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Other 4 interrupts is per CPU interrupts and will handle TX done(release of transmitted resources)<o:p></o:p></span></p>
<p class="MsoListParagraph" style="margin-left:1.0in;text-indent:-.25in;mso-list:l0 level2 lfo1">
<![if !supportLists]><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><span style="mso-list:Ignore">c.<span style="font:7.0pt "Times New Roman"">
</span></span></span><![endif]><span dir="LTR"></span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">This mode is default one.<o:p></o:p></span></p>
<p class="MsoListParagraph" style="text-indent:-.25in;mso-list:l0 level1 lfo1"><![if !supportLists]><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><span style="mso-list:Ignore">2.<span style="font:7.0pt "Times New Roman"">
</span></span></span><![endif]><span dir="LTR"></span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Multi queue mode:<o:p></o:p></span></p>
<p class="MsoListParagraph" style="margin-left:1.0in;text-indent:-.25in;mso-list:l0 level2 lfo1">
<![if !supportLists]><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><span style="mso-list:Ignore">a.<span style="font:7.0pt "Times New Roman"">
</span></span></span><![endif]><span dir="LTR"></span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">In this mode you can enable RSS feature:
<a href="https://www.kernel.org/doc/Documentation/networking/scaling.txt">https://www.kernel.org/doc/Documentation/networking/scaling.txt</a><o:p></o:p></span></p>
<p class="MsoListParagraph" style="margin-left:1.0in;text-indent:-.25in;mso-list:l0 level2 lfo1">
<![if !supportLists]><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><span style="mso-list:Ignore">b.<span style="font:7.0pt "Times New Roman"">
</span></span></span><![endif]><span dir="LTR"></span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">In this mode traffic would be distributed between all 4 CPU’s by different hash of 5-Tuple in packet header<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">So to utilize all 4 CPU’s with traffic do the following:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> <o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:4.75pt"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">1. In U-Boot:<o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:4.75pt"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> - Reset board and stop system in boot by hitting on any button<o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:4.75pt"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> - Set multi queue mode:<o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:4.75pt"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal" style="margin-left:4.75pt"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> setevn extra_params mvpp2x.queue_mode=1<o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:4.75pt"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> saveenv<o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:4.75pt"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal" style="margin-left:4.75pt"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> - Press boot to start Linux<o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:4.75pt"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal" style="margin-left:4.75pt"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> 2. In Linux:<o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:4.75pt"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> ifconfig eth2 up<o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:4.75pt"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> ifconfig eth0 up<o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:4.75pt"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal" style="margin-left:4.75pt"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> - Enable RSS hash distribution:<o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:4.75pt"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal" style="margin-left:4.75pt"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> ethtool -K eth2 rxhash on<o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:4.75pt"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> ethtool -K eth0 rxhash on<o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:4.75pt"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal" style="margin-left:4.75pt"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> - Set configuration for 4 cores:<o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:4.75pt"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal" style="margin-left:4.75pt"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> ethtool -X eth2 weight 1 1 1 1<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> ethtool -X eth0 weight 1 1 1 1<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">In Ixia you should create steams with different 5-Tuples, let’s say different source IP address.<b><o:p></o:p></b></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Streams with different 5-Tuples would be distributed to different CPU’s.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Best Regards.<o:p></o:p></span></p>
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></b></p>
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> Macchiato [<a href="mailto:macchiato-bounces@lists.einval.com">mailto:macchiato-bounces@lists.einval.com</a>]
<b>On Behalf Of </b>Frederik Lotter<br>
<b>Sent:</b> Tuesday, January 30, 2018 6:41 PM<br>
<b>To:</b> <a href="mailto:macchiato@lists.einval.com">macchiato@lists.einval.com</a><br>
<b>Subject:</b> [EXT] [Macchiato] Network load balancing interrupt issue?<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="color:red">External Email</span> <o:p></o:p></p>
<div class="MsoNormal" align="center" style="text-align:center">
<hr size="2" width="100%" align="center">
</div>
<div>
<p class="MsoNormal">Hi guys,<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">I apologize if I have this wrong. <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<div>
<p class="MsoNormal">Hi,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">I am using an IXIA packet generator to test the networking interfaces (kernel 4.4.52).<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">It does not seem like the kernel ever spend more than ~25% of processing during packet reads using pcap/tcpdump. I have tried multiple tcpdump instances at once, and my PCAP read loop is threaded over 4 threads.<o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">The basic issue is that only one processor is at 100% system (kernel) utilization, while the other 3 processors are mostly running userspace threads (let’s say at 10% utilization each).<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">This lead me to look at the interrupt handling:<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">cat /proc/interrupts<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">116: 2 0 0 0 ICU 129 Level f2000000.ppv22.eth0.link<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">117: 0 0 0 0 ICU 39 Level f2000000.ppv22.eth0.cpu0<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">118: 0 0 0 0 ICU 43 Level f2000000.ppv22.eth0.cpu1<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">119: 0 0 0 0 ICU 47 Level f2000000.ppv22.eth0.cpu2<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">120: 0 0 0 0 ICU 51 Level f2000000.ppv22.eth0.cpu3<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">121: 0 0 0 0 ICU 55 Level f2000000.ppv22.eth0.rx_shared<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">122: 5 0 0 0 ICU 129 Level f4000000.ppv22.eth1.link<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">123: 0 0 0 0 ICU 39 Level f4000000.ppv22.eth1.cpu0<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">124: 0 0 0 0 ICU 43 Level f4000000.ppv22.eth1.cpu1<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">125: 0 0 93 0 ICU 47 Level f4000000.ppv22.eth1.cpu2<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">126: 0 0 0 14 ICU 51 Level f4000000.ppv22.eth1.cpu3<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">127: 26 0 0 0 ICU 55 Level f4000000.ppv22.eth1.rx_shared<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">128: 2 0 0 0 ICU 128 Level f4000000.ppv22.eth2.link<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">129: 256721 0 0 0 ICU 40 Level f4000000.ppv22.eth2.cpu0<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">130: 0 88767 0 0 ICU 44 Level f4000000.ppv22.eth2.cpu1<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">131: 0 0 12367 0 ICU 48 Level f4000000.ppv22.eth2.cpu2<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">132: 0 0 0 20693 ICU 52 Level f4000000.ppv22.eth2.cpu3<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">133: 1118351 0 0 0 ICU 56 Level f4000000.ppv22.eth2.rx_shared<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">134: 0 0 0 0 ICU 127 Level f4000000.ppv22.eth3.link<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">135: 0 0 0 0 ICU 41 Level f4000000.ppv22.eth3.cpu0<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">136: 0 0 0 0 ICU 45 Level f4000000.ppv22.eth3.cpu1<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">137: 0 0 0 0 ICU 49 Level f4000000.ppv22.eth3.cpu2<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">138: 0 0 0 0 ICU 53 Level f4000000.ppv22.eth3.cpu3<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">139: 0 0 0 0 ICU 57 Level f4000000.ppv22.eth3.rx_shared<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">140: 0 0 0 0 MSI 0 Edge PCIe PME, aerdrv<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">141: 0 0 0 0 pMSI 1024 Edge f26a0000.dma_xor<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">142: 0 0 0 0 pMSI 1280 Edge f26c0000.dma_xor<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">143: 0 0 0 0 pMSI 1536 Edge f46a0000.dma_xor<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">144: 0 0 0 0 pMSI 1792 Edge f46c0000.dma_xor<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">145: 1 1 0 0 MSI 524288 Edge enp1s0np0-lsc<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">146: 0 0 0 0 MSI 524289 Edge enp1s0np0-exn<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">147: 86 0 0 0 MSI 524290 Edge enp1s0np0-rxtx-0<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">148: 0 11 0 0 MSI 524291 Edge enp1s0np0-rxtx-1<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">149: 0 0 14 0 MSI 524292 Edge enp1s0np0-rxtx-2<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">150: 0 0 0 0 MSI 524293 Edge enp1s0np0-rxtx-3<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">IPI0: 62499 15118972 10318390 12673769 Rescheduling interrupts<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">The thing to note here is that eth2 is the management port, and is enabled at startup. The IXIA tests run on eth1 (marvell) and enp1s0np0 (proprietory) NICs. It does not matter which NIC I excercise, the respective NIC generate almost no
interrupts, and it appears that interrupt traffic due to networking<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">always end up with:<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">133: 1118351 0 0 0 ICU 56 Level f4000000.ppv22.eth2.rx_shared<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">and also:<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">IPI0: 62499 15118972 10318390 12673769 Rescheduling interrupts<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Although RES interrupts are somewhat load balanced (although watching it live it is not really actively balanced, but more like switched periodically), while RX traffic appear to all come in on 133.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">This, I believe is causing a serious networking bottleneck.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Any ideas or comments on my observation?<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Regards,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Fred<o:p></o:p></p>
</div>
</div>
</div>
</div>
</body>
</html>