Route10 Firmware 1.4l Released!

I haven’t seen any speed reduction myself but sounds like something’s going on based on that information. If I had to speculate, I’d say one of these two changes could be the culprit or maybe a regression of some sort:

  • Improve hardware acceleration speed.
  • Improve CPU responsiveness on larger sites.

What kind of Internet connection are you using? And how is the Route10 connected to the ISPs equipment? That might give some more information for someone else to chime in or someone from Alta Labs to test and confirm if they see the same behavior.

1 Like

Looks like if I disable hardware acceleration it fixes the problem. Might create other problems, but it fixes this specific issue.

1 Like

Is there a guide available for the OSPF config? The L3 switches in my network are running OSPF which I setup using CLI. Just want to make sure the R10 continues to play nice with them.

I wonder if the Alternate hardware acceleration mode would behave any differently? Just curious if you feel like trying it out.

From the top post it kinda sounds like that’s pending. but I gather that any of the FRR documentation should be relevent here:

Otherwise as far as I can tell it’s all off and unconfigured by default and i that’s the case, I wouldn’t expect any behavior changes if the Route10 has already been in place and working. Granted I haven’t truly looked super closely at it :grinning_face_with_smiling_eyes:

1 Like

thanks so much for your help. I have those docs which I used to configure the switches a long time ago. The previous router was advertising the default gateway, but I had to hard code that part when I got the R10. I want to restore the advertisement without bringing the network down. I thought it might be standard but the R10 has given me problems so I’m a little skittish.

2 Likes

I tried that too and saw the same results as the normal acceleration setting.

2 Likes

Very nice firmware drop!

3 Likes

I would like to configure OSPF. I know the basic commands pretty well - just a question. Is the shell that opens when dynamic routing is accessed the virtual teletype shell? Is it ready to receive OSPF commands or do we have to configure the terminal for global config? I should wait for the tutorial but it’s like giving a kid a toy he’s been wanting and telling him not to play with it yet!! ha

I suspect @Alta-cmb might be able to elaborate on that, so hopefully we can tag him back into the thread for a minute :slight_smile:

1 Like

Thanks! I hope we hear from @Alta-cmb soon - or someone from Alta. My switches are routing ospf well but I have tried several flavors of ospf commands on the Route10 and can’t get it fully configured.

Looks like they’re chatting about it right now if you can hop into the live stream!

@jmszuch Thanks for notifying me of that video. It was helpful but I noticed some nuances that makes the ospf group unique in Route10. Since there are several other settings needed, I hope they put out a tutorial video soon.

2 Likes

No one else is having throughput or performance issues?

i noticed with hardware accel enabled, when I do a throughput test, the cpu stat reported on the UI goes to 52-53%. With hardware accel disable, it only goes to 32-33%.

>20% increase in CPU for the same traffic seems off

Yeah, the Route10’s I have deployed seem to be operating normally, although I don’t have an Internet connection like yours on any of them to try and test that sort of throughput.

Maybe we can ping @Alta-Jeff to see if there have been any reports of similar behavior, although I suspect the recommendation will be to shoot an email directly to support@alta.inc to have someone invited to the site for a closer look

We have not had any reports of throughput degradation. Have you confirmed there are no issues in 1.4k? I have a few intermediate firmwares we could potentially try to see if it is firmware related, if you want to invite me to your site.

2 Likes

I would say I am both seeing throughput degradation and not. It’s rather interesting. My internet connection is 3Gbps symmetrical. I’ve got an Eero connected at 2.5Gbps.

Since the upgrade to this version the Eero built-in speedtest tops out at around 810Mbps down and 685Mbps up. While running the speedtest a ksoftirqd kernel thread hits 25% (with sirq at 25%), consuming an entire core and causing load average to rise. Prior to this version it was 2.45Gbps down, 2.41Gbps up. According to tcpdump the speedtest on the Eero is using UDP packets instead of TCP.

If I run a speedtest on my laptop connected to the Eero over wireless it hits 712Mbps down and 902Mbps up. While doing this there is no noticeable change on the Route10, no ksoftirqd kernel thread popping up, no load average rising, nada.

Moving the Eero to a different physical port makes no difference.

I also ran speedtest on an ethernet connected device and that didn’t exhibit the ksoftirqd CPU consumption either.

It feels as though there is a specific characteristic of the traffic that is causing it to rise up to the host and not be accelerated, resulting in load average rising and bottlenecking throughput based on what a single core can do. This might be why it is fine for others, plus you’d need to have a sufficient internet connection to really notice and hit the single core limit.

I haven’t found anything else from my normal usage (as of yet) that triggers it but will keep poking.

@Alta-Jeff It’s UDP traffic. I was able to reproduce it by using iperf3 with UDP through my internet connection to a public iperf3 instance, specifically:

iperf3 -b 900000000 -u -c iperf3-server-instance-hostname-or-ip

It hit the same limit as the Eero speedtest - before the 900Mbps target, and ksoftirqd hit 25%.

I haven’t used iperf3 a ton, but just out or curiosity, are we sure on that bitrate switch? A couple results from testing internally across vlans:

>iperf3 -b 900000000 -u -c 192.168.0.156
Connecting to host 192.168.0.156, port 5201
[  5] local 10.87.7.187 port 59462 connected to 192.168.0.156 port 5201
[ ID] Interval           Transfer     Bitrate         Total Datagrams
[  5]   0.00-1.01   sec   107 MBytes   892 Mbits/sec  77048
[  5]   1.01-2.00   sec   107 MBytes   900 Mbits/sec  76688
[  5]   2.00-3.01   sec   108 MBytes   902 Mbits/sec  77921
[  5]   3.01-4.01   sec   107 MBytes   898 Mbits/sec  76527
[  5]   4.01-5.00   sec   107 MBytes   899 Mbits/sec  76660
[  5]   5.00-6.01   sec   108 MBytes   900 Mbits/sec  77872
[  5]   6.01-7.01   sec   107 MBytes   902 Mbits/sec  76712
[  5]   7.01-8.00   sec   107 MBytes   899 Mbits/sec  76539
[  5]   8.00-9.01   sec   108 MBytes   901 Mbits/sec  77875
[  5]   9.01-10.01  sec   107 MBytes   900 Mbits/sec  76672
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Jitter    Lost/Total Datagrams
[  5]   0.00-10.01  sec  1.05 GBytes   899 Mbits/sec  0.000 ms  0/770514 (0%)  sender
[  5]   0.00-10.06  sec   510 MBytes   425 Mbits/sec  0.022 ms  404207/770281 (52%)  receiver

But if I set the bitrate to unlimited

iperf3 -b 0 -u -c 192.168.0.156
Connecting to host 192.168.0.156, port 5201
[  5] local 10.87.7.187 port 50354 connected to 192.168.0.156 port 5201
[ ID] Interval           Transfer     Bitrate         Total Datagrams
[  5]   0.00-1.01   sec   257 MBytes  2.13 Gbits/sec  184678
[  5]   1.01-2.01   sec   251 MBytes  2.12 Gbits/sec  179969
[  5]   2.01-3.00   sec   251 MBytes  2.12 Gbits/sec  180539
[  5]   3.00-4.01   sec   261 MBytes  2.18 Gbits/sec  187768
[  5]   4.01-5.00   sec   254 MBytes  2.15 Gbits/sec  182458
[  5]   5.00-6.01   sec   257 MBytes  2.14 Gbits/sec  184579
[  5]   6.01-7.02   sec   259 MBytes  2.16 Gbits/sec  186279
[  5]   7.02-8.01   sec   253 MBytes  2.14 Gbits/sec  182014
[  5]   8.01-9.00   sec   251 MBytes  2.11 Gbits/sec  179938
[  5]   9.00-10.01  sec   206 MBytes  1.71 Gbits/sec  147604
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Jitter    Lost/Total Datagrams
[  5]   0.00-10.01  sec  2.44 GBytes  2.10 Gbits/sec  0.000 ms  0/1795826 (0%)  sender
[  5]   0.00-10.23  sec   508 MBytes   417 Mbits/sec  0.017 ms  1430695/1795764 (80%)  receiver

iperf Done.

Ah, this is actually intentional. We’ve disabled UDP acceleration by default in this release because BitTorrents will waste too many flow slots on acceleration. They don’t have the bandwidth to justify acceleration, and chew through literally thousands of flow slots, even for just a single client.

If you want to enable UDP acceleration again, you can run echo 4 > /cfg/alta_bits and reboot.

1 Like