I have an L3 switch connected to the Route10 with ospf running on both. The L3 switch does the routing and passes the subnets to the router using ospf.
The problem is the Route 10 is not routing on the subnets it received through ospf. I have never run into this before. The routes are entered into the network routing table but NOT the router routing table. I’m stumped! Perhaps @Alta-cmb can weigh in on this. How do I fix this?
In order to not lose connection to the Internet, I had to enter static routes in the router.
Also - Can the frr ospf install on Route 10 do multi-instance? I noticed the instance parameter was not in the daemons dir so I don’t want to do anything to break it.
It sounds like you’ve happened upon a problem I noticed last week, where mwan3’s routing table doesn’t get the OSPF routes, which makes reply traffic from the internet get dropped where you have a router on the LAN like that circumstance. My circumstance also had a blackhole summary route which made that traffic get blackholed, but absent that it’s a similar circumstance with no correct matching route.
The policy routing rule which mwan3 applies for traffic ingressing WAN causing the issue appears to be entirely unnecessary because of marking handled elsewhere and other ‘ip rule’ entries. There are a lot of things that can impact though, and hence potential for edge case bugs. I believe I have that fixed, just working through verifying every potential edge case to make sure.
It’s not something you can easily fix in the mean time, but hopefully today I can confirm the fix is 100% appropriate and we can get a new release out including that in the coming days. FRR isn’t able to manage mwan3’s routing tables as the two would stomp on each other.
@Alta-cmb Thank you so much.!! You are a lifesaver. I followed the video you recorded last week and checked the routes and thought I was good. I pulled the static routes from the route10 and the whole system went down. Scrambling to get it up, I noticed the router routing table was empty. I changed the network type to broadcast since that matches the L3 switch. It worked before using opnsense frr and openwrt frr so I was lost. Please let me know when the fix is in so I can covert my system to ospf.
@Alta-cmb I just wanted to mention this. I have a multi-gig wan and a 10G backbone on the network. I turned on Jumbo Frames and matched the MTU on all switches with the Route10. After doing so I could not form an ospf adjacency to pass the networks to the router. I could not make it work - resetting, rebooting, deleting the config and readding, etc, - nothing worked. I disabled jumbo frames on all units including the route10 and everything started working. the adjacency formed, the network routing table received the networks and the default route will pass to the core switch. I COULD use Jumbo Frames on version 1.4l but not on 1.4m. I don’t know if this helps but I thought it was worth reporting to you.
I want to give a shout-out to @Alta-cmb!!! Great job on ospf routing!! Since 1.4n my network is humming like a nascar track - sweet!! The Route10 is routing on all ospf networks!!
Now - if I could get link aggregation on the Route10 - I need to LAG the SFP+ ports - I would be on cloud 9!!!
Just a quick edit - do you know if it all works with jumbo frames? Don’t want to enable them if there is an issue.