Netgate SG-1000 microFirewall

Author Topic: LAG and CARP issue after a firewall restart  (Read 299 times)

0 Members and 1 Guest are viewing this topic.

Offline mistral

  • Newbie
  • *
  • Posts: 9
  • Karma: +0/-0
    • View Profile
LAG and CARP issue after a firewall restart
« on: December 27, 2017, 06:23:47 am »
Hi,

We are experiencing some issue with PfSesne every time we reboot the firewall.

This is how our network looks like.

We have two AT switches in the stack and two PfSense firewalls (we bought original PfSense hardware ).
Three ISP are connected to two AT switches and through one port connected to WAN in the firewall.
On Firewall I have created LAGG_1 on igb1 and igb2 then I have created three VLAN's for three different ISP's and assigned these VLANs to LAGG_1, after that created three interfaces for three Internet connection (all of this you can see in attachment named "LAGG.png)
The same is done for LAN and all others VLAN's are assigned to LAGG_2.
Every time we restart firewall all VLANs are inactive and under CARP option all VLANs are displayed with a question mark (?).
To fix this I have to connect to LAN port directly to PfSense firewall and then open all VLANs and save them individually.
After that everything works fine.

This is happening just for VLAN that are assigned to LAGG 2 that is going through LAN interface.

Maybe I have missed something or It's a bug?
« Last Edit: April 16, 2018, 10:13:49 am by Derelict »

Offline mistral

  • Newbie
  • *
  • Posts: 9
  • Karma: +0/-0
    • View Profile
Re: LAG and CAPR issue after a firewall restart
« Reply #1 on: January 30, 2018, 05:36:48 am »
Whenever I reboot my firewall all of VLAN's are down. I have to connect to LAN interface and save all VLANs again.
Had anyone this problem?

Offline Derelict

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 10260
  • Karma: +1177/-313
    • View Profile
Re: LAG and CAPR issue after a firewall restart
« Reply #2 on: January 30, 2018, 02:51:41 pm »
What version are you running?
Las Vegas, Nevada, USA
Use this diagram to describe your issue.
The pfSense Book is now available for just $24.70!
Do Not PM For Help! NO_WAN_EGRESSTM

Offline mistral

  • Newbie
  • *
  • Posts: 9
  • Karma: +0/-0
    • View Profile
Re: LAG and CAPR issue after a firewall restart
« Reply #3 on: February 21, 2018, 01:09:18 pm »
Sorry for the late reply.
We are on the latest version, 2.4.2-RELEASE-p1, and our hardware is Netgate SG-8860

Offline Derelict

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 10260
  • Karma: +1177/-313
    • View Profile
Re: LAG and CAPR issue after a firewall restart
« Reply #4 on: February 21, 2018, 01:43:47 pm »
No. Nothing like that reported by anyone else.

I would start by taking a copy of the output from ifconfig -a if that happens again. Before and after the edit/save that you say fixes it.
Las Vegas, Nevada, USA
Use this diagram to describe your issue.
The pfSense Book is now available for just $24.70!
Do Not PM For Help! NO_WAN_EGRESSTM

Offline mistral

  • Newbie
  • *
  • Posts: 9
  • Karma: +0/-0
    • View Profile
Re: LAG and CAPR issue after a firewall restart
« Reply #5 on: April 16, 2018, 08:36:15 am »
Sorry, it took me a long time. We moved our offices and it was the perfect time to make ifconfig -a and post result.
Thanks for your help

This is the state after the restart
All VLANs are inactive and under CARP option all VLANs are displayed with a question mark (?).
Quote
[2.4.2-RELEASE][root@marwa.mistral.ba]/root: ifconfig
igb0: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 14                                                                             50
        options=4400b8<VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,VLAN_HWTSO,                                                                             TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:48
        hwaddr 00:08:a2:0b:dc:48
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        media: Ethernet autoselect (1000baseT <full-duplex>)
        status: active
igb1: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 15                                                                             00
        options=4500b8<VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,VLAN_HWFILT                                                                             ER,VLAN_HWTSO,TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:49
        hwaddr 00:08:a2:0b:dc:49
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        media: Ethernet autoselect (1000baseT <full-duplex>)
        status: active
igb2: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 15                                                                             00
        options=4500b8<VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,VLAN_HWFILT                                                                             ER,VLAN_HWTSO,TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:49
        hwaddr 00:08:a2:0b:dc:44
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        media: Ethernet autoselect (1000baseT <full-duplex>)
        status: active
igb3: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 14                                                                             50
        options=4400b8<VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,VLAN_HWTSO,                                                                             TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:48
        hwaddr 00:08:a2:0b:dc:45
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        media: Ethernet autoselect (1000baseT <full-duplex>)
        status: active
igb4: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=4400b8<VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,VLAN_HWTSO,                                                                             TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:46
        hwaddr 00:08:a2:0b:dc:46
        inet6 fe80::208:a2ff:fe0b:dc46%igb4 prefixlen 64 scopeid 0x5
        inet 2.2.2.2 netmask 0xfffffffc broadcast 2.2.2.3
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        media: Ethernet autoselect (1000baseT <full-duplex>)
        status: active
igb5: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=6403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCS                                                                             UM,TSO4,TSO6,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:47
        hwaddr 00:08:a2:0b:dc:47
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: no carrier
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
        options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
        inet6 ::1 prefixlen 128
        inet6 fe80::1%lo0 prefixlen 64 scopeid 0x7
        inet 127.0.0.1 netmask 0xff000000
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        groups: lo
enc0: flags=0<> metric 0 mtu 1536
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        groups: enc
pflog0: flags=100<PROMISC> metric 0 mtu 33160
        groups: pflog
pfsync0: flags=41<UP,RUNNING> metric 0 mtu 1500
        groups: pfsync
        pfsync: syncdev: igb4 syncpeer: 2.2.2.1 maxupd: 128 defer: off
        syncok: 1
lagg0: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1                                                                             500
        options=4500b8<VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,VLAN_HWFILT                                                                             ER,VLAN_HWTSO,TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:49
        inet6 fe80::208:a2ff:fe0b:dc49%lagg0 prefixlen 64 scopeid 0xb
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: active
        groups: lagg
        laggproto failover lagghash l2,l3,l4
        laggport: igb1 flags=5<MASTER,ACTIVE>
        laggport: igb2 flags=0<>
lagg1.50: flags=8903<UP,BROADCAST,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=400000<TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:48
        inet6 fe80::208:a2ff:fe0b:dc48%lagg1.50 prefixlen 64 tentative scopeid 0                                                                             xd
        inet 192.168.50.3 netmask 0xffffff00 broadcast 192.168.50.255
        inet 192.168.50.1 netmask 0xffffff00 broadcast 192.168.50.255 vhid 5
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        vlan: 0 vlanpcp: 0 parent interface: <none>
        carp: INIT vhid 5 advbase 1 advskew 100
        groups: vlan
lagg1.20: flags=8903<UP,BROADCAST,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=400000<TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:48
        inet6 fe80::208:a2ff:fe0b:dc48%lagg1.20 prefixlen 64 tentative scopeid 0                                                                             xe
        inet 192.168.20.3 netmask 0xfffffc00 broadcast 192.168.23.255
        inet 192.168.20.1 netmask 0xfffffc00 broadcast 192.168.23.255 vhid 6
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        vlan: 0 vlanpcp: 0 parent interface: <none>
        carp: INIT vhid 6 advbase 1 advskew 100
        groups: vlan
lagg1.30: flags=8903<UP,BROADCAST,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=400000<TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:48
        inet6 fe80::208:a2ff:fe0b:dc48%lagg1.30 prefixlen 64 tentative scopeid 0                                                                             xf
        inet 192.168.30.3 netmask 0xffffff00 broadcast 192.168.30.255
        inet 192.168.30.1 netmask 0xffffff00 broadcast 192.168.30.255 vhid 7
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        vlan: 0 vlanpcp: 0 parent interface: <none>
        carp: INIT vhid 7 advbase 1 advskew 100
        groups: vlan
lagg1.40: flags=8903<UP,BROADCAST,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=400000<TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:48
        inet6 fe80::208:a2ff:fe0b:dc48%lagg1.40 prefixlen 64 tentative scopeid 0                                                                             x10
        inet 192.168.40.3 netmask 0xfffffe00 broadcast 192.168.41.255
        inet 192.168.40.1 netmask 0xfffffe00 broadcast 192.168.41.255 vhid 8
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        vlan: 0 vlanpcp: 0 parent interface: <none>
        carp: INIT vhid 8 advbase 1 advskew 100
        groups: vlan
lagg1.100: flags=8903<UP,BROADCAST,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=400000<TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:48
        inet6 fe80::208:a2ff:fe0b:dc48%lagg1.100 prefixlen 64 tentative scopeid                                                                              0x11
        inet 10.0.100.3 netmask 0xffffff00 broadcast 10.0.100.255
        inet 10.0.100.1 netmask 0xffffff00 broadcast 10.0.100.255 vhid 9
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        vlan: 0 vlanpcp: 0 parent interface: <none>
        carp: INIT vhid 9 advbase 1 advskew 100
        groups: vlan
lagg1.130: flags=8903<UP,BROADCAST,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=400000<TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:48
        inet6 fe80::208:a2ff:fe0b:dc48%lagg1.130 prefixlen 64 tentative scopeid                                                                              0x12
        inet 10.0.130.3 netmask 0xffffff00 broadcast 10.0.130.255
        inet 10.0.130.1 netmask 0xffffff00 broadcast 10.0.130.255 vhid 11
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        vlan: 0 vlanpcp: 0 parent interface: <none>
        carp: INIT vhid 11 advbase 1 advskew 100
        groups: vlan
lagg1.60: flags=8903<UP,BROADCAST,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=400000<TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:48
        inet6 fe80::208:a2ff:fe0b:dc48%lagg1.60 prefixlen 64 tentative scopeid 0                                                                             x13
        inet 192.168.60.3 netmask 0xffffff00 broadcast 192.168.60.255
        inet 192.168.60.1 netmask 0xffffff00 broadcast 192.168.60.255 vhid 13
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        vlan: 0 vlanpcp: 0 parent interface: <none>
        carp: INIT vhid 13 advbase 1 advskew 200
        groups: vlan
lagg1.140: flags=8903<UP,BROADCAST,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=400000<TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:48
        inet6 fe80::208:a2ff:fe0b:dc48%lagg1.140 prefixlen 64 tentative scopeid                                                                              0x14
        inet 10.0.140.3 netmask 0xffffff00 broadcast 10.0.140.255
        inet 10.0.140.1 netmask 0xffffff00 broadcast 10.0.140.255 vhid 15
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        vlan: 0 vlanpcp: 0 parent interface: <none>
        carp: INIT vhid 15 advbase 1 advskew 100
        groups: vlan
lagg1.160: flags=8903<UP,BROADCAST,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=400000<TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:48
        inet6 fe80::208:a2ff:fe0b:dc48%lagg1.160 prefixlen 64 tentative scopeid                                                                              0x15
        inet 10.0.160.3 netmask 0xffffff00 broadcast 10.0.160.255
        inet 10.0.160.1 netmask 0xffffff00 broadcast 10.0.160.255 vhid 18
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        vlan: 0 vlanpcp: 0 parent interface: <none>
        carp: INIT vhid 18 advbase 1 advskew 100
        groups: vlan
lagg1.170: flags=8903<UP,BROADCAST,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=400000<TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:48
        inet6 fe80::208:a2ff:fe0b:dc48%lagg1.170 prefixlen 64 tentative scopeid                                                                              0x16
        inet 10.0.170.3 netmask 0xffffff00 broadcast 10.0.170.255
        inet 10.0.170.1 netmask 0xffffff00 broadcast 10.0.170.255 vhid 21
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        vlan: 0 vlanpcp: 0 parent interface: <none>
        carp: INIT vhid 21 advbase 1 advskew 100
        groups: vlan
lagg1.200: flags=8903<UP,BROADCAST,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=400000<TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:48
        inet6 fe80::208:a2ff:fe0b:dc48%lagg1.200 prefixlen 64 tentative scopeid                                                                              0x17
        inet 10.0.200.3 netmask 0xffffff00 broadcast 10.0.200.255
        inet 10.0.200.1 netmask 0xffffff00 broadcast 10.0.200.255 vhid 35
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        vlan: 0 vlanpcp: 0 parent interface: <none>
        carp: INIT vhid 35 advbase 1 advskew 100
        groups: vlan
lagg1.210: flags=8903<UP,BROADCAST,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=400000<TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:48
        inet6 fe80::208:a2ff:fe0b:dc48%lagg1.210 prefixlen 64 tentative scopeid                                                                              0x18
        inet 10.0.210.3 netmask 0xffffff00 broadcast 10.0.210.255
        inet 10.0.210.1 netmask 0xffffff00 broadcast 10.0.210.255 vhid 32
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        vlan: 0 vlanpcp: 0 parent interface: <none>
        carp: INIT vhid 32 advbase 1 advskew 100
        groups: vlan
lagg0.1001: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0                                                                              mtu 1500
        options=400000<TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:49
        inet6 fe80::208:a2ff:fe0b:dc49%lagg0.1001 prefixlen 64 scopeid 0x19
        inet 85.158.33.62 netmask 0xffffffe0 broadcast 85.158.33.63
        inet 85.158.33.34 netmask 0xffffffe0 broadcast 85.158.33.63 vhid 14
        inet 85.158.33.38 netmask 0xffffffe0 broadcast 85.158.33.63 vhid 17
        inet 85.158.33.41 netmask 0xffffffe0 broadcast 85.158.33.63 vhid 24
        inet 85.158.33.42 netmask 0xffffffe0 broadcast 85.158.33.63 vhid 29
        inet 85.158.33.43 netmask 0xffffffe0 broadcast 85.158.33.63 vhid 30
        inet 85.158.33.44 netmask 0xffffffe0 broadcast 85.158.33.63 vhid 33
        inet 85.158.33.46 netmask 0xffffffe0 broadcast 85.158.33.63 vhid 36
        inet 85.158.33.36 netmask 0xffffffe0 broadcast 85.158.33.63 vhid 37
        inet 85.158.33.37 netmask 0xffffffe0 broadcast 85.158.33.63 vhid 38
        inet 85.158.33.45 netmask 0xffffffe0 broadcast 85.158.33.63 vhid 39
        inet 85.158.33.47 netmask 0xffffffff broadcast 85.158.33.47 vhid 40
        inet 85.158.33.48 netmask 0xffffffe0 broadcast 85.158.33.63 vhid 41
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: active
        vlan: 1001 vlanpcp: 0 parent interface: lagg0
        carp: MASTER vhid 14 advbase 1 advskew 100
        carp: MASTER vhid 17 advbase 1 advskew 100
        carp: MASTER vhid 24 advbase 1 advskew 100
        carp: MASTER vhid 29 advbase 1 advskew 100
        carp: MASTER vhid 30 advbase 1 advskew 100
        carp: MASTER vhid 33 advbase 1 advskew 100
        carp: MASTER vhid 36 advbase 1 advskew 100
        carp: MASTER vhid 37 advbase 1 advskew 100
        carp: MASTER vhid 38 advbase 1 advskew 100
        carp: MASTER vhid 39 advbase 1 advskew 100
        carp: MASTER vhid 40 advbase 1 advskew 100
        carp: MASTER vhid 41 advbase 1 advskew 100
        groups: vlan
lagg0.1002: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=400000<TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:49
        inet6 fe80::208:a2ff:fe0b:dc49%lagg0.1002 prefixlen 64 scopeid 0x1a
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: active
        vlan: 1002 vlanpcp: 0 parent interface: lagg0
        groups: vlan
lagg0.1003: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0                                                                              mtu 1500
        options=400000<TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:49
        inet6 fe80::208:a2ff:fe0b:dc49%lagg0.1003 prefixlen 64 scopeid 0x1b
        inet 77.221.1.172 netmask 0xfffffff8 broadcast 77.221.1.175
        inet 77.221.1.170 netmask 0xfffffff8 broadcast 77.221.1.175 vhid 3
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: active
        vlan: 1003 vlanpcp: 0 parent interface: lagg0
        carp: MASTER vhid 3 advbase 1 advskew 100
        groups: vlan
lagg1.150: flags=8903<UP,BROADCAST,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=400000<TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:48
        inet6 fe80::208:a2ff:fe0b:dc48%lagg1.150 prefixlen 64 tentative scopeid                                                                              0x1c
        inet 10.0.150.3 netmask 0xffffff00 broadcast 10.0.150.255
        inet 10.0.150.1 netmask 0xffffff00 broadcast 10.0.150.255 vhid 16
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        vlan: 0 vlanpcp: 0 parent interface: <none>
        carp: INIT vhid 16 advbase 1 advskew 100
        groups: vlan
lagg1.180: flags=8903<UP,BROADCAST,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=400000<TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:48
        inet6 fe80::208:a2ff:fe0b:dc48%lagg1.180 prefixlen 64 tentative scopeid                                                                              0x1d
        inet 10.0.180.3 netmask 0xffffff00 broadcast 10.0.180.255
        inet 10.0.180.1 netmask 0xffffff00 broadcast 10.0.180.255 vhid 12
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        vlan: 0 vlanpcp: 0 parent interface: <none>
        carp: INIT vhid 12 advbase 1 advskew 100
        groups: vlan
lagg1: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1                                                                             450
        options=4400b8<VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,VLAN_HWTSO,                                                                             TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:48
        inet6 fe80::208:a2ff:fe0b:dc48%lagg1 prefixlen 64 scopeid 0xc
        inet 10.0.110.3 netmask 0xffffff00 broadcast 10.0.110.255
        inet 10.0.110.1 netmask 0xffffff00 broadcast 10.0.110.255 vhid 4
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: active
        carp: BACKUP vhid 4 advbase 1 advskew 100
        groups: lagg
        laggproto lacp lagghash l2,l3,l4
        laggport: igb0 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING>
        laggport: igb3 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING>
ovpns7: flags=8051<UP,POINTOPOINT,RUNNING,MULTICAST> metric 0 mtu 1500
        options=80000<LINKSTATE>
        inet6 fe80::208:a2ff:fe0b:dc46%ovpns7 prefixlen 64 scopeid 0x1e
        inet 172.16.50.1 --> 172.16.50.2  netmask 0xffffff00
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        groups: tun openvpn
        Opened by PID 20844
ovpns2: flags=8051<UP,POINTOPOINT,RUNNING,MULTICAST> metric 0 mtu 1500
        options=80000<LINKSTATE>
        inet6 fe80::208:a2ff:fe0b:dc46%ovpns2 prefixlen 64 scopeid 0x1f
        inet 172.16.20.1 --> 172.16.20.2  netmask 0xffffff00
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        groups: tun openvpn
        Opened by PID 26080









This is the state after I open all VLANs and save them individually.

Quote
[2.4.2-RELEASE][root@marwa.mistral.ba]/root: ifconfig
igb0: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1450
        options=4500b8<VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,VLAN_HWFILTER,VLAN_HWTSO,TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:48
        hwaddr 00:08:a2:0b:dc:48
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        media: Ethernet autoselect (1000baseT <full-duplex>)
        status: active
igb1: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=4500b8<VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,VLAN_HWFILTER,VLAN_HWTSO,TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:49
        hwaddr 00:08:a2:0b:dc:49
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        media: Ethernet autoselect (1000baseT <full-duplex>)
        status: active
igb2: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=4500b8<VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,VLAN_HWFILTER,VLAN_HWTSO,TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:49
        hwaddr 00:08:a2:0b:dc:44
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        media: Ethernet autoselect (1000baseT <full-duplex>)
        status: active
igb3: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1450
        options=4500b8<VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,VLAN_HWFILTER,VLAN_HWTSO,TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:48
        hwaddr 00:08:a2:0b:dc:45
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        media: Ethernet autoselect (1000baseT <full-duplex>)
        status: active
igb4: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=4400b8<VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,VLAN_HWTSO,TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:46
        hwaddr 00:08:a2:0b:dc:46
        inet6 fe80::208:a2ff:fe0b:dc46%igb4 prefixlen 64 scopeid 0x5
        inet 2.2.2.2 netmask 0xfffffffc broadcast 2.2.2.3
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        media: Ethernet autoselect (1000baseT <full-duplex>)
        status: active
igb5: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=6403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:47
        hwaddr 00:08:a2:0b:dc:47
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: no carrier
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
        options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
        inet6 ::1 prefixlen 128
        inet6 fe80::1%lo0 prefixlen 64 scopeid 0x7
        inet 127.0.0.1 netmask 0xff000000
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        groups: lo
enc0: flags=0<> metric 0 mtu 1536
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        groups: enc
pflog0: flags=100<PROMISC> metric 0 mtu 33160
        groups: pflog
pfsync0: flags=41<UP,RUNNING> metric 0 mtu 1500
        groups: pfsync
        pfsync: syncdev: igb4 syncpeer: 2.2.2.1 maxupd: 128 defer: off
        syncok: 1
lagg0: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=4500b8<VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,VLAN_HWFILTER,VLAN_HWTSO,TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:49
        inet6 fe80::208:a2ff:fe0b:dc49%lagg0 prefixlen 64 scopeid 0xb
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: active
        groups: lagg
        laggproto failover lagghash l2,l3,l4
        laggport: igb1 flags=5<MASTER,ACTIVE>
        laggport: igb2 flags=0<>
lagg0.1001: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=400000<TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:49
        inet6 fe80::208:a2ff:fe0b:dc49%lagg0.1001 prefixlen 64 scopeid 0x19
        inet 85.158.33.62 netmask 0xffffffe0 broadcast 85.158.33.63
        inet 85.158.33.34 netmask 0xffffffe0 broadcast 85.158.33.63 vhid 14
        inet 85.158.33.38 netmask 0xffffffe0 broadcast 85.158.33.63 vhid 17
        inet 85.158.33.41 netmask 0xffffffe0 broadcast 85.158.33.63 vhid 24
        inet 85.158.33.42 netmask 0xffffffe0 broadcast 85.158.33.63 vhid 29
        inet 85.158.33.43 netmask 0xffffffe0 broadcast 85.158.33.63 vhid 30
        inet 85.158.33.44 netmask 0xffffffe0 broadcast 85.158.33.63 vhid 33
        inet 85.158.33.46 netmask 0xffffffe0 broadcast 85.158.33.63 vhid 36
        inet 85.158.33.36 netmask 0xffffffe0 broadcast 85.158.33.63 vhid 37
        inet 85.158.33.37 netmask 0xffffffe0 broadcast 85.158.33.63 vhid 38
        inet 85.158.33.45 netmask 0xffffffe0 broadcast 85.158.33.63 vhid 39
        inet 85.158.33.47 netmask 0xffffffff broadcast 85.158.33.47 vhid 40
        inet 85.158.33.48 netmask 0xffffffe0 broadcast 85.158.33.63 vhid 41
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: active
        vlan: 1001 vlanpcp: 0 parent interface: lagg0
        carp: BACKUP vhid 14 advbase 1 advskew 100
        carp: BACKUP vhid 17 advbase 1 advskew 100
        carp: BACKUP vhid 24 advbase 1 advskew 100
        carp: BACKUP vhid 29 advbase 1 advskew 100
        carp: BACKUP vhid 30 advbase 1 advskew 100
        carp: BACKUP vhid 33 advbase 1 advskew 100
        carp: BACKUP vhid 36 advbase 1 advskew 100
        carp: BACKUP vhid 37 advbase 1 advskew 100
        carp: BACKUP vhid 38 advbase 1 advskew 100
        carp: BACKUP vhid 39 advbase 1 advskew 100
        carp: BACKUP vhid 40 advbase 1 advskew 100
        carp: BACKUP vhid 41 advbase 1 advskew 100
        groups: vlan
lagg0.1002: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=400000<TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:49
        inet6 fe80::208:a2ff:fe0b:dc49%lagg0.1002 prefixlen 64 scopeid 0x1a
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: active
        vlan: 1002 vlanpcp: 0 parent interface: lagg0
        groups: vlan
lagg0.1003: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=400000<TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:49
        inet6 fe80::208:a2ff:fe0b:dc49%lagg0.1003 prefixlen 64 scopeid 0x1b
        inet 77.221.1.172 netmask 0xfffffff8 broadcast 77.221.1.175
        inet 77.221.1.170 netmask 0xfffffff8 broadcast 77.221.1.175 vhid 3
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: active
        vlan: 1003 vlanpcp: 0 parent interface: lagg0
        carp: BACKUP vhid 3 advbase 1 advskew 100
        groups: vlan
lagg1: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1450
        options=4500b8<VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,VLAN_HWFILTER,VLAN_HWTSO,TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:48
        inet6 fe80::208:a2ff:fe0b:dc48%lagg1 prefixlen 64 scopeid 0xc
        inet 10.0.110.3 netmask 0xffffff00 broadcast 10.0.110.255
        inet 10.0.110.1 netmask 0xffffff00 broadcast 10.0.110.255 vhid 4
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: active
        carp: BACKUP vhid 4 advbase 1 advskew 100
        groups: lagg
        laggproto lacp lagghash l2,l3,l4
        laggport: igb0 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING>
        laggport: igb3 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING>
ovpns7: flags=8051<UP,POINTOPOINT,RUNNING,MULTICAST> metric 0 mtu 1500
        options=80000<LINKSTATE>
        inet6 fe80::208:a2ff:fe0b:dc46%ovpns7 prefixlen 64 scopeid 0x1e
        inet 172.16.50.1 --> 172.16.50.2  netmask 0xffffff00
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        groups: tun openvpn
        Opened by PID 60418
ovpns2: flags=8051<UP,POINTOPOINT,RUNNING,MULTICAST> metric 0 mtu 1500
        options=80000<LINKSTATE>
        inet6 fe80::208:a2ff:fe0b:dc46%ovpns2 prefixlen 64 scopeid 0x1f
        inet 172.16.20.1 --> 172.16.20.2  netmask 0xffffff00
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        groups: tun openvpn
        Opened by PID 64601
lagg1.50: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1450
        options=400000<TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:48
        inet6 fe80::208:a2ff:fe0b:dc48%lagg1.50 prefixlen 64 scopeid 0xd
        inet 192.168.50.3 netmask 0xffffff00 broadcast 192.168.50.255
        inet 192.168.50.1 netmask 0xffffff00 broadcast 192.168.50.255 vhid 5
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: active
        vlan: 50 vlanpcp: 0 parent interface: lagg1
        carp: BACKUP vhid 5 advbase 1 advskew 100
        groups: vlan
lagg1.20: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1450
        options=400000<TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:48
        inet6 fe80::208:a2ff:fe0b:dc48%lagg1.20 prefixlen 64 scopeid 0xe
        inet 192.168.20.3 netmask 0xfffffc00 broadcast 192.168.23.255
        inet 192.168.20.1 netmask 0xfffffc00 broadcast 192.168.23.255 vhid 6
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: active
        vlan: 20 vlanpcp: 0 parent interface: lagg1
        carp: BACKUP vhid 6 advbase 1 advskew 100
        groups: vlan
lagg1.30: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1450
        options=400000<TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:48
        inet6 fe80::208:a2ff:fe0b:dc48%lagg1.30 prefixlen 64 scopeid 0xf
        inet 192.168.30.3 netmask 0xffffff00 broadcast 192.168.30.255
        inet 192.168.30.1 netmask 0xffffff00 broadcast 192.168.30.255 vhid 7
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: active
        vlan: 30 vlanpcp: 0 parent interface: lagg1
        carp: BACKUP vhid 7 advbase 1 advskew 100
        groups: vlan
lagg1.40: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1450
        options=400000<TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:48
        inet6 fe80::208:a2ff:fe0b:dc48%lagg1.40 prefixlen 64 scopeid 0x10
        inet 192.168.40.3 netmask 0xfffffe00 broadcast 192.168.41.255
        inet 192.168.40.1 netmask 0xfffffe00 broadcast 192.168.41.255 vhid 8
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: active
        vlan: 40 vlanpcp: 0 parent interface: lagg1
        carp: BACKUP vhid 8 advbase 1 advskew 100
        groups: vlan
lagg1.100: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1450
        options=400000<TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:48
        inet6 fe80::208:a2ff:fe0b:dc48%lagg1.100 prefixlen 64 scopeid 0x11
        inet 10.0.100.3 netmask 0xffffff00 broadcast 10.0.100.255
        inet 10.0.100.1 netmask 0xffffff00 broadcast 10.0.100.255 vhid 9
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: active
        vlan: 100 vlanpcp: 0 parent interface: lagg1
        carp: BACKUP vhid 9 advbase 1 advskew 100
        groups: vlan
lagg1.130: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1450
        options=400000<TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:48
        inet6 fe80::208:a2ff:fe0b:dc48%lagg1.130 prefixlen 64 scopeid 0x12
        inet 10.0.130.3 netmask 0xffffff00 broadcast 10.0.130.255
        inet 10.0.130.1 netmask 0xffffff00 broadcast 10.0.130.255 vhid 11
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: active
        vlan: 130 vlanpcp: 0 parent interface: lagg1
        carp: BACKUP vhid 11 advbase 1 advskew 100
        groups: vlan
lagg1.60: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1450
        options=400000<TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:48
        inet6 fe80::208:a2ff:fe0b:dc48%lagg1.60 prefixlen 64 scopeid 0x13
        inet 192.168.60.3 netmask 0xffffff00 broadcast 192.168.60.255
        inet 192.168.60.1 netmask 0xffffff00 broadcast 192.168.60.255 vhid 13
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: active
        vlan: 60 vlanpcp: 0 parent interface: lagg1
        carp: BACKUP vhid 13 advbase 1 advskew 200
        groups: vlan
lagg1.140: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1450
        options=400000<TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:48
        inet6 fe80::208:a2ff:fe0b:dc48%lagg1.140 prefixlen 64 scopeid 0x14
        inet 10.0.140.3 netmask 0xffffff00 broadcast 10.0.140.255
        inet 10.0.140.1 netmask 0xffffff00 broadcast 10.0.140.255 vhid 15
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: active
        vlan: 140 vlanpcp: 0 parent interface: lagg1
        carp: BACKUP vhid 15 advbase 1 advskew 100
        groups: vlan
lagg1.160: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1450
        options=400000<TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:48
        inet6 fe80::208:a2ff:fe0b:dc48%lagg1.160 prefixlen 64 scopeid 0x15
        inet 10.0.160.3 netmask 0xffffff00 broadcast 10.0.160.255
        inet 10.0.160.1 netmask 0xffffff00 broadcast 10.0.160.255 vhid 18
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: active
        vlan: 160 vlanpcp: 0 parent interface: lagg1
        carp: BACKUP vhid 18 advbase 1 advskew 100
        groups: vlan
lagg1.170: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1450
        options=400000<TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:48
        inet6 fe80::208:a2ff:fe0b:dc48%lagg1.170 prefixlen 64 scopeid 0x16
        inet 10.0.170.3 netmask 0xffffff00 broadcast 10.0.170.255
        inet 10.0.170.1 netmask 0xffffff00 broadcast 10.0.170.255 vhid 21
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: active
        vlan: 170 vlanpcp: 0 parent interface: lagg1
        carp: BACKUP vhid 21 advbase 1 advskew 100
        groups: vlan
lagg1.150: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1450
        options=400000<TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:48
        inet6 fe80::208:a2ff:fe0b:dc48%lagg1.150 prefixlen 64 scopeid 0x1c
        inet 10.0.150.3 netmask 0xffffff00 broadcast 10.0.150.255
        inet 10.0.150.1 netmask 0xffffff00 broadcast 10.0.150.255 vhid 16
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: active
        vlan: 150 vlanpcp: 0 parent interface: lagg1
        carp: BACKUP vhid 16 advbase 1 advskew 100
        groups: vlan
lagg1.200: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1450
        options=400000<TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:48
        inet6 fe80::208:a2ff:fe0b:dc48%lagg1.200 prefixlen 64 scopeid 0x17
        inet 10.0.200.3 netmask 0xffffff00 broadcast 10.0.200.255
        inet 10.0.200.1 netmask 0xffffff00 broadcast 10.0.200.255 vhid 35
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: active
        vlan: 200 vlanpcp: 0 parent interface: lagg1
        carp: BACKUP vhid 35 advbase 1 advskew 100
        groups: vlan
lagg1.180: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1450
        options=400000<TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:48
        inet6 fe80::208:a2ff:fe0b:dc48%lagg1.180 prefixlen 64 scopeid 0x1d
        inet 10.0.180.3 netmask 0xffffff00 broadcast 10.0.180.255
        inet 10.0.180.1 netmask 0xffffff00 broadcast 10.0.180.255 vhid 12
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: active
        vlan: 180 vlanpcp: 0 parent interface: lagg1
        carp: MASTER vhid 12 advbase 1 advskew 100
        groups: vlan
lagg1.210: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1450
        options=400000<TXCSUM_IPV6>
        ether 00:08:a2:0b:dc:48
        inet6 fe80::208:a2ff:fe0b:dc48%lagg1.210 prefixlen 64 scopeid 0x18
        inet 10.0.210.3 netmask 0xffffff00 broadcast 10.0.210.255
        inet 10.0.210.1 netmask 0xffffff00 broadcast 10.0.210.255 vhid 32
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: active
        vlan: 210 vlanpcp: 0 parent interface: lagg1
        carp: BACKUP vhid 32 advbase 1 advskew 100
        groups: vlan

Offline Derelict

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 10260
  • Karma: +1177/-313
    • View Profile
Re: LAG and CAPR issue after a firewall restart
« Reply #6 on: April 16, 2018, 10:13:31 am »
If that is the primary, why did you mess around with all the advbase/advskew timings?
Las Vegas, Nevada, USA
Use this diagram to describe your issue.
The pfSense Book is now available for just $24.70!
Do Not PM For Help! NO_WAN_EGRESSTM

Offline mistral

  • Newbie
  • *
  • Posts: 9
  • Karma: +0/-0
    • View Profile
Re: LAG and CARP issue after a firewall restart
« Reply #7 on: April 17, 2018, 08:10:49 am »
This is not the primary, this is the backup pfSense.

On primary pfSense:
Advertising frequency Base is set to 1
Advertising frequency Skew is set to 0
on all interfaces.
« Last Edit: April 17, 2018, 08:14:58 am by mistral »

Offline Derelict

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 10260
  • Karma: +1177/-313
    • View Profile
Re: LAG and CARP issue after a firewall restart
« Reply #8 on: April 17, 2018, 10:22:39 am »
I see an advskew 200 in there. what's that about? What's the setting on the primary?
Las Vegas, Nevada, USA
Use this diagram to describe your issue.
The pfSense Book is now available for just $24.70!
Do Not PM For Help! NO_WAN_EGRESSTM

Offline mistral

  • Newbie
  • *
  • Posts: 9
  • Karma: +0/-0
    • View Profile
Re: LAG and CARP issue after a firewall restart
« Reply #9 on: April 18, 2018, 02:43:48 am »
I see an advskew 200 in there. what's that about? What's the setting on the primary?
I check the VLAN with advskew 200 and these are the settings on primary and secondary pfSense

Primary pfSense:
Advertising frequency Base is set to 1
Advertising frequency Skew is set to 100

Secondary  pfSense
Advertising frequency Base is set to 1
Advertising frequency Skew is set to 200


Should i put Advertising frequency Skew to 0 on primary pfSense?
Should all Advertising frequency Skew must be set to 0 on primary pfSense?
Thanks
« Last Edit: April 18, 2018, 03:18:52 am by mistral »

Offline Derelict

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 10260
  • Karma: +1177/-313
    • View Profile
Re: LAG and CARP issue after a firewall restart
« Reply #10 on: April 18, 2018, 05:49:32 am »
Yes. Set 1/0 on primary. it will sync 1/100 on the secondary.

Doubt it is causing whatever it is you're seeing but it's anomalous.
Las Vegas, Nevada, USA
Use this diagram to describe your issue.
The pfSense Book is now available for just $24.70!
Do Not PM For Help! NO_WAN_EGRESSTM

Offline mistral

  • Newbie
  • *
  • Posts: 9
  • Karma: +0/-0
    • View Profile
Re: LAG and CARP issue after a firewall restart
« Reply #11 on: April 18, 2018, 09:31:56 am »
Yes. Set 1/0 on primary. it will sync 1/100 on the secondary.

Doubt it is causing whatever it is you're seeing but it's anomalous.
Thanks, i will change it on first planed maintenance downtime we have.

Do you have any idea what is causing the interface initialization problems that we are facing?
Is there anything more i can do? Make additional logs or something else that would help us to resolve it?

Offline Derelict

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 10260
  • Karma: +1177/-313
    • View Profile
Re: LAG and CARP issue after a firewall restart
« Reply #12 on: April 18, 2018, 11:36:02 am »
Nope. Never seen it. Though "INIT" means it thinks the interface is down/unplugged. Countless people using VLANs on a lagg and CARP. Though most I have seen are using LACP, not a static group like you are.
Las Vegas, Nevada, USA
Use this diagram to describe your issue.
The pfSense Book is now available for just $24.70!
Do Not PM For Help! NO_WAN_EGRESSTM