what is the meaning of exclamation mark (!) in stacking?

[Marlon]

! Slot-1 H.O-x460-Stack.1 #

[Marlon]

Hi Prashanth,

Thanks you so much.

[Prashanth_KG]

Hi Marlon,

yes, we need to reboot the slot after clearing the sys-recovery-level.

Snippet from the user guide:

Clear the shutdown state with the command:
clear sys-recovery-level
On a SummitStack, use the command:
clear sys-recovery-level slot slot
The switch prompts you to confirm this action. The following is a sample confirmation message:
Are you sure you want to clear sys-recovery-level? (y/n)
2 Enter y to confirm this action and clear the shutdown state. Enter n or press [Enter] to cancel this
action.
After you clear the shutdown state, use the reboot command to bring the switch and ports back
online. After rebooting, the switch is operational.

Hope this helps!

[Marlon]

Hi Prashanth,

Thanks. if we execute "clear sys-recovery-level" command this will required a reboot?

below are the outputs:

! Slot-1 H.O-x460-Stack.1 # show log messages nvra
! Slot-1 H.O-x460-Stack.4 # 835265 bytes saved on Tue Dec 15 10:24:44 2015primary.cfg Created by ExtremeXOS version 15.3.4.6Config Booted: primary.cfg Config Selected: primary.cfg Secondary ver: 15.2.2.7 15.2.2.7 patch1-13 patch1-13Primary ver: 15.3.4.6 15.3.4.6 Press to continue or to quit:Image Booted: primary primary Image Selected: primary primary Current State: MASTER BACKUP (In Sync) ------------------------ ------------------------Slot: Slot-1 * Slot-2 System UpTime: 246 days 7 hours 13 minutes 58 seconds Next Reboot: None scheduledBoot Count: 14Boot Time: Mon Apr 13 03:14:43 2015Timezone: [Auto DST Disabled] GMT Offset: 480 minutes, name is Taiwan.Current Time: Tue Dec 15 10:28:41 2015System Watchdog: EnabledRecovery Mode: AllSysHealth check: Enabled (Normal)System Type: X460-24t (Stack)System MAC: 02:04:96:52:57:FASysContact: support@extremenetworks.com, +1 888 257 3000SysLocation: HO-2ndFloor-ITSysName: H.O-x460-Stack! Slot-1 H.O-x460-Stack.3 # show switch ! Slot-1 H.O-x460-Stack.3 # show switSlot-8 Empty 0 Slot-7 Empty 0 Slot-6 Empty 0 Slot-5 Empty 0 Slot-4 Empty 0 Slot-3 Empty 0 Slot-2 X460-24t X460-24t Operational 34 Slot-1 X460-24t X460-24t Operational 34 --------------------------------------------------------------------Slots Type Configured State Ports! Slot-1 H.O-x460-Stack.2 # sho slotA total of 111 log messages were displayed.11/13/2015 18:04:47.41 Slot-2: dest 0xAC12017B / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:47.41 Slot-2: dest 0xAC120182 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:48.41 Slot-1: dest 0xAC120108 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:48.41 Slot-1: dest 0xAC120158 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:48.40 Slot-2: dest 0xAC120108 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:48.41 Slot-1: dest 0xAC12016E / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:48.40 Slot-2: dest 0xAC120158 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:48.41 Slot-1: dest 0xAC120187 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:48.40 Slot-2: dest 0xAC12016E / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:48.41 Slot-1: dest 0xAC120157 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:48.40 Slot-2: dest 0xAC120187 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:48.41 Slot-1: dest 0xAC120159 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:48.40 Slot-2: dest 0xAC120157 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:48.41 Slot-1: dest 0xAC12016F / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:48.40 Slot-2: dest 0xAC120159 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:48.41 Slot-1: dest 0xAC120181 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:48.40 Slot-2: dest 0xAC12016F / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:48.41 Slot-1: dest 0xAC120156 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.Press to continue or to quit:11/13/2015 18:04:48.40 Slot-2: dest 0xAC120181 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:48.41 Slot-1: dest 0xAC120180 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:48.40 Slot-2: dest 0xAC120156 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:48.41 Slot-1: dest 0xAC12014A / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:48.40 Slot-2: dest 0xAC120180 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:49.41 Slot-1: dest 0xAC120149 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:48.40 Slot-2: dest 0xAC12014A / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:49.41 Slot-1: dest 0xAC12014B / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:49.40 Slot-2: dest 0xAC120149 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:49.41 Slot-1: dest 0xAC12013C / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:49.40 Slot-2: dest 0xAC12014B / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:49.41 Slot-1: dest 0xAC120163 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:49.40 Slot-2: dest 0xAC12013C / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:49.41 Slot-1: dest 0xAC12017C / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:49.40 Slot-2: dest 0xAC120163 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:49.41 Slot-1: dest 0xAC12018B / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:49.40 Slot-2: dest 0xAC12017C / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:50.44 Slot-1: dest 0xAC120185 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:49.40 Slot-2: dest 0xAC12018B / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:50.44 Slot-1: dest 0xAC120199 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:50.42 Slot-2: dest 0xAC120185 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:50.44 Slot-1: dest 0xAC120160 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:50.42 Slot-2: dest 0xAC120199 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.Press to continue or to quit:11/13/2015 18:04:50.44 Slot-1: dest 0xAC12019A / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:50.42 Slot-2: dest 0xAC120160 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:50.44 Slot-1: dest 0xAC120138 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:50.42 Slot-2: dest 0xAC12019A / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:50.44 Slot-1: dest 0xAC120146 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:50.42 Slot-2: dest 0xAC120138 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:50.44 Slot-1: dest 0xAC120147 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:50.42 Slot-2: dest 0xAC120146 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:04:50.42 Slot-2: dest 0xAC120147 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/13/2015 18:06:37.19 Slot-1: Received BFD an invalid packet on VLAN MPLS Error:Invalid ttl value for single Hop session11/14/2015 00:00:03.24 Slot-1: Login failed for user admin through telnet (172.18.1.151)11/15/2015 00:00:03.55 Slot-1: Login failed for user admin through telnet (172.18.1.151)11/16/2015 00:00:03.30 Slot-1: Login failed for user admin through telnet (172.18.1.151)11/17/2015 00:00:03.36 Slot-1: Login failed for user admin through telnet (172.18.1.151)11/18/2015 00:00:03.06 Slot-1: Login failed for user admin through telnet (172.18.1.151)11/19/2015 00:00:03.21 Slot-1: Login failed for user admin through telnet (172.18.1.151)11/20/2015 00:00:03.51 Slot-1: Login failed for user admin through telnet (172.18.1.151)11/20/2015 16:39:54.45 Slot-1: dest 0xAC12018A / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/20/2015 16:39:54.45 Slot-1: dest 0xAC1201B9 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/20/2015 16:39:54.45 Slot-2: dest 0xAC12018A / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/20/2015 16:39:54.45 Slot-1: dest 0xAC1201A0 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/20/2015 16:39:54.45 Slot-2: dest 0xAC1201B9 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/20/2015 16:39:54.45 Slot-1: dest 0xAC1202A3 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.Press to continue or to quit:11/20/2015 16:39:54.45 Slot-2: dest 0xAC1201A0 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/20/2015 16:39:54.45 Slot-1: dest 0xAC120109 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/20/2015 16:39:54.45 Slot-2: dest 0xAC1202A3 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/20/2015 16:39:54.45 Slot-1: dest 0xAC12017B / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/20/2015 16:39:54.45 Slot-2: dest 0xAC120109 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/20/2015 16:39:54.45 Slot-2: dest 0xAC12017B / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/20/2015 16:39:55.48 Slot-1: dest 0xAC120182 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/20/2015 16:39:55.48 Slot-1: dest 0xAC12024A / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/20/2015 16:39:55.47 Slot-2: dest 0xAC120182 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/20/2015 16:39:55.48 Slot-1: dest 0xAC12024D / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/20/2015 16:39:55.47 Slot-2: dest 0xAC12024A / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/20/2015 16:39:55.48 Slot-1: dest 0xAC120249 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/20/2015 16:39:55.47 Slot-2: dest 0xAC12024D / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/20/2015 16:39:55.48 Slot-1: dest 0xAC120248 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/20/2015 16:39:55.47 Slot-2: dest 0xAC120249 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/20/2015 16:39:55.48 Slot-1: dest 0xAC120264 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/20/2015 16:39:55.47 Slot-2: dest 0xAC120248 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/20/2015 16:39:55.48 Slot-1: dest 0xAC12024B / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/20/2015 16:39:55.47 Slot-2: dest 0xAC120264 / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/20/2015 16:39:55.47 Slot-2: dest 0xAC12024B / 32 nexthop 0xAC1202F6: Unable to add route to unit 0, rc Entry exists. Shadow problem.11/21/2015 00:00:03.05 Slot-1: Login failed for user admin through telnet (172.18.1.151)11/22/2015 00:00:03.26 Slot-1: Login failed for user admin through telnet (172.18.1.151)11/23/2015 00:00:03.82 Slot-1: Login failed for user admin through telnet (172.18.1.151)Press to continue or to quit:11/24/2015 00:00:02.91 Slot-1: Login failed for user admin through telnet (172.18.1.151)11/25/2015 00:00:03.31 Slot-1: Login failed for user admin through telnet (172.18.1.151)11/26/2015 00:00:03.13 Slot-1: Login failed for user admin through telnet (172.18.1.151)11/27/2015 00:00:03.53 Slot-1: Login failed for user admin through telnet (172.18.1.151)11/28/2015 00:00:02.94 Slot-1: Login failed for user admin through telnet (172.18.1.151)11/29/2015 00:00:03.52 Slot-1: Login failed for user admin through telnet (172.18.1.151)11/30/2015 00:00:03.48 Slot-1: Login failed for user admin through telnet (172.18.1.151)12/01/2015 00:00:03.25 Slot-1: Login failed for user admin through telnet (172.18.1.151)12/02/2015 00:00:03.72 Slot-1: Login failed for user admin through telnet (172.18.1.151)12/03/2015 00:00:03.85 Slot-1: Login failed for user admin through telnet (172.18.1.151)12/04/2015 00:00:03.92 Slot-1: Login failed for user admin through telnet (172.18.1.151)12/05/2015 00:00:06.79 Slot-1: Login failed for user admin through telnet (172.18.1.151)12/06/2015 00:00:03.49 Slot-1: Login failed for user admin through telnet (172.18.1.151)12/07/2015 00:00:03.41 Slot-1: Login failed for user admin through telnet (172.18.1.151)12/07/2015 13:48:36.41 Slot-1: Login failed for user failsafe through telnet (172.21.200.246)12/08/2015 00:00:03.82 Slot-1: Login failed for user admin through telnet (172.18.1.151)12/09/2015 00:00:03.44 Slot-1: Login failed for user admin through telnet (172.18.1.151)12/10/2015 00:00:03.95 Slot-1: Login failed for user admin through telnet (172.18.1.151)12/11/2015 00:00:03.36 Slot-1: Login failed for user admin through telnet (172.18.1.151)12/11/2015 10:19:13.23 Slot-1: Warning: received IGMPv3 query on vlan WIFI configured for IGMPv2 from 172.25.14.1112/12/2015 00:00:03.64 Slot-1: Login failed for user admin through telnet (172.18.1.151)12/13/2015 00:00:02.89 Slot-1: Login failed for user admin through telnet (172.18.1.151)12/14/2015 00:00:02.90 Slot-1: Login failed for user admin through telnet (172.18.1.151)12/15/2015 00:00:03.40 Slot-1: Login failed for user admin through telnet (172.18.1.151)! Slot-1 H.O-x460-Stack.1 # show log messages nvram

[Prashanth_KG]

Hi Marlon,

Thank you for sharing the configuration and the log messages.
I see that the switch sys-recovery option is set to reset and not shutdown.

Please check if there is any issue with the temperature in the switch/environment LED is on in the switch.
We can verify the same from the output of show switch.

This output is little strange as the ! indicates a node to in the shutdown state. Please collect the following outputs:

show slot
show log messages nvram.

Also, please share if the traffic flow across the slot 1 is fine.
Look for any failure state of the slots in the outputs above. If nothing interesting shows up, I would suggest opening up a GTAC case.

Looking forward to the outputs!