Fan speed in X620-10X not increasing despite high temperature, switch and SFP gets very hot

[FredrikB]

Hi!

We have a few X620-10X at a customer’s and they and the SFPs in them get very, very hot. They have ambient temperatures in the 25 C range even if some may be in slightly warmer rooms so nothing really out of the ordinary. Still the fans only indicate 2100 or 2160 rpm in all switches. Are those fans not capable of higher speeds than that? The SFPs are burning hot, so you can’t hold them in your hand for more than a second and are also reporting about 90 C temps. All temps are of course on some chip so the surface is not 90 C but it’s still super hot.

Some measurements (first an X460-G2 for reference, also note that EXOS 22.7 and 30.7 behaves the same in X620):

[me@server ~]$  for ESTAB in 123 112 116 140 194 ; do for IP in 4 5 ; do echo 172.24.$ESTAB.$IP ; for OID in SNMPv2-MIB::sysName.0 SNMPv2-MIB::sysDescr.0 .1.3.6.1.4.1.1916.1.1.1.8.0 SNMPv2-SMI::enterprises.1916.1.1.1.9.1.4 ; do snmpbulkwalk  -v 2c -c "myCommunity" 10.0.$ESTAB.$IP $OID ; done ; done ; done
10.0.123.4
SNMPv2-MIB::sysName.0 = STRING: d123a
SNMPv2-MIB::sysDescr.0 = STRING: ExtremeXOS (X460G2-24x-10G4) version 30.7.1.1 30.7.1.1-patch1-54 by release-manager on Thu Oct 22 12:58:28 EDT 2020
SNMPv2-SMI::enterprises.1916.1.1.1.8.0 = INTEGER: 60
SNMPv2-SMI::enterprises.1916.1.1.1.9.1.4.101 = INTEGER: 3240
SNMPv2-SMI::enterprises.1916.1.1.1.9.1.4.102 = INTEGER: 6780
SNMPv2-SMI::enterprises.1916.1.1.1.9.1.4.103 = INTEGER: 3240
SNMPv2-SMI::enterprises.1916.1.1.1.9.1.4.104 = INTEGER: 6780
SNMPv2-SMI::enterprises.1916.1.1.1.9.1.4.105 = INTEGER: 3240
SNMPv2-SMI::enterprises.1916.1.1.1.9.1.4.106 = INTEGER: 6480
10.0.123.5
SNMPv2-MIB::sysName.0 = STRING: d123b
SNMPv2-MIB::sysDescr.0 = STRING: ExtremeXOS (X460G2-24x-10G4) version 30.7.1.1 30.7.1.1-patch1-54 by release-manager on Thu Oct 22 12:58:28 EDT 2020
SNMPv2-SMI::enterprises.1916.1.1.1.8.0 = INTEGER: 63
SNMPv2-SMI::enterprises.1916.1.1.1.9.1.4.101 = INTEGER: 3000
SNMPv2-SMI::enterprises.1916.1.1.1.9.1.4.102 = INTEGER: 6660
SNMPv2-SMI::enterprises.1916.1.1.1.9.1.4.103 = INTEGER: 3120
SNMPv2-SMI::enterprises.1916.1.1.1.9.1.4.104 = INTEGER: 6480
SNMPv2-SMI::enterprises.1916.1.1.1.9.1.4.105 = INTEGER: 3000
SNMPv2-SMI::enterprises.1916.1.1.1.9.1.4.106 = INTEGER: 6420
10.0.112.4
SNMPv2-MIB::sysName.0 = STRING: d112a
SNMPv2-MIB::sysDescr.0 = STRING: ExtremeXOS (X620-10x) version 22.7.2.4 22.7.2.4-patch1-5 by release-manager on Tue Jul 21 10:25:12 EDT 2020
SNMPv2-SMI::enterprises.1916.1.1.1.8.0 = INTEGER: 82
SNMPv2-SMI::enterprises.1916.1.1.1.9.1.4.101 = INTEGER: 2100
SNMPv2-SMI::enterprises.1916.1.1.1.9.1.4.102 = INTEGER: 2100
10.0.112.5
SNMPv2-MIB::sysName.0 = STRING: d112b
SNMPv2-MIB::sysDescr.0 = STRING: ExtremeXOS (X620-10x) version 22.7.2.4 22.7.2.4-patch1-5 by release-manager on Tue Jul 21 10:25:12 EDT 2020
SNMPv2-SMI::enterprises.1916.1.1.1.8.0 = INTEGER: 82
SNMPv2-SMI::enterprises.1916.1.1.1.9.1.4.101 = INTEGER: 2160
SNMPv2-SMI::enterprises.1916.1.1.1.9.1.4.102 = INTEGER: 2100
10.0.116.4
SNMPv2-MIB::sysName.0 = STRING: d116a
SNMPv2-MIB::sysDescr.0 = STRING: ExtremeXOS (X620-10x) version 30.7.1.1 30.7.1.1-patch1-54 by release-manager on Thu Oct 22 12:58:28 EDT 2020
SNMPv2-SMI::enterprises.1916.1.1.1.8.0 = INTEGER: 77
SNMPv2-SMI::enterprises.1916.1.1.1.9.1.4.101 = INTEGER: 2160
SNMPv2-SMI::enterprises.1916.1.1.1.9.1.4.102 = INTEGER: 2160
10.0.116.5
SNMPv2-MIB::sysName.0 = STRING: d116b
SNMPv2-MIB::sysDescr.0 = STRING: ExtremeXOS (X620-10x) version 30.7.1.1 30.7.1.1-patch1-54 by release-manager on Thu Oct 22 12:58:28 EDT 2020
SNMPv2-SMI::enterprises.1916.1.1.1.8.0 = INTEGER: 88
SNMPv2-SMI::enterprises.1916.1.1.1.9.1.4.101 = INTEGER: 2160
SNMPv2-SMI::enterprises.1916.1.1.1.9.1.4.102 = INTEGER: 2100
10.0.140.4
SNMPv2-MIB::sysName.0 = STRING: d140a
SNMPv2-MIB::sysDescr.0 = STRING: ExtremeXOS (X620-10x) version 22.7.2.4 22.7.2.4-patch1-3 by release-manager on Wed Jun 3 14:45:26 EDT 2020
SNMPv2-SMI::enterprises.1916.1.1.1.8.0 = INTEGER: 80
SNMPv2-SMI::enterprises.1916.1.1.1.9.1.4.101 = INTEGER: 2160
SNMPv2-SMI::enterprises.1916.1.1.1.9.1.4.102 = INTEGER: 2160
10.0.140.5
SNMPv2-MIB::sysName.0 = STRING: d140b
SNMPv2-MIB::sysDescr.0 = STRING: ExtremeXOS (X620-10x) version 22.7.2.4 22.7.2.4-patch1-3 by release-manager on Wed Jun 3 14:45:26 EDT 2020
SNMPv2-SMI::enterprises.1916.1.1.1.8.0 = INTEGER: 79
SNMPv2-SMI::enterprises.1916.1.1.1.9.1.4.101 = INTEGER: 2160
SNMPv2-SMI::enterprises.1916.1.1.1.9.1.4.102 = INTEGER: 2100
10.0.194.4
SNMPv2-MIB::sysName.0 = STRING: d194a
SNMPv2-MIB::sysDescr.0 = STRING: ExtremeXOS (X620-10x) version 22.7.2.4 22.7.2.4-patch1-3 by release-manager on Wed Jun 3 14:45:26 EDT 2020
SNMPv2-SMI::enterprises.1916.1.1.1.8.0 = INTEGER: 77
SNMPv2-SMI::enterprises.1916.1.1.1.9.1.4.101 = INTEGER: 2160
SNMPv2-SMI::enterprises.1916.1.1.1.9.1.4.102 = INTEGER: 2100
10.0.194.5
SNMPv2-MIB::sysName.0 = STRING: d194b
SNMPv2-MIB::sysDescr.0 = STRING: ExtremeXOS (X620-10x) version 22.7.2.4 22.7.2.4-patch1-3 by release-manager on Wed Jun 3 14:45:26 EDT 2020
SNMPv2-SMI::enterprises.1916.1.1.1.8.0 = INTEGER: 77
SNMPv2-SMI::enterprises.1916.1.1.1.9.1.4.101 = INTEGER: 2100
SNMPv2-SMI::enterprises.1916.1.1.1.9.1.4.102 = INTEGER: 2100

Can someone else have a look at their X620-10Xes and see if the fans sometimes go above 2160? Is there some way to force the fans to go at high speed or adjust the levels for when the fans should increase their RPM?

Thanks!

/Fredrik

[FredrikB · Accepted solution]

Thanks! The fan speed can be seen without debug:

# show fans
Slot-1 FanTray information:
State:                  Operational
NumFan:                 2
Fan-1:                  Operational at 12420 RPM
Fan-2:                  Operational at 12300 RPM

# show temperature
Field Replaceable Units                                  Temp (C)   Status   Min  Normal   Max
Switch                : X620-8t-2x                            73.50       Normal     0   10-100  110

We actually got a debug command that can set the fan speed if needed. We have a few X620’s that get really hot and in particular we need to make sure the SFPs aren’t overheated. I can’t reveal the debug command but the important point here is that there is a way to speed them up if needed, so give TAC a call if you bump into problems. I tested this as you can see above, so the X620-8T fans can actually do high RPMs, which I wasn’t sure of previously.

The X620-10X and -8T should rev up the fans when they reach 90C so we were 2 degrees from seeing that with the hottest switch that was at 88C.

[StephenW]

That is how fast the fan goes.  You can check the power level percentage with the below command.

switch # debug hal show platform platformInfo | include "Fan Power Level"
Fan Power Level: 100 errorSum: 210000000