Brocade VDX6740 constant reboot

[Adam_Aronson]

Switch constantly reboots, here is a printout of the boot process:

Unrecognized Cobra version '', defaulting to rev B

vsmgr : disk xfer failed for IO: READ size:69632 ret size 0
HV>

Current Mode of Op:interrupt Vs Thread State:0x0 blockPos:0x0
Current Active cookie Gos0:0xe41 Gos1:0x0
Current Queued max cookie Gos0:0xe42 Gos1:0x0
Guest sem info data 0x0 waitlist 0x0
Guest mutex info data 0x0 waitlist 0x0
Usb host controller status 0x40080
Number of Interrupts 0x2ae1 Num_of_blocks 0x2ae6
VS queue head pos :0x9080 tail pos:0x9080
HV USB timer: no of times exp 0xf No of times start 0x2af0 No of times stop 0x2af0
cur_io_info disk 0x0: cookie 0xe42
Num Critical errors=5 Real errors=0

GOS0 flush_io_sem info data 0x0 waitlist 0x0

GOS1 flush_io_sem info data 0x0 waitlist 0x0

usb_io_err_counters excluding the current io :
num_read_errs 0x0 num_write_errs 0x0
num_rd_usb_resets 0x0 num_wr_usb_resets 0x0 num_usb_stall 0x0 num_usb_st_buff_err 0x0
num_usb_babble_err 0x0 num_usb_crc_err 0x0 num_usb_stalls 0x0
num_non_critical 0x0 num_ehci_timeouts 0x0

usb_io_err_counters encounter in the current io :
num_read_errs 0x5 num_write_errs 0x0
num_rd_usb_resets 0x0 num_wr_usb_resets 0x0 num_usb_stall 0x0 num_usb_st_buff_err 0x0
num_usb_babble_err 0x0 num_usb_crc_err 0x0 num_usb_stalls 0x0
num_non_critical 0x5 num_ehci_timeouts 0x5

[2]
Hypervisor Reset Flush:

BootROM version: 1.0.60
Copyright (C) 2011 Brocade Communication.

CPU0: P3041, Version: 2.0, (0x82110320)
Core: E500MC, Version: 3.2, (0x80230032)
Clock Configuration:
CPU0:1500 MHz, CPU1:1500 MHz, CPU2:1500 MHz, CPU3:1500 MHz,
CCB:750 MHz,
DDR:500 MHz (1000 MT/s data rate) (Asynchronous), LBC:46.875 MHz
FMAN1: 375 MHz
PME: 375 MHz
L1: D-cache 32 kB enabled
I-cache 32 kB enabled
Model ID: 131
Board: P3041 CASTOR, 36-bit Addressing
reset reason was 0x00000002: CPU request
I2C: ready
DRAM: Initializing....
Enabled DHC_EN
FSL_ERRATUM_DDR_A003 workaround applied
DIMM 0 [0xfe008174=0x8675a607] [0xfe008f38=0x11110e0c] [0xfe008f3c=0x0a0c0d0f] [0xfe008f40=0x0d004004]
6 GiB left unmapped
DDR: 8 GiB (DDR3, 64-bit, CL=7, ECC on)
testdram value not set, dram test not run
Now running in RAM - U-Boot at: 7ff20000
FLASH: 4 MiB
L2: 128 KB enabled
Corenet Platform Cache: 1024 KB enabled
SERDES: bank 2 disabled
PCI: gd->brcd_flags = 0, PCI init
PCIE1 connected to Slot 1 as Root Complex (base addr fe200000)
Scanning PCI bus 01
PCIE0 on bus 00 - 01

MMK configuring pit regs
In: serial
Out: serial
Err: serial
SRIO1: disabled
SRIO2: disabled
NVRAM/RTC oscillator already turned on in a previous boot
Net: Fman: Uploading microcode version 101.6.0.
FM1@DTSEC4, FM1@DTSEC5
usb reset 0
(Re)start USB 0...
USB: Register 10011 NbrPorts 1
USB EHCI 1.00
scanning bus for devices... Manufacturer u-boot
Product EHCI Host Controller
SerialNumber
Manufacturer Generic
Product Flash Card Reader
SerialNumber 000000225001
2 USB Device(s) found
scanning bus for storage devices... 1 Storage Device(s) found
setting prt to 2
Hit ESC to stop autoboot: 0
Loading Environment 1 from NVRAM...
(Re)start USB 0...
USB: Register 10011 NbrPorts 1
USB EHCI 1.00
scanning bus for devices... Manufacturer u-boot
Product EHCI Host Controller
SerialNumber
Manufacturer Generic
Product Flash Card Reader
SerialNumber 000000225001
2 USB Device(s) found
scanning bus for storage devices... 1 Storage Device(s) found
setting prt to 1
Loading Environment 0 from NVRAM...
(Re)start USB 0...
USB: Register 10011 NbrPorts 1
USB EHCI 1.00
scanning bus for devices... Manufacturer u-boot
Product EHCI Host Controller
SerialNumber
Manufacturer Generic
Product Flash Card Reader
SerialNumber 000000225001
2 USB Device(s) found
scanning bus for storage devices... 1 Storage Device(s) found
setting prt to 2
Loading file "/boot/fastloading.mdt" from usb device 0:2 (usbda2)
158 bytes read
Image: [uImage]
Image: [hv.uImage]
Image: [silkworm.dtb]
Image: [silkworm_hct.dtb]
WARNING: adjusting available memory to 30000000
## Booting kernel from Legacy Image at 02000000 ...
Image Name:
Image Type: PowerPC Linux Kernel Image (uncompressed)
Data Size: 473624 Bytes = 462.5 KiB
Load Address: 00000000
Entry Point: 00000000
Verifying Checksum ... OK
## Flattened Device Tree blob at 04000000
Booting using the fdt blob at 0x4000000
Loading Kernel Image ... OK
OK
Loading Device Tree to 00ff7000, end 00fff22b ... OK
=======================================
Freescale Hypervisor 0.8-004
Hypervisor command line: config-addr=0x3000000 p1-linux="root=/dev/sda2 rootfstype=ext4 quiet" p2-linux="root=/dev/sda1 rootfstype=ext4 quiet ip=bootp"
[0] malloc_init: using 31 MiB at 0x7e0e2b70 - 0x7fffffff
Brocade PB device tree:brocade,SILKWORM_PB
Got liodn 125
[0] assign_callback: device serial0 in serial0 not found
[0] assign_callback: device /hvcpld in fpga not found
USB:
Static Qhead=0x4d6080 Qhead list=0x4d6100 Qtd base=0x4d6180

Static Qhead Align=[0] Qhead list Align=[0] Qtd base=[0]
hv scanning bus for usb devices... 2 USB Device(s) found
[0] watchdog enabled with period 38
hv scanning bus for storage devices... 1 HV Storage Device(s) found
Init hypervisor timer init_timer:8
[2] watchdog enabled with period 38
[3] watchdog enabled with period 38
[1] watchdog enabled with period 38
[2] Virtual Storage thread=7e260008
[0] get_rpn: mem-range has discontiguity at guest address 0x68000000.
HV>
part_start 2 2
HV>
dev_name vs_attach_guest /vsmgr/vd@usb0/vda01 part_start 2 no_of_parts 2

[vs_attach_guest]vdisk->start 0x7737ff vdisk->size 0x773001
HV>
[vs_attach_guest]vdisk->start 0x7737ff vdisk->size 0x773001
Bootargs set for cpu = 2 guest p2-linux bootagrs = root=/dev/sda1 rootfstype=ext4 quiet ip=bootp
HV>
part2 STANDBY
HV>
part_start 0 2
HV>
dev_name vs_attach_guest /vsmgr/vd@usb0/vda00 part_start 0 no_of_parts 2
HV>
[vs_attach_guest]vdisk->start 0x0 vdisk->size 0x773800
HV>
[vs_attach_guest]vdisk->start 0x0 vdisk->size 0x773800
Bootargs set for cpu = 0 guest p1-linux bootagrs = root=/dev/sda2 rootfstype=ext4 quiet
HV>
part1 ACTIVE
patch_pcie_msi_guest_node:set p2-linux msi0
patch_pcie_msi_guest_node: set msi-address-64 f0000740
[0] Clearing standby console log
[0] loading binary image from 0x79fff000 to 0x3000000
[0] Loading uImage from 0x78000000 to 0
[2] loading binary image from 0x79fff000 to 0x3000000
[2] Loading uImage from 0x78000000 to 0
[2] branching to guest p2-linux, 2 cpus
[0] branching to guest p1-linux, 2 cpus
HV> this is quiet!

end of DRAM 4294967296 memstart_addr0 total_lowmem 4294967296

[silkworm_setup_pci_shared_memory]config_done 0 scandone 0 pcilcok 0x0
SLUB: dfree enabled
PRIMING SLUB: main caches
SLUB: export __kmalloc at 0x40108204 changed to 0x401085c4
SLUB: export vmalloc at 0x400f6404 changed to 0x400f61b8
SLUB: export vfree at 0x400f5578 changed to 0x400f54a8
network namespace NR (VRF) started

PCI_PROBE_DEVTREE

PCI_PROBE_DEVTREE
mmod_sysctl_inited: 1
***** pcie_portdrv_init: active completed
cpu1/1: failover_register() - registering notifiers...

Fman microcode 51 45 46

FMAN microcode UC size 0x1b64
default MII is 0xc10b0000 for tsec0
Uboot wdt counter value: 0
VSD Created with major number vsd_probe = 254

disk->start 0 cmd->start 0 nstart 0 disk name /vsmgr/vd@usb0/vda00
HV>
create_new_partition_table part_no 0 no_of_parts 2
INIT: version 2.78 booting
Firmware Integrity Check is default off
Bypassing firmware validation.
mount: sysfs already mounted or /sys busy
mount: according to mtab, none is already mounted on /sys
mknod: /dev/fsl-hv: File exists
Hostname is VDX-Switch-02
INIT: Entering runlevel: 3
FIPS-mode test application

1. Non-Approved cryptographic operation test...
a. Excluded algorithm (MD5)...successful
b. Included algorithm (D-H)...successful
2. Automatic power-up self test...
2.a. FIPS RNG selftest...successful
3. AES-128,192,256 CBC encryption/decryption...successful
4. RSA key generation and encryption/decryption...successful
4.1. RSA 2048 with 'SHA256' testing...successful
5. TDES-CBC encryption/decryption...successful
6a. SHA-1 hash...successful
6b. SHA-256 hash...successful
6c. SHA-384 hash...successful
6d. SHA-512 hash...successful
6e. HMAC-SHA-1 hash...successful
6f. HMAC-SHA-224 hash...successful
6g. HMAC-SHA-256 hash...successful
6h. HMAC-SHA-384 hash...successful
6i. HMAC-SHA-512 hash...successful
7. Non-Approved cryptographic operation test...
a. Excluded algorithm (MD5)...Not executed
b. Included algorithm (D-H)...successful as expected
8. Zero-ization...Successful
9. TLS KDF 1.0...successful
9a. TLS KDF 1.2...successful
10.ECDSA ...successful
11.ECDH ...successful
11. SSH KDF...successful

All tests completed with 0 errors
(none)
Waiting to starting configuration management service
Starting configuration management service
Found 2(threshold 5) abnormal reboots within 5000 seconds window(threshold)
KernelSpace rastrace_register
DCM MODE:0x0
SWBD module launch ... Thu Jan 25 18:55:46 GMT 2018
CPLD INIT DONE
SEEPROM Read Done!
Unrecognized Cobra version '', defaulting to rev B <======THIS IS THE LAST LINE, THEN

STARTS AGAIN FROM THE TOP!!

[Adam_Aronson]

Changed the active partition to sda1 from sda2, rebooted and found error "SCSI_REQ_SENSE failed cmd 0x03 returned 0x70 0x06 0x28 0x00" which indicates a hardware issue.

[Drew_C]

Thanks for coming back with an update on this!