Reset Search
 

 

Article

A VDX6740 in a fabric cluster suddenly rebooted after execution of "copy running-config startup-config".

« Go Back

Information

 
TitleA VDX6740 in a fabric cluster suddenly rebooted after execution of "copy running-config startup-config".
Symptoms
A VDX6740 in a fabric cluster suddenly rebooted after execution of "copy running-config startup-config".

While booting it displayed EXT4-fs error messages such as the following.

 
EXT4-fs error (device sda2): ext4_mb_generate_buddy: EXT4-fs: group 6: 6473 blocks in bitmap, 6466 in gd
EXT4-fs error (device sda2): ext4_mb_generate_buddy: EXT4-fs: group 9: 8521 blocks in bitmap, 8540 in gd

Later in the boot process it displayed the following.
 
Waiting to starting configuration management service
Starting configuration management service
confd[1288]: - Starting ConfD vsn: 4.3.6.3
confd[1288]: - Loading file confd_cfg.fxs
confd[1288]: - Loading file confd.fxs
confd[1288]: - Loading file config.fxs
confd[1288]: - Loading file netconf.fxs
confd[1288]: - Loading file netconf_notification.fxs
confd[1288]: - Loading file netconf_actions.fxs
confd[1288]: - Loading file netconf_transactions.fxs
confd[1288]: - Loading file netconf_partial_lock.fxs
confd[1288]: - Loading file netconf_tailf_commit.fxs
confd[1288]: - Loading file netconf_forward.fxs
confd[1288]: - Loading file netconf_inactive.fxs
confd[1288]: - Loading file tailf_netconf.fxs
confd[1288]: - Loading file ietf_with_defaults.fxs
confd[1288]: - Loading file cli-builtin.fxs
confd[1288]: - Loading file /usr/confd/etc/confd.conf
confd[1288]: - Consulting daemon configuration file /usr/confd/etc/confd.conf
confd[1288]: - Bad configuration: /usr/confd/etc/confd.conf:0: cannot dynamically link with libcrypto shared library
Module len 157010 truncated
Error 1 returned by insmod while loading trace-module


It did display a login prompt, but login attempts failed.
 
console login: admin


Password:
ttylogin(pam_unix)[1490]: authentication failure; logname= uid=0 euid=0 tty=/dev/ttyS0 ruser= rhost=VDX1 user=admin
login[1490]: FAILED LOGIN 1 FROM (null) FOR admin, Authentication failure
Login incorrect


VDX1 login: root
Password:
ttylogin(pam_unix)[1490]: account root has expired (account expired)
Your account is disabled; please contact your system administrator
ttylogin(pam_unix)[1490]: session opened for user root by (uid=0)

Cannot make/remove an entry for the specified session
login[1490]: Cannot make/remove an entry for the specified session

A later attempt to boot in single user mode and reset passwords reported success but displayed error messages and actually failed.
 
sh-2.04# /sbin/passwddefault -^f f
EXT4-fs error (device sda2): ext4_mb_generate_buddy: EXT4-fs: group 6: 6473 blocks in bitmap, 6466 in gd
EXT4-fs error (device sda2): ext4_mb_generate_buddy: EXT4-fs: group 9: 8521 blocks in bitmap, 8540 in gd
EXT4-fs error (device sda2): ext4_mb_free_metadata: Double free of blocks 3596 (3584 140)
EXT4-fs error (device sda2): ext4_mb_free_metadata: Double free of blocks 3720 (3584 140)
EXT4-fs error (device sda2): ext4_mb_free_metadata: Double free of blocks 3723 (3584 140)
EXT4-fs error (device sda2): ext4_mb_free_metadata: Double free of blocks 3604 (3584 140)
All account passwords have been successfully set to factory default.
sh-2.04#.

 
Environment
  • VDX6740
  • NOS 5.0.2a
Cause
Incidents such as sudden power loss can result in file and file system corruption. It is possible for symptoms to not appear until the corrupted files or section of the storage device are used through actions such as "copy running-config startup-config" in a fabric cluster VCS.
Resolution
It is possible to recover from this condition with netinstall. Please refer to How to perform netinstall on VDX 6740 and 6940 via USB? and TFTP/NFS netinstall on 6740/6940/8770 for more details.
Additional notes

Feedback

 

Was this article helpful?


   

Feedback

Please tell us how we can make this article more useful.

Characters Remaining: 255