到货6台 Nexus 93108TC-FX switch
到货时系统为NXOS
由于我们是ACI环境 ,所以需要将其转换为ACI 镜像,否则是无法注册到APIC上的。
前5台的操作都很顺利,按以下步骤操作完重启就完成了。
1 确认bootflash中有ACI的镜像
switch# dir
4096 Jul 04 03:47:19 2024 .rpmstore/
4096 Jul 04 03:47:40 2024 .swtam/
1738 Jul 04 03:49:03 2024 20240704_034857_poap_693_init.log
1738 Jul 04 04:03:57 2024 20240704_040352_poap_855_init.log
2097252 Oct 12 13:14:00 2024 20240930_062241_poap_867_1.log
1778408 Oct 12 14:09:38 2024 20240930_062241_poap_867_2.log
2097159 Sep 30 10:30:50 2024 20240930_062241_poap_867_init.log
1777998029 Jul 04 03:51:00 2024 aci-n9000-dk9.14.1.2g.bin
2 进入配置模式,取消NXOS启动,加载aci镜像,再重启
完整命令如下:
conf t
no boot nxos
copy runn startup-config
boot aci bootflash:<aci-image-name>
询问是否继续,输入Y,回车
exit
reload
询问是否继续,输入Y,回车,就会重启并加载ACI镜像了
以下为实际操作的console记录
switch#
switch# conf t
switch(config)# no boot nxos
switch(config)# copy runn startup-config
[########################################] 100%
Copy complete, now saving to disk (please wait)...
Copy complete.
switch(config)# boot aci bootflash:aci-n9000-dk9.14.1.2g.bin
Warning: Please check list of all ACI supported hardware before doing this operation, not all hardware are supported.
Warning: Booting to an ACI image will remove all nxos configuration and format bootflash. Do you want to continue (y/n)?[n] y
Performing image verification and compatibility check, please wait....
Unable remove internal file
Image verification successful.
switch(config)#
switch(config)# exit
switch# relo
!!!WARNING! there is unsaved configuration!!!
This command will reboot the system. (y/n)? [n] y
重启完成
提示符变成以下,说明是ACI模式,
(none)#
通过show version也可以确认
(none)# show version
[ 1079.994670] Hal (23490) Ran 5352 msecs in last 5372 msecs
Cisco Nexus Operating System (NX-OS) Software
TAC support: http://www.cisco.com/tac
Documents: http://www.cisco.com/en/US/products/ps9372/tsd_products_support_series_home.html
Copyright (c) 2002-2014, Cisco Systems, Inc. All rights reserved.
The copyrights to certain works contained in this software are
owned by other third parties and used and distributed under
license. Certain components of this software are licensed under
the GNU General Public License (GPL) version 2.0 or the GNU
Lesser General Public License (LGPL) Version 2.1. A copy of each
such license is available at
http://www.opensource.org/licenses/gpl-2.0.php and
http://www.opensource.org/licenses/lgpl-2.1.php
Software
BIOS: version 05.47
kickstart: version 14.1(2g) [build 14.1(2g)]
system: version 14.1(2g) [build 14.1(2g)]
PE: version 4.1(2g)
BIOS compile time: 04/28/2022
kickstart image file is: /bootflash/aci-n9000-dk9.14.1.2g.bin
kickstart compile time: 06/11/2019 06:26:57 [06/11/2019 06:26:57]
system image file is: /bootflash/auto-s
system compile time: 06/11/2019 06:26:57 [06/11/2019 06:26:57]
为保险起见,我们会通过命令将交换机再次重启,观察是否能正常加载ACI镜像,前5台都没有问题。
遇到了故障
但是第6台在转换时都正常,重启后是ACI模式,但是在第2次reload时直接进入了loader>模式
(none)# reload
This command will reload the chassis, Proceed (y/n)? [n]: y
[ 1040.238494] (1728743952.826687) (10-12-2024 14:39:12 UTC) sys_srvc_cctrl_diag_test: dbg_caller_id is 3
(none)# [ 1040.350198] (1728743952.938372) (10-12-2024 14:39:12 UTC)cctrl2 card_index=21136, link flap done.
loader >
开case找思科工程师,给了以下建议
请帮忙boot aci镜像进入aci mode, 然后执行下列命令(指定boot参数),之后再进行reload测试。
先说结论:之前重启后进入loader>的原因,tac答复是启动项失败导致的,即重启后交换机找不到指定的启动镜像。是因为指定的启动变量失效导致的。
下面是思科TAC答复的原文
从之前log中我们可以看到重启后无法执行auto boot.
Auto boot configuration file is absent.
No autoboot or failed autoboot. falling to loader
这个情况有时候会发生在从nxos转化ACI的过程中。
文档中,我们可以看见指导遇到这种情况时手动设置boot值来解决。
实际上有用的就是最后1条 setup-bootvars.sh开头的命令,前面几条只是采集信息。
实际操作过程如下:
(none)# dir /bootflash/aci-n9000* //输入的命令
/bootflash/aci-n9000-dk9.13.2.10f.bin /bootflash/aci-n9000-dk9.15.2.4f.bin
(none)# cat /mnt/cfg/0/boot/grub/menu.lst.local //输入的命令
# 0
#
# General configuration
#
#disable certificate
#timeout=8
#serial --unit=0 --speed=9600 --word=8 --stop=1 --parity=no
#terminal --timeout=8 serial console
boot auto-k
(none)#
(none)# cat /mnt/cfg/1/boot/grub/menu.lst.local //输入的命令
# 0
#
# General configuration
#
#disable certificate
#timeout=8
#serial --unit=0 --speed=9600 --word=8 --stop=1 --parity=no
#terminal --timeout=8 serial console
boot auto-k
(none)#
(none)# cd bootflash //输入的命令
(none)# setup-bootvars.sh aci-n9000-dk9.15.2.4f.bin //输入的命令
In progress
In progress
In progress
In progress
In progress
Done //这里完成了
这时show ver查看仍为原来的老版本,因为还没有重启
(none)# show version
Software
BIOS: version 05.47
kickstart: version 13.2(10f) [build 13.2(10f)]
system: version 13.2(10f) [build 13.2(10f)]
PE: version 3.2(10f)
BIOS compile time: 04/28/2022
kickstart image file is: /usb1/aci-n9000-dk9.13.2.10f.bin
kickstart compile time: 07/30/2021 01:06:44 [07/30/2021 01:06:44]
system image file is: /bootflash/auto-s
system compile time: 07/30/2021 01:06:44 [07/30/2021 01:06:44]
重启后确认新版本已经生效
(none)# reload
This command will reload the chassis, Proceed (y/n)? [n]: y
(none)# show version
Software
BIOS: version 05.47
kickstart: version 15.2(4f) [build 15.2(4f)]
system: version 15.2(4f) [build 15.2(4f)]
PE: version 5.2(4f)
BIOS compile time: 04/28/2022
kickstart image file is: /bootflash/aci-n9000-dk9.15.2.4f.bin
kickstart compile time: 08/04/2022 22:01:28 [08/04/2022 22:01:28]
system image file is: /bootflash/auto-s
system compile time: 08/04/2022 22:01:28 [08/04/2022 22:01:28]
之后进行了多次重启,均可以正常加载镜像,
所以关键就是下面的命令,指定启动项
(none)# cd bootflash
(none)# setup-bootvars.sh aci-n9000-dk9.15.2.4f.bin