升级 Mellanox ConnectX-3 EN 10/40 Gbps 网卡固件

本文详细介绍了如何使用mstflint工具查询Mellanox ConnectX-3网卡的固件版本、下载正确的固件、验证固件的完整性,并最终完成固件的更新过程。
确认 ib_uverbs mlx4_en mlx4_core mlx4_ib  mst_pciconf 已加载, mstflint 已编译安装.

1> 确认mlx固件版本

查询 mlx 设备信息
# lspci |grep Mell
02:00.0 Network controller: Mellanox Technologies MT27500 Family [ConnectX-3]

查询 mlx 设备信息, 其中 Device ID 与 PSID 很重要, 必须根据这2个信息下载响应的固件.
# mstflint  -d 02:00.0 q

# mstflint -d /proc/bus/pci/02/00.0 q

Image type:      FS2
FW Version:      2.10.700
Device ID:       4099
Description:     Node             Port1            Port2            Sys image
GUIDs:           0002c90300faa480 0002c90300faa481 0002c90300faa482 0002c90300faa483 
MACs:                                 0002c9faa481     0002c9faa482
VSD:             
PSID:            MT_1090110019


ConnectX-3 Pro 与 ConnectX-3 Device ID 区别:
ConnectX-3 Pro : 4103
ConnectX-3     : 4099

固件下载地址
http://www.mellanox.com/page/firmware_download
当前设备 ConnectX-3 为 PSID: MT_1090110019 (ConnectX®-3 VPI Adapter Cards (InfiniBand, Ethernet,VPI))
http://www.mellanox.com/page/firmware_table_ConnectX3IB


验证固件信息
# mstflint  -d 02:00.0 v

     FS2 failsafe image. Start address: 0x80000. Chunk size 0x80000:

     NOTE: The addresses below are contiguous logical addresses. Physical addresses on
           flash may be different, based on the image start address and chunk size

     /0x00000038-0x00000bdf (0x000ba8)/ (BOOT2) - OK
     /0x00000be0-0x00005053 (0x004474)/ (BOOT2) - OK
     /0x00005054-0x00005f2b (0x000ed8)/ (Configuration) - OK
     /0x00005f2c-0x00005f6f (0x000044)/ (GUID) - OK
     /0x00005f70-0x000060ab (0x00013c)/ (Image Info) - OK
     /0x000060ac-0x0000cfef (0x006f44)/ (DDR) - OK
     /0x0000cff0-0x0000e8eb (0x0018fc)/ (DDR) - OK
     /0x0000e8ec-0x0001db83 (0x00f298)/ (DDR) - OK
     /0x0001db84-0x00026c77 (0x0090f4)/ (DDR) - OK
     /0x00026c78-0x000869ab (0x05fd34)/ (DDR) - OK
     /0x000869ac-0x0008a5fb (0x003c50)/ (DDR) - OK
     /0x0008a5fc-0x000b129b (0x026ca0)/ (DDR) - OK
     /0x000b129c-0x000b4c33 (0x003998)/ (DDR) - OK
     /0x000b4c34-0x000b896b (0x003d38)/ (DDR) - OK
     /0x000b896c-0x000b993f (0x000fd4)/ (Configuration) - OK
     /0x000b9940-0x000b999b (0x00005c)/ (Jump addresses) - OK
     /0x000b999c-0x000b9fdb (0x000640)/ (FW Configuration) - OK
     /0x00000000-0x000b9fdb (0x0b9fdc)/ (Full Image) - OK

-I- FW image verification succeeded. Image is bootable.

保存当前固件 及其他信息
mstflint  -d 02:00.0 ri mlx4.img
# mstflint  -d 02:00.0 dc mlx4.config
# mstflint  -d 02:00.0 hw query > mlx4.hw
验证当前固件 
 # mstflint  -i mlx4.img  v

     FS2 failsafe image. Start address: 0x0. Chunk size 0x80000:

     NOTE: The addresses below are contiguous logical addresses. Physical addresses on
           flash may be different, based on the image start address and chunk size

     /0x00000038-0x00000bdf (0x000ba8)/ (BOOT2) - OK
     /0x00000be0-0x00005053 (0x004474)/ (BOOT2) - OK
     /0x00005054-0x00005f2b (0x000ed8)/ (Configuration) - OK
     /0x00005f2c-0x00005f6f (0x000044)/ (GUID) - OK
     /0x00005f70-0x000060ab (0x00013c)/ (Image Info) - OK
     /0x000060ac-0x0000cfef (0x006f44)/ (DDR) - OK
     /0x0000cff0-0x0000e8eb (0x0018fc)/ (DDR) - OK
     /0x0000e8ec-0x0001db83 (0x00f298)/ (DDR) - OK
     /0x0001db84-0x00026c77 (0x0090f4)/ (DDR) - OK
     /0x00026c78-0x000869ab (0x05fd34)/ (DDR) - OK
     /0x000869ac-0x0008a5fb (0x003c50)/ (DDR) - OK
     /0x0008a5fc-0x000b129b (0x026ca0)/ (DDR) - OK
     /0x000b129c-0x000b4c33 (0x003998)/ (DDR) - OK
     /0x000b4c34-0x000b896b (0x003d38)/ (DDR) - OK
     /0x000b896c-0x000b993f (0x000fd4)/ (Configuration) - OK
     /0x000b9940-0x000b999b (0x00005c)/ (Jump addresses) - OK
     /0x000b999c-0x000b9fdb (0x000640)/ (FW Configuration) - OK
     /0x00000000-0x000b9fdb (0x0b9fdc)/ (Full Image) - OK

-I- FW image verification succeeded. Image is bootable.


下载固件后解压并验证固件
当前下载版本为为fw-ConnectX3-rel-2_33_5100-MCX354A-FCB_A1-FlexBoot-3.4.460.bin.zip
# unzip /hgfs/HarddiskVolume3/Tmp/fw-ConnectX3-rel-2_33_5100-MCX354A-FCB_A1-FlexBoot-3.4.460.bin.zip
验证固件
# mstflint  -i fw-ConnectX3-rel-2_33_5100-MCX354A-FCB_A1-FlexBoot-3.4.460.bin  v

     FS2 failsafe image. Start address: 0x0. Chunk size 0x80000:

     NOTE: The addresses below are contiguous logical addresses. Physical addresses on
           flash may be different, based on the image start address and chunk size

     /0x00000038-0x0000065b (0x000624)/ (BOOT2) - OK
     /0x0000065c-0x00002a4f (0x0023f4)/ (BOOT2) - OK
     /0x00002a50-0x00003927 (0x000ed8)/ (Configuration) - OK
     /0x00003928-0x0001c53b (0x018c14)/ (ROM) - OK
     /0x0001c53c-0x0001c57f (0x000044)/ (GUID) - OK
     /0x0001c580-0x0001c6eb (0x00016c)/ (Image Info) - OK
     /0x0001c6ec-0x00029c33 (0x00d548)/ (DDR) - OK
     /0x00029c34-0x0002ac77 (0x001044)/ (DDR) - OK
     /0x0002ac78-0x0002b047 (0x0003d0)/ (DDR) - OK
     /0x0002b048-0x00064c47 (0x039c00)/ (DDR) - OK
     /0x00064c48-0x0006a157 (0x005510)/ (DDR) - OK
     /0x0006a158-0x0006e27b (0x004124)/ (DDR) - OK
     /0x0006e27c-0x0007033b (0x0020c0)/ (DDR) - OK
     /0x0007033c-0x000a929f (0x038f64)/ (DDR) - OK
     /0x000a92a0-0x000ace23 (0x003b84)/ (DDR) - OK
     /0x000ace24-0x000c1ef7 (0x0150d4)/ (DDR) - OK
     /0x000c1ef8-0x000c1fff (0x000108)/ (DDR) - OK
     /0x000c2000-0x000cc30b (0x00a30c)/ (DDR) - OK
     /0x000cc30c-0x000cdae3 (0x0017d8)/ (Configuration) - OK
     /0x000cdae4-0x000cdb57 (0x000074)/ (Jump addresses) - OK
     /0x000cdb58-0x000ce3c7 (0x000870)/ (FW Configuration) - OK
     /0x00000000-0x000ce3c7 (0x0ce3c8)/ (Full Image) - OK

-I- FW image verification succeeded. Image is bootable.

烧录固件,程序将自动验证版本跟PSID,PSID不匹配将提示错误.
# mstflint  -d 02:00.0 -i fw-ConnectX3-rel-2_33_5100-MCX354A-FCB_A1-FlexBoot-3.4.460.bin b

    Current FW version on flash:  2.10.700
    New FW version:               2.33.5100

Burning FS2 FW image without signatures - OK  
Restoring signature                     - OK

查询当前版本
# mstflint  -d 02:00.0 q
Image type:      FS2
FW Version:      2.33.5100
FW Release Date: 25.1.2015
Product Version: 02.33.51.00
Rom Info:        type=PXE version=3.4.460 devid=4099
Device ID:       4099
Description:     Node             Port1            Port2            Sys image
GUIDs:           0002c90300faa480 0002c90300faa481 0002c90300faa482 0002c90300faa483 
MACs:                                 0002c9faa481     0002c9faa482
VSD:             
PSID:            MT_1090110019

可见已烧录成功当前版本为 2.33.5100.

验证当前固件
 # mstflint  -d 02:00.0 v

     FS2 failsafe image. Start address: 0x0. Chunk size 0x80000:

     NOTE: The addresses below are contiguous logical addresses. Physical addresses on
           flash may be different, based on the image start address and chunk size

     /0x00000038-0x0000065b (0x000624)/ (BOOT2) - OK
     /0x0000065c-0x00002a4f (0x0023f4)/ (BOOT2) - OK
     /0x00002a50-0x00003927 (0x000ed8)/ (Configuration) - OK
     /0x00003928-0x0001c53b (0x018c14)/ (ROM) - OK
     /0x0001c53c-0x0001c57f (0x000044)/ (GUID) - OK
     /0x0001c580-0x0001c6eb (0x00016c)/ (Image Info) - OK
     /0x0001c6ec-0x00029c33 (0x00d548)/ (DDR) - OK
     /0x00029c34-0x0002ac77 (0x001044)/ (DDR) - OK
     /0x0002ac78-0x0002b047 (0x0003d0)/ (DDR) - OK
     /0x0002b048-0x00064c47 (0x039c00)/ (DDR) - OK
     /0x00064c48-0x0006a157 (0x005510)/ (DDR) - OK
     /0x0006a158-0x0006e27b (0x004124)/ (DDR) - OK
     /0x0006e27c-0x0007033b (0x0020c0)/ (DDR) - OK
     /0x0007033c-0x000a929f (0x038f64)/ (DDR) - OK
     /0x000a92a0-0x000ace23 (0x003b84)/ (DDR) - OK
     /0x000ace24-0x000c1ef7 (0x0150d4)/ (DDR) - OK
     /0x000c1ef8-0x000c1fff (0x000108)/ (DDR) - OK
     /0x000c2000-0x000cc30b (0x00a30c)/ (DDR) - OK
     /0x000cc30c-0x000cdae3 (0x0017d8)/ (Configuration) - OK
     /0x000cdae4-0x000cdb57 (0x000074)/ (Jump addresses) - OK
     /0x000cdb58-0x000ce3c7 (0x000870)/ (FW Configuration) - OK
     /0x00000000-0x000ce3c7 (0x0ce3c8)/ (Full Image) - OK

-I- FW image verification succeeded. Image is bootable.

烧录成功
# reboot

mstflint 参考
http://www.mellanox.com/pdf/firmware/mstflint_README.txt

01:00.0 Ethernet controller: Mellanox Technologies MT2894 Family [ConnectX-6 Lx] Subsystem: Mellanox Technologies Device 0001 Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx+ Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx- Latency: 0, Cache Line Size: 32 bytes Interrupt: pin A routed to IRQ 77 NUMA node: 0 Region 0: Memory at 80002000000 (64-bit, prefetchable) [size=32M] Expansion ROM at e7a00000 [disabled] [size=1M] Capabilities: [60] Express (v2) Endpoint, MSI 00 DevCap: MaxPayload 512 bytes, PhantFunc 0, Latency L0s unlimited, L1 unlimited ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset+ SlotPowerLimit 25.000W DevCtl: CorrErr+ NonFatalErr+ FatalErr+ UnsupReq- RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop+ FLReset- MaxPayload 256 bytes, MaxReadReq 512 bytes DevSta: CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxPwr- TransPend- LnkCap: Port #0, Speed 16GT/s, Width x8, ASPM not supported ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp+ LnkCtl: ASPM Disabled; RCB 128 bytes Disabled- CommClk- ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt- LnkSta: Speed 16GT/s (ok), Width x8 (ok) TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt- DevCap2: Completion Timeout: Range ABC, TimeoutDis+, NROPrPrP-, LTR- 10BitTagComp+, 10BitTagReq-, OBFF Not Supported, ExtFmt-, EETLPPrefix- EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit- FRS-, TPHComp-, ExtTPHComp- AtomicOpsCap: 32bit- 64bit- 128bitCAS- DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled AtomicOpsCtl: ReqEn+ LnkCtl2: Target Link Speed: 16GT/s, EnterCompliance- SpeedDis- Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS- Compliance De-emphasis: -6dB LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete+, EqualizationPhase1+ EqualizationPhase2+, EqualizationPhase3+, LinkEqualizationRequest- Capabilities: [48] Vital Product Data Product Name: ConnectX-6 Lx EN adapter card, 25GbE, Dual-port SFP28, PCIe 4.0 x8, No Crypto Read-only fields: [PN] Part number: MCX631102AN-ADAT [EC] Engineering changes: AC [V2] Vendor specific: MCX631102AN-ADAT [SN] Serial number: MT24476013AM [V3] Vendor specific: 4451ddbdd4a9ef118000b8e924cea95a [VA] Vendor specific: MLX:MN=MLNX:CSKU=V2:UUID=V3:PCI=V0:MODL=CX631102A [V0] Vendor specific: PCIeGen4 x8 [VU] Vendor specific: MT24476013AMMLNXS0D0F0 [RV] Reserved: checksum good, 1 byte(s) reserved End Capabilities: [9c] MSI-X: Enable+ Count=64 Masked- Vector table: BAR=0 offset=00002000 PBA: BAR=0 offset=00003000 Capabilities: [c0] Vendor Specific Information: Len=18 <?> Capabilities: [40] Power Management version 3 Flags: PMEClk- DSI- D1- D2- AuxCurrent=375mA PME(D0-,D1-,D2-,D3hot-,D3cold+) Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME- Capabilities: [100 v1] Advanced Error Reporting UESta: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol- UEMsk: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol- UESvrt: DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol- CESta: RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr- CEMsk: RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+ AERCap: First Error Pointer: 08, ECRCGenCap+ ECRCGenEn- ECRCChkCap+ ECRCChkEn- MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap- HeaderLog: 00000000 00000000 00000000 00000000 Capabilities: [150 v1] Alternative Routing-ID Interpretation (ARI) ARICap: MFVC- ACS-, Next Function: 1 ARICtl: MFVC- ACS-, Function Group: 0 Capabilities: [180 v1] Single Root I/O Virtualization (SR-IOV) IOVCap: Migration-, Interrupt Message Number: 000 IOVCtl: Enable- Migration- Interrupt- MSE- ARIHierarchy+ IOVSta: Migration- Initial VFs: 8, Total VFs: 8, Number of VFs: 0, Function Dependency Link: 00 VF offset: 2, stride: 1, Device ID: 101e Supported Page Size: 000007ff, System Page Size: 00000010 Region 0: Memory at 0000080004800000 (64-bit, prefetchable) VF Migration: offset: 00000000, BIR: 0 Capabilities: [1c0 v1] Secondary PCI Express LnkCtl3: LnkEquIntrruptEn-, PerformEqu- LaneErrStat: 0 Capabilities: [230 v1] Access Control Services ACSCap: SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans- ACSCtl: SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans- Capabilities: [320 v1] Lane Margining at the Receiver <?> Capabilities: [370 v1] Physical Layer 16.0 GT/s <?> Capabilities: [420 v1] Data Link Feature <?> Kernel driver in use: mlx5_core Kernel modules: mlx5_core 以上信息含有:网卡型号解析、数量、ID、带宽、速率、驱动等信息吗
08-20
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值