HCA卡的Port GUID 和ib0的关系

最新推荐文章于 2025-03-03 11:32:04 发布

msdnchina

最新推荐文章于 2025-03-03 11:32:04 发布

阅读量2.8k

点赞数

CC 4.0 BY-SA版权

文章标签： hca ib地址对应关系 port guid

本文链接：https://blog.youkuaiyun.com/msdnchina/article/details/72859887

InfiniBand相关技术同时被 2 个专栏收录

32 篇文章

订阅专栏

InfiniBand相关技术

21 篇文章

订阅专栏

HCA卡的Port GUID 和ib0的关系

[root@rac2 ~]# ibstat
CA 'mlx4_0'         ——————————————>>>>额外说明：这是第一个HCA卡(并且是双port，所以下面有port1和prot2)
    CA type: MT4099
    Number of ports: 2
    Firmware version: 2.35.5100
    Hardware version: 0
    Node GUID: 0x248a0703005d07f0
    System image GUID: 0x248a0703005d07f3
    Port 1:
        State: Active
        Physical state: LinkUp
        Rate: 56
        Base lid: 4
        LMC: 0
        SM lid: 4
        Capability mask: 0x0259486a
        Port GUID: 0x248a0703005d07f1---------------->>>注意此处！！！！
        Link layer: InfiniBand
    Port 2:
        State: Down
        Physical state: Polling
        Rate: 10
        Base lid: 0
        LMC: 0
        SM lid: 0
        Capability mask: 0x02594868
        Port GUID: 0x248a0703005d07f2
        Link layer: InfiniBand
CA 'mlx4_1''         ——————————————>>>>额外说明：这是第二个HCA卡(并且是双port，所以下面有port1和prot2)
    CA type: MT4099
    Number of ports: 2
    Firmware version: 2.35.5100
    Hardware version: 0
    Node GUID: 0x248a0703005d0840
    System image GUID: 0x248a0703005d0843
    Port 1:
        State: Active
        Physical state: LinkUp
        Rate: 56
        Base lid: 6
        LMC: 0
        SM lid: 8
        Capability mask: 0x02594868
        Port GUID: 0x248a0703005d0841
        Link layer: InfiniBand
    Port 2:
        State: Down
        Physical state: Polling
        Rate: 10
        Base lid: 0
        LMC: 0
        SM lid: 0
        Capability mask: 0x02594868
        Port GUID: 0x248a0703005d0842
        Link layer: InfiniBand

[root@rac2 ~]# ip addr show
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host
       valid_lft forever preferred_lft forever
2: enp5s0f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000
    link/ether 0c:c4:7a:ab:d3:4c brd ff:ff:ff:ff:ff:ff
    inet 192.168.100.102/24 brd 192.168.100.255 scope global enp5s0f0
       valid_lft forever preferred_lft forever
    inet6 fe80::ec4:7aff:feab:d34c/64 scope link
       valid_lft forever preferred_lft forever
3: enp5s0f1: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN qlen 1000
    link/ether 0c:c4:7a:ab:d3:4d brd ff:ff:ff:ff:ff:ff
4: ib0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 2044 qdisc pfifo_fast state UP qlen 256
    link/infiniband 80:00:02:08:fe:80:00:00:00:00:00:00:24:8a:07:03:00:5d:07:f1 brd 00:ff:ff:ff:ff:12:40:1b:ff:ff:00:00:00:00:00:00:ff:ff:ff:ff
    inet 10.10.10.105/24 brd 10.10.10.255 scope global ib0         ~~~~~~~~~~~~--->注意此处！！！
       valid_lft forever preferred_lft forever
    inet6 fe80::268a:703:5d:7f1/64 scope link
       valid_lft forever preferred_lft forever
5: ib1: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 2044 qdisc pfifo_fast state DOWN qlen 256
    link/infiniband 80:00:02:09:fe:80:00:00:00:00:00:00:24:8a:07:03:00:5d:07:f2 brd 00:ff:ff:ff:ff:12:40:1b:ff:ff:00:00:00:00:00:00:ff:ff:ff:ff
    inet 10.10.10.106/24 brd 10.10.10.255 scope global ib1
       valid_lft forever preferred_lft forever
6: ib2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 2044 qdisc pfifo_fast state UP qlen 256
    link/infiniband 80:00:02:08:fe:80:00:00:00:00:00:02:24:8a:07:03:00:5d:08:41 brd 00:ff:ff:ff:ff:12:40:1b:ff:ff:00:00:00:00:00:00:ff:ff:ff:ff
    inet 10.10.10.107/24 brd 10.10.10.255 scope global ib2
       valid_lft forever preferred_lft forever
    inet6 fe80::268a:703:5d:841/64 scope link
       valid_lft forever preferred_lft forever
7: ib3: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 2044 qdisc pfifo_fast state DOWN qlen 256
    link/infiniband 80:00:02:09:fe:80:00:00:00:00:00:00:24:8a:07:03:00:5d:08:42 brd 00:ff:ff:ff:ff:12:40:1b:ff:ff:00:00:00:00:00:00:ff:ff:ff:ff
    inet 10.10.10.108/24 brd 10.10.10.255 scope global ib3
       valid_lft forever preferred_lft forever
8: virbr0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN
    link/ether 52:54:00:74:ff:7b brd ff:ff:ff:ff:ff:ff
    inet 192.168.122.1/24 brd 192.168.122.255 scope global virbr0
       valid_lft forever preferred_lft forever
9: virbr0-nic: <BROADCAST,MULTICAST> mtu 1500 qdisc pfifo_fast master virbr0 state DOWN qlen 500
    link/ether 52:54:00:74:ff:7b brd ff:ff:ff:ff:ff:ff

[root@rac2 ~]# ifconfig
enp5s0f0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 192.168.100.102  netmask 255.255.255.0  broadcast 192.168.100.255
        inet6 fe80::ec4:7aff:feab:d34c  prefixlen 64  scopeid 0x20<link>
        ether 0c:c4:7a:ab:d3:4c  txqueuelen 1000  (Ethernet)
        RX packets 9803  bytes 744701 (727.2 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 2027  bytes 175450 (171.3 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0
        device memory 0xc7820000-c783ffff  

ib0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 2044
        inet 10.10.10.105  netmask 255.255.255.0  broadcast 10.10.10.255
        inet6 fe80::268a:703:5d:7f1  prefixlen 64  scopeid 0x20<link>---------------------------->注意本行最左侧！！
Infiniband hardware address can be incorrect! Please read BUGS section in ifconfig(8).
        infiniband 80:00:02:08:FE:80:00:00:00:00:00:00:00:00:00:00:00:00:00:00  txqueuelen 256  (InfiniBand)
        RX packets 61  bytes 6687 (6.5 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 51  bytes 4298 (4.1 KiB)
        TX errors 0  dropped 7 overruns 0  carrier 0  collisions 0

ib1: flags=4099<UP,BROADCAST,MULTICAST>  mtu 2044
        inet 10.10.10.106  netmask 255.255.255.0  broadcast 10.10.10.255
Infiniband hardware address can be incorrect! Please read BUGS section in ifconfig(8).
        infiniband 80:00:02:09:FE:80:00:00:00:00:00:00:00:00:00:00:00:00:00:00  txqueuelen 256  (InfiniBand)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

ib2: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 2044
        inet 10.10.10.107  netmask 255.255.255.0  broadcast 10.10.10.255
        inet6 fe80::268a:703:5d:841  prefixlen 64  scopeid 0x20<link>
Infiniband hardware address can be incorrect! Please read BUGS section in ifconfig(8).
        infiniband 80:00:02:08:FE:80:00:00:00:00:00:00:00:00:00:00:00:00:00:00  txqueuelen 256  (InfiniBand)
        RX packets 14  bytes 3411 (3.3 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 7 overruns 0  carrier 0  collisions 0

ib3: flags=4099<UP,BROADCAST,MULTICAST>  mtu 2044
        inet 10.10.10.108  netmask 255.255.255.0  broadcast 10.10.10.255
Infiniband hardware address can be incorrect! Please read BUGS section in ifconfig(8).
        infiniband 80:00:02:09:FE:80:00:00:00:00:00:00:00:00:00:00:00:00:00:00  txqueuelen 256  (InfiniBand)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

lo: flags=73<UP,LOOPBACK,RUNNING>  mtu 65536
        inet 127.0.0.1  netmask 255.0.0.0
        inet6 ::1  prefixlen 128  scopeid 0x10<host>
        loop  txqueuelen 0  (Local Loopback)
        RX packets 24  bytes 1724 (1.6 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 24  bytes 1724 (1.6 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

virbr0: flags=4099<UP,BROADCAST,MULTICAST>  mtu 1500
        inet 192.168.122.1  netmask 255.255.255.0  broadcast 192.168.122.255
        ether 52:54:00:74:ff:7b  txqueuelen 0  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

[root@rac2 ~]#