计算线程index

本文详细介绍了CUDA编程中不同维度的网格与块所对应的全局线程索引计算方法,并提供了9种常见情况的具体实现代码。此外,还概述了CUDA中常用的两大库:BLAS和FFT的功能。

摘要生成于 C知道 ,由 DeepSeek-R1 满血版支持, 前往体验 >

CUDA相关知识整理

  1. CUDA libraries主要有两个:
    (1) BLAS:全称是Basic Linear Algebra Subprograms。 是一个用于线性代数运算的应用程序接口。
    (2) FFT: 即使得能够在NVIDIA GPU上高效执行FFT变换的库。

  2. 当我们launch了a grid of blocks of threads 的时候, 我们在kernel中需要指定CUDA的thread indexing。 关于CUDA线程模型如下图:
    这里写图片描述
    我们的计算thread的global index的情况有如下种9种:
    (1). 1D grid of 1D blocks

__device__ int getGlobalIdx_1D_1D() {
    return blockIdx.x * blockDim.x + threadIdx.x;
}

(2) 1D grid of 2D blocks

__device__ int getGlobalIdx_1D_2D() {
    return blockIdx.x * blockDim.x * blockDim.y + threadIdx.y * blockDim.x + threadIdx.x;
}

(3). 1D grid of 3D blocks

 __device__ int getGlobalIdx_1D_3D()
{ 

 return blockIdx.x * blockDim.x * blockDim.y * blockDim.z + threadIdx.z * blockDim.y * blockDim.x 
 + threadIdx.y * blockDim.x + threadIdx.x; 

}

(4) 2D grid of 1D blocks

__device__ int getGlobalIdx_2D_1D()
{ 

 int blockId = blockIdx.y * gridDim.x + blockIdx.x; 

int threadId = blockId * blockDim.x + threadIdx.x; 

 return threadId; 

}

(5) 2D grid of 3D blocks

__device__ int getGlobalIdx_2D_3D()
{ 

 int blockId = blockIdx.x 
+ blockIdx.y * gridDim.x; 

int threadId = blockId * (blockDim.x * blockDim.y * blockDim.z) 
+ (threadIdx.z * (blockDim.x * blockDim.y)) 
+ (threadIdx.y * blockDim.x)
 + threadIdx.x; 

 return threadId; 

}

(6) 3D grid of 1D blocks

__device__ int getGlobalIdx_3D_1D()
{ 

 int blockId = blockIdx.x + blockIdx.y * gridDim.x 
 + gridDim.x * gridDim.y * blockIdx.z; 

int threadId = blockId * blockDim.x + threadIdx.x; 

 return threadId; 

}

(7) 3D of 2D blocks

__device__ int getGlobalIdx_3D_2D()
{ 

 int blockId = blockIdx.x 
+ blockIdx.y * gridDim.x 
 + gridDim.x * gridDim.y * blockIdx.z; 

int threadId = blockId * (blockDim.x * blockDim.y)

 + (threadIdx.y * blockDim.x) + threadIdx.x; 

 return threadId; 

}

(8) 3D grid of 3D blocks

__device__ int getGlobalIdx_3D_3D()
{ 

 int blockId = blockIdx.x + blockIdx.y * gridDim.x 
 + gridDim.x * gridDim.y * blockIdx.z; 

int threadId = blockId * (blockDim.x * blockDim.y *       blockDim.z) 
+ (threadIdx.z * (blockDim.x * blockDim.y))  + (threadIdx.y * blockDim.x)
 + threadIdx.x; 

return threadId; 

}
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值