常用函数记录（更新中 2023-3-23）

记录汇总一下读code过程中遇到的函数。

• torch

torch.gt(): greater than

FlopCountAnalysis(): count flops(evaluating model flops)

torch.numel(): number of elements

torch.cuda.synchronize(gpu): wait for gpu to finish kernels(used in timing)

torch.lazylinear(): needs to be initialized in first call of forward(), needs to specify out_features

torch.nn.init: a bunch of initializations of model parameters

torch.amp: automatic mixed precision(use GradScale to prevent gradient from underflow)

torch.flatten(): flatten a tensor, may start from a given dimension

silu(): Swish activation function

torch.multiply(): alias for torch.mul(), multiplication with broadcasting

• numpy

np.percentile(): find percentile in an array, used for elinimating outliers

• python string

str.startswith(): prefix matching

• multiprocessing

mp.Manager(): generates a space for shared instances.

mp.Process(target, args): create process which executes function "target", with arguments args

process.start(): start a process

process.join(): 

• sklearn

metrics.roc_auc_score: compute the Area Under the Receiver Operating Characteristic Curve (ROC AUC) from prediction scores.

• tensorboard

summarywriter.add_scalar():