[Summarry] Synchronized BatchNorm

MegDet 与 Synchronized BatchNorm

https://blog.youkuaiyun.com/yiran103/article/details/80820300

[论文笔记]MegDet: A Large Mini-Batch Object Detector

https://blog.ddlee.cn/posts/e9b3289c/

caffe：同步Batch Normalization(syncbn)作用

https://blog.youkuaiyun.com/l297969586/article/details/87719753?depth_1-utm_source=distribute.pc_relevant.none-task-blog-BlogCommendFromMachineLearnPai2-1&utm_source=distribute.pc_relevant.none-task-blog-BlogCommendFromMachineLearnPai2-1

batch normalization的multi-GPU版本该怎么实现？

https://www.zhihu.com/question/59321480