最近在测试caffe0.16,
ResNet-50 batch_size=64 8卡时可以跑得起来,但是1/2/4卡时均跑不起来,显示:
F0824 10:07:26.011203 35974 gpu_memory.hpp:38] Failed to allocate 40140800bytes on device 0. Total memory: 24025956352, Free: 33488896, dev_info[0]:total=24025956352 free=33488896
why?