- Checking the current GPU devices
$ nvidia-smi
Mon Sep 26 18:01:53 2016
+------------------------------------------------------+
| NVIDIA-SMI 352.63 Driver Version: 352.63 |
|-------------------------------+----------------------+----------------------+
| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |
|===============================+======================+======================|
| 0 Tesla K40c Off | 0000:02:00.0 Off | 0 |
| 31% 69C P0 74W / 235W | 150MiB / 11519MiB | 66% Default |
+-------------------------------+----------------------+----------------------+
| 1 GeForce GT 610 Off | 0000:81:00.0 N/A | N/A |
| 40% 43C P8 N/A / N/A | 277MiB / 1023MiB | N/A Default |
+-------------------------------+----------------------+----------------------+
| 2 Tesla K40c Off | 0000:82:00.0 Off | 0 |
| 30% 65C P0 68W / 235W | 113MiB / 11519MiB | 0% Default |
+-------------------------------+----------------------+----------------------+
- Selec two of them works fine.
export CUDA_VISIBLE_DEVICES=0 # only one K40c
export CUDA_VISIBLE_DEVICES=0,1 # one K40c + GT610
export CUDA_VISIBLE_DEVICES=0,2 # two K40c together
https://github.com/BVLC/caffe/issues/1993