[Computer-go] Nvidia Titan V!
gcp at sjeng.org
Fri Dec 8 06:27:12 PST 2017
On 08-12-17 09:29, Rémi Coulom wrote:
> Nvidia just announce the release of their new GPU for deep learning:
> "The Titan V is available today and is limited to two per
> $2,999, 110 TFLOPS!
You can test Voltas on AWS, the prices are very acceptable.
I had problems getting good convergence with fp16 training, even taking
into account all the tricks in NVIDIA's "mixed precision learning"
document and using the respective NVIDIA-caffe branches. It worked for
the policy network, but not for the value network.
You only get 110 TFLOPS when using the mixed precision fp16 into fp32
accumulator matrix multipliers from the Tensor Cores, otherwise it's not
so different from a 1080 Ti in speed. It has a lot of cores, but the
clock-speed is much lower.
I also had the impression that using the Tensor Cores disables the
Winograd transform, perhaps due to accuracy issues? So you lose a factor
~3 in speedup.
Things to consider before plunking down 3000 USD :-)
More information about the Computer-go