[Computer-go] Using GPUs?
darren at dcook.org
Fri Jun 26 06:20:14 PDT 2015
> http://arxiv.org/abs/1412.6564 (nvidia gtx titan black)
> http://arxiv.org/abs/1412.3409 (nvidia gtx 780)
Thanks - I had read those papers but hadn't realized the neural nets
were run on GPUs.
This was very useful, thanks!
>> As for hardware breakthroughs, Nvidia has announced that its next
>> generation GPUs (codenamed Pascal) will offer 10x the performance in 2016,
>> so you might want to wait a little more.
One of the comments, on the above blog, questions that 10x speed-up:
So, currently they use a 32-bit float, rather than a 64-bit double, but
will reduce that to 16-bit to get a double speed-up. Assuming they've
been listening to customers properly, that must mean 16-bit floats are
good enough for neural nets?
More information about the Computer-go