Selecting Servers and GPUs

https://d2l.ai/chapter_appendix-tools-for-deep-learning/selecting-servers-gpus.html


from Deep Learning | One Page Knowledge

from Practical Deep Learning for Coders - Practical Deep Learning

  1. NVIDIA Optimized Deep Learning Framework, powered by Apache MXNet Release Notes - NVIDIA Docs
  2. PyTorch Release Notes - NVIDIA Docs
  3. TensorFlow Release Notes - NVIDIA Docs

NVIDIA Data Center Deep Learning Product Performance
Google pytorch vm


FrameView Performance and Power Benchmarking App

Graphics cards are investments, bought on the promise of delivering excellent performance in that card’s class for at least 2 to 3 years. It’s therefore important that the benchmarks of these cards, which you’re likely using as research, are accurate and cover all the bases, showing frame rates, frame times, power usage, performance per watt, and more.

Comparison of learning and inference speed of different gpu with various cnn models in pytorch

  • 1080TI
  • TITAN V
  • 2080TI

Horovod synthetic benchmarks
Transformers Benchmark