The Lambda deep learning blog

Published on January 28, 2021 by Michael Balaban

A100 vs V100 Deep Learning Benchmarks

Check out the discussion on Reddit 195 upvotes, 23 comments

Published on January 4, 2021 by Michael Balaban

RTX A6000 Deep Learning Benchmarks

Lambda is now shipping RTX A6000 workstations & servers. In this post, we benchmark the RTX A6000's PyTorch and TensorFlow training performance. We compare ...

Published on May 22, 2020 by Stephen Balaban

NVIDIA A100 GPU Benchmarks for Deep Learning

Lambda customers are starting to ask about the new NVIDIA A100 GPU and our Hyperplane A100 server. The A100 will likely see the large gains on models like ...

Published on February 18, 2020 by Michael Balaban

Choosing the Best GPU for Deep Learning in 2020

State-of-the-art (SOTA) deep learning models have massive memory footprints. Many GPUs don't have enough VRAM to train them. In this post, we determine which ...

Published on March 12, 2019 by Michael Balaban

Titan V Deep Learning Benchmarks with TensorFlow

In this post, Lambda Labs benchmarks the Titan V's Deep Learning / Machine Learning performance and compares it to other commonly used GPUs. We use the Titan V ...

Published on March 4, 2019 by Stephen Balaban

RTX 2080 Ti Deep Learning Benchmarks with TensorFlow

by Chuan Li, PhD

Published on February 17, 2019 by Stephen Balaban

Perform GPU, CPU, and I/O stress testing on Linux

CPU, GPU, and I/O utilization monitoring using tmux, htop, iotop, and nvidia-smi. This stress test is running on a Lambda GPU Cloud 4x GPU instance. Often ...

Published on February 11, 2019 by Chuan Li

V100 server on-prem vs AWS p3 instance cost comparison

Deep Learning requires GPUs, which are very expensive to rent in the cloud. In this post, we compare the cost of buying vs. renting a cloud GPU server. We use ...

Published on January 7, 2019 by Chuan Li

ResNet9: train to 94% CIFAR10 accuracy in 100 seconds with a single Turing GPU

DAWNBench recently updated its leaderboard. Among the impressive entries from top-class research institutes and AI Startups, perhaps the biggest leap was ...

Published on December 26, 2018 by Michael Balaban

Titan RTX Deep Learning Benchmarks

Titan RTX vs. 2080 Ti vs. 1080 Ti vs. Titan Xp vs. Titan V vs. Tesla V100. For this post, Lambda engineers benchmarked the Titan RTX's deep learning ...

Published on October 12, 2018 by Stephen Balaban

Crowd Sourced Deep Learning GPU Benchmarks from the Community

We open sourced the benchmarking code we use at Lambda Labs so that anybody can reproduce the benchmarks that we publish or run their own. We encourage people ...

Published on October 8, 2018 by Stephen Balaban

Deep Learning GPU Benchmarks - V100 vs 2080 Ti vs 1080 Ti vs Titan V

At Lambda, we're often asked "what's the best GPU for deep learning?" In this post and accompanying white paper, we evaluate the NVIDIA RTX 2080 Ti, RTX 2080, ...