With our special offer you can get 2 years of NordPass with 1 month free for a personal account:
Or use code highyieldnordpass at checkout.

Business accounts (must register with a biz domain) can get a free 3-month trial of NordPass: with code highyieldbusiness in the form.
….

What hardware was used to train ChatGPT and what does it take to keep it running? In this video we will take a look at the AI hardware behind ChatGPT and figure out how Microsoft & OpenAI use machine learning and Nvidia GPUs to create advanced neural networks.

Support me on Patreon:
Follow me on Twitter:

Links
The Google research paper that changed everything:
The OpenAI research paper confirming Nvidia V100 GPUs:

0:00 Intro
0:28 AI Training & Inference
2:22 Microsoft & OpenAI Supercomputer
4:08 NordPass
5:57 Nvidia Volta & GPT-3
9:05 Nvidia Ampere & ChatGPT
13:23 GPT-3 & ChatGPT Training Hardware
14:41 Cost of running ChatGPT / Inference Hardware
16:06 Nvidia Hopper / Next-gen AI Hardware
17:58 How Hardware dictates the Future of AI