🔴 WATCH LIVE: NVIDIA GTC 2024 Keynote - The Future Of AI!

e

[Music]

[Music]

for

[Music]

[Laughter]

for

[Music]

[Music]

[Music]

[Music]

e

[Music]

[Music]

[Music]

[Music]

[Music]

[Music]

our show is about to

begin

[Music]

e

[Music]

I am a

Visionary Illuminating galaxies to

witness the birth of

[Music]

stars and sharpening our understanding

of extreme weather

[Music]

events I am a

helper guiding the blind through a

crowded

world I was thinking about running to

the store and giving voice to those who

cannot

speak to not make me laugh

love I am a

[Music]

Transformer harnessing gravity to store

Renewable

[Music]

Power and Paving the way towards

unlimited clean energy for us

[Music]

all I am a

trainer teaching robots to

assist

[Music]

to watch out for

danger and help save

lives I am a

Healer providing a new generation of

cures and new levels of patient care

doctor that I am allergic to penicillin

is it still okay to take the medic ation

definitely these antibiotics don't

contain penicillin so it's perfectly

safe for you to take

them I am a

navigator generating virtual

scenarios to let us safely explore the

real

world and understand every

decision

I even help write the

script breathe life into the

[Music]

words I am

AI brought to life by

Nvidia deep learning

and Brilliant

Minds

[Music]

everywhere please welcome to the stage

Nvidia founder and CEO Jensen

[Music]

Wong

welcome to

[Music]

[Applause]

GTC I hope you realize this is not a

concert you have

arrived at a developers

conference there will be a lot of

science

described algorithms computer

architecture mathematics

I sensed a very heavy weight in the room

all of a

sudden almost like you were in the wrong

place no no conference in the

world is there a greater assembly of

researchers from such diverse fields of

science from climate Tech to radio

scientist trying to figure out how to

use AI to robotically control MOS for

Next Generation 6G radios robotic

self-driving

cars even artificial

intelligence even artificial

intelligence

everybody's first I noticed a sense of

relief there all of all of a

sudden also this conference is

represented by some amazing

companies this list this is not the

attendees these are the

presentors and what's amazing is

this if you take away all of my friends

close friends Michael Dell is sitting

right there in the IT

industry all of the friends I grew up

with in the industry if you take away

that list this is what's

amazing these are the presenters of the

non-it industries using accelerated

Computing to solve problems that normal

computers

can't it's

represented in Live

Science it's rep

represented in life sciences healthc

care genomics

transportation of course retail

Logistics manufacturing

industrial the gamut of Industries

represented is truly amazing and you're

not here to attend only you're here to

present to talk about your research $100

trillion dollar of the world's

Industries is represented in this room

today this is absolutely

amazing

there is absolutely something happening

there is something going

on the industry is being transformed not

just ours because the computer industry

the computer is the single most

important instrument of society today

fundamental transformations in Computing

affects every industry but how did we

start how did we get here I made a

little cartoon for you literally I drew

this in one page this is nvidia's

Journey started in

1993 this might be the rest of the

talk 1993 this is our journey we were

founded in 1993 there are several

important events that happened along the

way I'll just highlight a few in 2006

Cuda which has turned out to have been a

revolutionary Computing model we thought

it was revolutionary then it was going

to be overnight success and almost 20

years later it

happened we saw it

coming two decades

later in

2012

alexnet Ai and

Cuda made first

Contact in

2016 recognizing the importance of this

Computing model we invented a brand new

type of computer we call the

dgx-1

170 Tera flops in this super computer

eight gpus connected together for the

very first time I hand delivered the

very first djx1 to a

startup located in San

Francisco called open

AI djx1 was the world's first AI

supercomputer remember 170

teraflops

2017 the Transformer arrived

2022 chat GPT captured the world's imag

imaginations have people realize the

importance and the capabilities of

artificial intelligence in

2023 generative AI emerged and a new

industry begins why

why is a new industry because the

software never existed before we are now

producing software using computers to

write software producing software that

never existed before it is a brand new

category it took share from

nothing it's a brand new category and

the way you produce the

software is unlike anything we've ever

done before in data

centers generating tokens

producing floating Point

numbers at very large scale as if in the

beginning of this last Industrial

Revolution when people realized that you

would set up

factories apply energy to it and this

invisible valuable thing called

electricity came out AC

generators and 100 years later 200 years

later we are now creating

new types of electrons tokens using

infrastructure we call factories AI

factories to generate this new

incredibly valuable thing called

artificial intelligence a new industry

has

emerged well we're going to talk about

many things about this new

industry we're going to talk about how

we're going to do Computing next we're

going to talk about the type of software

that you build because of this new

industry the new

software how you would think about this

new software what about applications in

this new

industry and then maybe what's next and

how can we start preparing today for

what is about to come next well but

before I

start I want to show you the soul of

Nvidia the soul of our company at the

intersection of computer

Graphics physics

and artificial

intelligence all intersecting inside a

computer in

Omniverse in a virtual world

simulation everything we're going to

show you today literally everything

we're going to show you

today is a simulation not animation it's

only beautiful because it's physics the

world is

beautiful it's only amazing because it's

being animated with robotics it's being

animated with artificial intelligence

what you're about to see all

day is completely generated completely

simulated in Omniverse and all of it

what you're about to enjoy is the

world's first concert where everything

is

homemade everything is homemade you're

about to watch some home videos so sit

back and eny enjoy

[Music]

yourself

[Applause]

[Music]

[Music]

w

[Music]

he

[Music]

[Music]

God I love

Nvidia accelerated Computing has reached

the Tipping

Point general purpose Computing has run

out of steam

we need another way of doing Computing

so that we can continue to scale so that

we can continue to drive down the cost

of computing so that we can continue to

consume more and more Computing while

being sustainable accelerated Computing

is a dramatic speed up over general

purpose Computing and in every single

industry we engage and I'll show you

many the impact is dramatic but in no

industry is a more important than our

own the industry of using simulation

tools to create

products in this industry it is not

about driving down the cost of computing

it's about driving up the scale of

computing we would like to be able to

simulate the entire product that we do

completely in full Fidelity completely

digitally and essentially what we call

digital twins we would like to design it

build it

simulate it operate it completely

digitally in order to do that we need to

accelerate an entire industry and today

I would like to announce that we have

some Partners who are joining us in this

journey to accelerate their entire

ecosystem so that we can bring the world

into accelerated Computing but there's a

bonus when you become accelerated your

INF infrastructure is cou to gpus and

when that happens it's exactly the same

infrastructure for generative

Ai and so I'm just delighted to announce

several very important Partnerships

there are some of the most important

companies in the world ansis does

engineering simulation for what the

world makes we're partnering with them

to Cuda accelerate the ancis ecosystem

to connect Anis to the Omniverse digital

twin incredible the thing that's really

great is that the install base of

Invidia GPU accelerated systems are all

over the world in every cloud in every

system all over Enterprises and so the

app the applications they accelerate

will have a giant installed base to go

serve end users will have amazing

applications and of course system makers

and csps will have great customer

demand

synopsis synopsis is nvidia's literally

first software partner they were there

in very first day of our company

synopsis revolutionized the chip

industry with highlevel design we are

going to Cuda accelerate synopsis we're

accelerating computational lithography

one of the most important applications

that nobody's ever known about in order

to make chips we have to push

lithography to the Limit Nvidia has

created a library domain specific

library that accelerates computational

lithography incredibly once we can

accelerate and software Define all of

tsmc who is announcing today that

they're going to go into production with

Nvidia kitho once is software defined

and accelerated the next step is to

apply generative AI to the future of

semiconductor manufacturing pushing

geometry even

further Cadence builds the world's

essential Ed and SDA tools we also use

Cadence between these three companies

ansis synopsis and Cadence

we basically build Nvidia together we

are cud to accelerating Cadence they're

also building a supercomputer out of

Nvidia gpus so that their customers

could do fluid Dynamic simulation at a

100 a thousand times scale

basically a wind tunnel in real time

Cadence Millennium a supercomputer with

Nvidia gpus inside a software company

building supercomputers I love seeing

that building k co-pilots together

imagine a

day when Cadence could synopsis ansis

tool providers would offer you AI

co-pilots so that we have thousands and

thousands of co-pilot assistants helping

us design chips Design Systems and we're

also going to connect Cadence digital

twin platform to Omniverse as you could

see the trend here we're accelerating

the world's CAE Eda and SDA so that we

could create our future in digital Twins

and we're going to connect them all to

Omniverse the fundamental operating

system for future digital

twins one of the industries that

benefited tremendously from scale and

you know you all know this one very well

large language

models basically after the Transformer

was

invented we were able to scale large

language models at incredible rates

effectively doubling every six months

now how is it possible possible that by

doubling every six months that we have

grown the industry we have grown the

computational requirements so far and

the reason for that is quite simply this

if you double the size of the model you

double the size of your brain you need

twice as much information to go fill it

and so every time you double your

parameter count you also have to

appropriately increase your training

token count the combination of those two

numbers becomes the computation scale

you have to

support the latest the state-of-the-art

open AI model is approximately 1.8

trillion parameters 1.8 trillion

parameters required several trillion

tokens to go

train so a few trillion parameters on

the order of a few trillion tokens on

the order of when you multiply the two

of them together approximately 30 40 50

billion

quadrillion floating Point operations

per second now we just have to do some

Co math right now just hang hang with me

so you have 30 billion

quadrillion a quadrillion is like a p

and so if you had a paa flop GPU you

would need

30 billion seconds to go compute to go

train that model 30 billion seconds is

approximately 1,000

years well 1,000 years it's worth

it like to do it sooner but it's worth

it which is usually my answer when most

people tell me hey how long how long's

it going to take to do something so 20

years I it's worth

it but can we do it next

week and so 1,000 years 1,000 years so

what we need what we need

need are bigger

gpus we need much much bigger gpus we

recognized this early on and we realized

that the answer is to put a whole bunch

of gpus together and of course innovate

a whole bunch of things along the way

like inventing tensor cores advancing MV

links so that we could create

essentially virtually Giant

gpus and connecting them all together

with amazing networks from a company

called melanox infiniband so that we

could create these giant systems and so

djx1 was our first version but it wasn't

the last we built we built

supercomputers all the way all along the

way in

2021 we had Seline 4500 gpus or so and

then in 2023 we built one of the largest

AI supercomputers in the world it's just

come

online

EOS and as we're building these things

we're trying to help the world build

these things and in order to help the

world build these things we got to build

them first we build the chips the

systems the networking all of the

software necessary to do this you should

see these

systems imagine writing a piece of

software that runs across the entire

system Distributing the computation

across thousands of gpus but inside are

thousands of smaller

gpus millions of gpus to distribute work

across all of that and to balance the

workload so that you can get the most

energ efficiency the best computation

time keep your cost down and so those

those fundamental

Innovations is what God is here and here

we

are as we see the miracle of chat GPT

emerg in front of us we also realize we

have a long ways to go we need even

larger models we're going to train it

with multimodality data not just text on

the internet but we're going to we're

going to train it on texts and images

and graphs and

charts and just as we learn watching TV

and so there's going to be a whole bunch

watching video so that these Mo models

can be grounded in physics understands

that an arm doesn't go through a wall

and so these models would have common

sense by watching a lot of the world's

video combined with a lot of the world's

languages it'll use things like

synthetic data generation just as you

and I

when we try to learn we might use our

imagination to simulate how it's going

to end up just as I did when I Was

preparing for this keynote I was

simulating it all along the

way I hope it's going to turn out as

well as I had in my

head as I was simulating how this

keynote was going to turn out somebody

did say that another performer

did her performance completely on a

treadmill so that she could be in shape

to deliver it with full

energy I I didn't do

that if I get a low wind at about 10

minutes into this you know what

happened and so so where were we we're

sitting here using synthetic data

generation we're going to use

reinforcement learning we're going to

practice it in our mind we're going to

have ai working with AI training each

other just like student teacher

Debaters all of that is going to

increase the size of our model it's

going to increase the amount of the

amount of data that we have and we're

going to have to build even bigger

gpus Hopper is

fantastic but we need bigger

gpus and so ladies and

gentlemen I would like to introduce

you to a very very big GPU

[Applause]

you named after David

Blackwell

mathematician game theorists

probability we thought it was a perfect

per per perfect name Blackwell ladies

and gentlemen enjoy this

[Music]

oh

[Music]

so

s

Blackwell is not a chip Blackwell is the

name of a

platform uh people think we make

gpus and and we do but gpus don't look

the way they used

to uh here here's the here's the here's

the the if you will the heart of the

Blackwell system and this inside the

company is not called Blackwell it's

just the number and um uh

this this is Blackwell sitting next to

oh this is the most advanced GP in the

world in production

today this is

Hopper this is hopper Hopper changed the

world this is

Blackwell

it's okay

Hopper you're you're very

good good good

boy well good

girl 208 billion transistors and so so

you could see you I can see that there's

a small line between two dieses this is

the first time two dyes have abutted

like this together in such a way that

the two chip the two dies think it's one

chip there's 10 terabytes of data

between it 10 terabytes per second so

that these two these two sides of the

Blackwell Chip have no clue which side

they're on there's no memory locality

issues no cash issues it's just one

giant chip and so uh when we were told

that Blackwell's Ambitions were beyond

the limits of physics uh the engineer

sits so what and so this is what what

happened and so this is the

Blackwell chip and it goes into two

types of systems the first

one is form fit function compatible to

Hopper and so you slide a hopper and you

push in Blackwell that's the reason why

one of the challenges of ramping is

going to be so efficient there are

installations of Hoppers all over the

world and they could be they could be

you know the same infrastructure same

design the power the electricity The

Thermals the software identical push it

right back and so this is a hopper

version for the current hgx

configuration and this is what the other

the second Hopper looks like this now

this is a prototype board and um Janine

could I just

borrow ladies and gentlemen J

Paul

and so this this is the this is a fully

functioning board and I just be careful

here this right here is I don't know10

billion the second one's

five it gets cheaper after that so any

customers in the audience it's

okay

all right but this is this one's quite

expensive this is to bring up board and

um and the the way it's going to go to

production is like this one here okay

and so you're going to take take this it

has two blackw D two two blackw chips

and four Blackwell dyes connected to a

Grace CPU the grace CPU has a super fast

chipto chip link what's amazing is this

computer is the first of its kind where

this much computation

first of all fits into this small of a

place second it's memory coherent they

feel like they're just one big happy

family working on one application

together and so everything is coherent

within it um the just the amount of you

know you saw the numbers there's a lot

of terabytes this and terabytes that um

but this is this is a miracle this is a

this let's see what are some of the

things on here uh there's um uh uh mvy

link on top PCI Express on the

bottom on on uh

your which one is mine and your left one

of them it doesn't matter uh one of them

one of them is a c CPU chipto chip link

it's my left or your depending on which

side I was just I was trying to sort

that out and I just kind of doesn't

matter

hopefully it comes plugged in

so okay so this is the grace Blackwell

[Applause]