저자: JensenHuang · 외국인
요약 보기
젠슨 황은 엔비디아가 한국 정부·삼성·SK·현대 등과 6만 개 GPU 도입을 발표했고, 내년 추가로 25만 개를 배치하며 합계 26만 개 규모를 언급했다. 한국이 지역 AI 허브가 될 가능성을 낙관했다. 삼성 파운드리 협력은 헤징이 아닌 상호보완 관계라고 설명했다. 중국 시장은 사실상 0% 기대로 제외되어 있으며, 이는 회사에 영향을 주지만 다른 성장 기회가 크다고 밝혔다. 한국 시가총액 5조 달러 돌파에 대해서는 감사하다고만 답했다.
다듬은 글
Let me just if we take if we take this question then then the whole room will be less loud. No, I I'm not allowed. Okay. Let me take this and I'll take your car. Yeah. Yeah. So Nvidia just announced a deal involving 60,000 GPUs with South Korean governments. The country is leading us to a giant. So are there any plans to supply additional unions to other companies in South Korea or government?
So any plans to have more countries coming up in South Korean government? There are 60,000 GPUs in Korea today. Right. In the next year, we were we will deploy another 250,000 in just Samsung, SK, Hyundai, Neighbor, and the Korean government. And so just five teams will deploy another 260,000. That's very significant.
After that, there's no question in my mind that Korea will build many more AI factories here. Not just for the Korean industry, which is one of the largest economies in the world and one of the largest technology industries in the world, but also because Korea has a chance to be an AI hub of the region and it has the ability to attract startups that are in other countries to be hosted on Korea AI cloud.
It also has the opportunity to attract companies to invest here. You know, if you want to be an AI company, you need to have AI infrastructure. If Korea has AI infrastructure, you can attract the investment of many startups. So, I'm very optimistic about the future of AI in Korea. Talk to us about the foundry cooperation with Samsung Electronics.
Are you in a way hedging TSMC? No, hedging isn't really the right way to think about it. How would you describe it? Um we have partners that that uh are excel at the areas of manufacturing semiconductors. It is not as you know I make chips there are many companies that make chips and we make chips in different ways for different reasons and different different uh value propositions if you will and so it's the same with Samsung and you know they are deeply they're deep and excellent in their field of semiconductors and and whenever we have opportunities where our products uh are perfect fit for the way that they manufacture chips uh we find opportunities to work together today
Samsung manufacturer all of Nvidia's robotics processors. You mentioned that the um Chinese government was blocking. I'll come back. It was my fault. GDP, thanks for talking to me. Um will you guys will these new announcements? I've been up since 3:00 in the morning, so a little tired. So, will these new announcements make up for the shortfall um with the Chinese market for Nvidia?
That's really the best way to think about about it is that China is a very large market. It's a very important market. The developers that the developer and the industry is really vibrant. It's dynamic. Um the vast majority of the world's open source AI is developed in China. Q in China um deep so on so forth.
There's so so many amazing AI research in China. They do amazing work and they do it in an open source way. And so it's the China market is just simply unique. It's important. It's an important and large market for all of the reasons that I mentioned. And so there is no replacing it. But is it justified that you're being locked out of the market because of the US China relations?
Um, I hope that we will be able to go back to China and and um I I'll keep I'll keep explaining the reasons why it's important for American companies to be able to particip participate in the China market and and I'll I'll keep uh I'll keep um uh being optimistic that that China would want American companies to be in the China market because China wants to be a a region, a market where people invest, where uh able to build businesses and they love they love companies coming into the China market.
They want to be an open and so I'll continue to be optimistic about these things and and hopefully things work. Is Nvidia suffering because you've not got access to the Chinese market? Is Nvidia suffering because you've got not got access to the Chinese market? Um the definition of obviously It will be impactful for every single company and uh and all of the CEO my CEO friends and companies giants here in Korea have announced big partnerships and we're going to launch.
What's the potential of silver programs you mentioned especially across Asia? Well, here in Korea, Korea has a chance to be one of the world's major AI hubs along with President Lee's passion, enthusiasm, drive to create this journey for Korea. This is a perfect example of sovereign AI. We just saw you have a conversation with SK Group to check their SK group and Samsung in that rivalry right now that you're getting uh business with both companies.
What's the potential? Well, they're both friends and uh they're friendly competitors. Uh, of course competition is terrific and Korea Korea is is going to be Korea and the reason for that as you know without the HDM there is no I'll come back to you. I promise you. Heat. Heat. Okay. Okay. All right.
All right. All right. What do you think about lasting plan if anything happens with every in the world? Yeah. Heat. Let me just take if we take this question then then the whole room will be less loud. No I'm not allowed. Okay. We take this and I'll tell you. So Nvidia just announced a deal involving 60,000 GPU supposed to be Jayan and um Tony and I having having fried chicken and and the reason I I just really love Korean fried chicken.
Who doesn't love Korean fried chicken, right? There's K-pop and there's KFC, right? And so, so and uh and so last night was the first night I've been back for many many years. And so I was hoping that three of us, the four of us would go, but Tony had a doctor because he's very busy. He's the chairman of Apex and so he could not join us.
Mostly he spoke about flight. Yeah. And then we spoke about uh they they introduced me to uh uh show so many so many so many and how many I I had quite a few that's why that's why I'm a little slow today but but we we did that and we spoke to the other guests and we spoke uh to a lot of people who were actually and we spoke to the restaurant owner you know that's that's what we spoke
I thought you were closer found something wasn't there. No, we were hope all of us were hoping in Korea's market cap just surpassed 5 trillion recently. what do you think is main uh mainly driving uh the milestone and do you see it as sustainable? Um and first of all I'm I'm grateful that that uh company is valued so much but the reason for that is because we invented impactful for every single company and and uh and all of the CEO my CEO friends and companies with the giant companies here in Korea have announced big partnerships and we're going to launch What's the potential programs that you mentioned especially across Asians?
Well, here in Korea, Korea has a chance to be one of the world's major AI clubs along with President Lee's passion, enthusiasm, drive to create this journey for this is a perfect example of sovereign AI. We're just going to have a conversation with SK Group in Czech SK Group and Samsung in that rivalry right now that you're getting uh business with both companies.
Well, they're both friends and uh they're friendly. Uh, of course competition is terrific and uh Korea Korea is is going to be Korea tremendously and the reason for that as you know and they're friendly. Uh, of course competition is terrific and uh Korea Korea is is going to be uh Korea is going to be tremendous and the reason for that as you know without the HDM there is no I'll come back to you.
I promise you. China we share in China now we're 0% sure and disappointed by and uh but we're expecting zero we're hoping for non zero but we're expecting zero and um uh we'll do our best and continue to continue to grow the company you know of course around the world the opportunity is really quite substantial.
We're going through a platform shift from the old way of doing computing to this new way of Nvidia's way of doing accelerated computing and AI. We're in the beginning of that the decade journey of building out uh this infrastructure. I think it's going to be really a lot of growth uh with or without China.
But the China market is very special and we we um we don't take it for granted and it would be really helpful that we're in there to Korea. Um when do you expect the chips to be delivered to Korea? the the critical path for chips in Korea is actually building the factories, the data centers chips get here as fast as possible.
Okay, question. This is your last question, but I I do. Do you remember? Every time I go to Taiwan, I be the first person. Yeah. Morris Morris and Sophia is always your first and I always What's your message for people in South Korea who admires you and your company's vision? Well, I'm great I'm grateful.
I'm grateful for your friendship. Uh Korea has well 2 years old. We were probably, you know, a hundred million dollar company, just a small company and Korea was very welcoming. It was also quite incredible that we have invented a whole new genre of sports and because of the GeForce is so important to this we became if you will the the gear of choice of Korea and a whole generation of young people grew up on so we've had a very long relationship and one that I treasure very and now now we have a new journey you know in the beginning it uh Korea uh growing with India's journey now growing with Korea's journey and the journey of AI.
ingredient. Take one more question. One more question. Who's going to take? The last question is very important, right? Who has a good question to be the last question? Are you Is this the last question? Okay, everyone is going to hear her question. Let's hear her question. We can decide whether it's a good last question.
You are you sure? Yes. Okay. Um, her last question. Are you sure? Yes. Uh, I I think they're still working on it. Uh, in Taiwan, we have a lot of employees there and our office space is not enough. And so, we selected a very beautiful site to put in Taiwan. And um uh I think there's still discussing between the local government and the and the land owner.
I don't know what the latest status is, but I do know this. All of the people in Taipei really would like Nvidia to be in Taipei. But if we cannot find anywhere in Taipei, I have to put it somewhere. And so so I I hope I can put it in Taipei. Okay. Thank you everybody. Thank you. Thank you everybody.
For every single company and uh and all of the CEO my CEO friends and companies with the giant office here in Korea have announced big partnerships and we're going to launch programs like you mentioned especially across Asia. Well, here in Korea, Korea has a chance to be one of the world's major AI hubs along with President Lee's passion, enthusiasm, drive to create this journey for Korea.
This is a perfect example of AI. We just saw you have a conversation with SK Group. S group and Samsung in you got rivalry right now that you're getting uh business with gold companies. Well, they're both friends and uh they're friendly countries. Uh, of course, competition is terrific and Korea Korea is is going to be Korea tremendously and the reason for that as you know Without the HDM I'll come back to you.
I promise you. and over domestic Heat. Okay, great. Okay. Thank you. Okay. Okay. All right. What do you think about last contingency plan if anything happens with a new technology in the world? Yeah. Heat. If you take if we take this question then then the whole room will be less loud. No, I I'm not allowed for that.
Okay, let me take this and I'll tell you. So, Nvidia has announced a deal involving 60,000 GPU South Korean governments. The country is being given any plans to supply additional unions to other companies in South Korea government. Are there any plans to have more countries coming up in South Korean government?
There are 60,000 GPUs in Korea today, right? In the next year, we were we will deploy another 250,000 in just Samsung, SK, Hyundai, Neighbor, and the Korean government. And so just five teams will deploy another 260,000. That's very significant. After that, there's no question in my mind that Korea will build many more AI factories here.
Not just for the Korean industry, which is one of the largest economies in the world and one of the largest technology industries in the world, but also because Korea has a chance to be an AI hub of the region and it has the ability to attract startups that are in other countries to be hosted on Korea AI cloud.
It also has the opportunity to attract companies to invest here. You know, if you want to be an AI company, you need to have AI infrastructure. If Korea has AI infrastructure, you can attract the investments of many startups. So, I'm very optimistic about the future of AI in Korea. Talk to us about the foundry cooperation with Samsung Electronics.
Are you in a way hedging TSMC? No, hedging isn't really the right way to think about it. How would you describe it? Um we have partners that that uh are excel at the areas of manufacturing semiconductors. It is not as you know I make chips there are many companies that make chips and we make chips in different ways for different reasons and different different uh value propositions if you will and so it's the same with Samsung and you know they are deeply they're deep and excellent in their field of semiconductors and and whenever we have opportunities where our products uh are perfect fit for the way that they manufacture chips uh we find opportunities to work together today
Samsung manufacturers all of Nvidia's robotics processors. You mentioned that the um Chinese government was blocking I'll come back and thanks for talking to me all night. Will these new announcements I've been up since 3:00 in the morning so I'm a little tired. Totally. Will these new announcements make up for the short calls um with the Chinese market or in video?
That's really the best way to think about about it is that China is a very large market. It's a very important market. The developers that the developer in the industry is really dynamic. Um the vast majority of the world opensource AI is developed in China. Q China um deep so on so forth. There's so so many amazing AI research in China.
They do amazing work and they do it in an open source way. And so it's the China market is just simply unique. It's important. It's an important and large market for all of the reasons that I mentioned. And so there is no replacing it. But is it justified that you're being locked out of the market because of the US China relations?
Um, I hope that we will be able to go back to China and and um I I'll keep I'll keep explaining the reasons why it's important for American companies to be able to particip participate in the China market and and I'll I'll keep uh I'll keep um being optimistic that that China would want American companies to be in the China market because China wants to a region of market where people invest where people to build businesses and they love they love companies coming into the Chinese.
So I'll continue to be optimistic about these things and hopefully we'll work. Is Nvidia suffering because you've not got access to the Chinese market? Is Nvidia suffering because you've got not got access to the Chinese market? impactful for every single company and uh and all of the CEO my CEO friends and companies with the giant companies here in Korea have announced big partnerships and we're going to launch
what's the potential programs have been mentioned especially across Asia well here in Korea Korea has a chance to be one of the world's major AI hubs along with President Lee's passion drive who are dedicated to create this journey for this is a perfect example of sovereign AI which is saw you have a conversation with SK group SK group and Samsung in that rivalry right now that you're getting uh business with both company.
Well, they're both friends and companies and uh they're friendly competitors. Uh, of course, competition is terrific and Korea Korea is is going to be Korea tremendously. And the reason for that as you know without the HDM there is no I'll come back to you. I promise you. Heat. Heat. Okay. Okay. All right.
All right. What do you think about last world? Heat. Heat. Heat. All right. If we take if we take this question then then the whole room will be less loud. No, I I'm not. Okay. We take this and I'll tell you. So if you guys have announced a deal involving 60,000 South Korean governments the country is leading us to giants.
So are there any plans to supply additional units to other companies in South Korea or government? Are there any plans to have more countries coming up in South Korean government? There are 60,000 GPUs in Korea today. In the next year, we were we will deploy another 250,000 in just Samsung, SK, Hyundai, Neighbor, and the Korean government.
And so just five teams will deploy another 260,000. That's very significant. After that, there's no question in my mind that Korea will build many more AI factories here. Not just for the Korean industry, which is one of the largest economies in the world and one of the largest technology industries in the world, but also because Korea has a chance to be an AI hub of the region and it has the ability to attract startups that are in other countries to be hosted on Korea AI cloud.
It also [clears throat] has the opportunity to attract companies to invest here. You know, if you want to be an AI company, you need to have AI infrastructure. If Korea has AI infrastructure, you can attract the investments of many startups. So, I'm very optimistic about the future of AI in Korea. There are more.
Talk to us about the foundry cooperation with Samsung Electronics. Are you in a way hedging TSMC? No, hedging isn't really the right way to think about it. How would you describe it? Um we have partners that that uh are excel at the areas of manufacturing semiconductors. It is not as you know I make chips there are many companies that make chips and we make chips in different ways for different reasons and different different uh value propositions if you will and so it's the same with Samsung and you know they are deeply they're deep and excellent in their field of semiconductors and and whenever we have opportunities where our products uh are perfect fit for the way that they manufacture chips uh we find opportunities to work together today
Samsung manufacturers all of Nvidia's robotics processors. You mentioned that the um Chinese government was blocking. I'll come back. I'll come back. I'll come back. It was my fault. EDPA, thanks for talking to me. Um all night, you guys. Will these new announcements will I've been up since 3:00 in the morning, so a little tired.
Totally. Will these new announcements make up for the short calls um with the Chinese market and video? That's really the best way to think about about it is that China is a very large market. It's a very important market. The developer se the developer is really dynamic. Um the vast majority of the world's open source AI is developed in China.
Q China um deep so on so forth. There's so so many amazing AI research in China. They do amazing work and they do it in an open source way. And so it's the China market is just simply unique. It's important. It's an important and large market for all of the reasons that I mentioned. And so there is no replacing it.
But is it justified that you're being locked out of the market because of the US China relations? Um, I hope that we will be able to go back to and and um I I'll keep I'll keep explaining the reasons why it's important for American companies to be able to participate in the China market and and I'll I'll keep uh I'll keep um being optimistic that that China would want American companies to be in China market because China wants to be a region market where people invest where people who build businesses and they love they love companies and so I'll continue to be optimistic about these things and hopefully we'll still work.
Is Nvidia suffering because you've not got access to the Chinese market? Is Nvidia suffering because you've got not got access to the Chinese market? impactful for every single company and uh and all of the CEO my CEO friends and companies with giant companies here in Korea have announced big partnerships and we're going to launch.
What's the potential programs you mentioned especially across Asia? Well, here in Korea, Korea has a chance to be one of the world's major AI hubs along with President Lee's passion, enthusiasm, drive to create this journey for this is a perfect example of AI. We just saw you have a conversation with SK Group.
S group and Samsung got rivalry right now that you're getting uh business with gold companies. Well, they're both friends and uh they're friendly countries. Uh, of course, competition is terrific and Korea Korea is is going to be Korea tremendously and the reason for that as you know Without the HDM I'll come back to you.
I promise you. And over the next decade of Yeah. Heat. Okay, great. Okay. Okay. Okay. All right. What do you think about last does have any contingency plan if anything happens with a new technology in the world? Yeah. Heat. If we take if we take this question then then the whole room will be less loud.
No, I I'm not allowed on that. Okay, let me take this and I'll tell you. So, Nvidia has announced a deal involving 60,000 GPU South Korean governments. The country is being given any plans to supply additional unions to other companies in South Korea government. Are any plans to have more countries coming up in South Korean government?
There are 60,000 GPUs in Korea today, right? In the next year, we were we will deploy another 250,000 in just Samsung, SK, Hyundai, Neighbor, and the Korean government. And so just five teams will deploy another 260,000. That's very significant. After that, there's no question in my mind that Korea will build many more AI factories here.
Not just for the Korean industry, which is one of the largest economies in the world and one of the largest technology industries in the world, but also because Korea has a chance to be an AI hub of the region and it has the ability to attract startups that are in other countries to be hosted on Korea AI cloud.
It also has the opportunity to attract companies to invest here. You know, if you want to be an AI company, you need to have AI infrastructure. If Korea has AI infrastructure, you can attract the investment of many startups. So, I'm very optimistic about the future of AI in Korea. Talk to us about the foundry cooperation with Samsung Electronics.
Are you in a way hedging TSMC? No, hedging isn't really the right way to think about it. How would you describe it? Um we have partners that that uh are excel at the areas of manufacturing semiconductors. It is not as you know I make chips there are many companies that make chips and we make chips in different ways for different reasons and different different uh value propositions if you will and so it's the same with Samsung and you know they are deeply they're deep and excellent in their field of semiconductors and and whenever we have opportunities where our products uh are perfect fit for the way that they manufacture chips uh we find opportunities to work together today
Samsung manufacturers all of Nvidia's robotics processors. You mentioned that the um Chinese government was blocking. I'll come back. I'll come back. I'll come back. It was my fault. EDP news. Thanks for talking to me. Um will you guys will these new announcements will I've been up since 3:00 in the morning, so I'm a little tired.
Totally. Will these new announcements make up for the short calls um with the Chinese market or in video? That's really the best way to think about about it is that China is a very large market. It's a very important market. The developers that the developer in the industry is really dynamic. Um the vast majority of the world opensource AI is developed in China.
Q China um deep so on so forth. There's so so many amazing AI research in China. They do amazing work and they do it in an open source way. And so it's the China market is just simply unique. It's important. It's an important and large market for all of the reasons that I mentioned. And so there is no replacing it.
But is it justified that you're being locked out of the market because of the US China relations? Um, I hope that we will be able to go back to China and and um I I'll keep I'll keep explaining the reasons why it's important for American companies to be able to particip participate in the China market and and I'll I'll keep uh I'll keep um being optimistic that that China would want American companies to be in the China market because China wants to a region of market where people invest where people to build businesses and they love they love companies coming into the Chinese and so I'll continue to be optimistic about these things and hopefully we'll still work
is Nvidia suffering because you've not got access to the Chinese market is Nvidia suffering because you've got not got access to the Chinese marketing obviously That's it everyone. Good job. Ankur, could you send in a summary in 10 minutes? Is that even possible? Got it. With Acrobat, it's all sorted.
Are you looking to have your own custom domain? With Cloudflare, you can get transparent at cost market pricing with no fees or markups. Your domain comes automatically integrated with our free website security and performance plan that includes CDN, unmeter DDOS protection, a universal SSL certificate, and more.
So you can rest easy that your new domain is protected from the start at cloudflare.com. The initials GPT stand for generative pre-trained transformer. So that first word is straightforward enough. These are bots that generate new text. Pre-trained refers to how the model went through a process of learning from a massive amount of data.
And the prefix insinuates that there's more room to fine-tune it on specific tasks with additional training. But the last word, that's the real key piece. A transformer is a specific kind of neural network, a machine learning model, and it's the core invention underlying the current boom in AI. What I want to do with this video and the following chapters is go through a visually driven explanation for what actually happens inside a transformer.
We're going to follow the data that flows through it and go step by step. There are many different kinds of models that you can build using transformers. Some models take in audio and produce a transcript. This sentence comes from a model going the other way around, producing synthetic speech just from text.
All those tools that took the world by storm in 2022, like Dolly and Midjourney that take in a text description and produce an image, are based on transformers. Even if I can't quite get it to understand what a pie creature is supposed to be, I'm still blown away that this kind of thing is even remotely possible.
And the original transformer introduced in 2017 by Google was invented for the specific use case of translating text from one language into another. But the variant that you and I will focus on, which is the type that underlies tools like chat GPT, will be a model that's trained to take in a piece of text, maybe even with some surrounding images or sound accompanying it, and produce a prediction for what comes next in the passage.
That prediction takes the form of a probability distribution over many different chunks of text that might follow. At first glance, you might think that predicting the next word feels like a very different goal from generating new text. But once you have a prediction model like this, a simple thing you could try to make it generate a longer piece of text is to give it an initial snippet to work with, have it take a random sample from the distribution it just generated, append that sample to the text, and then run the whole process again to make a new prediction based on all the new text, including what it just added.
I don't know about you, but it really doesn't feel like this should actually work. In this animation, for example, I'm running GPT2 on my laptop and having it repeatedly predict and sample the next chunk of text to generate a story based on the seed text. And the story just doesn't actually really make that much sense.
But if I swap it out for API calls to GPT3 instead, which is the same basic model just much bigger, suddenly almost magically, we do get a sensible story. One that even seems to infer that a pie creature would live in a land of math and computation. This process here of repeated prediction and sampling is essentially what's happening when you interact with chat GPT or any of these other large language models and you see them producing one word at a time.
In fact, one feature that I would very much enjoy is the ability to see the underlying distribution for each new word that it chooses. Let's kick things off with a very high-level preview of how data flows through a transformer. We will spend much more time motivating and interpreting and expanding on the details of each step, but in broad strokes.
When one of these chatbots generates a given word, here's what's going on under the hood. First, the input is broken up into a bunch of little pieces. These pieces are called tokens. And in the case of text, these tend to be words or little pieces of words or other common character combinations. If images or sound are involved, then tokens could be little patches of that image or little chunks of that sound.
Each one of these tokens is then associated with a vector, meaning some list of numbers, which is meant to somehow encode the meaning of that piece. If you think of these vectors as giving coordinates in some very highdimensional space, words with similar meanings tend to land on vectors that are close to each other in that space.
This sequence of vectors then passes through an operation that's known as an attention block. And this allows the vectors to talk to each other and pass information back and forth to update their values. For example, the meaning of the word model in the phrase a machine learning model is different from its meaning in the phrase a fashion model.
The attention block is what's responsible for figuring out which words in the context are relevant to updating the meanings of which other words and how exactly those meanings should be updated. And again, whenever I use the word meaning, this is somehow entirely encoded in the entries of those vectors.
After that, these vectors pass through a different kind of operation. And depending on the source that you're reading, this will be referred to as a multi-layer perceptron or maybe a feed forward layer. And here the vectors don't talk to each other. They all go through the same operation in parallel.
And while this block is a little bit harder to interpret, later on we'll talk about how the step is a little bit like asking a long list of questions about each vector and then updating them based on the answers to those questions. All of the operations in both of these blocks look like a giant pile of matrix multiplications.
And our primary job is going to be to understand how to read the underlying matrices. I'm glossing over some details about some normalization steps that happen in between, but this is after all a highle preview. After that, the process essentially repeats. You go back and forth between attention blocks and multi-layer perceptron blocks until at the very end, the hope is that all of the essential meaning of the passage has somehow been baked into the very last vector in the sequence.
We then perform a certain operation on that last vector that produces a probability distribution over all possible tokens, all possible little chunks of text that might come next. And like I said, once you have a tool that predicts what comes next given a snippet of text, you can feed it a little bit of seed text and have it repeatedly play this game of predicting what comes next, sampling from the distribution, appending it, and then repeating over and over.
Some of you in the know may remember how long before chat GPT came into the scene, this is what early demos of GPT3 looked like. You would have it autocomplete stories and essays based on an initial snippet. To make a tool like this into a chatbot, the easiest starting point is to have a little bit of text that establishes the setting of a user interacting with a helpful AI assistant, what you would call the system prompt.
And then you would use the user's initial question or prompt as the first bit of dialogue. And then you have it start predicting what such a helpful AI assistant would say in response. There is more to say about an added step of training that's required to make this work well, but at a high level, this is the general idea.
Huge bubbles are inflating all over New York City. Sources are linking this phenomenon to the new Colossal Bubble Mascara by Maybelline New York. The lightweight formula and inflator comb brush give big bubble volume on Indian lashes with zero smudge and is completely waterproof. The new colost bubble mascara from Maybelline New York.
In this chapter, you and I are going to expand on the details of what happens at the very beginning of the network, at the very end of the network. And I also want to spend a lot of time reviewing some important bits of background knowledge, things that would have been second nature to any machine learning engineer by the time Transformers came around.
If you're comfortable with that background knowledge and a little impatient, you could probably feel free to skip to the next chapter, which is going to focus on the attention blocks, generally considered the heart of the transformer. After that, I want to talk more about these multi-layer perceptron blocks, how training works, and a number of other details that will have been skipped up to that point.
For broader context, these videos are additions to a minieries about deep learning. And it's okay if you haven't watched the previous ones. I think you can do it out of order. But before diving into Transformers specifically, I do think it's worth making sure that we're on the same page. She Not going to be our enjoyment.
Fore aboutchech. Yeah. Speech. Speech. Well, being material. We just saw you have a conversation with SK Group Czech SK Group and Samsung in that rivalry right now that you're getting uh business with both companies. What's the potential there? Well, they're both friends of mine and um uh they're friendly competitors.
Uh, of course, competition is terrific and and uh Korea Korea is is going to be uh Korea is going to be uh uh growing tremendously in civil and the reason for that as you know Samsung and SK helped me in the AI super computer. Without the HPM memory there is no AI super computer and so I'll come back to you.
I promise you. They help me in the AI super computer and over the next decade uh memory technology has been growing will be very significant with with respect to China. Uh China is now 0% business. We use 95% share of the AI business in China. Now we're at zero share and I'm disappointed by and uh I I hope that will change but irrespective I think it's going to grow once out of
okay thank you very much okay all okay all right the the extraordinary what do you think And at last does have any contingency plan if anything happens with a high technology in the world already happening cyber security guard. Heat. Heat. Let me just if we take if we take this question then then the whole room will be less loud.
No, I I'm not allowed. Okay, let me take this and I'll take it. I'll take Yeah. Yeah. So, NB has announced a deal involving EPU South Korean governance. The country is leading us to a giant. So are there any plans to supply additional unions to other companies in South Korea or government? Are there any plans to have more contracts coming up in South Korean government or there are 60,000 GPUs in Korea today, right?
In the next year, we were we will deploy another 250,000 in just Samsung, SK, Hyundai, Neighbor, and the Korean government. And so just five teams will deploy another 260,000. That's very significant. After that, there's no question in my mind that Korea will build many more AI factories here. Not just for the Korean industry which is one of the largest economies in the world and one of the largest technology industries in the world but also because Korea has a chance to be an AI hub of the region and it has the ability to attract startups that are in other countries to be hosted on Korea AI cloud.
It also has the opportunity to attract companies to invest here. You know if you want to be an AI company you need to have AI infrastructure. If Korea has AI infrastructure, you can attract the investments of many startups. So I'm very optimistic about the future of AI in Korea. Talk to us about the foundry cooperation with Samsung electronics.
Are you in a way hedging TSMC? No, hedging isn't really the right way to think about it. How would you describe it? Um, we have partners that that uh are excel at the areas of manufacturing semiconductors. It is not, as you know, I make chips. There are many companies that make chips and we make chips in different ways for different reasons and different different uh value propositions if you will and so it's the same with Samsung and you know they are deeply they're deep and excellent in their field of semiconductors and and whenever we have opportunities where our products uh are perfect fit for the way that they manufacture chips uh we find opportunities to work together.
Today, Samsung manufactures all of Nvidia's robotics processors. You mentioned that the um Chinese government was blocking. I'll come back. I'll come back. DBP News, thanks for talking to me. Um will you guys will these new announcements? I've been up since 3:00 in the morning, so a little tired. So have we.
Will these new announcements make up for the shortfall um with the Chinese market for Nvidia? That's really the best way to think about about it is that China is a very large market. It's a very important market. The developers that the developer and the industry is really vibrant. It's dynamic. Um the vast majority of the world's open source AI it's developed in China.
Q is involved in China um deep so on so forth. There's so so many amazing AI research in China and they do amazing work and they do it in an open source way and so it's the China market is just simply unique. It's important. It's an important and large market for all of the reasons that I mentioned.
And so there's just no replacing it. But is it justified that you're being locked out of the market because of the US China relations? Um, I hope that we will be able to go back to China and and um I I'll keep I'll keep explaining the reasons why it's important for American companies to be able to particip participate in the China market and and I'll I'll keep uh I'll keep um uh being optimistic that that China would want American companies to be in the China market because China wants to be a a region, a market where people invest, where uh people build businesses and they love they love uh companies coming into the China market.
They want to be an open market and so I'll I'll continue to be optimistic about these things and and hopefully things will still work. Is Nvidia suffering because you've not got access to the Chinese market? Is Nvidia suffering because you've got not got access to the Chinese market? Um if the definition of suffering obviously It will be impactful for every single company and and uh and all of the CEO my CEO friends and companies giant conference here in Korea have announced big partnerships and we're going to launch.
What's the potential of silver programs that you mentioned especially across Asia? Well, that's here in Korea. Korea has a chance to be one of the world's major AI hubs along with President Lee's passion, enthusiasm, drive are dedicated to uh create this journey for Korea. This is a perfect example of sovereign AI.
We just saw you have a conversation with SK group SK Group and Samsung in that rivalry right now that you're getting uh business with both companies. What's the potential? Well, they're both friends of mine and um uh they're friendly competitors. Uh, of course competition is terrific and uh Korea Korea is is going to be uh Korea is going to be growing tremendously and the reason for that as you know help the AI without the HBM there is no AI and so I'll come back to you.
I promise you. And over the next decade, our memory technology is very China is now we share China. Now we're at 0% and disappointed by and I hope that irrespective of okay what do you think At last contingency plan if anything happens with technology in the Heat. Heat. Heat. Let me just if you take if we take this question then then the whole room will be less loud.
No, I I'm not allowed. Okay, let me take this and I'll take you out. Okay, cool. Yeah. Yeah. So, Nvidia just announced a deal involving 60,000 KPU supposed to be Jay uh his son and um Tony and I having having fried chicken and and the reason I I just really love Korean fried chicken. Who doesn't love Korean fried chicken, right?
There's K-pop and there's KFC, right? And so, so and and uh and so last night was the first night I've been back for many many years. And so I was hoping that the three of us, the four of us would go off, but Tony had a doctor because he's very busy. He's the chairman of Apex and so he could not join us.
Mostly he spoke about fighting. Yeah. And then we spoke about uh they they introduced me to uh uh show so many so many so many. And how many did you I I had quite a few. That's why that's why I'm a little slow today. But but we we did that and we spoke to the other guests and we spoke uh to a lot of people who were actually and we spoke to the restaurant owner, you know, and that's that's what we spoke about.
I thought you were closer to downtown because Tony wasn't there. No, I was we were all of us were hoping market cap just surpassed 5 trillion dollars recently. What do you think is may uh maybe driving uh the milestone and do you see it as a stable? Um and they first of all I'm I'm grateful that that uh the company is is valued so much but the reason for that is because we invented impactful for every single company and and uh and all of the CEO my CEO friends and companies with the giant conference here in Korea have announced big partnerships and we're going to launch
what's the potential silver programs have been mentioned especially across Asians. [clears throat] Well, that's here in Korea. Korea has a chance to be one of the world's major AI hubs along with President Lee's passion, enthusiasm, drive, my friends who are dedicated to uh create this journey for Korea.
This is a perfect example of sovereign AI. We're just sawing you have a conversation with SK Group in Czech SK Group and Samsung in that rivalry right now that you're getting uh business with both companies. What's the potential? Well, they're both friends and um uh they're friendly companies. Uh, of course competition is terrific and and uh Korea Korea is is going to be uh Korea is going to be growing tremendously and the reason for that as you know and uh they're friendly competitors uh of course competition is terrific and and uh Korea Korea is is going to be uh Korea is going to be u growing tremendously and the reason for that as you know health without the HDM memory there is no I'll come back to you I promise you are healthy and over the next decade our memory technology is growing very China is now we use 95% share of the AR China now we're at 0% share and disappointed by and uh we're expecting zero we're hoping for non zero but we're expecting zero and um uh we'll do our best and continue to continue to grow the company.
You know, of course, around the world, the opportunity is really quite substantial. We're going through a platform shift from the old way of doing computing to this new way, Nvidia's way of doing accelerated computing and AI. We're in the beginning of that the decade journey of building out uh this infrastructure.
I think it's going to be really a lot of growth. uh with or without China, but the China market is very special and we we um we don't take it for granted and it would be really helpful that we're in there to Korea. Um when do you expect the chips to be delivered to Korea? the the critical path for chips in Korea is actually building the factories, the data centers chips get here as fast as possible.
Okay, question. Yeah, this is your last question. I I do. Do you remember? Every time I go to Taiwan, I think he's the first person I [clears throat] have. Yeah. Morris Morris and Sophia is always the first guy and I always What's your message for people in South Korea who admires you and your company's vision?
Well, I'm great I'm grateful I'm grateful for your friendship. Uh Korea has well 2 years old. We were probably, you know, a hundred million dollar company, just a small company. And Korea was was very loving and welcoming. It was also quite incredible that Korea invented a whole new genre of sports, esport.
And because of the GeForce is so important to esports, we became, if you will, the the gear of choice of Korea. and a whole generation of young people grew up on a new so we've had a very long relationship and one that I treasure and now now we have a new journey you know in the beginning it was uh Korea uh growing with India's journey now it's a very growing with Korea's journey and the journey of AI so I'm very grateful I'll take this question
aside from creating the best in the world and the that in learning about what insurance the last question is Very important, right? Okay. Who Who has who is going to ask a good question to be the last question? Are you Is this the last? Okay. Everyone is going to hear her question. Let's hear her question.
We can decide whether it's a good last question. Are you sure? Yes. Okay. Her last question. Are you sure? Yes. Uh I I think you're still working on it. uh in India in India, Taiwan, we have a lot of employees there and our office space is not enough and so we selected a very beautiful site to put in Taiwan and um uh I think there's still discussing between the local government and the and the land owner.
I don't know what the latest status is, but I do know this. All of the people in Taipei really would like Nvidia to be in Taipei. But if we cannot find anywhere in Taipei, I have to put it somewhere. And so so I I hope I can put it in Taipei. Okay. Thank you everybody. Thank you. Thank you everybody.
for every single company and and uh and all of the CEO my CEO friends and companies with the giant companies here in Korea have announced big partnerships and we're going to launch what's the potential to run programs like you mentioned especially across Asia well here in Korea Korea has a chance to be one of the world's major AI hubs along with President Lee's passion enthusiasm and drive my co are dedicated to uh create this journey for Korea.
This is a perfect example of sovereign AI. We just saw you have a conversation with SK group SK group and Samsung in that rivalry right now that you're getting uh business with both companies. What's the potential? Well, they're both friends and parties and um uh they're friendly competitors. Uh, of course, competition is terrific and and uh Korea Korea is is going to be uh Korea is going to be growing tremendously and the reason for that as you know help the AI without the HP memory there is no AI and so I'll come back to you.
I promise you. And over the next decade, our memory technology is here. China is now we share China. Now we're at 0% and disappointment and I hope that irrespective of okay the next what do you think about We ask and last does community have any contingency plan if anything happens with a technology in the world personnel would be given a task for rescue operations for instance there are about 235 training regulations Earn certification certification.
If we take if we take this question then then the whole room will be less loud. No, I I'm not allowed on that. Okay, let me take this and I'll tell you. Okay, cool. So, Nvidia just announced a deal involving 26,000 GPU South Korean governments. The country is being giant. So, are there any plans to supply additional units to other companies in South Korea or government?
Are there any plans to have more countries coming up in South Korean government or there are 60,000 GPUs in Korea today, right? In the next year, we were we will deploy another 250,000 in just Samsung, SK, Hyundai, Neighbor, and the Korean government. And so just five teams will deploy another 260,000.
That's very significant. After that, there's no question in my mind that Korea will build many more AI factories here. Not just for the Korean industry, which is one of the largest economies in the world and one of the largest technology industries in the world, but also because Korea has a chance to be an AI hub of the region and it has the ability to attract startups that are in other countries to be hosted on Korea AI cloud.
It also has the opportunity to attract companies to invest here. You know, if you want to be an AI company, you need to have AI infrastructure. If Korea has AI infrastructure, you can attract the investments of many startups. So, I'm very optimistic about the future of AI in Korea. Talk to us about the foundry cooperation with Samsung Electronics.
Are you in a way hedging TSMC? No, hedging isn't really the right way to think about it. How would you describe it? Um we have partners that that uh are excel at the areas of manufacturing semiconductors. It is not as you know I make chips there are many companies that make chips and we make chips in different ways for different reasons and different different uh value propositions if you will and so it's the same with Samsung and you know they are deeply they're deep and excellent in their field of semiconductors and and whenever we have opportunities where our products uh are perfect fit for the way that they manufacture chips uh we find opportunities to work together.
Today, Samsung manufactures all of Nvidia's robotics processors. You mentioned that the um Chinese government was blocking. I'll come back. I'll come back. I'll come back. It was my fault. BBC News, thanks for talking to me. Um will you guys will these new announcements will I've been up since 3:00 in the morning, so I'm a little tired.
Totally. Will these new announcements make up for the shortfalls um with the Chinese market for Nvidia? That's really the best way to think about about it is that China is a very large market. It's a very important market. The developers that the developer and the industry is really it's dynamic. Um the vast majority of the world opensource AI is developed in China.
Q in China um deep sea and so on so forth. There's so so many amazing AI research in China and they do amazing work and they do it in an open source way and so it's the China market is just simply unique. It's important it's an important and large market for all of the reasons that I mentioned. And so there is no replacing it.
But is it justified that you're being locked out of the market because of the US China relations? Um, I hope that we will be able to go back to China and and um I, you know, I'll keep I'll keep explaining the reasons why it's important for American companies to be able to particip participate in the China market and and I'll I'll keep uh I'll keep um being optimistic that that China would want American companies to be in the China market because China wants to a region, a market where people invest, where people can businesses and they love they love companies coming into the China market.
They want to be an open and so I'll continue to be optimistic about these things and hopefully we'll still work. Is Nvidia suffering because you've not got access to the Chinese market? Is Nvidia suffering because you've got not got access to the Chinese market? Um the definition of something obviously impactful for every single company and and uh and all of the CEO my CEO friends and companies with the giant companies here in Korea have announced big partnerships and we're going to launch.
What's the potential silver programs you mentioned especially across Asia? Well, that's here in Korea. Korea has a chance to be one of the world's major AI hubs along with President Lee's passion, enthusiasm, drive who are dedicated to uh create this journey for Korea. This is a perfect example of sovereign AI.
We're just sawing you have a conversation with SK Group in Czech SK Group and Samsung in that rivalry right now that you're getting uh business with both companies. What's the potential? Well, they're both friends and um uh they're friendly competitors. Uh, of course competition is terrific and and uh Korea Korea is is going to be uh Korea is going to be growing tremendously and the reason for that as you know Samsung helps the AI without the HDMI there is no I'll come back to you.
I promise you. And over the next decade, our memory technology is here. China is now we share China now and I hope that irrespective Okay. Thank you. Okay. All right. Okay. All right. What do you think about last contingency plan? If anything happens with a new ideology in the Heat. Heat. Yeah. Heat.
Let me just take if we take this question. Yeah. Then then the whole room will be less loud. No, I I'm not allowed. Okay. We take this and I'll take you out. Okay. So Nvidia just announced a deal involving 26,000 CPU South Korean governments. They're countries leading industrial giants. So are there any plans to supply additional units to other companies in South Korea or government?
Are there any plans to have more countries coming up in South Korean government or there are 60,000 GPUs in Korea today, right? In the next year, we were we will deploy another 250,000 in just Samsung, SK, Hyundai, Neighbor, and the Korean government. And so just five teams will deploy another 260,000.
That's very significant. After that, there's no question in my mind that Korea will build many more AI factories here. Not just for the Korean industry, which is one of the largest economies in the world and one of the largest technology industries in the world, but also because Korea has a chance to be an AI hub of the region and it has the ability to attract startups that are in other countries to be hosted on Korea AI cloud.
It also has the opportunity to attract companies to invest here. You know, if you want to be an AI company, you need to have AI infrastructure. If Korea has AI infrastructure, you can attract the investments of many startups. So, I'm very optimistic about the future of AI in Korea. Talk to us about the foundry cooperation with Samsung Electronics.
Are you in a way hedging TSMC? No, hedging isn't really the right way to think about it. How would you describe it? Um we have partners that that uh are excel at the areas of manufacturing semiconductors. It is not as you know I make chips there are many companies that make chips and we make chips in different ways for different reasons and different different uh value propositions if you will and so it's the same with Samsung and you know they are deeply they're deep and excellent in their field of semiconductors and and whenever we have opportunities where our products uh are perfect fit for the way that they manufacture chips uh we find opportunities to work together today
Samsung manufacturers all of Nvidia's robotics processors. You mentioned that the um Chinese government was blocking. I'll come back. I'll come back. I'll come back. It was my fault. EBP, thanks for talking to me. Um all night, you guys. Will these new announcements will I've been up since 3:00 in the morning, so a little tired.
Absolutely. Will these new announcements make up for the short calls um with the Chinese market or in video? That's really the best way to think about about it is that China is a very large market. It's a very important market. The developers the developer in the industry is purely China. It's dynamic.
Um the vast majority of the world's open source AI is developed in China. Q in China um deep so on so forth. There's so so many amazing AI research in China. They do amazing work and they do it in an open source way. And so it's the China market is just simply unique. It's important. It's an important and large market for all of the reasons that I mentioned.
And so there is no replacing it. But is it justified that you're being locked out of the market because of the US China relations? Um, I hope that we will be able to go back to China and and um I I'll keep I'll keep explaining the reasons why it's important for American companies to be able to particip participate in the China market and and I'll I'll keep uh I'll keep um being optimistic that that China would want American companies to be in the China market because China wants to be a region, a market where people invest, where people to build businesses and they love they love companies coming into the China market.
They want to be in the world and so I'll I'll continue to be optimistic about these things and hopefully we'll still work. Is Nvidia suffering because you've not got access to the Chinese market? Is Nvidia suffering because you've got not got access to the Chinese market? Um the definition of obviously impactful for every single company and and uh and all of the CEO my CEO friends and companies with giant companies here in Korea have announced big partnerships and we're going to launch
what's the potential so programs like you mentioned especially across Asia well does here in Korea Korea has a chance to be one of the most major AI hubs along with President Lee's passion, enthusiasm, drive dedicated to uh create this journey for Korea. This is a perfect example of sovereign AI. We just saw you have a conversation with SK group SK group and Samsung in that rivalry right now that you're getting uh business with both companies.
What's the potential? Well, they're close friends of mine and uh they're friendly competitors. Uh, of course, competition is terrific and uh Korea Korea is is going to be uh Korea is going to be growing tremendously. And the reason for that as you know Samsung help the AI without the HP memory there is no so I'll come back to you I promise you healthy and over the next decade Our memory technology is here very China we share China now we're 0% sure and I hope that irrespective question what's Okay, great.
Thank you. Okay. Okay. All right. What do you think about the at last contingency plan? If anything happens with a technology in the world. Heat. Heat. Yeah. Heat. Let me just if we take if we take this question then then the whole room will be less loud. No I I'm not allowed. Okay. Let me take this and I'll tell you.
So Nvidia just announced a deal involving 60,000 GPU South Korean government. The country is leading us to giant. So are there any plans to supply additional unions to other companies in South Korea or government? Are there any plans to have more countries coming up in South Korean government? There are 60,000 GPUs in Korea today.
In the next year, we were we will deploy another 250,000 in just Samsung, SK, Hyundai, Neighbor, and the Korean government. And so just five teams will deploy another 260,000. That's very significant. After that, there's no question in my mind that Korea will build many more AI factories here. Not just for the Korean industry, which is one of the largest economies in the world and one of the largest technology industries in the world, but also because Korea has a chance to be an AI hub of the region and it has the ability to attract startups that are in other countries to be hosted on Korea AI cloud.
It also has the opportunity to attract companies to invest here. You know, if you want to be an AI company, you need to have AI infrastructure. If Korea has AI infrastructure, you can attract the investments of many startups. So, I'm very optimistic about the future of AI in Korea. Talk to us about the foundry cooperation with Samsung Electronics.
Are you in a way hedging TSMC? No, hedging isn't really the right way to think about. How would you describe it? Um we have partners that that uh are excel at the areas of manufacturing semiconductors. It is not as you know I make chips there are many companies that make chips and we make chips in different ways for different reasons and different different uh value propositions if you will and so it's the same with Samsung and you know they are deeply they're deep and excellent in their field of semiconductors and and whenever we have opportunities where our products uh are perfect fit for the way that they manufacture chips uh we find opportunities to work together.
Today, Samsung manufactures all of Nvidia's robotics processors. Did you mention that the I'm
댓글 0