Amazon Web Services aims to expand presence of its AI chips in Korea
Amazon Web Services (AWS) Korea aims to expand the adoption of its in-house AI chips for training and inference among domestic clients this year, vying to compete with Nvidia’s dominant processors in the market.
Ham Kee-ho, The country managing director of AWS Korea, at a press event held at its office building in southern Seoul on Wednesday to outline business strategies for 2025, said:
Nvidia is not the only GPU provider,
“We have been producing our own GPUs for a long time, with dedicated chips for training, Trainium, and for inference, Inferentia, already in place. One of our key goals this year is to expand the adoption rate of the two chips in the Korean market.”
The U.S. cloud service provider is collaborating with domestic companies to conduct training tests and pilot projects, with concrete results to be announced “soon.”
AWS offers servers equipped with 16 Trainium2 chips, and supports large-scale AI model training through “UltraServers,” which bundle four servers together.
The company is also developing an AI supercomputer with Anthropic, under the code name Project Rainier, which will utilize hundreds of thousands of Trainium2 chips to significantly enhance AI training capabilities.
Anthropic’s training of its Claude 3.5 Haiku model was 60 percent faster using Tranium2 than other processors, and AI coding startup Poolside leveraged Trainium to cut down costs by 40 percent compared to Nvidia’s H100 GPUs, according to AWS.
The company is also undergoing an evaluation to receive cloud security certification (CSAP), a mandatory security verification for private cloud service providers (CSPs) before their services can be adopted by public institutions. Other foreign CSPs such as Microsoft and Google Cloud have obtained this certification.
Ham briefly stated regarding the matter,
The CSAP certification progress is progressing as planned,
AWS previously announced an investment of 7.85 trillion won ($5.4 billion) in Korea’s cloud computing infrastructure by 2027.
Ham said,
We have already invested 3 trillion won,
“The adoption rate of generative AI for Korean companies is relatively faster than global companies.”
READ the latest news shaping the AI Chips market at AI Chips News
Amazon Web Services aims to expand presence of its AI chips in Korea, source
Add comment