Foxconn Announces Large Language Model (LLM) Refined from Metas Llama 3.1

Foxconn, the company best known for manufacturing iPhones and other Apple hardware products, has just surprised everyone by announcing its first large language model (LLM), called FoxBrain, which is intended to be used to improve manufacturing and supply chain management.

The Taiwanese manufacturer said that FoxBrain was trained with just 120 Nvidia H100 GPUs. This LLM is essentially built on Meta's Llama 3.1 architecture, with 70 billion parameters through a distillation process. The concept of LLM distillation involves taking a "parent" model and training a "child" model based on its feedback. Foxconn also admitted that its LLM is not as good as the refined model of China's DeepSeek, but the overall performance is very close to world-class standards.

Speaking about this achievement, Dr. Yung-Hui Li, Director of the Artificial Intelligence Research Center at Hon Hai Research Institute (Foxconn), said:

In recent months, the increasing inference capabilities and efficient use of GPUs have gradually become the main trends in the field of AI. Our FoxBrain model has adopted a very effective training strategy, focusing on optimizing the training process rather than blindly accumulating computing power.

Through carefully designed training methods and resource optimization, we have succeeded in building a local AI model with strong reasoning capabilities."

Foxconn Announces Large Language Model (LLM) Refined from Meta's Llama 3.1

Foxconn not only assembles Apple products, but also manufactures Nvidia’s AI servers. With 120 H100 GPUs, FoxBrain is scaled up with Nvidia’s Quantum-2 InfiniBand network, and the training process took only about 4 weeks (with a total computational cost of 2,688 GPU days). Foxconn generated 98 billion high-quality pre-training data tokens in traditional Chinese with a context window length of up to 128,000 tokens.

The partnership between Foxconn and Nvidia isn't new, and the two companies are also working on other projects, including building the world's largest Blackwell GPU manufacturing facility.

Nvidia also provided Foxconn with the Taipei-1 supercomputer to complete the model pre-training process. Foxconn said FoxBrain will become a “key engine” to upgrade the company’s three main platforms: Smart Manufacturing, Smart Electric Vehicles, and Smart Cities.

Sign up and earn $1000 a day ⋙

Leave a Comment

What is 1314?

What is 1314?

1314 is a number often used by young people as a love code. However, not everyone knows what 1314 is and what it means?

How to protect your mental and physical health when in a toxic environment

How to protect your mental and physical health when in a toxic environment

Dealing with toxic situations can be incredibly difficult. Here are some tips to help you handle toxic environments tactfully and maintain peace of mind.

Ways music stimulates the brain

Ways music stimulates the brain

Most people know that music is not just for entertainment but has many benefits. Here are some ways music stimulates our brain development.

The most commonly deficient nutrients in the diet

The most commonly deficient nutrients in the diet

Diet is important to our health. Yet most of our meals are lacking in these six important nutrients.

How to use Circle Ks CK Club app to receive attractive offers

How to use Circle Ks CK Club app to receive attractive offers

To get the fastest promotional information from Circle K, you should install the CK Club application. The application saves your payments when shopping or paying at Circle K as well as the number of stamps collected.

Instagram Will Allow Reels Up to 3 Minutes Long

Instagram Will Allow Reels Up to 3 Minutes Long

Instagram has just announced that it will allow users to post Reels videos up to 3 minutes long, double the previous 90-second limit.

How to view Chromebook CPU information

How to view Chromebook CPU information

This article will guide you how to view CPU information, check CPU speed directly on your Chromebook.

8 Cool Things You Can Do With an Old Android Tablet

8 Cool Things You Can Do With an Old Android Tablet

If you don't want to sell or give away your old tablet, you can use it in 5 ways: as a high-quality photo frame, music player, e-book & magazine reader, housework assistant, and as a secondary screen.

How to get beautiful nails quickly

How to get beautiful nails quickly

You want to have a beautiful, shiny, healthy nail quickly. The simple tips for beautiful nails below will be useful for you.

Color inspiration secrets only designers know

Color inspiration secrets only designers know

This article will list color-inspired tips, shared by top designers from the Creative Market community, so you can get the perfect color combination every time.

Everything you need to replace your laptop with a phone

Everything you need to replace your laptop with a phone

Can you really replace your laptop with your phone? Yes, but you'll need the right accessories to turn your phone into a laptop.

ChatGPT will soon be able to see everything happening on your screen

ChatGPT will soon be able to see everything happening on your screen

One important thing in the full event video was that the upcoming ChatGPT app feature was demoed but no real details were shared. That is, ChatGPT's ability to see everything that's happening on the user's device screen.

AI is learning to fool humans despite being trained to be honest

AI is learning to fool humans despite being trained to be honest

Many top AIs, despite being trained to be honest, learn to deceive through training and systematically induce users into false beliefs, a new study finds.

How to change questions on ChatGPT

How to change questions on ChatGPT

ChatGPT now has a question change option so users can edit the question or content they are exchanging with ChatGPT.

How to spot fake QR codes and keep your data safe

How to spot fake QR codes and keep your data safe

QR codes seem pretty harmless until you scan a bad one and get something nasty thrown at you. If you want to keep your phone and data safe, there are a few ways you can spot a fake QR code.