Running large language models (LLMs) locally on your Android phone means you can access AI models without relying on cloud servers or an Internet connection . This local setup ensures privacy by keeping your data secure and on-device. With advances in mobile hardware, running AI models locally has become a reality. The MLC Chat app makes it easy to experience this powerful technology right on your phone.
This article will explain the importance of running LLM locally on Android phones and provide step-by-step instructions to install and run them using the MLC Chat app.
Why run LLM on Android phone?
LLMs are typically run on cloud servers because they require significant computing power. While Android phones have some limitations when running LLMs, they also open up some interesting possibilities.
Step by Step Guide to Install and Run MLC Chat on Android
The MLC Chat application is designed to allow users to run and interact with large language models (LLMs) locally on a variety of devices, including mobile phones, without relying on cloud-based services. Follow the steps below to run LLMs locally on an Android device.
Step 1: Install MLC Chat application
First, you need to download the APK for MLC Chat app (112MB) from the link below.
Once the APK is downloaded, tap on the file to start the installation.
Step 2: Download LLM
After successfully installing the app, open it and you will see a list of LLMs available for download. Models of different sizes and capacities, such as LLama-3.2, Phi-3.5, and Mistral, are available. Select the model according to your needs and tap the download icon next to it to start downloading. For example, if you are using a mid-range phone like Redmi Note 10, choose a lightweight model like Qwen-2.5 for smoother performance.
Step 3: Run the installed LLM
Once the model is downloaded, a chat icon will appear next to it. Tap the icon to start modeling.
Once the model is ready, you can start typing prompts and interacting with the local LLM.
For example, on a device like the Redmi Note 10, running a smaller model like Qwen2.5 provides a fairly smooth experience, generating around 1.4 tokens per second. While this performance is slower than high-end devices like the Galaxy S23 Ultra , it still works fine for basic tasks like short chats and simple content creation.
Running LLM locally on Android devices via the MLC Chat app provides an accessible and privacy-preserving way to interact with AI models. Performance is highly dependent on the phone’s hardware. This solution is ideal for users who need offline access to AI models, experiment with LLM in real time, or are concerned about privacy. As mobile hardware continues to improve, the capabilities of local LLM will only expand, making this an exciting frontier for AI technology.
It's easy to think of screenshots as temporary, but many of us never delete them. The danger is that some of them can become gold mines for hackers, identity thieves, or even just curious friends.
Many people think that their Samsung phone battery can no longer meet the daily needs. But after turning off these overlooked settings, the battery can easily last all day.
Current web browsers on computers or phones all have the option to delete browsing history, such as deleting browsing history on Chrome, deleting browsing history on Firefox,...
Many people never thought they would leave Stock Android. But after just a week of using this launcher, they now find the original interface bland and restrictive.
Microsoft's new feature makes it easy to open shared files on Android anonymously without having to log in to your account.
Losing your phone is one of the most frustrating experiences you can have. While you may not be able to get your old device back, there are ways to recover your data.
Smartphones have replaced so many other devices. They are so versatile that you probably don't need any of the categories of devices they replace.
With auto click applications. You will not have to do much when playing games, using applications or tasks available on the device.
Notifications are great for staying informed, but they can quickly get out of hand. With so many alerts coming from different apps, checking the notification center can feel like wading through a sea of information.
Many people never expected the weakest camera on their phone to become a secret weapon for creative photography.
Maybe your Google Play payment card has expired, or you want to switch to a new bank. Here's how to remove a payment method from your Google Play account.
Sometimes, if there is a problem with this tool on your Android phone, uninstalling and reinstalling Google Play Store is one of the recommended solutions.
If you're an Android user, you're probably familiar with the term APK, but did you know there's also something called XAPK? This guide explains what XAPK files are and how you can install them on your device.
Deleted contacts on Android phones will be moved to the Google Contacts trash folder, from there you can restore deleted contacts according to the instructions below.
While most of us look for the best specs at the lowest price, it's important to remember that they aren't everything.
It's easy to think of screenshots as temporary, but many of us never delete them. The danger is that some of them can become gold mines for hackers, identity thieves, or even just curious friends.
Many people think that their Samsung phone battery can no longer meet the daily needs. But after turning off these overlooked settings, the battery can easily last all day.
Current web browsers on computers or phones all have the option to delete browsing history, such as deleting browsing history on Chrome, deleting browsing history on Firefox,...
You can use iCloud Keychain or iCloud Keychain to save your passwords and easily access them on your iPhone. Here's how to recover deleted passwords on your iPhone.
The Phone app on iPhone when upgraded to iOS 18 has been updated with a call history search feature. Below are instructions for searching call history on iPhone.
The Wallet app on iOS 26 lets you store physical card information alongside your digital payment card. This feature lets you quickly access your account number, expiration date, and other information without having to carry your physical card.
You may have had an iPhone for years, but pairing it with a Mac completely changes the way you use it. There's a whole layer of functionality that only comes to light when the two devices work together.
The yellow battery color displayed on the iPhone screen is actually due to a new feature called Low Power Mode by Apple. This feature will not be automatically activated without the user's permission. If you accidentally allowed the mode to be activated while using it and now do not know how to turn off the yellow iPhone battery icon, please refer to the following instructions.
The Notes app on iOS 26 gets an update that lets you create 3D graphs from functions you enter without needing another app or doing too much work.
The Messages app on iPhone has a lot of fun and cool features, like the invisible ink effect that will hide your messages.
Many people never thought they would leave Stock Android. But after just a week of using this launcher, they now find the original interface bland and restrictive.
iOS 26 has added an option to enlarge the lock screen clock so that users can adjust it if needed. Below are instructions to enlarge the iPhone lock screen clock.
The Apple account web interface in your browser lets you view your personal information, change settings, manage subscriptions, and more. But sometimes you can't sign in for a variety of reasons.
When Find My becomes inaccurate or unreliable, apply a few tweaks to make it more accurate when it's needed most.
Microsoft's new feature makes it easy to open shared files on Android anonymously without having to log in to your account.
