Running large language models (LLMs) locally on your Android phone means you can access AI models without relying on cloud servers or an Internet connection . This local setup ensures privacy by keeping your data secure and on-device. With advances in mobile hardware, running AI models locally has become a reality. The MLC Chat app makes it easy to experience this powerful technology right on your phone.
This article will explain the importance of running LLM locally on Android phones and provide step-by-step instructions to install and run them using the MLC Chat app.
Why run LLM on Android phone?
LLMs are typically run on cloud servers because they require significant computing power. While Android phones have some limitations when running LLMs, they also open up some interesting possibilities.
Step by Step Guide to Install and Run MLC Chat on Android
The MLC Chat application is designed to allow users to run and interact with large language models (LLMs) locally on a variety of devices, including mobile phones, without relying on cloud-based services. Follow the steps below to run LLMs locally on an Android device.
Step 1: Install MLC Chat application
First, you need to download the APK for MLC Chat app (112MB) from the link below.
Once the APK is downloaded, tap on the file to start the installation.
Step 2: Download LLM
After successfully installing the app, open it and you will see a list of LLMs available for download. Models of different sizes and capacities, such as LLama-3.2, Phi-3.5, and Mistral, are available. Select the model according to your needs and tap the download icon next to it to start downloading. For example, if you are using a mid-range phone like Redmi Note 10, choose a lightweight model like Qwen-2.5 for smoother performance.
Step 3: Run the installed LLM
Once the model is downloaded, a chat icon will appear next to it. Tap the icon to start modeling.
Once the model is ready, you can start typing prompts and interacting with the local LLM.
For example, on a device like the Redmi Note 10, running a smaller model like Qwen2.5 provides a fairly smooth experience, generating around 1.4 tokens per second. While this performance is slower than high-end devices like the Galaxy S23 Ultra , it still works fine for basic tasks like short chats and simple content creation.
Running LLM locally on Android devices via the MLC Chat app provides an accessible and privacy-preserving way to interact with AI models. Performance is highly dependent on the phone’s hardware. This solution is ideal for users who need offline access to AI models, experiment with LLM in real time, or are concerned about privacy. As mobile hardware continues to improve, the capabilities of local LLM will only expand, making this an exciting frontier for AI technology.
TWRP allows users to save, install, backup and restore firmware on their devices without worrying about affecting the state of the device when rooting, flashing or installing new firmware on Android devices.
On the Google Play Store, there are many alternative applications to the default Android gallery. They provide more interesting features than the default gallery such as connecting to Dropbox or Google Photos accounts, etc. Depending on your needs and desires, you can choose the following applications.
It is important to work on the image you are selecting to review on the app. This is why you need to know what your screenshots look like to grab the user's attention and get them to download.
Here are some of the best calorie counting apps on both Android and iOS mobile platforms.
To make your mobile experience easier to navigate, you can change the font size on Android. When text, fonts, and icons are easier to see, you may also want to make your Android keyboard larger.
If you are not tech savvy, it is easy to get confused about different operating systems, manufacturers, device models, and specifications. One such example is people considering Samsung and Android as synonymous, which is not entirely correct.
If you've been using a Samsung phone for a few years now, you'll find the great features the Galaxy line offers hard to beat.
Taking screenshots on Samsung Galaxy phones is also extremely easy.
Setting a default volume level for each application is useful in some cases, such as you are watching a video using the Youtube application and want to reduce the volume of the ringtone and message tone so as not to be disturbed.
Trying to completely delete and uninstall an app on Android isn't always as simple as tapping Uninstall. Instead, files are left behind, cluttering up your system, but there are ways to get rid of them.
The default camera apps on your phone can do a lot, but they still don't have many advanced tools for creative photography. Here are the best phone camera apps.
In the article below, Quantrimang will talk about how Shelter works and how to use this tool.
While Android accessibility features are designed with specific needs in mind, some of them can benefit everyone.
Juggling multiple apps on your phone to get things done can sometimes feel overwhelming. Luckily, Android offers a variety of features that make multitasking a breeze.
Most virtual keyboard apps include a vibration feedback feature — also known as “haptic feedback” — to make typing on a touchscreen more realistic.
Many different issues can cause your iPhone to become unresponsive or even not turn on. The good news is that you can fix most of these problems without having to take your phone to a repair center.
After testing all the photo filters on your iPhone, you will eventually come up with your favorites. These are the best filters to use on your photos.
To limit unwanted application downloads on Android, you should set a password to download applications on Android.
TWRP allows users to save, install, backup and restore firmware on their devices without worrying about affecting the state of the device when rooting, flashing or installing new firmware on Android devices.
On Android phones, there is an option to adjust the screen lock mode when the user is inactive. So how to keep the screen always on?
In Apple's new product launch events, including iPhone, iOS, macOS... the time stamp is always 9:41.
On the Google Play Store, there are many alternative applications to the default Android gallery. They provide more interesting features than the default gallery such as connecting to Dropbox or Google Photos accounts, etc. Depending on your needs and desires, you can choose the following applications.
iOS 18 added a new feature that simplifies this process and lets you access recent notes with just a few taps.
The Google voice assistant feature on the phone helps users a lot in their daily life and work. However, this can affect the privacy of users.
Instead of manually calculating the time difference between cities, you can use your iPhone to view multiple time zones.
Clean Up is a tool in the Photos app in iOS 18 that lets you remove unwanted objects from photos. However, it sometimes has the strange behavior of blurring faces instead of removing them.
The new iPhone update adds a widget that displays nighttime health information in the Health app. When you add the widget to your iPhone home screen, all health indicators are recorded when you use Apple Watch.
Do you often feel annoyed when every time you turn on 3G on your Android Smartphone, applications compete to notify Update while the budget for mobile data network is limited?
As soon as the Passwords app detects an account with a weak, vulnerable, or leaked password, it will notify you of the status of that password.
Are you having a flickering issue with your iPhone camera? There are many factors that can cause this issue, so don't assume it's a hardware issue and take it to the Apple Store right away.
