- 0 Posts
- 5 Comments
91·11 months agoThe ai box is 700$ ? Who’s gonna buy it? Anyway, If you anyone want to run local llm on their own phone then try 4bit quantized phi-3.
Easy. Don’t run the python files directly but create a a launcher script that use md5 hash to check if the python file you wanna run changed and then apply the patch before actually running the patched python file. This avoid ever running the unpatched version.
I couldn’t believe the spec of
that pile of garbagethe phone when i first saw it. The worst being that It has a Mali-400 MP2 (2 cores, the most famous and used varient is MP4 with 4 cores), a GPU from 2008. I know it’s supposed to run linux but they choose the cheapest SOC they could find and then asked the seller if he had any unsold SOCs from the last decade they could use instead.The saddest part is that when I pointed this, I was always told that it’s made for tinkerers and not users, but this doesn’t excuse the use of extremely outdated hardware. I didn’t expect the latest powerhouse but even 30$ Chinese tvboxes had the latest rockchip SOCs…
My PC with 4GB of RAM and an HDD is barely holding with linux mint. Tbf Mint isn’t the problem, it only takes 32% of ram compared to the 60+% of a debloated windows 10. It’s the other apps. Running a browser along anything else and Linux mint starts to struggle, even the built-in apps like the file manager and the text editor feel like they’re gonna crash the computer at any moment because of the random freezing/ delays.
My advice would be to try upgrading to 4GB and installing an SSD. Your old computer will likely only support SATA SSDs, which have a max speed of 500MB/s, but it’s far better than the 30MB/s at best that the HDD disks give.