4.2
4.25581 star

Total 43 Positive Reviews

Private LLM - Local AI Chatbot App User Positive Comments 2024

Private LLM - Local AI Chatbot app received 43 positive comments and reviews by users. Can you share your positive thoughts about private llm - local ai chatbot?

Please wait! Private LLM - Local AI Chatbot Facebook comments loading...



Private LLM - Local AI Chatbot for Positive User Reviews

Great so farSeems to do most of what I want. I think there just needs to be two main features added, and one of them should be super easy: 1. Allow increasing font size. Right now the font is pretty small on my computer, and the view menu doesn't have an option to increase font size 2. Support LaTeX. I do a lot of math work these days, and I don't want to see math written without LaTeX. ChatGPT has this feature, which has been super helpful for me when studying.Version: 1.5

Helpful but not an end-all problem solverGives solid basic advice. Can handle smaller projects and concerns. Not 100% there. Not 100% stable. Can tell some creepy stories that are unsolicited. Definitely needs a safety team..Version: 1.1.4

I like it a lotAs in it meets , maybe exceeds, my privacy expectations, works on all my ios devices WHEN OFF LINE. Emphasis mine, country internet is unreliable. ;-( Developer seems commited, saw this with the guy from the Applo app, hoping for good things, 10 bucks aint bad for what I see so far.Version: 1.0.2

Great appThis app is pretty great for when you don’t have internet, but want access to ChatGPT. It’s not as powerful as the online version, but the fact that this is a one-time price of $10 is awesome! The only issue I’ve encountered with it so far is that it reloads every time you leave the app even for a moment. I’d love to see a History feature to see previous conversations and maybe Shortcut support, but it’s overall a really great app!.Version: 1.1.3

Great app! More features pls! :)This app is awesome for offline use! I would like to be able to download other models from hugging face though. Please make this a feature!.Version: 1.6.5

Has potentialThe app seems more stable than the others I’ve tried. It would be good to see the ability to browse and add models from huggingface and to have RAG available document querying..Version: 1.7.2

Great app.Would love to be able to download different models. If not from an in app catalogue, perhaps putting in a url from hugging face? Otherwise pretty neat..Version: 1.6.1

Works well would be nice to integrate with iOS shortcutsIt works well and quick. Would be nice if it integrated into iOS shortcuts..Version: 1.0.3

Gemma 2B just made this a killer app.With the recent addition of Gemma 2B which is based of Google Gemni this has just become a killer app for me this has been the best LLM model that provides the best answer I hope to see 7B support in the future and I hope this comes Gemma comes to iPhone and iPad soon. Not only is ther the best performing model but it's all done on device which make this even better. Thank you!.Version: 1.7.7

FantasticHard to believe this kind of power is available locally. Can’t wait to see how this tech develops. Would love to be able to upload documents or large text files..Version: 1.5.1

Great tool. Looking forward to future features.What as easy way to work with LLMs. You can download multiple different models and you can share the application with your family. That's a deal that is hard to beat..Version: 1.6

FantasticI run LLMs on Colab and other cloud providers. Private LLM let's me have fun running decent smaller models on my Mac and on my iPad Pro, Recommended!.Version: 1.6

Getting there!UPDATE: app is much faster now. Still waiting on a prompt library which would be awesome, but the speed and quality is increasing seemingly by the day. There was a small period of time where it didn’t work on the 13 mini but that has been fixed. I’m happy with the amount of work the devs are putting in and I’m hopeful for more features in the future. MLC chat is comparable in speed and quality but this app is looking to widen the gap by adding more features in the (hopefully near) future. Old review: In comparison to MLC chat (free and open source) this app is lacking. MLC chat offers the ability to install additional models, and the default is on par or better than this apps responses (like gpt 3 level, lots of incorrect information and it kinda goes wild when explaining things). Additionally, performance is abysmal comparatively for better quality responses on MLC chat. It’s a great idea but lacks the ability to fine tune. Being able to change the temperature and other settings for the model would be great. Would also be cool if we could create a starting prompt (or a library to choose from) for the AI so it can be used for things like role playing or DND. Kinda bummed that it’s $5 since I was expecting a lot more than MLC AIs app for the pricing. Instead I’ll be uninstalling and checking back later for new features and possible performance increases. If you’re reading this and thinking about buying it, you should probably check out MLC chat for now and just wait for more features and performance updates..Version: 1.1.1

Love Being able to run a powerfull LLM locallyI cannot believe it is as easy as a few clicks to install an LLM like ChatGPT and it is running entirely on my Mac! No internet required, no monthly fee for a plus version. awesome!.Version: 1.5

Too much good stuff to sayPrivateLLM rocks! First off the devs are cool and responsive but the best part is that it has shortcuts support so the sky’s the limit. Feed whatever data you can into it and it’s all offline and private..Version: 1.7.2

Wish there will be a local api compatible to openai, and different chatboxesGreat app.Version: 1.3

Amazing!I'm astounded that I can run such capable models on my laptop. The developer is very active and constantly improving the app. It makes running local private models extremely easy and as of the latest update has a great range of different models to chose from. I have replaced a decent portion of my Open AI usage with this App.Version: 1.6

GreatFeature suggestion: the ability to edit the REPLIES that the LLM gives. This way you can influence it better..Version: 1.6.2

This is crazy-good, running on my *phone*!Nice for Shortcuts that need to “think” a little!!!.Version: 1.6.2

Cool app that keeps getting updated!I've been using the app since it first came out and it keeps getting better and better. The developers just released a new version that allows you to switch between different models, which is really nice feature!.Version: 1.7.9

Great Support So FarLove the additional models, this is what I was hoping to see when I paid for an app. It's easy enough to find a free client, so this type of support is just what I hope to see continue!.Version: 1.6

Great approachHaving option to load own models will be wonderful. Eg Llama 2 or others..Version: 1.3

Works well but needs some improvementThe 7B model constantly crashes on 14 Pro even though the prompt says that the phone can handle it. Downgrading to the 3B seems to work much better..Version: 1.6.1

Fantastic!A clean and easy-to-use Mac-native implementation of Llama. It's early days, but I'd love to see this on the roadmap: 1. Ability to upload a file 2. Ability to read a folder of files (imagine being able to ask questions about a bunch of documents!) 3. Sharing options, incl. Markdown support.Version: 1.3

So far so good!Okay… THIS APP IS AMAZING. I am using this on my iPhone 12 Pro Max and wow, pretty fast reply. I am still playing around with this app but I am very impressed with it. I wonder if new models from huggingface could be downloaded, if that’s possible..Version: 1.6.2

Please allow LLM choicePlease allow us to pick our LLM the same way we do in text-generation-ui by providing hugging face name. I realize not all models can run on iOS, but I was hoping to mostly use this for CodeLlama..Version: 1.6

Good tryWell, according to the list of viable machines, my iPad Air 3rd generation should be able to run this. It won't run. It launches, struggles for a minute, and crashes. So, I can't really review this. All I can say is that it won't run on my iPad. EDIT: I was able to run this on my MacBook M2 just fine. Looking forward to seeing it run on my iPad. (I have poor old-person eyesight, and I hope the type is slightly larger on the iPad. It doesn't seem to be adjustable on the Mac.).Version: 1.6.7

Good app with a privacy oriented focusThis is a very important app and concept in this day and age. Although as a suggestion in order to improve the AI users should be allowed to "opt in" to submitting data to better refine the model. Thank you for everything you do!.Version: 1.6.4

Better and BetterThe developer is doing a wonderful job at updating the models the app uses, and it’s really noticeable..Version: 1.6.5

A good startThis app is fun, but being able to use other models and configure them would make this app 10 times more useful. I’m hoping the dev adds support for model selection (mistral, pls) and setting the role of the AI..Version: 1.6.2

A great packageWorth the $10. Obviously not as useful as Bard/GPT but it undeniably meets all expectations, and I have yet to see anything comparable. With outstanding email support, a Discord support server, and devs that continually work to improve the app for all platforms- this is a must buy for anyone interested..Version: 1.5

Great little local run chat botThis is a good little chat bot to play around with when you don’t have internet access. I only have an iPhone 12, so it won’t run the bigger model, but it’s still enjoyable. For a feature request, it’d be nice to have the ability to customize the system prompt..Version: 1.6.6

App is actually not so bad but could be improvedI’m currently using the 3b model on a iPhone 12 and it’s pretty rough. It’d be great to see it worked on some more even if the 7b model is the priority..Version: 1.6.5

So much potentialI've been using this app for a couple of months at this point. When it was first released, it was a neat proof of concept, but it only supported 7B models and was overall just too simple to use effectively. With a recent update, a 13B model was released for all macs with 16GB of memory, and it makes such a huge difference! It's not quite at the same level as ChatGPT 3.5T, but it's close enough that I never use 3.5T anymore; this is my go-to. I greatly appreciate the on-device processing (hallelujah privacy!), and it doesn't even use too much power - my battery still lasts for hours and hours. The performance is also great; my base M1 Air powers right through the prompts. I only have two complaints about the app at this point. 1) The 13B model uses about 12GB of memory by itself, which does force the use of swap on a 16GB Air. Not much the dev can do about this, but it is something to keep in mind. You'll want to close out of other programs before launching this. 2) There still is no feature that has separate conversations. If you want to start a new conversation, you need to delete the existing conversation. I'd love it if we could get separate conversations in a future update; it would make this app so much easier to use. Overall, I love it and do not regret buying it at all. I can't wait to see what future updates bring :).Version: 1.4.1

Privacy focusedAfter I saw the only review here on the App Store that’s nothing but gibberish, I had to write my own. I love that this app works offline and everything you put into it is private and kept on your device. Plus, there’s no money hungry subscription service. From what I’ve seen on reddit, the developer is working hard on improving the app and I’m looking forward to seeing what’s implemented in the coming updates. So far it’s been great for every day questions and information..Version: 1.6.7

Greatly appreciated efforts by devWhen I first tried this app, it was a letdown - just one slow option and I wasn't impressed. But man, was I wrong! The developer has put in some serious hard work, pulling off a 'No Man’s Sky' style transformation. Now, it's packed with well performing models for whichever device you have presently, and honestly it’s become my go-to. Also, I will always appreciate and recommend this app based on its privacy oriented USP alone - because finding apps that care about privacy (especially in a field so ripe for exploit) feels like panning for gold in a septic tank. I’ve gone from regretting my purchase to relying on it daily. It’s versatile, reliable, and an absolute game-changer for anyone looking to work with LLMs privately. I've got to give a huge shoutout to the developers for their commitment to turning things around. Your hard work hasn’t gone unnoticed, and I'm sincerely grateful for it. Wishing you all the success in the future - you’ve got a fan in me! Had to update my review to give the devs a huge thumbs up for such an impressive turnaround!.Version: 1.7.2

3B model is great!Nice at coding too.Version: 1.6.2

Easy to use and truly private and offline.Unlike almost every other offering on the App Store, Personal GPT was designed to provide a local, private GPT for you to use offline with no data being sent to third parties. It includes a limited LLM that works reasonably, given its size. The developer is clearly very passionate about this project and they are constantly updating and refining it. The more memory you have on your device the better this app performs..Version: 1.0.2

A great tool, with huge potential.Obviously being an offline GPT limits the responses, but the fundamentals for something impressive in future less memory restricted devices eg iPhone 15 and beyond is really exciting. Offline and privacy focused are essential qualities of this app and it works quite well. A good bargain for the price with an active developer. One recommendation/piece of feedback would be to provide information on what the settings TOP-P and temperature do. If we come across an error or weird, reproducible response could you provide an option to email you a log so we can forward you the issue easily? This way you don’t need to embed any privacy violating analytics packages..Version: 1.1.2

Reasonable ExpectationsThe developer has given easy access to a usable information source, disconnected from the tentacles of big tech. This is to be applauded. But expectations are important here. You can't compare a solo effort with that of an organization with billion-dollar funding. Just contextualize this with pre-ChatGPT tech and you may find this a tool to have (in situations where yes.. you are disconnected from the internet or you don't want big tech operators to hoover your brain for free). Docs on if or how to do do supervised instruction of the model would be welcome or how to tweak this. Read the vendor warnings. These are known industry limitations of this type of offering..Version: 1.0.2

Missing features.We need the ability to set the system message, considering the price we should be able to load our own models. —— Changed to 5 star for now, if the dev delivers on what they said this app should be great!.Version: 1.6.7

Could be 5-starThis app is superb, in terms of its immediate usefulness. It would be above and beyond if there were a history or separate chat type feature as all of the other apps have..Version: 1.6.7

Simply Incredible!I cannot believe that I can run a model similar to GPT 3.5 on my iPhone 12 mini! It is a bit slow, but really impressive. The purchase allowed me to install on my MacBook Pro M1 Max 32GB and it is faster than GPT 4. Really excited to see how this app continues to develop and the models get better..Version: 1.6.2


😕 Private LLM - Local AI Chatbot Negative Reviews
Applications with positive comments similar to Private LLM - Local AI Chatbot
Kheiman positive reviews, comments
Kheiman Positive ReviewsKarl KlusmannHealth & Fitness2024-04-12
勤音妙响 positive reviews, comments
勤音妙响 Positive ReviewshaiqinUtilities2024-04-12
AI Keyboard & Themes positive reviews, comments
AI Keyboard & Themes Positive ReviewsMoMo Play LIMITEDUtilities2024-04-11
xFarm Indoor positive reviews, comments
xFarm Indoor Positive ReviewsxFarm Technologies Italia srlUtilities2024-04-12