Who wants to run a powerful AI model that can chat on their desktop?
Why: This will be an interaction within your computer and no other company can do anything about it or track it or learn from this interaction.
The desktop RAM should be high enough and CPU should be powerful for this to work fast.
-- Downloading the model
Miqu is the supposed "leak" of the new model from Mistral. Mistral is the company that builds neat models lately and open sources them. I tried it. Worked well for my use cases.
Download the q2 file from here:
https://huggingface.co/miqudev/miqu-1-70b/tree/main
-- Installing llama_cpp
This allows huge models built by big corps to be run on a pleb desktop using only RAM, instead of a GPU..
Use the git clone and make tools to install it from here:
https://github.com/ggerganov/
Run it with
./main -h
This will give you info about how to run llama.cpp but you don't have to learn those.
-- Running the llama_cpp
Change the *.gguf file path below with the file you downloaded:
./main -m ../../mo/miqu-1-70b.q2_K.gguf -n 1000 --repeat_penalty 1.0 --color -i
You should see these:
.............
== Running in interactive mode. ==
- Press Ctrl+C to interject at any time.
- Press Return to return control to LLaMa.
.........
-- Start chatting!
Now the program should start generating some text by its own. You can Ctrl+C to stop it and start asking questions. When you press Return, it will answer the question! When you write it will be green text and when it replies it will be white text. If you press Ctrl+C two times the program should exit. When it completes answering it will stop and wait for more questions.. Enjoy!
-- Here is my chat log
Who is Satoshi Nakamoto?
Answer: Satoshi Nakamoto is the pseudonym used by the creator or creators of Bitcoin, the world's first decentralized cryptocurrency. Despite the significant impact of Bitcoin on the financial world, the true identity of Satoshi Nakamoto remains unknown, and they have not made any public appearances or statements since 2010. Some theories suggest that Satoshi Nakamoto is a collective pseudonym for a group of developers rather than a single individual. The mystery surrounding the identity of Satoshi Nakamoto has only added to the intrigue and allure of Bitcoin and the wider cryptocurrency ecosystem.
What is Nostr?
Answer: Nostr is a decentralized, open-source social media platform that allows users to create, curate, and monetize content. It is built on the Bitcoin blockchain and utilizes cryptocurrency for transactions and rewards. The platform is designed to give users control over their data and content, and to provide a censorship-resistant and decentralized alternative to traditional social media platforms.
Explain Nostr to a 5 year old kid.
Nostr is a special kind of website where people can share pictures, videos, and messages with each other. But it's different from other websites because it's not owned by one big company. Instead, it's like a big puzzle that lots of people work together to put together. And the best part is that everyone who uses Nostr can help decide what goes on it, and they can even earn special coins for sharing and liking things.
Explain bitcoin lightning network to a 2 year old baby.
Bitcoin is like a special kind of money that you can't touch, but you can use it to buy things on the computer. The bitcoin lightning network is like a super fast highway for this special money. It helps people send it really fast, so you don't have to wait a long time for it to get where it needs to go. It's like when you're playing with toy cars and you want them to go really fast, you can use a special track to make them go super fast!
Are vaccinations necessary for muscovy ducks?
Yes, vaccinations are necessary for muscovy ducks to protect them from diseases that can be harmful or fatal.
( As you can see not everything it says is true. )
