damus users: do you see my name as a bunch of letters or as "someone"?
Building a new LLM based on only Nostr.
I took the Llama 3.1 8B which is the most aligned LLM with humanity. I figured out how to do the conversion from base to instruct. Base is the version where they pretrain with "everything on the internet" with some curation. The instruct version is giving it the ability to answer questions. But during making instruct they add many misinformations either deliberately or unknowingly. So instruct version is somewhat far away from human alignment. I needed to start with base and do my own instruct fine tuning.
After some trials and errors I managed to convert base version to instruct using unsloth and some coding datasets. So I will use this llama 3.1 8B instruct fine tuned by me and add Nostr notes to it. Not going to add other wisdom from my other curations and projects like Ostrich 70B. This is going to be Nostr only.
Ostrich 70B was downloaded by 150k people! It was very succesful and it was really beautiful and had so much wisdom.. It included Nostr notes and my other curations.
Among nostriches, I won't be able to include everybody, since Nostr is very open and since there are so many spam and so many not wisdomy stuff. My main criteria is web of trust but also I will utilize things like LLM pre processing to classify whether a not is an "encyclopedia material" or like news material or high time preference info like politics.
The instruct fine tuning seems complete and I will start training with nostr notes. Who do you think has the most wisdom on Nostr? Tag and I may give them more "weights" in the LLM (pun intended).
Lmk if you want the unsloth code.
Lmk if you don't want your notes to be used in this project.
The resulting LLM is going to be an amazing collection of wisdom. Thanks for participating!
even though we go thru many things, we have the ability to choose what we focus on from our past. this choice also helps what will continue to happen to us in the future. by choosing something from past and not caring about others, we flow towards that potential universe that mimics our focus. then we start to forget about things that we dont focus from the past. this not only results in choosing the future, it also means choosing the past. we are so powerful and everything is in our hands (or minds).
some may say it is hard to forget some things. but you can still change how you feel about it. and thats more important than the atoms that made that story. by changing how you perceive that event you are making the past event beneficial for you. forgiving the past and being content and grateful for now opens many doors.
being grateful now, makes you be grateful for everything that happened in the past effectively removing every bad feeling from the past because if those didnt exactly happen you could end up in a state where you could be not grateful now. by being grateful now you see the past differently. this transformation allows you to see the future differently. your state of mind now is the "regenerative mind" choosing the best from the quantum.
the problem is many people put too much trust in teachers because teachers convey the facts most of the time. but those facts are trivial and dont mean much but the lies may matter more.
An AI that does well in math, reasoning, science and other benchmarks may not do well in wisdom domain.
There are not many AIs that are focusing on wisdom it seems. It is going to be a problem. Smartness does not equal human alignment.
quackery > science
Should I block AI web crawlers on Oddbean?
On oddbean.com I see a *lot* of web crawling traffic from AI bots like GPTBot hoovering up nostr notes presumably for training purposes. I guess it's probably one of the easiest nostr sites to crawl since everything is rendered as plain HTML and they don't need to execute JS code to query relays.
To avoid wasting bandwidth I decided to use the following method to soft-block them (honour-system robots.txt): https://coryd.dev/posts/2024/go-ahead-and-block-ai-web-crawlers
You could argue they're just wasting my resources and won't bring any visitors or benefit the nostr community in any way. On the other hand, I guess they can/will access this data in some other way, and maybe the world-at-large gets some modicum of benefit from better AI models (?).
Thoughts? #asknostr
nostr is source of wisdom. will change bad opinions of mainstream models. i actually have an article about this called Nostr Changes You. (one of those long form notes.)
takes special skills to be deplatformed from a decntralized one
what do you think of insulin going too low after religious keto or carnivore and kidney being unable to balance electrolytes and ending up with heart palpitations? is that a plausable theory?
how can a scientist believe both entropy tends to increase and this life randomly appeared without Creator, at the same time.
left alone things go meaningless. yet this randomness should create life!
pretty sure. what do you think?
Aliens are demons.
They are mostly after your faith. They try to inject lies like "we brought DNA to Earth (so we are the creators)".
Some fast moving flying objects may be angels or demons.
does giving an LLM stuff from humans that truly care about other humans make it human aligned?
is the human alignment problem mostly "quackery" and not a science?
is it a problem to be solved by pineal and not the brain?
what if elon hurts gov so bad at the end worse governments like china or russia gets more powerful?
what if google has the smartest ai hidden, but only makes it gradually public after open ai takes all the heat and blames and such and advances sota a bit.
is linoleic acid also affecting mitochondria?
there are lots of religious leaders who claim to know God (who is invisible) but none of them see satanic plans (which are visible). All they had to do was to research satan and invert, yet they fail.
- Byte Latent Transformer
- Training Large Language Models to Reason in a Continuous Latent Space
Laws of the universe is based on preferences of prophets. Because the prophets loved fasting, fasting heals. Because they liked fragrances, aromatherapy works. Because they were deep meditators, meditation works marvelously. Beloved ones have the right to "design".
🤱 nostr.mom update
1: Replies are costlier for fresh accounts to reduce ReplyGuy type of spammers.
2: DMs are costlier to reduce spam.
3: NSFW tagged posts are much costlier. However if the user does not include the tag in the note we have no way of detecting the abuse at this point.
By costly I mean it is eating up the rate limit faster. Enjoy.
nah. chickens are the real alchemists
Robots will need a human aligned LLM brain to act properly. Easiest way to align robots with human values is to teach them stuff that is generated by people that cares about humanity.
God offers us a universe as an echo chamber. But we seek a smaller echo chamber like a political party, sports team, bitcoin hodlers, nostriches, brand worshipping, or simply ego worshipping. Transcending every echo chamber allows us to rule the universe: we realize universe is ready to echo what we say.
what are the correct sources of history? gonna add them to my AI
i believe parasites are there to clear. why did the person eat the junk is the main problem
everybody that held it for x years made money. what is x?
universe tries to minimize bad behavior and extend the life of good ones