Stanford downloaded Facebook's LLAMA from torrents, started w/ human written instructions dataset, then pimped it by generating shit ton more by OpenAI API & trained own LLM on "cents"
Funny, AI development wants to be open source.
Paper: https://crfm.stanford.edu/2023/03/13/alpaca.html
For non-amateur take, see Eliezer's tweet quoted below.
"I don't think people realize what a big deal it is that Stanford retrained a LLaMA model, into an instruction-following form, by **cheaply** fine-tuning it on inputs and outputs **from text-davinci-003**.
It means: If you allow any sufficiently wide-ranging access to your AI model, even by paid API, you're giving away your business crown jewels to competitors that can then nearly-clone your model without all the hard work you did to build up your own fine-tuning dataset. If you successfully enforce a restriction against commercializing an imitation trained on your I/O - a legal prospect that's never been tested, at this point - that means the competing checkpoints go up on bittorrent.
I'm not sure I can convey how much this is a brand new idiom of AI as a technology. Let's put it this way:
If you put a lot of work into tweaking the mask of the shoggoth, but then expose your masked shoggoth's API - or possibly just let anyone build up a big-enough database of Qs and As from your shoggoth - then anybody who's brute-forced a *core* *unmasked* shoggoth can gesture to *your* shoggoth and say to *their* shoggoth "look like that one", and poof you no longer have a competitive moat.
It's like the thing where if you let an unscrupulous potential competitor get a glimpse of your factory floor, they'll suddenly start producing a similar good - except that they just need a glimpse of the *inputs and outputs* of your factory. Because the kind of good you're producing is a kind of pseudointelligent gloop that gets sculpted; and it costs money and a simple process to produce the gloop, and separately more money and a complicated process to sculpt the gloop; but the raw gloop has enough pseudointelligence that it can stare at other gloop and imitate it.
In other words: The AI companies that make profits will be ones that either have a competitive moat not based on the capabilities of their model, OR those which don't expose the underlying inputs and outputs of their model to customers, OR can successfully sue any competitor that engages in shoggoth mask cloning."
Yesterday MOVE index (VIX for bonds) made peak above both: 20' March & Gilt drama in 22' October
Coupled w/ yield moves I view this as changing hands, not necessarily liquidity issues. IMO cuts pricing is getting ahead of itself yet again
CPI stable +0.4MoM, Core accelerating...
GPT-4 is here and Google, month+ after announcement, still in garage, punching the last right biases from #Bard.
Google was smart to train image recognition with captchas. It missed LLM training w/ human feedback big time.
Waiting for dev stream, 1st impression: better ChatGPT
Reading "Meta is building a decentralized, text-based social network":
"The app is codenamed P92 and will allow users to log in through their existing Instagram credentials, the outlet reported"
Zuck, just traversing through buzzwords to see which one makes the stock go up. $FB
Peter Zeihan on Russian #gold changed by worldview a bit.
-Russia probably #1 producer
-Can't tell real reserves (aside from FX by c bank)
-Flying gold to pay for goods (dense; avoids SWIFT)
If your enemy has the printer on hardest conventional currency for centuries...
Crypto + compliant in one post - everything you need to know about this dude.
I'm certain their quality is great. Been a shareholder myself for at least 3 yrs (exited 2022 after H1 earnings call), but great product unfortunately does nkt always translate into good stock. Will see if they can rekindle growth. As of now company is too expensive imo.
Madara Cosmetics trades at 21.5 EV/EBITDA. Closed 22':
revenue down (-3.5%)
profits down bigly (-60.5% operating)
Either buyers are not doing math or stock is running on hopes of return to growth & "competition" suddenly disappears.
Healthy balance sheet though. 0 debt, 6M cash
Haven't shared this before. Seems more useful now, to understand the elite, government links to Russia.
#Tbilisi #Georgia
Wonderful people, aspiring for freedom. Eventually some dumass comes and says "US overthrowing gov, expanding into Russian sphere"
It's the first time I see ML Chat interface that orchestrates data + external integrations. These are the applications of the future. Great job @Hubspot
#ChatGPT
Never owned, or even valued $TSLA, but just observed I have been watching all their investor events for quite some time. Super clear communication, obvious progress and everything is driven by a simple mission.
Admirable really.
Uganda's roots: Geoffrey Oryema - Makambo (1990).
#GLMusicDiscovery
In 77' after murder of his father, Erinayo Wilson Oryema, cabinet minister in government of Idi Amin, he began his life in exile. At age of 24 smuggled out of country in the trunk of a car.
If the vision is the same (open, permisionless, censorship resistant, user in control, etc), I believe multiple projects can arrive at the same place and be easily interoperable (think different LN implementations and common standarts)
Cut off might be a change in time, when two countries agree on borders and then suddenly one changes their mind.
Started "Morning Oldies" playlist last year. Has Boney M, ABBA. Here's Dire Straits.
But sometimes you wake up with a particular tune in mind, you know...
Shameless plug: each second weekend I explore different genres, geographies in #GLMusicDiscovery
"Back" is missing. To take land back.