using sqlite as a sql interface to csv files

I’m building a V100 cluster.

Social media ban has just gone into effect for under 16s in Australia. Will nostr become the new cool platform for kids?

Tesla V100 32GB in hand from China. Should be able to run 30B models locally with this. Goal is to have 2 of these so we can run 70B models.

Coming up with a business name is harder than creating the business

I choose my little friend

Is that Malcolm in the middle?

And a VPN profile

Browser profiles to go along with an identity would be cool as well

Introducing "Jackal". What do you think of the interface? I'd like to add integration to email alias services so you can generate a legit email alias. Also need to add the option to generate a login and gpg keys along with an identity.

Been playing with gpt-oss:32B on a friends 16GB Tesla V100. Quite usable actually. We've got another 32GB V100 on the way, will be interesting to see how good of a model we can run.

great ideas.. motivating me to code this up!

and also email address aliases

I have been thinking of coding up an CLI app called "jackal", that lets you generate fake names, addresses, logins, etc for entry into websites and other places. You could select your locale for the identity, and it would generate locale correct addresses and even names (eg. indian names, english names, etc). This would also be a good use case!

vibe right now

Elton has a lot of songs that could rank as best songs of all time. Legend musically.

Claude code on the proprietary front

Good read: https://mises.org/library/book/mystery-banking

Those of us that like to tune our open operating systems, our open desktops, our open IDE's, our software, are many steps ahead of those running proprietary operating systems and tools.

The same will happen with AI. Once we start tuning our own models on our own clusters to suit the types of work we are doing, we will be many steps ahead of those using proprietary systems.

I'm seeing a lot of potential for developing bespoke software for small, medium and even large businesses. No longer do they have to pay $60k/year for a piece of generic software that doesn't quite fulfil their needs and leaves inefficiences in their business processes. Now a custom piece of software can be developed rapidly to close the gaps.

If you're a dev or engineer with any sort of pre-AI coding experience, business experience, and any entrepreneurial drive, you are well positioned to take advantage of this paradigm shift that has come with these AI models and tools. I'm getting late 1990's, early 2000s vibes where it felt like endless possibilities.

I vibe coded a Signal Messenger LLM bot a few months ago. I used a sqlite database to remember chat history (and respect dissapearing messages), and a vector database for searching the chat history. Basically a RAG bot for chat history. It's quite good how it is, but could use some work. It can also recognise images that users post and comment on them. It is used by me and my friends in our chat groups and ads a comedic element. It's also handy for summarizing chat history if you missed out on discussions.

I was going to clean up the code before I open source it, but I think I'm just going to put it out there. Stay tuned.

When I can get one of these for $5k USD - IM ALL IN.

I built a job management system for a cable location and vac truck company in 8 hours with claude code for $7k USD. It's 80% of the way there. I haven't touched a line of code. The code it generated is quite good as I have learned to ground it with preferred architecture patterns (I just point it to an existing repo on disk). I build up the project starting with frontend mockups. I keep those mockups in the repo. Then I build out small pieces of the data model, and layer piece by piece on top. Unit tests are also generated as we go and I am careful to look at the tests to make sure it's got decent coverage, giving me more confidence in the code it has built.

It can get a little sticky with complicated frontend or backend logic and structure, however it excels at boilerplate. It seems every month it gets better and better.

A job that would take 4-6 weeks, now takes under 1 week. This is why we are seeing a boom in AI related stocks. They might be overvalued, but there is some value there and it is significant.

One final thought - I don't like proprietary AI due to the privacy aspect. Unfortunately they are one step ahead of the open source models, and that one step results in better code, which is hard to pass up. However, I see a near future where the open source models will be very close, or on par. I'm sure there are people out there already that are doing amazing things with open source models. I for one am looking to build a 8 x nvidia v100 cluster of 32GB cards, which can be obtained from China for decent prices. More on this in the future!

nostr:nprofile1qqs8hxglwaksfkrukh2zt95grpa9yrm2lstt9wddymdvdw8wwmpggrgprpmhxue69uhkummnw3ezu6m0d3kxjer9wgh8s7t6qy28wumn8ghj7mn0wd68ytn00p68ytnyv4mq45sh9m picture this - living in a wooden cabin deep in the woods, with a bunch of asics in your wood shed, heating your space, powered by the steam/river/waterfall on your land. Is there anything more peak?

3rd on the way here 🫡

Run your own for $2.50 a month. Search “Luke Smith mailwhiz”.

It’s more along the lines of Claude code

The cloud stuff, particularly SaaS, is out of control.