I think one of the toughest things about using the new AI API’s is breaking large complex projects down into digestible tasks.

GPT models all have various token limits and da-vinci is about 10x cheaper than GPT.

But I feel like I’m beginning to think of certain engineering activities in terms of tokens as a measure of complexity.

I’m breaking big complex things down into smaller chunks and using “high temp” models to make divergent hypothesise and then “colder” more deterministic models to do QA and eventually pull things back together.

What’e exciting for me personally is that my ability to do difficult engineering problems suddenly seems scalable to vastly larger more complex problems.

Managing AI is actually an entirely new skill set, and I think some tech people who can hold a big complex system in their mind, and then understand how to break it down and tackle it using the suit of models available to them… are going to prove to be the big winners here.