“Dirt” is such a crazy word. It can mean almost anything.

In your case, it means stuff that doesn’t have very much organic content. So:

First of all, soil (or even your dirt) hates to be naked. I don’t know if you’re northern hemisphere, but it’s time for fall cover crop here. I’ll tell you what we do, if you’re down under you need spring crops instead. We will plant wheat, Rye, cowpea, buckwheat, all that stuff. You’re just wanting to cover the soil up for the winter. You don’t want a crop. All this will be chopped off, and you’ll dress soil amendments right over the roots in the spring.

Add some daikon radish, sometimes it’s called tillage or tilling radish. They get VERY large and break soil. Probably as tall as your raised bed. When you think it’s done growing, chop the top off with a knife and let it rot. Worms love to eat radish.

Now you’re building soil!

Next, you need even more organic matter than a couple radishes and some rye straw will give you. Find someone near you with rabbits, and try to buy some 5 gallon buckets of poop, and/or offer to help clean their rabbitry. Very few weed seeds in rabbit poop, and you can plant right in it. It’s not chemically “hot” like many other manures, it won’t hurt the crops even if it’s very fresh. Just lay it on top, and worms will come up through your bad dirt to get to food; then they drag their own poop back down through the dirt and create soil.

Lastly, don’t put any chemical fertilizer, no pesticide, and most importantly no fungicide on those beds for a year at least. If you get straw bedding from a farm, make sure they haven’t treated their animals for parasites or worms. (They usually use ivermectin and it kills earthworms) You may find that when you get healthy soil, you don’t need these things anyway. It will take some time!

Short version: You need to build the organic matter up, you need to get the worms and the beneficial bacteria and fungus to arrive.

Looks good!! Doesn’t take long.. I think it will make a really nice garden next year!