Yes you can do that of course, i do it, if your infrastructure is somewhat scalable (it should be for various reasons). But in general there is more to it. One important thing is that it should be a side project. Not your main project, unless there is prospect to it. When i said infrastructure i meant it. Also the right tools. You can't go far with a shovel only for example. So, if you can invest to it as a side project in a way that doesn't consume much time and effort for you, then you are ok. But you have to invest if you like it. And if you like it , you will make , how is that word in English, depreciation?
Discussion
So let's take an example. You are coding and let's say this is your main thing. If you buy a small tractor, i have one also, you can do much work with less effort in less time and you could sell some product also. I use the the tractor also to carry the wood i cut for heating and cooking. That way you can achieve depretiation quickly.
By the way, since you said about olive oil, most of the oil producers in Greece, they do it as a side project. They have other jobs...
Same with Bavarian farmers. They or their wives tend to have day jobs.