Coca and marijuana plants as just plants are punishable but poppies are fine to grow and only processing can make them illegal. Psilocybin mushrooms growing in your yard are not punishable but grown inside your house they are, the cultivation or picking is where the crime begins AFAIK.

Put in that context you realize that attacking plant growing because you might be able to get high is a thought crime.