At the end of the day, farmland is going to earn a similar basic return to whatever other capital asset, and while farming labour isn't unskilled the amount of people raised in it means it earns like it is.
Nobody who says this is picturing manhandling half-dead battery chickens, and it's usually someone white who isn't going to move to the mountains of Ethiopia to farm subsistence crops and cocoa. That pretty much leaves something land-intensive.
I did talk to someone on Lemmy who made it work with ranching, but ranching is definitely not a good earner right now, and a lot of people are leaving the industry. Modern crop farming seems a lot like a desk job on wheels. Mainly, I think people just want space and fresh air, and have no idea what rural life is actually like.