A homestead will provide you with your water (a well), your heat and hot water (firewood from your woodlot), and most of your food (milk cow, pastures, gardens, field corn for feed). Well, to do all of that means you must have a water well, a woodlot, a pasture, and a hayfield—not to mention a wood cook stove (and the previously mentioned wood-fired hot water kettle, otherwise you are just another dependent "Prol" pretending to be homesteading). And a hayfield is of no value unless you have all of the necessary haymaking equipment and a place to store the hay (a barn).
First: A wood cook stove. How are you going to go "off-grid" without a wood cook stove? Propane kind of violates the principle, doesn't it? How are you preppers going to survive a winter when the grid goes down? With a rocket stove? I guess rocket stoves are OK for hermits living alone in a bunker with two tons of baked beans...but for people with a family to provide for the rocket stove thing is just plain silly.
So back to wood cookstoves. I like "Ashland," "Kitchen Queen," and "Pioneer Princess" (and no, I did not receive any compensation for saying that). These stoves will set you back about $2,500, not including stove pipe and "thru-kits" (to pass through walls and roofs) and are all Amish made.
I do not recommend trying to cut corners and buy a used stove (I tried that). Cracks in cast iron simply cannot be repaired. The welds just don't hold—and we are talking about equipment that holds fire and produces smoke (and carbon mon/dioxide). But if you truly know what you are doing, and stay clear of the old cast iron stoves and shop around for an Amish stove, and you can get the parts to rebuild the firebox... you can get the older Ashland stoves (with their much smaller fireboxes—good for cooking in late fall/early spring without making the house too hot. Not big enough to put out enough heat in the cold of winter without risk of damage) for about $1,000.
For a single person or a childless couple, you might be able to get by for domestic water with just the tanks on the wood cookstove with a couple of 5-gallon stock pots and not buy the hot water kettle. I don't know why you would want to do this to yourself... but you might be able to.