He pretty much did. Unless you are willing and able fork over alot of money for a basic glassware set and decent lab setup, then you're pretty much screwed. The materials don't come in traditional chemestry sets per se, only glassware sets and various standalone apparati. Reactions also often require larger volumes of solvent and reactant than are practical to include in a set. Often organic reagents are controlled substances, due to their use and abuse in the creation of drugs and explosives, or are just plain dangerous to have around. Companies will often refuse to sell to civilians, and law enforcement are often overzealous when they find out about home labs.
If you are very interested in hobby chemistry for personal or educational purposes, talking to any chemestry teacher may open more avenues of persuit for you. Their easier access to a wider variety of chemicals and equipment will make it easier to do everything, plus their knowledge, experience and training can help guide you to a fun, interesting, and productive endeavour. Often times they are very eager to have someone who is genuinely interested in the subject matter, and will go out of their way to help. Perhaps there are others interested, enough to start an after school club (and maybe get the district to fund your hobby).
That being said, sciencekit.com sells a decent Pyrex micro kit for a little less than 500.00. (local business plug, shop around) Scaling up will cost more.
http://sciencekit.com/pyrex-reg-micro-organic-chemistry-kit-deluxe-version/p/IG0024828/You can buy a pre made fume hood, or make one yourself. (350.00)
www.lcmlab.com/Small_Molded_Benchtop_Fume_Hood_p/244-0001w.htm beakers, flasks, burners, hotplates (45.00, 55.00, 25.00, 225.00)
http://sciencekit.com/griffin-low-form-pyrex-beakers/p/IG0027881/ http://sciencekit.com/boiling-flasks-flat-bottom-mdash-pyrex/p/IG0026034/ http://sciencekit.com/adjustable-bunsen-burners/p/IG0025780/ http://sciencekit.com/the-student-hotplate-stirrer/p/IG0051484/ As for chemicals, they will have to be procured online through various companies, and good luck with that. Remember grocery, automotive, and hardware stores can be your friend, but anything you get there is usually not pure and will have to be purified.
Good luck, and have fun!