Zoning and city boards are one consideration, for certain. Here are some others.
A storefront costs money to have, usually thousands a month. If you're paying someone else to help you run it, that cost is even higher. You have to be able to make that in profit just to break even. Consumer goods is a highly competitive, cutthroat world, and you're competing with Amazon, whose economies of scale allow them to buy very low and keep their overhead per piece also extremely low, and you'll deal with endless whining about "I can buy that online for half this price," when you may hace actually paid more for it than that. In many cases it won't be the same thing they're seeing online, and yours will be better quality, but many people can't see past price, and in many cases it will be the same thing, but it's scAmazon, or someone selling out of their basement. The general economics are heavily against any new retail business surviving, and likely to get worse.
That said, the niche nature of what you're proposing to do has some advantages. You will have a small, but dedicated customer base who will seek you out; you won't have to do a ton of advertising--just what it takes so people can find you. They'll come from far and wide to see and touch products that otherwise they can only imagine from a picture. You won't be in competition with big box stores, as most of what you sell, they don't. If you're in an area with a large population in a moderate driving distance, it could work.
Location location location, of course. You probably don't want that highly visible location on that busy street corner. Not only will it be expensive, but you'll have greater pushback from The Powers, and ironically probably less traffic in the end because people feel like they're outing themselves. A cheap building in a quieter part of town is better, as long as it's not so cheap people fear for their safety.
Speak of outed, in many circles you will be labeled as a weirdo, or worse. There will be social consequences, but they won't all be bad. You'll meet a lot of likeminded people who will become good friends, and you'll probably have a lot of fun, if you can manage to keep the business challenges from driving you bananas.
I'm not saying you should or shouldn't; you have to do what you believe is for the best. I hope I can help that decision be an informed one.
