Webb Marstellar-Fabrics, Wallcoverings (amazing selection with good prices), Furniture etc. I have been shopping here for the past 6 years and they never disappoint. It is on the high-end side, but stop in for that WOW piece for your house.
Bungalow-Everyone who knows this store, just loves it. If I were to choose a shop in which I would want to live forever---it would be Bungalow.
B Braithwaite-This is a great children's/baby store. They are located right next to Bacchanalia (another fav. spot for eating) and have fabulous cribs, bedding, clothes, toys, books etc. You can also find some high-end baby gear here. I love to just walk around in this store--although I always end up with something for Baby G.
Lewis and Sheron-Looking for a fabric to recover that ugly sofa sitting in your basement that your husband just won't let you part with? L&S has been in the fabric biz. forever! There are 2 floors of fabrics, 1 furniture area, trims galore....love this place. Plus, the same people have been working there for seriously 10+ years and always are willing to help.
A couple others to check out local to ATL:
Paris on Ponce
Horchow is a company that carries just about everything. They have fabulous art/furniture/accessories etc. Horchow carries a lot of my favorite designer pieces as well.
Junk2Funk is a duo of the ultra funky (lovely friends of mine) Shana & John. They hit up antique shops, estate sales and thrift shops to find super cool finds---then they re-create their treasures into usable furniture, art and accessories. If you are looking for something eclectic and (like me) don't really love hitting up the junkstores to look through it all, check out their site on etsy.
Serena and Lily is pretty well known for their ultra-chic (and pricey) baby bedding; however, I love their whole furniture line/paint/bedding/accessories etc. The two super-cool women that own Serena and Lily have fantastic taste. Definitely check out their site.
Room and Board What I especially love about Room and Board is that they have the "rights" to sell a lot of mid-century modern pieces. They carry some of the big names like Knoll, Herman Miller, Eames. Most designers know that oftentimes you have to go through a dealer to purchase from these companies. Need it fast and don't feel like going through a designer (unless you want to call me of course:-), go to Room and Board.
Neiman Marcus Who knew that this big name clothing store would have great pieces for your house. They do, check 'em out.
Enjoy just a few of my favorite shopping spots!