Cooooool!
Well, there's
Soul Veg. Basically, it's all vegan soul food. Mac and cheese, burgers, soup, greens. Their salad dressing is amazing. SV is maybe 5 miles from the Aquarium?
Dough Bakery is an all vegan bakery. Their breakfast biscuits and actual bakery items are better than the sandwiches, but most everything I've had from there is really nice.
Sevananda is the local co-op. They have a hot bar that is usually pretty dang good. 95% of the time it's all vegan. It's in Little Five Points.
Village Pizza has vegan options by the slice. Soy cheese, fake meats, lots of veggies. The slices are pretty huge too. Parking on Carroll St. is pretty terrible though.
Mediterranean Grill is one of my favorite restaurants in Atlanta. Great falafel and hummus wraps. There's one fairly close to where you'll be.