Hi boober, no one has answered you yet but I assume you haven't gone - the camping parks don't open until the weekend after next and it's been quite chilly. Have you ever been to Nova Scotia? Just about everywhere here is nice, really.
if you want to set up camp in one spot, Kejimkujik National Park is re wally nice. You can camp in the drive/bike-in spots that have water and bathrooms with flush toilets, or you can hike or canoe into one of the remote sites. The drive-in camping spots are fine and there is a lot to do: hiking, canoeing/kayaking (rentals in the park), swimming. You could also take day trips from there to Annapolis Royal and the Annapolis Valley, which have a lot to see and do.
If you want to drive further you should go to the Cabot Trail in Cape Breton, which is also a national park. Absolutely gorgeous trails and views with good camping and hiking, and swimming if you don't mind the cold.
We have a lot of provincial parks that are nice too, but most are quite simple and small. Many are on the water though, so there is swimming and if you bring your own kayak/canoe you can go boating. http://parks.gov.ns.ca/misc/parks_by_region.asp
The only warning I have is that some of them are swarming with bugs in the summer. Dollar Lake near me is nicknamed "buggy lake". Probably not any different from where you live but just a warning. All of them have potable water and outhouses, some (or maybe all now) have flush toilets and showers.
This is a great book, we have been on a number of trails I would never have known about otherwise: http://www.amazon.ca/Hiking-Trails-Scot ... 0864922914
i was also trying to find the Waterfalls of Nova Scotia book and came across this: http://nswaterfalls.blogspot.ca/
Have you thought any more about where you hope to go?