Is Williamsburg,VA really fun for kids?

I have 2 kids, 6 and almost 4. We are trying to figure out where to go this summer for 4-5 nights. I was thinking about Williamsburg. I know there is a Busch Gardens, water park, and the whole Colonial thing, which I think my kids might be too young to appreciate. My friend tells me my kids will be bored there. He's been there, I haven't. Any input from people who've been there w/small kids?