Congratulations on being accepted, I'm still anxiously waiting to hear back from any of my schools. As I haven't received an acceptance letter, I can't answer your question. However, virtually all US math programs fund all their PhD students (except those who do not wish to be considered for funding). I'm certain that you are not the exception, especially considering how quickly they got back to you.
By the way, which school did you get accepted to?