It has an AGP 8x slot so yes it would. The weird thing about that system is that it has a 3200+ in it yet it uses PC2700 DDR, therefore it runs the RAM asynchronously, reducing performance. It also says it has an onboard Intel network chip oO. It is for a low price though and nonetheless should perform well.
Edit: Thought I should throw in that I saw that model at Best Buy a few months ago, I almost had my mom get it instead but I figured she wouldn't need the hard drive space, DVD burner, or the powerful (for onboard ) graphics chip.
I checked out my mom's model on their site and it says that it also has PC2700 in it, yet when I checked CPU-Z, it said it had a stick of Samsung PC3200. Even if it does have PC3200 in it, you probably wouldn't be able to change the speed it runs at since it's an OEM computer. Good choice for the video card though, eVGA seems like a pretty good brand and I like the cooler on it.