A very good hardware site I found was ComputerGeeks.com they have very good prices and a lot of old parts. I need to tell you a quick story so you can understand the point. Ok, a friend of mine got this old computer, two days later she got drunk, tripped over the monitor cord, and ripped out the AGP slot. After that my Fiancé tells me that her computer doesn't work and she wants me to fix it. So I tried. It turns out that the operating system wasn't installed. But the computer was also really old, so when I started working on it the motherboard fried.
So now I'm working on the one that my friend broke and I need a video card. But the motherboard is so old that it doesn't have an AGP slot so I can't hook up another video card. The original video card was onboard. But on ComputerGeeks.com I found a new video card that plugs into a regular PCI slot for $17.99! And that's why I liked that site.
Frys.com this is another good site. They are a little pricey but they will have anything you want and or need for your electronics. Not just computers. I look on this site before any others when I need parts.
Where not to go: any online bidding site. You can't trust people's hardware to work right and they never list any right information about what systems the part(s) are compatible with. If you can't get it from a business or for free you might as well wait for one to drop into your lap. But both of these sites are great for all your projects and I hope you'll go have a look for yourself.