In my excitement to rip out the old cam, I put 2 or three nice nicks in the last bearing by the timing gear. The cam hit the hood and I had to drop the hood and hold it with my head and I pressed the gear of the cam against the bearing and did some damage. I took some super fine wet sandpaper with some oil and took 80% of the nick out. Am I screwed and do I need to replace the bearing or being it is only one will it be o.k. and if I wanted to change just that one could I and is it a pain in the butt 

  I THINK YOUR'E SCREWED...........

Can I just pull that one bearing and change it ?

Yes, you can just change the one brng., but they come in a set, so you'll have the rest left over. Be aware that the bearings are all a different(inside diameter) size, from front to back, with the largest inside diameter one going in the front. The cam journals are tapered from front to back, with the smallest of them in the rear. If you install the smallest I.D. brng in the front hole, the cam will not fit in all the way.
You can very carefully knock the brng out with a small screwdriver. You just want to flip it in the bore, so you can get a grip on it, and pull it out thru the front. Just tap on it a few times in one spot, and it should flip sideways.
You will need a bushing installer to install the new bearing properly. You might be able to borrow one from a trans shop, or machine shop in your area. They may have them for rent at local auto-parts houses, also.

          Like I said before..............