Ram, leave it in or take it out?

My computer came with 2x512mb of 533mhz ram. I just purchased 2x1gb of 667mhz ram. Should I remove the 1 gig in there, or is that not any noticable difference between the speeds? Thanks in advance.