If it's scanned, you're stuck -- it's a bitmap image. I doubt you want to take the time to mask around each character to remove the flaws.... and keying it, then applying the matte choker is a crap shoot at best. You might want to think about incorporating the look of the scanned image into your design.
You can run OCR on the PDF and then edit to remove the images. Requires Acrobat Pro.