Have you considered using Picasa Facial Recognition?
Picasa contains a facial recognition feature similar to Picasa Web Albums, but it will catalog the collection of photos on your hard drive.
Perhaps it being hit or miss sometimes, you may be able to find that doppelganger you're searching for.