Phone to Outlook/MPE exclusion

[FFandPM]

When I sync my contacts, every email contact I have sent to is imported into MPE and Outlook. How do I exclude these contacts? I want only contacts I add (with phone numbers etc). I did check the box in the settings that says it should only import contacts with at least 1 phone number, but it still tries to do otherwise.