Under statistical leing framework, the paper focuses on how to use traditional linguistic findings on anaphora resolution as a guide for mining and organizing contextual features for Chinese co-reference resolution. The main achieve- ments are as follows. (1) In order to simulate syntactic and semantic parallelism factor, we extract bags of word form and POS feature and bag of semes feature from the contexts of the entity mentions and incorporate them into the baseline feature set. (2) Because it is too coarse to use the feature of bags of word form, POS tag and seme to determine the syntactic and semantic parallelism between two entity mentions, we propose a method for contextual feature reconstruction based on semantic similarity computation, in order that the reconstructed contextual features could better approximate the anaphora resolution factor of Syntactic and Semantic Parallelism Preferences. (3) We use an entity-mention-based contextual lea- ture representation instead of isolated word-based contextual feature representation, and expand the size of the contextual windows in addition, in order to approximately simulate the selectional restriction factor for anaphora resolution. The experiments show that the multi-level contextual features are useful for co-reference resolution, and the statistical system incorporated with these features performs well on the standard ACE datasets.