An Investigation into Rating Scales and Error Control of the Oral Test of China Public English Test System(PETS)

论文摘要

The present study attempts to investigate the validity and reliability of the oral component of the PETS, so as to find out the possible causes of variables that may affect the process of scoring. For these purposes, research questions were designed to explore four related aspects: rating scales, raters, rater training, and the unitary validity of the oral test. To enhance the validity of the study, a multi-method research approach has been adopted, using four different instruments, questionnaire, group interview, tape transcription, and verbal report. Data were collected and analyzed through both qualitative and quantitative methods. And the results obtained from all approaches were synthesized to provide responses to the research questions. The results show that more efforts are still needed in aspects of analytic rating scales of PETS oral test, rater training and also the materials used in the oral test. Finally, the study also made suggestions regarding the reform of the oral component of the PETS.

论文目录

• Acknowledgements
• Abstract
• Chapter I Introduction
• 1.1 Background of the Study
• 1.2 PETS and its Oral Component
• 1.3 Significance of the Study
• 1.4 Organization of the Thesis
• Chapter II Literature Review
• 2.1 Conceptualizing Communicative Language Testing
• 2.2 Testing Oral Language from a Communicative Approach: a Historical Perspective
• 2.2.1 Speaking Tests and the Underlying Problems
• 2.2.2 Studies on Oral Proficiency and Oral Tests
• 2.2.3 Examples of Mass-scale Oral Tests
• 2.3 Variables which may Affect the Oral Tests: a Critical Review
• 2.3.1 Test Types and Formats
• 2.3.2 Tasks
• 2.3.3 Rating Scales
• 2.3.4 Rater Characteristics
• 2.4 Rater Training
• Chapter III A Study of the Oral Test of China Public English Test System （PETS）
• 3.1 Research Questions
• 3.2 Research Design
• 3.3 Instruments
• 3.3.1 Questionnaire
• 3.3.2 Group Interview
• 3.3.3 Testees' Performance Data
• 3.3.4 Verbal Report
• 3.4 Summary
• Chapter IV Results and Discussion
• 4.1 Rating Scales
• 4.2 Raters and Rating Process
• 4.3 Rater Training
• 4.4 The Validity of the Oral Test
• Chapter V Conclusion and Implications
• Bibliography
• Appendix A
• Appendix B
• Appendix C
• Appendix D