On site observation of KPG oral examiners
Implications for oral examiner training and evaluation
Keywords:
testing/assessment, examiner training, examiner evaluation, examiner observationAbstract
The paper focuses on the development and main findings of an observation project carried out by the Research Centre for English Language Teaching Learning and Assessment (RCEL) of the Faculty of English Studies, University of Athens, within the context of the Greek state exams for foreign language proficiency, known as KPG exams. The project, which was launched in November 2005 and is ongoing, involved on site observation of oral examiners as a means of evaluating and monitoring the KPG oral exams for English gathering thus information about, inter alia, the conditions of the oral exam administration, examiner discourse practices, examiner efficiency and conduct.The project involved the design of structured observation schemes used by trained observers during each exam administration (from November 2005 to May 2008). The observation schemes (the categories of which were refined after each exam administration based on the analysis of results) focused mainly on the discourse practices of examiners who assume the role of interlocutor in the KPG oral exams. More specifically, specific observation categories were gradually developed focusing on the changes examiners/interlocutors made to task rubrics and their interventions on candidates’ language output. The observation scheme findings have contributed significantly to the refinement and development of the KPG oral examiner training programme and specifically to three main developments described in this paper: a) a thorough specification of acceptable and unacceptable KPG oral examiner discourse practices, b) the development and introduction of interlocutor frames for every level of the oral exam and c) the development of criteria for the evaluation of oral examiner performance.
Downloads
Published
Issue
Section
License
Author’s Warranty and Publication Agreement
The corresponding Author (hereafter Author) hereby warrants on behalf of all the authors (hereafter author(s)) that the manuscript here submitted to the journal Apples - Journal of Applied Language Studies is original and has not been published or submitted to publication elsewhere in part or in whole. The Author also commits not to send the manuscript for consideration elsewhere while the article is being processed by Apples - Journal of Applied Language Studies. The Author also warrants to have the full authority to submit the article. Apples will not accept a manuscript for which the copyright is held by a third party. The Author also warrants that the article contains no libelous or unlawful statements, and does not infringe on the rights of others. If the article contains any material protected by the copyright of others, the Author must deliver a written permission from the copyright owner(s) to reproduce such material in the article.
The Author also understands that:
1. The Author hereby agrees that the Publisher (the University of Jyväskylä, Centre for Applied Language Studies) has the right to publish, distribute, display and copy the article. When the manuscript is ready for publication, it will be published at Publisher's own expense and under the Publisher's name. The author(s) retains the copyright to the article.
2. The Author understands that no royalties or remuneration will be paid by the Publisher to the author(s) for the above-named submitted manuscript.
3. The Author is responsible for the content, originality and integrity of the article, and will indemnify and defend the Publisher against any claim, demand or recovery against the Publisher by reason of any violation of any proprietary right or copyright, or because of any libelous or scandalous matter contained in the manuscript.
4. The publisher will have the right to edit the work, provided that the meaning of the text is not materially altered.
5. The publisher has the right to end the service of the journal Apples - Journal of Applied Language Studies or alter it at any time and for any cause without liability to the author(s).
6. The Author understands that the article will be published openly on the Internet and, after publication, anyone has the right to copy, distribute and display the work freely as long as it is for nonprofit purposes, and the original author(s) is given credit and Apples - Journal of Applied Language Studies is named as the original publication.
7. This Agreement, whenever called upon to be construed, shall be governed under Finnish law.
8. The parties to this Agreement consent and agree that all possible disputes will be resolved primarily by negotiations. If needed all legal proceedings relating to the subject matter of this Agreement shall be maintained in Jyväskylä district court.
9. This Agreement cannot be modified except by a written instrument signed by the parties hereto.
10. This Agreement shall be binding upon the parties hereto, their heirs, successors, assigns and personal representatives.
11. If the Article was prepared jointly with other authors, you warrant that you have been authorized by all co-authors to sign this Agreement on their behalf, and to agree on their behalf the order of names in the publication of the Article. You shall notify us in writing of the names of any such co-authors.
If the article includes material from other copyrighted sources, the Author agrees to send the relevant permissions to Apples editors (address below).
If the article include illustrations in which a person can be recognized, the Author agrees to send the relevant permissions to Apples editors (address below).
Apples – Journal of Applied Language Studies
Centre for Applied Language Studies
P.O. Box 35
FIN-40014 University of Jyväskylä, Finland
Email apples@jyu.fi
