Undergraduate Teaching 2018-19

Part IIA Examiners and Assessors: Faculty Board Guidelines

Part IIA Examiners and Assessors: Faculty Board Guidelines

Not logged in. More information may be available... Login via Raven / direct.

PDF versionPDF version

Table of contents

Guidelines approved by the Faculty Board for use in 2018-19.


Guidelines for Examiners and Assessors: key points for all Parts

General points

  1. Examiners and Assessors are required to adhere to the timetable and detailed instructions provided by the Chair of Examiners.
  2. Examiners must follow all aspects of the agreed policies on security.
  3. Form and conduct notices that detail any changes to the examinations from the previous year are published annually in the Cambridge University Reporter.
  4. External Examiners have an important role to play in our examinations. In particular, Examiners should pay due attention to comments made on their draft papers by the External Examiner.
  5. The General Data Protection Regulation (GDPR) 2018 requires that any data retained must be communicated to students on request.  The Faculty Board Office retains marks books and the students will receive transcripts giving a breakdown of their marks. Examination scripts are not normally released, but any written comments made by the Examiners (excluding ticks and minor notational marks) would need to be transcribed and made available.  Examiners must therefore adhere to the script marking guidelines given below so that data can easily be made available to students who make a request under the GDPR.

Purpose of Tripos exams

  1. The purpose of the Tripos exams is to determine the extent to which candidates have achieved the aims and objectives of the lecture courses.  Exams should test students on whether they:

(a) have understood the basic principles with which they have been confronted, and their limitations;

(b) have developed skills in applying basic principles to the solution of straightforward problems, and;

(c) have developed a deeper understanding, allowing them to tackle problems that are, for them, novel.

Setting the paper

  1. In setting the paper, Examiners should attempt to cover most of the course syllabus and no major topic should be completely omitted.  Questions should be of uniform difficulty.  Setters should study the papers and Examiners’ reports from previous years and note which questions proved satisfactory and which did not. No major changes should be made to the structure or style of papers without consulting the Chair of Examiners: it may be necessary to issue a sample paper. The best indication of the work that has been covered is obtained from the course hand-outs and examples papers.  Lecturers should always be consulted and shown the questions on their part of the course.
  2. Examiners have a tendency to set questions which are too difficult.  When a lecturer, checker, or External Examiner warns that a draft question is too difficult, history shows that he or she is almost always correct.  It is important for Examiners to act on such comments. 

Structuring the questions

  1. Exams should be structured so that very able students will distinguish themselves above the rest and less gifted, but conscientious, students will achieve a safe II.2 level mark.
  2. Questions with only one substantial point are unsatisfactory because candidates either get very high or very low marks.  Questions should whenever possible be ‘scaffolded’, i.e. structured as a series of closely linked steps. 
  3. If a question requires the derivation of a key equation en route, candidates should be specifically asked to derive it as an intermediate result.  Not all is then lost in later parts of the question if they have been unable to perform the derivation correctly.  Lengthy or difficulty algebraic manipulation should be avoided.
  4. Symbols used in questions should be clearly defined except where the definitions are systematically provided in examination data books or data sheets.
  5. It is most important that Examiners always keep in mind the time available for answering a question.  They should also remember that questions are often greatly improved by including a diagram.
  6. Essay type questions are rarely answered really well or really badly.  Engineering students may avoid essay questions because they know there is little chance of gaining high marks. If a question simply asks

‘Discuss the design parameters for a high-speed switching bipolar transistor’,

then mediocre answers can be expected.  A better way of structuring the question would be:

‘For a bipolar transistor:

(a) Explain the concept of minority carrier stored charge in the base.

(b) Outline the effect of current crowding at the base, indicating why it is deleterious and how these deleterious effects are combated.

(c) Explain what causes breakdown in the collector of a transistor and why an increase in the breakdown voltage increases the transit time for the relevant charge carriers.

Hence, discuss criteria for the design of a high-speed switching bipolar transistor.’

This type of structure will help students to provide appropriate answers, ensuring some uniformity and making for easier comparisons and better marking.  The important points expected in the answer should be identified, and form the substance of the crib.  Some open-endedness towards the end of an essay question is desirable, however, so that better candidates can display their knowledge.

Please see the Part-specific guidelines.

Checking the draft papers

  1. Checkers have a most important job.  They ensure that questions are valid, clearly expressed and of the correct level of difficulty.  The checker must write solutions for every question independently of the setter: simply accepting an Examiner's explanation without a clear understanding is unacceptable.  After checking, a detailed and easily readable crib comprising the model solutions and marking scheme is prepared by the Examiner in consultation with the checker.
  2. At this stage, the examination paper and crib should be, in the view of the setter and checker, ready for market in every respect.  This includes not only the length, difficulty, content, and style of each question, but also the presentation details such as layout (including diagrams), sentence structure, grammar, and punctuation.  If these aspects are covered conscientiously by the setter and checker at an early stage it saves everyone a very large amount of time and work later on.  It is not acceptable for semi-complete draft papers to proceed to the reading meeting.

Script marking guidelines

  1. All aspects of the marking process must be fully auditable and defensible in case of an appeal. 
  2. Examiners should adhere to the marking scheme indicated on the exam paper and crib.  The exam paper will show the approximate number of marks for each part of a question in the right margin, the mark to be level with the end of the paragraph(s) to which it refers.
  3. Scripts should be marked in red ink using the following guidelines:

i. mark to whole numbers (do not use half marks);

ii. tick or score through every page to indicate that the page has been seen;

iii. put sub-marks in the right-hand margin - these must correlate with the breakdown on the paper;

iv. circle the total mark for each question at either the start or the end of the question;

v. record the marks on the script cover sheet;

vi. keep the scripts in the correct order.

vii. no comments whatsoever should be made on the scripts.  Under no circumstances should an Examiner write any comments about a candidate’s performance.

  1. Calibrate the marking to comply with the required mark distribution. If, after about 20 scripts, it appears that adjustments will be required to produce a mark distribution in line with that required for that particular Part of the Tripos, the marking scheme can be revised slightly and the scripts remarked.  If major adjustments are required, the Chair should be consulted.
  2. When marking a large number of scripts, standards may shift slightly.  It is therefore best not to mark whole scripts at a time as some candidates may get a raw deal.  After doing the calibration described above, divide the scripts into piles, then mark Q1 right through starting with pile 1, then Q2 right through starting with pile 2, and so on.
  3. Silly arithmetical and algebraical mistakes should not normally be penalized heavily.  It is very troublesome when an early minor error gets carried through a solution: the Examiner then has no choice but to follow the whole solution in detail to check the correctness of the later work.  Questions should be structured to avoid this waste of time.
  4. Transfer the raw marks for each question to the excel markbook provided.  NB. where a candidate answers more than the required number of questions the Examiner should mark all the questions answered and then exclude from the marks recorded the question(s) scoring the lowest mark(s).  
  5. Scaling of the marks may be required by some Triposes.  In such cases, the Chair will issue instructions as to how to proceed.

 

Useful links


Guidelines for Examiners & Assessors: Part II information

Summary of duties

  1. Principal Assessors are responsible for setting and marking the examination papers and preparing the cribs. 
  2. Second Assessors assist the Principal Assessors.  In particular, they should scrutinize all the coursework exercises for the module as a means of quality control and confirm in writing to the Chair of Examiners that the length/workload and content are appropriate.
  3. Group Examiners have overall responsibility for ensuring that the quality assurance procedures are maintained within their group.  Their level of responsibility is above that of the Principal Assessors. 

Setting the paper

  1. Questions should aim to examine the current year's work as listed in the objectives and syllabus for the module.
  2. Papers should be set at a level of difficulty that will produce an average mark in the range 60% to 65% on each paper. All candidates who have attended lectures and worked through examples papers should be able to gain at least 40%.
  3. The three-part question structure used in Part I can be used, but in Part IIA and IIB papers the problems may place more emphasis on deeper understanding and the allocation of credit to the different parts of a question will reflect the change in emphasis.
  4. At Part II Examiners should include questions which require students to synthesize information to check that the students have a good understanding of the topic.

Marking and scaling

  1. The Principal Assessor is responsible for the marking of the coursework. Any subcontracting of marking must be approved ahead of time by the Teaching Office and Chair of Examiners.
  2. As the standard of questions may change from year to year and between modules, it is recommended that Assessors check that their setting and marking have not been either unduly severe or unduly lenient.
  3. Each module is normalised individually according to procedures agreed by the Board of Examiners.  Scaling should be used where necessary, and to the least degree consistent with producing the required change.  Where an Assessor finds a serious discrepancy arising, the Chair should be consulted and consideration given to either modifying the marking scheme or otherwise adjusting the marks.
  4. Where marks have been normalised, the Examiners at their meetings will consider only the normalised marks in their discussions and in reaching their decisions.

Cribs and reports

  1. The Faculty Board requires every Assessor to provide a written report on the examination or coursework assignment to be sent to the Chair at the time the marks are handed in.  A copy of the report is to be placed in the Assessor’s file for the Assessor in the following year.  Where raw marks have been adjusted, the effect of the adjustment on the raw marks must be recorded in the report.
  2. Assessors are required to provide cribs for their papers.  The Faculty Board recommends to Assessors the practice of including in the cribs comments that may serve as a useful guide to future students.  Specific comments may be added after each solution. Alternatively the section of the Assessor’s report that deals with individual questions may be reproduced on the last page of the crib. Assessors should update their crib in the light of examination marking where necessary and ensure that this updated version is supplied for putting on the web for future students.

Guidelines for Examiners and Assessors: Part IIA supplement

Style of the exam papers

  1. The style of the paper should be in keeping with a Part II examination that is the final classified examination of the four-year course.

Prizes

  1. See the prize guidelines for Part IIA Examiners.

Additional information

Last updated on 03/10/2018 09:31