Examinations Analyst

Royal College of Psychiatrists

Hours
35 hours per week

About the Organisation

Royal College of Psychiatrists (RCPsych) is the professional membership body for psychiatrists and promotes excellent care for people with mental illness. It has 21,000 members and engages with government and the media as the leading voice of UK mental health services. The College is an award-winning, values-based organisation. 

Royal College of Psychiatrists is the professional medical body responsible for supporting psychiatrists throughout their careers, setting standards in psychiatry, and promoting mental health in the United Kingdom. The organization is crucial in education, training, research, and policy advocacy related to psychiatry and mental health services. The primary mission of RCPsych is to improve the understanding, prevention, and treatment of mental illnesses and ensure that people with mental health conditions receive high-quality care

About the role

The Royal College of Psychiatrists is looking to hire for the position of Examinations Analyst within the Examinations Team. The Examinations Analyst is an important role at the College, and procedures associated with the Membership examinations (MRCPsych). Further development will be provided by creating, validating, and maintaining new and existing examination and assessment tools.

As an Examinations Analyst, you will calculate and set MRCPsych pass marks, perform quality assurance on exam output, and administer standard setting meetings. You will be joining a very busy team, and whilst it has a broad range of operational and development tasks, you will have a large degree of autonomy and the opportunity to improve processes, as well as develop professionally.

Reporting to the Psychometrician, you will conduct routine analysis of MRCPsych examinations, which are run multiple times a year. You will collaborate and assist in identifying areas for change and development within examination and assessment processes, alongside the Examination Team, and evaluate and develop new processes.

Responsibilities

Key Responsibilities:

• Set and calculate pass marks for examinations, based on procedures and processes for the theory and clinical exams.
• Monitoring pass marks and pass rates of College examinations and publishing examination pass rates on the RCPsych website.
• Perform analysis of examinations to highlight anomalous occurrences or spurious items.
• Providing evidence-based psychometric and statistical analysis, expert guidance and support for the evaluation and quality assurance of assessment data across all College examinations.
• Contributing to College Committees, Theory and Clinical
• Committees and facilitating knowledge exchange.
• Organising, running and developing MRCPsych standard-setting meetings for theory examinations.
• Contributing to standard setting, validity and reliability studies for various assessments.
• Analyse and provide individual feedback to candidates on their performance.
• Analyse, report on and monitor examiner performance, including the provision of individual examiner feedback.
• Contribute to key components of departmental reports, including interpreting the data analysis, & validation and writing editorial or graphical content.
• Developing and assisting with changes, piloting and evaluation of new assessment tools using both quantitative and qualitative methods (focus groups, questionnaires).
• Undertaking and submitting examination data to the General Medical Council.
• Support the development of software and contribute to the development of existing and new assessment tools.
• Taking the initiative to advance specialist knowledge in their discipline and keeping skills up to date.
• In association with staff within the department, assist in other
• MRCPsych examination duties as required, invigilation of examinations, checking examination results, etc.
• Performing any other duties consistent with this role to support the smooth running of assessments, when required.

General:

• Undertake any other duties related to the job purpose and which may be necessary in the College’s work.
• To carry out all duties in a safe and proper manner in accordance with the College’s Health and Safety Policy.
• To undertake all duties in line with the College’s values, policies, procedures, and regulations, ensuring that the work undertaken actively promotes equity and diversity.
• To support the College’s sustainability and net zero programme with a focus on adhering to policy and implementing initiatives.
• This job description is not exhaustive and is subject to change in accordance with the business needs of the College.

Skills, Competencies, Experience & Attributes

Essential:

• An understanding of the use of research methodology and psychometric analysis in order to manipulate and analyse data and produce meaningful reports and detailed statistical analysis.
• Demonstrable ability to find pragmatic solutions, seek improvements, and adapt to changing situations.
• Experience in standard-setting analysis and methodology
• Experience in the use of SPSS (other relevant statistical packages, Stata) to capture, collate, manipulate, and analyse data.
• Ability to identify issues, including thorough analysis and interpretation of data, and to anticipate problems in developing and implementing new and emerging processes and procedures.
• Ability to use a range of ICT, including MS Office (particularly
• Outlook, Teams, Word, Excel, and PowerPoint), with accurate word processing skills and the ability to learn new systems quickly.
• Excellent interpersonal skills with proven ability to work collaboratively.
• Ability to present information, verbally and in writing, in a clear and concise manner, with excellent attention to detail.
• Ability to work with minimal supervision, manage own workload, and take responsibility for achieving results.
• Experience in dealing with large volumes of data.
• Ability to deal with individuals and stakeholders at all levels of an organisation.
• Ability to exercise discretion in dealing with confidential or sensitive matters and deliver difficult messages with diplomacy and tact.

Desirable:

• Knowledge and experience of principles of assessment, psychometric theories, and methodologies
• Experience in undertaking and interpreting item analysis
• Experience in the administration of examinations.
• Experience of working in medical education and knowledge of higher medical examinations.
• Experience in presenting to board members/committees and addressing queries they may have.
• Experience and understanding of the workings of a Royal Medical College.

Required Qualifications

• Undergraduate degree in a discipline with a heavy element of statistics (Psychology) and equivalent qualification or experience

Compensation & Benefits

• 25 days of annual leave, plus public and bank holidays
• Six college closure days (during May, August and December)
• Generous flexi-time and time off in lieu (TOIL) schemes
• Enhanced maternity leave (eight weeks at full pay, 18 weeks at half pay, 13 weeks lower rate SMP, 13 weeks unpaid leave)
• Enhanced paternity leave (two weeks at full pay, rather than at the statutory level)
• Interest-free season ticket loan
• Probationary period 6 months
• Subsidised café at our London Head Office
• Health and well-being package (including up to £160 for complementary therapies)
• Money towards annual eye tests
• 24/7 health and stress-related helplines
• Management support helplines
• Group Income Protection Scheme
• Generous pension and life assurance schemes

Working locations

• Hybrid model, working in the London office and remotely

How to apply

• Apply to our website
• RCPsych Candidate Information Pack
• Job Advert
• If you require assistance or any other reasonable adjustments to complete your application form, don't hesitate to get in touch with [email protected]
• Please note that applications received after this date and time will not be considered.

Interviews

• The interview date is Tuesday, 30th June 2026 (via MS Teams)

Policies

The College is opposed to all forms of prejudice and believes that everyone should be treated fairly, regardless of age, disability, gender reassignment, marriage and civil partnership status, race, religion or belief, sex, or sexual orientation (the protected characteristics). We are committed to promoting equality, diversity and inclusion for our existing and future members, associates, affiliates, staff, and visitors in all our practices and arrangements. We actively advocate for, and support, equality of access, experience and outcomes for all College staff, all members and for all mental health patients and carers.

Return to listing