|Year : 2020 | Volume
| Issue : 2 | Page : 145-149
National exit test: How will one size fit all?
Piyush Ranjan1, Rajeev Ranjan2, Mukul Kumar3
1 Department of Medicine, All India Institute of Medical Sciences, New Delhi, India
2 Department of Laboratory Medicine and Secretary, Resident's Doctor Associations, New Delhi, India
3 MBBS Student and President Student's Union, All India Institute of Medical Sciences, New Delhi, India
|Date of Submission||16-Sep-2019|
|Date of Acceptance||28-Nov-2019|
|Date of Web Publication||07-Feb-2020|
Dr. Piyush Ranjan
Department of Medicine, Room No 3092, All India Institute of Medical Sciences, New Delhi - 110 029
Source of Support: None, Conflict of Interest: None
| Abstract|| |
Medical education in India is expected to undergo a significant reform after the introduction of the National Medical Commission Act. Single, nationwide National Exit Test (NEXT) is an essential provision under this act, which will be implemented during the next three years. It aims to bring about uniformity in the minimum standard of final MBBS examination, quality control in the licentiate examination and elimination of multiple entrance examinations for admission in postgraduate courses. Since the NEXT has multiple and varied objectives, we suggest a three-step scheme for the conduct of NEXT. Step I (Part A and B) will be equivalent to present-day first and second professional MBBS examinations and step II will act as the final professional MBBS and licentiate examination. Step III will form the basis for admission to the different PG courses. The written exam of Step I and II will consist of structured long, short and multiple choice type questions, whereas practical or clinical examination will consist of structured instruments with lesser inter-rater variability (viz., OSCE, OSPE, OSLER, etc.). This opinion piece is a result of in-depth discussions among major stakeholders such as MBBS students, resident doctors, and faculty of AIIMS, New Delhi. The suggested three-step plan is probably the most feasible way to ensure that the three modalities (final year MBBS, licentiate examination, and PG entrance competitive) are assessed in a valid, reliable, and acceptable manner. Due consideration is given to the fact that an assessment process has a significant impact on learning and teaching. The government may consider these suggestions while formulating the regulations of the NMC Act.
Keywords: India, medical education, national exit test, NEXT, NMC Act
|How to cite this article:|
Ranjan P, Ranjan R, Kumar M. National exit test: How will one size fit all?. Ann Indian Acad Neurol 2020;23:145-9
| Introduction|| |
In order to usher in mega reforms in the field of medical education, the Government of India introduced the National Medical Commission Act (NMC Act), 2019., The Act aims to form a medical education and health care system that improves the quality and affordability of medical education and ensures the availability of adequate and high-quality medical professionals in all parts of the country. The government considers the Act as a progressive step to ensure integrity, quality, and affordability in medical education along with providing quality healthcare to common people. However, associations of medical practitioners, medical students, and resident doctors have raised concerns [Box 1] over individual sections of the Act including the provisions of the National Exit Test (NEXT). We present this opinion piece to suggest a scheme for the conduct of NEXT after an in-depth discussion with three major stakeholders, i.e., MBBS students, resident doctors, and faculty of AIIMS, New Delhi.
| Next as Described in the Act|| |
NEXT is supposed to serve three purposes. First, it will act as a passing examination for final MBBS examination. Second, it will act as a qualifying examination to grant the license to practice modern medicine in India for Indian as well as foreign medical graduates. Third, it will serve as a competitive test that will form the basis for admission to the postgraduate (PG) broad-speciality courses in the medical institutions of India.
The NEXT will be conducted by a “designated authority” notified by the NMC/Central government, which is likely to become operational within three years from the date of commencement of this Act. The nitty-gritty of the NEXT (like the pattern of questions, number of papers, etc.) is not yet described and will be specified by the regulations in the act, which is supposed to be formed in due course of time after due diligence.
The primary intent of NEXT could be to ensure uniformity in the level of training in MBBS course (more so in private medical colleges), quality control for medical graduates from foreign medical colleges intending to practice in India, and abolishing the need to take multiple entrance examination and/or multiple counseling processes for admission in PG courses.
| Challenges With Next: Will One Shoe Fit All?|| |
There is a marked difference in the fundamental purpose of evaluation in MBBS examination (passing in nature), licentiate examination (qualifying in nature), and PG entrance examination (competitive in nature). While the purpose of the first two examinations is to assess the minimum level of knowledge and competency, the PG entrance examination aims to discriminate between the skills of any two candidates as even the minimal difference in their ranks (merit number) may lead to differences in the course and/or institute offered to them (or available at their rank). Besides, the stakes involved in these three examinations are also different. The PG entrance examination is one of the most sensitive tests of the country that needs to be conducted with extreme caution. Thus, the methods proposed to be used in evaluation for these three modalities will principally require different types of instruments which should to be valid, reliable, and feasible to test these three modalities individually.
| Establishment of Central Board of Medical Education|| |
Section 15.2 of the NMC act mandates the establishment of a “designated body” which will conduct final year MBBS examination (for more than 70,000 students), PG entrance examination (of more than one lakh students), and licentiate examination of thousands of the foreign medical graduates. Such a mammoth task will require a dedicated body. Central Board of Medical Education (CBME) can be the “designated authority” mentioned in the NMC Act. The success of NEXT will entirely depend on the continuous inflow of skillfully constructed questions for written/theory and clinical/practical examinations. Constant research and development will be instrumental in improving the validity and reliability of such a high stakes examination. There is a general perception that PG entrance examination in India (like NEET PG and SS) has poor validity and reliability in comparison to similar examinations from the west like USMLE that tests a candidate over 2-3 days with thousand-odd questions. Establishment of a dedicated central examination body will be an extremely crucial step. Faculty already involved in various examinations in the country (like AIIMS entrance, PG entrance) and qualified in the field of medical education with an inclination toward assessment system may be deputed/attached to this board. CBME can be a massive success in bringing quality improvement in the field of medical education, in the same way as Central Board of Secondary Education has been in the secondary and higher secondary school education in India.
| Problems and Concerns|| |
There are several concerns regarding the scheme of NEXT among major stakeholders [tabulated in Box 1]. Education drives learning and we need to formulate a method directed to meet the healthcare goals of our country without compromising on the quality while looking for the means to achieve quantity (like meeting doctors-patients ratio). While doing so, we also need to devise a strategy that facilitates the engagement of appropriately trained foreign medical graduates. The current method of evaluation (MCI screening test) has already created a backlog of about 2 lakh students who are not able to clear this examination after getting MBBS/equivalent degrees from various countries. Some of them might be competent enough to serve at primary care level (equivalent to proposed community health workers). However, they might be failing multiple times to clear screening test due to deficiencies in our evaluation system (like number, nature, and type of questions asked in the screening examination). A similar situation may arise if NEXT is conducted without due deliberations and preparedness. This may have a negative impact on the psychology of these students, their parents, and society in general. In the initial few years, it would be appropriate to set the level of NEXT examination relatively easier, (with must know questions mainly) to build up the confidence of students, parents, and society.
| Assessment Methods Commonly Used in Medical Education|| |
Commonly used tools for written, practical, and clinical examination in medical education are summarized in [Table 1] and [Table 2]., Readers are advised to go through the tables to understand the basis for our suggestion. It is important to note that all assessment methods have strengths and limitations and no single method (in isolation) can assess all types of knowledge and skills and, thus, a mix of methods depending upon the context is suggested.
|Table 1: Basic description of the written examination assessment methods used in medical education|
Click here to view
|Table 2: Methods for the assessments used in the evaluation of clinical skills in medical education|
Click here to view
Tool(s) of evaluation should be chosen carefully based on the context and purpose. The consideration of utility criteria of the assessment tool (viz., validity, reliability, educational impact, acceptability, and feasibility) can be helpful in making an appropriate choice. In real life, there is always some swapping between validity and reliability. For high stakes, competitive examinations, more reliable instruments should be used, whereas, for formative assessments, tools with higher educational impact should be chosen.
Assessment methods need careful planning and strategic designing. It should be studied for its educational effects; otherwise, it can promote unhealthy approaches to learning. What is evaluated and which methods are used in the assessment significantly guides what will be learnt by the students., This is quite evident in the current scenario, where the MBBS students are found missing from clinical postings and enrolling themselves in coaching classes in the very first year to prepare for MCQs for PG entrance examination.
| Suggested Scheme of Next|| |
The suggested scheme to conduct NEXT is summarized in [Table 3]. The scheme has been proposed after giving due consideration to the context and purpose of assessment. Besides, the feasibility of selecting a particular tool for the designated purpose has also been considered. There has been increased concern about suboptimal training facilities and infrastructure in many private medical colleges. Step I of the suggested scheme will act as a quality check for such colleges and will motivate them to improve the standard of teaching and training to an acceptable level. Although the act has left the examination of the first and second MBBS examination to the respective colleges/universities, we are of the opinion that the conduct of step I by the CBME will improve proper training in first and second professional subjects that are equally important in medical science. Many countries like USA, UK, Canada, and Australia conduct central licentiate examinations. Steps I and II of the suggested scheme are similar to that of USMLE in terms of the content (medical subjects covered in steps I and II) with a slight change in the types of question. We have suggested the use of structured LAQs and SAQs in steps I and II along with MCQs (USMLE uses MCQs only) for two reasons. First, no single modality of evaluation is ideal, and every instrument of evaluation has its advantages [Table 1] and [Table 2]. Hence, a mixed bag of all types of questions will be most appropriate (valid and reliable) to judge the knowledge and competency of the students. Careful structuring and preset marking scheme will be required to avoid the inter evaluator variability in the marking and evaluation of SAQs and LAQs. Second, the validity of MCQs based examination entirely depends upon the framing of good quality questions which is a resource-intensive process (requires time and skills). Steps I and II conducted by a central university could be the most suitable alternative to the current system of university examinations which has failed to stand up to the expectations in many private medical colleges. Besides, the CMSE will extend infrastructural support to many newly opened/proposed medical colleges. Step II will also involve a clinical evaluation, which would consist of Objective Structured Clinical examination (OSCE), Objective Structured Long Examination Record (OSLER), Mini-Clinical Evaluation Exercise (mini-CEX), and Direct Observation of Procedural Skills (DOPS) that are more reliable tools with less inter-evaluator variability., One long case and a short case can also be considered with proper structuring and preset marking scheme. Careful structuring and preset marking scheme will avoid the inter-evaluator variability. STEP-II in the proposed scheme of NEXT will act as the final year MBBS examination as well as licentiate examination for Indian medical graduates. Both the written test and the clinical/practical examination should be conducted by the central board in a non-home center to ensure integrity. The foreign medical graduates can appear in the randomly allotted designated centers for taking licentiate examination.
|Table 3: Basic details of the suggested scheme of the evaluation under the NEXT|
Click here to view
Step III will act as a competitive entrance test and form the basis for admission to the different PG courses. Approximately, one lakh twenty-five thousand candidates compete for thirty thousand odd seats. Considering the factors of reliability and feasibility, it should be MCQs based. Different formats of MCQs (single and multiple options, extended matching type, assertion-reasoning, etc.) can be used to ensure widespread sampling. The number of items should be adequate to ensure proper sampling of the final year syllabus. The validity and reliability of this test will depend upon skillfully constructed good quality questions. Candidates can take Step III after passing Step II before the internship. Besides, step III can be taken multiple times to improve rank, if desired by the students. Multiple sets of questions used in the different time frame with different difficulty levels (even if notionally) may lead to the controversy. The issue regarding the decision of inter-se merit for counseling can be addressed by validated statistical methods like “normalization procedure adopted on the basis of percentiles.”
| Separate Board of Examination for AIIMSs and Other INIs|| |
To create medical excellence in country, visionaries and creators of the medical education system of the country have established All India Institute of Medical Sciences (AIIMS) and other INIs (Institute of National Importance) by a separate Act of parliament. These institutes have proven their high standards in the field of patient care, medical education, research, and training decade after decade. They have the mandate to act as an apex referral center for patient care, conduct cutting edge medical research, and formulate guidelines for different diseases based on the local needs and conditions. This mandate is notably different from other medical colleges in India, which is mainly to take care of basic medical needs of the country, act as tertiary level referral centers for patient care and run various undergraduate and postgraduate courses like MBBS, MD/MS, and DM/MCh. Thus, the content of training in these institutions and the nature of competencies/skills expected to be attained by students in these institutes will be different. Besides, these institutions (AIIMS, New Delhi and PGI Chandigarh) have a different pattern of intake of students (biannual intake) in postgraduate courses from sate medical colleges (that have an annual intake), including their high-quality entrance examinations which are most difficult examinations by any standards. Assessment is a controlling driver of learning, and it gives guidance to learners about what they should be learning. Keeping the same assessment system for the students of these INIs will ultimately lead to deviations in the mandate of these institutes.
Our suggestion to have multiple steps in NEXT and the use of mixed types of questions for assessment by a central board will be crucial in the quality improvement of medical education in our country. The suggested scheme is probably the most feasible, valid, reliable, and acceptable option to achieve the three main intentions of the NMC Act (in medical education), viz., ensuring uniform and quality teaching in medical colleges (via Step I, II, and III), a minimal level of competency to grant the license to practice (for Indian and foreign medical graduates) through step II, and a single and valid PG entrance examination (Step III). Government of India may find these suggestions useful while formulating the regulations of NMC Act 2019.
The authors express their gratitude to the executives and members of students, resident doctors, and faculty association who have participated in the in-depth discussion on the said matter.
Financial support and sponsorship
Conflicts of interest
There are no conflicts of interest.
| References|| |
Tabish SA. Assessment methods in medical education. Int J Health Sci 2008;2:3-7.
Sood R, Singh T. Assessment in medical education: Evolving perspectives and contemporary trends. Natl Med J India 2012;25:357-64.
Epstein RM. Assessment in medical education. N
Engl J Med 2007;356:387-96.
Nagral S. We need to discuss India's reliance on private medical colleges. BMJ 2015;350:h237.
United States Medical Licensing Examination® [Internet]. [cited 2019 Sep 08]. Available from: https://www.usmle.org/
Gleeson F. AMEE medical education guide No. 9. Assessment of clinical competence using the Objective structured long examination record (OSLER). Medical Teacher 1997;19:7-14.
Sood R. Long case examination-Can it be improved. J Indian Acad Clin Med 2001;2:252-5.
Richardson J, Gill D, Woolf K. Addressing assessment in Libyan medical education. Libyan J Med 2009;4:51-3.
[Table 1], [Table 2], [Table 3]