Use of Item analysis to improve quality of Multiple Choice Questions in II MBBS

Rupal M. Patel

Abstract


Item analysis helps in assessing the quality of the multiple choice items and of the test as a whole.

  • To analyze the quality of MCQs & to determine internal consistency reliability of test.
  • To evaluate perception of teachers towards item analysis.

In a cross-sectional study, total 40 items from Microbiology First Continuous Evaluation Test of 83 students of 2nd year M.B.B.S. were analysed. Item & test analysis was done by calculating Difficulty index (DIF I), Discrimination index (DI), Distractor effectiveness (DE), Point Bi-serial correlation (PBS) and Cronbach’s Alpha. Feedback of faculties was collected on a 5 point Likert scale.

Difficulty index of 12(30%) & 18(45%) items were in the ideal (50-60%) & acceptable range (30-70%) respectively, 7(17.5%) items were easy (>70%) and 3(7.5%) items were difficult (<30%). Discrimination index of 17(42.5%) items was excellent (=>0.36), 7(17.5%) items was good (0.25-0.35), 1(2.5%) item was acceptable (0.20-0.24) and 15(37.5%) items was poor (=<0.20).  Out of 15 items with poor DI, 6 (40%) items  were of easy and difficult level of DIF I and 3 items (20%) were poorly framed but rest of the items were appropriately framed testing higher level of cognitive domain. Out of 120 distractors analysed, 102(85%) were functional & 18(15%) were non-functional. Thirty (75%) items had acceptable PBS values (>0.15). Cronbach’s Alpha improved from 0.702 to 0.794 on removal of 15 items with poor DI. Most of the faculties found item analysis useful to improve quality of MCQs.

Majority of the items had acceptable level of difficulty & discrimination index. Most of distractors were functional. Item analysis helped in revising items with poor discrimination index and thus improved the quality of items & a test as a whole.

Keywords: Item Analysis, MCQs


Full Text:

PDF

References


Baig M, Ali SK, Ali S, Huda N. Evaluation of Multiple Choice and Short Essay Question items in Basic Medical Sciences. Pak J Med Sci. 2014;30(1):3–6.

Mehta G, Mokhasi V. Item Analysis of Multiple Choice Questions- An Assessment of the Assessment Tool. IJHSR. 2014;4(7):197-202.

Mitra N K, Nagaraja H S, Ponnudurai G, Judson J P. The Levels of Difficulty and Discrimination Indices in Type A Multiple Choice Questions Of Pre-clinical Semester 1 Multidisciplinary Summative Tests. IeJSME 2009;3(1):2-7.

Karelia BN, Pillai A, Vegada BN. The levels of difficulty and discrimination indices and relationship between them in four responses type multiple choice questions of pharmacology summative tests of year II MBBS students. IeJSME 2013;6:41-46.

Scorepak®: Item analysis. Available from: www.washington.edu./oea/score1/htm . [Last Accessed on 13 September 2015].

Ananthakrishnan N. Item Analysis validation and banking of MCQs. In: Medical Education Principles and Practices. 2nd ed. Ananthkrishnan N, Sethuraman KR, kumar S. Alumini Association of National Teacher Training Centre, JIPMER, Pondichery, India. p,131-137.

Gajjar S, Sharma R, Kumar P, Rana M. Item and test analysis to identify quality Multiple Choice Questions (MCQs) from an assessment of medical students of Ahmedabad, Gujarat. Indian journal of Community Medicine 2014;39:17-20.

Ho TF, Yip WC, Tay JS. The use of multiple choice questions in medical examination: an evaluation of scoring and analysis of results. Singapore Med J. 1981;22(6):361-7.

Chauhan P, Ratrhod S, Chauhan B, Chauhan G, Adhvaryu A, Chauhan A. Study of Difficulty Level and Discriminating Index of Stem Type Multiple Choice Questions of Anatomy in Rajkot, BIOMIRROR 2013; Volume 4:1-4.

Tarrant M, Ware J, Mohammed AM. An assessment of functioning and nonfunctioning distractors in multiple choice questions: a descriptive analysis. BMC Medical Education 2009;9:1-8.

Singh T, Anshu. Item analysis and Question Banking In: Principles of Assessment in Medical Education. 1st ed. New Delhi: Jaypee Brothers Medical Publishers (P) Ltd: 2012.p,116-127.

Verma S. 1999 Preliminary Item Statistics Using Point Biserial Correlation And P-Values. Education Data Systems Inc., Morgan Hills, USA.

Kolte V. Item Analysis of Multiple Choice Questions in Physiology Examinations. Indian J of Basic & Applied Medical Research 2015;4(4):320–326.

Matlock-Hetzel S. Basic Concepts in Item and Test Analysis. US: Texas A & M University; 1997.


Refbacks

  • There are currently no refbacks.