IMPLEMENTATION AND EVALUATION OF STANDARD SETTING: EXPLORING THE UTILITY OF ONE-MEMBER SUBPANELS USING THE BORDERLINE GROUP METHOD
Abstract
Standard setting has been a concept for consideration in Literature for more than 50 years, and many methods of setting standards have been researched. Senior School Certificate Examinations (SSCE) has also been conducted in Nigeria by both the West African Examinations council (WAEC) and National Examinations Council (NECO) for the
certification of candidates for over two decades now. However, formal standard setting procedures seem not to be given much research attention and application by these examining bodies. This study therefore explored the utility of one-member sub-panels for standard setting for a constructed Physics Achievement Test using Borderline Group Method (BGM) in Oyo state, Nigeria. The standard setting study had a sample of 541 Senior Secondary Two (SS2) students, and their Physics teachers purposively sampled from 14 public secondary schools in three local government areas of Oyo state. Four instruments were constructed and used to collect data for the study, including a Physics Achievement Test with reliability (KR = 0.85). The data obtained were analyzed using descriptive statistics (minimum score, maximum score, mean score, median, standard deviation, Frequency, and Percentages), Item Difficulty, and Independent t-test. Findings of the study revealed that the BGM produced comparable individual cut scores from nine judges' judgement, and a reasonable overall cut score (18) compared with the 50% fixed pass mark of 35. Consequently, the BGM produced a higher Pass/Fail ratio 288/284 (53.23% pass) than the 50% fixed pass mark 26/515 (4.81% pass). The procedures involved in the standard setting
exercise, and the training programme were also found to be clear and practicable, by the judges' favourable ratings. Based on the findings, it was recommended that the BGM with one-member sub-panels should be adopted by the examining bodies (WAEC and NECO), and zonal
education authorities in setting cut scores for grading their candidates.
Keywords: Standard Setting, Cut Scores, Borderline, One-member Sub-panel, Validity
evidence.
Inimfon A. Antia & Olusegun G. Ogundare
IMPLEMENTATION AND EVALUATION OF STANDARD SETTING: EXPLORING THE UTILITY OF ONE-MEMBER SUBPANELS USING THE BORDERLINE GROUP METHOD
Abstract Standard setting has been a concept for consideration in Literature for more than 50 years, and many methods of setting standards have been researched. Senior School Certificate Examinations (SSCE) has also been conducted in Nigeria by both the West African Examinations council (WAEC) and National Examinations Council (NECO) for the certification of candidates for over two decades now. However, formal standard setting procedures seem not to be given much research attention and application by these examining bodies. This study therefore explored the utility of one-member sub-panels for standard setting for a constructed Physics Achievement Test using Borderline Group Method (BGM) in Oyo state, Nigeria. The standard setting study had a sample of 541 Senior Secondary Two (SS2) students, and their Physics teachers purposively sampled from 14 public secondary schools in three local government areas of Oyo state. Four instruments were constructed and used to collect data for the study, including a Physics Achievement Test with reliability (KR = 0.85). The data obtained were analyzed using descriptive statistics (minimum score, maximum score, mean score, median, standard deviation, Frequency, and Percentages), Item Difficulty, and Independent t-test. Findings of the study revealed that the BGM produced comparable individual cut scores from nine judges' judgement, and a reasonable overall cut score (18) compared with the 50% fixed pass mark of 35. Consequently, the BGM produced a higher Pass/Fail ratio 288/284 (53.23% pass) than the 50% fixed pass mark 26/515 (4.81% pass). The procedures involved in the standard setting exercise, and the training programme were also found to be clear and practicable, by the judges' favourable ratings. Based on the findings, it was recommended that the BGM with one-member sub-panels should be adopted by the examining bodies (WAEC and NECO), and zonal education authorities in setting cut scores for grading their candidates. Keywords: Standard Setting, Cut Scores, Borderline, One-member Sub-panel, Validity evidence.