國民中學學生基本學力測驗國文科和英語科成就性別差異和性別差別試題功能(DIF)分析

Investigation of the Gender Differences and Differential Item Functioning on Chinese and English Basic Competency Test for Junior High School Students

盧雪梅
Sheue-Mei Lu


所屬期刊: 第3卷第4期 「測驗與評量」
主編:朝陽科技大學社工系
黃國彥教授
系統編號: vol011_04
主題: 測驗與評量
出版年份: 2007
作者: 盧雪梅
作者(英文): Sheue-Mei Lu
論文名稱: 國民中學學生基本學力測驗國文科和英語科成就性別差異和性別差別試題功能(DIF)分析
論文名稱(英文): Investigation of the Gender Differences and Differential Item Functioning on Chinese and English Basic Competency Test for Junior High School Students
共同作者:
最高學歷:
校院名稱:
系所名稱:
語文別:
論文頁數: 34
中文關鍵字: 國中基測、語文學習成就性別差異、語文性別DIF
英文關鍵字: Basic Competency Test for Junior High School Students, gender differences on Chinese and English achievement tests, verbal gender DIF
服務單位: 國立臺灣師範大學教育心理與輔導學系副教授
稿件字數: 28632
作者專長: 測驗與評量、應用統計
投稿日期: 2007/8/31
論文下載: pdf檔案icon
摘要(中文): 本研究分析90到94年度國民中學學生基本學力測驗國文科和英語科成就性別差異和性別差別試題功能(differential item functioning,簡稱DIF)。在成就差異分析方面,本研究發現國文科和英語科的性別差異組型非常相似,具體言之,女生表現一致顯著高於男生,男生個別差異皆較女生略大些,兩科之低成就組以男生居多,高成就組以女生居多,不過高成就組男女生人數比例差距不及低成就組大。在性別DIF分析方面,國文科DIF出現率約為7.5%,有利男生者和女生者各半;英語科DIF出現率則不到1%,有利女生者佔0.7%,有利男生者佔0.2%。不同內容類型試題的DIF出現率不等,國文科以「組織結構」、「詞語」、「字音、字形、字義」和「段篇」題的出現率較高些;英語科DIF題都來自「生活情境閱讀」題。篇末根據研究發現提出建議供相關人員參考。
摘要(英文): This research investigated the gender differences and gender differential item functioning (DIF) on the Chinese and English Basic Competency Tests for Junior High School Students (BCTEST) from 2001 to 2005. The results showed similar pictures of gender differences on the Chinese and English parts of the BCTEST. Specifically, the females consistently performed significantly better than the males, and the score variations of males were slightly larger than those of females across test administrations. In addition, the proportion of males was much higher than those of females in the low-achieving groups, and the proportion of females was slightly higher than those of males in the high-achieving groups. The results on DIF analyses showed that the average percentage of items displaying gender DIF were respectively about 7.5% and 0.9% on Chinese and English tests. The number of items presenting DIF on Chinese tests favoring males was equal to those favoring females. The items presenting DIF on English tests favoring males were about 0.2% and favoring females were about 0.7%. The proportions of DIF items across different item contents showed variations, the content areas that yielded more DIF items were those associated with structure and organization, paragraph reading, characters or vocabulary on Chinese tests, and real life context reading on English tests. Implications based on findings were proposed for educators, test developers and researchers.
參考文獻: 王嘉寧(2007)。影響試題差異功能的試題特徵探討—以90-95年國中基本學力測驗地理科試題為例。國立臺灣師範大學教育心理與輔導研究所碩士論文,未出版,臺北市。
自由時報(2005,8月6日)。考倒女生?杜正勝指示研究,A8版。
吳裕益(1993)。台灣地區國民小學學生學業成就調查分析。初等教育學報(台南器">如何??路由器師院),6,1-31。吳裕益、洪碧霞、徐綺穗和葉千綺(1993)。國民中學國文、數學及理化科成就測驗編製報告。臺灣省教育廳專案研究報告。
余民寧和謝進昌(2006)。國中基本學力測驗之DIF的實徵分析:以91年度兩次測驗為例。教育學刊,26,241-276。
林世華、陳柏熹和盧雪梅(2005)。國中畢業生能力分析研究計畫成果報告。教育部中教司委託專案研究報告。
陳淑惠、何東憲、張郁雯和吳毓瑩(2006)。2005年台灣學生小六學生英語成就趨勢調查研究。輯於國立教育研究院籌備處主編:台灣教育研究的回顧與展望研討會論文輯,48-76。
曾建銘(2004)。Differential Item Functioning on Basic Mathematics Achievement Test for Middle School in Taiwan。中華教育學報,11,331-354。
曾建銘(2005)。93年第一次國中基本學力測驗數學科區域試題差別功能的探討與研究。教育部台灣省中等學校教師研習會九十四年度研究計畫(編號94105)。
盧雪梅(2000)。Mantel-Haenszel DIF程序之第一類錯誤率和DIF嚴重度分類結果研究。中國測驗學會測驗年刊,47(1),57-71。
聯合報(2005,8月6日)。竹女降7分 彰女降6分 屏女降13分-老師說:數理難不利女生,A3版。
Camilli, G., & Shepard, L. A. (1994). Methods for identifying biased test items. Thousand Oaks, CA: Sage.
Clauser, B.E, & Mazor, K.M. (1998). Using statistical procedures to identify differentially functioning test items. Educational Measurement: Issues and Practice, 17(1),31-44.
Carlton, S. T., & Harris, A. M., (1992). Characteristics associated with differential item performance on the Scholastic Aptitude Test: Gender and majority/minority group comparisons (ETS RR-92-64). Princeton, N.J.: Educational Testing Service.
Cohen, J. (1988). Statistical power analysis for the behavioral science (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.
Doolittle, A. E., & Welch, C. (1989). Gender differences in performance on a college-level achievement test (ACT Research Rep. Series 89-9). Iowa City, IA: American College Testing Program.
Dorans, N.J., & Holland, P.W. (1993). DIF detection and description: Mantel-Haenszel and standardization. In P.W. Holland and H. Wainer (Eds.) Differential item functioning (pp. 35-66). Hillsdale, NJ: Lawrence Erlbaum Associates.
Educational Testing Service (2003). Fairness review guidelines. 2006年8月22日,取自http://www.ets.org/Media/About_ETS/pdf/overview.pdf.
Harris, A. M., & Carlton, S. T. (1993). Patterns of gender differences on mathematics items on the SAT. Applied Measurement in Education, 6, 137-151.Holland, P. W., & Thayer, D. T. (1988). Differential item performance and Mantel-Haenszel procedure. In H. Wainer & H. I. Braun (Eds), Test validity (pp. 129-145). Hillsdale NJ: Lawrence Erlbaum Associates.
Holland, P.W., & Wainer, H. (1993). Differential item functioning. Hillsdale, NJ: Lawrence Erlbaum Associates.
Maccoby, E.E., & Jacklin, C.N. (1974). The psychology of sex difference. Stanford, CA: Stanford University.
Mantel, N., & Haenszel, W. M. (1959). Statistical aspects of the analysis of data from respective studies of disease. Journal of the National Cancer Institute, 22, 719-748.
Lawrence, I. M., Curley, W. E., & McHale, F. J. (1988). Differential item functioning for males and females on SAT-Verbal reading items (Report No. 88-4). New York: College Entrance Examination Board.
OECD (2004). Learning for tomorrow’s world-first results from PISA 2003. Pairs: Author.
O’Neill, K.A., Wild, C. L., & McPeek, W. M. (1989). Gender-related differential item performance on graduate admissions tests. Paper presented at the annual meeting of the American Educational Research Association, San Francisco.
Roussos, L., & Stout, W. (1996). Simulation studies of effects of small sample size and studied item parameters on SIBTEST and Mantel-Haenszel Type I error performance. Journal of Educational Measurement, 33, 215-230.
Scheuneman, J. D., & Geritz, K. (1990). Using differential item functioning procedures to explore sources of item difficulty and group performance characteristics. Journal of Educational Measurement, 27, 109-131.
Wild, C. L., & McPeek, W. M. (1986). Performance of the Mantel-Haenszel statistic in identifying differentially functioning items. Paper presented at the annual meeting of the American Psychological Association, Washington, DC..
Willingham, W. W., & Cole, N. S. (1997). Research on gender differences. In W. W. Willingham and N. S. Cole (Eds.) Gender and fair assessment(pp.17-54). Hillsdale, NJ: Lawrence Erlbaum Associates.
Willingham, W. W., Cole, N. S., Lewis, C., & Leung, S.W. (1997). Test Performance. In W. W. Willingham and N. S. Cole (Eds.) Gender and fair assessment(pp.55-126). Hillsdale, NJ: Lawrence Erlbaum Associates.