以Rasch Model GSP表及GSM結構圖進行試題修正:以企業倫理與職業道德課程之測驗為例

The Use of Rasch Model GSP Chart and Grey Structural Model Analysis for Vocational Education and Training Courses: Taking Enterprise Ethics and Professional Ethics Courses as an Example

許天維;曾建維;梁榮進;王柏婷;永井正武
Tian-Wei Sheu;Jian-Wei Tzeng;Jung-Chin Liang;Bor-Tyng Wang;Masatake Nagai


所屬期刊: 第8卷第4期 「測驗與評量」
主編:國立政治大學心理學系教授
林邦傑
系統編號: vol031_03
主題: 測驗與評量
出版年份: 2012
作者: 許天維;曾建維;梁榮進;王柏婷;永井正武
作者(英文): Tian-Wei Sheu;Jian-Wei Tzeng;Jung-Chin Liang;Bor-Tyng Wang;Masatake Nagai
論文名稱: 以Rasch Model GSP表及GSM結構圖進行試題修正:以企業倫理與職業道德課程之測驗為例
論文名稱(英文): The Use of Rasch Model GSP Chart and Grey Structural Model Analysis for Vocational Education and Training Courses: Taking Enterprise Ethics and Professional Ethics Courses as an Example
共同作者:
最高學歷:
校院名稱:
系所名稱:
語文別:
論文頁數: 28
中文關鍵字: Rasch Model;GRA;S-P 表;GSP表;GSM結構圖
英文關鍵字: Rasch Model;GRA;S-P Chart;GSP Chart;GSM Figure
服務單位: 國立臺中教育大學教育測驗統計研究所教授;國立臺中教育大學教育測驗統計研究所博士候選人;嶺東科技大學嶺東科技大學科技商品設計所副教授;逢甲大學外語教學中心講師;國立臺中教育大學教育測驗統計研究所教授
稿件字數: 11820
作者專長: 試題關連結構、試題質性分析、測驗等化
投稿日期: 2012/7/21
論文下載: pdf檔案icon
摘要(中文): 本研究以Rasch Model的參數模式,運用灰關聯分析方法GRA(grey relational analysis),與S-P表的方式建立Rasch Model GSP(grey student problem)表,並且以結合灰色結構模式GSM(grey structural model)建立GSM結構圖,這種方法突破了傳統S-P表的圖形表達方式,讓複雜的數據可以簡單化進行分析,同時成為有系統的結構組織。本研究內容是依據臺灣某上市公司,內部員工之職業教育訓練課程-企業倫理與職業道德之試題,進行分析研究,而實質獲得了受測者與試題的鑑別度「a」,以及受測者測驗平均值與試題難度「B」,而從「r」的分佈圖,可以清楚辨識受測者的得分率和試題答對率情形,針對教師進行學習者程度與試題難度修正之依據。透過GSM結構圖進行研究解析,從圖形的方向性(digraph),可以清楚了解試題的分群狀態,根據評量所得到的數據資料進行計算,可以鑑別出相同類型的試題,成為命題改進的依據,仍是教師進行難度相似試題刪減之依據。實驗驗證Rasch Model GSP表與GSM結構圖的研究組合,是一種提供教師進行測驗後試題修正的創新方法。
摘要(英文): The paper aims at the application of Rasch Model, Grey Relational Analysis (GRA) and S-P chart to establish the Rasch Model GSP (grey student-problem) figure. With the combination of Grey structural modeling, the GSM (grey structural model) figure could be established. This approach breaks through the traditional graphical representation of S-P chart; therefore, the complicated data analysis could be simplified into a systematic structural organization. In accordance with a listed company in Taiwan, the paper analyzed the internal staff training courses, including business ethics and ethical questions. Based on the findings, the GSP chart can be set up with discrimination from students and items, and it is used as discrimination parameter . The average of item difficulty and the average of examinees’ scores could be used as difficulty parameter . The lowest score and the lowest rate of correct test items could be recognized as guessing parameter . According to the analysis, the levels of the learners can be assessed, and the difficulties of the questions revised. Through the GSM figure and the direction of the graph (digraph), the structural components of the clustering state can be analyzed. Through the analysis of GSM figure, it is possible to understand test item clustering based on the directions of the graphs. Also, according to the assessment data, the same type questions and test items with similar difficulty can be identified, which can not only be the basis of test design, but also become the reference for test item deletion. In brief, the experiment shows that the combination of Rasch Model GSP chart and GSM figure is an innovative method for teachers’ remedial teaching after testing.
參考文獻: 王文中(2004)。Rasch 測量理論與其在教育和心理之應用。教育與心理研究,27,637-694。
王濟州、郭志剛(2004)。Logistic迴歸模型-方法及應用。臺北市 :五南。
余民寧(1995)。成就測驗的編制原理。臺北市:心理。
余民寧(2002)。教育測驗與評量-成就測驗與教學評量。臺北市:心理。
何英奇(1989)。精熟學習策略配合微電腦化s-p表分析診斷對學生學習效果的實驗研究。教育心理學報,22,191-214。
許天維、梁榮進、王柏婷、曾建維、永井正武(2010a,十月)。工業設計產品模型專業課程的教育評量鑑別。第一屆設計創新暨應用學術研討會,12-20,臺南科技大學,臺南。
許天維、梁榮進、王柏婷、曾建維、永井正武(2010b,十二月)。產品設計專業學習內容難度評量與判斷之研究。第十五屆灰色系統理論與應用研討會,A83-A92,建國科技大學,彰化。
許天維、曾建維、梁榮進、王柏婷、永井正武(2010c,十二月)。Rasch Model GSP表的提案與工具之開發。第十五屆灰色系統理論與應用研討會,A115-A122,建國科技大學,彰化。
許天維、曾建維、梁榮進、王柏婷、永井正武(2011a,五月)。以GSP表探討數位學習課程認證指標重要程度之研究。第二十二屆國際資訊管理學術研討會,S1-11,朝陽科技大學,臺中。
許天維、曾建維、梁榮進、王柏婷、永井正武(2011b,五月)。以Rasch Model GSP表進行三參數對數型模式之探究。第三屆科技與數學教育學術研討會,723-733,臺中教育大學,臺中。
游森期、余民寧(2006)。知識結構診斷評量與s-p表之關聯性研究。教育與心理研究,29(1),183-208。
溫坤禮、趙忠賢、張宏志、陳曉瑩、溫惠筑(2009)。灰色理論與應用。臺北市:五南。
Bond, T., & Fox, C. (2001). Applying the Rasch model: Fundamental measurement in the human sciences, Mahwah, NJ: Lawrence Erlbaum Associates.
Bryman, A., & Cramer, D. (1997). Quantitative data analysis with SPSS for Windows. London and New York: Routledge.
Carmines, E. G., & Richard A. Z. (1979). Reliability and Validity Assessment. Newbury Park, CA: Sage.
Chacko, I. (1998). S-P chart and instructional decisions in the classroom. International Journal of Mathematical Education in Science & Technology, 29(3), 445-450.
Chen, D. J., Lai, A. F., & Liu, I. C. (2005). The design and implementation of a diagnostic test system based on the enhanced S-P model. Journal of Information Science and Engineering, 21, 1007-1030.
Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297-334.
Dinero, T. E., & Blixt, S. L. (1988). Information about Tests from Satos S-P Chart. College Teaching, 36(3), 123-128.
Liang, J. C., Lee, Y. L., & Chen, J. S. (2009). A style description framework analysis of gear stick based on GRA and ISM. Journal of Grey System, 12(3), 109-116.
Liang, J. C., Lee, Y. L., & Nagai, M. (2011, May). The innvative evaluation of product design based on AHP, GRA and GSM. Paper presented at the International Conference on Planning and Design , Tainan, Taiwan.
Lin, Y. H., & Chen, S. M. (2006a, October). The investigation of S-P chart analysis on the test evaluations of equality axiom concepts for sixth graders. Paper presented at Proceedings of the 2nd WSEAS/IASME International Conference on Educational Technologies, Bucharest, Romania.
Lin, Y. H., & Chen, S. M. (2006b). The integrated analysis of S-P chart and ordering theory on equality axiom concepts test for sixth graders. WSEAS TRANSACTIONS ON MATHEMATICS, 5 (12), 1303-1308.
Lin, Y. H., & Liu, M. H. (2010, August). Integration of polytomous IRS and S-P chart in concept diagnosis of fraction addition based on learning styles. Paper presented at the ISTASC10 Proceedings of the 10th WSEAS international conference on Systems theory and scientific computation, World Scientific and Engineering Academy and Society (WSEAS) Stevens Point, WI.
Lord, F. M. (1980). Applications of item response theory to practice testing problems. Hillsdale, NJ: Lawrence Erlbaum Associates.
Nagai, M., Yamaguchi, D., & Li, G. D. (2005). Grey structural modeling. Journal of Grey System, 8(2), 119-130.
Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Copenhagen: The Danish Institute for Educational Research.
Sato, T. (1969, August). A method of analyzing data gathered by the response analyzer for diagnosis of student performance and the quality of instructional sequence. Paper presented at the meeting of IECE of Japan Annual Conference S12-1, Japanese.
Sato, T., & Kurata, M. (1977). Basic S-P score table characteristics. NEC Research and Development, 47, 64-71.
Sato, T. (1980) . The S-P chart and the caution index. Tokyo, Japan: NEC Educational Information Bulletin, 80(1) , C&C Systems Research Laboratories, Nippon Electric Co., Ltd.
Sato, T. (1985). Introduction to student - Problem curve theory analysis and evaluation. Tokyo: Meiji Tosho, Japan.
Sheu, T. W., Wang, B. T., Liang, J. C., Tzeng, J. W., & Nagai, M. (2010, December). Applying grey S-P chart to analyze the English listening performances among college students. Paper presented at the 15th Conference on Grey System Theory and Applications, Chienkuo Technology University, Changhua, Taiwan.
Sheu, T. W., Tzeng, J. W., Tsai, C. P., & Chen, T. L. (2012). Applying problem-concept chart combined with structural analysis to investigate the learning misconcept-simple equation with one variable for example. Journal of Grey System, 15(1), 56-67.
Wang, B. T., Sheu, T. W., Liang, J. C., Tzeng, J. W., & Nagai, M. (2011, November). The integrated methods of ISM and GSM in concepts diagnosis for English grammar: A case study in Taiwan. Paper presented at the 2011 Kansei Engineering Conference, Chienkuo Technology University, Changhua, Taiwan.
Wright, B. D., & Masters, G. N. (1982). Rating scale analysis. Rasch measurement. Chicago, IL: MESA Press.
Wright B. D. (1977). Solving measurement problems with the Rasch Model. Journal of Educational Measurement, 14, 97-116.
Wright, B. D., & Mok, M. M. C. (2004). An overview of the family of Rasch measurement models. In E.V. Smith & R.M. Smith (Eds.), Introduction to Rasch measurement: Theories, models and applications (pp. 1-24). Maple Grove, MN: JAM Press.
Yamaguchi, D., Li, G.. D., & Nagai, M. (2005). New Grey relational analysis for finding the invariable structure and its applications. Journal of Grey System, 8(2), 167-178.
Yamaguchi, D., Li, G.. D., Mizutani, K., Akabane, T., Nagai, M., & Kitaoka, M. (2006, June). A realization algorithm of grey structural modeling with MATLAB. Paper presented at the Cybernetics and Intelligent Systems, 2006 IEEE International Conference on Cybernetics and Intelligent Systems (CIS06), Bangkok, Thailand.
Yamaguchi, D., Li, G.. D., & Nagai, M. (2007). Verification of effectiveness for grey relational analysis models. Journal of Grey System, 10(3), 169-181.
Yamaguchi, D., Li, G.. D., Mizutani, K., Akabane, T., Nagai, M., & Kitaoka, M. (2007). A realization algorithm of grey structural modeling. Journal of Grey System, 10(1), 33-40.
Yih, J. M., & Lin, Y. H. (2010). Concept structure based on response pattern detection of S-P chart with application in algebra learning. WSEAS Transactions on Computers, 9(8), 847-856.
Yuksel, A., & Yuksel, F. (2002). Measurement of tourist satisfaction with restaurant services: A segment-based approach. Journal of Vacation Marketing, 9(1), 52-68.