科技大學校務評鑑之運用及其影響因素

Exploring a High School Transformation through the Lens of Activity Theory

曾淑惠；張仁傑
Shu-Hui Tseng; Jen-Chieh Chang

Doi：10.3966/181665042018091403001


所屬期刊： 第14卷第3期 「教育政策與制度」
主編：國立臺灣師範大學教育學系副教授
林子斌
系統編號： vol054_01
主題： 教育政策與制度
出版年份： 2018
作者： 曾淑惠；張仁傑
作者(英文)： Shu-Hui Tseng; Jen-Chieh Chang
論文名稱： 科技大學校務評鑑之運用及其影響因素
論文名稱(英文)： Exploring a High School Transformation through the Lens of Activity Theory
共同作者：
最高學歷：
校院名稱：
系所名稱：
語文別： 中文
論文頁數： 32
中文關鍵字： 評鑑運用; 影響評鑑運用的因素; 校務評鑑
英文關鍵字： evaluation use; influence factors of evaluation use; institutional evaluation
服務單位： 國立臺北科技大學技術及職業教育研究所
稿件字數： 17963
作者專長： 教育評鑑; 教學與評量
投稿日期： 2018/5/3
論文下載： pdf檔案icon
摘要(中文)： 校務評鑑在臺灣舉辦多年，而評鑑運用的議題近年才逐漸受到重視。本研究
採問卷調查法探究科技大學教職員對評鑑運用的用途與影響因素的看法，以重要-
表現分析法分析評鑑運用之用途的理想與實際運用的差異，並以結構方程模型驗
證影響校務評鑑運用的因素與評鑑運用的用途間關係之假設模型。總計發放795
份問卷，有效回收701 份，有效回收率為88.17%，主要研究結論包括：一、評鑑
運用的用途分為過程運用與成果運用兩構面；二、影響評鑑運用的因素則可分為
評鑑實施、政策決策及評鑑人員三構面；三、評鑑運用的用途理想重要程度顯著
高於實際符合程度；四、本研究所提出之科技大學校務評鑑運用影響因素與用途
模式架構為一適配模型。
摘要(英文)： The institutional evaluation has been held in Taiwan for many years, and the evaluation use has gradually gained attention in recent years. The main purpose of this study is to explore the views of the faculty and staff of a University of Technology on the use and influencing factors of evaluation. The questionnaire survey was conducted in this study. A total of 795 questionnaires were issued and 701 were effectively collected. The effective response rate was 88.17%. Firstly, performance analysis was used to analyze the difference between the ideal and the actual use of the school evaluation. Secondly, the structural equation model was used to verify the hypothetical model that influences the relationship between the use of evaluation and the evaluation use.
The major findings are summarized as follows:
(1) The evaluation use is divided into two aspects: the process use and the result use. Factors that influence the evaluation use can be divided into three aspects: evaluation implementation, policy decision-making and evaluators.
(2) The importance degree of ideal evaluation use is significantly higher than the actual.
(3) The factors that influences the evaluation use for university of science and technology and the usage model provided in this study is an adaptation model.
參考文獻： 林原宏（2009）。規則評量方法論。教育研究月刊，185，108-111。
吳明隆（2009）。結構方程模式方法與實務應用。高雄市：麗文。
技專校院基本資料庫（2016）。104 學年度技專校院概況。取自http://www.tvedb.
yuntech.edu.tw/tvedb/index/social/report/StatisticsQuery DataFrame.asp?table_
name=report1
技專校院評鑑資訊網。107 學年度科技校院評鑑實施計畫。取自http://tve-eval.
twaea.org.tw/DLFile/107 學年度科技校院評鑑實施計畫( 公告版).pdf
?金堂（2012）。量表編製與SPSS。臺北市：五南。
陳錦玉（2016）。新北市國民中學校務評鑑應用之研究（未出版之碩士論文）。
國立臺灣師範大學教育政策與行政研究所，臺北市。
侯永琪、陳慧蓉（2016）。高等教育品質保證及其結果之運用對於大學校院之影
響及意涵。評鑑雙月刊，61，21-24。
黃嘉雄（2012）。影響小學對課程與教學評鑑發現利用之因素研究。課程與教學
季刊，15（3），1-26。
曾淑惠（2010，12 月）。使用評鑑促進高職學校革新。載於中華民國學校行政研
究學會主辦之「新世紀學校革新之挑戰與展望」國際研討會論文集（頁53-
54），臺北市。
鄭淑惠（2009）。教育評鑑的效用性：促進組織學習的觀點。新竹教育大學教育
學報，26（2），57-88。
鄭淑惠（2016）。地方教育行政機關校務評鑑運用之研究。當代教育研究季刊，
24（4），33-69。
潘慧玲（2004，5 月）。邁向下一代的教育評鑑：回顧與前瞻。論文發表於張新仁
（主持人），國立臺灣師範大學主辦之「教育評鑑：回顧與前瞻」學術研討
會，臺北市。
Alkin, M. C., Daillak, R., & White, P. (1979). Using evaluations: Does evaluation make
a difference? Beverly Hills, CA: Sage.
Alkin, M. C. (1985). A guide for evaluation decision makers. Beverly Hills, CA: Sage.
Alkin, M., & Christie, C. (2004). An evaluation theory tree. In M. Alkin (Ed.), Evaluation
roots: Tracing theorists’ views and influences (pp. 381-392). Thousand Oaks, CA:
Sage.
Alkin, M. C. (2005). Utilization of evaluation. In S. Mathison (Ed.), Encyclopedia of
evaluation (pp.434-436). Thousand Oaks, CA: Sage.
Alkin, M. C., & Taut, S. (2003). Unbundling evaluation use. Studies in Educational
Evaluation, 29, 1-12.
Alkin, M. C., & King, J. A. (2017). Definitions of evaluation use and misuse, evaluation
influence, and factors affecting use. Unbundling evaluation use. American Journal
of Evaluation, 38(3), 434-450.
Amo, C., & Cousins, J. B. (2007). Going through the process: An examination of
the operationalization of process use in empirical research on evaluation. New
Directions for Evaluation, 116, 5-26.
Beurgeois, I., & Whynot, J. (2018). The influence of evaluation recommendations on
instrumental and conceptual uses: A preliminary analysis. Evaluation and Program
Planning, 68, 13–18.
Bollen, K. A. (1989). Structural equations with latent variables. New York. NY: John
Wiley and Sons.
Cousins, J. B., & Leithwood, K. A. (1986). Current empirical research on evaluation
utilization. Review of Educational Research, 56 (3), 331-64.
Chelimsky, E. (2015). A strategy for improving the use of evaluation findings in policy.
In C. A. Christie & A. T. Vo (Eds.), Evaluation use and decision making in society:
A tribute to Marvin C. Alkin (pp. 73-89). Charlotte, NC: Information Age.
Christie, C. A. (2007). Reported influence of evaluation data on decision maker’s actions.
American Journal of Evaluation, 28(1), 8-25.
Christie, C. A., & Alkin, M. C. (2013). An evaluation theory tree. In M. C. Alkin (Ed.),
Evaluation roots: A wider perspective of theorists’ views and influence. (2nd ed.)
(pp. 11-57). Thousand Oaks, CA: Sage.
Devellis, R. (2012). Scale development theory and applications. New York, NY: Sage.
D’Ostie-Racine, L., Dagenais, C., & Ridde, V. (2016). A qualitative case study of
evaluation use in the context of a collaborative program evaluation strategy in
Burkina Faso. Health Research Policy and System, 14(37), 1-16.
Fleischer, D. N., & Christie, C. A. (2009). Evaluation use: Results from a survey of U.S.
American Evaluation Association members. American Journal of Evaluation, 30(2),
158-175.
Greene, J. C. (1988). Stakeholder utilization and participation in program evaluation.
Evaluation Review, 18, 574–591.
Henry, G. T., & Mark, M. M. (2003). Beyond use: Understanding evaluation’s influence
on attitudes and actions. American Journal of Evaluation, 23(3), 293-314.
Hofsetter, C. H., & Alkin, M. (2003). Evaluation use revisited. In T. Kellaghan, D. L.
Stufflebeam, & L. Wingate (Eds.), International handbook of education evaluation
(pp. 197-222). Boston, MA: Kluwer.
Hojlund, S. (2014). Evaluation use in the organizational context–changing focus to
improve theory. Evaluation, 20(1), 26-43.
Hojlund, S. (2015). Evaluation use in evaluation systems: The case of the European
commission. Copenhagen, Denmark: Copenhagen business school.
Huberman, M. (1987). Steps toward an integrated model of research utilization.
Knowledge: Creation, Diffusion, Utilization, 8, 586-611.
Johnson, K., Greenseid, L. O., Toal, S. A., King, J. A., Lawrenz, F., & Volkov, B. (2009).
Research on evaluation use: A review of the empirical literature from 1986 to 2005.
American Journal of Evaluation, 30(3), 377-410.
Kline, R. B. (1998). Principles and practice of structural equation modeling. New York,
NY: Guilford Press.
Leviton, L. C., & Hughes, E. F. X. (1981). Research on the utilization of evaluations: A
review and synthesis. Evaluation Review, 5, 525-549.
D’Ostie-Racine1, L., Dagenais1, C., & Ridde, V. (2016). A qualitative case study of
evaluation use in the context of a collaborative program evaluation strategy in
Burkina Faso. Health Research Policy and Systems, 14(37), 1-16.
McCormick, E. R. (1997). Factors influencing the use of evaluation results. Dissertation
Abstracts International, 58, 4187 (UMI 9815051).
Owen, J. M. (1992, 11). Toward a meta-model of evaluation utilization. Paper presented
at the Annual Meeting of the American Evaluation Association, Seattle, WA.
Patton, M. Q., Grimes, P. S., Guthrie, K. M., Brennan, N. J., French, B. D., & Blyth,
D. A. (1977). In search of impact: An analysis of the utilization of federal health
evaluation research. In C. H. Weiss (Ed.), Using social research in policy making (pp.
141-163). Lexington, MA: Lexington.
Patton, M. Q. (2007). Process use as a usefulism. New Directions for Evaluation, 116,
99-112.
Patton, M. Q. (2008). Utilization–focused evaluation (4th ed.). Thousand Oaks, CA:
Sage.
Peck, L., & Gorzalski, L. (2009). An evaluation use framework and empirical assessment.
Journal of MultiDisciplinary Evaluation, 6(12), 139-156.
Rebora, G., & Turri, M.(2011). Critical factors in the use of evaluation in Italian
universities. Higher Education, 61(5), 531–544.
Rich, R. F. (1977). Uses of social science information by federal bureaucrats: Knowledge
for action versus knowledge for understanding. In C. H. Weiss (Ed.), Using social
research in public policy making (pp.199-211). Lexington, MA: Lexington.
Rossi, P. H., Lipsey, M. W., & Freeman, H. E. (2004). Evaluation: A systematic approach
(7th ed.). Thousand Oaks, CA: Sage.
Saunders, M. (2012). The use and usability of evaluation outputs: A social practice
approach. Evaluation, 18(4), 421–436.
Shadish, W. R., Cook, T. D., & Leviton, L. C. (1991). Foundations of program
evaluation: Theories of practices. Newbury Park, CA: Sage.
Sheizi Calheira de Freitas (2016). The impact of evaluation use on accounting programs’
performance: An exploratory study. National Association of Postgraduation and
Research in Administration, 20(6), 733-752.
Shulha, L. M. & Cousins, J. B. (1997). Evaluation use: Theory, research and practice
since 1986. American Journal of Evaluation, 18, 195-208.
Spector, P. (1992). Summated rating scale construction. Thousand Oaks, CA: Sage.
Weiss, C. H. (1979). The many meanings of research utilization. Public Administration
Review, 39(5), 426-431.
Weiss, C., Murphy-Graham, E., & Birkeland, S. (2005). An alternate route to policy
influence: Evidence from a study of the Drug Abuse Resistance Education
(D.A.R.E.) program. American Journal of Evaluation, 26, 12-31.