Sage Journals: Discover world-class research

Abstract

This article presents a comprehensive theory-based evaluation of Japan’s Foreign Student Policy towards Thailand between the years of 1954 and 2001, utilizing a logical framework: the Policy Evaluation Matrix (PEM). Two logical frameworks were created, based on the policy objectives of Japan’s Foreign Student Policy, namely human resource development (the policy objective which is related to the development of recipient countries) and fostering pro-Japanese leaders (the policy objective which is related to national interest). The collected data are analysed on the two PEMs to measure the effectiveness, impact, efficiency and relevance of the policy. The attainment of the policy objective (i.e. effectiveness) is estimated to be 75 percent in terms of human resource development and 87.5 percent in terms of fostering pro-Japanese leaders. The result is plotted on a three-dimensional graph for ODA (Official Development Assistance) evaluation to show the relationship between inputs and impact on development and impact on national interest.

Keywords

foreign student policy logical framework Official Development Assistance (ODA)Policy Evaluation Matrix (PEM)theory-based evaluation

Get full access to this article

View all access options for this article.

References

Chen, H. T. (1990) Theory-Driven Evaluations. Thousand Oaks, CA: SAGE .

Endo, H. et al. (2002) Comparative Follow-up Survey of Returned Students in Asia Who Studied in Japan, Europe and USA. Tsukuba: Tsukuba University (in Japanese).

Funnell, S. C. (2000) ‘Developing and Using a Program Theory Matrix for Program Evaluation and Performance Monitoring’, in P. J. Rogers et al. (eds) Program Theory in Evaluation: Challenges and Opportunities, New Direction for Evaluation, pp. 91-101. San Francisco, CA: Jossey-Bass Publishers .

Gondo, Y. et al. (1991) Ryugaku no kouka to seika ni kansuru kokusaiteki hikaku kenkyu (International Comparative Study on the Effect and Influence of Study Abroad). Fukuoka: Kyushu University .

Immigration Office of Japan (2003) Foreign Students’ Employment Situation in Japan in 2002 (in Japanese). Available at http://www.moj.go.jp/index.html (accessed Aug. 2005).

Knapp, P. V. D. (2004) ‘Theory-Based Evaluation and Learning: Possibilities and Challenges’ , Evaluation 10(1): 16-34 .

Ministry of Education, Science and Culture (1970) Outline of the Kokuhi gaikokujin ryugaku seido no gaiyou (Japanese Government Scholarship Program for Foreign Students). Tokyo: Ministry of Education, Science and Culture .

Ministry of Education, Culture, Sports, Science and Technology (2001) Outline of the Student Exchange System in Japan. Available at: http://www.mext.go.jp/english/news/2001/05/010501.html/

Miyoshi, K. (2002) ‘Utilization of Program Theory Matrix for Improving the Usefulness of Evaluation Analysis’ , Japanese Journal of Evaluation Studies 2(1): 11-27 (in Japanese).

10.

National Economic and Social Development Board (1991) The Seventh National Economic and Social Development Plan (1992-1996). Bangkok: National Economic and Social Development Board .

11.

National Economic and Social Development Board (1996) The Eighth National Economic and Social Development Plan (1997-2001). Bangkok: National Economic and Social Development Board .

12.

OECD (1991) The DAC Principles for the Evaluation of Development Assistance. Paris: OECD .

13.

Pawson, R. (2003) ‘Nothing as Practical as a Good Theory’ , Evaluation 9(4): 471-490 .

14.

Pornavalai, S. (1995) ‘Tai no Kogyoka to Nikkei kigyo’ (Industrialization of Thailand and Japanese Capital Companies), in Y. Ogawa (ed.) Tai no Kogyoka to Shakai no Henyo(Industrialization of Thailand and Social Change), pp. 37-54. Fukuoka: Kyushu Daigaku Shuppankai .

15.

Sato, Y. (2002a) ‘Impact Study of the Japanese Government Scholarship Policy toward Indonesian Students from the Perspective of Fostering Pro-Japanese Leaders’ , Japanese Journal of Evaluation Studies 2(2): 59-78 (in Japanese).

16.

Sato, Y. (2002b) ‘An Impact of the Japanese Government’s Foreign Student Policy toward Indonesia: From the Perspective of Human Resources Development’ , Journal of International Development Studies 11(2): 59-78 (in Japanese).

17.

Stame, N. (2004) ‘Theory-Based Evaluation and Varieties of Complexity’ , Evaluation 10(1): 58-76 .

18.

UNESCO (1963-98) Statistical Yearbook. Paris: UNESCO Publishing & Bernan Press .

19.

Vedung, E. (2000) Public Policy and Program Evaluation. New Brunswick, NJ: Transaction Publishers ; originally published 1997.

20.

Weiss, C. H. (1998) Evaluation, 2nd edn. Upper Saddle River, NJ: Prentice-Hall .

21.

Yamatani, K. (1997) Seisaku Hyoka no Riron to Sono Tenkai (Theory of Policy Evaluation and its Development). Tokyo: Koyo Shobo .