-
The OECD’s new Teaching and Learning International Survey (TALIS) has been designed to provide data and analyses on the conditions needed for effective teaching and learning in schools. As the first international survey with this focus, it seeks to fill important information gaps that have been identified at the national and international levels.
-
-
This chapter offers an overview of the OECD Teaching and Learning International Survey (TALIS) and summarises the survey’s main features and objectives. It introduces the main stakeholders in the management and implementation of TALIS and their responsibilities, discusses standardised procedures used for the data collection and analyses and outlines the survey’s milestones, beginning with the pilot study in 2006.
-
This chapter presents the rationale and aims of TALIS, as well as the design of the TALIS survey programme, which was conceptualised as a cycle of surveys, the first of which was conducted in 2007-08 and is the focus of this report. The chapter presents the conceptual and analytical frameworks that shaped the development of the programme and offers an overview of the policy issues and indicators considered and chosen for the first TALIS cycle.
-
In order to establish goals for the development of the teacher and principal questionnaires, the TALIS Board of Participating Countries (BPC) conducted a priority rating exercise (see Chapter 2). To translate these goals into survey analysis plans and survey questionnaires (i.e. the Teacher and Principal Questionnaires), an Instrument Development Expert Group (IDEG) was established in conjunction with the BPC. This chapter explains in detail the frameworks guiding the questionnaire development for each of the main themes covered by the first TALIS survey: teacher background characteristics and professional development; principal and school background characteristics; school leadership and management; appraisal of and feedback to teachers; and teaching practices, attitudes and beliefs.
-
This chapter details the rigorous approach taken to ensure an accurate and appropriate translation and cultural adaptation of the TALIS survey instruments. Each version of the TALIS questionnaires was subject to a stringent translation procedure and layout verification process prior to both the field trial and the main survey. The chapter explains the rationale for this strict system and describes the responsibilities of the various parties involved in the processes, including the IEA Secretariat, Instrument Development Expert Group, National Project Managers and independent language experts, translators and linguistic verifiers.
-
This chapter offers an overview of the international sampling plan prepared for the participants in TALIS, including the international sampling strategy and sample size. Appendix B presents the characteristics of each national sampling plan. Strategies for estimating population characteristics and their sampling error are covered in detail in Chapter 9. This chapter deals primarily with the TALIS “core survey” of ISCED Level 2 teachers.
-
This chapter focuses on the survey operation procedures implemented for TALIS, including the materials and software that the International Study Centre (ISC) provided to all National Project Managers (NPMs). Other tasks of the NPMs as well as the three phases of the survey were explained in more detail in Chapter 1of this report. The International Association for the Evaluation of Educational Achievement Data Processing Center (IEA DPC) had developed a series software packages for previous IEA surveys, and adapted them to fit the needs of TALIS. The chapter concludes with an explanation of the quality control checks at different levels which ensure the high quality of the TALIS data.
-
This chapter discusses the on line and electronically delivered questionnaires that have become an increasingly useful option for international large-scale sample surveys and assessments. TALIS offered on line data collection (ODC) with a mixed-mode design as an international option: countries could use the option as a default means to collect data for all schools and respondents, selected schools only or a particular population, i.e. school principals or teachers. This chapter provides information on the design, operations, technical solutions, field trial, main study and on line data collection processes.
-
This chapter explores the quality control programme prepared for administering TALIS. It discusses the standardised procedures taken for survey preparation, administration and data entry in order to ensure a high quality collection and processing of TALIS data. Quality control in TALIS comprised three parts: organisation and oversight by the IEA Secretariat of an international programme of school and national centre visits by International Quality Control Monitors (IQCMs); a national quality control programme of school visits operated by National Project Managers; and a follow-up on line Survey Activities Questionnaire seeking experiential information from the National Project Managers.
-
This chapter offers an overview of the strategy used to create the TALIS 2008 international database (IDB). It describes the data entry and verification tasks employed by the national centres, the integration of data from the paper and online administration modes, the dataediting and database creation procedures implemented by the International Study Centre, and the steps that all involved centres took to confirm the integrity of the international database.
-
This chapter covers three important aspects of the quality of the TALIS outcomes: weighting of the data to produce estimates, participation rates and an estimation of the sampling error. It begins by detailing how each component of the final estimation weight is defined and how those components are assembled into the final estimation weight, before describing participation rates and how they were computed.
-
This chapter outlines the design and validation of scales and indices in TALIS. The TALIS questionnaires were comprised of many items; while some were intended to be used in single item analyses, others were intended to be combined to measure latent constructs. This chapter explains how simple indices were constructed, describes the methodology used for construct validation and scaling and finally details the construction, validation, and computation of each scaled index and its characteristics.
-
At the ISC Mr. Dirk Hastedt and Dr. Steffen Knoll acted as co-directors of TALIS. Mr. Hastedt was responsible for the overall budget, contractual agreements and consulting, while Dr. Knoll took care of the international schedules, co-ordinating the consortium and the internal budget. As study co-ordinator Ms. Friederike Westphal maintained close contact with the National Project Managers (NPMs) and co-ordinated the survey administration at the international level. Mr. Ralph Carstens acted as director of data management and was involved in the analysis of the TALIS data. As deputy data manager Ms. Alena Becker was responsible for the everyday business of data processing in co-operation with the national data managers.
-
-
-