Integrating online behavioral data and questionnaires in TEL research

Integrating online behavioral data and questionnaires in TEL research

Friday 27/05 14:00-15:30h

Outdoor Area B

—

Friday 27/05 16:00-17:30h

Outdoor Area B

Abstract

Many researchers in the field of TEL use behavioral indicators from learning management systems such as Moodle and MOOCs’ platforms to identify patterns of online learning behavior using diverse techniques of educational data mining and learning analytics. Other researchers use questionnaires at the beginning, during, and at the end of the learning process to identify characteristics of the learners such as their demographical characteristics, attitudes, personality, and learning outcomes. Yet, the research literature lacks research that integrates the two methods. Integrating the two methods helps us to understand the full picture. Combining the two methods enable researchers to follow the learners` trajectories, identify pre-dispositional attitudes, follow unobtrusively the learning behavior, and identify subjective attitudes and feelings at the end of the course. At the workshop, we will identify the pros and cons of each method and discuss the ways to integrate the two methods to enjoy the advantages of each one of them. The participants at the workshop will have the opportunity to learn about each method, integrate them, and think about how they can expand their research by using several data collection methods.

Needs Analysis

The workshop is suggested in order to help Ph.D. candidates in TEL to develop their methodological skills. The workshop will raise awareness and teach about two basic quantitative methods of data collection – behavioral data and questionnaires. Those two methods are highly popular and useful in TEL research. Since Ph.D. candidates in TEL come from diverse disciplines they might lack the knowledge regarding ways to collect quantitative data or they are familiar with only one of the methods. In the workshop we will discuss how to use the two methods, what are the advantages and disadvantages of each method, and how to integrate them. The suggested workshop will help the students to broaden their methodological knowledge and raise their awareness of the different possibilities of conducting quantitative research. Special attention will be paid during the workshop to help each student to think about how he or she can use these methods during his or her research.

Learning Objectives

During the workshop, the participants will learn the basic principles of data collection of digital behavioral data and questionnaires. The participants will learn the advantages and disadvantages of each method while using it seperatly. Afterward, the participants will learn how to integrate the two methods for TEL research and will know the pros and cons of integrating behavioral data with self-report data. The participants will be encouraged to think about how they can implement the material studied in their own studies.

Pre-activities

The workshop won`t require prior knowledge regarding quantitative research methods. The participants will get a list of reading materials to in-deep their knowledge regarding quantitative research methods, collecting and using behavioral data and self-report data in the TEL domain, and examples of research that integrated the two methods.

Session Description

The session will start with a theoretical presentation that will expose the learners to the study topics of the workshop. In the first part, the participants will learn the basic principles of data collection using behavioral data and questionnaires. The participants will learn about the pros and cons of each data collection method and will understand why and how to integrate digital behavioral data collection with questionnaires. In the second part of the workshop, the participants will critically consider in groups how they can integrate the quantitative tools in their research.

Post-activities

The participants will be able to in-depth their knowledge regarding research methods and statistics using diverse resources. I will provide the participants with a list of resources at the end of the activity regarding research methods, statistics, and relevant software for conducting the analyses.