ETEC 565A: Understanding Learning Analytics

Description


Learning analytics (LA) is a significant area of technology-enhanced learning that has emerged during the last decade. It is a fast-growing area of educational technology research, with roots in a variety of fields, particularly business intelligence, web analytics, educational data mining and recommender systems. In recent years there has been a growing interest in moving from research to practice, and in implementing analytics to support learning and teaching. Contemporary educators and educational technology specialists need to be able to understand and think critically about the possible advantages and disadvantages of LA in different contexts. This course is not intended to teach MET students to become sophisticated data scientists, even though we may undertake some simple data exploration for learning purposes. Instead, it will be aimed at a scholar practitioner audience, and will investigate LA in the context of other data-focused approaches to educational change.

In this course, we will consider definitions of analytics, explore different LA approaches and methods, examine implementation challenges, and think critically about the range of diverse LA tools and claims that already exist. A particular focus will be on asking you to relate LA to your own practice of teaching and learning, and to existing educational theories and research. What do we mean by ‘learning analytics’? What data is used? How are the data manipulated? Can we trust what learning analytics tell us about our learners or our courses? Are there ethical issues we should consider before undertaking such data analyses? And which tools might be more or less useful for analysing data in meaningful ways?

A number of learning analytics tools will be integrated into this Canvas-based course that will allow you to view and analyze ‘your own data’ as the course progresses, as examples of the kind of learning data generated by learning technologies. Later, in the ‘choose your own adventure’ section of this course, you may choose to undertake some data analysis activities using available tools such as Gephi (for social network analysis) and Tableau/Tableau Prep for simple data visualization. Alternatively, you may choose to focus on current findings in the LA literature, ethical dilemmas, implementation frameworks, or other relevant social or institutional aspects of learning analytics research and practice.

All learning activities in this course are related to its major goals:

  • Understand how and why the field of learning analytics has developed.
  • Consider who the stakeholders are in learning analytics, and the different purposes for which learning analytics might be employed.
  • Investigate current learning analytics processes and tools, and consider the claims made about their utility and value and relation to learners and learning.
  • Examine real ‘teaching and learning data’
  • Investigate ethical dilemmas that related to the use of learning analytics and learning data.
  • Gain some hands on experience in analyzing, interpreting and developing usable actions from teaching and learning data.

Learning Objectives

After completing ETEC 565A, you will be able to:

  • Speak to and investigate the origins of the field of learning analytics.
  • Evaluate learning analytics tools appropriate to your context, as preparation for possible adoption.
    • Apply critical thinking skills to learning analytics claims and publications.
    • Make a balanced risk-benefit assessment of a learning analytics tool or method.
  • Strategically plan the implementation of LA within your context, including rallying interested parties, being aware of institutional cultures and potential barriers and needs.
  • Propose methods of LA and approaches that will benefit you and your learners by providing insights and intelligence in your own educational context.

Activities

This course will require you to complete assigned readings, watch assigned videos, investigate the learning analytics literature, complete activities (‘Tasks’) and assignments, and engage with your classmates, survey and critically assess current ‘learning analytics’ tools being marketed by technology vendors, experiment with analysis and interpretation of simple course generated learning analytics, and respond to other students’ questions and comments.

Discussion Forums will be used extensively to support idea sharing, exchange and collaboration on assignments. There will be numerous opportunities in every module to share understandings in discussion forums, and you are expected to engage in scholarly discussion on the topics under study, regardless of whether the activity is ‘graded’. While most discussions are not formally assessed, your substantive and thoughtful participation is expected.

Readings & Resources

All course materials will be available online via the Library Online Course Reserve (LOCR) linked to the course navigation menu, and/or from hyperlinks to freely available videos and articles online.

Core resources

The following two texts are core resources, and numerous extracts from these texts are required throughout the course. Both are available online.

  • Sclater, N. (2017). Learning Analytics Explained. New York, USA: Taylor & Francis. [LOCR]
  • Lang, Siemens, Wise & Gašević (Eds.) (2017). Handbook of Learning Analytics– First edition. SoLAR.

Examples of other required and recommended resources

Assignments & Assessment

Assessed work in this course comprises seven small ‘Tasks’ and two major ‘Assignments’. Tasks are short applied activities closely aligned to module content. Assignments are larger reports that synthesize your learning and independent study.

Task 1: Explore Canvas analytics 6%
Task 2: Analytics in your own teaching or learning context 6%
Task 3: Get your hands dirty: Explore some real data 6%
Task 4: Pedagogy-driven analytics questions for your local educational context 6%
Task 5: An institutional policy on ethical use of student data for learning analytics 6%
Task 6: Advising on LA implementation 6%
Task 7: Share a video tour summary of your LA adventure 6%
Assignment 1: Evaluation of an LA tool 18%
Assignment 2: Choose your own LA adventure 40%