During the two days we worked in two different formats. In addition to the classic sessions with plenary lectures, we had sessions with an impulse talk to stimulate the following small group work on a specific topic.

Wednesday 17 June 2020

Day One


Title Speaker
Using log data – Related challenges, desiderata, and motivation for this workshop Frank Goldhammer (DIPF/ZIB) & Dirk Hastedt (IEA)

Opening Keynote

Title Speaker
Process Data Research and some Examples from TIMSS Matthias von Davier (Boston College), Ina Mullis and Mick Martin

Concepts and Constructs

Title Speaker
The Benefits of Process Data Analysis for a Better Understanding of Complex Psychological Constructs Samuel Greiff (University of Luxembourg)
Validation and Applications of Rapid Guessing to Detect Test Taker Disengagement Steven L. Wise (nwea)
Using Log-file Based Process Measures as Indicators of Task Engagement in Digital Reading: Perspectives and Problems. Johannes Naumann (University of Wuppertal)

Data Management

Title Speaker
Preprocessing of log-file data: Adapting familiar routines to unfamiliar data Heiko Sibberns (IEA) & Ulf Kroehne (DIPF)
Small Group Work  

Closing Keynote Day One

Title Speaker
Using Paradata to Evaluate Online Performance Frauke Kreuter (University of Maryland)

Virtual Social Event

Title Performance
Take Love Easy Stefanie Hoevel & Martin Lejeune

Thursday 18 June 2020

Day Two

Log-data and Items Documentation

Title Speaker
Advances and Challenges in Logging Documentation for Educational Assessments Qiwei He (ETS)
Small Group Work  

Data Protection and Anonymization

Title Speaker
Privacy and Process-data: Lessons learned from Trusted Learning Analytics Hendrik Drachsler (DIPF)

Extraction Approaches and Tools

Title Speaker
LOGAN—An R Package for Log-file Analysis in International Large-Scale Assessments Denise Reis Costa (CEMO) & Ronny Scherer (CEMO)
Addressing the Challenges From Response Process Data: glassPy Data Analytics Solution and its Applications at Educational Testing Service Jiangang Hao (ETS)
Experience with Log-data Analysis and the Use of Big Data Technologies in Large-Scale Assessment in France Saskia Keskpaik (French Ministry of Education)
Processing and Analyzing PIAAC log files with the PIAAC LogDataAnalyzer (LDA) Carolin Hahnel (DIPF/ZIB)
Tools for Analyzing Log File Data Ulf Kroehne (DIPF)

Closing Keynote

Title Speaker
Using Computer-Based Process Data to Improve Assessment Validity: Challenges and Opportunities Stephen Sireci (University of Massachusetts Amherst)
Wrap up Frank Goldhammer (DIPF/ZIB) & Dirk Hastedt (IEA)

Friday 19 June 2020

Hands-on Training

Title Speaker
Analysis of Log-File Data using LogFSM and R Ulf Kroehne (DIPF)