• Affiliated to IEEE PerCom 2021
  • March 22 – 26, 2020 (full day, date TBA)
  • Kassel, Germany

Labelling user data is a central part of the design and evaluation of pervasive systems that aim to support the user through situation-aware reasoning. It is essential both in designing and training the system to recognise and reason about the situation, either through the definition of a suitable situation model in knowledge-driven applications, or though the preparation of training data for learning tasks in data-driven models. Hence, the quality of annotations can have a significant impact on the performance of the derived systems. Labelling is also vital for validating and quantifying the performance of applications. With pervasive systems relying increasingly on large datasets for designing and testing models of users’ activities, the process of data labelling is becoming a major concern for the community. Even more, with the increase of pervasive applications relying on annotated data, it becomes important to develop standards and normalisation methodologies for transferability of annotated data across different applications.

To address the problem, this year’s workshop focuses on methods for standardisation and normalisation in annotation practices and possible roadmaps and good practices in addressing the associated challenges.

Furthermore, we aim to address the general problems of

  1. the role and impact of annotations in designing pervasive applications,
  2. the process of labelling, and the requirements to produce high quality annotations for diverse settings and tasks, and
  3. innovative tools, interfaces and automated methods for annotating user data.

The goal of the workshop is to bring these topics to the attention of researchers from interdisciplinary backgrounds, and to initiate a reflection on possible resolutions of the related problems.

Important dates:

Submission deadline: November 09, 2020

Notification: January 05, 2021

Camera ready version: approximately January 31, 2021 (TBC)

Author registration due by: approximately January 12, 2021 (TBC)