NITEC: Versatile Hand-Annotated Eye Contact Dataset for Ego-Vision Interaction

NITEC: Versatile Hand-Annotated Eye Contact Dataset for Ego-Vision Interaction

Eye contact is a crucial non-verbal interaction modality and plays an important role in our everyday social life. While humans are very sensitive to eye contact, the capabilities of machines to capture a person’s gaze are still mediocre. We tackle this challenge and present NITEC, a hand-annotated eye contact dataset for ego-vision interaction. NITEC exceeds existing datasets for ego-vision eye contact in size and variety of demographics, social contexts, and lighting conditions, making it a valuable resource for advancing ego-vision-based eye contact research. Our extensive evaluations on NITEC demonstrate strong cross-dataset performance, emphasizing its effectiveness and adaptability in various scenarios, that allows seamless utilization to the fields of computer vision, humancomputer interaction, and social robotics. We make our NITEC dataset publicly available to foster reproducibility and further exploration in the field of ego-vision interaction.

Dataset: https://github.com/thohemp/nitec

Fulltext Access

https://openaccess.thecvf.com/content/WACV2024/papers/Hempel_NITEC_Versatile_Hand-Annotated_Eye_Contact_Dataset_for_Ego-Vision_Interaction_WACV_2024_paper.pdf

Citing

@inproceedings{hempel2024nitec,
  title={Nitec: Versatile hand-annotated eye contact dataset for ego-vision interaction},
  author={Hempel, Thorsten and Jung, Magnus and Abdelrahman, Ahmed A and Al-Hamadi, Ayoub},
  booktitle={Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision},
  pages={4437--4446},
  year={2024}
}