News
News & blog posts
Vision on the Warehouse Floor: Perceptive HRI for Autonomous Forklifts
September 30, 2026
We present an integrated vision system for autonomous forklifts that combines RGB-only 6D pallet pose estimation with gesture- and face-based...
See, Spawn, Synchronize: A Digital Twin Pipeline for Smart Production Cells
August 28, 2026
We present a digital twin of a smart production cell that synchronizes objects bidirectionally between a real and a virtual...
REMA-Net: Real-Time Human Action Recognition via Caption-Guided Dual-Stream Attention
August 26, 2026
REMA-Net is a lightweight dual-stream framework for real-time human action recognition that pairs RGB visual features with semantic embeddings derived...
SAR-SLAM: Semantic-Aware Recognition for Dynamic SLAM in Robotic Applications
July 20, 2026
SAR-SLAM is an RGB-D SLAM framework that keeps tracking reliable when people and objects move through the scene. It combines...
Intent Recognition in Speech-to-Text Processing in the Context of Natural Interaction with Cognitive Assistive Systems
May 11, 2026
This study investigates efficient speech-to-intent recognition for human–robot interaction in elderly-care environments in German, targeting deployment on resource-constrained platforms such...
GESTRO: Skeleton-Based Dynamic Gesture Recognition for Robot Teleoperation
April 16, 2026
We introduce GESTRO, a dataset of 11 dynamic gestures for the intuitive teleoperation of mobile robots, comprising 3,300 samples recorded...
Deep Learning-Based Gaze Estimation: A Review
March 25, 2026
A comprehensive review of gaze estimation methodologies, tracing the evolution from conventional model- and feature-based approaches to modern deep learning...
Think Like a Team: Graph-Based Representation of Shared Mental Models in Human-Agent Collaboration
March 04, 2026
We introduce a conceptual temporal Shared Mental Model (SMM) that maps changing human-human and human-agent team dynamics using temporal graph...
Automating Synthetic Dataset Generation for Image-based 3D Detection: A Literature Review
October 19, 2025
A comprehensive review of synthetic dataset generation approaches for 3D object detection, covering both traditional 3D modeling and neural image...
Automated 3D Dataset Generation for Arbitrary Objects
October 10, 2025
An end-to-end pipeline that automates all aspects of 3D dataset generation by leveraging Radiance Fields for high-quality 3D modeling and...
A Real-Time Digital Twin Framework for the TIAGo Service Robot
October 05, 2025
We present a real-time digital twin of the TIAGo service robot built in Unity, featuring authentic kinematic mirroring, real-time sensor...
Gaze Matters: Eye Contact Detection in Unscripted Human-Robot Interaction Scenarios
October 05, 2025
We conducted a user study in a realistic collaborative human-robot interaction scenario with unscripted tasks to evaluate how well current...
Robot System Assistant (RoSA): evaluation of touch and speech input modalities for on-site HRI and telerobotics
July 30, 2025
RoSA 3 extends the Robot System Assistant framework with a React-based touchscreen interface and a locally running speech pipeline that...
MobGazeNet: Robust Gaze Estimation Mobile Network Based on Progressive Attention Mechanisms
May 09, 2025
An efficient and lightweight network for gaze estimation that leverages progressive attention mechanisms to emphasize crucial eye features while maintaining...
Multi-Head Attention-Based Framework with Residual Network for Human Action Recognition
May 06, 2025
We propose a novel HAR framework integrating residual networks, Bi-LSTM, and multi-head attention with a motion-based frame selection strategy. It...
IM HERE – Interaction Model for Human Effort-Based Robot Engagement
April 29, 2025
We present IM HERE, a formal effort-based framework for modeling engagement across human–robot, human–human, and robot–robot interaction. It captures relational...
Automating 3D Dataset Generation with Neural Radiance Fields
April 29, 2025
We present a fully automated pipeline that leverages Radiance Field–based universal 3D representations to rapidly generate high-quality models of arbitrary...
Toward Truly Intelligent Autonomous Systems A Taxonomy of LLM Integration for Everyday Automation
April 28, 2025
With the rapid development of large language models (LLMs), their integration into autonomous systems has become essential. This integration significantly...
Eye Contact Based Engagement Prediction for Efficient Human-Robot Interaction
April 28, 2025
We introduce a new approach to predict human engagement in human-robot interactions (HRI), focusing on eye contact and distance information....
Mobile Robot Navigation with Enhanced 2D Mapping and Multi-Sensor Fusion
April 10, 2025
We propose an enhanced SLAM framework that combines RGB-D and 2D LiDAR data using late fusion and adaptive resampling for...
Fine-grained gaze estimation based on the combination of regression and classification losses
September 03, 2024
We present our recent work on gaze estimation. Our approach is a novel two-branch CNN architecture with a multi-loss approach...