LiHRA: A LiDAR-Based HRI Dataset for Automated Risk Monitoring Methods

Frederik Plahl1,2, Georgios Katranis2, Ilshat Mamaev1, Andrey Morozov2
1Proximity Robotics & Automation GmbH, 2University of Stuttgart - Institute of Industrial Automation and Software Engineering

Abstract

We present LiHRA, a novel dataset designed to facilitate the development of automated, learning-based, or classical risk monitoring (RM) methods for Human-Robot Interaction (HRI) scenarios. The growing prevalence of collaborative robots in industrial environments has increased the need for reliable safety systems. However, the lack of high-quality datasets that capture realistic human-robot interactions, including potentially dangerous events, slows development. LiHRA addresses this challenge by providing a comprehensive, multi-modal dataset combining 3D LiDAR point clouds, human body keypoints, and robot joint states, capturing the complete spatial and dynamic context of human-robot collaboration. This combination of modalities allows for precise tracking of human movement, robot actions, and environmental conditions, enabling accurate RM during collaborative tasks. The LiHRA dataset covers six representative HRI scenarios involving collaborative and coexistent tasks, object handovers, and surface polishing, with safe and hazardous versions of each scenario. In total, the data set includes 4,431 labeled point clouds recorded at 10 Hz, providing a rich resource for training and benchmarking classical and AI-driven RM algorithms. Finally, to demonstrate LiHRA's utility, we introduce an RM method that quantifies the risk level in each scenario over time. This method leverages contextual information, including robot states and the dynamic model of the robot. With its combination of high-resolution LiDAR data, precise human tracking, robot state data, and realistic collision events, LiHRA offers an essential foundation for future research into real-time RM and adaptive safety strategies in human-robot workspaces.

Video

The LiHRA Dataset

LiHRA is a novel LiDAR-based dataset designed for automated Risk Monitoring (RM) in Human-Robot Interaction (HRI). It provides 3D LiDAR point clouds, human keypoints, and robot joint states, capturing real-world HRI dynamics. The dataset includes safety-critical scenarios, such as object handovers and shared workspace interactions, featuring both intentional contacts and unintentional collisions to support risk monitoring and mitigation research.

Please note that the dataset is provided for research purposes only and should not be used for commercial purposes.

Dataset

  • 6 Scenarios
    • Collaboration (Dangerous, Non-Dangerous)
    • Object Handover (Dangerous, Non-Dangerous)
    • Coexistence (Dangerous, Non-Dangerous)
  • 4,431 Point Clouds
  • Robot Joint States
  • Robot ROS 2 tf-Frames
  • Human Keypoints as ROS 2 tf-Frames

Hardware

  • Seyond Falcon Kinetic LiDAR
  • Franka Emika Robot (FER)
  • HTC VIVE Tracker 3.0

Annotations

  • 5 Human Keypoints
  • Robot Joint States

BibTeX

@inproceedings{plahl2025lihra,
  author = {Plahl,  Frederik and Katranis,  Georgios and Mamaev,  Ilshat and Morozov,  Andrey},
  title = {{LiHRA}: {A} {LiDAR-Based} {HRI} {D}ataset for {A}utomated {R}isk {M}onitoring {M}ethods},
  booktitle={2025 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)},
  year = {2025},
  pages={6351-6357},
  doi={10.1109/IROS60139.2025.11245888}
}