README

hri_rviz

This package provides a list of rviz2 plugins for human-related data visualisation. It is part of the ROS4HRI ecosystem.

Plugins

Humans

A plugin for visualising 2D information overlayed on a camera stream (ideally, the stream used to detect it). Currently, the plugin can visualise:

• Face bounding boxes

• Face landmarks

• Body bounding boxes

• 2D skeleton keypoints

How to use it

0. If not already available, add a Displays panel;

1. press the Add button at the bottom to istantiate a new plugin;

2. select By topic;

3. among the available topics, select the Humans plugin for the camera stream you are interested in;

4. once created the plugin, select which type of information you want to visualise (face bounging boxes, skeleton landmarks, etc.);

5. enjoy!

Skeletons3D

A plugin for visualising the estimated 3D poses of the detected humans.

How to use it

0. If not already available, add a Displays panel;

1. press the Add button at the bottom to istantiate a new plugin;

2. select By display type;

3. select Skeletons3D;

4. enjoy!

TF_HRI

A plugin for visualising the human-related TF frames. These are higly dynamical, appearing and disappearing in a matter of seconds. Using the classic TF plugin would result in a crowded and chaotic frames visualisation. This plugin:

• looks over the detected faces and bodies;

• only displays the face and bodies TF frames for the currently detected bodies and faces;

• readily remove the TF frames for those bodies and faces that are no more tracked, avoiding the disappearing phase observed in the original TF frame for the non-updated frames. It is possible to select which human frames to visualise among:

• face frames;

• gaze frames;

• body frames;

How to use it

0. If not already available, add a Displays panel;

1. press the Add button at the bottom to istantiate a new plugin;

2. select By display type;

3. select TF_HRI;

4. enjoy!

Test

To test the hri_rviz plugins:

1. Download hri_face_detect and hri_fullbody;

2. build them;

3. start an RGB camera stream;

4. start face and body detection: - ros2 launch hri_face_detect face_detect.launch.py filtering_frame:=<camera_frame> rgb_camera:=<rgb_camera_stream_ns> - ros2 launch hri_fullbody hri_fullbody.launch.py rgb_camera:=<rgb_camera_stream_ns> where <rgb_camera_stream_ns> is the RGB camera stream namespace (e.g., /camera/color). This expects the raw RGB images to be published on <rgb_camera_stream_ns>/image_raw. Check the launch files parameters for different options.

5. start the plugins as previously described.