Person tracking system using multi-sensor fusion (laser-based leg detection + YOLO vision) with the cs4home architecture prototype.
cd ~/ros2_ws/src
git clone https://github.com/CoreSenseEU/cs4home_vision_module.git
vcs import --recursive < cs4home_vision_module/thirparty.repos
cd ~/ros2_ws
colcon buildros2 launch yolo_bringup yolo.launch.pyConfigure and activate the YOLO nodes:
ros2 lifecycle set /yolo_node configure
ros2 lifecycle set /yolo_node activate
ros2 lifecycle set /yolo_3d_node configure
ros2 lifecycle set /yolo_3d_node activateYou need to have the map transform available. Either:
- Launch your navigation stack, or
- Change
target_frame_inPersonTrackerCore.cppfrom"map"to"base_link"or your preferred frame
Follow the instructions from the UPO Laser People Detector repository.
Run the laser model node (adjust paths and topic names for your setup):
ros2 run upo_laser_people_detector lasermodelnode --ros-args \
-p model_file:=/home/juan/Downloads/LFE-PPN.onnx \
-p laser_topic:=/scan_rawNote: Replace /home/juan/Downloads/LFE-PPN.onnx with your actual model file path and /scan_raw with your laser topic.
ros2 launch cs4home_person_tracker person_tracker.launch.pyConfigure and activate the person_tracker cognitive module:
ros2 lifecycle set /person_tracker configure
ros2 lifecycle set /person_tracker activateThe configuration for the person tracker cognitive module is located in the package's config directory.