-
 
No version for distro humble. Known supported distros are highlighted in the buttons above.
No version for distro jazzy. Known supported distros are highlighted in the buttons above.
No version for distro rolling. Known supported distros are highlighted in the buttons above.

video_stream_opencv package from video_stream_opencv repo

video_stream_opencv

Package Summary

Tags No category tags.
Version 1.1.6
License BSD
Build type CATKIN
Use RECOMMENDED

Repository Summary

Checkout URI https://github.com/ros-drivers/video_stream_opencv.git
VCS Type git
VCS Version master
Last Updated 2021-04-13
Dev Status MAINTAINED
CI status
Released RELEASED
Tags No category tags.
Contributing Help Wanted (0)
Good First Issues (0)
Pull Requests to Review (0)

Package Description

The video_stream_opencv package contains a node to publish a video stream (the protocols that opencv supports are supported, including rtsp, webcams on /dev/video and video files) in ROS image topics, it supports camera info and basic image flipping (horizontal, vertical or both) capabilities, also adjusting publishing rate.

Additional Links

Maintainers

  • Sammy Pfeiffer

Authors

  • Sammy Pfeiffer

video_stream_opencv

A package to view video streams based on the OpenCV VideoCapture module, easy way to publish on a ROS Image topic (including camera info) usb cams, ethernet cameras, video streams or video files. It also supports flipping of images and fps throttling.

Screenshot of the plugin working with a webcam, video stream and video file

Example usages in launch folder (only the argument video_stream_provider is mandatory):

<launch>
   <!-- launch video stream -->
   <include file="$(find video_stream_opencv)/launch/camera.launch" >
        <!-- node name and ros graph name -->
        <arg name="camera_name" value="webcam" />
        <!-- means video device 0, /dev/video0 -->
        <arg name="video_stream_provider" value="0" />
        <!-- set camera fps to (if the device allows) -->
        <arg name="set_camera_fps" value="30"/>
        <!-- set buffer queue size of frame capturing to -->
        <arg name="buffer_queue_size" value="100" />
        <!-- throttling the publishing of frames to -->
        <arg name="fps" value="30" />
        <!-- setting frame_id -->
        <arg name="frame_id" value="webcam" />
        <!-- camera info loading, take care as it needs the "file:///" at the start , e.g.:
        "file:///$(find your_camera_package)/config/your_camera.yaml" -->
        <arg name="camera_info_url" value="" />
        <!-- flip the image horizontally (mirror it) -->
        <arg name="flip_horizontal" value="false" />
        <!-- flip the image vertically -->
        <arg name="flip_vertical" value="false" />
        <!-- force a width and height, 0 means no forcing -->
        <arg name="width" value="640"/>
        <arg name="height" value="480"/>
        <!-- visualize on an image_view window the stream generated -->
        <arg name="visualize" value="true" />
   </include>
</launch>

Based on the ROS tutorial to convert opencv images to ROS messages.

Usability

You can use any input that OpenCV on your system accepts, e.g.:

  • Video devices that appear in linux as /dev/videoX, e.g.: USB webcams appearing as /dev/video0

  • Video streamings, e.g.: rtsp://wowzaec2demo.streamlock.net/vod/mp4:BigBuckBunny_115k.mov

  • Video files, anything you can play, e.g.: myvideo.avi

  • Etc.

Parameters

Note these important ones on the behaviour of the node:

  • set_camera_fps: Will set the OpenCV parameter CV_CAP_PROP_FPS to that amount of fps, if the camera allows it. Does nothing on video streams or video files.

  • buffer_queue_size: Will set the size of the buffer of images read from the capturing device. We read as fast as possible (in another thread) from the device and store in the buffer the images. The main thread consumes from the buffer. If you want the shortest delay/lag set it to 1. If you don’t want to lose images set it higher.

  • fps: The effective rate at which you want the image topic to publish, if lower than the effective fps of the camera it will throttle the publication dropping frames when needed.

So if you want the very latest image published from a camera, set buffer_queue_size to 1, set_camera_fps to the max the camera allows and fps to that same max.

If you want to publish all images (don’t drop any and you don’t mind some possible delay from real time), set buffer_queue_size big enough for your case (1000?), set_camera_fps and fps to whatever FPS it has.

The rest of the parameters explained, even though they are pretty self explanatory:

  • camera_name: node name and ros graph name. All topics will hang from this e.g.: /camera_name/.
  • video_stream_provider: A number for the /dev/videoX device, e.g.: 0 for /dev/video0. A string for a path for a video file, e.g.: /home/user/Videos/myvideo.avi or a url of a video stream e.g.: rtsp://wowzaec2demo.streamlock.net/vod/mp4:BigBuckBunny_115k.mov and http://10.68.0.6/mjpg/video.mjpg.
  • frame_id: frame_id to be published in the Header of the messages.
  • camera_info_url: camera info loading, take care as it needs the “file:///” at the start , e.g.: "file:///$(find your_camera_package)/config/your_camera.yaml".
  • flip_horizontal: flip horizontally the image (mirror it).
  • flip_vertical: flip vertically the image (upside down).
  • loop_videofile: if the provider is a video file, enable loop playback.
  • width and height: force a width and height to the capturing device (if it allows), 0 means no forcing.
  • start_frame: if the provider is a video file, set the start frame of video.
  • stop_frame: if the provider is a video file, set the stop frame of video. -1 means the end of the video. Also setting stop_frame = start_frame + 1 can publish a single frame with a certain rate.

Extras

In the scripts folder you’ll find test_video_resource.py which you can use to test if your system installation can use this node to open your video stream (not using any ROS, just copy the file to your computer and try). Just do any of those:

./test_video_resource.py 0
./test_video_resource.py rtsp://wowzaec2demo.streamlock.net/vod/mp4:BigBuckBunny_115k.mov
./test_video_resource.py /home/youruser/myvideo.mkv

And you’ll see an output like:

Trying to open resource: /dev/video0
Correctly opened resource, starting to show feed.

With an OpenCV image show window showing the stream (which should close when pressing ESC, or Control+C the shell).

CHANGELOG

Changelog for package video_stream_opencv

1.1.6 (2020-12-08)

  • #67 Deal better with looping on a video file and the start and stop frame selection
  • #77 Noticed the default camera info was actually wrong, corrected
  • #69 Get canonical file for target device and give a warning if we convert to a canonical path
  • Fix typo when moving log to debug
  • #57 Enable to select the start and stop points for playing video file.
  • Avoid the excess of [start_frame]{.title-ref} compared to [stop_frame]{.title-ref} for playing video file.
  • #55 Add title and travis badge
  • #54 Enable testing on melodic
  • Add linesep for each mp jpeg
  • #53 Upgrade to OpenCV 4
  • #52 video_stream: fix disconnect callbacks never being called
  • Video_stream: make sure to always increase suscriber count
  • #50 Add option to set output_encoding
  • Add link to cv_bridge::cvtColor
  • Add config to set output_encoding
  • #49 Use variable config instead of class properties
  • #51 install with source permissions, install small.mp4, install test directory to enable testing in catkin install space
  • #45 libvideo_stream_opencv now depends on gencfg
  • #44 Don't download test data on source directory
  • #43 Add option to re-open camera device on read failure
  • #39 Add dependency for gencfg
  • #37 Support camera property settings on dynamic reconfigure
  • #36 Fix bugs for thread initialization/deinitialization
  • #34 Support changing parameter by using dynamic reconfigure
  • Add dependencies for test
  • Support dynamic_reconfigure
  • #33 Convert video_stream node to nodelet, use nodelet for video_stream
  • #31 Do not flip old image multiple times, closes #30
  • #35 Enable CI
  • Contributors: Alexander Rössler, GITAI, Leonardo Lai, Michael Sobrepera, Ryohei Ueda, Sam Pfeiffer, Sammy Pfeiffer, Yuki Furuta, moju zhao

1.1.5 (2018-12-14)

  • Exit the program if we reach the end of the video when playing a video file (Issue #23)
  • Throw exception when a frame cant be captured (Issue #23, PR #27)
  • Add loop_video parameter for videofiles (PR #24)
  • Contributors: Sammy Pfeiffer, iory

1.1.4 (2018-07-23)

  • Fix bug, cv::Mat needs to be cloned otherwise all entries in the queue will point to the same frame. This resulted in always returning the last received frame.
  • Contributors: Axel13fr

1.1.3 (2018-07-11)

  • Fixing ever growing memory when using boost::sync_queue (Issue #20) by reimplementing thread safety of frames queue using std classes. boost::sync_queue is buggy (keeps on allocating memory over time).
  • Contributors: Axel13fr

1.1.2 (2018-06-12)

  • Fix empty frame id in camera info header when providing a calibration file.
  • Contributors: tim-fan

1.1.1 (2018-04-20)

  • Fix error of using camera_name instead of identifying the type of the provider to check when the provider is a video file, and act accordingly in the producer thread
  • Prevent locking when ROS SIGINT arrives and the image queue is empty.
  • Added rate limiting to camera_fps_rate also if videofile is used as input
  • Contributors: Andrea Ranieri, Avio, Sam Pfeiffer, Sammy Pfeiffer

1.1.0 (2018-03-23)

  • Update to use thread to read. Update to new parameters. Update description.
  • Fixed image flip bug, the flip implementation is inconsistent with OpenCV API.
  • Contributors: Sammy Pfeiffer, Zihan Chen, kantengri

1.0.2 (2016-11-14)

1.0.1 (2016-11-14)

  • Releasable version
  • Contributors: Sammy Pfeiffer, Stefano Probst, Wiebe Van Ranst

Wiki Tutorials

This package does not provide any links to tutorials in it's rosindex metadata. You can check on the ROS Wiki Tutorials page for the package.

Dependant Packages

Name Deps
eus_teleop

Launch files

Messages

No message files found.

Services

No service files found

Plugins

Recent questions tagged video_stream_opencv at Robotics Stack Exchange

No version for distro ardent. Known supported distros are highlighted in the buttons above.
No version for distro bouncy. Known supported distros are highlighted in the buttons above.
No version for distro crystal. Known supported distros are highlighted in the buttons above.
No version for distro eloquent. Known supported distros are highlighted in the buttons above.
No version for distro dashing. Known supported distros are highlighted in the buttons above.
No version for distro galactic. Known supported distros are highlighted in the buttons above.
No version for distro foxy. Known supported distros are highlighted in the buttons above.
No version for distro iron. Known supported distros are highlighted in the buttons above.

video_stream_opencv package from video_stream_opencv repo

video_stream_opencv

Package Summary

Tags No category tags.
Version 1.1.6
License BSD
Build type CATKIN
Use RECOMMENDED

Repository Summary

Checkout URI https://github.com/ros-drivers/video_stream_opencv.git
VCS Type git
VCS Version master
Last Updated 2021-04-13
Dev Status MAINTAINED
CI status Continuous Integration
Released RELEASED
Tags No category tags.
Contributing Help Wanted (0)
Good First Issues (0)
Pull Requests to Review (0)

Package Description

The video_stream_opencv package contains a node to publish a video stream (the protocols that opencv supports are supported, including rtsp, webcams on /dev/video and video files) in ROS image topics, it supports camera info and basic image flipping (horizontal, vertical or both) capabilities, also adjusting publishing rate.

Additional Links

Maintainers

  • Sammy Pfeiffer

Authors

  • Sammy Pfeiffer

video_stream_opencv

A package to view video streams based on the OpenCV VideoCapture module, easy way to publish on a ROS Image topic (including camera info) usb cams, ethernet cameras, video streams or video files. It also supports flipping of images and fps throttling.

Screenshot of the plugin working with a webcam, video stream and video file

Example usages in launch folder (only the argument video_stream_provider is mandatory):

<launch>
   <!-- launch video stream -->
   <include file="$(find video_stream_opencv)/launch/camera.launch" >
        <!-- node name and ros graph name -->
        <arg name="camera_name" value="webcam" />
        <!-- means video device 0, /dev/video0 -->
        <arg name="video_stream_provider" value="0" />
        <!-- set camera fps to (if the device allows) -->
        <arg name="set_camera_fps" value="30"/>
        <!-- set buffer queue size of frame capturing to -->
        <arg name="buffer_queue_size" value="100" />
        <!-- throttling the publishing of frames to -->
        <arg name="fps" value="30" />
        <!-- setting frame_id -->
        <arg name="frame_id" value="webcam" />
        <!-- camera info loading, take care as it needs the "file:///" at the start , e.g.:
        "file:///$(find your_camera_package)/config/your_camera.yaml" -->
        <arg name="camera_info_url" value="" />
        <!-- flip the image horizontally (mirror it) -->
        <arg name="flip_horizontal" value="false" />
        <!-- flip the image vertically -->
        <arg name="flip_vertical" value="false" />
        <!-- force a width and height, 0 means no forcing -->
        <arg name="width" value="640"/>
        <arg name="height" value="480"/>
        <!-- visualize on an image_view window the stream generated -->
        <arg name="visualize" value="true" />
   </include>
</launch>

Based on the ROS tutorial to convert opencv images to ROS messages.

Usability

You can use any input that OpenCV on your system accepts, e.g.:

  • Video devices that appear in linux as /dev/videoX, e.g.: USB webcams appearing as /dev/video0

  • Video streamings, e.g.: rtsp://wowzaec2demo.streamlock.net/vod/mp4:BigBuckBunny_115k.mov

  • Video files, anything you can play, e.g.: myvideo.avi

  • Etc.

Parameters

Note these important ones on the behaviour of the node:

  • set_camera_fps: Will set the OpenCV parameter CV_CAP_PROP_FPS to that amount of fps, if the camera allows it. Does nothing on video streams or video files.

  • buffer_queue_size: Will set the size of the buffer of images read from the capturing device. We read as fast as possible (in another thread) from the device and store in the buffer the images. The main thread consumes from the buffer. If you want the shortest delay/lag set it to 1. If you don’t want to lose images set it higher.

  • fps: The effective rate at which you want the image topic to publish, if lower than the effective fps of the camera it will throttle the publication dropping frames when needed.

So if you want the very latest image published from a camera, set buffer_queue_size to 1, set_camera_fps to the max the camera allows and fps to that same max.

If you want to publish all images (don’t drop any and you don’t mind some possible delay from real time), set buffer_queue_size big enough for your case (1000?), set_camera_fps and fps to whatever FPS it has.

The rest of the parameters explained, even though they are pretty self explanatory:

  • camera_name: node name and ros graph name. All topics will hang from this e.g.: /camera_name/.
  • video_stream_provider: A number for the /dev/videoX device, e.g.: 0 for /dev/video0. A string for a path for a video file, e.g.: /home/user/Videos/myvideo.avi or a url of a video stream e.g.: rtsp://wowzaec2demo.streamlock.net/vod/mp4:BigBuckBunny_115k.mov and http://10.68.0.6/mjpg/video.mjpg.
  • frame_id: frame_id to be published in the Header of the messages.
  • camera_info_url: camera info loading, take care as it needs the “file:///” at the start , e.g.: "file:///$(find your_camera_package)/config/your_camera.yaml".
  • flip_horizontal: flip horizontally the image (mirror it).
  • flip_vertical: flip vertically the image (upside down).
  • loop_videofile: if the provider is a video file, enable loop playback.
  • width and height: force a width and height to the capturing device (if it allows), 0 means no forcing.
  • start_frame: if the provider is a video file, set the start frame of video.
  • stop_frame: if the provider is a video file, set the stop frame of video. -1 means the end of the video. Also setting stop_frame = start_frame + 1 can publish a single frame with a certain rate.

Extras

In the scripts folder you’ll find test_video_resource.py which you can use to test if your system installation can use this node to open your video stream (not using any ROS, just copy the file to your computer and try). Just do any of those:

./test_video_resource.py 0
./test_video_resource.py rtsp://wowzaec2demo.streamlock.net/vod/mp4:BigBuckBunny_115k.mov
./test_video_resource.py /home/youruser/myvideo.mkv

And you’ll see an output like:

Trying to open resource: /dev/video0
Correctly opened resource, starting to show feed.

With an OpenCV image show window showing the stream (which should close when pressing ESC, or Control+C the shell).

CHANGELOG

Changelog for package video_stream_opencv

1.1.6 (2020-12-08)

  • #67 Deal better with looping on a video file and the start and stop frame selection
  • #77 Noticed the default camera info was actually wrong, corrected
  • #69 Get canonical file for target device and give a warning if we convert to a canonical path
  • Fix typo when moving log to debug
  • #57 Enable to select the start and stop points for playing video file.
  • Avoid the excess of [start_frame]{.title-ref} compared to [stop_frame]{.title-ref} for playing video file.
  • #55 Add title and travis badge
  • #54 Enable testing on melodic
  • Add linesep for each mp jpeg
  • #53 Upgrade to OpenCV 4
  • #52 video_stream: fix disconnect callbacks never being called
  • Video_stream: make sure to always increase suscriber count
  • #50 Add option to set output_encoding
  • Add link to cv_bridge::cvtColor
  • Add config to set output_encoding
  • #49 Use variable config instead of class properties
  • #51 install with source permissions, install small.mp4, install test directory to enable testing in catkin install space
  • #45 libvideo_stream_opencv now depends on gencfg
  • #44 Don't download test data on source directory
  • #43 Add option to re-open camera device on read failure
  • #39 Add dependency for gencfg
  • #37 Support camera property settings on dynamic reconfigure
  • #36 Fix bugs for thread initialization/deinitialization
  • #34 Support changing parameter by using dynamic reconfigure
  • Add dependencies for test
  • Support dynamic_reconfigure
  • #33 Convert video_stream node to nodelet, use nodelet for video_stream
  • #31 Do not flip old image multiple times, closes #30
  • #35 Enable CI
  • Contributors: Alexander Rössler, GITAI, Leonardo Lai, Michael Sobrepera, Ryohei Ueda, Sam Pfeiffer, Sammy Pfeiffer, Yuki Furuta, moju zhao

1.1.5 (2018-12-14)

  • Exit the program if we reach the end of the video when playing a video file (Issue #23)
  • Throw exception when a frame cant be captured (Issue #23, PR #27)
  • Add loop_video parameter for videofiles (PR #24)
  • Contributors: Sammy Pfeiffer, iory

1.1.4 (2018-07-23)

  • Fix bug, cv::Mat needs to be cloned otherwise all entries in the queue will point to the same frame. This resulted in always returning the last received frame.
  • Contributors: Axel13fr

1.1.3 (2018-07-11)

  • Fixing ever growing memory when using boost::sync_queue (Issue #20) by reimplementing thread safety of frames queue using std classes. boost::sync_queue is buggy (keeps on allocating memory over time).
  • Contributors: Axel13fr

1.1.2 (2018-06-12)

  • Fix empty frame id in camera info header when providing a calibration file.
  • Contributors: tim-fan

1.1.1 (2018-04-20)

  • Fix error of using camera_name instead of identifying the type of the provider to check when the provider is a video file, and act accordingly in the producer thread
  • Prevent locking when ROS SIGINT arrives and the image queue is empty.
  • Added rate limiting to camera_fps_rate also if videofile is used as input
  • Contributors: Andrea Ranieri, Avio, Sam Pfeiffer, Sammy Pfeiffer

1.1.0 (2018-03-23)

  • Update to use thread to read. Update to new parameters. Update description.
  • Fixed image flip bug, the flip implementation is inconsistent with OpenCV API.
  • Contributors: Sammy Pfeiffer, Zihan Chen, kantengri

1.0.2 (2016-11-14)

1.0.1 (2016-11-14)

  • Releasable version
  • Contributors: Sammy Pfeiffer, Stefano Probst, Wiebe Van Ranst

Wiki Tutorials

This package does not provide any links to tutorials in it's rosindex metadata. You can check on the ROS Wiki Tutorials page for the package.

Dependant Packages

No known dependants.

Launch files

Messages

No message files found.

Services

No service files found

Plugins

Recent questions tagged video_stream_opencv at Robotics Stack Exchange

video_stream_opencv package from video_stream_opencv repo

video_stream_opencv

Package Summary

Tags No category tags.
Version 1.1.6
License BSD
Build type CATKIN
Use RECOMMENDED

Repository Summary

Checkout URI https://github.com/ros-drivers/video_stream_opencv.git
VCS Type git
VCS Version master
Last Updated 2021-04-13
Dev Status MAINTAINED
CI status Continuous Integration
Released UNRELEASED
Tags No category tags.
Contributing Help Wanted (0)
Good First Issues (0)
Pull Requests to Review (0)

Package Description

The video_stream_opencv package contains a node to publish a video stream (the protocols that opencv supports are supported, including rtsp, webcams on /dev/video and video files) in ROS image topics, it supports camera info and basic image flipping (horizontal, vertical or both) capabilities, also adjusting publishing rate.

Additional Links

Maintainers

  • Sammy Pfeiffer

Authors

  • Sammy Pfeiffer

video_stream_opencv

A package to view video streams based on the OpenCV VideoCapture module, easy way to publish on a ROS Image topic (including camera info) usb cams, ethernet cameras, video streams or video files. It also supports flipping of images and fps throttling.

Screenshot of the plugin working with a webcam, video stream and video file

Example usages in launch folder (only the argument video_stream_provider is mandatory):

<launch>
   <!-- launch video stream -->
   <include file="$(find video_stream_opencv)/launch/camera.launch" >
        <!-- node name and ros graph name -->
        <arg name="camera_name" value="webcam" />
        <!-- means video device 0, /dev/video0 -->
        <arg name="video_stream_provider" value="0" />
        <!-- set camera fps to (if the device allows) -->
        <arg name="set_camera_fps" value="30"/>
        <!-- set buffer queue size of frame capturing to -->
        <arg name="buffer_queue_size" value="100" />
        <!-- throttling the publishing of frames to -->
        <arg name="fps" value="30" />
        <!-- setting frame_id -->
        <arg name="frame_id" value="webcam" />
        <!-- camera info loading, take care as it needs the "file:///" at the start , e.g.:
        "file:///$(find your_camera_package)/config/your_camera.yaml" -->
        <arg name="camera_info_url" value="" />
        <!-- flip the image horizontally (mirror it) -->
        <arg name="flip_horizontal" value="false" />
        <!-- flip the image vertically -->
        <arg name="flip_vertical" value="false" />
        <!-- force a width and height, 0 means no forcing -->
        <arg name="width" value="640"/>
        <arg name="height" value="480"/>
        <!-- visualize on an image_view window the stream generated -->
        <arg name="visualize" value="true" />
   </include>
</launch>

Based on the ROS tutorial to convert opencv images to ROS messages.

Usability

You can use any input that OpenCV on your system accepts, e.g.:

  • Video devices that appear in linux as /dev/videoX, e.g.: USB webcams appearing as /dev/video0

  • Video streamings, e.g.: rtsp://wowzaec2demo.streamlock.net/vod/mp4:BigBuckBunny_115k.mov

  • Video files, anything you can play, e.g.: myvideo.avi

  • Etc.

Parameters

Note these important ones on the behaviour of the node:

  • set_camera_fps: Will set the OpenCV parameter CV_CAP_PROP_FPS to that amount of fps, if the camera allows it. Does nothing on video streams or video files.

  • buffer_queue_size: Will set the size of the buffer of images read from the capturing device. We read as fast as possible (in another thread) from the device and store in the buffer the images. The main thread consumes from the buffer. If you want the shortest delay/lag set it to 1. If you don’t want to lose images set it higher.

  • fps: The effective rate at which you want the image topic to publish, if lower than the effective fps of the camera it will throttle the publication dropping frames when needed.

So if you want the very latest image published from a camera, set buffer_queue_size to 1, set_camera_fps to the max the camera allows and fps to that same max.

If you want to publish all images (don’t drop any and you don’t mind some possible delay from real time), set buffer_queue_size big enough for your case (1000?), set_camera_fps and fps to whatever FPS it has.

The rest of the parameters explained, even though they are pretty self explanatory:

  • camera_name: node name and ros graph name. All topics will hang from this e.g.: /camera_name/.
  • video_stream_provider: A number for the /dev/videoX device, e.g.: 0 for /dev/video0. A string for a path for a video file, e.g.: /home/user/Videos/myvideo.avi or a url of a video stream e.g.: rtsp://wowzaec2demo.streamlock.net/vod/mp4:BigBuckBunny_115k.mov and http://10.68.0.6/mjpg/video.mjpg.
  • frame_id: frame_id to be published in the Header of the messages.
  • camera_info_url: camera info loading, take care as it needs the “file:///” at the start , e.g.: "file:///$(find your_camera_package)/config/your_camera.yaml".
  • flip_horizontal: flip horizontally the image (mirror it).
  • flip_vertical: flip vertically the image (upside down).
  • loop_videofile: if the provider is a video file, enable loop playback.
  • width and height: force a width and height to the capturing device (if it allows), 0 means no forcing.
  • start_frame: if the provider is a video file, set the start frame of video.
  • stop_frame: if the provider is a video file, set the stop frame of video. -1 means the end of the video. Also setting stop_frame = start_frame + 1 can publish a single frame with a certain rate.

Extras

In the scripts folder you’ll find test_video_resource.py which you can use to test if your system installation can use this node to open your video stream (not using any ROS, just copy the file to your computer and try). Just do any of those:

./test_video_resource.py 0
./test_video_resource.py rtsp://wowzaec2demo.streamlock.net/vod/mp4:BigBuckBunny_115k.mov
./test_video_resource.py /home/youruser/myvideo.mkv

And you’ll see an output like:

Trying to open resource: /dev/video0
Correctly opened resource, starting to show feed.

With an OpenCV image show window showing the stream (which should close when pressing ESC, or Control+C the shell).

CHANGELOG

Changelog for package video_stream_opencv

1.1.6 (2020-12-08)

  • #67 Deal better with looping on a video file and the start and stop frame selection
  • #77 Noticed the default camera info was actually wrong, corrected
  • #69 Get canonical file for target device and give a warning if we convert to a canonical path
  • Fix typo when moving log to debug
  • #57 Enable to select the start and stop points for playing video file.
  • Avoid the excess of [start_frame]{.title-ref} compared to [stop_frame]{.title-ref} for playing video file.
  • #55 Add title and travis badge
  • #54 Enable testing on melodic
  • Add linesep for each mp jpeg
  • #53 Upgrade to OpenCV 4
  • #52 video_stream: fix disconnect callbacks never being called
  • Video_stream: make sure to always increase suscriber count
  • #50 Add option to set output_encoding
  • Add link to cv_bridge::cvtColor
  • Add config to set output_encoding
  • #49 Use variable config instead of class properties
  • #51 install with source permissions, install small.mp4, install test directory to enable testing in catkin install space
  • #45 libvideo_stream_opencv now depends on gencfg
  • #44 Don't download test data on source directory
  • #43 Add option to re-open camera device on read failure
  • #39 Add dependency for gencfg
  • #37 Support camera property settings on dynamic reconfigure
  • #36 Fix bugs for thread initialization/deinitialization
  • #34 Support changing parameter by using dynamic reconfigure
  • Add dependencies for test
  • Support dynamic_reconfigure
  • #33 Convert video_stream node to nodelet, use nodelet for video_stream
  • #31 Do not flip old image multiple times, closes #30
  • #35 Enable CI
  • Contributors: Alexander Rössler, GITAI, Leonardo Lai, Michael Sobrepera, Ryohei Ueda, Sam Pfeiffer, Sammy Pfeiffer, Yuki Furuta, moju zhao

1.1.5 (2018-12-14)

  • Exit the program if we reach the end of the video when playing a video file (Issue #23)
  • Throw exception when a frame cant be captured (Issue #23, PR #27)
  • Add loop_video parameter for videofiles (PR #24)
  • Contributors: Sammy Pfeiffer, iory

1.1.4 (2018-07-23)

  • Fix bug, cv::Mat needs to be cloned otherwise all entries in the queue will point to the same frame. This resulted in always returning the last received frame.
  • Contributors: Axel13fr

1.1.3 (2018-07-11)

  • Fixing ever growing memory when using boost::sync_queue (Issue #20) by reimplementing thread safety of frames queue using std classes. boost::sync_queue is buggy (keeps on allocating memory over time).
  • Contributors: Axel13fr

1.1.2 (2018-06-12)

  • Fix empty frame id in camera info header when providing a calibration file.
  • Contributors: tim-fan

1.1.1 (2018-04-20)

  • Fix error of using camera_name instead of identifying the type of the provider to check when the provider is a video file, and act accordingly in the producer thread
  • Prevent locking when ROS SIGINT arrives and the image queue is empty.
  • Added rate limiting to camera_fps_rate also if videofile is used as input
  • Contributors: Andrea Ranieri, Avio, Sam Pfeiffer, Sammy Pfeiffer

1.1.0 (2018-03-23)

  • Update to use thread to read. Update to new parameters. Update description.
  • Fixed image flip bug, the flip implementation is inconsistent with OpenCV API.
  • Contributors: Sammy Pfeiffer, Zihan Chen, kantengri

1.0.2 (2016-11-14)

1.0.1 (2016-11-14)

  • Releasable version
  • Contributors: Sammy Pfeiffer, Stefano Probst, Wiebe Van Ranst

Wiki Tutorials

This package does not provide any links to tutorials in it's rosindex metadata. You can check on the ROS Wiki Tutorials page for the package.

Dependant Packages

Name Deps
eus_teleop

Launch files

Messages

No message files found.

Services

No service files found

Plugins

Recent questions tagged video_stream_opencv at Robotics Stack Exchange

video_stream_opencv package from video_stream_opencv repo

video_stream_opencv

Package Summary

Tags No category tags.
Version 1.1.6
License BSD
Build type CATKIN
Use RECOMMENDED

Repository Summary

Checkout URI https://github.com/ros-drivers/video_stream_opencv.git
VCS Type git
VCS Version master
Last Updated 2021-04-13
Dev Status MAINTAINED
CI status Continuous Integration
Released RELEASED
Tags No category tags.
Contributing Help Wanted (0)
Good First Issues (0)
Pull Requests to Review (0)

Package Description

The video_stream_opencv package contains a node to publish a video stream (the protocols that opencv supports are supported, including rtsp, webcams on /dev/video and video files) in ROS image topics, it supports camera info and basic image flipping (horizontal, vertical or both) capabilities, also adjusting publishing rate.

Additional Links

Maintainers

  • Sammy Pfeiffer

Authors

  • Sammy Pfeiffer

video_stream_opencv

A package to view video streams based on the OpenCV VideoCapture module, easy way to publish on a ROS Image topic (including camera info) usb cams, ethernet cameras, video streams or video files. It also supports flipping of images and fps throttling.

Screenshot of the plugin working with a webcam, video stream and video file

Example usages in launch folder (only the argument video_stream_provider is mandatory):

<launch>
   <!-- launch video stream -->
   <include file="$(find video_stream_opencv)/launch/camera.launch" >
        <!-- node name and ros graph name -->
        <arg name="camera_name" value="webcam" />
        <!-- means video device 0, /dev/video0 -->
        <arg name="video_stream_provider" value="0" />
        <!-- set camera fps to (if the device allows) -->
        <arg name="set_camera_fps" value="30"/>
        <!-- set buffer queue size of frame capturing to -->
        <arg name="buffer_queue_size" value="100" />
        <!-- throttling the publishing of frames to -->
        <arg name="fps" value="30" />
        <!-- setting frame_id -->
        <arg name="frame_id" value="webcam" />
        <!-- camera info loading, take care as it needs the "file:///" at the start , e.g.:
        "file:///$(find your_camera_package)/config/your_camera.yaml" -->
        <arg name="camera_info_url" value="" />
        <!-- flip the image horizontally (mirror it) -->
        <arg name="flip_horizontal" value="false" />
        <!-- flip the image vertically -->
        <arg name="flip_vertical" value="false" />
        <!-- force a width and height, 0 means no forcing -->
        <arg name="width" value="640"/>
        <arg name="height" value="480"/>
        <!-- visualize on an image_view window the stream generated -->
        <arg name="visualize" value="true" />
   </include>
</launch>

Based on the ROS tutorial to convert opencv images to ROS messages.

Usability

You can use any input that OpenCV on your system accepts, e.g.:

  • Video devices that appear in linux as /dev/videoX, e.g.: USB webcams appearing as /dev/video0

  • Video streamings, e.g.: rtsp://wowzaec2demo.streamlock.net/vod/mp4:BigBuckBunny_115k.mov

  • Video files, anything you can play, e.g.: myvideo.avi

  • Etc.

Parameters

Note these important ones on the behaviour of the node:

  • set_camera_fps: Will set the OpenCV parameter CV_CAP_PROP_FPS to that amount of fps, if the camera allows it. Does nothing on video streams or video files.

  • buffer_queue_size: Will set the size of the buffer of images read from the capturing device. We read as fast as possible (in another thread) from the device and store in the buffer the images. The main thread consumes from the buffer. If you want the shortest delay/lag set it to 1. If you don’t want to lose images set it higher.

  • fps: The effective rate at which you want the image topic to publish, if lower than the effective fps of the camera it will throttle the publication dropping frames when needed.

So if you want the very latest image published from a camera, set buffer_queue_size to 1, set_camera_fps to the max the camera allows and fps to that same max.

If you want to publish all images (don’t drop any and you don’t mind some possible delay from real time), set buffer_queue_size big enough for your case (1000?), set_camera_fps and fps to whatever FPS it has.

The rest of the parameters explained, even though they are pretty self explanatory:

  • camera_name: node name and ros graph name. All topics will hang from this e.g.: /camera_name/.
  • video_stream_provider: A number for the /dev/videoX device, e.g.: 0 for /dev/video0. A string for a path for a video file, e.g.: /home/user/Videos/myvideo.avi or a url of a video stream e.g.: rtsp://wowzaec2demo.streamlock.net/vod/mp4:BigBuckBunny_115k.mov and http://10.68.0.6/mjpg/video.mjpg.
  • frame_id: frame_id to be published in the Header of the messages.
  • camera_info_url: camera info loading, take care as it needs the “file:///” at the start , e.g.: "file:///$(find your_camera_package)/config/your_camera.yaml".
  • flip_horizontal: flip horizontally the image (mirror it).
  • flip_vertical: flip vertically the image (upside down).
  • loop_videofile: if the provider is a video file, enable loop playback.
  • width and height: force a width and height to the capturing device (if it allows), 0 means no forcing.
  • start_frame: if the provider is a video file, set the start frame of video.
  • stop_frame: if the provider is a video file, set the stop frame of video. -1 means the end of the video. Also setting stop_frame = start_frame + 1 can publish a single frame with a certain rate.

Extras

In the scripts folder you’ll find test_video_resource.py which you can use to test if your system installation can use this node to open your video stream (not using any ROS, just copy the file to your computer and try). Just do any of those:

./test_video_resource.py 0
./test_video_resource.py rtsp://wowzaec2demo.streamlock.net/vod/mp4:BigBuckBunny_115k.mov
./test_video_resource.py /home/youruser/myvideo.mkv

And you’ll see an output like:

Trying to open resource: /dev/video0
Correctly opened resource, starting to show feed.

With an OpenCV image show window showing the stream (which should close when pressing ESC, or Control+C the shell).

CHANGELOG

Changelog for package video_stream_opencv

1.1.6 (2020-12-08)

  • #67 Deal better with looping on a video file and the start and stop frame selection
  • #77 Noticed the default camera info was actually wrong, corrected
  • #69 Get canonical file for target device and give a warning if we convert to a canonical path
  • Fix typo when moving log to debug
  • #57 Enable to select the start and stop points for playing video file.
  • Avoid the excess of [start_frame]{.title-ref} compared to [stop_frame]{.title-ref} for playing video file.
  • #55 Add title and travis badge
  • #54 Enable testing on melodic
  • Add linesep for each mp jpeg
  • #53 Upgrade to OpenCV 4
  • #52 video_stream: fix disconnect callbacks never being called
  • Video_stream: make sure to always increase suscriber count
  • #50 Add option to set output_encoding
  • Add link to cv_bridge::cvtColor
  • Add config to set output_encoding
  • #49 Use variable config instead of class properties
  • #51 install with source permissions, install small.mp4, install test directory to enable testing in catkin install space
  • #45 libvideo_stream_opencv now depends on gencfg
  • #44 Don't download test data on source directory
  • #43 Add option to re-open camera device on read failure
  • #39 Add dependency for gencfg
  • #37 Support camera property settings on dynamic reconfigure
  • #36 Fix bugs for thread initialization/deinitialization
  • #34 Support changing parameter by using dynamic reconfigure
  • Add dependencies for test
  • Support dynamic_reconfigure
  • #33 Convert video_stream node to nodelet, use nodelet for video_stream
  • #31 Do not flip old image multiple times, closes #30
  • #35 Enable CI
  • Contributors: Alexander Rössler, GITAI, Leonardo Lai, Michael Sobrepera, Ryohei Ueda, Sam Pfeiffer, Sammy Pfeiffer, Yuki Furuta, moju zhao

1.1.5 (2018-12-14)

  • Exit the program if we reach the end of the video when playing a video file (Issue #23)
  • Throw exception when a frame cant be captured (Issue #23, PR #27)
  • Add loop_video parameter for videofiles (PR #24)
  • Contributors: Sammy Pfeiffer, iory

1.1.4 (2018-07-23)

  • Fix bug, cv::Mat needs to be cloned otherwise all entries in the queue will point to the same frame. This resulted in always returning the last received frame.
  • Contributors: Axel13fr

1.1.3 (2018-07-11)

  • Fixing ever growing memory when using boost::sync_queue (Issue #20) by reimplementing thread safety of frames queue using std classes. boost::sync_queue is buggy (keeps on allocating memory over time).
  • Contributors: Axel13fr

1.1.2 (2018-06-12)

  • Fix empty frame id in camera info header when providing a calibration file.
  • Contributors: tim-fan

1.1.1 (2018-04-20)

  • Fix error of using camera_name instead of identifying the type of the provider to check when the provider is a video file, and act accordingly in the producer thread
  • Prevent locking when ROS SIGINT arrives and the image queue is empty.
  • Added rate limiting to camera_fps_rate also if videofile is used as input
  • Contributors: Andrea Ranieri, Avio, Sam Pfeiffer, Sammy Pfeiffer

1.1.0 (2018-03-23)

  • Update to use thread to read. Update to new parameters. Update description.
  • Fixed image flip bug, the flip implementation is inconsistent with OpenCV API.
  • Contributors: Sammy Pfeiffer, Zihan Chen, kantengri

1.0.2 (2016-11-14)

1.0.1 (2016-11-14)

  • Releasable version
  • Contributors: Sammy Pfeiffer, Stefano Probst, Wiebe Van Ranst

Wiki Tutorials

This package does not provide any links to tutorials in it's rosindex metadata. You can check on the ROS Wiki Tutorials page for the package.

Launch files

Messages

No message files found.

Services

No service files found

Plugins

Recent questions tagged video_stream_opencv at Robotics Stack Exchange

video_stream_opencv package from video_stream_opencv repo

video_stream_opencv

Package Summary

Tags No category tags.
Version 1.1.6
License BSD
Build type CATKIN
Use RECOMMENDED

Repository Summary

Checkout URI https://github.com/ros-drivers/video_stream_opencv.git
VCS Type git
VCS Version master
Last Updated 2021-04-13
Dev Status MAINTAINED
CI status No Continuous Integration
Released UNRELEASED
Tags No category tags.
Contributing Help Wanted (0)
Good First Issues (0)
Pull Requests to Review (0)

Package Description

The video_stream_opencv package contains a node to publish a video stream (the protocols that opencv supports are supported, including rtsp, webcams on /dev/video and video files) in ROS image topics, it supports camera info and basic image flipping (horizontal, vertical or both) capabilities, also adjusting publishing rate.

Additional Links

Maintainers

  • Sammy Pfeiffer

Authors

  • Sammy Pfeiffer

video_stream_opencv

A package to view video streams based on the OpenCV VideoCapture module, easy way to publish on a ROS Image topic (including camera info) usb cams, ethernet cameras, video streams or video files. It also supports flipping of images and fps throttling.

Screenshot of the plugin working with a webcam, video stream and video file

Example usages in launch folder (only the argument video_stream_provider is mandatory):

<launch>
   <!-- launch video stream -->
   <include file="$(find video_stream_opencv)/launch/camera.launch" >
        <!-- node name and ros graph name -->
        <arg name="camera_name" value="webcam" />
        <!-- means video device 0, /dev/video0 -->
        <arg name="video_stream_provider" value="0" />
        <!-- set camera fps to (if the device allows) -->
        <arg name="set_camera_fps" value="30"/>
        <!-- set buffer queue size of frame capturing to -->
        <arg name="buffer_queue_size" value="100" />
        <!-- throttling the publishing of frames to -->
        <arg name="fps" value="30" />
        <!-- setting frame_id -->
        <arg name="frame_id" value="webcam" />
        <!-- camera info loading, take care as it needs the "file:///" at the start , e.g.:
        "file:///$(find your_camera_package)/config/your_camera.yaml" -->
        <arg name="camera_info_url" value="" />
        <!-- flip the image horizontally (mirror it) -->
        <arg name="flip_horizontal" value="false" />
        <!-- flip the image vertically -->
        <arg name="flip_vertical" value="false" />
        <!-- force a width and height, 0 means no forcing -->
        <arg name="width" value="640"/>
        <arg name="height" value="480"/>
        <!-- visualize on an image_view window the stream generated -->
        <arg name="visualize" value="true" />
   </include>
</launch>

Based on the ROS tutorial to convert opencv images to ROS messages.

Usability

You can use any input that OpenCV on your system accepts, e.g.:

  • Video devices that appear in linux as /dev/videoX, e.g.: USB webcams appearing as /dev/video0

  • Video streamings, e.g.: rtsp://wowzaec2demo.streamlock.net/vod/mp4:BigBuckBunny_115k.mov

  • Video files, anything you can play, e.g.: myvideo.avi

  • Etc.

Parameters

Note these important ones on the behaviour of the node:

  • set_camera_fps: Will set the OpenCV parameter CV_CAP_PROP_FPS to that amount of fps, if the camera allows it. Does nothing on video streams or video files.

  • buffer_queue_size: Will set the size of the buffer of images read from the capturing device. We read as fast as possible (in another thread) from the device and store in the buffer the images. The main thread consumes from the buffer. If you want the shortest delay/lag set it to 1. If you don’t want to lose images set it higher.

  • fps: The effective rate at which you want the image topic to publish, if lower than the effective fps of the camera it will throttle the publication dropping frames when needed.

So if you want the very latest image published from a camera, set buffer_queue_size to 1, set_camera_fps to the max the camera allows and fps to that same max.

If you want to publish all images (don’t drop any and you don’t mind some possible delay from real time), set buffer_queue_size big enough for your case (1000?), set_camera_fps and fps to whatever FPS it has.

The rest of the parameters explained, even though they are pretty self explanatory:

  • camera_name: node name and ros graph name. All topics will hang from this e.g.: /camera_name/.
  • video_stream_provider: A number for the /dev/videoX device, e.g.: 0 for /dev/video0. A string for a path for a video file, e.g.: /home/user/Videos/myvideo.avi or a url of a video stream e.g.: rtsp://wowzaec2demo.streamlock.net/vod/mp4:BigBuckBunny_115k.mov and http://10.68.0.6/mjpg/video.mjpg.
  • frame_id: frame_id to be published in the Header of the messages.
  • camera_info_url: camera info loading, take care as it needs the “file:///” at the start , e.g.: "file:///$(find your_camera_package)/config/your_camera.yaml".
  • flip_horizontal: flip horizontally the image (mirror it).
  • flip_vertical: flip vertically the image (upside down).
  • loop_videofile: if the provider is a video file, enable loop playback.
  • width and height: force a width and height to the capturing device (if it allows), 0 means no forcing.
  • start_frame: if the provider is a video file, set the start frame of video.
  • stop_frame: if the provider is a video file, set the stop frame of video. -1 means the end of the video. Also setting stop_frame = start_frame + 1 can publish a single frame with a certain rate.

Extras

In the scripts folder you’ll find test_video_resource.py which you can use to test if your system installation can use this node to open your video stream (not using any ROS, just copy the file to your computer and try). Just do any of those:

./test_video_resource.py 0
./test_video_resource.py rtsp://wowzaec2demo.streamlock.net/vod/mp4:BigBuckBunny_115k.mov
./test_video_resource.py /home/youruser/myvideo.mkv

And you’ll see an output like:

Trying to open resource: /dev/video0
Correctly opened resource, starting to show feed.

With an OpenCV image show window showing the stream (which should close when pressing ESC, or Control+C the shell).

CHANGELOG

Changelog for package video_stream_opencv

1.1.6 (2020-12-08)

  • #67 Deal better with looping on a video file and the start and stop frame selection
  • #77 Noticed the default camera info was actually wrong, corrected
  • #69 Get canonical file for target device and give a warning if we convert to a canonical path
  • Fix typo when moving log to debug
  • #57 Enable to select the start and stop points for playing video file.
  • Avoid the excess of [start_frame]{.title-ref} compared to [stop_frame]{.title-ref} for playing video file.
  • #55 Add title and travis badge
  • #54 Enable testing on melodic
  • Add linesep for each mp jpeg
  • #53 Upgrade to OpenCV 4
  • #52 video_stream: fix disconnect callbacks never being called
  • Video_stream: make sure to always increase suscriber count
  • #50 Add option to set output_encoding
  • Add link to cv_bridge::cvtColor
  • Add config to set output_encoding
  • #49 Use variable config instead of class properties
  • #51 install with source permissions, install small.mp4, install test directory to enable testing in catkin install space
  • #45 libvideo_stream_opencv now depends on gencfg
  • #44 Don't download test data on source directory
  • #43 Add option to re-open camera device on read failure
  • #39 Add dependency for gencfg
  • #37 Support camera property settings on dynamic reconfigure
  • #36 Fix bugs for thread initialization/deinitialization
  • #34 Support changing parameter by using dynamic reconfigure
  • Add dependencies for test
  • Support dynamic_reconfigure
  • #33 Convert video_stream node to nodelet, use nodelet for video_stream
  • #31 Do not flip old image multiple times, closes #30
  • #35 Enable CI
  • Contributors: Alexander Rössler, GITAI, Leonardo Lai, Michael Sobrepera, Ryohei Ueda, Sam Pfeiffer, Sammy Pfeiffer, Yuki Furuta, moju zhao

1.1.5 (2018-12-14)

  • Exit the program if we reach the end of the video when playing a video file (Issue #23)
  • Throw exception when a frame cant be captured (Issue #23, PR #27)
  • Add loop_video parameter for videofiles (PR #24)
  • Contributors: Sammy Pfeiffer, iory

1.1.4 (2018-07-23)

  • Fix bug, cv::Mat needs to be cloned otherwise all entries in the queue will point to the same frame. This resulted in always returning the last received frame.
  • Contributors: Axel13fr

1.1.3 (2018-07-11)

  • Fixing ever growing memory when using boost::sync_queue (Issue #20) by reimplementing thread safety of frames queue using std classes. boost::sync_queue is buggy (keeps on allocating memory over time).
  • Contributors: Axel13fr

1.1.2 (2018-06-12)

  • Fix empty frame id in camera info header when providing a calibration file.
  • Contributors: tim-fan

1.1.1 (2018-04-20)

  • Fix error of using camera_name instead of identifying the type of the provider to check when the provider is a video file, and act accordingly in the producer thread
  • Prevent locking when ROS SIGINT arrives and the image queue is empty.
  • Added rate limiting to camera_fps_rate also if videofile is used as input
  • Contributors: Andrea Ranieri, Avio, Sam Pfeiffer, Sammy Pfeiffer

1.1.0 (2018-03-23)

  • Update to use thread to read. Update to new parameters. Update description.
  • Fixed image flip bug, the flip implementation is inconsistent with OpenCV API.
  • Contributors: Sammy Pfeiffer, Zihan Chen, kantengri

1.0.2 (2016-11-14)

1.0.1 (2016-11-14)

  • Releasable version
  • Contributors: Sammy Pfeiffer, Stefano Probst, Wiebe Van Ranst

Wiki Tutorials

This package does not provide any links to tutorials in it's rosindex metadata. You can check on the ROS Wiki Tutorials page for the package.

Launch files

Messages

No message files found.

Services

No service files found

Plugins

Recent questions tagged video_stream_opencv at Robotics Stack Exchange

video_stream_opencv package from video_stream_opencv repo

video_stream_opencv

Package Summary

Tags No category tags.
Version 1.1.6
License BSD
Build type CATKIN
Use RECOMMENDED

Repository Summary

Checkout URI https://github.com/ros-drivers/video_stream_opencv.git
VCS Type git
VCS Version master
Last Updated 2021-04-13
Dev Status MAINTAINED
CI status Continuous Integration
Released RELEASED
Tags No category tags.
Contributing Help Wanted (0)
Good First Issues (0)
Pull Requests to Review (0)

Package Description

The video_stream_opencv package contains a node to publish a video stream (the protocols that opencv supports are supported, including rtsp, webcams on /dev/video and video files) in ROS image topics, it supports camera info and basic image flipping (horizontal, vertical or both) capabilities, also adjusting publishing rate.

Additional Links

Maintainers

  • Sammy Pfeiffer

Authors

  • Sammy Pfeiffer

video_stream_opencv

A package to view video streams based on the OpenCV VideoCapture module, easy way to publish on a ROS Image topic (including camera info) usb cams, ethernet cameras, video streams or video files. It also supports flipping of images and fps throttling.

Screenshot of the plugin working with a webcam, video stream and video file

Example usages in launch folder (only the argument video_stream_provider is mandatory):

<launch>
   <!-- launch video stream -->
   <include file="$(find video_stream_opencv)/launch/camera.launch" >
        <!-- node name and ros graph name -->
        <arg name="camera_name" value="webcam" />
        <!-- means video device 0, /dev/video0 -->
        <arg name="video_stream_provider" value="0" />
        <!-- set camera fps to (if the device allows) -->
        <arg name="set_camera_fps" value="30"/>
        <!-- set buffer queue size of frame capturing to -->
        <arg name="buffer_queue_size" value="100" />
        <!-- throttling the publishing of frames to -->
        <arg name="fps" value="30" />
        <!-- setting frame_id -->
        <arg name="frame_id" value="webcam" />
        <!-- camera info loading, take care as it needs the "file:///" at the start , e.g.:
        "file:///$(find your_camera_package)/config/your_camera.yaml" -->
        <arg name="camera_info_url" value="" />
        <!-- flip the image horizontally (mirror it) -->
        <arg name="flip_horizontal" value="false" />
        <!-- flip the image vertically -->
        <arg name="flip_vertical" value="false" />
        <!-- force a width and height, 0 means no forcing -->
        <arg name="width" value="640"/>
        <arg name="height" value="480"/>
        <!-- visualize on an image_view window the stream generated -->
        <arg name="visualize" value="true" />
   </include>
</launch>

Based on the ROS tutorial to convert opencv images to ROS messages.

Usability

You can use any input that OpenCV on your system accepts, e.g.:

  • Video devices that appear in linux as /dev/videoX, e.g.: USB webcams appearing as /dev/video0

  • Video streamings, e.g.: rtsp://wowzaec2demo.streamlock.net/vod/mp4:BigBuckBunny_115k.mov

  • Video files, anything you can play, e.g.: myvideo.avi

  • Etc.

Parameters

Note these important ones on the behaviour of the node:

  • set_camera_fps: Will set the OpenCV parameter CV_CAP_PROP_FPS to that amount of fps, if the camera allows it. Does nothing on video streams or video files.

  • buffer_queue_size: Will set the size of the buffer of images read from the capturing device. We read as fast as possible (in another thread) from the device and store in the buffer the images. The main thread consumes from the buffer. If you want the shortest delay/lag set it to 1. If you don’t want to lose images set it higher.

  • fps: The effective rate at which you want the image topic to publish, if lower than the effective fps of the camera it will throttle the publication dropping frames when needed.

So if you want the very latest image published from a camera, set buffer_queue_size to 1, set_camera_fps to the max the camera allows and fps to that same max.

If you want to publish all images (don’t drop any and you don’t mind some possible delay from real time), set buffer_queue_size big enough for your case (1000?), set_camera_fps and fps to whatever FPS it has.

The rest of the parameters explained, even though they are pretty self explanatory:

  • camera_name: node name and ros graph name. All topics will hang from this e.g.: /camera_name/.
  • video_stream_provider: A number for the /dev/videoX device, e.g.: 0 for /dev/video0. A string for a path for a video file, e.g.: /home/user/Videos/myvideo.avi or a url of a video stream e.g.: rtsp://wowzaec2demo.streamlock.net/vod/mp4:BigBuckBunny_115k.mov and http://10.68.0.6/mjpg/video.mjpg.
  • frame_id: frame_id to be published in the Header of the messages.
  • camera_info_url: camera info loading, take care as it needs the “file:///” at the start , e.g.: "file:///$(find your_camera_package)/config/your_camera.yaml".
  • flip_horizontal: flip horizontally the image (mirror it).
  • flip_vertical: flip vertically the image (upside down).
  • loop_videofile: if the provider is a video file, enable loop playback.
  • width and height: force a width and height to the capturing device (if it allows), 0 means no forcing.
  • start_frame: if the provider is a video file, set the start frame of video.
  • stop_frame: if the provider is a video file, set the stop frame of video. -1 means the end of the video. Also setting stop_frame = start_frame + 1 can publish a single frame with a certain rate.

Extras

In the scripts folder you’ll find test_video_resource.py which you can use to test if your system installation can use this node to open your video stream (not using any ROS, just copy the file to your computer and try). Just do any of those:

./test_video_resource.py 0
./test_video_resource.py rtsp://wowzaec2demo.streamlock.net/vod/mp4:BigBuckBunny_115k.mov
./test_video_resource.py /home/youruser/myvideo.mkv

And you’ll see an output like:

Trying to open resource: /dev/video0
Correctly opened resource, starting to show feed.

With an OpenCV image show window showing the stream (which should close when pressing ESC, or Control+C the shell).

CHANGELOG

Changelog for package video_stream_opencv

1.1.6 (2020-12-08)

  • #67 Deal better with looping on a video file and the start and stop frame selection
  • #77 Noticed the default camera info was actually wrong, corrected
  • #69 Get canonical file for target device and give a warning if we convert to a canonical path
  • Fix typo when moving log to debug
  • #57 Enable to select the start and stop points for playing video file.
  • Avoid the excess of [start_frame]{.title-ref} compared to [stop_frame]{.title-ref} for playing video file.
  • #55 Add title and travis badge
  • #54 Enable testing on melodic
  • Add linesep for each mp jpeg
  • #53 Upgrade to OpenCV 4
  • #52 video_stream: fix disconnect callbacks never being called
  • Video_stream: make sure to always increase suscriber count
  • #50 Add option to set output_encoding
  • Add link to cv_bridge::cvtColor
  • Add config to set output_encoding
  • #49 Use variable config instead of class properties
  • #51 install with source permissions, install small.mp4, install test directory to enable testing in catkin install space
  • #45 libvideo_stream_opencv now depends on gencfg
  • #44 Don't download test data on source directory
  • #43 Add option to re-open camera device on read failure
  • #39 Add dependency for gencfg
  • #37 Support camera property settings on dynamic reconfigure
  • #36 Fix bugs for thread initialization/deinitialization
  • #34 Support changing parameter by using dynamic reconfigure
  • Add dependencies for test
  • Support dynamic_reconfigure
  • #33 Convert video_stream node to nodelet, use nodelet for video_stream
  • #31 Do not flip old image multiple times, closes #30
  • #35 Enable CI
  • Contributors: Alexander Rössler, GITAI, Leonardo Lai, Michael Sobrepera, Ryohei Ueda, Sam Pfeiffer, Sammy Pfeiffer, Yuki Furuta, moju zhao

1.1.5 (2018-12-14)

  • Exit the program if we reach the end of the video when playing a video file (Issue #23)
  • Throw exception when a frame cant be captured (Issue #23, PR #27)
  • Add loop_video parameter for videofiles (PR #24)
  • Contributors: Sammy Pfeiffer, iory

1.1.4 (2018-07-23)

  • Fix bug, cv::Mat needs to be cloned otherwise all entries in the queue will point to the same frame. This resulted in always returning the last received frame.
  • Contributors: Axel13fr

1.1.3 (2018-07-11)

  • Fixing ever growing memory when using boost::sync_queue (Issue #20) by reimplementing thread safety of frames queue using std classes. boost::sync_queue is buggy (keeps on allocating memory over time).
  • Contributors: Axel13fr

1.1.2 (2018-06-12)

  • Fix empty frame id in camera info header when providing a calibration file.
  • Contributors: tim-fan

1.1.1 (2018-04-20)

  • Fix error of using camera_name instead of identifying the type of the provider to check when the provider is a video file, and act accordingly in the producer thread
  • Prevent locking when ROS SIGINT arrives and the image queue is empty.
  • Added rate limiting to camera_fps_rate also if videofile is used as input
  • Contributors: Andrea Ranieri, Avio, Sam Pfeiffer, Sammy Pfeiffer

1.1.0 (2018-03-23)

  • Update to use thread to read. Update to new parameters. Update description.
  • Fixed image flip bug, the flip implementation is inconsistent with OpenCV API.
  • Contributors: Sammy Pfeiffer, Zihan Chen, kantengri

1.0.2 (2016-11-14)

1.0.1 (2016-11-14)

  • Releasable version
  • Contributors: Sammy Pfeiffer, Stefano Probst, Wiebe Van Ranst

Wiki Tutorials

This package does not provide any links to tutorials in it's rosindex metadata. You can check on the ROS Wiki Tutorials page for the package.

Dependant Packages

Name Deps
eus_teleop

Launch files

Messages

No message files found.

Services

No service files found

Plugins

Recent questions tagged video_stream_opencv at Robotics Stack Exchange

video_stream_opencv package from video_stream_opencv repo

video_stream_opencv

Package Summary

Tags No category tags.
Version 1.1.6
License BSD
Build type CATKIN
Use RECOMMENDED

Repository Summary

Checkout URI https://github.com/ros-drivers/video_stream_opencv.git
VCS Type git
VCS Version master
Last Updated 2021-04-13
Dev Status MAINTAINED
CI status
Released RELEASED
Tags No category tags.
Contributing Help Wanted (0)
Good First Issues (0)
Pull Requests to Review (0)

Package Description

The video_stream_opencv package contains a node to publish a video stream (the protocols that opencv supports are supported, including rtsp, webcams on /dev/video and video files) in ROS image topics, it supports camera info and basic image flipping (horizontal, vertical or both) capabilities, also adjusting publishing rate.

Additional Links

Maintainers

  • Sammy Pfeiffer

Authors

  • Sammy Pfeiffer

video_stream_opencv

A package to view video streams based on the OpenCV VideoCapture module, easy way to publish on a ROS Image topic (including camera info) usb cams, ethernet cameras, video streams or video files. It also supports flipping of images and fps throttling.

Screenshot of the plugin working with a webcam, video stream and video file

Example usages in launch folder (only the argument video_stream_provider is mandatory):

<launch>
   <!-- launch video stream -->
   <include file="$(find video_stream_opencv)/launch/camera.launch" >
        <!-- node name and ros graph name -->
        <arg name="camera_name" value="webcam" />
        <!-- means video device 0, /dev/video0 -->
        <arg name="video_stream_provider" value="0" />
        <!-- set camera fps to (if the device allows) -->
        <arg name="set_camera_fps" value="30"/>
        <!-- set buffer queue size of frame capturing to -->
        <arg name="buffer_queue_size" value="100" />
        <!-- throttling the publishing of frames to -->
        <arg name="fps" value="30" />
        <!-- setting frame_id -->
        <arg name="frame_id" value="webcam" />
        <!-- camera info loading, take care as it needs the "file:///" at the start , e.g.:
        "file:///$(find your_camera_package)/config/your_camera.yaml" -->
        <arg name="camera_info_url" value="" />
        <!-- flip the image horizontally (mirror it) -->
        <arg name="flip_horizontal" value="false" />
        <!-- flip the image vertically -->
        <arg name="flip_vertical" value="false" />
        <!-- force a width and height, 0 means no forcing -->
        <arg name="width" value="640"/>
        <arg name="height" value="480"/>
        <!-- visualize on an image_view window the stream generated -->
        <arg name="visualize" value="true" />
   </include>
</launch>

Based on the ROS tutorial to convert opencv images to ROS messages.

Usability

You can use any input that OpenCV on your system accepts, e.g.:

  • Video devices that appear in linux as /dev/videoX, e.g.: USB webcams appearing as /dev/video0

  • Video streamings, e.g.: rtsp://wowzaec2demo.streamlock.net/vod/mp4:BigBuckBunny_115k.mov

  • Video files, anything you can play, e.g.: myvideo.avi

  • Etc.

Parameters

Note these important ones on the behaviour of the node:

  • set_camera_fps: Will set the OpenCV parameter CV_CAP_PROP_FPS to that amount of fps, if the camera allows it. Does nothing on video streams or video files.

  • buffer_queue_size: Will set the size of the buffer of images read from the capturing device. We read as fast as possible (in another thread) from the device and store in the buffer the images. The main thread consumes from the buffer. If you want the shortest delay/lag set it to 1. If you don’t want to lose images set it higher.

  • fps: The effective rate at which you want the image topic to publish, if lower than the effective fps of the camera it will throttle the publication dropping frames when needed.

So if you want the very latest image published from a camera, set buffer_queue_size to 1, set_camera_fps to the max the camera allows and fps to that same max.

If you want to publish all images (don’t drop any and you don’t mind some possible delay from real time), set buffer_queue_size big enough for your case (1000?), set_camera_fps and fps to whatever FPS it has.

The rest of the parameters explained, even though they are pretty self explanatory:

  • camera_name: node name and ros graph name. All topics will hang from this e.g.: /camera_name/.
  • video_stream_provider: A number for the /dev/videoX device, e.g.: 0 for /dev/video0. A string for a path for a video file, e.g.: /home/user/Videos/myvideo.avi or a url of a video stream e.g.: rtsp://wowzaec2demo.streamlock.net/vod/mp4:BigBuckBunny_115k.mov and http://10.68.0.6/mjpg/video.mjpg.
  • frame_id: frame_id to be published in the Header of the messages.
  • camera_info_url: camera info loading, take care as it needs the “file:///” at the start , e.g.: "file:///$(find your_camera_package)/config/your_camera.yaml".
  • flip_horizontal: flip horizontally the image (mirror it).
  • flip_vertical: flip vertically the image (upside down).
  • loop_videofile: if the provider is a video file, enable loop playback.
  • width and height: force a width and height to the capturing device (if it allows), 0 means no forcing.
  • start_frame: if the provider is a video file, set the start frame of video.
  • stop_frame: if the provider is a video file, set the stop frame of video. -1 means the end of the video. Also setting stop_frame = start_frame + 1 can publish a single frame with a certain rate.

Extras

In the scripts folder you’ll find test_video_resource.py which you can use to test if your system installation can use this node to open your video stream (not using any ROS, just copy the file to your computer and try). Just do any of those:

./test_video_resource.py 0
./test_video_resource.py rtsp://wowzaec2demo.streamlock.net/vod/mp4:BigBuckBunny_115k.mov
./test_video_resource.py /home/youruser/myvideo.mkv

And you’ll see an output like:

Trying to open resource: /dev/video0
Correctly opened resource, starting to show feed.

With an OpenCV image show window showing the stream (which should close when pressing ESC, or Control+C the shell).

CHANGELOG

Changelog for package video_stream_opencv

1.1.6 (2020-12-08)

  • #67 Deal better with looping on a video file and the start and stop frame selection
  • #77 Noticed the default camera info was actually wrong, corrected
  • #69 Get canonical file for target device and give a warning if we convert to a canonical path
  • Fix typo when moving log to debug
  • #57 Enable to select the start and stop points for playing video file.
  • Avoid the excess of [start_frame]{.title-ref} compared to [stop_frame]{.title-ref} for playing video file.
  • #55 Add title and travis badge
  • #54 Enable testing on melodic
  • Add linesep for each mp jpeg
  • #53 Upgrade to OpenCV 4
  • #52 video_stream: fix disconnect callbacks never being called
  • Video_stream: make sure to always increase suscriber count
  • #50 Add option to set output_encoding
  • Add link to cv_bridge::cvtColor
  • Add config to set output_encoding
  • #49 Use variable config instead of class properties
  • #51 install with source permissions, install small.mp4, install test directory to enable testing in catkin install space
  • #45 libvideo_stream_opencv now depends on gencfg
  • #44 Don't download test data on source directory
  • #43 Add option to re-open camera device on read failure
  • #39 Add dependency for gencfg
  • #37 Support camera property settings on dynamic reconfigure
  • #36 Fix bugs for thread initialization/deinitialization
  • #34 Support changing parameter by using dynamic reconfigure
  • Add dependencies for test
  • Support dynamic_reconfigure
  • #33 Convert video_stream node to nodelet, use nodelet for video_stream
  • #31 Do not flip old image multiple times, closes #30
  • #35 Enable CI
  • Contributors: Alexander Rössler, GITAI, Leonardo Lai, Michael Sobrepera, Ryohei Ueda, Sam Pfeiffer, Sammy Pfeiffer, Yuki Furuta, moju zhao

1.1.5 (2018-12-14)

  • Exit the program if we reach the end of the video when playing a video file (Issue #23)
  • Throw exception when a frame cant be captured (Issue #23, PR #27)
  • Add loop_video parameter for videofiles (PR #24)
  • Contributors: Sammy Pfeiffer, iory

1.1.4 (2018-07-23)

  • Fix bug, cv::Mat needs to be cloned otherwise all entries in the queue will point to the same frame. This resulted in always returning the last received frame.
  • Contributors: Axel13fr

1.1.3 (2018-07-11)

  • Fixing ever growing memory when using boost::sync_queue (Issue #20) by reimplementing thread safety of frames queue using std classes. boost::sync_queue is buggy (keeps on allocating memory over time).
  • Contributors: Axel13fr

1.1.2 (2018-06-12)

  • Fix empty frame id in camera info header when providing a calibration file.
  • Contributors: tim-fan

1.1.1 (2018-04-20)

  • Fix error of using camera_name instead of identifying the type of the provider to check when the provider is a video file, and act accordingly in the producer thread
  • Prevent locking when ROS SIGINT arrives and the image queue is empty.
  • Added rate limiting to camera_fps_rate also if videofile is used as input
  • Contributors: Andrea Ranieri, Avio, Sam Pfeiffer, Sammy Pfeiffer

1.1.0 (2018-03-23)

  • Update to use thread to read. Update to new parameters. Update description.
  • Fixed image flip bug, the flip implementation is inconsistent with OpenCV API.
  • Contributors: Sammy Pfeiffer, Zihan Chen, kantengri

1.0.2 (2016-11-14)

1.0.1 (2016-11-14)

  • Releasable version
  • Contributors: Sammy Pfeiffer, Stefano Probst, Wiebe Van Ranst

Wiki Tutorials

This package does not provide any links to tutorials in it's rosindex metadata. You can check on the ROS Wiki Tutorials page for the package.

Dependant Packages

Name Deps
eus_teleop

Launch files

Messages

No message files found.

Services

No service files found

Plugins

Recent questions tagged video_stream_opencv at Robotics Stack Exchange