image_view2

image_view2 is an extended image_view.

Features

• Draw markers on image view
• Interact with user direction

Interaction Modes

image_view2 support several mode to interact with user. You can set interaction mode by ~interaction_mode parameter or change mode by service interfaces.

• Rectangle mode (~interaction_mode:=rectangle)

  In rectangle mode, user can select region-of-interest by dragging mouse pointer.

  

  Selected regions are published to image/screenrectangle (geometry_msgs/PolygonStamped) topic.

  If user clicks on the view instead of dragging pointer, clicked position is published to image/screenpoint (geometry_msgs/PointStamped) topic.

• Line mode (~interaction_mode:=line)

  In line mode, user can select a line by dragging mouse pointer.

  

  Selected line are published to image/line (geometry_msgs/PolygonStamped) topic.

• Polygon mode (~interaction_mode:=poly)

  In polygon mode, user can select a series of closed lines. User can add line by left-click and close the lines by right-click.

  

  Selected polygon are published to image/poly (geometry_msgs/PolygonStamped) topic.

• Grabcut mode (~interaction_mode:=grabcut)

  In grabcut mode, user can select two curves. By typing Esc key, you can clear selected curves.

  

  The selected first red curve is published to image/foreground (sensor_msgs/Image) and the second green one is publiehd to image/background (sensor_msgs/Image). This mode is originally implemented to select forground and background pixels for grabcut.

• Grabcut Rectangle mode (~interaction_mode:=grabcut_rect)

  In grabcut rectangle mode, user can select two rectangles. By typing Esc key, you can clear selected rectangles.

  

  The selected first red rectangle is published to image/foreground_rect (geometry_msgs/PolygonStamped) and the second green one is publiehd to image/background_rect (geometry_msgs/PolygonStamped). This mode is originally implemented to select forground and background regions for grabcut.

ROS API

Publising Topics

• image/marked (sensor_msgs/Image)

  Image with marks drawed.

• image/screenrectangle_image (sensor_msgs/Image)

  Cropped image with user selection at Rectangle mode.

  

Subscribing Topics

• image (sensor_msgs/Image)

  Input image

• camera_info (sensor_msgs/CameraInfo)

  CameraInfo of the image. camera info is required to compute projection matrix when drawing markers.

• image_marker (image_view2/ImageMarker2)

  Marker topic.

• image/event (image_view2/MouseEvent)

  Event interface. image_view2 can handle mouse events without gui interaction. This topic is used to emulate event handling via ros topics

Advertising Services

• ~change_mode (image_view2/ChangeMode)

  Service interface to change interaction mode.

• ~rectangle_mode (std_srvs/Empty)

• ~grabcut_mode (std_srvs/Empty)

• ~grabcut_rect_mode (std_srvs/Empty)

• ~line_mode (std_srvs/Empty)

• ~poly_mode (std_srvs/Empty)

• ~none_mode (std_srvs/Empty)

  Service interface to change interaction mode with std_srvs/Empty service.

image_view2/ImageMarker2

image_view2/ImageMarker2 is a message to draw on image_view2 canvas.

Definition is:

byte CIRCLE=0
byte LINE_STRIP=1
byte LINE_LIST=2
byte POLYGON=3
byte POINTS=4
byte FRAMES=5
byte TEXT=6
byte LINE_STRIP3D=7
byte LINE_LIST3D=8
byte POLYGON3D=9
byte POINTS3D=10
byte TEXT3D=11
byte CIRCLE3D=12
byte ADD=0
byte REMOVE=1
std_msgs/Header header
  uint32 seq
  time stamp
  string frame_id
string ns
int32 id
int32 type
int32 action
geometry_msgs/Point position
  float64 x
  float64 y
  float64 z
geometry_msgs/PointStamped position3D
  std_msgs/Header header
    uint32 seq
    time stamp
    string frame_id
  geometry_msgs/Point point
    float64 x
    float64 y
    float64 z
geometry_msgs/PoseStamped pose
  std_msgs/Header header
    uint32 seq
    time stamp
    string frame_id
  geometry_msgs/Pose pose
    geometry_msgs/Point position
      float64 x
      float64 y
      float64 z
    geometry_msgs/Quaternion orientation
      float64 x
      float64 y
      float64 z
      float64 w
float32 scale
float32 width
std_msgs/ColorRGBA outline_color
  float32 r
  float32 g
  float32 b
  float32 a
byte filled
std_msgs/ColorRGBA fill_color
  float32 r
  float32 g
  float32 b
  float32 a
duration lifetime
byte arc
float32 angle
geometry_msgs/Point[] points
  float64 x
  float64 y
  float64 z
image_view2/PointArrayStamped points3D
  std_msgs/Header header
    uint32 seq
    time stamp
    string frame_id
  geometry_msgs/Point[] points
    float64 x
    float64 y
    float64 z
std_msgs/ColorRGBA[] outline_colors
  float32 r
  float32 g
  float32 b
  float32 a
string[] frames
string text
bool left_up_origin
bool ratio_scale