Baxter Pick ‘n’ Place

Goal: To use baxter robot to pick and place objects from one location to another.

Project Website:

Project Summary:

  • Baxter robot is used to pick and place different sized square blocks from one location to another
  • Our group not only got baxter to pick & place the square blocks, but also stack larger of the cubes on top of each other
  • The project consists of 3 major elements:
  1. Image processing: OpenCv is used as a tool to detect objects & process images from baxter’s camera. A transformation of the objects in the image frame is obtained.
  2. Moving baxter’s arms: MoveIt! is used as a tool to move baxter’s arms to pick and place objects.
  3. Planning scene: MoveIt! is also used to visualize the planning scene in Rviz – a 3D visualization tool for ROS. Planning scene consisted of objects present around baxter. The main purpose was not only to visualize the scene, but also to prevent baxter from colliding with these objects

Future work:

  • Improved camera calibration
  • GUI development: A Graphical User Interface (GUI) that allows user to click an object in the virtual world (e.g in (Gazebo), and pick and place that particular object.

Thumbnail image of baxter: Adapted from

0 comments on “Baxter Pick ‘n’ PlaceAdd yours →

Leave a Reply

Your email address will not be published. Required fields are marked *