View Full Version : Vision Guided Industrial Robot

01-19-2010, 11:39 AM

This is a video of a vision guided industrial robot pick and placing objects based on vision. The vision system is nothing but a web camera running some shape detecting algorithms.

The pixel coordinates are mapped to robot coordinates using an automatic process using best fit curves

Once the robot coordinates are obtained, the robot performs the pick and place operation - the place point is pre-defined.

The software running here is LabView, but we also have the same thing running with RoboOp, OpenCV and other such open source libraries!

Some of the major challenges we faced are:

a. Adjusting the robot height during operations - typically the robot will sag a bit more if the object is far away (i.e the robot reaches a far point). This will often result in the robot banging on the ground / desk. The height is actually related to the reach - this should be solved experimentally

b. In vision, lighting is very very important - so we should remove the illumination effects as much as possible - we are happy that our system worked well outdoors too!

03-04-2010, 11:46 AM
beautiful , algo used for image processing was template matching or some blob detection based algorithm