Using 3D data for the autonomous robot

Until recently, robots were "blind" command receivers which followed predefined and fixed paths. Using 3D data, robots can adapt flexibly to the particular situation and react to their surroundings. A promise is becoming a reality. The robot is turning into an autonomous employee. Benefits: Fast retooling times, high variance of workpieces, simple teach-in, simplified part feeding with a consistently high degree of automation.

Each step in the process considered, all eventualities ruled out. Thanks to automation, large quantities of units can be produced extremely efficiently. A high degree of specialization further improves efficiency. However, this specialized but expensive equipment falls by the wayside when it comes to flexibility and rapid retooling, as it is simply not cost-effective to produce a small batch of alternative parts. Each step in the process would need to be adapted. Small batches are often laboriously produced and manufactured by hand. While this may be flexible and cost-saving, it is a slow and non-stable process.

Robots adapt according to the situation

The development of 3D cameras and 3D-capable software has opened up opportunities for the industry to develop brand new machine vision technologies. Thanks to 3D vision, new tasks can be solved that were not possible with 2D.

One robot removes unsorted and overlapping t-pieces for a tube directly from a small transport box safely and reliably. Another robot depalletizes large aluminum parts directly onto a conveyor belt. The delicate movements of its robust gripper find a firm hold at the first attempt without the slightest collision with the workpiece. This is despite the fact that the parts on the used or dirty pallets are often skewed or leaning due to excess casting flash. Robotics has had to step up its game considerably for this bin picking and transfer of parts in the correct position.

The Freiburg-based systems integration company, isys vision, has developed a solution for this called "MIKADO Adaptive Robot Control" (or ARC for short). It is a configurable robot control with its own collision-free path planning. It uses its own inverse kinematics to calculate the joint angles of the robotic arms for gripping positions or traverse paths. 3D information, such as the workpiece shape, position, location, or a virtual image of the surroundings, is used as the reference point for the complex calculations. A large number of robots available on the market can be controlled using MIKADO ARC and make time-consuming programming unnecessary. Parts can be changed quickly so that even small batches can be produced using this robot-assisted material handling.

The user can change the order of the process steps easily using Mikado ARC

3D cameras capture the situation

The output data is crucial for optimum control of the robot. The integrator opts for suitable 3D camera technology according to the project and application. This decision depends not only on the general suitability of a method, but also on the cost, precision, speed, and reliable data collection.

The pros and cons of the classical methods such as time-of-flight (ToF), stereo vision, or laser triangulation can only be weighed up as an initial selection process. This is because many of the 3D cameras used today are hybrid systems, which use multiple process characteristics to cover a broader range of uses and improve the results.