Robotic Perception / Industrial Computer Vision

Industry & robotics · Northern Navarre (Confidential client)

Computer vision for industrial robotics

Vision system capture: red beacon detected at close range, outlined in yellow, with 0.94 confidence and an estimated angle.Vision system capture: red beacon detected at a tilted position next to the cable, outlined in yellow, with 0.94 confidence.Vision system capture: red beacon detected head-on, outlined in yellow, with 0.93 confidence and an estimated angle of 0 degrees.Vision system capture: red beacon detected at mid range in front of a lattice structure, outlined in yellow.
Real captures of the system in operation.
  1. Camera
  2. Detection
  3. Spatial information
  4. Robotics integration

The challenge

At an industrial robotics company in northern Navarre, a robot needed to perceive its environment in order to interact with the elements on the line.

What we did

We developed a computer vision solution that identifies the elements and their positions so the robot can interact with them.

How it works

The camera captures the scene. The model detects objects and estimates their position. That information is passed to the robotic system to support the defined task.

Technologies

Python · Computer vision · OpenCV · Deep learning · Robotics

Result

The robot identifies and locates the elements to interact with them autonomously.

Validation depends on the task, objects and operating conditions. The result described here applies to this project's scope.