Thursday 15 November 2018

vislearn setup

Sneak peak: automatic position learning using vision

Normally with RoboForth positions are programmed using a teach pad. In JOG mode the user moves the robot in increments over and then down onto the object to be picked up, maybe making small adjustments in X,Y,Z and gripper angle then clicks the learn button on screen.

ST Robotics have been working on using a camera to locate an object and send coordinates to the robot controller. This includes the correct angle for the gripper. The software then learns the position as a PLACE name. The actual coordinates of the object are not of interest. The system can return to the learned position under program control.
If the position changes it may be quickly re-learned using the same vision system.

The process of learning the position involves moving the robot with camera over the object until it is in the viewport of the vision system. Rather than use the teach pad a joystick is employed which allows for continuous motion in straight lines in X,Y and Z directions.

The picture above shows the development setup. Please see the video here:
https://www.youtube.com/watch?v=KxcdBjwoNvQ

Ultimately it will be possible to learn many different positions and have different objects.

Monday 5 February 2018

Talk to your robot!

Control of an ST robot is a man-machine conversation so why not use speech?

In reality you really need text to program anything complex but once programmed you could easily have a few voice commands. The speech engine we use is like the macro buttons on RobWin. You can say a single word but have the system send a whole string to the robot. Do see it in action:
https://www.youtube.com/watch?v=RTh_0ZR7-aE&t=1s