Robotics Lab


Design of an Intelligent Telerobotic System (KACST project AT-20-80)
(View Final Report)




At client station (View video)

  1. Human operator holding a 6DOF master arm
  2. operator sees the slave arm 3D scene using a Head Mounted Display (HMD)
  3. Operator feels the force feedback transmitted through the network and displaced on the master arm.

At server station

  • The slave arm (Puma 560) motion is a replica of master arm motion transmitted through the network.
  • A force sensor is installed at the slave arm wrist to detect the contact forces on the used object.
  • The slave server transmit to the client a real time stream of force information.
  • Two cameras are set with 6cm disparity (like human eyes) to monitor the slave scene.
  • The slave server transmit a real time stereo vision to the client.


  Peg-in-Hole Insertion Experiment
  • To avoid jamming forces, that appear during the insertion, slave arm is to move in the direction that reduces these forces
  • A local force regulation (server program) makes correction to the peg position & orientation to reduce the contact forces (View Video 1 & Video 2)
  • A remote force regulation (operator) adjusts the peg position to reduce displayed forces.
  • The main strategy of the insertion is to align peg and hole axes while pushing down the peg. (View Video)
  • The main strategy of the extraction is to align peg and hole axes while pulling up the peg. (View Video)


  Water Pouring
  • Pickup a cup filled with colored water and move it to vicinity of a target empty cup (View Video)
  • Operator twists the cap at nearly constant altitude to pour the water
  • Operator shifts his arm back into its dexterity area while freezing the slave arm (like a mouse function)
  • Now the operator can completely pour the water and withdraws the empty cup. (View Video)


   Assembly of a Water-Pump
  • A water pump consists of a metallic base, a motor, and a plastic cover.
  • First step is to slave arm pick up the motor, move it close to the metallic base, align its axes with that of the base, carry out the part-mating, and release the motor. (View Video)
  • Now we have a sub-assembly consisting of the base and the motor.
  • Second step is to have the slave arm picks up the plastic cover, align its axes with that of the sub-assembly, carry out the part -mating, and release the plastic cover.
  • Part-mating and axis alignment may fail (View Video)
  • Part-mating and axis alignment succeeded (View Video)
  • Now the assembly complete.


   Wire Wrapping Experiment (View video)
  • Space scalability allows to scale down the motion to a small space with higher accuracy
  • Wire-wrapping requires a gun is be inserted in a set of successive needles that are 2 mm distant from each other
  • Operator hand is to zero the mis-alignment error while avoiding jamming due to lateral contact of the tool head and needle
  • Reflected force feedback and stereo vision provide orthogonal information that complement each other
  • Space scalability allows a surgeon to carry out flexible operations inside the patient's body without open-surgery


   Opening/Closing Drawer Experiment
  • Operating the drawer may require multi-objective eye-hand motion coordination
  • To pull the drawer the operator hand is to move backward while avoiding lateral contact of the drawer (View video)
  • To remove a drawer from its container we must tilt it up and move its back down (View video)
  • To install the drawer we must tilt it up, inter its back wing, tilt it down, and push (View video)  


   Filling Wire in Needle Hole Experiment
  • Operator magnified a needle scene 80 times to see the needle hole and a wire bein held by a slave arm.
  • Tele-Operation using 3D visual for insrting a wire in the needle hole (View video).  


   Please see the following papers for more details: