Skip to content
  • Our Work
    • Fields
      • Cardiology
      • ENT
      • Gastro
      • Orthopedics
      • Ophthalmology
      • Pulmonology
      • Surgical Intelligence
      • Surgical Robotics
      • Urology
      • Other
    • Modalities
      • Endoscopy
      • Medical Segmentation
      • Microscopy
      • Ultrasound
  • Success Stories
  • Insights
    • Magazine
    • Upcoming Events
    • Webinars
    • Meetups
    • News
    • Blog
  • The company
    • About us
    • Careers
Menu
  • Our Work
    • Fields
      • Cardiology
      • ENT
      • Gastro
      • Orthopedics
      • Ophthalmology
      • Pulmonology
      • Surgical Intelligence
      • Surgical Robotics
      • Urology
      • Other
    • Modalities
      • Endoscopy
      • Medical Segmentation
      • Microscopy
      • Ultrasound
  • Success Stories
  • Insights
    • Magazine
    • Upcoming Events
    • Webinars
    • Meetups
    • News
    • Blog
  • The company
    • About us
    • Careers
Contact

Robots Using Machine Vision in Retail

Robots are already being used in the retail industry. Major applications of such robots will be explained in this article. Some of their functionalities are available today, while other still represent a challenge.

 

Robots working with boxes

Robotics tasks using Machine Vision in Retail

Robotic automation can be found in shipment and distribution centers where they perform picking, sorting and packaging activities. These tasks are a natural evolution of automated warehouses – to which robots move in order to store and retrieve items.

Identification of objects (aka object recognition) is performed by a machine learning classifier along with OCR recognition of the attached text. Since the objects are not necessarily located and oriented in the optimal way for the robot’s cameras – a CNN classifier is used to identify clues of textual and visual features. Mobile robots navigate in a space where other robots are operating, thus requiring real-time update of their environment perception. The navigation system, using a highly capable real-time CNN classifier, updates the 3D environment model of the robot. This process enables autonomously navigating robots to respond to the increasing popularity of internet commerce.

Customer service

Customer service is a relatively new domain among robots functions. They take a form similar to human in order to ease their acceptance by customers. Assistance in item finding, promotions update and even advice customers are just few services the robots provide. Future robots, servicing customers in shops will be able to communicate in natural language using the latest machine learning technologies.

Machine vision functions for customer service are principally object recognition and face recognition. The object recognition is used when a customer is looking for a spare part or any similar object. The object is held in the front of the robot and captured by the robot cameras. A deep-learning based classifier can usually recognize the objects with a very high performance. In the same way, face recognition of the customer (as performed by the robot) can help the robot itself to handle the customer in a more specifically tailored manner (learned from previous visits and other information sources).

Robot navigation is the main challenge: in addition to map-driven navigation (directing customers to items on the shelves) the robot should avoid people and obstacles. At the same time, it should be in-touch with the served customers. Machine vision which performs 3D environment classification and data fusion of cameras stream are supported by CNN classifier. Deep learning training may be more effective with department- specific training: for example, the effect of learning in a fashion department is quite different from that of learning in a hardware department.

Store inventory management

Another application of robots is store inventory management: mobile robots in retail stores continuously scan shelves, count available product items, notify of any problem in the order or price and update the store back-end for action. Product availability and the right price are most important for the customer and robots can provide it.

Machine vision algorithms used for Store inventories management include an OCR function to recognize item codes and prices. Since items may be of any form factor and not necessarily facing directly to the robot’s cameras, a machine vision pre-process is required. Text areas should be undistorted and with good enough definition (contrast, size, intensity, color and so on). Algorithms solving image deformation, as well as image processing methods are employed (see our upcoming article on robots using OCR). Of course, navigation and obstacles overcoming capabilities are also essential. The navigation is more straightforward – scanning the shelves along the isles using map navigation. However, shoppers and their carts must still be avoided. For this purpose, a deep learning classifier assists in building the 3D robot’s environment.

RSIP Vision is already engaged with robotic applications. We are experienced with CNN classifiers, object detection using deep learning and OCR applications.

Share

Share on linkedin
Share on twitter
Share on facebook

Related Content

Percutaneous Nephrolithotomy

PCNL – Planning and real-time navigation

Prostate Tumor Segmentation

Implementing AI to Improve PI-RADS Scoring

RAS Navigation

Tissue Sparing in Robotic Assisted Orthopedic Surgeries

Procedural Planning in urology

Procedural Planning in Urology

C Arm X-Ray Machine Scanner

Radiation Reduction in Robotic Assisted Surgeries (RAS) Using AI

Visible spectrum color

Hyperspectral Imaging for Robotic Assisted Surgery

Percutaneous Nephrolithotomy

PCNL – Planning and real-time navigation

Prostate Tumor Segmentation

Implementing AI to Improve PI-RADS Scoring

RAS Navigation

Tissue Sparing in Robotic Assisted Orthopedic Surgeries

Procedural Planning in urology

Procedural Planning in Urology

C Arm X-Ray Machine Scanner

Radiation Reduction in Robotic Assisted Surgeries (RAS) Using AI

Visible spectrum color

Hyperspectral Imaging for Robotic Assisted Surgery

Show all

RSIP Vision

Field-tested software solutions and custom R&D, to power your next medical products with innovative AI and image analysis capabilities.

Read more about us

Get in touch

Please fill the following form and our experts will be happy to reply to you soon

Recent News

PR – Intra-op Virtual Measurements in Laparoscopic and Robotic-Assisted Surgeries

PR – Non-Invasive Planning of Coronary Intervention

PR – Bladder Panorama Generator and Sparse Reconstruction Tool

PR – Registration Module for Orthopedic Surgery

All news
Upcoming Events
Stay informed for our next events
Subscribe to Our Magazines

Subscribe now and receive the Computer Vision News Magazine every month to your mailbox

 
Subscribe for free
Follow us
Linkedin Twitter Facebook Youtube

contact@rsipvision.com

Terms of Use

Privacy Policy

© All rights reserved to RSIP Vision 2021

Created by Shmulik

  • Our Work
    • title-1
      • Ophthalmology
      • Uncategorized
      • Ophthalmology
      • Pulmonology
      • Cardiology
      • Orthopedics
    • Title-2
      • Orthopedics
  • Success Stories
  • Insights
  • The company