Haptic Intelligence

Learning to Predict Perceptual Distributions of Haptic Adjectives

2020

Article

hi


When humans touch an object with their fingertips, they can immediately describe its tactile properties using haptic adjectives, such as hardness and roughness; however, human perception is subjective and noisy, with significant variation across individuals and interactions. Recent research has worked to provide robots with similar haptic intelligence but was focused on identifying binary haptic adjectives, ignoring both attribute intensity and perceptual variability. Combining ordinal haptic adjective labels gathered from human subjects for a set of 60 objects with features automatically extracted from raw multi-modal tactile data collected by a robot repeatedly touching the same objects, we designed a machine-learning method that incorporates partial knowledge of the distribution of object labels into training; then, from a single interaction, it predicts a probability distribution over the set of ordinal labels. In addition to analyzing the collected labels (10 basic haptic adjectives) and demonstrating the quality of our method's predictions, we hold out specific features to determine the influence of individual sensor modalities on the predictive performance for each adjective. Our results demonstrate the feasibility of modeling both the intensity and the variation of haptic perception, two crucial yet previously neglected components of human haptic perception.

Author(s): Benjamin A. Richardson and Katherine J. Kuchenbecker
Journal: Frontiers in Neurorobotics
Volume: 13
Pages: 1--16
Year: 2020
Month: February

Department(s): Haptic Intelligence
Research Project(s): Learning Haptic Adjectives from Tactile Data
Bibtex Type: Article (article)
Paper Type: Journal

DOI: 10.3389/fnbot.2019.00116
State: Published

BibTex

@article{Richardson20-FNR-Distributions,
  title = {Learning to Predict Perceptual Distributions of Haptic Adjectives},
  author = {Richardson, Benjamin A. and Kuchenbecker, Katherine J.},
  journal = {Frontiers in Neurorobotics},
  volume = {13},
  pages = {1--16},
  month = feb,
  year = {2020},
  doi = {10.3389/fnbot.2019.00116},
  month_numeric = {2}
}