Enabling Human Activity Learning by MachineKnitted Whole-Garment Sensing Wearables

Systems and methods are provided for estimating 3D poses of a subject based on tactile interactions with the ground. Test subject interactions with the ground are recorded using a sensor system along with reference information (e.g., synchronized video information) for use in correlating tactile information with specific 3D poses, e.g., by training a neural network based on the reference information. Then, tactile information received in response to a given subject interacting with the ground can be used to estimate the 3D pose of the given subject directly, ie., without reference to corresponding reference information. Certain exemplary embodiments use a sensor system in the form of a pressure sensing carpet or mat, although other types of sensor systems using pressure or other sensors can be used in various alternative embodiments.

Researchers

Wojciech Matusik / Tomas Palacios / Antonio Torralba / Michael Foshey / Wan Shou / Yiyue Luo / Pratyusha Sharma / Yunzhu Li

Departments: Dept of Electrical Engineering & Computer Science, Electrical Eng & Computer Sci
Technology Areas: Artificial Intelligence (AI) and Machine Learning (ML) / Chemicals & Materials: Fabrics & Textiles / Industrial Engineering & Automation: Manufacturing & Equipment / Sensing & Imaging: Imaging
Impact Areas: Healthy Living

  • systems and methods for estimating 3d position and movement from tactile signals
    United States of America | Published application

License this technology

Interested in this technology? Connect with our experienced licensing team to initiate the process.

Sign up for technology updates

Sign up now to receive the latest updates on cutting-edge technologies and innovations.