Forbes, March 1, 2021. We have seen a rapid increase in the adoption of technology by Americans over the age of 65, and as prospects seek retirement communities, they’ll look for those that offer the latest technology, giving them comfort and peace of mind. Developers, owners and managers of communities need to be ready to answer the demand.
Deep Multimodal Embedding: Manipulating Novel Objects with Point-clouds, Language and Trajectories. ICRA, 2017. (finalist for ICRA Best cognitive robotics paper award)
A system operating in a real-world environment such as homes needs to perform reasoning with a variety of sensing modalities.
However, manually designing such features is extremely challenging. This work presents an algorithm to learn to embed point-cloud, natural language, and trajectory data into a shared embedding space using a deep neural network.