This technology enables users to send and receive touch sensations during video calls using face-worn haptic devices and AI gesture recognition, making remote communication more emotionally engaging by simulating human touch in real time.
Background: The field of digital communication has seen rapid advancements, with video conferencing platforms becoming essential tools for personal, educational, and professional interactions. Despite improvements in audio and visual fidelity, these platforms still cannot convey the sense of touch, a fundamental aspect of human connection. The absence of tactile feedback in remote communication can lead to emotional detachment and a diminished sense of presence, especially for vulnerable populations such as the elderly, children, or patients in isolation. As society increasingly relies on remote interactions, there is a growing need for technologies that can bridge the sensory gap and foster more meaningful, emotionally resonant connections across distances. Current approaches to remote communication focus primarily on visual and auditory channels, offering little to no support for the transmission of tactile sensations. While some research has explored haptic feedback in virtual reality or specialized telepresence systems, these solutions are often bulky, expensive, or impractical for everyday use. Mainstream video conferencing applications do not natively support haptic integration, and existing wearable haptic devices tend to be limited in their functionality, comfort, or ease of use. As a result, users are left with a communication experience that feels incomplete, lacking the emotional nuance and intimacy that touch can provide. This gap is particularly problematic in scenarios where emotional support and human connection are critical, highlighting the limitations of current technologies and the pressing need for more accessible, user-friendly solutions that can bring the sense of touch into digital interactions.
Technology Overview: This technology is a comprehensive system designed to bring the sense of touch to video conferencing, enhancing remote communication with real-time, bi-directional vibrotactile feedback. It features a compact, face-worn haptic device that attaches to the user's cheeks, utilizing Electromagnetic Rotation Motors (ERMs) or Linear Resonant Actuators (LRAs) for precise tactile sensations. The device connects wirelessly via Bluetooth to a custom video conferencing application, which manages the seamless transmission of touch signals. Advanced AI-driven gesture recognition, powered by Google’s Mediapipe Hand Gesture Detection, enables users to send intuitive tactile cues through simple hand gestures. These gestures are translated into specific vibrotactile and audio feedback, which is delivered instantly to the remote participant’s haptic device, creating a multi-sensory communication experience over a real-time video platform using WebRTC. What differentiates this solution is its holistic integration of hardware, software, and AI to address the emotional disconnect often experienced in digital communication. Unlike traditional video calls that rely solely on visual and auditory cues, this system introduces a tangible sense of presence by enabling users to physically "feel" gestures from afar. The focus on the cheeks for haptic feedback is both practical and emotionally resonant, as this area is highly expressive and visible during calls. The use of commercially available actuators ensures affordability and scalability, while the AI-based gesture recognition makes the system intuitive and accessible. By bridging the gap between physical and digital interaction, this technology stands out as a user-friendly, cost-effective, and emotionally supportive solution, with broad applications in personal communication, healthcare, elderly care, and education.
https://suny.technologypublisher.com/files/sites/adobestock_374889541.jpeg Photo for reference only, not a depiction of the invention.
Advantages: • Enables real-time, bi-directional tactile communication during video calls, enhancing emotional connection. • Uses compact, face-worn haptic devices that are wireless and comfortable for users. • Incorporates AI-based gesture recognition for intuitive, natural control of haptic feedback. • Improves the quality of remote interactions by adding a sense of touch, reducing feelings of disconnection. • Supports diverse applications including personal communication, healthcare, elderly care, and education. • Cost-effective and scalable solution leveraging commercially available actuators and standard wireless technology. • Integrates seamlessly with custom video conferencing software using WebRTC for real-time communication.
Applications: • Emotionally enhanced remote family calls • Virtual patient support in healthcare • Elderly remote companionship services • Childcare video calls with touch
Intellectual Property Summary: Patent Pending
Stage of Development: TRL 2
Licensing Status: This technology is available for licensing.