LG Gesture and Voice control

Improve the control of the LG with voice commands, body poses, and hand gestures

The LG Gesture & Voice Control project is a comprehensive initiative that seeks to enhance the Liquid Galaxy Rig's control capabilities by incorporating advanced interaction methods, such as voice commands, body poses, and hand gestures. Developed as a Flutter application, this project harnesses cutting-edge technologies, including Mediapipe, ML Kit, and Voice Recognition, to revolutionize how users interact with the Liquid Galaxy Rig.

The Liquid Galaxy Rig is a sophisticated multi-screen system that offers a captivating panoramic viewing experience. Traditionally, controlling such a complex system has often relied on conventional input methods. However, the LG Gesture & Voice Control project challenges this norm by introducing innovative and intuitive modes of interaction.

Created using Flutter, its capabilities enable the creation of a seamless and visually appealing interface that serves as the foundation for gesture and voice control functionalities. This cross-platform nature ensures that the benefits of this project can be enjoyed across multiple devices and operating systems.

Mediapipe, a robust open-source framework developed by Google, plays a pivotal role in this project. It provides a rich set of tools for building applications that involve perception-based tasks, including gesture and pose recognition. By integrating Mediapipe's capabilities, the LG Gesture & Voice Control project can accurately track hand gestures and body poses, translating them into actionable commands for the Liquid Galaxy Rig. This allows users to manipulate and navigate the system using natural movements.

The project bridges the gap between humans and machines by seamlessly blending gesture recognition, voice commands, and intuitive user interfaces. Users can easily navigate the Liquid Galaxy Rig, simplifying complex tasks and amplifying the system's accessibility.

The potential applications of the LG Gesture & Voice Control project are diverse. From educational presentations and interactive exhibitions to artistic displays and immersive entertainment experiences, the project opens doors to new modes of engagement.

LG Gesture & Voice Control underscores the dynamic nature of human-computer interaction. The fusion of Flutter, Mediapipe, ML Kit, and voice recognition technology showcases modern development tools' capabilities and paves the way for future advancements in user experience design.