This project proposes a low-cost, universal, and purely local gesture control scheme for
mobile phone screen projection games. Users only need to place their phones in a common stand and use the front camera to recognize left and right gestures and screen projection functions in real time. This allows users to control screen projection games (small games created based on these two gestures) without touching the screen while driving, achieving lightweight interaction between the driver and the car. Unlike existing solutions that rely on vehicle-grade cameras, this project is completely based on local computing power and does not upload any data, ensuring privacy and security without the need for vehicle reconstruction. Moreover, the project adds
vibration compensation and
smoothing filters to effectively solve the problem of users being unable to accurately control the screen with gestures in a bumpy car, as well as using screen projection technology to reduce eye strain and
motion sickness caused by small screens. Currently, this project has been implemented on Android phones such as OPPO and Huawei, with preliminary
adaptation tests underway.