Interactive learning system and operation method

Abstract

This invention discloses an interactive learning system and its operation method. The interactive learning system includes a central server, an embedded processing unit, an image projection device, an audio output device, and an image capturing device. The central server is configured to generate and store interactive picture book images and sound signals, wherein the interactive picture book images correspond to the sound signals. The image projection device projects the interactive picture book images onto a display surface. The audio output device is configured to play sound signals, and the embedded processing unit controls the audio output device to play sound signals according to the interactive picture book images. The image capturing device is configured to receive user gesture signals and transmit the gesture signals to the embedded processing unit. The embedded processing unit dynamically adjusts the content of the interactive picture book images and the sound signals according to the gesture signals.

Claims

1. An interactive learning system, comprising: A central server is configured to generate and store multiple interactive picture book images and multiple sound signals, wherein each interactive picture book image corresponds to a specific sound signal; an embedded processing unit is connected to the central server via a web interface, and is configured to receive the multiple interactive picture book images and multiple sound signals transmitted by the central server; an image projection device is connected to the embedded processing unit, and is configured to receive the multiple interactive picture book images transmitted by the embedded processing unit and project the multiple interactive picture book images onto a display surface; an audio output device is connected to the embedded processing unit, and is configured to receive the multiple sound signals transmitted by the embedded processing unit and to play the multiple sound signals, wherein the embedded processing unit controls the audio output device to play each sound signal according to each interactive picture book image; An image capturing device connected to an embedded processing unit is configured to receive multiple gesture signals from multiple users and to transmit these gesture signals to the embedded processing unit. The embedded processing unit dynamically adjusts the content of each interactive picture book image and each sound signal based on the gesture signals. A microphone is configured to simulate the voice characteristics of multiple characters in sub-images of the content of the interactive picture book image based on a speech imitation and synthesis method. A central server generates the content of each interactive picture book image and each sound signal based on multiple prompts, wherein the multiple prompts are configured to generate sub-images of the content of each interactive picture book image and sub-sound signals of each sound signal. The image capturing device identifies a gesture and finger distance using computer vision and depth sensing to simulate mouse movement and clicking.

2. The interactive learning system as described in claim 1, wherein, The image projection device projects multiple interactive picture book images onto the display surface, which may include a table or a wall.

3. The interactive learning system as described in claim 1, wherein, The embedded processing unit controls the audio output device to play the audio signals according to the content of each interactive picture book image.

4. The interactive learning system as described in claim 1, wherein, The image capturing device is configured to receive multiple gesture signals from the multiple users to play, stop, or change pages of the content of each interactive picture book image.

5. An operating method applicable to an interactive learning system, the interactive learning system including a central server, an embedded processing unit, an image projection device, an audio output device, an image capture device, and a microphone, wherein the embedded processing unit is connected to the central server via a web interface, the image projection device is connected to the embedded processing unit, the audio output device is connected to the embedded processing unit, and the image capture device is connected to the embedded processing unit, the operating method including: A central server is configured to generate and store multiple interactive picture book images and multiple sound signals, wherein each interactive picture book image corresponds to a specific sound signal; an embedded processing unit is configured to receive the multiple interactive picture book images and multiple sound signals transmitted by the central server; an image projection device receives the multiple interactive picture book images transmitted by the embedded processing unit and projects the multiple interactive picture book images onto a display surface; an audio output device receives the multiple sound signals transmitted by the embedded processing unit and is configured to play the multiple sound signals, wherein the embedded processing unit controls the audio output device to play each sound signal according to each interactive picture book image; The image capturing device is configured to receive multiple gesture signals from multiple users, and transmits these gesture signals to the embedded processing unit. The embedded processing unit dynamically adjusts the content of each interactive picture book image and each sound signal based on the gesture signals. A microphone is configured to simulate the voice characteristics of multiple characters in sub-images of the content of the interactive picture book image based on a speech imitation and synthesis method. A central server generates the content of each interactive picture book image and each sound signal based on multiple prompts, wherein the multiple prompts are configured to generate sub-images of the content of each interactive picture book image and sub-sound signals of each sound signal. The image capturing device identifies a gesture and finger distance using computer vision and depth sensing to simulate mouse movement and clicking.

6. The operating method as described in claim 5, wherein, The image projection device projects multiple interactive picture book images onto the display surface, which may include a table or a wall.

7. The operating method as described in claim 5, wherein, The embedded processing unit controls the audio output device to play the audio signals according to the content of each interactive picture book image.

8. The operating method as described in claim 5, wherein, The image capturing device is configured to receive multiple gesture signals from the multiple users to play, stop, or change pages of the content of each interactive picture book image.

Images