Immersive multimedia interaction device, system and method for children

Abstract

The invention discloses an immersive multimedia interaction device, system and method for children, and the device comprises a man-machine interaction device which is used for obtaining input instruction information and converting the instruction information into an interaction signal; the intelligent terminal is used for receiving the interaction signal and generating a video signal based on the interaction signal; and the projector is used for receiving the video signal and projecting the video signal to a target area. The problems that in existing multimedia teaching equipment, due to the fact that a blue light source is adopted by an LED lamp, vision is affected, obvious light reflection exists on a screen of an LCD screen, and the multimedia teaching equipment is low in integration level, poor in compatibility and complex in wiring are solved.

Description

Technical Field

[0001] The present invention relates to the field of multimedia interaction technology, and in particular to an immersive multimedia interaction device, system and method for children. Background Art

[0002] With the development of information technology, the integration of multimedia technology and teaching has attracted more and more attention. Multimedia teaching methods have entered kindergartens, injecting new vitality into early childhood education. The diversified teaching scenes and forms of multimedia teaching are loved by children and teachers.

[0003] Common products on the market at present: products that use LED and LCD screens as the main display tools, such as: LCD electronic black and white boards; intelligent learning all-in-one machines; LCD touch TVs; LED large screens, etc. Existing multimedia devices for young children have the following technical problems: 1. The backlight of the display screen of multimedia teaching equipment is white LED lamp. The light-emitting principle of white LED lamp is to coat a layer of yellow phosphor on the surface of blue light-emitting diode. Blue light is an active light source, so it is extremely strong and has high energy. Children are young and their eyeballs are not fully developed, so their vision is easily affected by the adverse external environment. Long-term exposure to this light source can easily cause eye fatigue and may also cause lesions in the macular area of ​​the eye.

[0004] 2. The reflection of multimedia teaching LCD screen is more obvious. The strong reflection will cause children to feel dizzy, distracted, tired and other discomforts. It will also damage the cornea and iris of children, and have different degrees of impact on children's physical, mental and academic performance.

[0005] 3. Multimedia teaching equipment has low integration, poor compatibility, complex wiring, and requires multiple switches and sockets to solve the problem of overall equipment operation, resulting in duplicate equipment purchases and waste of resources. Exposed wires and sockets pose great safety hazards to children and teachers.

[0006] Therefore, an immersive multimedia interactive device, system and method for children are provided to solve the problems in existing multimedia teaching equipment, such as the use of blue light sources in LED lamps that affect vision, obvious reflections on LCD screens, and low integration, poor compatibility and complex wiring of multimedia teaching equipment. Summary of the invention

[0007] To this end, the embodiments of the present invention provide an immersive multimedia interactive device, system and method for children, in order to at least partially solve the problems in existing multimedia teaching equipment, such as the use of blue light sources in LED lamps that affect vision, obvious reflections on LCD screens, and low integration, poor compatibility and complex wiring of multimedia teaching equipment.

[0008] In order to achieve the above objectives, the embodiments of the present invention provide the following technical solutions: The present invention provides an immersive multimedia interactive device for children, the device comprising: A human-computer interaction device, the human-computer interaction device is used to obtain input instruction information and convert the instruction information into an interaction signal; A smart terminal, the smart terminal is used to receive the interactive signal and generate a video signal based on the interactive signal; A projector is used to receive the video signal and project the video signal to a target area.

[0009] In some embodiments, the human-computer interaction device specifically includes: An infrared touch frame, the infrared touch frame is used to respond to touch information; An infrared transmitter, which is embedded in the frame and emits infrared rays when the infrared touch frame receives touch information; A receiver is used to receive the returned infrared rays.

[0010] In some embodiments, the intelligent terminal includes: A computer, the computer is used to process data, run software programs and manage files, and the computer is connected to the infrared touch control frame signal; A projector projects images and videos in a computer onto a screen or a wall to display information output by the computer.

[0011] The present invention also provides an immersive multimedia interactive system for children, the system comprising: A content layer, wherein the content layer has a plurality of interaction modules, each of which stores interaction content; The system layer is used to analyze and process touch information, and use the processed touch information to instruct the control device layer to change; The device layer has a plurality of intelligent terminals and controls the actions of the intelligent terminals according to the instructions generated by the system layer.

[0012] In some embodiments, the device layer includes at least: Customized smart terminals, speakers, interactive sensors and projectors.

[0013] In some embodiments, the system layer adopts the Android operating system.

[0014] The present invention also provides an immersive multimedia interaction method for children, characterized in that the method comprises: After the immersive multimedia is powered on and started, the infrared touch frame detects the touch area inside it in real time; When a child touches the infrared area, the number of touch points generated simultaneously is detected, and the information of these touch points is analyzed to infer their corresponding spatial coordinates; If the coordinate has a corresponding logical instruction in the UI interface, the instruction is executed and the UI changes accordingly.

[0015] The present invention also provides an electronic device, the electronic device comprising: a data acquisition device, a processor and a memory; The data acquisition device is used to acquire data; the memory is used to store one or more program instructions; and the processor is used to execute one or more program instructions to execute the method as described above.

[0016] The present invention also provides a computer-readable storage medium, wherein the computer-readable storage medium contains one or more program instructions, and the one or more program instructions are used to execute the method as described above.

[0017] The present invention also provides a computer program product, comprising a computer program, wherein when the computer program is executed by a processor, the method described above is implemented.

[0018] In one or more of the above specific embodiments, the immersive multimedia interactive device, system and method for children provided by the present invention have at least the following technical effects: 1. The projector uses diffuse reflection principle to form images, which is less harmful to the eyes than LCD screens. The diffuse reflection of the projector makes the light softer, can filter more blue light, and the screen size is larger without eye fatigue. There is no dizziness when watching for a long time, which effectively protects the eyesight of children; 2. It can be upward and downward compatible, solving the problem of poor compatibility between different software and different systems. The motherboard adopts the highly compatible Android RK3568 version, solving the problem of poor compatibility between different software and different systems, and effectively avoiding the problem of repeated purchase of kindergarten equipment and waste of resources; 3. High integration, good integrity, no complicated wiring, and an insulated device box that wraps the device as a whole, effectively avoiding the potential safety hazard of electric shock caused by accidental touch by young children, and ensuring the safety of children and teachers. Through the setting of the infrared interactive frame, the device can use the wall as the interactive space, effectively avoiding the possibility of the screen being broken due to improper interaction, which brings invisible safety problems to young children. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the implementation methods of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for the implementation methods or the description of the prior art. Obviously, the drawings in the following description are only exemplary, and for ordinary technicians in this field, other implementation drawings can be derived from the provided drawings without creative work.

[0020] The structures, proportions, sizes, etc. illustrated in this specification are only used to match the contents disclosed in the specification so as to facilitate understanding and reading by persons familiar with the technology. They are not used to limit the conditions under which the present invention can be implemented, and therefore have no substantial technical significance. Any structural modification, change in proportion or adjustment of size shall still fall within the scope of the technical contents disclosed in the present invention without affecting the effects and purposes that can be achieved by the present invention.

[0021] Figure 1 This is one of the structural schematic diagrams of the immersive multimedia interactive device for children provided by the present invention; Figure 2 This is a second structural schematic diagram of the immersive multimedia interactive device for children provided by the present invention; Figure 3 This is one of the structural block diagrams of the immersive multimedia interactive system for children provided by the present invention; Figure 4 This is the second structural block diagram of the immersive multimedia interactive system for children provided by the present invention. DETAILED DESCRIPTION

[0022] The following is a description of the implementation of the present invention by specific embodiments. People familiar with the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0023] Please refer to Figure 1 , Figure 1 This is one of the structural schematic diagrams of the immersive multimedia interactive device for children provided by the present invention.

[0024] The present invention provides an immersive multimedia interactive device for children, the device comprising: A human-computer interaction device, the human-computer interaction device is used to obtain input instruction information and convert the instruction information into an interaction signal; A smart terminal, the smart terminal is used to receive the interactive signal and generate a video signal based on the interactive signal; A projector is used to receive the video signal and project the video signal to a target area.

[0025] In some embodiments, Figure 2 As shown, the human-computer interaction device specifically includes an infrared touch box, a smart terminal, and a projector. Specifically, the infrared touch box is a common interactive device, which is mainly composed of an infrared transmitter and a receiver. The following is a detailed description of the structure of the infrared touch box, its working principle, and its input-output relationship and control relationship with other parts of the interactive device: In terms of structure, the infrared touch frame is generally composed of a frame and an internal infrared transmitter and receiver. The frame can be made of metal or plastic, and the transmitter and receiver are generally located around the frame or inside the frame.

[0026] In terms of working principle, when the user touches the infrared touch frame, the infrared transmitter will emit infrared rays, which will be reflected by the user's hand or other objects and received by the infrared receiver. The receiver will convert these signals into electrical signals and transmit them to the control circuit for processing. The control circuit will convert the signals into digital signals, perform calculations and judgments, and thus determine the user's operation intention.

[0027] The input-output relationship with other parts of the interactive device is that the infrared touch frame is mainly responsible for the user's input operation. It can be connected to computers and other devices and transmit the input data to these devices for processing. For example, when the user slides his finger on the infrared touch frame, the infrared touch frame will transmit the sliding track data to the computer and control the movement of the cursor in the computer.

[0028] In some embodiments, the intelligent terminal includes a computer, the computer is used to process data, run software programs and manage files, and the computer is connected to the infrared touch frame signal; A projector projects images and videos in a computer onto a screen or a wall to display information output by the computer.

[0029] The input-output relationship and control relationship between these devices are as follows: The projector is connected to the computer and projects images and videos through the signal output by the computer. There is no direct input and output relationship between the projector and the infrared touch box. The computer displays the output information on the screen or wall through the projector, receives the user's operation instructions through the infrared touch box, and performs relevant processing. The infrared touch box senses the user's touch operation and transmits the instruction to the computer through the USB cable signal. The computer receives the instruction and performs relevant operations.

[0030] The input and output relationships between the infrared touch frame, computer and projector are as follows: The infrared touch frame has no direct input / output relationship with the projector. The computer displays the output information on the screen or wall through the projector, which is a one-way output relationship. The projector has no direct input / output relationship with the computer.

[0031] In other words, the device is an integrated multimedia interactive device with independently developed terminal technology equipment as the core. Together with a cinema-grade high-lumen projector, a customized spatial interactive sensor device and an external speaker, it can build an immersive children's experience space.

[0032] The structure of the self-developed equipment consists of: power control, interactive device, display unit, intelligent terminal, insulation equipment box, multimedia unit; Functional modules: unified desktop system module, interactive experience module, authorization module, remote update module Control logic: The smart terminal projects the display signal onto the interactive wall through the projector, and the user interaction data is returned to the smart terminal through the infrared touch frame for processing, and the feedback information is reflected on the projection interface; Interaction strategy: real-time interactive response.

[0033] The present invention also provides an immersive multimedia interactive system for children, such as Figure 3 As shown, the system comprises: A content layer, wherein the content layer has a plurality of interaction modules, each of which stores interaction content; The system layer is used to analyze and process touch information, and use the processed touch information to instruct the control device layer to change.

[0034] The device layer has a plurality of intelligent terminals and controls the actions of the intelligent terminals according to the instructions generated by the system layer.

[0035] In some embodiments, the device layer includes at least: Customized smart terminals, speakers, interactive sensors and projectors.

[0036] In some embodiments, the system layer adopts the Android operating system.

[0037] In a specific usage scenario, the system is divided into an intelligent device layer, an intermediate system layer, and a multi-content layer. The intelligent device layer is based on the independently developed intelligent terminal device, and a set of customized integrated intelligent hardware is designed. It is small in size and light in weight. It uses the ROCKCHIP RK3568 64-bit Cortex-A55 processor to provide powerful computing power guarantee. Based on this device as the center, the spatial interactive sensor device, high-lumen projector, and external speaker are connected together. The content is projected onto a flat wall through the projector, and an immersive experience environment is created together with the speaker. The device adopts the form of an infrared touch frame and can be installed on any flat wall in the space, converting the flat wall into a plane that can be touched and interacted with. At the same time, in order to ensure the quality of interaction, the accuracy and sensitivity of the device are improved, overcoming the phenomenon of untimely interactive feedback of similar products on the market.

[0038] In the middle system layer, the Android operating system is customized based on the terminal to make its operation more convenient. Users can directly select and enter the selected content module, hide and delete other content, which is more suitable for the use environment. Users can select the required content more quickly.

[0039] In the multi-content layer, we have independently developed a series of content for young people, including: scientific exploration enlightenment, artificial intelligence enlightenment, physical intelligence AI, patriotism education, art theme interaction, sports theme interaction and other content. Artificial intelligence interactive technology is used to create rich and vivid scientific practice scenes, so that scientific topics that cannot be explored in real life (such as the universe, the seabed, etc.) can also be presented in full scenes, helping children to recognize and explore scientific phenomena in immersive and interactive games. The course content covers a wide range of topics and keeps pace with the times. In addition to natural sciences, life sciences, and marine sciences, it also introduces the exploration of cutting-edge science and technology to help children establish a scientific outlook and look at the world from a scientific perspective.

[0040] like Figure 4 As shown, an immersive multimedia interaction method for children, the method comprising the following steps: After the immersive multimedia is powered on and started, the infrared touch frame detects the touch area inside it in real time; When a child touches the infrared area, the number of touch points generated simultaneously is detected, and the information of these touch points is analyzed to infer their corresponding spatial coordinates; If the coordinate has a corresponding logical instruction in the UI interface, the instruction is executed and the UI changes accordingly.

[0041] In one or more of the above specific embodiments, the immersive multimedia interactive device, system and method for children provided by the present invention have at least the following technical effects: 1. The projector uses diffuse reflection principle to form images, which is less harmful to the eyes than LCD screens. The diffuse reflection of the projector makes the light softer, can filter more blue light, and the screen size is larger without eye fatigue. There is no dizziness when watching for a long time, which effectively protects the eyesight of children; 2. It can be compatible with different versions of Android systems 10, 11, and 12, solving the problem of poor system compatibility and effectively avoiding repeated purchase of kindergarten equipment and waste of resources; 3. High integration, good integrity, simplified installation process, and an insulated device box that wraps the device as a whole, effectively avoiding the potential safety hazard of electric shock caused by accidental touch by young children, and ensuring the safety of children and teachers. Through the setting of the infrared interactive frame, the device can use the wall as the interactive space, effectively avoiding the possibility of the screen being broken due to improper interaction, which brings invisible safety problems to young children.

[0042] The present invention also provides an electronic device, the electronic device comprising: a data acquisition device, a processor and a memory; The data acquisition device is used to acquire data; the memory is used to store one or more program instructions; and the processor is used to execute one or more program instructions to execute the method as described above.

[0043] Corresponding to the above embodiment, an embodiment of the present invention further provides a computer-readable storage medium, which contains one or more program instructions. The one or more program instructions are used to be executed by a binocular camera depth calibration system as described above.

[0044] Corresponding to the above embodiment, an embodiment of the present invention further provides a computer program product, including a computer program, and when the computer program is executed by a processor, the above method is implemented.

[0045] In the embodiment of the present invention, the processor may be an integrated circuit chip having the ability to process signals. The processor may be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components.

[0046] The methods, steps and logic block diagrams disclosed in the embodiments of the present invention can be implemented or executed. The general processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the embodiments of the present invention can be directly embodied as a hardware decoding processor for execution, or can be executed by a combination of hardware and software modules in the decoding processor. The software module can be located in a mature storage medium in the field such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The processor reads the information in the storage medium and completes the steps of the above method in combination with its hardware.

[0047] The storage medium may be a memory, which may be, for example, a volatile memory or a nonvolatile memory, or may include both volatile and nonvolatile memory.

[0048] Among them, the non-volatile memory can be a read-only memory (ROM), a programmable ROM (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory.

[0049] The volatile memory may be a random access memory (RAM) which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct RAM bus random access memory (DRRAM).

[0050] The storage media described in the embodiments of the present invention are intended to include, but are not limited to, these and any other suitable types of memory.

[0051] Those skilled in the art will appreciate that in one or more of the above examples, the functions described in the present invention can be implemented using a combination of hardware and software. When software is used, the corresponding functions can be stored in a computer-readable medium or transmitted as one or more instructions or codes on a computer-readable medium. Computer-readable media include computer-readable storage media and communication media, wherein communication media include any media that facilitates the transmission of computer programs from one place to another. The storage medium can be any available medium that can be accessed by a general or special-purpose computer.

[0052] The above specific implementation methods further illustrate the purpose, technical solutions and beneficial effects of the present invention in detail. It should be understood that the above are only specific implementation methods of the present invention and are not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc. made on the basis of the technical solutions of the present invention should be included in the scope of protection of the present invention.

Claims

1. An immersive multimedia interactive device for children. It is characterized in that The device comprises: A human-computer interaction device, the human-computer interaction device is used to obtain input instruction information and convert the instruction information into an interaction signal; A smart terminal, the smart terminal is used to receive the interactive signal and generate a video signal based on the interactive signal; A projector is used to receive the video signal and project the video signal to a target area.

2. The immersive multimedia interactive device for children according to claim 1, It is characterized in that The human-computer interaction device specifically comprises: An infrared touch frame, the infrared touch frame is used to respond to touch information; An infrared transmitter, which is embedded in the frame and emits infrared rays when the infrared touch frame receives touch information; A receiver is used to receive the returned infrared rays.

3. The immersive multimedia interactive device for children according to claim 2, It is characterized in that The intelligent terminal comprises: A computer, the computer is used to process data, run software programs and manage files, and the computer is connected to the infrared touch control frame signal; A projector projects images and videos in a computer onto a screen or a wall to display information output by the computer.

4. An immersive multimedia interactive system for children, It is characterized in that The system comprises: The content layer has a plurality of recognition modules, each of which can detect the touch information conveyed by the experiencer in real time; The system layer is used to analyze and process touch information, and use the processed touch information to instruct the control device layer to change; The device layer has a plurality of intelligent terminals and conveys and displays actions that the intelligent terminals should take according to the touch control instructions generated by the system layer.

5. The immersive multimedia interactive system for children according to claim 4, It is characterized in that The device layer at least includes: Customized smart terminals, speakers, interactive sensors and projectors.

6. The immersive multimedia interactive system for children according to claim 4, It is characterized in that The system layer adopts the Android operating system.

7. An immersive multimedia interactive method for children, It is characterized in that The method comprises: After the immersive multimedia is powered on and started, the infrared touch frame detects the touch area inside it in real time; When a child touches the infrared area, the number of touch points generated simultaneously is detected, and the information of these touch points is analyzed to infer their corresponding spatial coordinates; If the coordinate has a corresponding logical instruction in the UI interface, the instruction is executed and the UI changes accordingly.

8. An electronic product, It is characterized in that The electronic product includes: a data acquisition device, a processor and a memory; The data acquisition device is used to acquire data; the memory is used to store one or more program instructions; and the processor is used to execute one or more program instructions to execute the method as claimed in claim 7.

9. A computer-readable storage medium, It is characterized in that The computer-readable storage medium contains one or more program instructions, and the one or more program instructions are used to execute the method according to claim 7.

10. A computer program product comprising a computer program, It is characterized in that When the computer program is executed by a processor, the method according to claim 7 is implemented.

Images