Projection interaction equipment
By using multimodal fusion technology in projection interaction devices, the problem of single-function projection devices has been solved, enabling multi-person interaction and immersive experience, and improving the naturalness and efficiency of human-computer interaction.
Patent Information
- Application Number
- CN202520268950.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Utility models(China)
- Current Assignee / Owner
- Filing Date
- 2025-02-19
- Publication Date
- 2026-02-06
- Estimated Expiration
- 2035-02-19
AI Technical Summary
Existing projection equipment has limited functionality, lacks multi-user interaction capabilities, and offers a poor immersive experience.
It employs a combination of image acquisition module, sound acquisition module, projection optical engine and speaker, and processes images and sound through processor to achieve multimodal fusion of vision, hearing and projection. Combined with microphone array and depth camera for voice localization, it enhances human-computer interaction capabilities.
It significantly improves the naturalness and efficiency of human-computer interaction, enabling natural voice interaction and visual effects in multi-person gatherings, thereby enhancing users' immersion and participation.
Smart Images
Figure CN223885243U_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present disclosure relates to the field of projection technology, in particular to a projection interaction device. BACKGROUND
[0002] The projection device is a kind of multimedia device, which is widely used in daily life. With the continuous development of science and technology, its application scenarios are also more and more widely, such as family, office, school and entertainment place.
[0003] However, the projection device in the prior art is still relatively traditional, with single function and single structure, and does not have the ability to interact with multiple people in the process of organizing meetings or games, and the immersive experience effect is poor. CONTENT OF THE INVENTION
[0004] The present disclosure provides a projection interaction device to at least solve the above technical problems existing in the prior art.
[0005] According to the projection interaction device provided by the present disclosure, the main body includes an image acquisition module, a sound acquisition module, a projection light machine, a loudspeaker and a processor, wherein,
[0006] The image acquisition module and the sound acquisition module, the projection light machine are arranged on the first surface of the main body, and the loudspeaker is arranged on at least one second surface of the main body.
[0007] The processor is electrically connected with the image acquisition module, the sound acquisition module, the projection light machine and the loudspeaker, and is used for determining a projection image and a guide voice according to the image collected by the image acquisition module and / or the user sound collected by the sound acquisition module, and projecting the projection image via the projection light machine and playing the guide voice via the loudspeaker.
[0008] In an implementable manner, the sound acquisition module is a microphone array, which is arranged around the image acquisition module at a preset position.
[0009] In an implementable manner, the image acquisition module includes at least one camera and a depth camera, the at least one camera, the depth camera and the projection light machine are located at the same orientation, and each included angle is not greater than 10 degrees.
[0010] In an implementable manner, the device further includes:
[0011] A light source module is arranged at the edge position of the first surface of the main body.
[0012] The processor is further used for controlling the color and brightness of the light source module.
[0013] In an implementation, the speaker is further configured to play preset sound effects.
[0014] In an implementation, a recess is formed in a center of a first surface of the main body, and the image acquisition module and the projection light machine are embedded in the recess.
[0015] In an implementation, the recess is provided with a telescopic support and a telescopic platform, the telescopic support is fixedly connected with the telescopic platform, and the image acquisition module and the projection light machine are arranged in the telescopic platform.
[0016] In an implementation, the device further comprises:
[0017] a heat dissipation module arranged at an opening position of a third surface of the main body.
[0018] In an implementation, the heat dissipation module comprises a heat dissipation device and a temperature control device.
[0019] The processor is further configured to control switching of the heat dissipation device according to a temperature in the main body detected by the temperature control device.
[0020] In an implementation, the device further comprises:
[0021] a communication module configured to receive files and instructions sent by a user;
[0022] a control panel provided with a plurality of keys for use by the user.
[0023] a power supply configured to supply power to the main body.
[0024] The present disclosure provides a projection interaction device, which comprises a main body, and the main body comprises an image acquisition module, a sound acquisition module, a projection light machine, a speaker and a processor. The image acquisition module and the sound acquisition module are arranged on a first surface of the main body, the speaker is arranged on at least one second surface of the main body, and the processor is electrically connected with the image acquisition module, the sound acquisition module, the projection light machine and the speaker. The processor is configured to determine a projection image and a guide voice according to an image acquired by the image acquisition module and / or a user sound acquired by the sound acquisition module, project the projection image via the projection light machine, and play the guide voice via the speaker, so as to realize multi-modal fusion of visual, auditory and projection interactions, and significantly improve naturalness and efficiency of human-computer interaction.
[0025] It should be appreciated that the description set forth in this section is not intended to identify key or essential features of an embodiment of the disclosure, nor is it intended to limit the scope of the disclosure. Other features of the disclosure will be apparent from review of the disclosure, both hereinafter and in the drawings. BRIEF DESCRIPTION OF DRAWINGS
[0026] The above and other objects, features and advantages of the present disclosure exemplary embodiments will be more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which:
[0027] In the drawings, the same or similar numerals indicate the same or similar parts.
[0028] Figure 1 A structural schematic diagram of a projection interaction device provided by an embodiment of the present disclosure is shown;
[0029] Figure 2 A physical schematic diagram of an exemplary projection interaction device provided by an embodiment of the present disclosure is shown;
[0030] Figure 3 A schematic diagram of an application scenario of a projection interaction device provided by an embodiment of the present disclosure is shown. DETAILED DESCRIPTION
[0031] In order to make the purposes, characteristics and advantages of the present disclosure more obvious and easy to understand, the technical solutions in the embodiments of the present disclosure will be described clearly and completely below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, rather than all the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by those skilled in the art without creative work fall within the scope of protection of the present disclosure.
[0032] Figure 1 A structural schematic diagram of a projection interaction device provided by an embodiment of the present disclosure includes a host body 100, which includes a processor 110, an image acquisition module 120, a sound acquisition module 130, a projection light machine 140 and a loudspeaker 150, wherein,
[0033] The image acquisition module 120 and the sound acquisition module 130 and the projection light machine 140 are arranged on a first surface of the host body 100; the loudspeaker 150 is arranged on at least one second surface of the host body 100;
[0034] The processor 110 is electrically connected with the image acquisition module 120, the sound acquisition module 130, the projection light machine 140 and the loudspeaker 150, for determining a projection image and a guide voice according to the image acquired by the image acquisition module 120 and / or the user sound acquired by the sound acquisition module 130, projecting the projection image via the projection light machine 140, and playing the guide voice via the loudspeaker 150.
[0035] Since the projection interaction device can be diversified designed according to specific application scenarios and portability requirements, the host body 100 of the projection interaction device can be in various shapes, for example, can be a cuboid, a cube, an ellipsoid and a portable folding body.
[0036] The image acquisition module 120 can be an electronic device containing an optical lens and an image sensor, for capturing images, or user gestures, user facial expressions and user actions within a region set by the user. The sound acquisition module 130 can acquire sound information of the on-site user. The projection light machine 140 can be a device that projects images, text or video signals onto a screen or other plane through optical principles to realize the magnification and display of images. The loudspeaker 150 is used to play guide voice in appropriate situations or to play sound effects and music in accordance with the scene atmosphere.
[0037] The processor 110 can be a small computer, for calculating according to the image acquired by the image acquisition module 120 and / or the user sound acquired by the sound acquisition module 130; and can also perform targeted information processing according to different interaction contents selected by the user in the scene where the projection interaction device is used. For example, if the projection interaction device is used in the "Werewolf" table game scene in the embodiment, the processor 110 can process the received sound and image according to the "Werewolf" interaction content, and can create different atmospheres at different game nodes and output different guide voices.
[0038] Specifically, the image acquisition module 120 in the embodiment can be disposed on the first surface of the host body 100 together with the sound acquisition module 130 and the projection light machine 140. In addition, one loudspeaker 150 can be disposed on a second surface of the host body 100, or a plurality of loudspeakers 150 can be disposed on a plurality of second surfaces of the host body 100, and the plurality of second surfaces can be opposite surfaces or adjacent surfaces.
[0039] Specifically, the processor 110 is electrically connected with the image acquisition module 120, the sound acquisition module 130, the projection light machine 140 and the loudspeaker 150, and can be used to determine a projection image according to an image acquired by the image acquisition module 120 and project the projection image through the projection light machine 140. For example, if the projection interaction device is used in a "Werewolf" table game scene, the projection image to be projected around each card can be determined according to the user card on the table acquired by the image acquisition module 120, and then projected through the projection light machine 140; and / or different guide voices can be played according to scene nodes.
[0040] Specifically, the processor 110 in the embodiment can also be used to determine a projection image to be projected according to a user voice acquired by the sound acquisition module 130, and then project the projection image through the projection light machine 140; and / or different guide voices can be played according to the user voice. For example, if the projection interaction device is used in a "Werewolf" table game scene, the projection image can be changed through the projection light machine 140 according to the speech of user A acquired by the sound acquisition module 130, and a guide voice of "reminding the next user to speak" can be given.
[0041] The embodiment realizes the multi-modal fusion of vision, hearing and projection interaction, significantly improves the naturalness and efficiency of human-computer interaction, and can completely achieve the effect of "host" by playing guide voices through the loudspeaker in different scenes, so that everyone can participate in the activity and improve the user's deep experience.
[0042] In the embodiment of the present disclosure, the sound acquisition module 130 is a microphone array, which is arranged at a preset position around the periphery of the image acquisition module 120.
[0043] The preset position can be flexibly set according to the shape of the host body. For example, the microphone array in the embodiment can include 6-8 microphones, which are installed at positions close to the four sides of the image acquisition module 120, and a total of 6-8 microphones are used to acquire the user's voice and calculate the direction angle of the user relative to the center of the device. For example, the 6-8 microphones can be distributed at different positions of the device to form an array, and the bearing angle of the speaker relative to the device can be obtained through algorithms such as Time of Difference of Arrival (TDOA).
[0044] Specifically, for example, in the context of a "Werewolf" table game, when a game content is played, a player registers a respective domain by placing a palm on the table, and only gestures and voice instructions in the domain are counted as instructions of the virtual role at the position, and the domain center and the device form a certain azimuth. In a specific scenario, the device can activate the listening capability, and the azimuth of the speaker can be obtained. Whether the voice interaction is effective is determined by comparing the azimuth of the current speaker with the azimuth of the activated domain.
[0045] For example, in the context of taking turns to speak during the day, the embodiment determines whether to accept the voice semantics of the current speaker by the above method. For example, the voice "I have finished speaking" is only effective when the correct speaker speaks, and then the speaking right is transferred to the next player. In combination with light and shadow interaction, the system can achieve the effect of moving a spotlight to the player whose turn it is to speak and prompting "Player 4, please speak". After the player 4 finishes speaking, the system moves the spotlight to the next player and prompts "Player 5, please speak".
[0046] The embodiment can clearly obtain voice information of the user by surrounding the image acquisition module 120 with the sound acquisition module 130, that is, installing a 360-degree sound source positioning microphone and a high-definition noise reduction microphone in front of the device. The device has the ability of human-computer dialogue and sound positioning, and through local and cloud software algorithms, the table game interaction experience in the multi-person gathering scenario is more natural, and the ability and role of the traditional gathering game host can be better exercised. The voice interaction function is realized, and the scene node is also promoted.
[0047] In the embodiment of the present disclosure, the image acquisition module 120 includes at least one camera and a depth camera, the at least one camera, the depth camera, and the projection light machine 140 are located in the same direction, and each included angle is not greater than 10 degrees.
[0048] Specifically, the embodiment can use one camera or multiple cameras for image acquisition. For example, the embodiment can use a large wide-angle high-definition camera or a camera module composed of multiple cameras. The projection light machine 140 of the embodiment can use a short-focus large wide-angle projection light machine device. In addition, the embodiment can align the large wide-angle high-definition camera and the depth camera in the same direction, so that the device can capture real-world objects beyond the projection range. With the help of depth map and RGB image coordinates, the real-world 2D and 3D objects can be restored to the virtual world in a 1:1 manner. Then, the virtual augmented content (projection image) is projected onto the corresponding object through the projection light machine 140 by software calculation, realizing the visual fusion of virtual and real. At the same time, the setting mode provided by the embodiment can realize large-format recognition and light and shadow coverage within a limited distance. For example, it can realize a coverage range of 2.4m*1.2m at a distance of 2m, improving the sense of immersion and interactive space.
[0049] In the embodiment of the present disclosure, the device further comprises a light source module arranged at the edge position of the first surface of the main body; and the processor is further configured to control the color and brightness of the light source module.
[0050] The light source module can provide lamps of multiple colors, for example, a full-color light strip.
[0051] Specifically, the embodiment can install a full-color light strip at the edge position of the first surface of the device. The light color and brightness can be controlled by software content and driving. In a dark indoor environment, a light and shadow atmosphere consistent with the game content can be created, and the high-definition camera can also be supplemented with light.
[0052] Figure 2 An example of an entity schematic diagram of a projection interaction device is provided in the embodiment of the present disclosure. As shown in Figure 2 The host body of the projection interaction device is a cuboid device, which comprises a shell 210 of the host body, a large wide-angle high-definition camera 220, a short-focus high-definition projection light machine 230, a depth camera 240, a sound collection module 250, a full-color light strip 260, and a loudspeaker 270 located on the second surface.
[0053] As shown in Figure 2 The embodiment schematically provides a structure schematic diagram of a projection interaction device. The first surface and the second surface are adjacent surfaces. The device structure provided by the embodiment is particularly suitable for a hoisting scene, that is, the device is projected from top to bottom onto a table, so that the table real scene capture and virtual projection can be better matched. As shown in Figure 3 The hoisted projection interaction device 30 and the table 31 are included.
[0054] In addition, the loudspeaker provided by the embodiment can also play preset sound effects. The preset sound effects can be determined according to a scene used by the projection interaction device and different interaction contents selected according to user demand. For example, in a Werewolf game scene, the embodiment can play sound effects and music at appropriate times in combination with game content, so that sound and voice drive game narration.
[0055] In another embodiment, a recess is formed in a central position of a first surface of the main body, and the image acquisition module and the projection light machine are embedded in the recess.
[0056] In the embodiment of the present disclosure, the recess is provided with a telescopic support and a telescopic platform, the telescopic support is fixedly connected with the telescopic platform, and the image acquisition module and the projection light machine are arranged in the telescopic platform.
[0057] The embodiment can be provided with a recess in the center of the first surface, so that the image acquisition module and the projection light machine are embedded in the recess when the device is not in use, to avoid damage. When the device is in use, the image acquisition module and the projection light machine are adjusted in different heights and angles by the telescopic support and the telescopic platform, so that the device can cover a wider range and capture more and more comprehensive multi-user actions and voices, which not only ensures the spatial consistency of the acquisition angle and the projection area, but also avoids the problems of visual blind area and projection distortion.
[0058] In the embodiment of the present disclosure, the device further comprises a heat dissipation module arranged at an opening position of a third surface of the main body.
[0059] The heat dissipation module can dissipate heat from the device when the temperature of the device is too high. The opening position of the third surface can be provided with a heat dissipation grille. The embodiment can ensure the stability of the device during long-time operation by arranging the heat dissipation module, and avoid performance degradation caused by overheating of the device.
[0060] In the embodiment of the present disclosure, the heat dissipation module comprises a heat dissipation device and a temperature control device, and the processor is further configured to control the switch of the heat dissipation device according to the temperature detected by the temperature control device in the main body.
[0061] The heat dissipation device can include a centrifugal fan and a thermoelectric cooling sheet, and the temperature control device can be a device for monitoring the temperature of the processor or the temperature inside the main body in real time. The embodiment can intelligently control the switch of the heat dissipation device according to the temperature of the main body and / or the processor detected by the temperature control device, so as to keep the device running normally.
[0062] In the embodiments of the present disclosure, the device further comprises a communication module configured to receive a file and an instruction sent by a user; a control panel provided with a plurality of buttons for the user to operate; and a power supply configured to supply power to the main body.
[0063] Specifically, the embodiments are provided with a communication module, which can support wireless protocols (such as Bluetooth and Wi-Fi) and wired interfaces (such as HDMI), and can realize multi-device interconnection and data synchronization, and receive a file and an instruction sent by a user; the control panel can be provided for the user to operate buttons; and the power supply can be provided to ensure that the main body can operate normally.
[0064] The embodiments can dynamically generate projection content and voice instructions matching the current interaction scene by comprehensively analyzing image and voice data, realize personalized interaction response, and improve the adaptability of the device in diversified scenes such as education, conference, and exhibition.
[0065] It should be understood that the various forms of flow shown above can be used to reorder, add or delete steps. For example, the steps described in the present disclosure can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved, which is not limited herein.
[0066] In addition, the terms "first", "second" are only for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Therefore, the features defined with "first", "second" can explicitly or implicitly include at least one of the features. In the description of the present disclosure, the meaning of "a plurality of" is two or more, unless otherwise specifically limited.
[0067] The above is only a specific embodiment of the present disclosure, but the protection scope of the present disclosure is not limited thereto, and any person skilled in the art can easily think of changes or replacements within the technical scope disclosed in the present disclosure, which should be covered within the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be subject to the protection scope of the claims.
Claims
1. A projection interactive device, comprising a main body, characterized in that, The main body comprises an image acquisition module, a sound acquisition module, a projection light machine, a loudspeaker and a processor, wherein The image acquisition module and the sound acquisition module and the projection light machine are arranged on a first surface of the main body; the loudspeaker is arranged on at least one second surface of the main body; The processor is electrically connected with the image acquisition module, the sound acquisition module, the projection light machine and the loudspeaker, and is used for determining a projection image and a guide voice according to an image acquired by the image acquisition module and / or a user sound acquired by the sound acquisition module, projecting the projection image via the projection light machine, and playing the guide voice via the loudspeaker.
2. The apparatus of claim 1, wherein, The sound acquisition module is a microphone array and is arranged around the image acquisition module at a preset position.
3. The apparatus of claim 2, wherein, The image acquisition module comprises at least one camera and a depth camera, the at least one camera, the depth camera and the projection light machine are located at the same orientation, and each angle is not greater than 10 degrees.
4. The apparatus of claim 3, wherein, The device further comprises: A light source module arranged at an edge position of the first surface of the main body; The processor is further used for controlling the color and brightness of the light source module.
5. The apparatus of claim 4, wherein, The loudspeaker is further used for playing a preset sound effect.
6. The apparatus of claim 5, wherein, A recess is formed at a center position of the first surface of the main body, and the image acquisition module and the projection light machine are embedded in the recess.
7. The apparatus of claim 6, wherein, The recess is provided with a telescopic support and a telescopic platform, the telescopic support is fixedly connected with the telescopic platform, and the image acquisition module and the projection light machine are arranged in the telescopic platform.
8. The apparatus of claim 7, wherein, The device further comprises: A heat dissipation module arranged at an opening position of a third surface of the main body.
9. The apparatus of claim 7, wherein, The heat dissipation module comprises a heat dissipation device and a temperature control device, The processor is further used for controlling the switching of the heat dissipation device according to the temperature detected by the temperature control device in the main body.
10. The apparatus of claim 9, wherein, The device further comprises: A communication module used for receiving a file and an instruction sent by a user; A control panel provided with a plurality of keys for providing a user with use; A power supply used for supplying power to the main body.