A projector and interactive control method, device and storage medium thereof
By obtaining the unique identification information and interaction action information of the target object and inputting a preset interaction model, the convenience and accuracy of projector projection content creation, modification or marking in the prior art are solved, and efficient multi-user interaction is achieved.
Patent Information
- Application Number
- CN202411824805.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-11
- Publication Date
- 2025-04-08
AI Technical Summary
In the prior art, the projection content of the projector cannot be easily and accurately created, modified or marked, and is not suitable for multiple users to jointly create, modify or marked projection content.
By obtaining the unique identification information and interactive action information of the target object, and inputting it into the preset interaction model, the interaction results corresponding to the interactive action information are obtained, thereby controlling the projection content of the projector.
It realizes that the projector projection content can be directly created, marked or modified without the help of terminal devices, improving the interactive convenience and accuracy of the projector, and is suitable for multiple users to create, modify or mark projection content.
Smart Images

Figure CN119781609A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of projection technology, and in particular to a projector and an interactive control method, device and storage medium thereof. Background Art
[0002] Projectors can be widely used in homes, offices, schools, and entertainment venues. They can project images or videos onto display devices such as screens or walls. At the same time, they can be connected to portable or non-portable terminals through different interfaces to project the display content in the terminal onto the display device for display, thereby meeting the user's display needs.
[0003] When the projector projects the corresponding display content, the user can create, mark or modify the projected content of the projector according to actual needs. In the prior art, the user can create, modify or mark the projected content of the projector with the help of a terminal connected to the projector, or through a laser pen, remote control or other device wirelessly connected to the projector or the projected content displayed by the projector, etc.
[0004] However, when using the existing methods to create, modify or mark the projected content of the projector, the user needs to reach the location of the terminal, or get a laser pen or remote control that is wirelessly connected to the projector or the display device that displays the projected content, before creating, modifying or marking the projected content. This makes it more complicated for users to create, modify or mark the projected content, and is not suitable for multiple users to jointly create, modify or mark the projected content. Therefore, how to improve the convenience and accuracy of creating, modifying or marking the projected content of the projector has become a technical problem that needs to be solved urgently. Summary of the invention
[0005] The present invention provides a projector and an interactive control method, device and storage medium thereof, so as to solve the technical problem in the prior art that it is impossible to conveniently and accurately create, modify or mark the projection content of the projector.
[0006] According to one aspect of the present invention, there is provided a projector interactive control method, comprising:
[0007] Obtain unique identification information and interactive action information of the target object;
[0008] Inputting the unique identification information of the target object and the interaction action information into a preset interaction model to obtain an interaction result corresponding to the interaction action information;
[0009] The projection content of the projector is controlled according to the interaction result.
[0010] Optionally, before obtaining the unique identification information and interaction action information of the target object, the following is further included:
[0011] Acquire image information and / or voice information of each actual participating object in real time;
[0012] Determining an action identifier of each of the actual participating objects according to the image information and / or voice information of each of the actual participating objects;
[0013] The actual participating object whose action identifier is a preset identifier is determined as the target object.
[0014] Optionally, the projector interactive control method further includes:
[0015] Obtaining unique identification information and interaction feature information of each initial participant;
[0016] According to the unique identification information and the interaction feature information of each of the initial participating objects, a model training database is constructed in which the unique identification information corresponds to the interaction feature information one by one;
[0017] The deep learning model is trained through the model training database to obtain the preset interaction model.
[0018] Optionally, the projector interactive control method further includes:
[0019] The model training database is updated according to the unique identification information and the interactive action information of the target object.
[0020] Optionally, updating the model training database according to the unique identification information and the interactive action information of the target object includes:
[0021] Determine whether the unique identification information of the target object exists in the model training database;
[0022] If so, the interaction feature information corresponding to the unique identification information of the target object in the model training database is updated according to the unique identification information of the target object and the interaction action information.
[0023] Optionally, updating the model training database according to the unique identification information and the interactive action information of the target object further includes:
[0024] If the unique identification information of the target object does not exist in the model training database, using the interaction action information as the interaction feature information corresponding to the unique identification information of the target object;
[0025] The unique identification information of the target object and the interactive feature information of the target object are added to the model training database.
[0026] Optionally, the projector interactive control method further includes:
[0027] Acquiring image information and / or voice information of the target object in real time;
[0028] The projection content is adjusted according to the image information and / or voice information of the target object.
[0029] Optionally, the projector interactive control method further includes:
[0030] According to the adjusted projection content, the interaction result output by the preset interaction model is updated.
[0031] Optionally, obtain the unique identification information and interaction action information of the target object, including:
[0032] Acquiring image information and / or voice information of the target object in real time;
[0033] Unique identification information and interactive action information of the target object are determined according to the image information of the target object and / or the voice information of the target object.
[0034] Optionally, determining the interactive action information of the target object according to the image information of the target object and / or the voice information of the target object includes:
[0035] Determining actual action information and action reference information of the target object according to the image information of the target object and / or the voice information of the target object;
[0036] Determine interactive action information of the target object according to the actual action information and the action reference information.
[0037] According to another aspect of the present invention, there is provided a projector interactive control device, comprising:
[0038] An information acquisition module is used to obtain the unique identification information and interactive action information of the target object;
[0039] An interaction result acquisition module, used to input the unique identification information of the target object and the interaction action information into a preset interaction model, and acquire an interaction result corresponding to the interaction action information;
[0040] The projection content determination module is used to determine the projection content of the projector according to the interaction result.
[0041] According to another aspect of the present invention, there is provided a projector, comprising: a data processing module, an image acquisition module, a voice input module and a projection output module;
[0042] The image acquisition module is used to acquire image information;
[0043] The voice input module is used to obtain voice information;
[0044] The projection output module is used to output projection content;
[0045] The data processing module is connected to the image acquisition module, the voice input module and the projection output module respectively; the data processing module is used to obtain the image information and the voice information, execute the above-mentioned projector interactive control method, and control the projection output module to output the projection content.
[0046] Optionally, the image acquisition module includes a plurality of cameras arranged in an array;
[0047] Each of the cameras collects image information at different viewing angles around the projector.
[0048] Optionally, the projector further includes: a wireless communication module;
[0049] The data processing module performs signal interaction with a remote terminal and / or a server via the wireless communication module.
[0050] Optionally, the projector further includes: a storage module;
[0051] The data processing module is also connected to the storage module.
[0052] According to another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to implement the above-mentioned projector interactive control method when executed by a processor.
[0053] The technical solution of the present invention obtains the unique identification information and interactive action information of the target object, and inputs the unique identification information and interactive action information into a preset interactive model to obtain an interactive result corresponding to the interactive action information of the target object, so that the interactive result can be determined based on the personalized feature information and actual interactive action of the target object, ensuring that the interactive result has a high accuracy, so that when the projected content of the projector is controlled according to the interactive result, the determined projection content has a high accuracy. In this way, without the aid of a terminal device, the projected content of the projector can be directly created, marked or modified directly through the obtained unique identification information and interactive action information of the target object, thereby improving the interactive convenience of the projector, and at the same time, according to the personalized interactive characteristics of the target object, the accuracy of the determined projection content can be ensured, which is conducive to improving the user experience.
[0054] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0055] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0056] Figure 1 is a structural block diagram of a projector provided by an embodiment of the present invention;
[0057] Figure 2 is a structural schematic diagram of a projector provided by an embodiment of the present invention;
[0058] Figure 3 is a structural block diagram of another projector provided by an embodiment of the present invention;
[0059] Figure 4 is a flow chart of a projector interactive control method provided by Embodiment 2 of the present invention;
[0060] Figure 5 is a schematic diagram of projector projection content displayed by a display device provided in Embodiment 2 of the present invention;
[0061] Figure 6 is a schematic diagram of projector projection content displayed by another display device provided in Embodiment 2 of the present invention;
[0062] Figure 7is a flow chart of a projector interactive control method provided by Embodiment 3 of the present invention;
[0063] Figure 8 is a flow chart of a projector interactive control method provided by Embodiment 4 of the present invention;
[0064] Fig. 9 is a flow chart of a projector interactive control method provided by Embodiment 5 of the present invention;
[0065] Fig.10 is a flow chart of a projector interactive control method provided by Embodiment 6 of the present invention;
[0066] Fig.11 This is a structural schematic diagram of a projector interactive control device provided in Embodiment 7 of the present invention. DETAILED DESCRIPTION
[0067] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.
[0068] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0069] The acquisition, storage, use and processing of data in the technical solution of the present invention are in compliance with the relevant provisions of relevant laws and regulations.
[0070] Embodiment 1
[0071] Figure 1 is a structural block diagram of a projector provided in Embodiment 1 of the present invention, such as Figure 1As shown, the projector 100 includes a data processing module 10, an image acquisition module 20, a voice input module 30 and a projection output module 40; the image acquisition module 20 is used to acquire image information; the voice input module 30 is used to acquire voice information; the projection output module 40 is used to output projection content; the data processing module 10 is respectively connected to the image acquisition module 20, the voice input module 30 and the projection output module 40; the data processing module 10 is used to acquire image information and / or voice information, execute the projector interactive control method provided by the embodiment of the present invention, and control the projection output module 40 to output projection content.
[0072] The image acquisition module 20 may include a camera, etc., to obtain image information around the projector 100, and send the obtained image information to the data processing module 10 for processing. The voice input module 30 may include a microphone, etc., to pick up voice information around the projector 100, and send the picked up voice information to the data processing module 10. The data processing module 10 may process the image information and / or voice information it receives to determine the unique identification information and interactive action information of the target object, and input the unique identification information and interactive action information of the target object into a preset interactive model, obtain the interactive result corresponding to the interactive action information of the target object, and control the projection output module 40 to output the projection content to the display device according to the interactive result.
[0073] It can be understood that the preset interaction model can be obtained by training the deep learning model. By inputting the unique identification information and interaction feature information of the target object into the deep learning model for training, the deep learning model can learn the personalized feature information of the target object therefrom, thereby obtaining the preset interaction model. When the target object generates interaction action information, the preset interaction model can be used to determine the interaction result corresponding to the interaction action information, thereby being able to more accurately identify the interaction action information of the target object.
[0074] In an optional embodiment, the image information captured by the image acquisition module 20 may include facial feature information of the target object associated with the unique identification information of the target object, and the voice information picked up by the voice input module 30 may include voiceprint feature information associated with the unique identification information of the target object, so that after the data processing module 10 processes the image information and / or voice information, the facial feature information and voiceprint feature information of the target object can be determined, thereby determining the unique identification information of the target object.
[0075] It should be noted that, in the embodiment of the present invention, the data processing module 10 is respectively connected to the image acquisition module 20, the voice input module 30 and the projection output module 40, that is, the data processing module 10 can be electrically connected to the image acquisition module 20, the voice input module 30 and the projection output module 40 through wires, or can be communicatively connected to the image acquisition module 20, the voice input module 30 and the projection output module 40 through a wireless communication protocol, and the connection methods of the data processing module 10 and the image acquisition module 20, the voice input module 30 and the projection output module 40 can be the same or different, and can be designed according to actual needs, and the embodiment of the present invention does not make specific limitations on this.
[0076] This embodiment uses an image acquisition module to collect image information, and uses a voice input module to obtain voice information, so that the data processing module can accurately determine the unique identification information and interactive action information of the target object based on the image information and / or voice information, and input the unique identification information and interactive action information into a preset interactive model to determine the interactive result corresponding to the interactive action information of the target object, so that the interactive result of the target object interacting with the projector can be accurately determined based on the personalized feature information of the target object itself, and then the projection output module can be controlled to accurately output the projection content according to the interactive result. In this way, without the need for other equipment, accurate interaction between the target object and the projector can be achieved, which is conducive to simplifying the interactive operation mode of the projector, improving the interactive convenience of the projector, and thus helping to improve the user experience.
[0077] Optional, continue to refer to Figure 1 The image acquisition module 20 includes a plurality of cameras arranged in an array; each camera respectively acquires image information at different viewing angles around the projector 100 .
[0078] For example, Figure 2 As shown, the projector 100 may further include a housing 101, and the cameras 21 of the image acquisition module 20 may be arranged in a ring shape along the edge of the housing 101, so that each camera respectively acquires image information at a different viewing angle, thereby enabling the image acquisition module 20 to obtain image information at a 360° viewing angle around the projector 100. In this way, the image acquisition module 20 may identify image information of a target object located at any orientation of the projector 100, thereby enabling the target object located at any orientation of the projector 100 to accurately interact with the projector.
[0079] Optional, continue to refer to Figure 1The voice input module 30 may include a plurality of microphones, which may be arranged in a ring shape so as to respectively pick up voice information in various directions, so that the voice of the target object can be picked up at any direction of the target object, thereby improving the accuracy of voice recognition and the convenience of voice interaction.
[0080] Optional, Figure 3 is a structural block diagram of another projector provided in the first embodiment of the present invention, such as Figure 3 As shown, the projector 100 may further include a wireless communication module 50 ; in this case, the data processing module 10 may perform signal interaction with the remote terminal 51 and / or the server 52 via the wireless communication module 50 .
[0081] The wireless communication module 50 may include a Bluetooth module, a WIFI module, etc. As long as the projector 100 can communicate with the remote terminal 51 and / or the server 52 wirelessly, the embodiment of the present invention does not specifically limit this.
[0082] Specifically, the data processing module 10 can exchange signals with the remote terminal 51 through the wireless communication module 50, that is, the data processing module 10 can send at least one of the image information collected by the image acquisition module 20, the voice information obtained by the voice input module 30, and the projection content output by the projection output module 40 to the remote terminal 51 through the wireless communication module 50, so that the participating objects can understand the on-site situation of the projector in real time through the remote terminal, and watch the projected content of the projector; at the same time, the data processing module 10 can also receive the image information and / or voice information collected by the remote terminal 51, as well as the projection content sent by the remote terminal 51, so that the participating objects at the remote terminal can interact with the projector 100.
[0083] The data processing module 10 can also exchange signals with the server 52 through the wireless communication module 50. The server 52 can be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system, and solves the defects of difficult management and weak business scalability in traditional physical hosts and VPS services. Exemplarily, the data processing module 10 can upload the image information and / or voice information it receives, as well as the projection content it outputs, to the server 52 for storage, so as to facilitate subsequent calls; or, the data processing module 10 can also download the corresponding projection content and historical upload data from the server 52, so as to meet the projection needs of the projector while making the projection method of the projector more diversified.
[0084] In other optional embodiments, the remote terminal 51 may also interact with the server 52 through signals so that the remote terminal 51 can upload its terminal data to the server 52 and download corresponding data from the server 52. The specific communication method may be designed according to actual needs, and the embodiment of the present invention does not specifically limit this.
[0085] Based on the above embodiment, optionally, continue to refer to Figure 3 , the projector 100 may further include a storage module 60; in this case, the data processing module 10 may further be connected to the storage module 60. The storage module 60 may be used to store the image information collected by the image acquisition module 20, the voice information acquired by the voice input module 30, and the unique identification information and interactive action information generated according to the image information and / or the voice information, so that when the data processing module 10 performs signal processing, the content stored in the storage module 60 may be directly called, thereby simplifying the signal processing process and improving the signal processing efficiency.
[0086] It should be noted that the data processing module of the projector provided in this embodiment can be used to execute the projector interactive control method provided in any embodiment of the present invention. Therefore, the projector provided in this embodiment has a module for executing the projector interactive control method provided in any embodiment of the present invention. The specific execution process will be described below and will not be repeated here.
[0087] Embodiment 2
[0088] Figure 4 This is a flow chart of a projector interactive control method provided by the second embodiment of the present invention. This embodiment can be applied to realize personalized interaction with the projected content of the projector without the help of external devices. The method can be executed by a projector interactive control device. The projector interactive control device can be implemented in the form of hardware and / or software. The projector interactive control device can be configured in the data processing module of the projector. Figure 4 As shown, the method includes:
[0089] S110: Acquire unique identification information and interactive action information of the target object.
[0090] It can be understood that the unique identification information of the target object can be the unique and deterministic identification information of the target object, that is, different target objects have different unique identification information, and the unique identification information can exist in a coded manner; the interactive action information of the target object can be interactive information such as gestures and voices emitted when the target object interacts with the projector. Exemplarily, the interactive action information can be the gesture action information of the target object. By acquiring the gesture action information of the target object in real time, the image drawn and the text written by the target object can be determined. Alternatively, the interactive action information can also be the voice information of the target object. By acquiring the sound emitted by the target object, the text, pictures, etc. expressed by the target object can be known.
[0091] In an optional embodiment, obtaining unique identification information and interactive action information of the target object may include: obtaining image information and / or voice information of the target object in real time; and determining the unique identification information and interactive action information of the target object based on the image information and / or voice information of the target object.
[0092] Among them, the projector may include an image acquisition module and a voice input module, and the image information of the target object can be acquired based on the image acquisition module, and the voice information of the target object can be acquired based on the voice input module, and then the unique identification information and interactive action information of the target object can be determined based on the image information and / or voice information. In other optional embodiments, the projector can also be connected to a remote terminal for communication, and the image information can be acquired based on a camera in the remote terminal, and the voice information can be acquired based on a microphone in the remote terminal. The specific implementation method can be designed according to actual needs, and the embodiment of the present invention does not specifically limit this.
[0093] In an exemplary embodiment, after acquiring the image information of the target object, the facial feature information of the target object can be determined based on the image information of the target object. The facial feature information is the unique and deterministic identification information of the target object. Therefore, the unique identification information of the target object can be determined based on the facial feature information; or, after acquiring the voice information of the target object, the voiceprint feature information of the target object can be determined based on the voice information. The voiceprint feature information can also be used as the unique and deterministic identification information of the target object. Therefore, the unique identification information of the target object can also be determined based on the voiceprint feature information; or, after determining the facial feature information of the target object based on the image information of the target object and determining the voiceprint feature information of the target object based on the voice information of the target object, the unique identification information of the target object can be determined by combining the facial feature information and the voiceprint feature information of the target object.
[0094] Accordingly, by collecting the image information of the target object in real time through the image acquisition module, the gesture coordinates of the target object at each moment can be determined based on the image information collected at each moment, and the gesture action of the target object can be determined based on the gesture coordinates at each moment, so that the interactive action information of the target object can be determined based on the gesture action. For example, the finger or handheld laser pen of the target object moves along direction A. At this time, according to the image information of the target object, it can be determined that the interactive action information of the target object is to draw a straight line along direction A. Alternatively, by acquiring the voice information of the target object in real time through the voice input module, the text information corresponding to the voice information of the target object can be determined, and the text information can be used as the interactive action information of the target object. For example, the voice of the target object "insert content A in the center area" is acquired through the voice input module. At this time, the interactive action information of the target object is "insert content A in the center area". Alternatively, the target object's interactive action information can be determined in combination with the image information captured by the image acquisition module and the voice information obtained by the voice input module. In this case, the target object can perform gesture actions and voice output at the same time. For example, the target object's finger or handheld laser pen points to a certain position on the display surface of a display device used to display the projector content. At the same time, the target object outputs "Insert content A here" by voice. At this time, inserting content A at the position pointed by the target object is the target object's interactive action information.
[0095] It is understandable that when the target object has different sizes and the distance between the target object and the display device (such as a display screen, a background wall or a curtain, etc.) that displays the projected content of the projector is different, the interactive action information presented by the same gesture action amplitude of the target object is different, which is not conducive to the accurate recognition of the interactive action information of the target object. At this time, a reference object can be determined according to actual needs, and the relative action amplitude of the gesture action amplitude of the target object relative to the action and / or size of the reference object can be determined based on the action and / or size of the reference object, and the relative action amplitude can be used as the interactive action information of the target object.
[0096] In an optional embodiment, determining the interactive action information of the target object based on the image information of the target object and / or the voice information of the target object may include: determining the actual action information and action reference information of the target object based on the image information of the target object and / or the voice information of the target object; determining the interactive action information of the target object based on the actual action information and the action reference information.
[0097] As a feasible embodiment, when determining the action reference information and actual action information of the target object based on the image information of the target object, the action reference information may be the reference size information of the static reference object in the acquired image information, or the action reference information may also be the reference size information and / or reference action information of the dynamic reference object in the acquired image information. The actual action information may be the actual gesture action of the target object, based on which the gesture action amplitude of the target object may be determined.
[0098] In an exemplary embodiment, when the action reference information is the reference object size information of a static reference object, there is a fixed distance between the static reference object and the display device on which the user displays the projector content. The proportional relationship between the gesture action amplitude of the target object and the size of the static reference object can be determined through the image information. Based on the proportional relationship, the relative action amplitude of the gesture action amplitude of the target object can be determined. Based on the relative action amplitude, the interactive action information of the target object can be determined, thereby enabling the interactive action information of the target object to be accurately identified.
[0099] In another exemplary embodiment, when the action reference information is the reference size information of a dynamic reference object, the dynamic reference object may be a reference object that moves with the gesture action of the target object, for example, the dynamic reference object may be the palm of the target object. At this time, the position information and size information of the gesture action amplitude that should be presented on the display surface of the display device can be determined based on the proportional relationship between the target object's gesture action amplitude and the target object's palm size. The position information and size signal can be used as interactive action information. In this way, the interactive action information of the target object can be determined more accurately through the action reference signal and the actual action information, reducing the impact of the size difference of the target object and the distance difference between the target object and the display device on the interactive action information.
[0100] As another feasible embodiment, when the action reference information and actual action information of the target object are determined according to the voice information of the target object, the action reference information can be the preset voice information when the distance between the target object and the display device is the preset distance, and the preset voice information can include at least one of the loudness, timbre, and pitch of the sound emitted when the distance between the target object and the display device is the preset distance; the actual action information can be the actual sound emitted by the target object actually obtained by the voice input module. At this time, at least one of the relative loudness, timbre, and pitch of the target object can be determined according to the preset voice information and the actual sound emitted by the target object, and at least one of the relative loudness, timbre, and pitch of the sound can be used as the interactive action information of the target object. In this way, the influence on the accuracy of the interactive action information caused by the distance difference between the target object and the display device can also be reduced.
[0101] It is understandable that the above is only an example of the action reference information and the actual action information being determined by the image information or the voice information. In other feasible embodiments of the present invention, the action reference information can be determined based on the image information, and the actual action information can be determined based on the voice information; or the action reference information can be determined based on the voice information, and the actual action information can be determined based on the image information. The specific determination method of the action reference information and the actual action information can be designed according to actual needs, and the embodiments of the present invention do not specifically limit this.
[0102] S120: Input the unique identification information and interaction action information of the target object into a preset interaction model to obtain an interaction result corresponding to the interaction action information.
[0103] Among them, the preset interaction model can be understood as being used to identify unique identification information, and based on the identified unique identification information, determine the personalized feature information corresponding to the unique identification, so as to determine the personalized interaction result corresponding to the interaction action information based on the personalized feature information, so as to specifically determine the personalized characteristics of the target object and accurately determine the interaction result corresponding to the interaction action information, which is beneficial to improve the accuracy of the determined interaction result.
[0104] Specifically, by inputting the unique identification information and interactive action information of the target object into the preset interactive model, the interactive feature information corresponding to the unique identification information can be determined by the information processing module of the preset interactive model, and the interactive feature information can include information related to the personalized features corresponding to the unique identification information; then, the interactive action information is compared with the interactive feature information by the feature processing module of the preset interactive model, and the interactive feature information whose error with the interactive action information is within the preset allowable error range is determined, and finally, the interactive result corresponding to the determined interactive feature information, that is, the interactive result corresponding to the interactive action information, is determined by the result output module of the preset interactive model. In this way, by inputting the unique identification information and interactive action information of the target object into the preset interactive model, the personalized interactive result of the target object can be determined in a targeted manner, thereby improving the accuracy of the obtained interactive result.
[0105] In an exemplary embodiment, when determining the interactive action information of the target object based on the image information of the target object, the image information may include the gesture action of the target object. Since the moving direction, movement amplitude, etc. of the gesture actions of different target objects are different, it is necessary to determine the interactive result corresponding to the interactive action information of the target object for the personalized characteristic information of different target objects. For example, when the target object needs to draw a straight line of length d in the projection screen of the projector, the actual gesture action is to move a distance of d' from left to right. At this time, the moving direction, moving distance, etc. of the actual gesture action of the target object are identified based on the image information as the interactive action information of the target object; after the unique identification information and the interactive action information of the target object are input into the preset interactive model, the personalized characteristic information corresponding to the unique identification information of the target object can be determined. At this time, the interactive action information determined based on the actual gesture action of the target object can be compared with the personalized characteristic information of the target object. At this time, it can be determined that the content to be expressed by the interactive action information of the target object is to draw a straight line of length d in the projection screen of the projector, so that the personalized interactive result corresponding to the interactive action information of the target object can be determined in a targeted manner.
[0106] In another exemplary embodiment, when the interactive action information of the target object is determined based on the voice information of the target object, the voice information may include the pitch, intensity, length, timbre, language expression, etc. of the target object. Since the pitch, intensity, length, and timbre of different target objects are different, and the language expression of target objects in different regions is different, for example, the sounds sent by target objects in different regions may carry dialects of different regions. At this time, after the unique identification information and interactive action information of the target object are input into the preset interaction model, the regional dialect information corresponding to the unique identification information of the target object can be determined, and based on the regional dialect information of the target object, the text information to be expressed by each sound in the interactive action information of the target object can be determined, and based on the text information, the personalized interaction result corresponding to the interactive action information of the target object can be determined.
[0107] S130: Control the projection content of the projector according to the interaction result.
[0108] The projected content of the projector can be displayed on the display device in the form of pictures, text, video, etc. The interaction result of the determined target object is the content to be expressed by the target object, and the content to be expressed by the target object is converted into text, pictures, videos, etc. as the projected content of the projector and displayed on the display device.
[0109] In an exemplary embodiment, if Figure 5As shown, when the image information of the target object is collected based on the image collection module, and the gesture action of the target object is determined to be a movement of a distance d′ from left to right according to the collected image information, the position coordinates of each key point in the gesture action of the target object in the projector coordinate system and the distances between each key point can be determined according to the image information, for example, the position coordinates (x1′, y1′) of the starting point in the projector coordinate system, the position coordinates (x2′, y2′) of the ending point in the projector coordinate system, and the actual distance d′ between the starting point and the ending point, and the position coordinates of each key point in the gesture action in the projector coordinate system and the actual distances between each key point are used as the interactive action information of the target object; when the unique identification information of the target object and the interactive action information are input into After the interaction model is preset, the personalized interaction result corresponding to the interaction action information of the target object can be determined, that is, the position coordinates (x1′, y1′) of the starting point in the projector coordinate system are converted into the position coordinates (x1, y1) of the starting point in the display device coordinate system, the position coordinates (x2′, y2′) of the ending point in the projector coordinate system are converted into the position coordinates (x2, y2) of the ending point in the display device coordinate system, and the actual distance d′ between the starting point and the ending point is converted into the length d displayed on the display device. Based on the interaction result, it can be determined that the projection content of the projector is a line segment with a length of d displayed on the display device, and the starting point of the line segment is (x1, y1) and the ending point is (x2, y2).
[0110] In another exemplary embodiment, Figure 6 As shown, when the voice information of the target object is obtained based on the voice input module, and the voice of the target object is determined to be "insert content A in the center area" based on the obtained voice information, at this time, the various characters in the voice content of the target object can be determined based on the voice information, and the interaction action information of the target object is determined by the determined various characters. After the unique identification information and interaction action information of the target object are input into the preset interaction model, the personalized interaction result corresponding to the interaction action information of the target object can be determined accordingly, that is, the text content "insert content A in the center area" is converted into a picture, text or video of "content A" that can be displayed by the display device, and based on the interaction result, it can be determined that the projection content of the projector is to display "content A" in the center area of the display surface of the display device.
[0111] In an optional embodiment, before obtaining the interactive action information of the target object, the projection content of the projector can be a set projection content, so that the set projection content can be displayed in a display device used to display the projection content; after obtaining the unique identification information and interactive action information of the target object and determining the interaction result based on the unique identification information and interactive action information, the set projection content can be modified, marked, etc., so that the target object can directly interact with the projector.
[0112] This embodiment obtains the unique identification information and interactive action information of the target object, and inputs the unique identification information and interactive action information into a preset interactive model to obtain an interactive result corresponding to the interactive action information of the target object, so that the interactive result can be determined based on the personalized feature information and actual interactive action of the target object, ensuring that the interactive result has a high accuracy, so that when the projected content of the projector is controlled according to the interactive result, the determined projection content has a high accuracy. In this way, without the aid of a terminal device, the projected content of the projector can be directly created, marked or modified directly through the unique identification information and interactive action information of the target object, thereby improving the interactive convenience of the projector, and at the same time, according to the personalized interactive characteristics of the target object, the accuracy of the determined projection content can be ensured, which is conducive to improving the user experience.
[0113] Embodiment 3
[0114] Figure 7 This is a flowchart of a projector interactive control method provided by Embodiment 3 of the present invention. Based on the above embodiments, this embodiment describes how to determine the target object from a large number of actual participating objects. Figure 7 As shown, the method includes:
[0115] S210: Acquire image information and / or voice information of each actual participant in real time.
[0116] It is understandable that the projector provided in the embodiment of the present invention can be applied to teaching, conference and other scenes. When the projector is applied to the teaching scene, the actual participants may include the main lecturer and the audience. When the projector is applied to the conference scene, the actual participants may include all the participants. In any scene, the actual participants may be located at the projector site or at a remote terminal connected to the projector. In the embodiment of the present invention, the number and type of actual parameter objects can be confirmed according to the application scene of the projector, and the embodiment of the present invention does not specifically limit this.
[0117] Among them, after the projector starts working, the image acquisition module of the projector can collect image information of each participating object at the projector site, the camera of the remote terminal connected to the projector for communication can collect image information of the actual participating objects at the remote terminal, and the voice input module of the projector can obtain voice information of each participating object at the projector site, and the microphone of the remote terminal connected to the projector for communication can obtain voice information of the actual participating objects at the remote terminal.
[0118] S220 determines the action identifier of each actual participant according to the image information and / or voice information of each actual participant.
[0119] The action identifier of the actual participating action may include the gesture, body movement, facial expression, voice, or a combination of gesture and voice of the actual participating object. In an exemplary embodiment, the gesture of each actual participating object can be determined through the collected image information of each actual participating object, and the gesture of each actual participating object can be used as the action identifier of the actual participating object; in another exemplary embodiment, the voice of each actual participating object can be determined through the acquired voice information, and the voice of each actual participating object can be used as the action identifier of the actual participating object.
[0120] S230: Determine the actual participating object whose action identifier is a preset identifier as the target object.
[0121] Among them, when the action identifier is a gesture action, the preset identifier can be a preset gesture action, for example, the preset identifier can be a palm facing outward, a fist, or other gestures; when the action identifier is a facial expression, the preset identifier can be a preset facial expression, for example, the preset identifier can be a smile, a quick blink, etc.; when the action identifier is to make a voice, the preset identifier can be a preset voice content, for example, the preset identifier can be "please look at me", "listen to me" or "let me talk about it", etc. It should be noted that the preset identifier and the action identifier correspond to each other, and the specific implementation method can be designed according to actual needs, and the embodiment of the present invention does not make specific limitations on this.
[0122] In an exemplary embodiment, when the projector is applied to a conference scene, the actual participants are the actual participants. If there are multiple actual participants, during the meeting, the data processing module of the projector can obtain the image information and / or voice information of each actual participant, and determine the action identification of each actual participant according to the image information and / or voice information of each actual participant, and compare the action identification of each actual participant with the preset identification, determine the action identification whose difference with the preset identification is within the preset fault tolerance range, and determine the actual participant object that executes the action identification as the current target object. After determining the target object, the data processing module of the projector can obtain the image information and / or voice information of each actual participant, and when the action identification of other actual participants is the preset identification, the target object can be switched to other actual participants whose action identification is the preset identification. In this way, each actual participant only needs to make an action identification that is the same or similar to the preset identification to achieve interaction with the projector, so that the projector can interact with multiple people and improve the convenience of interactive control of the projector.
[0123] S240: Acquire unique identification information and interactive action information of the target object.
[0124] S250: Input the unique identification information and interaction action information of the target object into a preset interaction model, and obtain an interaction result corresponding to the interaction action information.
[0125] S260: Control the projection content of the projector according to the interaction result.
[0126] This embodiment obtains the image information and / or voice information of each actual participating object, and determines the action identifier of each actual participating object based on the image information and / or voice information of each actual participating object, so as to determine the actual participating object whose action identifier is a preset identifier as the target object. In this way, each actual participating object only needs to make an action identifier that is the same or similar to the preset identifier to achieve interaction with the projector, so that the projector can interact with multiple people, thereby improving the convenience of interactive control of the projector.
[0127] Embodiment 4
[0128] Figure 8 This is a flowchart of a projector interactive control method provided by Embodiment 4 of the present invention. Based on the above embodiments, this embodiment describes how to obtain a preset interactive model. Figure 8 As shown, the method includes:
[0129] S310: Acquire unique identification information and interaction feature information of each initial participant.
[0130] The initial participant may be a person who enters the participant information when using the projector for the first time. The unique identification information of each initial participant may be determined based on the image information and / or voice information of each initial parameter object; similarly, the interaction feature information of each initial participant may also be determined based on the image information and / or voice information of each initial participant, and the interaction feature information may include personalized interaction information of the initial participant, and the personalized interaction information of different initial participants may be different.
[0131] S320: Construct a model training database in which the unique identification information and the interaction feature information correspond one-to-one to each other according to the unique identification information and the interaction feature information of each initial participant.
[0132] Among them, after obtaining the unique identification information and interaction feature information of the initial participating objects, each initial participating object can be encoded respectively, and the unique identification information and interaction feature information of the same initial participating object can be stored correspondingly at the encoding position of the initial participating object, thereby constructing a model training database.
[0133] S330: Train the deep learning model through the model training database to obtain a preset interaction model.
[0134] Among them, the deep learning model learns the complex features of data through a multi-layer neural network. It is a machine learning model that can be used to learn the features of the interactive feature information in the model training database. In this embodiment, each unique identification information and interactive feature information of the model training database are input into the deep learning model, and based on the output of the deep learning model, the model parameters are adjusted to train the deep learning model to obtain a preset interactive model.
[0135] It is understandable that different initial participating objects have different unique identification information. For different unique identification information and interaction feature information, the model parameters of the deep learning module can be trained accordingly, so that the model parameters of the preset interaction model corresponding to different unique identification information are different. In this way, when the unique identification information and interaction action information of the target object are input into the preset interaction model, the model parameters of the preset interaction model required at this time can be first determined according to the unique identification information of the preset interaction model, and then the interaction action information is processed based on the determined model parameters of the preset interaction model, and finally the personalized interaction result corresponding to the interaction action information of the target object is determined, so as to improve the accuracy of the interaction result.
[0136] S340: Acquire unique identification information and interactive action information of the target object.
[0137] S350: Input the unique identification information and interaction action information of the target object into a preset interaction model, and obtain an interaction result corresponding to the interaction action information.
[0138] S360: Control the projection content of the projector according to the interaction result.
[0139] This embodiment obtains unique identification information and interaction feature information of each initial participating object, and constructs a model training database in which the unique identification information and the interaction feature information correspond one-to-one, so that after the deep learning model is trained using the model training database to obtain a preset interaction model, the model parameters of each initial participating object can be determined according to the personalized interaction feature information of different initial participating objects, so that after the target object is determined, the corresponding model parameters of the target object can be determined according to the unique identification information of the target object, so that after the interaction action information of the target object is input into the preset interaction model, the personalized interaction result of the target object can be accurately determined, thereby ensuring that the interaction result has a high accuracy, and then when the projection content of the projector is controlled according to the interaction result, the projection content has a high accuracy.
[0140] Embodiment 5
[0141] Fig. 9 This is a flowchart of a projector interactive control method provided by Embodiment 5 of the present invention. Based on the above embodiments, this embodiment describes how to update the model training database. Fig. 9 As shown, the method includes:
[0142] S410: Acquire unique identification information and interaction feature information of each initial participant.
[0143] S420: Construct a model training database in which the unique identification information and the interaction feature information correspond one-to-one to each other according to the unique identification information and the interaction feature information of each initial participant.
[0144] S430: Train the deep learning model through the model training database to obtain a preset interaction model.
[0145] S440: Acquire unique identification information and interactive action information of the target object.
[0146] S450: Update the model training database according to the unique identification information and interactive action information of the target object.
[0147] It can be understood that the original data in the model training database includes unique identification information and interaction feature information determined based on the image information and / or voice information of each initial participating object, so that the interaction feature information corresponding to the unique identification information of each initial participating object is relatively single, that is, the original data in the model training database is relatively single, which will affect the accuracy of the determined interaction results.
[0148] In this embodiment, during the use of the projector, the target object may have different interaction action information under different projection requirements. At this time, the preset interaction model can continue to learn the interaction action information of the target object, so that the model parameters corresponding to the unique identification information of the target object in the preset interaction model can be more accurate.
[0149] Specifically, after obtaining the unique identification information and interactive action information of the target object, the model training database can be updated accordingly, so that the interactive information corresponding to the unique identification information in the model training database is more abundant and diverse. In this way, by continuing to train the deep learning model with the updated model training database, the model parameters and the tolerance range of the model parameters can be further adjusted to adapt to different interactive action recognition situations, so as to achieve higher accuracy in determining the interactive results.
[0150] In an optional embodiment, updating the model training database according to the unique identification information and interaction action information of the target object may include: determining whether the unique identification information of the target object exists in the model training database; if so, updating the interaction feature information corresponding to the unique identification information of the target object in the model training database according to the unique identification information and interaction action information of the target object.
[0151] In another optional embodiment, if the unique identification information of the target object does not exist in the model training database, the interaction action information is used as the interaction feature information corresponding to the unique identification information of the target object; the unique identification information of the target object and the interaction feature information of the target object are added to the model training database.
[0152] It can be understood that the original data in the model training database is the unique identification information and interaction action information of the initial participating object. In the actual use of the projector, the actual participating object may be the same as or different from the initial participating object, and the target object is one of the actual participating objects, so that the model training database may include the unique identification information of the target object or exclude the unique identification information of the target object.
[0153] Specifically, after obtaining the unique identification information of the target object, the unique identification information of the target object can be compared with the unique identification information already in the model training database to determine whether the unique identification information of the target object exists in the model training database; if the unique identification information of the target object exists in the unique identification information already in the model training database, the interaction action information of the target object can be fused with the existing interaction feature information accordingly, so that the fused interaction feature information can more accurately represent the personalized characteristics of the target object; if the unique identification information of the target object exists in the unique identification information already in the model training database, the target object can continue to be encoded on the basis of the original encoding, and the unique identification information of the target object can be stored correspondingly under the encoding address of the target object, and the interaction action information of the target object can be stored as the interaction feature information of the target object under the encoding address of the target object, so as to train the deep learning model according to the unique identification information and interaction feature information of the target object, and obtain the model training parameters corresponding to the unique identification information of the target object, so that after the unique identification information and interaction action information of the target object are input into the preset interaction model, the personalized interaction result of the target object can be determined.
[0154] S460: Input the unique identification information and interaction action information of the target object into a preset interaction model to obtain an interaction result corresponding to the interaction action information.
[0155] S470: Control the projection content of the projector according to the interaction result.
[0156] This embodiment makes the data in the model training database richer by updating the data in the model training database based on the unique identification information and interaction action information after acquiring the unique identification information and interaction action information of the target object, so that after the deep learning model is trained with the updated model training database to obtain a preset interaction model, a more accurate interaction result can be determined based on the preset interaction model, so that when the projection content of the projector is controlled according to the interaction result, the projection content has higher accuracy.
[0157] Embodiment 6
[0158] Fig.10 This is a flowchart of a projector interactive control method provided by Embodiment 6 of the present invention. Based on the above embodiments, this embodiment describes how to accurately control the projected content. Fig.10 As shown, the method includes:
[0159] S510: Acquire image information and / or voice information of the target object in real time.
[0160] Specifically, by acquiring the image information and / or voice information of the target object in real time, the gestures and / or sounds of the target object can be acquired in real time during the interaction between the target object and the projector, so that the gesture trajectory and voice content of the target object can be determined based on the acquired gestures and / or sounds, and then the interactive action information of the target object can be determined based on the gesture trajectory and voice content of the target object. At the same time, based on the acquired image information and voice information of the target object, the facial feature information and voiceprint feature information of the target object can be correspondingly determined, so that the unique identification information of the target object can be correspondingly determined.
[0161] S520: Acquire unique identification information and interactive action information of the target object.
[0162] S530: Input the unique identification information and interaction action information of the target object into a preset interaction model, and obtain an interaction result corresponding to the interaction action information.
[0163] S540: Control the projection content of the projector according to the interaction result.
[0164] S550: Adjust the projection content according to the image information and / or voice information of the target object.
[0165] It is understandable that since the preset interaction model is obtained based on the training of the deep learning model, and the deep learning model is a machine learning model, the preset interaction model can output corresponding interaction results based on the model parameters determined after machine learning; but since there are certain deviations in the gestures or sounds made by the target object at different times, the interaction results output by the preset interaction model obtained only based on historical data training may have certain deviations, resulting in inaccurate output interaction results, and then causing inaccurate projection content of the projector.
[0166] In this embodiment, after determining the projection content of the projector according to the interaction result output by the preset interaction model, the projector can project the projection content onto the corresponding display device for display. At this time, the target object can determine whether the projection content is what the target object wants to express according to the displayed projection content. For example, if the projection content displayed on the display device is what the target object wants to express, the target object can issue a gesture action or voice content to confirm the projection content; conversely, if the projection content displayed on the display device is not what the target object wants to express, the target object can issue a gesture action or voice content to modify the projection content. In this way, according to the currently obtained image information and / or voice information of the target object, the current gesture action and / or voice content of the target object can be determined. By judging whether the current gesture action of the target object is a gesture action to confirm the projection content, or whether the current voice content of the target object is a voice content to confirm the projection content, it can be determined whether the projection content currently displayed on the display device is what the target object wants to express; if it is determined according to the image information and voice information of the target object that the target object has performed a gesture action to confirm the projection content or issued a voice content to confirm the projection content, the projector can continue to project with this projection content; conversely, if it is determined according to the image information and / or voice information of the target object that the target object has performed a gesture action to modify the projection content or issued a voice content to modify the projection content, the projection content of the projector can be modified according to the current gesture action or voice content of the target object to improve the accuracy of the projection content of the projector.
[0167] In an exemplary embodiment, after inputting the uniqueness identification information and interaction action information of the target object into the preset interaction model, the interaction result output by the preset interaction model is that the target object wrote a character '太' (too), but what the target object actually wanted to express was the character '大' (big); at this time, after determining that the projection content of the projector is to project the character '太' according to the interaction result and displaying the character '太' on the display device, the target object can issue the voice content 'Modify to the character 大 (big)', and by obtaining the voice information including this voice content, the projection content of the projector can be correspondingly modified from the character '太' to the character '大'.
[0168] In other exemplary embodiments, the unique identification information and interaction action information of the target object are input into a preset interaction model, and the interaction result output by the preset interaction model is that the target object draws a line segment in the central area of the display surface of the display device, but the target object actually wants to draw a line segment in the upper right corner; at this time, when it is determined according to the interaction result that the projection content of the projector is to display a line segment in the central area of the display device, the target object can perform a gesture action of moving the line segment in the central area, and by acquiring image information including the gesture action, the projection content of the projector can be modified from displaying a line segment in the central area to displaying a line segment in the upper right corner.
[0169] It should be noted that the above description is only an exemplary description of how the target object modifies the projected content of the projector. In the embodiment of the present invention, the way in which the target object modifies the projected content of the projector can be designed according to actual needs, and the embodiment of the present invention does not specifically limit this.
[0170] On the basis of the above embodiment, the projector interaction control method may further include: updating the interaction result output by the preset interaction model according to the adjusted projection content.
[0171] Specifically, during the interaction between the target object and the projector, the data in the model training database can be updated in real time, and the deep learning model can be trained again based on the updated model training database, so that the obtained preset interaction model can learn more personalized feature information; based on the personalized feature information of each target object, the interaction result corresponding to the interaction action information of the target object can be determined, and different interaction action information of the target object can correspond to different interaction results. However, due to the limitation of the data in the model training database during the machine learning process, the personalized feature information learned is limited, which leads to a certain deviation between the interaction result corresponding to the interaction action information output by the preset interaction model and the actual expression content, and then leads to a certain deviation in the projection content of the projector determined according to the interaction result. When the projection content of the projector is not the content that the target object wants to express, the target object can modify the projection content; at this time, the interaction result output by the preset interaction model after the unique identification information and interaction action information of the target object are input can be updated according to the modified projection content to ensure that the next time the target object has the interaction action information again, the preset interaction model can output an accurate interaction result, which is conducive to improving the accuracy of the interaction between the target object and the projector.
[0172] After controlling the projection content of the projector, this embodiment can adjust the projection content based on the image information and / or voice information acquired in real time, so that the projection content of the projector can accurately express the content that the target object wants to express, thereby further improving the accuracy and convenience of the interaction between the target object and the projector.
[0173] Embodiment 7
[0174] Fig.11 This is a schematic diagram of the structure of a projector interactive control device provided in Embodiment 7 of the present invention. This embodiment can be applied to realize personalized interaction with the projected content of the projector without the aid of external devices. The projector interactive control device can be implemented in the form of hardware and / or software, and the projector interactive control device can be configured in the data processing module of the projector. Fig.11 As shown, the device comprises:
[0175] The information acquisition module 71 is used to acquire the unique identification information and interactive action information of the target object;
[0176] An interaction result acquisition module 72, used to input the unique identification information and interaction action information of the target object into a preset interaction model, and acquire an interaction result corresponding to the interaction action information of the target object;
[0177] The projection content control module 73 is used to control the projection content of the projector according to the interaction result.
[0178] Optionally, the projector interactive control device may further include:
[0179] The target object determination module is used to obtain the image information and / or voice information of each actual participating object in real time before obtaining the unique identification information and interactive action information of the target object; determine the action identification of each actual participating object based on the image information and / or voice information of each actual participating object; and determine the actual participating object whose action identification is a preset identification as the target object.
[0180] Optionally, the projector interactive control device may further include:
[0181] A feature acquisition module is used to obtain unique identification information and interaction feature information of each initial participant;
[0182] A database construction module is used to construct a model training database in which the unique identification information and the interaction feature information correspond one to one according to the unique identification information and the interaction feature information of each initial participant;
[0183] The model training module is used to train the deep learning model through the model training database to obtain a preset interaction model.
[0184] Optionally, the projector interactive control device may further include:
[0185] The data update module is used to update the model training database according to the unique identification information and interaction action information of the target object.
[0186] Optionally, the data update module is specifically used to: determine whether the unique identification information of the target object exists in the model training database; if so, update the interaction feature information corresponding to the unique identification information of the target object in the model training database according to the unique identification information and interaction action information of the target object.
[0187] Optionally, the data update module is also specifically used to: if the unique identification information of the target object does not exist in the model training database, use the interaction action information as the interaction feature information corresponding to the unique identification information of the target object; add the unique identification information of the target object and the interaction feature information of the target object to the model training database.
[0188] Optionally, the projector interactive control device may further include:
[0189] A real-time information acquisition module is used to acquire image information and / or voice information of a target object in real time;
[0190] The projection content adjustment module is used to adjust the projection content according to the image information and / or voice information of the target object.
[0191] Optionally, the projector interactive control device may further include:
[0192] The result updating module is used to update the interaction result output by the preset interaction model according to the adjusted projection content.
[0193] Optionally, the information acquisition module is specifically used to: acquire image information and / or voice information of the target object in real time; and determine unique identification information and interactive action information of the target object based on the image information and / or voice information of the target object.
[0194] Optionally, the information acquisition module is specifically used to: determine actual action information and action reference information of the target object based on image information and / or voice information of the target object; determine interactive action information of the target object based on the actual action information and action reference information.
[0195] The projector interactive control device provided in the embodiment of the present invention can execute the projector interactive control method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method. The similarities can be referred to the above description and will not be repeated here.
[0196] Embodiment 8
[0197] This embodiment provides a computer-readable storage medium, which stores computer instructions. The computer instructions are used to enable a processor to implement the projector interactive control method of any embodiment of the present invention when executed.
[0198] Wherein, computer readable storage medium can be tangible medium, and it can contain or store for instruction execution system, device or equipment use or with instruction execution system, device or equipment use computer program in combination.Computer readable storage medium can include but not limited to electronic, magnetic, optical, electromagnetic, infrared or semiconductor system, device or equipment, or any suitable combination of the above.Alternatively, computer readable storage medium can be machine readable signal medium.More specific examples of machine readable storage medium can include electrical connection based on one or more lines, portable computer disk, hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.
[0199] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.
[0200] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims
1. A projector interactive control method, characterized in that: include: Obtain unique identification information and interactive action information of the target object; Inputting the unique identification information of the target object and the interaction action information into a preset interaction model to obtain an interaction result corresponding to the interaction action information; The projection content of the projector is controlled according to the interaction result.
2. The projector interactive control method according to claim 1, characterized in that: Before obtaining the unique identification information and interaction action information of the target object, it also includes: Acquire image information and / or voice information of each actual participating object in real time; Determining an action identifier of each of the actual participating objects according to the image information and / or voice information of each of the actual participating objects; The actual participating object whose action identifier is a preset identifier is determined as the target object.
3. The projector interactive control method according to claim 1, characterized in that: Also includes: Obtaining unique identification information and interaction feature information of each initial participant; According to the unique identification information and the interaction feature information of each of the initial participating objects, a model training database is constructed in which the unique identification information corresponds to the interaction feature information one by one; The deep learning model is trained through the model training database to obtain the preset interaction model.
4. The projector interactive control method according to claim 3, characterized in that: Also includes: The model training database is updated according to the unique identification information and the interactive action information of the target object.
5. The projector interactive control method according to claim 4, characterized in that: Updating the model training database according to the unique identification information and the interactive action information of the target object includes: Determine whether the unique identification information of the target object exists in the model training database; If so, the interaction feature information corresponding to the unique identification information of the target object in the model training database is updated according to the unique identification information of the target object and the interaction action information.
6. The projector interactive control method according to claim 5, characterized in that: Updating the model training database according to the unique identification information and the interactive action information of the target object also includes: If the unique identification information of the target object does not exist in the model training database, using the interaction action information as the interaction feature information corresponding to the unique identification information of the target object; The unique identification information of the target object and the interactive feature information of the target object are added to the model training database.
7. The projector interactive control method according to claim 1, characterized in that: Also includes: Acquiring image information and / or voice information of the target object in real time; The projection content is adjusted according to the image information and / or voice information of the target object.
8. The projector interactive control method according to claim 7, characterized in that: Also includes: According to the adjusted projection content, the interaction result output by the preset interaction model is updated.
9. The projector interactive control method according to claim 1, characterized in that: Get the unique identification information and interaction action information of the target object, including: Acquiring image information and / or voice information of the target object in real time; Unique identification information and interactive action information of the target object are determined according to the image information of the target object and / or the voice information of the target object.
10. The projector interactive control method according to claim 9, characterized in that: Determining the interactive action information of the target object according to the image information of the target object and / or the voice information of the target object includes: Determining actual action information and action reference information of the target object according to the image information of the target object and / or the voice information of the target object; Determine interactive action information of the target object according to the actual action information and the action reference information.
11. A projector interactive control device, characterized in that: include: An information acquisition module is used to obtain the unique identification information and interactive action information of the target object; An interaction result acquisition module, used to input the unique identification information of the target object and the interaction action information into a preset interaction model, and acquire an interaction result corresponding to the interaction action information; A projection content control module is used to control the projection content of the projector according to the interaction result.
12. A projector, characterized in that: include: Data processing module, image acquisition module, voice input module and projection output module; The image acquisition module is used to acquire image information; The voice input module is used to obtain voice information; The projection output module is used to output projection content; The data processing module is connected to the image acquisition module, the voice input module and the projection output module respectively; the data processing module is used to obtain the image information and the voice information, execute the projector interactive control method described in any one of claims 1-10, and control the projection output module to output the projection content.
13. The projector according to claim 12, characterized in that: The image acquisition module includes a plurality of cameras arranged in an array; Each of the cameras collects image information at different viewing angles around the projector.
14. The projector according to claim 12, characterized in that: Also includes: Wireless communication module; The data processing module performs signal interaction with a remote terminal and / or a server via the wireless communication module.
15. The projector according to claim 12, characterized in that: Also includes: Storage module; The data processing module is also connected to the storage module.
16. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the projector interactive control method according to any one of claims 1 to 11 when executed.