A naked-eye 3D large-screen interaction control system and method based on a multi-category mode
By analyzing scene content in real time on a naked-eye 3D large screen and determining the priority of multiple interaction methods, and combining gesture, voice, tactile and visual interaction, the problem of the single traditional interaction method is solved, achieving efficient and reliable interactive control and improving the user experience.
Patent Information
- Application Number
- CN202510680284.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2025-05-26
- Publication Date
- 2026-02-17
- Estimated Expiration
- 2045-05-26
AI Technical Summary
Traditional naked-eye 3D large screens have a single interaction method, which cannot meet the diverse interaction needs in complex scenarios. This may lead to interaction conflicts or failure to accurately identify user intentions, thus affecting the user experience.
The scene analysis module analyzes scene content in real time, determines the priority of multiple types of interaction methods, receives user interaction signals, and generates corresponding interaction instructions, including gestures, voice, tactile and visual interactions, to ensure the accuracy and reliability of interaction control.
It enables efficient interactive control of naked-eye 3D large screens in different application scenarios, improves user experience, and ensures the accuracy and reliability of interaction.
Smart Images

Figure CN120491830B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of equipment control technology, and in particular to a naked-eye 3D large-screen interactive control system and method based on multiple categories. Background Technology
[0002] Currently, with the continuous development of technology, the application scenarios of naked-eye 3D large screens are becoming more and more widespread, such as commercial displays, education and training, entertainment and games;
[0003] However, traditional naked-eye 3D large screen interaction methods are often relatively simple, possibly relying only on gesture recognition or simple touch control, which cannot meet the needs of different interaction methods at the same time, and thus cannot meet the diverse interaction needs in complex scenarios. Moreover, in scenarios where multiple people participate in the interaction at the same time, a single interaction method may lead to interaction conflicts or the inability to accurately identify the intentions of each user. Furthermore, different application scenarios may require different types of interaction methods to achieve the best user experience, which greatly reduces the effectiveness of naked-eye 3D large screen interaction control.
[0004] Therefore, in order to overcome the above-mentioned defects, the present invention provides a naked-eye 3D large-screen interactive control system and method based on multiple categories. Summary of the Invention
[0005] This invention provides a naked-eye 3D large-screen interactive control system and method based on multiple categories of interaction methods. By prioritizing multiple interaction methods according to scene content, it facilitates the adoption of more suitable interaction methods in different scene content, ensuring the effectiveness and accuracy of naked-eye 3D large-screen interactive control. Simultaneously, it can receive corresponding interaction signals in real time based on the user's selected target category interaction method, and then determine the user's identity and interaction action based on the interaction signals, thereby generating corresponding interaction commands for each user. This achieves the effect of interactive control of the naked-eye 3D large screen, ensuring the accuracy and reliability of naked-eye 3D large-screen interactive control, while meeting the needs of naked-eye 3D large screens in different application scenarios, greatly improving the user experience.
[0006] This invention provides a naked-eye 3D large-screen interactive control system based on multiple categories, comprising:
[0007] The scene analysis module is used to analyze the scene content at different times in the naked-eye 3D large screen in real time, and determine the priority of multiple types of interaction methods at different times based on the scene content;
[0008] The interaction signal receiving module is used to determine the target category interaction method selected by different users based on priority, and to receive the interaction signal input based on the target category interaction method;
[0009] The interactive control module is used to determine the user's identity and interactive actions based on the interactive signals, generate interactive instructions for each user based on the user's identity and interactive actions, and control the naked-eye 3D screen to perform interactive operations based on the interactive instructions.
[0010] Preferably, a naked-eye 3D large-screen interactive control system based on a multi-category approach includes a scene analysis module, comprising:
[0011] The image content acquisition unit is used to access the main control center of the naked-eye 3D screen, and determine the corresponding image sequence in the time series of the naked-eye 3D screen based on the access results, and obtain the target display image at different times based on the correspondence between the time series and the image sequence.
[0012] Scene content determination unit, used for:
[0013] The target display image is identified, its spatial structure is determined, and layers are divided based on the spatial structure.
[0014] Based on the layer division results, the layer elements in each layer are identified to obtain the main object and its corresponding morphological features in each layer. Based on the main object and morphological features, the scene content at different times in the naked-eye 3D large screen is obtained.
[0015] Preferably, a naked-eye 3D large-screen interactive control system based on multiple interaction methods includes: gesture interaction, voice interaction, tactile interaction and visual interaction.
[0016] Preferably, a naked-eye 3D large-screen interactive control system based on a multi-category approach includes a scene analysis module, comprising:
[0017] The scene content parsing unit is used for:
[0018] The scene content is analyzed to determine the main objectives of the scene content, and the visualization display task of the main objectives on the naked-eye 3D large screen is determined.
[0019] Based on industry implementation standards, the permissible types of interaction methods for scene content are determined according to the visualization display task;
[0020] Priority determination unit, used for:
[0021] The parameters of the naked-eye 3D large screen are traversed to determine the operating environment and device resource configuration of the scene content, and the feasibility and effectiveness of the scene content are evaluated based on the operating environment and device resource configuration.
[0022] Based on the feasibility and effectiveness assessment results, the permissible multiple types of interaction methods are prioritized.
[0023] Preferably, a naked-eye 3D large-screen interactive control system based on a multi-category approach includes a priority determination unit, comprising:
[0024] Simulate the running subunit for:
[0025] Based on the operating environment and device resource configuration of the naked-eye 3D large screen, a virtual operating scene is constructed in the computer, and virtual interaction requests with multiple permissible interaction methods are constructed in the virtual operating scene.
[0026] Based on the naked-eye 3D large screen, it responds to virtual interaction requests of different types of interaction methods and monitors the response process in real time to obtain the simulated running status of scene content;
[0027] The feasibility assessment subunit is used for:
[0028] The smoothness of scene content response on the naked-eye 3D large screen is determined based on the simulated running state, and the smoothness of response is used as the first evaluation parameter.
[0029] Meanwhile, based on the simulated running state, the display effect of scene content under each type of interaction method is determined, and the adaptability of scene content to each type of interaction method is determined based on the display effect, and the adaptability is used as the second evaluation parameter.
[0030] Based on the interaction requirements, weights are assigned to the first and second evaluation parameters respectively, and the first and second evaluation parameters are comprehensively analyzed based on the allocation results to obtain the feasibility effect evaluation results of each type of interaction method.
[0031] Preferably, a naked-eye 3D large-screen interactive control system based on a multi-category approach includes an interactive signal receiving module, comprising:
[0032] The interaction method determination unit is used for:
[0033] Prioritize the various interaction methods for different scenarios and content, push them to users, grant users uplink communication permissions based on the push results, and receive feedback signals from different users on various interaction methods in real time based on the grant results.
[0034] Based on feedback signals, determine the interaction method for different user-selected target categories;
[0035] The signal receiving unit is used for:
[0036] Based on the target category interaction method, the corresponding linkage component is determined on the naked-eye 3D large screen, and the linkage component is initialized.
[0037] Based on the device initialization results, the linkage components are self-calibrated, and based on the device self-calibration results, the linkage is used to detect and receive the interaction signals of different users in real time, so as to obtain the interaction signal sequence of different users.
[0038] The signal filtering unit is used for:
[0039] Obtain sample datasets for each type of interaction method, parse the sample datasets, and determine the action features of interactive actions for each type of interaction method;
[0040] Based on the action features, the action parameters corresponding to each sample data are determined, and the action parameters corresponding to different sample data are recorded in sequence to obtain the parameter fluctuation range of interactive actions under each category of interaction mode.
[0041] Based on action characteristics and parameter fluctuation range, a signal filtering model for each type of interaction mode is constructed, and the signal filtering models for multiple types of interaction modes are integrated to obtain the target signal filtering model.
[0042] The target signal screening model is deployed on a naked-eye 3D screen, and interference signal detection is performed on the received interactive signal sequence based on the deployment results.
[0043] The interaction signal sequence is purified based on the interference signal detection results to obtain the final interaction signal.
[0044] Preferably, a naked-eye 3D large-screen interactive control system based on multiple categories includes an interactive control module comprising:
[0045] Interactive action determination unit, used for:
[0046] The interaction signals are preprocessed, and the action focus of the interaction signals is determined based on the category of interaction mode corresponding to the interaction signals.
[0047] Based on action focus, action features are extracted from the preprocessed interaction signal to obtain the action features contained in the interaction signal, and the association logic of the action features is determined based on the category interaction method.
[0048] Actions are associated with action features based on association logic, and the action association results are matched with a predefined set of actions to obtain the interactive actions corresponding to the interaction signals.
[0049] The identity verification unit is used for:
[0050] The user identity signal recognition dimension is determined, and key identity signals are extracted from the interaction signals based on the user identity signal recognition dimension to obtain the biometric features of different users, including face, fingerprint and iris.
[0051] The extracted biometric features are matched with the registered user identities to obtain the user identities of different users;
[0052] The binding unit is used to associate and bind the user identity of different users with their corresponding interactive actions.
[0053] Preferably, a naked-eye 3D large-screen interactive control system based on multiple categories includes an interactive control module comprising:
[0054] Instruction generation unit, used for:
[0055] Identify interactive actions, determine the control requirements for the interactive actions, and break down the control requirements into nodes based on the business attributes of the interactive components;
[0056] Based on node splitting, the personalized execution action and execution object of each interactive component are obtained, and the instruction elements are combined in the first logical combination based on the personalized execution action and execution object to obtain the first interactive instruction of each interactive component.
[0057] The second interaction instruction is obtained by combining the first interaction instruction with the second logic based on the collaborative logic of the interaction component.
[0058] Interactive control unit, used for:
[0059] The system controls the naked-eye 3D screen to perform interactive operations based on the second interactive command, and monitors the interactive operations dynamically to generate an interactive control timing report.
[0060] This invention provides a naked-eye 3D large-screen interactive control method based on multiple categories, including:
[0061] Step 1: Analyze the scene content on the naked-eye 3D screen at different times in real time, and determine the priority of multiple interaction methods at different times based on the scene content;
[0062] Step 2: Determine the target category interaction method selected by different users based on priority, and receive the interaction signal input based on the target category interaction method;
[0063] Step 3: Determine the user's identity and interaction actions based on the interaction signals, generate corresponding interaction instructions for each user based on the user's identity and interaction actions, and control the naked-eye 3D screen to perform interactive operations based on the interaction instructions.
[0064] Preferably, a naked-eye 3D large-screen interactive control method based on multi-category approach includes, in step 1, real-time analysis of scene content on the naked-eye 3D large screen at different times, including:
[0065] Access the main control center of the naked-eye 3D screen, and determine the corresponding image sequence in the time series of the naked-eye 3D screen based on the access results. Based on the correspondence between the time series and the image sequence, obtain the target display image at different times.
[0066] The target display image is identified, its spatial structure is determined, and layers are divided based on the spatial structure.
[0067] Based on the layer division results, the layer elements in each layer are identified to obtain the main object and its corresponding morphological features in each layer. Based on the main object and morphological features, the scene content at different times in the naked-eye 3D large screen is obtained.
[0068] Compared with the prior art, the beneficial effects of the present invention are as follows:
[0069] By prioritizing multiple interaction methods based on scene content, more suitable interaction methods can be adopted for different scene content, ensuring the effectiveness and accuracy of interactive control of the naked-eye 3D large screen. At the same time, it can receive corresponding interaction signals in real time according to the target category of interaction method selected by the user, and then determine the user's identity and interaction action based on the interaction signals, thereby generating corresponding interaction commands for each user. This achieves the effect of interactive control of the naked-eye 3D large screen, ensuring the accuracy and reliability of interactive control of the naked-eye 3D large screen, while meeting the needs of the naked-eye 3D large screen in different application scenarios, greatly improving the user experience.
[0070] Other features and advantages of the invention will be set forth in the description which follows, and will be apparent in part from the description, or may be learned by practicing the invention. The objects and other advantages of the invention may be realized and obtained by means of the structures particularly pointed out in this application.
[0071] The technical solution of the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. Attached Figure Description
[0072] The accompanying drawings are provided to further illustrate the invention and form part of the specification. They are used in conjunction with embodiments of the invention to explain the invention and do not constitute a limitation thereof. In the drawings:
[0073] Figure 1 This is a structural diagram of a naked-eye 3D large-screen interactive control system based on a multi-category approach, as described in an embodiment of the present invention.
[0074] Figure 2 This is a structural diagram of the scene analysis module in a naked-eye 3D large-screen interactive control system based on a multi-category approach, as described in an embodiment of the present invention.
[0075] Figure 3 This is a flowchart of a naked-eye 3D large-screen interactive control method based on a multi-category approach, as described in an embodiment of the present invention. Detailed Implementation
[0076] The preferred embodiments of the present invention will be described below with reference to the accompanying drawings. It should be understood that the preferred embodiments described herein are for illustration and explanation only and are not intended to limit the present invention.
[0077] This embodiment provides a naked-eye 3D large-screen interactive control system based on multiple categories, such as... Figure 1 As shown, it includes:
[0078] The scene analysis module is used to analyze the scene content at different times in the naked-eye 3D large screen in real time, and determine the priority of multiple types of interaction methods at different times based on the scene content;
[0079] The interaction signal receiving module is used to determine the target category interaction method selected by different users based on priority, and to receive the interaction signal input based on the target category interaction method;
[0080] The interactive control module is used to determine the user's identity and interactive actions based on the interactive signals, generate interactive instructions for each user based on the user's identity and interactive actions, and control the naked-eye 3D screen to perform interactive operations based on the interactive instructions.
[0081] In this embodiment, scene content refers to the specific content played on the naked-eye 3D large screen at different times, such as advertisements and games.
[0082] In this embodiment, the multiple interaction methods include gesture interaction, voice interaction, tactile interaction and visual interaction (eye tracking).
[0083] In this embodiment, the priority is determined by sorting the control effects of different types of interaction methods based on the scene content at different times in the naked-eye 3D large screen. For example, in the educational scenario, precise pointing interaction may be required, while in the entertainment scenario, more emphasis may be placed on free gesture and action interaction. Therefore, the effects achieved by using different interaction methods for different scene content are different.
[0084] In this embodiment, the target category interaction method refers to the final interaction method selected by the user based on priority.
[0085] In this embodiment, the interaction signal refers to the user's interaction needs with the naked-eye 3D large screen through the target category interaction method, such as the gesture "slide" or voice signal.
[0086] The beneficial effects of the above technical solution are as follows: By prioritizing multiple types of interaction methods based on scene content, it is easier to adopt more suitable interaction methods in different scene content, ensuring the effectiveness and accuracy of interactive control of naked-eye 3D large screen. At the same time, it can receive corresponding interaction signals in real time according to the target category of interaction method selected by the user, and then determine the user's identity and interaction action based on the interaction signals, thereby generating corresponding interaction instructions for each user, achieving the effect of interactive control of naked-eye 3D large screen, ensuring the accuracy and reliability of interactive control of naked-eye 3D large screen, and meeting the needs of naked-eye 3D large screen in different application scenarios, greatly improving the user experience.
[0087] In one embodiment, a naked-eye 3D large-screen interactive control system based on a multi-category approach is provided, such as... Figure 2 As shown, the scene analysis module includes:
[0088] The image content acquisition unit is used to access the main control center of the naked-eye 3D screen, and determine the corresponding image sequence in the time series of the naked-eye 3D screen based on the access results, and obtain the target display image at different times based on the correspondence between the time series and the image sequence.
[0089] Scene content determination unit, used for:
[0090] The target display image is identified, its spatial structure is determined, and layers are divided based on the spatial structure.
[0091] Based on the layer division results, the layer elements in each layer are identified to obtain the main object and its corresponding morphological features in each layer. Based on the main object and morphological features, the scene content at different times in the naked-eye 3D large screen is obtained.
[0092] In this embodiment, the image sequence refers to the images that need to be played at different times in advance on the naked-eye 3D screen, which corresponds to the time sequence.
[0093] In this embodiment, the target display image refers to the specific image information corresponding to each moment.
[0094] In this embodiment, spatial structure refers to the positional relationships between content or objects contained in the target display image.
[0095] In this embodiment, layer division refers to distinguishing different objects contained in the target display image, thereby determining the main object (the object to be displayed) contained in the target display image.
[0096] In this embodiment, morphological features refer to the appearance outline or structural features of the main object.
[0097] The beneficial effects of the above technical solution are: it ensures the accuracy of determining the scene content at different times in the naked-eye 3D large screen, provides convenience and guarantee for determining the priority of multiple types of interaction methods under different scene content, and thus improves the reliability of the interaction control of the naked-eye 3D large screen.
[0098] In one embodiment, a naked-eye 3D large-screen interactive control system based on multiple interaction methods is provided, including gesture interaction, voice interaction, tactile interaction and visual interaction.
[0099] In one embodiment, a naked-eye 3D large-screen interactive control system based on a multi-category approach is provided, including a scene analysis module:
[0100] The scene content parsing unit is used for:
[0101] The scene content is analyzed to determine the main objectives of the scene content, and the visualization display task of the main objectives on the naked-eye 3D large screen is determined.
[0102] Based on industry implementation standards, the permissible types of interaction methods for scene content are determined according to the visualization display task;
[0103] Priority determination unit, used for:
[0104] The parameters of the naked-eye 3D large screen are traversed to determine the operating environment and device resource configuration of the scene content, and the feasibility and effectiveness of the scene content are evaluated based on the operating environment and device resource configuration.
[0105] Based on the feasibility and effectiveness assessment results, the permissible multiple types of interaction methods are prioritized.
[0106] In this embodiment, the main target refers to the main object or object recorded in the scene content, such as the structure and appearance of a product.
[0107] In this embodiment, the visualization display task refers to the form and effect of visually displaying the main target on a naked-eye 3D large screen. For example, when the main target is a game character, the visualization display task is to display the appearance, posture and movements of the game character in detail.
[0108] In this embodiment, the industry implementation standard is known in advance and is used to characterize all the interaction methods that can be used for different scenario content.
[0109] In this embodiment, the operating environment refers to the parameter configuration of the scene content when it runs on a naked-eye 3D large screen.
[0110] In this embodiment, the feasibility effect assessment is used to evaluate the effect of visual display of the scene on a naked-eye 3D large screen under the current operating environment and equipment resource configuration. That is, it analyzes the effect of visual display of scene content, including the smoothness of scene content visualization.
[0111] The beneficial effects of the above technical solution are as follows: by determining the main objectives and visualization tasks in the scene content, and combining industry standards to determine the permissible multiple types of interaction methods for a given scene content, and secondly, by evaluating the feasibility of the scene content in conjunction with the operating environment and device resource configuration of the scene content in the naked-eye 3D large screen, and finally prioritizing the permissible multiple types of interaction methods according to the evaluation results, it provides convenience and guarantee for realizing interactive control of the naked-eye 3D large screen.
[0112] In one embodiment, a naked-eye 3D large-screen interactive control system based on a multi-category approach is provided, including a priority determination unit comprising:
[0113] Simulate the running subunit for:
[0114] Based on the operating environment and device resource configuration of the naked-eye 3D large screen, a virtual operating scene is constructed in the computer, and virtual interaction requests with multiple permissible interaction methods are constructed in the virtual operating scene.
[0115] Based on the naked-eye 3D large screen, it responds to virtual interaction requests of different types of interaction methods and monitors the response process in real time to obtain the simulated running status of scene content;
[0116] The feasibility assessment subunit is used for:
[0117] The smoothness of scene content response on the naked-eye 3D large screen is determined based on the simulated running state, and the smoothness of response is used as the first evaluation parameter.
[0118] Meanwhile, based on the simulated running state, the display effect of scene content under each type of interaction method is determined, and the adaptability of scene content to each type of interaction method is determined based on the display effect, and the adaptability is used as the second evaluation parameter.
[0119] Based on the interaction requirements, weights are assigned to the first and second evaluation parameters respectively, and the first and second evaluation parameters are comprehensively analyzed based on the allocation results to obtain the feasibility effect evaluation results of each type of interaction method.
[0120] In this embodiment, the virtual running scene is a simulated scene constructed in a computer based on the operating environment and device resource configuration, used to test the interactive feasibility of different scene content on a naked-eye 3D large screen.
[0121] In this embodiment, the virtual interaction request is a simulated request generated in the computer and is used in conjunction with the virtual running scenario for simulated detection.
[0122] In this embodiment, the first evaluation parameter refers to the smoothness of the scene content response on the naked-eye 3D screen, that is, the smoothness of the scene content when it changes according to the interaction request on the naked-eye 3D screen, including whether there is any lag.
[0123] In this embodiment, the fit is used to characterize the matching degree between scene content and each type of interaction method. For example, in the game screen, the gesture interaction method is more effective than the voice interaction method, that is, the fit degree between the gesture interaction method and the scene content is higher than that between the voice interaction method and the scene content.
[0124] In this embodiment, the second evaluation parameter is used to characterize the adaptation of different types of interaction methods to the corresponding scene content under different scene content.
[0125] In this embodiment, the interaction requirements are known in advance, such as the effect of displaying scene content.
[0126] The beneficial effects of the above technical solution are: it ensures the accuracy and reliability of the feasibility effect assessment of each type of interaction method, thereby ensuring the accuracy of prioritizing the allowed multiple types of interaction methods, and thus providing a guarantee for improving the interactive control effect of naked-eye 3D large screen.
[0127] In one embodiment, a naked-eye 3D large-screen interactive control system based on a multi-category approach is provided, comprising an interactive signal receiving module, including:
[0128] The interaction method determination unit is used for:
[0129] Prioritize the various interaction methods for different scenarios and content, push them to users, grant users uplink communication permissions based on the push results, and receive feedback signals from different users on various interaction methods in real time based on the grant results.
[0130] Based on feedback signals, determine the interaction method for different user-selected target categories;
[0131] The signal receiving unit is used for:
[0132] Based on the target category interaction method, the corresponding linkage component is determined on the naked-eye 3D large screen, and the linkage component is initialized.
[0133] Based on the device initialization results, the linkage components are self-calibrated, and based on the device self-calibration results, the linkage is used to detect and receive the interaction signals of different users in real time, so as to obtain the interaction signal sequence of different users.
[0134] The signal filtering unit is used for:
[0135] Obtain sample datasets for each type of interaction method, parse the sample datasets, and determine the action features of interactive actions for each type of interaction method;
[0136] Based on the action features, the action parameters corresponding to each sample data are determined, and the action parameters corresponding to different sample data are recorded in sequence to obtain the parameter fluctuation range of interactive actions under each category of interaction mode.
[0137] Based on action characteristics and parameter fluctuation range, a signal filtering model for each type of interaction mode is constructed, and the signal filtering models for multiple types of interaction modes are integrated to obtain the target signal filtering model.
[0138] The target signal screening model is deployed on a naked-eye 3D screen, and interference signal detection is performed on the received interactive signal sequence based on the deployment results.
[0139] The interaction signal sequence is purified based on the interference signal detection results to obtain the final interaction signal.
[0140] In this embodiment, uplink communication permission refers to the permission of the user to send messages or requests to the naked-eye 3D screen via a communication channel. Once enabled, the user can send corresponding interactive information to the naked-eye 3D screen.
[0141] In this embodiment, the feedback signal refers to the user's autonomous selection of multiple interaction methods.
[0142] In this embodiment, the target category interaction method refers to the interaction method finally determined by the user, which is one of the known multi-category interaction methods.
[0143] In this embodiment, the linkage components correspond to the target category interaction methods. For example, when the interaction method is gesture interaction, the linkage components include cameras and motion capture devices, etc. The linkage components corresponding to different categories of interaction methods are different.
[0144] In this embodiment, device initialization refers to the unified restoration of the parameters of the linkage components, so as to facilitate the corresponding configuration adjustments according to the interaction requirements.
[0145] In this embodiment, device self-calibration refers to calibrating the working accuracy of the linkage components as well as the operating conditions and environment.
[0146] In this embodiment, the interaction signal sequence refers to the interaction signals at different times obtained after real-time acquisition of the user's interaction signals.
[0147] In this embodiment, the sample dataset refers to the historical sample data corresponding to each category of interaction method.
[0148] In this embodiment, action features refer to the characteristics of interactive actions under each type of interaction method, including the amplitude of the interactive action and the type of action.
[0149] In this embodiment, the action parameter refers to the specific degree of execution of the interactive action under each type of interaction method. For example, when the interactive action is a gesture, it can be the distance of the gesture swipe.
[0150] In this embodiment, the signal filtering model is a signal filtering mechanism for each type of interaction mode built based on action characteristics and parameter fluctuation range. The purpose is to eliminate abnormal interaction signals under each type of interaction mode.
[0151] In this embodiment, the target signal filtering model refers to an overall model obtained by integrating and summarizing signal filtering models of multiple interaction methods.
[0152] In this embodiment, interference signal detection refers to non-interactive signals in the interactive signals. For example, when the interaction method is tactile interaction, the interactive signal generated when briefly touched is the interference signal.
[0153] In this embodiment, the purification process refers to removing the detected interference signals from the interactive signal sequence.
[0154] The beneficial effects of the above technical solution are: it ensures accurate and effective reception of user interaction signals, thereby facilitating corresponding interactive control of the naked-eye 3D screen according to the user's interaction needs. At the same time, it can filter the received user interaction signals, eliminate interference signals, ensure the accuracy and reliability of the final interaction signals, and also guarantee the effectiveness of interactive control of the naked-eye 3D screen.
[0155] In one embodiment, a naked-eye 3D large-screen interactive control system based on a multi-category approach is provided, the interactive control module including:
[0156] Interactive action determination unit, used for:
[0157] The interaction signals are preprocessed, and the action focus of the interaction signals is determined based on the category of interaction mode corresponding to the interaction signals.
[0158] Based on action focus, action features are extracted from the preprocessed interaction signal to obtain the action features contained in the interaction signal, and the association logic of the action features is determined based on the category interaction method.
[0159] Actions are associated with action features based on association logic, and the action association results are matched with a predefined set of actions to obtain the interactive actions corresponding to the interaction signals.
[0160] The identity verification unit is used for:
[0161] The user identity signal recognition dimension is determined, and key identity signals are extracted from the interaction signals based on the user identity signal recognition dimension to obtain the biometric features of different users, including face, fingerprint and iris.
[0162] The extracted biometric features are matched with the registered user identities to obtain the user identities of different users;
[0163] The binding unit is used to associate and bind the user identity of different users with their corresponding interactive actions.
[0164] In this embodiment, preprocessing refers to sorting and cleaning the interactive signals.
[0165] In this embodiment, the action focus is determined according to the type of interaction method. For example, when the interaction method is gesture interaction, the action focus is the user's gesture action, and when the interaction method is voice interaction, the action focus is the specific voice input by the user.
[0166] In this embodiment, action feature extraction refers to extracting key information about actions related to the interaction from the interaction signal.
[0167] In this embodiment, action features refer to the results obtained after extracting action features from the interaction signals, that is, behaviors that can characterize the user's specific interaction needs.
[0168] In this embodiment, the association logic refers to the standard or rule for associating action features, such as sequentially associating the user's gestures at different times to obtain the user's specific gesture actions.
[0169] In this embodiment, the predefined set of actions is set in advance.
[0170] In this embodiment, the user identity signal recognition dimension refers to determining the user's identity information through dimensions such as the user's face, fingerprint, and iris.
[0171] The beneficial effects of the above technical solution are as follows: by processing the interaction signal, the action features in the interaction signal can be effectively extracted, and the extracted action features can be associated and matched with a predefined action set to achieve accurate and effective determination of the interaction action corresponding to the interaction signal. At the same time, the user's identity information can be determined through the interaction signal, and the determined interaction action can be bound to the user's identity information, thereby facilitating the differentiation of interaction requests from different users and improving the interaction control effect of naked-eye 3D large screen.
[0172] In one embodiment, a naked-eye 3D large-screen interactive control system based on a multi-category approach is provided, the interactive control module including:
[0173] Instruction generation unit, used for:
[0174] Identify interactive actions, determine the control requirements for the interactive actions, and break down the control requirements into nodes based on the business attributes of the interactive components;
[0175] Based on node splitting, the personalized execution action and execution object of each interactive component are obtained, and the instruction elements are combined in the first logical combination based on the personalized execution action and execution object to obtain the first interactive instruction of each interactive component.
[0176] The second interaction instruction is obtained by combining the first interaction instruction with the second logic based on the collaborative logic of the interaction component.
[0177] Interactive control unit, used for:
[0178] The system controls the naked-eye 3D screen to perform interactive operations based on the second interactive command, and monitors the interactive operations dynamically to generate an interactive control timing report.
[0179] In this embodiment, the control requirements are determined based on the interactive actions, such as the sensitivity or accuracy of the control.
[0180] In this embodiment, business attributes refer to the interactive tasks that the interactive component can perform.
[0181] In this embodiment, node splitting refers to splitting control requirements according to the business attributes of interactive components. The purpose is to obtain specific interactive control parameters corresponding to different interactive components, thereby ensuring that interactive components can quickly enter the interactive state.
[0182] In this embodiment, the personalized execution action value refers to the specific interactive behavior that each interactive component needs to perform.
[0183] In this embodiment, the execution object refers to the specific image element corresponding to each interactive component in the scene content, such as the legs, hands, and head of a game task.
[0184] In this embodiment, the instruction element refers to the set of instruction codes corresponding to the personalized execution action and the execution object.
[0185] In this embodiment, the first interaction instruction refers to the instruction for controlling each interaction component.
[0186] In this embodiment, the second interaction instruction refers to the result obtained by combining the first interaction instructions of each interaction component, and is used to coordinate the control of each interaction component.
[0187] In this embodiment, the interactive control timing report refers to the result obtained after real-time monitoring of the interactive control process of the naked-eye 3D large screen, which is used to record the interactive situation of the naked-eye 3D large screen at different times.
[0188] The beneficial effects of the above technical solution are: it ensures the accuracy and reliability of interactive control of naked-eye 3D large screen, while improving the user's interactive experience.
[0189] This embodiment provides a naked-eye 3D large-screen interactive control method based on multiple categories, such as... Figure 3 As shown, it includes:
[0190] Step 1: Analyze the scene content on the naked-eye 3D screen at different times in real time, and determine the priority of multiple interaction methods at different times based on the scene content;
[0191] Step 2: Determine the target category interaction method selected by different users based on priority, and receive the interaction signal input based on the target category interaction method;
[0192] Step 3: Determine the user's identity and interaction actions based on the interaction signals, generate corresponding interaction instructions for each user based on the user's identity and interaction actions, and control the naked-eye 3D screen to perform interactive operations based on the interaction instructions.
[0193] The beneficial effects of the above technical solution are as follows: By prioritizing multiple types of interaction methods based on scene content, it is easier to adopt more suitable interaction methods in different scene content, ensuring the effectiveness and accuracy of interactive control of naked-eye 3D large screen. At the same time, it can receive corresponding interaction signals in real time according to the target category of interaction method selected by the user, and then determine the user's identity and interaction action based on the interaction signals, thereby generating corresponding interaction instructions for each user, achieving the effect of interactive control of naked-eye 3D large screen, ensuring the accuracy and reliability of interactive control of naked-eye 3D large screen, and meeting the needs of naked-eye 3D large screen in different application scenarios, greatly improving the user experience.
[0194] In one embodiment, a naked-eye 3D large-screen interactive control method based on a multi-category approach is provided. Step 1 involves real-time analysis of the scene content on the naked-eye 3D large screen at different times, including:
[0195] Access the main control center of the naked-eye 3D screen, and determine the corresponding image sequence in the time series of the naked-eye 3D screen based on the access results. Based on the correspondence between the time series and the image sequence, obtain the target display image at different times.
[0196] The target display image is identified, its spatial structure is determined, and layers are divided based on the spatial structure.
[0197] Based on the layer division results, the layer elements in each layer are identified to obtain the main object and its corresponding morphological features in each layer. Based on the main object and morphological features, the scene content at different times in the naked-eye 3D large screen is obtained.
[0198] The beneficial effects of the above technical solution are: it ensures the accuracy of determining the scene content at different times in the naked-eye 3D large screen, provides convenience and guarantee for determining the priority of multiple types of interaction methods under different scene content, and thus improves the reliability of the interaction control of the naked-eye 3D large screen.
[0199] Obviously, those skilled in the art can make various modifications and variations to this invention without departing from its spirit and scope. Therefore, if these modifications and variations fall within the scope of the claims of this invention and their equivalents, this invention also intends to include these modifications and variations.
Claims
1. A naked-eye 3D large-screen interactive control system based on a multi-category approach, characterized in that, include: The scene analysis module is used to analyze the scene content at different times in the naked-eye 3D large screen in real time, and determine the priority of multiple types of interaction methods at different times based on the scene content; The interaction signal receiving module is used to determine the target category interaction method selected by different users based on priority, and to receive the interaction signal input based on the target category interaction method; The interactive control module is used to determine the user's identity and interactive actions based on the interactive signals, generate interactive instructions for each user based on the user's identity and interactive actions, and control the naked-eye 3D screen to perform interactive operations based on the interactive instructions. The interactive control module includes: Instruction generation unit, used for: Identify interactive actions, determine the control requirements for the interactive actions, and break down the control requirements into nodes based on the business attributes of the interactive components; Based on node splitting, the personalized execution action and execution object of each interactive component are obtained, and the instruction elements are combined in the first logical combination based on the personalized execution action and execution object to obtain the first interactive instruction of each interactive component. The second interaction instruction is obtained by combining the first interaction instruction with the second logic based on the collaborative logic of the interaction component. Interactive control unit, used for: The system controls the naked-eye 3D screen to perform interactive operations based on the second interactive command, and monitors the interactive operations dynamically to generate an interactive control timing report.
2. The naked-eye 3D large-screen interactive control system based on a multi-category approach according to claim 1, characterized in that, The scene analysis module includes: The image content acquisition unit is used to access the main control center of the naked-eye 3D screen, and determine the corresponding image sequence in the time series of the naked-eye 3D screen based on the access results, and obtain the target display image at different times based on the correspondence between the time series and the image sequence. Scene content determination unit, used for: The target display image is identified, its spatial structure is determined, and layers are divided based on the spatial structure. Based on the layer division results, the layer elements in each layer are identified to obtain the main object and its corresponding morphological features in each layer. Based on the main object and morphological features, the scene content at different times in the naked-eye 3D large screen is obtained.
3. The naked-eye 3D large-screen interactive control system based on multi-category methods according to claim 1, characterized in that, Multiple interaction methods include: gesture interaction, voice interaction, tactile interaction, and visual interaction.
4. The naked-eye 3D large-screen interactive control system based on multi-category methods according to claim 1, characterized in that, The scene analysis module includes: The scene content parsing unit is used for: The scene content is analyzed to determine the main objectives of the scene content, and the visualization display task of the main objectives on the naked-eye 3D large screen is determined. Based on industry implementation standards, the permissible types of interaction methods for scene content are determined according to the visualization display task; Priority determination unit, used for: The parameters of the naked-eye 3D large screen are traversed to determine the operating environment and device resource configuration of the scene content, and the feasibility and effectiveness of the scene content are evaluated based on the operating environment and device resource configuration. Based on the feasibility and effectiveness assessment results, the permissible multiple types of interaction methods are prioritized.
5. A naked-eye 3D large-screen interactive control system based on a multi-category approach according to claim 4, characterized in that, Priority determination unit, including: Simulate the running subunit for: Based on the operating environment and device resource configuration of the naked-eye 3D large screen, a virtual operating scene is constructed in the computer, and virtual interaction requests with multiple permissible interaction methods are constructed in the virtual operating scene. Based on the naked-eye 3D large screen, it responds to virtual interaction requests of different types of interaction methods and monitors the response process in real time to obtain the simulated running status of scene content; The feasibility assessment subunit is used for: The smoothness of scene content response on the naked-eye 3D large screen is determined based on the simulated running state, and the smoothness of response is used as the first evaluation parameter. Meanwhile, based on the simulated running state, the display effect of scene content under each type of interaction method is determined, and the adaptability of scene content to each type of interaction method is determined based on the display effect, and the adaptability is used as the second evaluation parameter. Based on the interaction requirements, weights are assigned to the first and second evaluation parameters respectively, and the first and second evaluation parameters are comprehensively analyzed based on the allocation results to obtain the feasibility effect evaluation results of each type of interaction method.
6. The naked-eye 3D large-screen interactive control system based on a multi-category method according to claim 1, characterized in that, The interactive signal receiving module includes: The interaction method determination unit is used for: Prioritize the various interaction methods for different scenarios and content, push them to users, grant users uplink communication permissions based on the push results, and receive feedback signals from different users on various interaction methods in real time based on the grant results. Based on feedback signals, determine the interaction method for different user-selected target categories; The signal receiving unit is used for: Based on the target category interaction method, the corresponding linkage component is determined on the naked-eye 3D large screen, and the linkage component is initialized. Based on the device initialization results, the linkage components are self-calibrated, and based on the device self-calibration results, the linkage is used to detect and receive the interaction signals of different users in real time, so as to obtain the interaction signal sequence of different users. The signal filtering unit is used for: Obtain sample datasets for each type of interaction method, parse the sample datasets, and determine the action features of interactive actions for each type of interaction method; Based on the action features, the action parameters corresponding to each sample data are determined, and the action parameters corresponding to different sample data are recorded in sequence to obtain the parameter fluctuation range of interactive actions under each category of interaction mode. Based on action characteristics and parameter fluctuation range, a signal filtering model for each type of interaction mode is constructed, and the signal filtering models for multiple types of interaction modes are integrated to obtain the target signal filtering model. The target signal screening model is deployed on a naked-eye 3D screen, and interference signal detection is performed on the received interactive signal sequence based on the deployment results. The interaction signal sequence is purified based on the interference signal detection results to obtain the final interaction signal.
7. A naked-eye 3D large-screen interactive control system based on a multi-category approach according to claim 1, characterized in that, The interactive control module includes: Interactive action determination unit, used for: The interaction signals are preprocessed, and the action focus of the interaction signals is determined based on the category of interaction mode corresponding to the interaction signals. Based on action focus, action features are extracted from the preprocessed interaction signal to obtain the action features contained in the interaction signal, and the association logic of the action features is determined based on the category interaction method. Actions are associated with action features based on association logic, and the action association results are matched with a predefined set of actions to obtain the interactive actions corresponding to the interaction signals. The identity verification unit is used for: The user identity signal recognition dimension is determined, and key identity signals are extracted from the interaction signals based on the user identity signal recognition dimension to obtain the biometric features of different users, including face, fingerprint and iris. The extracted biometric features are matched with the registered user identities to obtain the user identities of different users; The binding unit is used to associate and bind the user identity of different users with their corresponding interactive actions.
8. A naked-eye 3D large-screen interactive control method based on multi-category approach, characterized in that, include: Step 1: Analyze the scene content on the naked-eye 3D screen at different times in real time, and determine the priority of multiple interaction methods at different times based on the scene content; Step 2: Determine the target category interaction method selected by different users based on priority, and receive the interaction signal input based on the target category interaction method; Step 3: Determine the user's identity and interaction actions based on the interaction signals, generate interaction instructions for each user based on the user's identity and interaction actions, and control the naked-eye 3D screen to perform interactive operations based on the interaction instructions. Step 3 includes: Identify interactive actions, determine the control requirements for the interactive actions, and break down the control requirements into nodes based on the business attributes of the interactive components; Based on node splitting, the personalized execution action and execution object of each interactive component are obtained, and the instruction elements are combined in the first logical combination based on the personalized execution action and execution object to obtain the first interactive instruction of each interactive component. The second interaction instruction is obtained by combining the first interaction instruction with the second logic based on the collaborative logic of the interaction component. The system controls the naked-eye 3D screen to perform interactive operations based on the second interactive command, and monitors the interactive operations dynamically to generate an interactive control timing report.
9. A naked-eye 3D large-screen interactive control method based on multi-category methods according to claim 8, characterized in that, In step 1, the scene content on the naked-eye 3D large screen at different times is analyzed in real time, including: Access the main control center of the naked-eye 3D screen, and determine the corresponding image sequence in the time series of the naked-eye 3D screen based on the access results. Based on the correspondence between the time series and the image sequence, obtain the target display image at different times. The target display image is identified, its spatial structure is determined, and layers are divided based on the spatial structure. Based on the layer division results, the layer elements in each layer are identified to obtain the main object and its corresponding morphological features in each layer. Based on the main object and morphological features, the scene content at different times in the naked-eye 3D large screen is obtained.
Citation Information
Patent Citations
Viewing user tracking method and device, electronic equipment and storage medium
CN114173109A
Posture recognition system, method and electronic device
US20240331448A1