Naked eye 3D large screen interaction control system and method based on multi-category mode

Through a control system with multi-category interaction methods, the scene content is analyzed in real time and the interaction method is prioritized, the user interaction signals are received, the user identity and actions are determined, and the interaction instructions are generated. The problem of a single interaction method of traditional naked-eye 3D large-screen is solved, and the accuracy and reliability are achieved, which is improved and the user experience is improved.

CN120491830AActive Publication Date: 2025-08-15JIANGSU OGESTE INFORMATION TECH CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
CN202510680284.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-05-26
Publication Date
2025-08-15
Estimated Expiration
2045-05-26

AI Technical Summary

Technical Problem

The traditional naked-eye 3D large-screen interaction method is single, which cannot meet the diverse interaction needs in complex scenarios. It may lead to interaction conflicts or the intent cannot be accurately identified, affecting the user experience.

Method used

The control system adopts a multi-category interaction method, analyzes the scene content in real time through the scene analysis module, determines the priority of the interaction mode, and receives user interaction signals through the interactive signal receiving module, combines the interaction control module to determine the user identity and interaction actions, and generates interactive instructions to control the naked-eye 3D large screen.

Benefits of technology

It improves the accuracy and reliability of interactive control of naked-eye 3D large-screen, meets the needs of different application scenarios, and enhances the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120491830A_ABST
    Figure CN120491830A_ABST
Patent Text Reader

Abstract

The invention provides a naked eye 3D large screen interaction control system and method based on a multi-category mode, and the system comprises a scene analysis module which is used for analyzing the scene content at different moments in a naked eye 3D large screen in real time, and determining the priority of multi-category interaction modes at different moments based on the scene content; the interaction signal receiving module is used for determining target category interaction modes selected by different users based on priorities and receiving interaction signals input based on the target category interaction modes; and the interaction control module is used for determining a user identity and an interaction action based on the interaction signal, generating an interaction instruction corresponding to each user based on the user identity and the interaction action, and controlling the naked eye 3D large screen to execute an interaction operation based on the interaction instruction. The accuracy and reliability of interaction control of the naked-eye 3D large screen are ensured, the requirements of the naked-eye 3D large screen in different application scenes are met, and the use experience of a user is greatly improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of device control technology, and in particular to a multi-category-based naked-eye 3D large-screen interactive control system and method. Background Art

[0002] At present, with the continuous development of technology, the application scenarios of naked-eye 3D large screens are becoming more and more extensive, such as commercial display, education and training, entertainment games, etc.

[0003] However, traditional naked-eye 3D large-screen interaction methods are often relatively simple, and may only rely on gesture recognition or simple touch control. They cannot simultaneously meet different interaction methods, and thus cannot meet the diverse interaction needs in complex scenarios. Moreover, in scenarios where multiple people participate in the interaction at the same time, a single interaction method may cause interaction conflicts or fail to accurately identify the intentions of each user. Moreover, different application scenarios may require different types of interaction methods to achieve the best user experience, which greatly reduces the effectiveness of naked-eye 3D large-screen interactive control.

[0004] Therefore, in order to overcome the above-mentioned defects, the present invention provides a naked-eye 3D large-screen interactive control system and method based on a multi-category approach. Summary of the Invention

[0005] The present invention provides a naked-eye 3D large-screen interactive control system and method based on a multi-category mode, which is used to prioritize the multi-category interactive modes according to the scene content, thereby facilitating the adoption of more matching interactive modes in different scene contents, ensuring the effect and accuracy of the naked-eye 3D large-screen interactive control. At the same time, it can receive corresponding interactive signals in real time according to the target category interactive mode selected by the user, and then determine the user identity and interactive action according to the interactive signal, thereby generating interactive instructions corresponding to each user, achieving the effect of interactive control of the naked-eye 3D large screen, ensuring the accuracy and reliability of the naked-eye 3D large-screen interactive control, and at the same time, meeting the needs of the naked-eye 3D large screen in different application scenarios, greatly improving the user experience.

[0006] The present invention provides a multi-category naked eye 3D large screen interactive control system, comprising:

[0007] The scene analysis module is used to analyze the scene content at different times in the naked-eye 3D large screen in real time, and determine the priority of multiple categories of interaction methods at different times based on the scene content;

[0008] An interaction signal receiving module, configured to determine target category interaction modes selected by different users based on priority, and to receive interaction signals input based on the target category interaction modes;

[0009] The interactive control module is used to determine the user identity and interactive action based on the interactive signal, generate interactive instructions corresponding to each user based on the user identity and interactive action, and control the naked-eye 3D large screen to perform interactive operations based on the interactive instructions.

[0010] Preferably, a multi-category naked-eye 3D large-screen interactive control system and a scene analysis module include:

[0011] An image content acquisition unit is used to access the main control center of the naked-eye 3D large screen, and determine the image sequence corresponding to the time sequence in the naked-eye 3D large screen based on the access result, and obtain the corresponding target display image at different times based on the correspondence between the time sequence and the image sequence;

[0012] A scene content determination unit, configured to:

[0013] Identify the target display image, determine the spatial structure of the target display image, and divide the target display image into layers based on the spatial structure;

[0014] Based on the layer division results, the layer elements in each layer are identified to obtain the main objects and corresponding morphological features in each layer, and the scene content at different times in the naked-eye 3D large screen is obtained based on the main objects and morphological features.

[0015] Preferably, a naked-eye 3D large-screen interactive control system is provided, wherein the multiple interaction modes include gesture interaction, voice interaction, tactile interaction and visual interaction.

[0016] Preferably, a multi-category naked-eye 3D large-screen interactive control system, a scene analysis module, includes:

[0017] Scene content analysis unit, used to:

[0018] Analyze the scene content, determine the main objectives of the scene content, and determine the visualization task of the main objectives on the naked-eye 3D large screen;

[0019] Determine the permissible multi-category interaction methods for scene content based on industry implementation standards and visualization presentation tasks;

[0020] A prioritization unit for:

[0021] Traverse the parameters of the naked-eye 3D large screen to determine the operating environment and device resource configuration of the scene content, and evaluate the feasibility of the scene content based on the operating environment and device resource configuration;

[0022] Based on the feasibility effect evaluation results, the allowable multi-category interaction modes are prioritized.

[0023] Preferably, a multi-category naked-eye 3D large-screen interactive control system, the priority determination unit includes:

[0024] The simulation operation subunit is used to:

[0025] A virtual operation scene is constructed in a computer based on the operation environment and device resource configuration of the naked-eye 3D large screen, and virtual interaction requests of multiple categories of allowable interaction modes are constructed in the virtual operation scene;

[0026] Respond to virtual interaction requests of different types of interaction methods based on the naked-eye 3D large screen, and monitor the response process in real time to obtain the simulated operation status of the scene content;

[0027] Feasibility Assessment Subunit, used to:

[0028] Determine the response smoothness of the scene content on the naked-eye 3D large screen based on the simulation running state, and use the response smoothness as the first evaluation parameter;

[0029] At the same time, based on the simulation running status, the display effect of the scene content under each type of interaction mode is determined, and based on the display effect, the adaptability of the scene content to each type of interaction mode is determined, and the adaptability is used as the second evaluation parameter;

[0030] Based on the interaction requirements, weights are assigned to the first evaluation parameter and the second evaluation parameter respectively, and based on the assignment results, the first evaluation parameter and the second evaluation parameter are comprehensively analyzed to obtain the feasibility effect evaluation results of each category of interaction mode.

[0031] Preferably, a multi-category naked-eye 3D large-screen interactive control system, an interactive signal receiving module, includes:

[0032] The interaction mode determination unit is used to:

[0033] Push the priorities of multiple interaction methods under different scenarios to users, activate the user's uplink communication rights based on the push results, and receive real-time feedback signals from different users on the multiple interaction methods based on the activation results;

[0034] Determine the interaction mode of target categories selected by different users based on feedback signals;

[0035] A signal receiving unit, used for:

[0036] Determine the corresponding linkage components on the naked-eye 3D large screen based on the target category interaction mode, and initialize the linkage components;

[0037] Based on the device initialization result, the linkage component is self-calibrated, and based on the device self-calibration result, the interaction signals of different users are linked to be detected and received in real time to obtain the interaction signal sequences of different users;

[0038] Signal filtering unit for:

[0039] Obtain a sample data set under each category of interaction mode, and parse the sample data set to determine the action features of the interactive actions under each category of interaction mode;

[0040] Determine the action parameters corresponding to each sample data based on the action characteristics, and record the action parameters corresponding to different sample data in sequence to obtain the parameter fluctuation range of the interactive action under each category of interaction mode;

[0041] Based on the action characteristics and parameter fluctuation range, a signal screening model for each type of interaction mode is constructed, and the signal screening models of multiple types of interaction modes are integrated to obtain the target signal screening model;

[0042] Deploy the target signal screening model on the naked-eye 3D large screen, and perform interference signal detection on the received interactive signal sequence based on the deployment results;

[0043] The interaction signal sequence is purified based on the interference signal detection result to obtain the final interaction signal.

[0044] Preferably, a multi-category naked-eye 3D large-screen interactive control system, an interactive control module, includes:

[0045] The interactive action determination unit is used to:

[0046] Preprocess the interaction signal and determine the action focus of the interaction signal based on the category interaction mode corresponding to the interaction signal;

[0047] Extract action features from the pre-processed interaction signal based on action focus points to obtain the action features contained in the interaction signal, and determine the association logic for the action features based on the category interaction mode;

[0048] Perform action association on action features based on association logic, and match the action association results with the predefined action set to obtain the interaction action corresponding to the interaction signal;

[0049] An identity determination unit, configured to:

[0050] Determine the user identity signal recognition dimension, and extract key identity signals from the interaction signal based on the user identity signal recognition dimension to obtain biometric features of different users, where the biometric features include face, fingerprint, and iris;

[0051] Match the extracted biometric features with the registered user identities to obtain user identities of different users;

[0052] The binding unit is used to associate and bind user identities of different users with corresponding interaction actions.

[0053] Preferably, a multi-category naked-eye 3D large-screen interactive control system, an interactive control module, includes:

[0054] Instruction generation unit, used to:

[0055] Identify interactive actions, determine control requirements for interactive actions, and split control requirements into nodes based on the business attributes of interactive components;

[0056] Obtaining a personalized execution action and execution object of each interactive component based on the node splitting, and performing a first logical combination on the instruction elements based on the personalized execution action and execution object to obtain a first interactive instruction of each interactive component;

[0057] Performing a second logical combination on the first interaction instruction based on the collaborative logic of the interaction component to obtain a second interaction instruction;

[0058] Interactive control unit for:

[0059] Based on the second interactive instruction, the naked-eye 3D large screen is controlled to perform interactive operations, and the interactive operations are dynamically monitored to generate an interactive control timing report.

[0060] The present invention provides a naked-eye 3D large-screen interactive control method based on a multi-category approach, comprising:

[0061] Step 1: Analyze the scene content at different times on the naked-eye 3D large screen in real time, and determine the priority of multiple types of interaction methods at different times based on the scene content;

[0062] Step 2: Determine the target category interaction mode selected by different users based on priority, and receive the interaction signal input based on the target category interaction mode;

[0063] Step 3: Determine the user identity and interaction action based on the interaction signal, generate interaction instructions corresponding to each user based on the user identity and interaction action, and control the naked-eye 3D large screen to perform interaction operations based on the interaction instructions.

[0064] Preferably, a multi-category naked-eye 3D large-screen interactive control method is provided, wherein in step 1, the scene contents at different moments in the naked-eye 3D large-screen are analyzed in real time, including:

[0065] Access the main control center of the naked-eye 3D large screen, and determine the image sequence corresponding to the time sequence in the naked-eye 3D large screen based on the access result, and obtain the corresponding target display image at different times based on the correspondence between the time sequence and the image sequence;

[0066] Identify the target display image, determine the spatial structure of the target display image, and divide the target display image into layers based on the spatial structure;

[0067] Based on the layer division results, the layer elements in each layer are identified to obtain the main objects and corresponding morphological features in each layer, and the scene content at different times in the naked-eye 3D large screen is obtained based on the main objects and morphological features.

[0068] Compared with the prior art, the present invention has the following beneficial effects:

[0069] By prioritizing multiple categories of interaction methods based on the scene content, it is convenient to adopt more suitable interaction methods in different scene contents, ensuring the effectiveness and accuracy of the interactive control of the naked-eye 3D large screen. At the same time, it can receive the corresponding interaction signal in real time according to the target category interaction method selected by the user, and then determine the user identity and interaction action based on the interaction signal, thereby generating the corresponding interaction instruction for each user, achieving the effect of interactive control of the naked-eye 3D large screen, ensuring the accuracy and reliability of the interactive control of the naked-eye 3D large screen, and at the same time, meeting the needs of the naked-eye 3D large screen in different application scenarios, greatly improving the user experience.

[0070] Other features and advantages of the present invention will be described in the following description, and in part will become apparent from the description, or will be understood by practicing the present invention. The purpose and other advantages of the present invention can be achieved and obtained through the structures specifically pointed out in this application document.

[0071] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0072] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:

[0073] Figure 1 This is a structural diagram of a multi-category naked-eye 3D large-screen interactive control system in an embodiment of the present invention;

[0074] Figure 2 This is a structural diagram of a scene analysis module in a multi-category naked-eye 3D large-screen interactive control system according to an embodiment of the present invention;

[0075] Figure 3 This is a flowchart of a naked-eye 3D large-screen interactive control method based on a multi-category approach in an embodiment of the present invention. DETAILED DESCRIPTION

[0076] The preferred embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention.

[0077] This embodiment provides a naked eye 3D large screen interactive control system based on multiple categories, such as Figure 1 Shown, including:

[0078] The scene analysis module is used to analyze the scene content at different times in the naked-eye 3D large screen in real time, and determine the priority of multiple categories of interaction methods at different times based on the scene content;

[0079] An interaction signal receiving module, configured to determine target category interaction modes selected by different users based on priority, and to receive interaction signals input based on the target category interaction modes;

[0080] The interactive control module is used to determine the user identity and interactive action based on the interactive signal, generate interactive instructions corresponding to each user based on the user identity and interactive action, and control the naked-eye 3D large screen to perform interactive operations based on the interactive instructions.

[0081] In this embodiment, scene content refers to the specific content played at different times on the naked-eye 3D large screen, such as advertising and game entertainment.

[0082] In this embodiment, the multiple interaction modes include gesture interaction, voice interaction, tactile interaction and visual interaction (eye tracking).

[0083] In this embodiment, the priority is determined by sorting the control effects of different types of interaction methods based on the scene content at different times in the naked-eye 3D large screen. For example, precise pointing interaction may be required in an educational scenario, while free gesture and action interaction may be more emphasized in an entertainment scenario. Therefore, the effects achieved by using different interaction methods for different scene contents are different.

[0084] In this embodiment, the target category interaction mode refers to the final interaction mode selected by the user according to the priority.

[0085] In this embodiment, the interaction signal refers to the user's interaction demand for input to the naked-eye 3D large screen through the target category interaction method, for example, it can be a gesture "sliding" or a voice signal.

[0086] The beneficial effect of the above technical solution is: by prioritizing multiple categories of interaction methods according to the scene content, it is convenient to adopt more matching interaction methods in different scene contents, ensuring the effect and accuracy of the interactive control of the naked-eye 3D large screen. At the same time, it can receive the corresponding interaction signal in real time according to the target category interaction method selected by the user, and then determine the user identity and interaction action according to the interaction signal, thereby generating the corresponding interaction instruction for each user, achieving the effect of interactive control of the naked-eye 3D large screen, ensuring the accuracy and reliability of the interactive control of the naked-eye 3D large screen, and at the same time, meeting the needs of the naked-eye 3D large screen in different application scenarios, greatly improving the user experience.

[0087] In one embodiment, a multi-category naked eye 3D large screen interactive control system is provided, such as Figure 2 As shown, the scene analysis module includes:

[0088] An image content acquisition unit is used to access the main control center of the naked-eye 3D large screen, and determine the image sequence corresponding to the time sequence in the naked-eye 3D large screen based on the access result, and obtain the corresponding target display image at different times based on the correspondence between the time sequence and the image sequence;

[0089] A scene content determination unit, configured to:

[0090] Identify the target display image, determine the spatial structure of the target display image, and divide the target display image into layers based on the spatial structure;

[0091] Based on the layer division results, the layer elements in each layer are identified to obtain the main objects and corresponding morphological features in each layer, and the scene content at different times in the naked-eye 3D large screen is obtained based on the main objects and morphological features.

[0092] In this embodiment, the image sequence refers to the image pictures that need to be played at different moments that are set in advance in the naked-eye 3D large screen, corresponding to the time sequence.

[0093] In this embodiment, the target display image refers to specific image information corresponding to each moment.

[0094] In this embodiment, the spatial structure refers to the positional relationship between the contents or objects contained in the target display image.

[0095] In this embodiment, layer division refers to distinguishing different objects included in the target display image, thereby determining the main object (the object to be displayed) included in the target display image.

[0096] In this embodiment, the morphological feature refers to the appearance, outline or structure of the main object.

[0097] The beneficial effects of the above technical solution are: ensuring the accuracy of determining the scene content at different times in the naked-eye 3D large screen, providing convenience and guarantee for determining the priority of multiple categories of interaction methods under different scene contents, and thus improving the reliability of the interactive control of the naked-eye 3D large screen.

[0098] In one embodiment, a naked-eye 3D large-screen interactive control system based on multiple categories of interaction methods is provided. The multiple categories of interaction methods include: gesture interaction, voice interaction, tactile interaction and visual interaction.

[0099] In one embodiment, a multi-category naked-eye 3D large-screen interactive control system is provided, wherein the scene analysis module includes:

[0100] Scene content analysis unit, used to:

[0101] Analyze the scene content, determine the main objectives of the scene content, and determine the visualization task of the main objectives on the naked-eye 3D large screen;

[0102] Determine the permissible multi-category interaction methods for scene content based on industry implementation standards and visualization presentation tasks;

[0103] A prioritization unit for:

[0104] Traverse the parameters of the naked-eye 3D large screen to determine the operating environment and device resource configuration of the scene content, and evaluate the feasibility of the scene content based on the operating environment and device resource configuration;

[0105] Based on the feasibility effect evaluation results, the allowable multi-category interaction modes are prioritized.

[0106] In this embodiment, the main target refers to the main object or subject recorded in the scene content, for example, the structure and appearance of a product.

[0107] In this embodiment, the visualization display task refers to the form of visualization of the main target on the naked-eye 3D large screen and the effect to be achieved. For example, when the main target is a game character, the visualization display task is to display the appearance, posture, and movements of the game character in detail.

[0108] In this embodiment, the industry implementation standard is known in advance and is used to characterize all interaction methods that can be used for content in different scenarios.

[0109] In this embodiment, the operating environment refers to the parameter configuration of the scene content when it is running on the naked-eye 3D large screen.

[0110] In this embodiment, the feasibility effect evaluation is used to evaluate the effect of visual display on the naked-eye 3D large screen under the current operating environment and equipment resource configuration within the scene, that is, to analyze the effect of visual display of scene content, including the smoothness of visual display of scene content.

[0111] The beneficial effects of the above technical solution are: by determining the main goals and visualization display tasks in the scene content, and combining industry standards to determine the multiple categories of interaction methods that are allowable for the given scene content, secondly, combining the operating environment and device resource configuration of the scene content in the naked-eye 3D large screen to evaluate the feasibility of the scene content, and finally achieving priority sorting of the multiple categories of interaction methods that are allowable based on the evaluation results, which provides convenience and guarantee for the interactive control of the naked-eye 3D large screen.

[0112] In one embodiment, a multi-category naked-eye 3D large-screen interactive control system is provided, wherein the priority determination unit includes:

[0113] The simulation operation subunit is used to:

[0114] A virtual operation scene is constructed in a computer based on the operation environment and device resource configuration of the naked-eye 3D large screen, and virtual interaction requests of multiple categories of allowable interaction modes are constructed in the virtual operation scene;

[0115] Respond to virtual interaction requests of different types of interaction methods based on the naked-eye 3D large screen, and monitor the response process in real time to obtain the simulated operation status of the scene content;

[0116] Feasibility Assessment Subunit, used to:

[0117] Determine the response smoothness of the scene content on the naked-eye 3D large screen based on the simulation running state, and use the response smoothness as the first evaluation parameter;

[0118] At the same time, based on the simulation running status, the display effect of the scene content under each type of interaction mode is determined, and based on the display effect, the adaptability of the scene content to each type of interaction mode is determined, and the adaptability is used as the second evaluation parameter;

[0119] Based on the interaction requirements, weights are assigned to the first evaluation parameter and the second evaluation parameter respectively, and based on the assignment results, the first evaluation parameter and the second evaluation parameter are comprehensively analyzed to obtain the feasibility effect evaluation results of each category of interaction mode.

[0120] In this embodiment, the virtual operation scene is a simulation scene constructed in a computer according to the operation environment and device resource configuration, and is used to test the interactive feasibility of different scene contents in the naked-eye 3D large screen.

[0121] In this embodiment, the virtual interaction request is a simulation request generated in a computer, and is used in conjunction with a virtual operation scenario to perform simulation detection.

[0122] In this embodiment, the first evaluation parameter refers to the response smoothness of the scene content in the naked-eye 3D large screen, that is, the smoothness of the scene content when the naked-eye 3D large screen changes according to the interaction request, including whether there is any lag.

[0123] In this embodiment, the adaptability is used to characterize the matching between the scene content and each category of interaction method. For example, in the game screen, the gesture interaction method is better than the voice interaction method, that is, the adaptability of the gesture interaction method to the scene content is higher than the adaptability of the voice interaction method to the scene content.

[0124] In this embodiment, the second evaluation parameter is used to characterize the adaptation of different types of interaction modes to the corresponding scene contents under different scene contents.

[0125] In this embodiment, the interaction requirements are known in advance, for example, the effect of the scene content display, etc.

[0126] The beneficial effect of the above technical solution is: ensuring the accuracy and reliability of the feasibility effect evaluation of each category of interaction method, thereby ensuring the accuracy of the priority sorting of the allowed multiple categories of interaction methods, and thus providing a guarantee for improving the naked-eye 3D large-screen interactive control effect.

[0127] In one embodiment, a multi-category naked-eye 3D large-screen interactive control system is provided, wherein the interactive signal receiving module includes:

[0128] The interaction mode determination unit is used to:

[0129] Push the priorities of multiple interaction methods under different scenarios to users, activate the user's uplink communication rights based on the push results, and receive real-time feedback signals from different users on the multiple interaction methods based on the activation results;

[0130] Determine the interaction mode of target categories selected by different users based on feedback signals;

[0131] A signal receiving unit, used for:

[0132] Determine the corresponding linkage components on the naked-eye 3D large screen based on the target category interaction mode, and initialize the linkage components;

[0133] Based on the device initialization result, the linkage component is self-calibrated, and based on the device self-calibration result, the interaction signals of different users are linked to be detected and received in real time to obtain the interaction signal sequences of different users;

[0134] Signal filtering unit for:

[0135] Obtain a sample data set under each category of interaction mode, and parse the sample data set to determine the action features of the interactive actions under each category of interaction mode;

[0136] Determine the action parameters corresponding to each sample data based on the action characteristics, and record the action parameters corresponding to different sample data in sequence to obtain the parameter fluctuation range of the interactive action under each category of interaction mode;

[0137] Based on the action characteristics and parameter fluctuation range, a signal screening model for each type of interaction mode is constructed, and the signal screening models of multiple types of interaction modes are integrated to obtain the target signal screening model;

[0138] Deploy the target signal screening model on the naked-eye 3D large screen, and perform interference signal detection on the received interactive signal sequence based on the deployment results;

[0139] The interaction signal sequence is purified based on the interference signal detection result to obtain the final interaction signal.

[0140] In this embodiment, the uplink communication permission refers to the permission of the user to send messages or request a communication channel to the naked-eye 3D large screen. If enabled, the user can send corresponding interactive information to the naked-eye 3D large screen.

[0141] In this embodiment, the feedback signal refers to the result of the user's autonomous selection of multiple types of interaction modes.

[0142] In this embodiment, the target category interaction mode refers to the interaction mode finally determined by the user, which is one of the known multi-category interaction modes.

[0143] In this embodiment, the linkage components correspond to the target category interaction mode. For example, when the interaction mode is gesture interaction, the linkage components include a camera and a motion capture device, etc. Different categories of interaction modes correspond to different linkage components.

[0144] In this embodiment, device initialization refers to the unified restoration of parameters of linkage components, thereby facilitating corresponding configuration adjustments based on interaction requirements.

[0145] In this embodiment, the device self-calibration refers to calibrating the working accuracy, operating conditions, environment, etc. of the linkage components.

[0146] In this embodiment, the interaction signal sequence refers to interaction signals corresponding to different moments obtained by collecting the user's interaction signals in real time.

[0147] In this embodiment, the sample data set refers to historical sample data corresponding to each type of interaction mode.

[0148] In this embodiment, the action feature refers to the characteristics of the interactive actions in each type of interaction mode, including the amplitude and type of the interactive action.

[0149] In this embodiment, the action parameter refers to the specific execution degree of the interactive action under each type of interaction mode. For example, when the interactive action is a gesture, it can be the sliding distance of the gesture.

[0150] In this embodiment, the signal screening model is a signal screening mechanism for each type of interaction mode constructed based on action characteristics and parameter fluctuation range, with the purpose of eliminating abnormal interaction signals under each type of interaction mode.

[0151] In this embodiment, the target signal screening model refers to an overall model obtained by integrating and summarizing signal screening models of multiple categories of interaction modes.

[0152] In this embodiment, interference signal detection refers to a non-interaction signal in an interaction signal. For example, when the interaction method is tactile interaction, the interaction signal generated by a brief touch is an interference signal.

[0153] In this embodiment, the purification process refers to removing the detected interference signal from the interactive signal sequence.

[0154] The beneficial effects of the above technical solution are: ensuring the accurate and effective reception of the user's interactive signals, thereby facilitating the corresponding interactive control of the naked-eye 3D large screen according to the user's interactive needs. At the same time, it can filter the received user's interactive signals and eliminate the interference signals therein, ensuring the accuracy and reliability of the final interactive signals, and also ensuring the effect of the interactive control of the naked-eye 3D large screen.

[0155] In one embodiment, a multi-category naked-eye 3D large-screen interactive control system is provided, wherein the interactive control module includes:

[0156] The interactive action determination unit is used to:

[0157] Preprocess the interaction signal and determine the action focus of the interaction signal based on the category interaction mode corresponding to the interaction signal;

[0158] Extract action features from the pre-processed interaction signal based on action focus points to obtain the action features contained in the interaction signal, and determine the association logic for the action features based on the category interaction mode;

[0159] Perform action association on action features based on association logic, and match the action association results with the predefined action set to obtain the interaction action corresponding to the interaction signal;

[0160] An identity determination unit, configured to:

[0161] Determine the user identity signal recognition dimension, and extract key identity signals from the interaction signal based on the user identity signal recognition dimension to obtain biometric features of different users, where the biometric features include face, fingerprint, and iris;

[0162] Match the extracted biometric features with the registered user identities to obtain user identities of different users;

[0163] The binding unit is used to associate and bind user identities of different users with corresponding interaction actions.

[0164] In this embodiment, preprocessing refers to sorting and cleaning the interaction signals.

[0165] In this embodiment, the action focus is determined according to the category of interaction mode. For example, when the interaction mode is gesture interaction, the action focus is the user's gesture action. When the interaction mode is voice interaction, the action focus is the specific voice input by the user.

[0166] In this embodiment, action feature extraction refers to extracting key information of the action related to the interaction in the interaction signal.

[0167] In this embodiment, the action feature refers to the result obtained by extracting the action feature of the interaction signal, that is, the behavior that can represent the user's specific interaction needs.

[0168] In this embodiment, the association logic refers to a standard or rule for associating action features, for example, sequentially associating the actions of the user's gestures at different times to obtain the user's specific gesture action.

[0169] In this embodiment, the predefined action set is set in advance.

[0170] In this embodiment, the user identity signal recognition dimension refers to determining the identity information through dimensions such as the user's face, fingerprint, and iris.

[0171] The beneficial effects of the above technical solution are: by processing the interactive signal, the action features in the interactive signal can be effectively extracted, and the extracted action features are associated and then matched with the predefined action set, so as to accurately and effectively determine the interactive action corresponding to the interactive signal. At the same time, the user's identity information is determined through the interactive signal, and the determined interactive action is bound to the user's identity information, so as to facilitate the distinction between interactive requests of different users and improve the interactive control effect of the naked-eye 3D large screen.

[0172] In one embodiment, a multi-category naked-eye 3D large-screen interactive control system is provided, wherein the interactive control module includes:

[0173] Instruction generation unit, used to:

[0174] Identify interactive actions, determine control requirements for interactive actions, and split control requirements into nodes based on the business attributes of interactive components;

[0175] Obtaining a personalized execution action and execution object of each interactive component based on the node splitting, and performing a first logical combination on the instruction elements based on the personalized execution action and execution object to obtain a first interactive instruction of each interactive component;

[0176] Performing a second logical combination on the first interaction instruction based on the collaborative logic of the interaction component to obtain a second interaction instruction;

[0177] Interactive control unit for:

[0178] Based on the second interactive instruction, the naked-eye 3D large screen is controlled to perform interactive operations, and the interactive operations are dynamically monitored to generate an interactive control timing report.

[0179] In this embodiment, the control requirement is determined according to the interactive action, and may be, for example, the sensitivity or accuracy of the control.

[0180] In this embodiment, the service attribute refers to the interactive task that the interactive component can perform.

[0181] In this embodiment, node splitting refers to splitting the control requirements according to the business attributes of the interactive components, in order to obtain specific interactive control parameters corresponding to different interactive components, thereby ensuring that the interactive components quickly enter the interactive state.

[0182] In this embodiment, the personalized execution action value refers to the specific interaction behavior that each interaction component needs to execute.

[0183] In this embodiment, the execution object refers to the specific portrait element corresponding to each interactive component in the scene content, such as the legs, hands, and head of the game task.

[0184] In this embodiment, the instruction element refers to a set of instruction codes corresponding to the personalized execution action and the execution object.

[0185] In this embodiment, the first interaction instruction refers to an instruction for controlling each interaction component.

[0186] In this embodiment, the second interaction instruction refers to the result obtained by combining the first interaction instructions of each interaction component, and is used to coordinately control the interaction components.

[0187] In this embodiment, the interactive control timing report refers to the result obtained after real-time monitoring of the naked-eye 3D large-screen interactive control process, and is used to record the interactive conditions of the naked-eye 3D large-screen at different times.

[0188] The beneficial effects of the above technical solution are: ensuring the accuracy and reliability of interactive control of the naked-eye 3D large screen, while improving the user's interactive experience.

[0189] This embodiment provides a naked eye 3D large screen interactive control method based on multiple categories, such as Figure 3 Shown, including:

[0190] Step 1: Analyze the scene content at different times on the naked-eye 3D large screen in real time, and determine the priority of multiple types of interaction methods at different times based on the scene content;

[0191] Step 2: Determine the target category interaction mode selected by different users based on priority, and receive the interaction signal input based on the target category interaction mode;

[0192] Step 3: Determine the user identity and interaction action based on the interaction signal, generate interaction instructions corresponding to each user based on the user identity and interaction action, and control the naked-eye 3D large screen to perform interaction operations based on the interaction instructions.

[0193] The beneficial effect of the above technical solution is: by prioritizing multiple categories of interaction methods according to the scene content, it is convenient to adopt more matching interaction methods in different scene contents, ensuring the effect and accuracy of the interactive control of the naked-eye 3D large screen. At the same time, it can receive the corresponding interaction signal in real time according to the target category interaction method selected by the user, and then determine the user identity and interaction action according to the interaction signal, thereby generating the corresponding interaction instruction for each user, achieving the effect of interactive control of the naked-eye 3D large screen, ensuring the accuracy and reliability of the interactive control of the naked-eye 3D large screen, and at the same time, meeting the needs of the naked-eye 3D large screen in different application scenarios, greatly improving the user experience.

[0194] In one embodiment, a multi-category naked-eye 3D large-screen interactive control method is provided. In step 1, scene contents at different moments in the naked-eye 3D large-screen are analyzed in real time, including:

[0195] Access the main control center of the naked-eye 3D large screen, and determine the image sequence corresponding to the time sequence in the naked-eye 3D large screen based on the access result, and obtain the corresponding target display image at different times based on the correspondence between the time sequence and the image sequence;

[0196] Identify the target display image, determine the spatial structure of the target display image, and divide the target display image into layers based on the spatial structure;

[0197] Based on the layer division results, the layer elements in each layer are identified to obtain the main objects and corresponding morphological features in each layer, and the scene content at different times in the naked-eye 3D large screen is obtained based on the main objects and morphological features.

[0198] The beneficial effects of the above technical solution are: ensuring the accuracy of determining the scene content at different times in the naked-eye 3D large screen, providing convenience and guarantee for determining the priority of multiple categories of interaction methods under different scene contents, and thus improving the reliability of the interactive control of the naked-eye 3D large screen.

[0199] Obviously, those skilled in the art may make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if such changes and modifications fall within the scope of the claims and their equivalents, the present invention is intended to include such changes and modifications.

Claims

1. A multi-category naked eye 3D large screen interactive control system, characterized in that: include: The scene analysis module is used to analyze the scene content at different times in the naked-eye 3D large screen in real time, and determine the priority of multiple categories of interaction methods at different times based on the scene content; An interaction signal receiving module, configured to determine target category interaction modes selected by different users based on priority, and to receive interaction signals input based on the target category interaction modes; The interactive control module is used to determine the user identity and interactive action based on the interactive signal, generate interactive instructions corresponding to each user based on the user identity and interactive action, and control the naked-eye 3D large screen to perform interactive operations based on the interactive instructions.

2. The multi-category naked eye 3D large screen interactive control system according to claim 1, characterized in that: Scenario analysis module, including: An image content acquisition unit is used to access the main control center of the naked-eye 3D large screen, and determine the image sequence corresponding to the time sequence in the naked-eye 3D large screen based on the access result, and obtain the corresponding target display image at different times based on the correspondence between the time sequence and the image sequence; A scene content determination unit, configured to: Identify the target display image, determine the spatial structure of the target display image, and divide the target display image into layers based on the spatial structure; Based on the layer division results, the layer elements in each layer are identified to obtain the main objects and corresponding morphological features in each layer, and the scene content at different times in the naked-eye 3D large screen is obtained based on the main objects and morphological features.

3. The multi-category naked eye 3D large screen interactive control system according to claim 1, characterized in that: Multiple interaction methods include: gesture interaction, voice interaction, tactile interaction and visual interaction.

4. The multi-category naked eye 3D large screen interactive control system according to claim 1, characterized in that: Scenario analysis module, including: Scene content analysis unit, used to: Analyze the scene content, determine the main objectives of the scene content, and determine the visualization display tasks of the main objectives on the naked-eye 3D large screen; Determine the permissible multi-category interaction methods for scene content based on industry implementation standards and visualization presentation tasks; A prioritization unit for: Traverse the parameters of the naked-eye 3D large screen to determine the operating environment and device resource configuration of the scene content, and evaluate the feasibility of the scene content based on the operating environment and device resource configuration; Based on the feasibility effect evaluation results, the allowable multi-category interaction modes are prioritized.

5. The multi-category naked eye 3D large screen interactive control system according to claim 4, characterized in that: Prioritization unit, comprising: The simulation operation subunit is used to: A virtual operation scene is constructed in a computer based on the operation environment and device resource configuration of the naked-eye 3D large screen, and virtual interaction requests of multiple categories of allowable interaction modes are constructed in the virtual operation scene; Respond to virtual interaction requests of different types of interaction methods based on the naked-eye 3D large screen, and monitor the response process in real time to obtain the simulated operation status of the scene content; Feasibility Assessment Subunit, used to: Determine the response smoothness of the scene content on the naked-eye 3D large screen based on the simulation running state, and use the response smoothness as the first evaluation parameter; At the same time, based on the simulation running status, the display effect of the scene content under each type of interaction mode is determined, and based on the display effect, the adaptability of the scene content to each type of interaction mode is determined, and the adaptability is used as the second evaluation parameter; Based on the interaction requirements, weights are assigned to the first evaluation parameter and the second evaluation parameter respectively, and based on the assignment results, the first evaluation parameter and the second evaluation parameter are comprehensively analyzed to obtain the feasibility effect evaluation results of each category of interaction mode.

6. The multi-category naked eye 3D large screen interactive control system according to claim 1, characterized in that: The interactive signal receiving module includes: The interaction mode determination unit is used to: Push the priorities of multiple interaction methods under different scenarios to users, activate the user's uplink communication rights based on the push results, and receive real-time feedback signals from different users on the multiple interaction methods based on the activation results; Determine the interaction mode of target categories selected by different users based on feedback signals; A signal receiving unit, used for: Determine the corresponding linkage components on the naked-eye 3D large screen based on the target category interaction mode, and initialize the linkage components; Based on the device initialization result, the linkage component is self-calibrated, and based on the device self-calibration result, the interaction signals of different users are linked to be detected and received in real time to obtain the interaction signal sequences of different users; Signal filtering unit for: Obtain a sample data set under each category of interaction mode, and parse the sample data set to determine the action features of the interactive actions under each category of interaction mode; Determine the action parameters corresponding to each sample data based on the action characteristics, and record the action parameters corresponding to different sample data in sequence to obtain the parameter fluctuation range of the interactive action under each category of interaction mode; Based on the action characteristics and parameter fluctuation range, a signal screening model for each type of interaction mode is constructed, and the signal screening models of multiple types of interaction modes are integrated to obtain the target signal screening model; Deploy the target signal screening model on the naked-eye 3D large screen, and perform interference signal detection on the received interactive signal sequence based on the deployment results; The interaction signal sequence is purified based on the interference signal detection result to obtain the final interaction signal.

7. The multi-category naked eye 3D large screen interactive control system according to claim 1, characterized in that: Interaction control module, including: The interactive action determination unit is used to: Preprocess the interaction signal and determine the action focus of the interaction signal based on the category interaction mode corresponding to the interaction signal; Extract action features from the pre-processed interaction signal based on action focus points to obtain the action features contained in the interaction signal, and determine the association logic for the action features based on the category interaction mode; Perform action association on action features based on association logic, and match the action association results with the predefined action set to obtain the interaction action corresponding to the interaction signal; An identity determination unit, configured to: Determine the user identity signal recognition dimension, and extract key identity signals from the interaction signal based on the user identity signal recognition dimension to obtain biometric features of different users, where the biometric features include face, fingerprint, and iris; Match the extracted biometric features with the registered user identities to obtain user identities of different users; The binding unit is used to associate and bind user identities of different users with corresponding interaction actions.

8. The multi-category naked eye 3D large screen interactive control system according to claim 1, characterized in that: Interaction control module, including: Instruction generation unit, used to: Identify interactive actions, determine control requirements for interactive actions, and split control requirements into nodes based on the business attributes of interactive components; Obtaining a personalized execution action and execution object of each interactive component based on the node splitting, and performing a first logical combination on the instruction elements based on the personalized execution action and execution object to obtain a first interactive instruction of each interactive component; Performing a second logical combination on the first interaction instruction based on the collaborative logic of the interaction component to obtain a second interaction instruction; Interactive control unit for: Based on the second interactive instruction, the naked-eye 3D large screen is controlled to perform interactive operations, and the interactive operations are dynamically monitored to generate an interactive control timing report.

9. A multi-category naked eye 3D large screen interactive control method, characterized in that: include: Step 1: Analyze the scene content at different times on the naked-eye 3D large screen in real time, and determine the priority of multiple types of interaction methods at different times based on the scene content; Step 2: Determine the target category interaction mode selected by different users based on priority, and receive the interaction signal input based on the target category interaction mode; Step 3: Determine the user identity and interaction action based on the interaction signal, generate interaction instructions corresponding to each user based on the user identity and interaction action, and control the naked-eye 3D large screen to perform interaction operations based on the interaction instructions.

10. The multi-category naked eye 3D large screen interactive control method according to claim 9, characterized in that: In step 1, the scene content at different times on the naked-eye 3D large screen is analyzed in real time, including: Access the main control center of the naked-eye 3D large screen, and determine the image sequence corresponding to the time sequence in the naked-eye 3D large screen based on the access result, and obtain the corresponding target display image at different times based on the correspondence between the time sequence and the image sequence; Identify the target display image, determine the spatial structure of the target display image, and divide the target display image into layers based on the spatial structure; Based on the layer division results, the layer elements in each layer are identified to obtain the main objects and corresponding morphological features in each layer, and the scene content at different times in the naked-eye 3D large screen is obtained based on the main objects and morphological features.

Citation Information

Patent Citations

  • Viewing user tracking method and device, electronic equipment and storage medium

    CN114173109A

  • Naked eye 3D display device capable of recognizing dynamic gestures

    CN116009275A

  • Somatosensory interaction immersive experience compartment system

    CN118860155A

  • Virtual-real interaction method and system for naked-eye 3D large screen

    CN119052455A

  • Naked eye 3D interactive display processing method applied to giant spherical building

    CN119127023A