19 results about "3D interaction" patented technology

The invention belongs to the technical field of code-free development, and particularly relates to a Web3D zero-code interactive design platform and method based on a unified model, and the platform comprises a unified business logic model UBLM and a platform-independent, self-described and structured data container which is used for completely defining all behavior logics in 3D interactive application, including events, conditions, actions, parameters, variables and flow relations; the dual-mode editor comprises a form-type editor and a blueprint-type editor, and the form-type editor and the blueprint-type editor can be used for completely creating, editing and visualizing the same UBLM and realizing real-time state synchronization; and the interpreted rule execution engine IREE is a lightweight engine running in a JavaScript environment of a browser and is responsible for analyzing the UBLM during running and converting the declarative logic into an executable instruction in a 3D scene through a rule matching and function registration mechanism. According to the invention, the development and cooperation efficiency can be improved, and the iterative maintenance process is simplified.

The invention discloses a naked-eye 3D augmented reality interactive display system, and relates to the technical field of naked-eye 3D display and reality interaction. According to the invention, the multi-source depth data acquisition module acquires and fuses a user limb depth image, the parallax physical depth mapping module completes depth and parallax mapping and visual angle correction, the occlusion relation determination module divides regions to determine the occlusion type, and the adaptive mask layer generation module generates a dynamic smooth mask layer. The shielding effect fusion display module is used for overlapping and synthesizing the shielding layer and the multi-view virtual image and then displaying the overlapped and synthesized shielding layer and the multi-view virtual image; the problems that in naked eye 3D interaction, the occlusion relation between the limbs of the user and the virtual object is not accurate, and the vision is abrupt are effectively solved, the space consistency and the vision fluency of interaction are remarkably improved, and the real and natural naked eye 3D augmented reality interaction experience is achieved.

The invention discloses an energy flow interface 3D interaction method, and relates to the technical field of vehicle electronics, and the method comprises the steps: collecting a real-time operation message of each subsystem of a vehicle through a whole vehicle communication network, and analyzing the real-time operation message into an engineering value with a physical quantity line; determining the running state of the vehicle based on the engineering numerical value, and dynamically generating an energy flow direction topology table defining a source node and a target node; calculating a three-dimensional energy flux vector containing a direction vector and a modulus length scalar according to the node anchor point coordinates; calculating a target observation matrix of the virtual camera based on the three-dimensional energy flux vector, so that the sight line direction and the space direction of the vector meet a preset geometric projection relationship; and driving a graphic rendering pipeline, and generating an interactive interface comprising the three-dimensional part model and the dynamic particle flow according to the engineering numerical value and the target observation matrix. According to the method, self-adaptive adjustment of a visual angle is realized by constructing an energy flux vector, the optimal visibility of an energy transmission path is ensured, and real-time visualization of physical data driving is realized.

The invention relates to the technical field of man-machine interaction, and discloses a naked eye 3D interaction guiding method and system based on posture perception data, and the method comprises the steps: obtaining a continuous posture sequence of a user in a naked eye 3D display space; recognizing an action mode according to the motion vector and acceleration change of the key joint points in the continuous attitude sequence; generating a predicted interaction track according to the spatial orientation and the change trend of the action mode; comparing the predicted interaction track with a preset interaction area in real time, and taking the interaction area as a target interaction area when a main path section of the predicted interaction track is within a triggering range of the interaction area; calling interaction logic bound with the target interaction area in the naked eye 3D display space to determine a target interaction event; generating visual guidance information synchronized with the naked eye 3D display space according to the target interaction event; according to the invention, the accuracy of naked eye 3D interaction guidance can be improved.

The utility model provides a handheld XR head-mounted display control host with a 3D interaction function, and relates to the field of XR head-mounted displays. The handheld XR head display control host with the 3D interaction function comprises an upper shell, and a lower shell is connected to the back face of the upper shell in a clamped mode. According to the handheld XR head display control host with the 3D interaction function, the rocker and the gyroscope are arranged on the XR host, the rocker is used for controlling a first person visual angle or role translation, the gyroscope arranged in the AR glasses is used for controlling the steering of the visual angle along with the swing of the head of a wearer, and compared with an existing AR control host, the handheld XR head display control host with the 3D interaction function adopts keys, so that the operation is simple and convenient. According to the design, the main machine and the interaction modes (the button and the gyroscope) are configured together, the interaction response agility is improved, and the interaction delay is reduced. And meanwhile, stacking is made to be extreme and combined into one, so that the battery capacity is maximized under the condition that the overall size of the AR control interaction equipment is minimum.

The application discloses a naked-eye 3D immersive interaction method and system applied to a giant ball building, and relates to the technical field of naked-eye 3D interaction; the naked-eye 3D immersive interaction method and system are characterized in that the geometric parameters of the giant ball building and the display screen array distribution parameters are collected, a regular icosahedron is used to construct a spherical surface partition and a viewing area mapping, multi-source collaborative positioning is realized in combination with an ultra-wideband and an inertial measurement unit, and errors are compensated, a parallax adaptation image is generated based on the user position, the line of sight and the virtual object depth, motion prediction and pre-rendering are used to optimize the interaction response, the positioning accuracy and the delay evaluation are synchronously completed, the problems of inaccurate naked-eye 3D interaction positioning, poor parallax adaptation and high response delay in the giant ball building are effectively solved, and the positioning accuracy, the parallax adaptation accuracy, the interaction response speed and the user immersive experience are significantly improved.

The present invention discloses a method, system, terminal and storage medium for generating 3D results of hand-object interaction based on a large language model. The method includes: obtaining hand-object interaction data, and performing preprocessing and text annotation processing to obtain a target 3D interaction data set; determining a preset large language model, and training and fine-tuning the preset large language model according to the target 3D interaction data set to obtain an interaction 3D generation model; obtaining a user description text and inputting it into the interaction 3D generation model to output preliminary interaction 3D data; optimizing the hand parameters in the interaction 3D generation model according to the preliminary interaction 3D data to obtain optimized hand MANO parameters, and obtaining a target hand-object interaction 3D result according to the optimized hand MANO parameters. The present invention can quickly and accurately output the 3D result of hand-object interaction by constructing an interaction 3D generation model and optimizing the model through the user description text.

This application provides a map generation method and system based on multi-source heterogeneous geographic information processing. It acquires three types of heterogeneous data: a geographic element attribute database, a geographic coordinate semantic database, and a geographic reference image database. Spatial spectrum reconstruction processing is then performed to generate a spatial spectrum cube. Belief propagation fusion processing is then used to construct a belief network from the spatial spectrum data. Combined with spatially constrained probability field optimization and D-S evidence synthesis, a geographic evidence chain is generated. Next, spatiotemporal field reconstruction processing is performed to separate the static and dynamic states of the geographic evidence chain and couple them into fields, constructing a hyperdimensional spatiotemporal map. Finally, holographic projection conversion processing is used to perform phase field compression and coherent diffraction reconstruction on the hyperdimensional spatiotemporal map, generating a holographic geographic projection map that supports 3D interaction. This method achieves the automatic generation of a structurally unified, highly reliable geographic map that supports dynamic behavioral reasoning and true 3D interaction from multi-source heterogeneous geographic data, significantly improving the decision-making value and cognitive efficiency of geographic information.

The invention discloses a method for constructing a dynamic simulation system of an interactive virtual substation. The method comprises the following steps of: 1, digitalizing information; 2, constructing a three-dimensional model of the substation equipment, and designing a corresponding two-dimensional graphic model; 3, creating an interactive virtual element abstract model VSE and an interactive virtual environment VSS; 4, constructing interactive virtual equipment based on a VSE model, and establishing a transformer substation simulation model library; 5, combining a plurality of interactive virtual devices according to a logical relationship by using the VSS, and constructing a virtual substation operation environment; according to the method, a modular design concept is combined, a transformer substation system is decomposed into independent management units, and standardized virtual simulation elements are constructed to describe equipment attributes and dynamic behavior characteristics; an overall model is constructed based on the action relation between the devices, and a state change rule is comprehensively presented; and in combination with 2D and 3D interaction scenes, a high-responsiveness virtual operation system is developed, and multi-dimensional interaction with reality and immersion is realized.

The invention discloses a 3D scene interaction system and method based on combination of Vue3 and WebGL, and relates to the field of Web front ends and computer graphics. In order to overcome the problems of high difficulty in traditional 3D interaction development, response delay, poor equipment adaptability and the like, the invention constructs a system architecture comprising a response type component module, a WebGL rendering core, a multi-mode interaction unit and a state collaboration center. Wherein the responsive component module realizes bidirectional binding of an interface and a scene, the WebGL rendering core ensures efficient rendering, the multi-modal interaction unit supports cross-device operation, and the state collaboration center ensures data consistency. According to the scheme, the development threshold is remarkably reduced, the interaction response speed and the cross-device adaptation capability are improved, and the method can be widely applied to the fields of virtual display, online education, digital twinning and the like.

This invention discloses a naked-eye 3D augmented reality interactive display system, relating to the field of naked-eye 3D display and real-world interaction technology. The invention acquires and fuses user limb depth images through a multi-source depth data acquisition module, completes the mapping of depth and parallax and viewpoint correction through a parallax physical depth mapping module, divides regions to determine occlusion types through an occlusion relationship determination module, generates a dynamically smooth occlusion layer through an adaptive occlusion layer generation module, and displays the occlusion effect fusion display module by superimposing the occlusion layer with multi-viewpoint virtual images. This effectively solves the problems of inaccurate occlusion relationships between user limbs and virtual objects and visual abruptness in naked-eye 3D interaction, significantly improving the spatial consistency and visual smoothness of the interaction, and achieving a realistic and natural naked-eye 3D augmented reality interactive experience.

The invention discloses a naked-eye 3D interaction agricultural data visualization analysis platform, relates to the field of 3D interaction control, solves the problem of high cost of existing agricultural practical training, and comprises a data acquisition module for acquiring agricultural planting simulation information; the user practical operation module is used for controlling the planting character model through interaction equipment to obtain user simulation data, and obtaining the changed planting environment model to obtain a change result model; the simulation comparison module is used for acquiring a model operation record and a planting main body model according to a planting standard, and performing comparison in combination with user simulation data to obtain an operation completion degree; obtaining a completion standard model, and comparing with the change result model to obtain a result completion degree; the comprehensive analysis module is used for carrying out comprehensive analysis on user simulation according to the operation completion degree and the result completion degree and outputting an analysis result to a user; the agricultural training cost can be effectively reduced, and the agricultural data analysis efficiency is improved.

This application relates to the field of 3D reconstruction technology, providing a method and electronic device for optimizing face driving parameters. Applied to a remote 3D communication system, before remote 3D interaction, the gender and age identified in the initial face image of the target object are used as prior knowledge. Corresponding wrinkle information is loaded and added to the initial parameterized head model, increasing the detail description of facial wrinkles and improving the accuracy of face reconstruction. During remote 3D interaction, the wrinkle information is used to optimize the parameters used to drive the initial parameterized head model based on the target object's current facial expression. This ensures that each expression base of the target object contains descriptive features of wrinkles, further improving the driving accuracy of facial expressions by adding wrinkles, thereby better representing the detail accuracy of facial expression driving and enhancing the realism of facial expression expression.

The application belongs to the technical field of codeless development, and particularly relates to a Web3D zero-code interaction design platform and method based on a unified model, which comprises: a unified business logic model (UBLM), a platform-independent, self-describing and structured data container, which is used for completely defining all behavior logic in a 3D interaction application, including events, conditions, actions, parameters, variables and flow relationships; a dual-mode editor, which comprises a form editor and a blueprint editor, and can completely create, edit and visualize the same UBLM, and realize real-time state synchronization; and an interpretive rule execution engine (IREE), a lightweight engine running in a browser JavaScript environment, which is responsible for parsing the UBLM at runtime, and converting the declarative logic into executable instructions in a 3D scene through a rule matching and function registration mechanism. The application can improve development and collaboration efficiency, and simplify the iteration and maintenance process.

This invention discloses a naked-eye 3D immersive interaction method and system applied to giant spherical buildings, belonging to the field of naked-eye 3D interaction technology. This invention collects the geometric parameters of the giant spherical building and the distribution parameters of the display array, constructs a mapping between spherical partitions and viewing areas using icosahedral subdivision, and achieves multi-source collaborative positioning and error compensation by combining ultra-wideband and inertial measurement units. Based on the user's position, line of sight, and virtual object depth, it generates parallax-adapted images, optimizes the interaction response through motion prediction and pre-rendering, and simultaneously completes positioning accuracy and latency evaluation. This effectively solves the problems of inaccurate positioning, poor parallax adaptation, and high response latency in naked-eye 3D interaction within giant spherical buildings, significantly improving positioning accuracy, parallax adaptation precision, interaction response speed, and user immersive experience.

The application discloses an energy flow interface 3D interaction method, and relates to the technical field of vehicle electronics, and comprises the following steps: collecting real-time running messages of each vehicle subsystem through a vehicle communication network and analyzing the real-time running messages into engineering values with physical dimensions; determining a vehicle running state based on the engineering values, dynamically generating an energy flow topology table defining source nodes and target nodes; calculating three-dimensional energy flux vectors containing direction vectors and modulus scalars according to node anchor point coordinates; calculating a target observation matrix of a virtual camera based on the three-dimensional energy flux vectors, so that the sight direction and the spatial direction of the vector satisfy a preset geometric projection relationship; driving a graphics rendering pipeline to generate an interactive interface containing three-dimensional component models and dynamic particle flows according to the engineering values and the target observation matrix. The application realizes adaptive adjustment of the visual angle by constructing the energy flux vector, ensures the best visibility of the energy transmission path, and realizes real-time visualization driven by physical data.

This invention discloses a distributed real-time 3D spatial reconstruction system and method, capable of real-time acquisition and reconstruction of large-scale 3D scenes, emphasizing real-time performance and large scale, which is the main difference from traditional 3D reconstruction methods. It transmits encoded and compressed 3D data, including spatial location data and color image data, via real-time high frame rate streaming over a network. Traditional methods only transmit color data or only transmit spatial location data acquired in a single frame. Camera installation is flexible, allowing cameras to be installed in areas where data needs to be acquired, and the calibration method supports rapid deployment. Data acquired by discrete cameras is combined in real-time, undergoing time synchronization and 3D spatial stitching to form a large-scale, real-time changing 3D scene data, whereas traditional cameras acquire independent 2D images without spatial stitching. The 3D scene data supports real-time 3D interaction and display, allowing translation, rotation, and scaling according to user commands. Data processed and aligned in real-time in 3D space is still recorded, stored, and played back in 3D format.

The invention discloses a multi-mode interactive teaching system and method based on problem solving path driving, and the system comprises a problem solving path planning module which is used for generating a structured teaching path which comprises a teaching step, a presentation mode and a success standard; the teaching execution engine is used for analyzing the structured teaching path and scheduling other modules; the multi-dimensional interaction scene module is used for dynamically rendering a programmable 2D or 3D interaction environment according to the configuration information in the structured teaching path; the user interaction capturing module is used for capturing multi-channel input of a user and generating a procedural interaction log; the multi-modal evaluation engine is used for comparing the interaction log with the success standard and outputting a structured evaluation result; and the adaptive teaching intervention module is used for executing personalized teaching intervention according to the evaluation result.

1. The name of the design product: digital human holographic image cylinder. 2. The use of the design product: for creating realistic holographic images, realizing naked-eye 3D interaction and emotional companionship. 3. The design points of the design product: in shape. 4. The picture or photo that best indicates the design points: perspective view. 5. Other circumstances that need to be explained: the glass cover is at A in the perspective view, and the screen is at B.