2322 results about "Virtual image" patented technology

The invention discloses an ocean holographic environment comprehensive digital twinning system, and relates to the technical field of ocean monitoring, the digital twinning system comprises a data layer, a model layer, an application layer, an environment layer, a governance layer and a service layer, multi-scale spatio-temporal data is used as a substrate, and a virtual-real mapping and intelligent simulation technology is used to simulate the ocean holographic environment comprehensive digital twinning system. A full-dimension virtual mirror image covering the seabed, the middle sea and the sea surface is constructed, and the system serves core scenes such as a supervisor, scientific research cooperation and ocean engineering. According to the digital twin system, a six-layer layered architecture is adopted, edge computing and cloud computing collaboration are combined, a data-model-service-governance-environment multi-dimensional collaboration system is formed, data-driven decision making and dynamic optimization are achieved, and the marine monitoring efficiency and accuracy are improved.

Systems and methods of converting visual content for display on a virtual display system include extracting depth information from input visual content and formatting the input visual content and the depth information. The virtual display system may produce virtual images that are multifocal virtual images. The conversion of the input visual content into the multifocal virtual images may be impacted by properties of the human vision system, physical modeling of the input visual content, user input or sensory data, or generative content.

The invention relates to the technical field of physical education, in particular to a physical education method and system based on multimedia and holographic AR fusion, and the method comprises the following steps: collecting the motion data of a trainee based on a multi-source sensor array, constructing a motion parameterized model, and generating a holographic projection generation module through the cooperation with a standard motion database; a holographic AR teaching image is generated in real time, an environment perception module is combined to carry out adaptive projection on illumination and spatial layout, a spatial positioning module is used to establish coordinate mapping between a trainee and a virtual image, and a multi-channel feedback device is started to output visual, tactile and auditory signals. And finally, comparing the action parameters with the standard action data to automatically generate a training report containing wrong action labels and correction suggestions. According to the method, the motion capture precision and the interactive immersion can be effectively improved, and efficient and extensible technical support is provided for modern physical education and training.

The invention discloses a tunnel fracture recognition method based on three-dimensional live-action reconstruction and ordered re-acquisition of a virtual camera. The method specifically comprises the following steps: acquiring a multi-view rock fracture image; acquiring three-dimensional point cloud data of a tunnel wall surface according to the acquired rock mass fracture image, reconstructing a geometrical shape of the tunnel, mapping acquired texture information to a three-dimensional grid vertex through an image processing algorithm, and generating a three-dimensional tunnel model; setting parameters of the virtual camera, orderly collecting to form a virtual image, and enabling the position of the virtual camera to correspond to the real position of the model; and extracting information of the crack of the virtual image, and projecting the coordinates of the two-dimensional image back to the three-dimensional space through the projection matrix to obtain the space coordinates of the crack. A virtual image is generated by combining a texture mapping technology of a three-dimensional model, so that the limitation of a visual angle, illumination and space in actual image acquisition is overcome, and high-precision identification of tunnel cracks is realized.

The invention provides an interactive automatic explanation method for converting a traditional video into an artificial intelligence digital human, and relates to the technical field of artificial intelligence, and the method comprises the steps: obtaining original video data and an audio track, and carrying out the semantic analysis of the audio track, and obtaining multi-mode deconstruction data; generating an explanation script for each time period of the video based on the explanation text, and performing timestamp labeling on the visual elements to form a time sequence synchronization data structure; in the playing process, a virtual image generator is driven to synthesize digital human dynamic expression output in real time according to the current playing time point; after a user interruption request is received, semantic matching is carried out on a query intention in the explanation script, a target explanation fragment and visual elements are positioned, and complementary explanation content is generated; and driving the virtual image generator to synthesize dynamic output synchronized with the supplementary explanation, and after interaction is completed, recovering playing or skipping to a specified time point according to a user instruction. According to the invention, the conversion from the traditional video to the interactive intelligent explanation video is realized, and the watching experience and learning efficiency of the user are improved.

The invention provides a virtual imaging method and system applied to virtual shooting, computing equipment and a storage medium, and relates to the technical field of virtual imaging. The method comprises the following steps: synchronously acquiring object surface reflection characteristic data by using a multi-wavelength light source, and generating various imaging parameters through an image feature extraction network; the dynamic attitude data and binocular vision depth information are fused, and virtual and real scene dynamic space coordinate mapping is constructed; calculating the surface reflection intensity distribution of the virtual object in real time through a light propagation simulation module in combination with the specular reflectance and deformation correction parameters, and dynamically adjusting the relative position of the virtual object and the real light source; generating a continuous and smooth shadow boundary transition effect based on a material attenuation model; and performing space-time calibration on the shadow effect by using the dynamic attitude sequence to realize frame-level synchronous rendering of virtual and real light source positions and shadow changes. According to the technical scheme provided by the invention, through optical parameter modeling and dynamic path optimization, the problem of light and shadow distortion of the virtual object in a real scene is solved.

The invention discloses a double-domain artifact correction method based on multi-energy-level data and physical prior fusion, and the method achieves the efficient and precise removal of dispersive metal artifacts through the construction of a complete technical scheme of the combination of multi-energy-level data collection, double-domain cooperative correction and physical model constraint. The system has the beneficial effects that the system covers multiple fields of medical treatment, industry, security and protection, aerospace and the like, and has extremely high universality and adaptability. On the basis of a multi-energy-level slow switching scanning protocol, full-angle scanning of at least two energy levels is completed by dynamically adjusting radiation source parameters, and obtained complete multi-energy-level projection data is converted into a high-dimensional tensor through a channel dimension splicing image fusion method. The constructed multi-channel virtual image completely retains attenuation characteristics and structure information of a target object under each energy, provides a more comprehensive input source with discrimination for a deep learning network, builds a data basis for accurate correction in different fields fundamentally, and adapts to various imaging scenes containing metal targets.

The invention relates to the technical field of vehicle vision calibration, and discloses a DMS camera calibration method based on computer vision. The method comprises the following steps: acquiring a multi-view original image sequence in a target vehicle cockpit, and synchronously acquiring a camera mounting position, a view angle, an inclination angle and an environment illumination intensity parameter; after distortion correction is carried out on the original image sequence, edge features of a calibration reference object in each frame of image are extracted through image recognition, and an initial calibration matrix containing a mapping relation between pixel coordinates and physical coordinates is generated; constructing a three-dimensional space projection model based on the initial calibration matrix, and adjusting rotation and translation parameters of the model by using an iterative optimization algorithm to enable the error between a virtual imaging position and an actual edge feature to be minimum; and extracting an internal parameter matrix and an external parameter matrix of the optimized model, fusing the internal parameter matrix and the external parameter matrix into a final calibration parameter, and writing the final calibration parameter into a DMS camera firmware storage area. According to the method, the DMS camera calibration accuracy and environmental adaptability are improved, and stable technical support is provided for driver state monitoring.

The invention provides a method and a system for generating deviation guide information in an approaching landing section of an aircraft and a readable storage medium, and the method comprises the steps: S1, real image collection and processing: capturing an outboard environment image through an airborne visual sensor, and extracting key feature points of a target landing airport runway; s2, virtual image generation: based on the airport three-dimensional high-precision map, generating an approach glide image under a visual angle of a virtual camera; s3, image feature registration: carrying out spatial alignment on the key feature points of the runway in the real image and the key feature points of the runway in the virtual image; the pixel deviation of the runway center point in the real image and the virtual image is calculated, glide guidance is provided for a pilot or is directly input into an automatic flight system.The method can be used for the aircraft in the approaching landing section, the enhanced outboard visual display is provided for the pilot in the cockpit based on the equivalent ILS deviation guidance method, and the visual guidance effect is improved. And providing approaching glide deviation guide information.

The invention discloses a video generation method, belongs to the technical field of artificial intelligence, particularly relates to the technical fields of computer vision, deep learning, large models and the like, and can be applied to scenes such as digital humans and the like. The method comprises the following steps: extracting a target audio feature of a target audio and a virtual image feature of a virtual image in a reference image; based on an attention mechanism, processing the target audio feature and the initial video feature to obtain a target video feature, the initial video feature being formed by splicing a virtual image feature and random noise; and decoding the target video feature to obtain a target video, the target video comprising a video frame of the virtual image expressed based on the target audio speech. The invention further provides a video generation device, an intelligent agent, electronic equipment and a storage medium.

The invention provides a video generation method and device, electronic equipment, a storage medium and a program product, relates to the technical field of artificial intelligence, in particular to the technical fields of computer vision, deep learning, large models and the like, and can be applied to scenes of digital human, content generation based on artificial intelligence and the like. The method comprises the following steps: acquiring text features of a description text, image features of a virtual image in a reference image and audio features of audio, wherein the description text indicates action description information for driving the virtual image based on the audio; the role feature is bound with the audio feature to obtain a target audio feature, the role feature is associated with a corresponding virtual image in the reference image, and the role feature is used for indicating an association relationship between the target audio feature and the image feature; and generating a target video based on the text feature, the image feature and the target audio feature, wherein the target video comprises a plurality of video frames for making a sound according to the action description information based on the audio driving virtual image.

A low-illuminance image enhancement method based on virtual exposure and dual fusion, which relates to the technical field of image processing. The method comprises the following steps: step 1, receiving an original image; step 2, performing different levels of exposure on the original image to acquire a plurality of virtual images, and generating a virtual-image sequence; step 3, calculating a weight map for each virtual image in the virtual-image sequence, and obtaining a brightness-enhanced image after fusion; and step 4, extracting detail information from the brightness-enhanced image and fusing same with details of the original image, so as to obtain an enhanced image. The method has a relatively small brightness distortion and contrast distortion, and can effectively preserve visual information of an image itself, making it more compatible with the visual enjoyment of human eyes.

The invention provides an intelligent agent generation method, a learning machine and electronic equipment. The generation method comprises the following steps: acquiring user input data and learning behavior data; processing the user input data to obtain a first feature vector, and processing the learning behavior data to obtain a second feature vector; fusing the first feature vector and the second feature vector to obtain a fused feature vector; inputting the fusion feature vector into a generator of a generative adversarial network to obtain a virtual image; and endowing the virtual image with an interaction behavior by adopting a machine learning algorithm according to the user input data and the learning behavior data to obtain an intelligent agent. According to the method, the fusion feature vector is obtained based on the input data and the learning behavior data, the virtual image is generated through the adversarial network generator, the virtual image meeting the emotional requirements of children can be generated in combination with the interests and characters of the children, and the interactive behaviors are generated based on the user input data and the learning behavior data, so that the actual requirements of the children can be better met.

The disclosure relates to augmented reality devices based on a curved waveguide. An augmented reality device is provided. The augmented reality device includes a projection system to project an undistorted image, an input optical compensator located on the path of light rays out-coupled from the projection system, a curved waveguide comprising an input diffractive optical element and an output diffractive optical element. The output diffractive optical element performs the function of an output optical compensator that converts the light beams of a distorted image at the output of the waveguide into parallel light beams to output an undistorted image. Augmented reality glasses comprising an augmented reality device are also proposed. There is provided the ability to project a virtual image without aberrations, distortions and doubling of the image.

The invention provides a real-time operation remote video consultation system and method based on virtual reality, and the system comprises a driving data collection module which collects multi-modal data; the data processing module is used for carrying out fusion processing on data from different acquisition sources; the virtual image driving module is used for reconstructing a virtual scene of an operation site and performing three-dimensional modeling and rendering on an image acquired by the high-definition camera and an internal structure image acquired by the medical imaging equipment; the template matching module is used for collecting and sorting standard action templates of common surgical operations and matching the standard action templates; the data collaboration module is fused with the virtual scene to display the medical data of the patient; and the 5G robot assistance module remotely controls the robot to execute an action corresponding to the virtual reality scene through 5G. According to the invention, audio and scene fusion is realized, scene fidelity is improved, and consultation immersion is enhanced. Interaction between experts and virtual scenes in consultation can be achieved, consultation efficiency and sense of participation are improved, doctors are assisted in standard operation, and surgical risks are reduced.

The invention relates to a head-up display. The head-up display comprises an image source and an image adjusting device. The image adjusting device comprises a first reflecting mirror and a second reflecting mirror, and the first reflecting mirror is arranged in a turnover mode around the axis of the first reflecting mirror so that the first reflecting mirror can have a first posture and a second posture. The second reflecting mirror is arranged in a translation manner relative to the image source, so that the second reflecting mirror has a first position and a second position; the first reflecting mirror in the first posture and the second reflecting mirror in the first position are used for reflecting image light to a projection medium so as to form a first virtual image of a first imaging distance; the first reflecting mirror in the second posture and the second reflecting mirror in the second position are used for reflecting the image light to the projection medium so as to form a second virtual image of a second imaging distance; wherein the first virtual image and the second virtual image coincide in the direction perpendicular to the imaging distance. According to the head-up display, the imaging distance of the virtual image can be adjusted, and the position of the virtual image in the direction perpendicular to the imaging distance is not affected.

The invention relates to the field of image data processing, in particular to an AR (Augmented Reality) steady display regulation and control method and system based on image fusion and an AR fire-fighting helmet, and aims to determine light field distortion of a real scene image according to space variation data in a real scene image acquisition period so as to delimit a fusion matching sub-region and a fusion conflict sub-region of the real scene image; the operation range of fusion and superposition of the virtual image is narrowed; selecting a fusion matching sub-region according to the information distribution characteristics of the virtual image, and adjusting the superposition state of the virtual image in the selected fusion matching sub-region according to the picture characteristics of the selected fusion matching sub-region; and performing visual stabilization adjustment on at least one of the fusion conflict sub-region and the superposed virtual image according to a picture attribute difference between the fusion conflict sub-region and the superposed virtual image. According to the invention, the virtual image can be ensured to be accurately and stably fused to the real environment image without parallax according to the light field distortion generated by real environment image acquisition.

The invention provides a vortex electromagnetic wave radar multipath virtual image suppression method and system, and relates to the technical field of radar imaging virtual image suppression, and the method comprises the steps: adjusting the circular ring radiuses corresponding to different modes in a uniform concentric circular ring array according to the prior information of a target pitch angle, and obtaining the radar emission configuration of main lobe alignment; performing time domain sampling on the multi-path vortex radar echo signal in each mode to form a two-dimensional radar echo matrix; analyzing the obtained two-dimensional radar echo matrix and the MISO system echo after phase compensation by using an azimuth dimension point spread function to obtain dual-system imaging features; and performing modal domain FFT and time domain pulse compression processing on the multipath echo features under the MISO and MIMO systems by using fast Fourier transform and pulse compression, and finally outputting a virtual image suppressed synthetic radar image. The multi-path virtual image suppression method has the beneficial effects that the suppression of the multi-path virtual image is realized by utilizing the characteristic that the real image positions of the imaging results are completely the same and the virtual image positions are different under the multi-transmitting and single-receiving systems.

The invention discloses an augmented reality-based standard artificial temporomandibular joint installation navigation system, which comprises the following steps: S1, carrying out image registration on a preoperative CT image of a patient and a target operative site to obtain a registration result, and S2, updating the registration result in real time, and readjusting registration based on AR display equipment to obtain a registration result; virtual-actual transformation between the virtual image and the actual model is realized; s3, calibrating a surgical instrument, respectively aligning the surgical instrument with the TMJ surgical site and the virtual model, and tracking the position and posture of a patient entity in real time; and S4, navigating the artificial joint installation path in real time based on the updated position and posture of the patient entity.

The invention relates to a head-up display device, a head-up display system and a vehicle. In one aspect, the head-up display device includes: a first image generation unit configured to emit first image light; the second image generation unit is provided with a first transflective surface, the second image generation unit is configured to emit second image light rays through the first transflective surface of the second image generation unit, and the first image light rays emitted by the first image generation unit and propagated to the second image generation unit are reflected through the first transflective surface of the second image generation unit; and a first imaging amplification unit configured to reflect the second image light emitted by the second image generation unit and propagated to the first imaging amplification unit and the first image light reflected by the second image generation unit and propagated to the first imaging amplification unit. According to the method and the device, virtual images of different distances can be formed to realize fusion of the virtual images and corresponding real scenes, so that the driving safety and the driving experience are improved.

The invention belongs to the field of virtual image display, particularly relates to a spherical reflection cavity virtual calibration method based on a neural radiation field, and aims to solve the problems that micron-level deviation is difficult to accurately capture due to interference of a high-reflection surface, and an executable correction instruction cannot be generated by fusing process constraints. The method comprises the following steps: deploying image acquisition equipment around a cavity to synchronously capture a multi-view optical image sequence; inputting a neural radiation field model, reconstructing a three-dimensional geometric structure and optical properties through a volume rendering technology, and dynamically optimizing and fitting reflection characteristics and curvature changes of a carbon fiber material; extracting spherical radius, local curvature and boundary contour parameters, and comparing the parameters with design specifications point by point to generate a deviation distribution diagram; generating a multi-level calibration instruction set based on the deviation distribution diagram in combination with the laying layer tolerance and the assembly clearance; and outputting an instruction to the manufacturing system to execute physical adjustment, and re-collecting the image to verify the calibration effect until the acceptance index is met. According to the invention, the deviation capturing precision is improved, and a correction instruction can be generated.

The invention provides a smart home system, and the system comprises a user behavior data collection module which is used for collecting and processing the daily behavior data of a user, including a position, an activity track, and the frequency and time of using home equipment; the shadow intelligent modeling module is used for creating a digital twin model of the user based on the user behavior data, analyzing user habits through a machine learning algorithm and generating a prediction rule; the home control module is used for executing home operation in advance based on the shadow intelligence prediction result, and the home operation comprises light adjustment, temperature control, home appliance starting and stopping and curtain opening and closing; and the augmented reality interaction module is used for generating a virtual image of a user, displaying a home decision of the shadow intelligence through AR equipment or a terminal, and allowing the user to modify or optimize the home decision. The method has the following beneficial effects: intelligent prediction: the shadow intelligence can predict user behaviors in advance and execute corresponding operation at a proper time point; the air conditioner is turned on in advance, water is boiled and tea is made, and light is adjusted.

A display system and method for generating virtual images or light field images includes, in some embodiments, a display and a field-evolving cavity. The field-evolving cavity modulates the optical depth of the virtual image. In some embodiments, the components of the display system are curved. The focal plane of the virtual image is curved and may approximate a portion of a human horopter. In some embodiments, the display system is integrated into a part of a vehicle. Components of the display system may move relative to each other, such that the display system is collapsible or foldable when not in use.

The invention discloses an immersive three-dimensional simulation territorial space planning visual interaction system, and relates to the field of territorial space planning. Comprising a data acquisition and integration module, a three-dimensional modeling module, an immersive interaction module, a data analysis and decision support module, a multi-user cooperation module, a data updating and maintenance module, a security and authority management module, a system performance monitoring and optimization module, an intelligent recommendation module and a virtual image and social interaction module. Quantum remote sensing and low-altitude robot borrowing block chain guarantee data are fused, textures are generated by GAN based on meta universe and quantum calculation, a brain-computer interface and holographic projection immersive interaction are combined, quantum machine learning and causal diagram reasoning are fused, multi-person cooperation depends on a block chain platform, and data are updated by unmanned aerial vehicle swarms and edge calculation. And quantum encryption and zero-trust architecture security management are adopted. According to the method, data are accurately collected and integrated, a vivid three-dimensional model is constructed, immersive interactive experience is provided, scientific decision is assisted, multi-person cooperation is supported, and scientificity and efficiency of territorial space planning are comprehensively improved.

The invention discloses an airborne visible light image automatic splicing method, and relates to the field of unmanned aerial vehicle image processing, and the method comprises the steps: obtaining a plurality of images collected in the flight process of an unmanned aerial vehicle, and the corresponding spatial position information and attitude information; on the basis of the spatial position relation between the images and the image overlapping information, determining image pairs capable of being registered, and constructing a connection map with the images as nodes and the image pairs capable of being registered as edges; detecting whether spatial connection fracture caused by image missing exists in the atlas or not, if so, inserting a virtual node and constructing a virtual image comprising an edge region and a transition region; and further calculating geometric transformation parameters between the images, resampling all image contents to a unified coordinate system, and executing pixel-level fusion processing in an image overlapping region. According to the invention, the problem of discontinuous image splicing of the unmanned aerial vehicle due to the existence of a no-fly zone, a privacy protection zone and the like of the unmanned aerial vehicle is solved.

The invention relates to the technical field of numerical control, in particular to an engraving and milling machine machining track control method based on machine vision. Comprising the steps of receiving an operation task instruction, collecting a reflected light intensity matrix and processing thermal field data, and generating a source data packet; obtaining a fusion heat distribution matrix through the homography matrix; based on the friction thermal response coefficient, a physical tool nose contact area is judged, a dynamic feature mask is generated, the dynamic feature mask and the reflected light intensity matrix are operated, and a monitoring area is output; executing end coordinates are output through least square ellipse fitting, and sensor calibration parameters are inversely transformed into tool nose feedback coordinates; and reading interpolation instruction coordinates, calculating a differential vector, and driving a feed shaft motor to execute displacement compensation. According to the method, deep space-time coupling is performed on the physical cut-off characteristic of the infrared spectrum, the high-frequency texture characteristic of the visible light and the kinematics constraint of a numerical control system, so that a real tool nose hot spot and an optical virtual image are distinguished, and the uniqueness and authenticity of track identification are ensured.

The invention relates to a teaching interaction method and device based on a virtual digital human, equipment and a medium. According to the method, semantic segmentation and differential coding are performed on a student video stream according to a face, a gesture and a background region, code rate distribution of each region is dynamically adjusted in combination with an attention weight generated by eye movement tracking, and head steering and 3D parallax rendering of a virtual digital human are driven based on pupil coordinate mapping. Meanwhile, according to network state self-adaptive slice distribution, the technical effects of accurate perception of attention of multiple students in a teaching scene, synchronous response of virtual image actions and real intentions and on-demand optimization of network resources are achieved, and the authenticity of immersive interaction and the utilization rate of system resources are remarkably improved.

The invention discloses a vehicle-mounted head-up display system, a vehicle and a vehicle display driving method, and relates to the technical field of vehicle-mounted display.The vehicle-mounted head-up display system comprises a first display module and a second display module; the first display module is configured to project an image shot by the streaming media rearview mirror system out of a windshield in front of a driver to form virtual image display, and the second display module is configured to project head-up display content out of the windshield in front of the driver to form virtual image display. Therefore, the head-up display content and the image shot by the streaming media rearview mirror system form an integrated vision field, and a driver can simultaneously watch the front road, the head-up display content and the image of the streaming media rearview mirror system without shifting the sight line and the focal length, so that the driving safety is greatly improved; and a fused and coherent virtual image picture can be constructed, so that the driving experience is improved.

The invention relates to the technical field of smart home, and discloses a virtual environment image home control method and system under digital twinning, and the method comprises the steps: building a digital twinning body through the physical data of a home scene, and building a user 3D human body model based on the human body scattered wave data, so as to generate a virtual mirror image; creating a communication channel between the virtual mirror image and the home equipment so as to construct a control interface of the virtual mirror image to the home equipment; based on the current behavior intention, setting a personalized control instruction of the virtual mirror image to the home equipment; according to the time sequence image and the behavior tracking network, setting a real-time synchronization mechanism of the virtual mirror image and the home scene, and constructing data binding of the home device and the virtual mirror image; and in combination with the virtual mirror image, the control instruction, the scene synchronization mechanism and the data security interaction system, executing the control instruction of the home equipment. According to the invention, one-to-one correspondence between the pictures displayed by the digital twinning and the real scene can be realized, so that a user can accurately control the actual state of the supervised object.

A wearable terminal apparatus to be worn by a user for use includes at least one processor. The at least one processor causes a display unit to display a virtual image of a polyhedron located in a space. The at least one processor causes a first image having first information to be displayed on a first surface of the polyhedron and causes a second image having second information to be displayed on a second surface of the polyhedron.