2919 results about "Virtual image" patented technology

The invention discloses an ocean holographic environment comprehensive digital twinning system, and relates to the technical field of ocean monitoring, the digital twinning system comprises a data layer, a model layer, an application layer, an environment layer, a governance layer and a service layer, multi-scale spatio-temporal data is used as a substrate, and a virtual-real mapping and intelligent simulation technology is used to simulate the ocean holographic environment comprehensive digital twinning system. A full-dimension virtual mirror image covering the seabed, the middle sea and the sea surface is constructed, and the system serves core scenes such as a supervisor, scientific research cooperation and ocean engineering. According to the digital twin system, a six-layer layered architecture is adopted, edge computing and cloud computing collaboration are combined, a data-model-service-governance-environment multi-dimensional collaboration system is formed, data-driven decision making and dynamic optimization are achieved, and the marine monitoring efficiency and accuracy are improved.

A collaborative map building method is described in which if it is determined, for example, by a SLAM network edge, that a portion of a map corresponding to a target area of a first region is incomplete, a request to a device is transmitted to move toward the target area. The map is updated based on the scan performed by the device in the target area. Also described is a virtual image guide embodiment in which upon determining that a map of a target area of the first region is incomplete, a virtual guide image is generated on a device to appear at a target location. The user of the device is guided to the target area by the virtual image.

Systems and methods of converting visual content for display on a virtual display system include extracting depth information from input visual content and formatting the input visual content and the depth information. The virtual display system may produce virtual images that are multifocal virtual images. The conversion of the input visual content into the multifocal virtual images may be impacted by properties of the human vision system, physical modeling of the input visual content, user input or sensory data, or generative content.

A collaborative map building method is described in which if it is determined, for example, by a SLAM network edge, that a portion of a map corresponding to a target area of a first region is incomplete, a request to a device is transmitted to move toward the target area. The map is updated based on the scan performed by the device in the target area. Also described is a virtual image guide embodiment in which upon determining that a map of a target area of the first region is incomplete, a virtual guide image is generated on a device to appear at a target location. The user of the device is guided to the target area by the virtual image.

The invention provides a multi-person intelligent motion interaction and cooperation method and system based on meta universe, and relates to the technical field of meta universe, and the method comprises the steps: collecting the motion data of participants, and constructing a virtual image motion state model; carrying out cooperative operation to generate a cooperative degree index and adjusting the motion state parameters; virtual-real interaction parameters are calculated based on the Singhamiltonian system theory; acquiring a physiological signal to generate a motion ability threshold constraint motion state; and generating a motion evaluation report according to the collaboration degree index and the motion ability threshold to update the collaboration operation parameters. According to the invention, accurate collaboration and personalized regulation and control of multi-person movement interaction can be realized.

The invention relates to the technical field of physical education, in particular to a physical education method and system based on multimedia and holographic AR fusion, and the method comprises the following steps: collecting the motion data of a trainee based on a multi-source sensor array, constructing a motion parameterized model, and generating a holographic projection generation module through the cooperation with a standard motion database; a holographic AR teaching image is generated in real time, an environment perception module is combined to carry out adaptive projection on illumination and spatial layout, a spatial positioning module is used to establish coordinate mapping between a trainee and a virtual image, and a multi-channel feedback device is started to output visual, tactile and auditory signals. And finally, comparing the action parameters with the standard action data to automatically generate a training report containing wrong action labels and correction suggestions. According to the method, the motion capture precision and the interactive immersion can be effectively improved, and efficient and extensible technical support is provided for modern physical education and training.

The invention discloses a tunnel fracture recognition method based on three-dimensional live-action reconstruction and ordered re-acquisition of a virtual camera. The method specifically comprises the following steps: acquiring a multi-view rock fracture image; acquiring three-dimensional point cloud data of a tunnel wall surface according to the acquired rock mass fracture image, reconstructing a geometrical shape of the tunnel, mapping acquired texture information to a three-dimensional grid vertex through an image processing algorithm, and generating a three-dimensional tunnel model; setting parameters of the virtual camera, orderly collecting to form a virtual image, and enabling the position of the virtual camera to correspond to the real position of the model; and extracting information of the crack of the virtual image, and projecting the coordinates of the two-dimensional image back to the three-dimensional space through the projection matrix to obtain the space coordinates of the crack. A virtual image is generated by combining a texture mapping technology of a three-dimensional model, so that the limitation of a visual angle, illumination and space in actual image acquisition is overcome, and high-precision identification of tunnel cracks is realized.

The embodiment of the invention provides a content generation method and device, equipment and a storage medium. The method for content generation comprises the steps that in response to a content generation request of a first user for a first visual style, whether a first virtual image associated with the first user is triggered to be created or not is determined; sending a first session message for the first visual style to at least one second user based on the fact that the first virtual image is triggered to be created; and presenting a first session message on a session interface with the at least one second user, the presentation of the first session message being configured to be associated with generation of first content, the first content being generated based on the first visual style, the first virtuality, and a second virtuality associated with the at least one second user.

The invention provides a motion capture and feedback adjustment method and system for smart motion of meta universe, and relates to the technical field of meta universe, and the method comprises the steps: collecting actual motion data of a user through a plurality of inertial measurement units, establishing a mapping relation with skeleton nodes, evaluating and optimizing the motion based on a multi-dimensional scoring matrix, and constructing a user virtual image. And performing time sequence analysis on the virtual motion data to obtain local and global motion features, comparing the local and global motion features with standard motion features to generate an adjustment amount, and converting the adjustment amount into a motion correction instruction to guide a user to adjust a posture, so that accurate capture and real-time feedback can be realized, and a motion learning effect is improved.

The invention relates to a role face pinching method based on an AI model, and the method comprises the steps: obtaining a face base image and reference data, and analyzing the reference data to obtain role gender and role feature data; a face pinching reasoning module corresponding to the role gender is obtained, a virtual image code is generated based on the face pinching reasoning module and the role feature data, and the face pinching reasoning module comprises a combination rule of various face features; and redrawing the face substrate image according to the virtual image code to obtain a role face image, and rendering the role face image based on a differentiable rendering method. Through the face pinching method and device, the problem that the efficiency of a 2D role face pinching method is low is solved, the face pinching reasoning module dynamically calls rules to generate virtual image codes, logic judgment of hard codes is not needed, and the face pinching efficiency is improved.

The invention discloses an intelligent home decoration system and method based on mixed reality, and the system comprises a data collection module which comprises a space scanning module, a 3D model generation module and a space feature recognition module; the intelligent assistant module comprises an AI drive design suggestion module based on deep learning, an automatic layout optimization module, a personalized recommendation engine and a design rule check module; the multi-party cooperation module comprises a cross-device synchronization module, a real-time multi-user interaction module, a remote cooperation support module and a role authority management module; and the visual presentation module comprises a mixed reality rendering module, a real-time light and shadow simulation module, a material reality presentation module and a virtual image presentation module. According to the method, the design efficiency is greatly improved, the design period is shortened, design errors and rework are reduced, the project cost is reduced, the design quality is improved, the whole-course visualization and traceability of the design process are realized, and the working mode of traditional home decoration design is changed.

The utility model discloses an out-of-focus protection desktop far-vision read-write device which comprises a plane spectroscope, a first concave reflector and a second concave reflector. Wherein the light reflected by the table top and an object placed on the table top is emitted to the plane spectroscope from the lower part and then is split; a first light ray formed by reflection of the plane spectroscope is reflected by the first concave reflector, then penetrates through the plane spectroscope and is emitted to an exit pupil position; a second light ray formed after penetrating through the plane spectroscope is reflected by the second concave reflector, is reflected by the plane spectroscope again and then is emitted to an exit pupil position; one of the first light and the second light emitted to the exit pupil position is imaged at a virtual image position not less than 3 meters in front of the exit pupil position, and the other one is imaged at a real image behind the exit pupil position to form positive defocus. According to the out-of-focus protection desktop far-vision read-write device, the coaxial optical system is used, an object placed on a desktop is amplified, projected and imaged, positive out-of-focus stimulation is provided, and myopia prevention and control are achieved.

The invention provides an interactive automatic explanation method for converting a traditional video into an artificial intelligence digital human, and relates to the technical field of artificial intelligence, and the method comprises the steps: obtaining original video data and an audio track, and carrying out the semantic analysis of the audio track, and obtaining multi-mode deconstruction data; generating an explanation script for each time period of the video based on the explanation text, and performing timestamp labeling on the visual elements to form a time sequence synchronization data structure; in the playing process, a virtual image generator is driven to synthesize digital human dynamic expression output in real time according to the current playing time point; after a user interruption request is received, semantic matching is carried out on a query intention in the explanation script, a target explanation fragment and visual elements are positioned, and complementary explanation content is generated; and driving the virtual image generator to synthesize dynamic output synchronized with the supplementary explanation, and after interaction is completed, recovering playing or skipping to a specified time point according to a user instruction. According to the invention, the conversion from the traditional video to the interactive intelligent explanation video is realized, and the watching experience and learning efficiency of the user are improved.

The invention provides a virtual imaging method and system applied to virtual shooting, computing equipment and a storage medium, and relates to the technical field of virtual imaging. The method comprises the following steps: synchronously acquiring object surface reflection characteristic data by using a multi-wavelength light source, and generating various imaging parameters through an image feature extraction network; the dynamic attitude data and binocular vision depth information are fused, and virtual and real scene dynamic space coordinate mapping is constructed; calculating the surface reflection intensity distribution of the virtual object in real time through a light propagation simulation module in combination with the specular reflectance and deformation correction parameters, and dynamically adjusting the relative position of the virtual object and the real light source; generating a continuous and smooth shadow boundary transition effect based on a material attenuation model; and performing space-time calibration on the shadow effect by using the dynamic attitude sequence to realize frame-level synchronous rendering of virtual and real light source positions and shadow changes. According to the technical scheme provided by the invention, through optical parameter modeling and dynamic path optimization, the problem of light and shadow distortion of the virtual object in a real scene is solved.

An object of the present invention is to provide a head-up display apparatus further reduced in size, the head-up display apparatus having: an image display apparatus including a light source and a display element; and a virtual image optical system in which light emitted from the image display apparatus is reflected by a windshield or a combiner of the vehicle so that a virtual image is displayed in front of the vehicle, wherein the virtual image optical system has a concave mirror and a distortion correcting lens, and the distortion correcting lens is disposed between the image display apparatus and the concave mirror, the concave mirror is disposed in a housing including an outer case along a shape of an effective light path area of the image light from the image display apparatus, and the image display apparatus is attached to part of an outer periphery of the housing.

The invention discloses a double-domain artifact correction method based on multi-energy-level data and physical prior fusion, and the method achieves the efficient and precise removal of dispersive metal artifacts through the construction of a complete technical scheme of the combination of multi-energy-level data collection, double-domain cooperative correction and physical model constraint. The system has the beneficial effects that the system covers multiple fields of medical treatment, industry, security and protection, aerospace and the like, and has extremely high universality and adaptability. On the basis of a multi-energy-level slow switching scanning protocol, full-angle scanning of at least two energy levels is completed by dynamically adjusting radiation source parameters, and obtained complete multi-energy-level projection data is converted into a high-dimensional tensor through a channel dimension splicing image fusion method. The constructed multi-channel virtual image completely retains attenuation characteristics and structure information of a target object under each energy, provides a more comprehensive input source with discrimination for a deep learning network, builds a data basis for accurate correction in different fields fundamentally, and adapts to various imaging scenes containing metal targets.

The invention discloses a peripheral visual area defocused long-distance imaging optical system, and the system comprises a defocus panel which is located right above an observed object, and comprises a flat plate region and a micro-lens array region; the flat plate area is used for directly transmitting light emitted by an observed object; the micro-lens array area is used for carrying out first imaging on the peripheral area of an observed object to form a real image; the objective lens is positioned right above the defocus panel, and is used for performing first imaging on the observed object to form a virtual image of the observed object, receiving a real image of a peripheral area of the observed object, and performing second imaging to form a virtual image of the peripheral area of the observed object; the eyepiece is located right in front of the human eyes and used for conducting secondary imaging on the observed object, forming an amplified long-distance virtual image in front of the human eyes, receiving a virtual image of the peripheral area of the observed object and forming a real image in front of the peripheral retina in the human eyes. And the purpose of preventing and controlling myopia is better achieved.

The invention relates to the technical field of vehicle vision calibration, and discloses a DMS camera calibration method based on computer vision. The method comprises the following steps: acquiring a multi-view original image sequence in a target vehicle cockpit, and synchronously acquiring a camera mounting position, a view angle, an inclination angle and an environment illumination intensity parameter; after distortion correction is carried out on the original image sequence, edge features of a calibration reference object in each frame of image are extracted through image recognition, and an initial calibration matrix containing a mapping relation between pixel coordinates and physical coordinates is generated; constructing a three-dimensional space projection model based on the initial calibration matrix, and adjusting rotation and translation parameters of the model by using an iterative optimization algorithm to enable the error between a virtual imaging position and an actual edge feature to be minimum; and extracting an internal parameter matrix and an external parameter matrix of the optimized model, fusing the internal parameter matrix and the external parameter matrix into a final calibration parameter, and writing the final calibration parameter into a DMS camera firmware storage area. According to the method, the DMS camera calibration accuracy and environmental adaptability are improved, and stable technical support is provided for driver state monitoring.

The invention discloses a vehicle-mounted VR back-row entertainment method, and relates to the field of VR, and the method comprises the steps: processing image data transmitted by a controller through a DCT plate negative reflection plate lens, and generating aerial imaging data; reflecting a virtual image corresponding to the aerial imaging data by using a plane mirror to generate real image data; performing voice recognition processing on the input voice of the user to obtain voice control instruction data; acquiring image data of user gestures through an infrared sensor, and performing image recognition to obtain gesture control instruction data; generating interaction control data according to the three-dimensional coordinates in the real image data, the voice control instruction and the gesture control instruction; aiming at low image imaging precision in a vehicle-mounted VR entertainment system in the prior art, high-quality aerial imaging is generated by using a DCT plate negative reflection plate lens and a plane mirror, multi-modal interaction and the like are realized by adopting voice recognition and gesture recognition, and a vivid imaging effect is provided.

The invention provides a method and a system for generating deviation guide information in an approaching landing section of an aircraft and a readable storage medium, and the method comprises the steps: S1, real image collection and processing: capturing an outboard environment image through an airborne visual sensor, and extracting key feature points of a target landing airport runway; s2, virtual image generation: based on the airport three-dimensional high-precision map, generating an approach glide image under a visual angle of a virtual camera; s3, image feature registration: carrying out spatial alignment on the key feature points of the runway in the real image and the key feature points of the runway in the virtual image; the pixel deviation of the runway center point in the real image and the virtual image is calculated, glide guidance is provided for a pilot or is directly input into an automatic flight system.The method can be used for the aircraft in the approaching landing section, the enhanced outboard visual display is provided for the pilot in the cockpit based on the equivalent ILS deviation guidance method, and the visual guidance effect is improved. And providing approaching glide deviation guide information.

The invention belongs to the field of quality detection of mobile automobile windshields, and discloses a quality detection method of a head-up display windshield based on machine vision, which comprises the following steps: acquiring an original image of an original projection virtual image formed by a standard image projected by a head-up display system through the windshield, and carrying out graying processing on the original image to obtain a gray image; a corresponding grey-scale map is obtained; extracting an ROI (Region of Interest) area, namely a virtual image area, from the grey-scale map, performing dual-threshold processing on the image from which the virtual image area is extracted so as to segment a background area and the virtual image area, highlighting edge features of a virtual image in the background area and the virtual image area, and obtaining a thresholding image; and measuring each physical parameter of the thresholding image, comparing the difference between the measurement result and the corresponding parameter of the standard image, and if the difference is within a preset threshold range, determining that the imaging quality of the head-up display windshield is qualified, otherwise, determining that the imaging quality of the head-up display windshield is unqualified. The stability and efficiency of HUD imaging quality measurement of the windshield are improved, and meanwhile the cost of the whole detection system is greatly reduced.

The invention discloses a video generation method, belongs to the technical field of artificial intelligence, particularly relates to the technical fields of computer vision, deep learning, large models and the like, and can be applied to scenes such as digital humans and the like. The method comprises the following steps: extracting a target audio feature of a target audio and a virtual image feature of a virtual image in a reference image; based on an attention mechanism, processing the target audio feature and the initial video feature to obtain a target video feature, the initial video feature being formed by splicing a virtual image feature and random noise; and decoding the target video feature to obtain a target video, the target video comprising a video frame of the virtual image expressed based on the target audio speech. The invention further provides a video generation device, an intelligent agent, electronic equipment and a storage medium.

Provided is an image combiner including a waveguide, an input-coupling element, in an input-coupling area of the waveguide, configured to input light of a virtual image incident on the input-coupling area into the waveguide, and a folding / output-coupling element, in a folding / output-coupling area of the waveguide, configured to form an eye box by outputting the light input into the waveguide out of the waveguide, wherein the folding / output-coupling element is an anisotropic metasurface including a first sub-metasurface and a second sub-metasurface in a first sub-area and a second sub-area, and wherein the anisotropic metasurface is configured such that among rays input through different areas of the input-coupling area, a first ray having a first incidence angle is diffracted by the first sub-metasurface to be directed to the eye box and a second ray having a second incidence angle is diffracted by the second sub-metasurface to be directed to the eye box.

The invention provides a video generation method and device, electronic equipment, a storage medium and a program product, relates to the technical field of artificial intelligence, in particular to the technical fields of computer vision, deep learning, large models and the like, and can be applied to scenes of digital human, content generation based on artificial intelligence and the like. The method comprises the following steps: acquiring text features of a description text, image features of a virtual image in a reference image and audio features of audio, wherein the description text indicates action description information for driving the virtual image based on the audio; the role feature is bound with the audio feature to obtain a target audio feature, the role feature is associated with a corresponding virtual image in the reference image, and the role feature is used for indicating an association relationship between the target audio feature and the image feature; and generating a target video based on the text feature, the image feature and the target audio feature, wherein the target video comprises a plurality of video frames for making a sound according to the action description information based on the audio driving virtual image.

The side light-emitting device comprises a frame extending in the vertical direction and a light source module arranged on the inner side of the frame, the light source module emits light in the direction parallel to the extending direction of the frame, a light distribution piece is arranged in a light emitting path of the light source module, and the side light-emitting device is arranged on the side light-emitting device. The light rays are refracted by the light distribution piece and then are emitted in the direction away from the frame. The side light-emitting device can simulate the effect of illuminating the frame on one side of the window when sunlight enters from one side of the window, and can form a virtual image and simulate the window shadow effect in cooperation with the light-emitting surface of the lamp, so that the display effect of the lamp is more vivid, and the visual experience of a user is improved.

A low-illuminance image enhancement method based on virtual exposure and dual fusion, which relates to the technical field of image processing. The method comprises the following steps: step 1, receiving an original image; step 2, performing different levels of exposure on the original image to acquire a plurality of virtual images, and generating a virtual-image sequence; step 3, calculating a weight map for each virtual image in the virtual-image sequence, and obtaining a brightness-enhanced image after fusion; and step 4, extracting detail information from the brightness-enhanced image and fusing same with details of the original image, so as to obtain an enhanced image. The method has a relatively small brightness distortion and contrast distortion, and can effectively preserve visual information of an image itself, making it more compatible with the visual enjoyment of human eyes.

A head mounted display system can process images by assessing relative motion between the head mounted display and one or more features in a user's environment. The assessment of relative motion can include determining whether the head mounted display has moved, is moving and / or is expected to move with respect to one or more features in the environment. Additionally or alternatively, the assessment can include determining whether one or more features in the environment have moved, are moving and / or are expected to move relative to the head mounted display. The image processing can further include determining one or more virtual image content locations in the environment that correspond to a location where renderable virtual image content appears to a user when the location appears in the display and comparing the one or more virtual image content locations in the environment with a viewing zone.

A head-up display apparatus that includes an image forming unit that emits video light; an optical element provided in the image forming unit and that generates video light divided into a first video light and a second video light as the video light; a first returning mirror that reflects the first video light; a second returning mirror that reflects the second video light; and a video projector that reflects the first video light from the first returning mirror and the second video light from the second returning mirror, and a first display region which is a first display area capable of displaying a first virtual image is formed based on the first video light from the video projector, and a second display region which is a second display area capable of displaying a second virtual image is formed based on the second video light from the video projector.

The invention provides an intelligent agent generation method, a learning machine and electronic equipment. The generation method comprises the following steps: acquiring user input data and learning behavior data; processing the user input data to obtain a first feature vector, and processing the learning behavior data to obtain a second feature vector; fusing the first feature vector and the second feature vector to obtain a fused feature vector; inputting the fusion feature vector into a generator of a generative adversarial network to obtain a virtual image; and endowing the virtual image with an interaction behavior by adopting a machine learning algorithm according to the user input data and the learning behavior data to obtain an intelligent agent. According to the method, the fusion feature vector is obtained based on the input data and the learning behavior data, the virtual image is generated through the adversarial network generator, the virtual image meeting the emotional requirements of children can be generated in combination with the interests and characters of the children, and the interactive behaviors are generated based on the user input data and the learning behavior data, so that the actual requirements of the children can be better met.

The disclosure relates to augmented reality devices based on a curved waveguide. An augmented reality device is provided. The augmented reality device includes a projection system to project an undistorted image, an input optical compensator located on the path of light rays out-coupled from the projection system, a curved waveguide comprising an input diffractive optical element and an output diffractive optical element. The output diffractive optical element performs the function of an output optical compensator that converts the light beams of a distorted image at the output of the waveguide into parallel light beams to output an undistorted image. Augmented reality glasses comprising an augmented reality device are also proposed. There is provided the ability to project a virtual image without aberrations, distortions and doubling of the image.