391 results about "Virtual cinematography" patented technology

The present disclosure relates to a method and an apparatus of generating a surround view monitoring (SVM) image. The method includes: obtaining installation information of an actual camera installed on a ship; setting a virtual camera to orient toward a ground plane perpendicularly within a world coordinate system; calculating a conversion relationship between the virtual camera and the actual camera, based on the installation information of the actual camera; generating the SVM image based on the calculated conversion relationship; and controlling the ship based on the generated SVM image.

The invention relates to the field of video processing, in particular to a video data processing method and device, equipment and a medium. In a background replacement link, based on precise operation of video processing requirements, an adaptive algorithm can be selected according to scene characteristics, and errors are preliminarily reduced. And subsequently, error compensation is carried out on the generated intermediate video data, the error region is corrected in a targeted manner, the edge is filled and optimized by utilizing the edge pixel characteristics of the foreground region, and iteration processing is carried out until the error is lower than a preset value, so that the accuracy of background replacement is greatly improved. And finally, the target video data is injected into the virtual camera of the cloud mobile phone, the method is applied to a mobile terminal scene, the background and the foreground are naturally fused under high-precision scenes such as live broadcast and virtual conferences, the image flaws are remarkably reduced, the strict requirements of a user on the video image quality are met with a high-precision background replacement effect, and the overall user experience is improved.

The system obtains a first recording of a construction site captured at a first time, and a first virtual trajectory of a first virtual camera, and creates a first data structure representing the first recording. The system obtains a second recording of the construction site captured at a second time, and creates a second data structure representing the second recording. The system establishes a correspondence between the first and second data structures by creating a map between a second image in the second recording and a first image in the first recording by efficiently searching the first data structure for the first image similar to the second image. The system obtains a first location of the first virtual camera corresponding to the first image and, based on the map between the first and second image, determines a second location of a second virtual camera corresponding to the second image.

A splat generation system and associated methods generate a splat representation of a three-dimensional (3D) model with varying detail based on an unequal or non-uniform capture of the 3D model. The system receives the 3D model. The system analyzes variation in the position or visual characteristics of the 3D model primitives, attributes different levels-of-importance to different surfaces or regions of the 3D model based on the variation, and defines a non-uniform placement of virtual cameras around the 3D model according to the different levels-of-importance that are attributed to the different surfaces or regions of the 3D model. The system generates the splats for the splat representation that reconstruct the different surfaces or regions with differing amounts of detail that match the detail captured for the different surfaces or regions in images generated from the non-uniform placement of the virtual cameras.

Embodiments of the present application provide a method, an apparatus, a device, a medium, and a program for generating a cover image of a virtual object. The method includes receiving a generation instruction of a cover image of a virtual object; determining a position of a virtual camera for shooting the virtual object; shooting the virtual object according to the position of the virtual camera; and generating, according to an image of the virtual object shot by the virtual camera, a cover image corresponding to the virtual object. The cover image of the virtual object shot by this method is more complete and aesthetically pleasing.

An image generation apparatus includes one or more memories storing instructions; and one or more processors that, upon execution of the stored instructions, are configured to operate as a first acquisition unit configured to acquire 3D data and a defective area of the 3D data, a second acquisition unit configured to acquire a movable range of a virtual camera, and a generation unit configured to generate mask data based on the movable range of the virtual camera and the defective area such that the defective area is not visible in the movable range of the virtual camera.

This disclosure provides an AI filmmaking workflow including AI-assisted storyboarding, AI animation, and post-production processes for creating films. The workflow provides techniques for reconstructing 3D digital environments and characters, and for virtual camera control. The workflow also provides techniques for capturing 2D live-action performances and extracting visual cues. The AI animation process generates synthetic images and video using prompts that are based on virtual camera control in case of 3D digitization and / or visual cues in case of 2D camera capturing. Further, the workflow provides techniques for compositing with AI assistance, to generate a composited video based on the AI-animated video and inputs resulting from 3D digitization and / or 2D video processing. Advanced post-processing techniques are also provided for generating a complete film based on the composited video. This framework is designed to facilitate creative collaborative networks by using a hybrid digitization approach to enhance consistency, directability, and scalability in AI filmmaking.

The embodiment of the invention discloses a volume object rendering method and device, equipment and a storage medium, and relates to the technical field of image rendering. Comprises: obtaining a shape profile of a volume object, the volume object being a heterogeneous volume object, the shape profile being a volume texture comprising a narrow-band level set of density; performing density sampling on the shape section according to the observation direction of the virtual camera, and determining the transmissivity of the sampling points in the observation direction according to the density of the sampling points; performing shadow sampling on the sampling points in the shape section to obtain the radiance of the sampling points; according to the transmissivity and the radiance of each sampling point, determining the target radiance of the volume object in the observation direction; the volumetric object is rendered according to the target emissivity in each viewing direction. According to the scheme provided by the embodiment of the invention, the rendering efficiency and the rendering effect can be taken into account in the real-time rendering scene.

There is provided an information processing method to easily recognize a region focused by a shooting camera. The information processing method according to the present disclosure includes: placing a virtual camera in a virtual environment space obtained by modeling a target environment in which a mobile object equipped with a shooting camera is allowed to move, the virtual camera being associated with the shooting camera; determining a virtual focus region in the virtual environment space on the basis of an image corresponding to the field range of the virtual camera, the virtual focus region corresponding to a region focused by the shooting camera in the target environment; and displaying region-specific information on a display screen, the region-specific information specifying the virtual focus region.

In a virtual camera calibration method, a target object model of a physical camera device is obtained. The physical camera device includes a camera and a contact plane. The target object model with an operation controller is output for display through a head-mounted display device. The contact plane of the target object model and a contact plane of the operation controller are in an attached state. A camera position of the target object model corresponds to a camera position of the physical camera device. An indication that a camera of the target object model and the camera of the physical camera device are in an overlapping state is output for display. A virtual camera is calibrated based on spatial information of the operation controller and a spatial calibration operation for the virtual camera. The spatial information includes target position information and a target orientation.

The invention provides a rapid configuration method and system for PTZ parameters of inspection points in a substation inspection system, and the method comprises the steps: importing a virtual scene of a substation into the inspection system, and setting a virtual camera in the virtual scene; wherein the position of the virtual camera in the virtual scene is matched with the position of an inspection camera in the transformer substation; acquiring a reference space position preset by the inspection camera, and determining a virtual reference position corresponding to the reference space position and the position of the inspection point in the virtual scene; obtaining a first PTZ parameter when the virtual camera shoots the virtual reference position; generating a second PTZ parameter corresponding to the inspection point based on the position of the inspection point, the virtual reference position and the first PTZ parameter; and the patrol point and the second PTZ parameter are stored in an associated manner, and patrol configuration information of the patrol point is obtained. According to the mode, the configuration operation of the PTZ parameters is simplified, the configuration efficiency is improved, and the configuration requirements of large-scale inspection points can be met.

The invention provides a vehicle-mounted virtual reality synchronization system, which can solve the problem of motion sickness caused by mismatching of vehicle dynamic motion and visual perception in a vehicle-mounted environment of traditional VR. The system collects the acceleration, angular velocity and GPS position information of a vehicle through the sensor module, and the data analysis module maps the information to a virtual camera coordinate system in real time. The virtual camera motion control module ensures that the motion of the virtual camera is synchronized with the actual motion of the vehicle. And the dynamic scene response module adjusts the virtual scene according to the vehicle state to enhance the immersion. Finally, the virtual reality equipment provides a dynamic VR picture synchronous with the vehicle motion, the motion sickness symptom is reduced, and the user experience is improved. Furthermore, the system has the design of light weight and low power consumption, is suitable for various vehicles, and has a wide application prospect.

The subject matter described in this disclosure can be embodied in methods and systems for stabilizing video. A computing system determines a stabilized location of a facial feature in a frame of video accounting for its location in a previous frame. The computing system determines a physical camera pose in virtual space and maps the frame into virtual space. The computing system determines an optimized virtual camera pose using an optimization process that determines (1) a difference between the stabilized location of the facial feature and a location of the facial feature when viewed from a potential virtual camera pose, (2) a difference between the potential virtual camera pose and a previous virtual camera pose, and (3) a difference between the potential virtual camera pose and the physical camera pose. The computing system generates the stabilized view of the frame using the optimized virtual camera pose.

In a multiplayer video game, virtual cameras are controlled by continually assessing and ranking storylines relating to the interactions of various players during a game session. A ranking for each storyline may be based on various factors such as, but not limited to, what the players can see, the distance between certain players, nearby game items or in-game. Subsequently, at least one virtual camera is navigated to provide a view of the highest-ranking storyline, subject to certain limitations on how the camera can move, transition, or otherwise display the interactions between players. A set of rules including rules of cinematography, are used to provide additional control of the movement of the virtual camera. Movements of a human camera-person are used on a mocap system to control the movement of the virtual camera.

A method for extracting at least one image feature from at least one image generated by at least one real camera, present in a motor vehicle, for monitoring the environment of the motor vehicle. The method includes, in a first step a), the image generated by the camera is transformed into a transformed image by means of a virtual camera which is assigned to the real camera and the optical axis of which extends along a horizontal direction with respect to the motor vehicle, according to which, in a second step b), at least one image feature is extracted from the transformed image.

A computer-implemented method includes receiving at a first computing device a first machine-learned latent space model of a first scene located proximate a second computing device where the first scene includes a first face. The first machine-learned latent space model of the first scene is decoded to produce first generated imagery corresponding to the first scene from a first viewpoint defined by a first virtual camera. The first virtual camera is positioned in alignment with a display screen of the second computing device.

Systems and methods are described for generating an AR image are described herein. A physical camera is used to capture a video of a physical object in front of a physical background. The system then accesses data defining a virtual environment and selects a first position of a virtual camera in the virtual environment. While capturing the video, the system displays captured video of the physical object, such that the physical background is replaced with a view of the virtual environment from the first position of the virtual camera. In response to detecting a movement of the physical camera, the system selects a second position of the virtual camera in the virtual environment based on the detected movement. The system then displays the captured video of the physical object, wherein the view of the physical background is replaced with a view of the virtual environment from the second position of the virtual camera.

The invention discloses a video frame sharing output processing method and a related device, and relates to the technical field of software, and the method comprises the steps: obtaining an original video frame collected by a camera; the original video frame is converted into a first target video frame according to the format configuration of the stream pushing end, the original video frame is converted into a second target video frame according to the format configuration of the virtual camera, and the stream pushing end and the virtual camera are pre-created with respective shared memories; and writing the first target video frame into a shared memory of the stream pushing end, and writing the second target video frame into a shared memory of the virtual camera. According to the method, the architecture design of single-source processing and multi-target distribution can be realized, repeated calculation is avoided, in addition, cross-process access can be supported, and the effect of isolated storage of double shared memories is achieved.

The invention relates to the technical field of computer graphics, and provides a model data adaptation processing method for a graphics rendering engine, which comprises the following steps of: importing and analyzing model files from different geometric modeling engines, and extracting original geometric data, original topological data and auxiliary information in the model files; converting the original geometric data into a unified standard geometric data structure for representation and storage; converting the original topological data into a standard topological data structure based on a boundary representation method for representation and storage; creating, analyzing or setting spatial position and direction information of the model entity and the virtual camera in a world coordinate system; analyzing material attributes, surface textures and animation information in the affiliated information of the model file, and packaging the materials, the surface textures and the animation information into corresponding standard data structures; and combining the standardized geometric data, topological data, coordinate system information and affiliated information into a complete standardized model data packet which can be directly used by a graphic rendering engine.

The invention discloses a digital special effect simulation online preview platform, which comprises a segmentation module, a splicing module and a special effect simulation system, the special effect simulation system comprises a simulation module, a special effect integration module and a special effect generation module, and the segmentation module is used for collecting historical existing special effect videos, extracting special effect images from the collected special effect videos and generating the special effect images; determining a segmentation position and a segmentation shape of the special effect image according to the position of the special effect element in the special effect image, and segmenting the special effect image to form sub-images; calculating sub-image segmentation values according to the sub-images; building a special effect simulation system according to the formed special effect elements; the method comprises the following steps: setting a virtual camera, shooting special effect elements by using the virtual camera, evaluating the special effect elements shot by the virtual camera, adjusting parameters of a virtual special effect according to an evaluation result, and selecting a corresponding segmentation method according to a segmentation position and a segmentation shape, so that the accuracy and efficiency of special effect segmentation are improved, and the accuracy and integrity of sub-images are ensured.

There is provided with an image processing system. A first imaging parameter and a second imaging parameter of a virtual camera corresponding to a virtual viewpoint image generated based on a plurality of captured images is set, the second imaging parameter being different from the first imaging parameter. A first virtual viewpoint image is generated based on the first imaging parameter and a second virtual viewpoint image is generated based on the second imaging parameter. A composite image is generated by combining the first virtual viewpoint image and the second virtual viewpoint image. Content of operation of a user for the first imaging parameter or the second imaging parameter is obtained. The generated composite image is displayed.

The invention discloses an energy flow interface 3D interaction method, and relates to the technical field of vehicle electronics, and the method comprises the steps: collecting a real-time operation message of each subsystem of a vehicle through a whole vehicle communication network, and analyzing the real-time operation message into an engineering value with a physical quantity line; determining the running state of the vehicle based on the engineering numerical value, and dynamically generating an energy flow direction topology table defining a source node and a target node; calculating a three-dimensional energy flux vector containing a direction vector and a modulus length scalar according to the node anchor point coordinates; calculating a target observation matrix of the virtual camera based on the three-dimensional energy flux vector, so that the sight line direction and the space direction of the vector meet a preset geometric projection relationship; and driving a graphic rendering pipeline, and generating an interactive interface comprising the three-dimensional part model and the dynamic particle flow according to the engineering numerical value and the target observation matrix. According to the method, self-adaptive adjustment of a visual angle is realized by constructing an energy flux vector, the optimal visibility of an energy transmission path is ensured, and real-time visualization of physical data driving is realized.

A method includes identifying a transformation associated with a video see-through (VST) extended reality (XR) device using registration and parallax errors. The registration and parallax errors are based on one or more differences between (i) one or more actual positions of contents of a scene as imaged using a see-through camera and (ii) one or more perceived positions of the contents of the scene at a virtual camera associated with a viewpoint of a user when viewing a display panel. The method also includes obtaining an image that captures an object using the see-through camera, applying the transformation to the image in order to generate a modified image, and rendering the modified image for presentation on the display panel. Applying the transformation modifies the image such that a perceived position of the object substantially matches an actual position of the object when the display panel is viewed by the user.

The invention discloses an immersive off-road mode switching mode, and relates to the field of vehicle electronic technology and intelligent cabin man-machine interaction, and the method comprises the steps: responding to a switching instruction, and controlling a virtual camera to move towards an off-road scene along a planned path while preloading resources. The system divides a control state according to a transition progress: in a pre-interaction state that resources are ready but transition is not completed, the off-road instrument assembly is controlled to fade in display and open input, a user pre-operation instruction is temporarily stored in an instruction buffer queue through de-duplication logic, and a physical signal is temporarily not issued through a vehicle bus interface; and when the transition time is over and a fully activated state is entered, the queue is locked, and an instruction is converted into a standard protocol data unit to be sent to a chassis electronic control unit. Through the staged state machine and instruction buffer logic, three-dimensional visual rendering and a bottom layer control time sequence are decoupled, and continuity of interactive operation and deterministic transmission of a control instruction are realized while scene switching smoothness is ensured.

Provided is a device including a communication module that receives a drone image from a drone, and a processor that generates an AR image by merging the virtual object in virtual space with the drone image. The processor converts first location information of the drone in real space into second location information in virtual space, generates the AR image based on a field of view (FOV) of a virtual camera positioned at a location corresponding to the second location information in the virtual space, calculates a similarity between the AR image and the drone image, and corrects the second location information when the calculated similarity is lower than a predetermined similarity.

The invention discloses a method, a system, a medium and equipment for panoramic display of underground facilities, and belongs to the technical field of augmented reality visualization. The method comprises the following steps: real picture data of a real camera in a target area is acquired in real time, and the real picture data of the real camera are acquired based on pose data of the real camera; synchronously adjusting the pose state of a virtual camera configured in the fused three-dimensional model; wherein the fused three-dimensional model is obtained by performing space alignment based on an underground facility three-dimensional model and a ground three-dimensional model; according to the pose state, performing perspective projection rendering and image matting processing on the fused three-dimensional model to obtain an underground facility image only containing a view angle corresponding to the current pose state; and carrying out picture fusion on the real picture data and the underground facility image to obtain a virtual-real fused perspective image, and displaying the virtual-real fused perspective image. By implementing the method and the device, the problem that the underground facility shielded by the ground cannot be accurately and stably displayed in a real-time picture of a common camera in the prior art can be solved.

The application provides a display control method and device in a game, an electronic device and a storage medium. The method comprises the following steps: in response to a game image drawing instruction, identifying a target line-shaped element in a visual range; determining a feature adjustment value of each vertex on the target line-shaped element according to a positional relationship between each vertex and a virtual camera; and performing game image drawing based on the feature adjustment value of each vertex on the target line-shaped element. Through the application, the calculation consumption can be effectively reduced.

The invention discloses a BIM model and building drawing collaborative management method and device, and belongs to the technical field of building data processing, the method comprises the steps that a first BIM model and a first building drawing are acquired, and the first BIM model and the first building drawing are used for indicating the same building; generating a visual description data set of the first BIM model by adopting a virtual camera and a large language model; generating a primitive feature vector corresponding to each primitive in the first architectural drawing; the similarity between the visual description of each data point and the primitive feature vector of each primitive is calculated pairwise, a plurality of matching pairs are obtained based on the similarity, each matching pair comprises one data point and one primitive, and the matching pairs are used for collaborative management of the BIM model and the architectural drawing. According to the method, the management efficiency of the BIM model and the architectural drawing can be improved.

The invention relates to the technical field of XR operation, and discloses a WebXR-based panoramic immersive robot teleoperation system and method. The method comprises the following steps: carrying out distortion correction and splicing fusion on original images collected by a double-fisheye lens to obtain a panoramic image frame; encoding the panoramic image frame into a video code stream, transmitting the video code stream to a browser end, and decoding the video code stream at the browser end to obtain a panoramic video texture; mapping the panoramic video texture to the inner surface of a sphere, setting a virtual camera at the center of the sphere, and constructing a panoramic sphere rendering model; and converting the attitude quaternion of the VR head-mounted display into a sight decoupling rotation matrix, performing local GPU rendering on the panoramic sphere rendering model to obtain a real-time visual angle picture, and mapping a rocker shaft value of the gamepad into a control instruction to be sent to a robot dog end. In the whole view angle switching process, vertex transformation and texture sampling are completed at the browser end, no pan-tilt rotation instruction is generated or sent to the robot dog end through the network, and delay is reduced.

The entertainment system of the present invention provides an image with high satisfaction to a user on the basis of learning information relating to the image. The entertainment system places at least one virtual camera in a virtual space. And generating an image which can be seen from the virtual camera. The learning information related to the image includes evaluation information related to the image, and the image is generated based on the learning information. In an entertainment system, learning information related to an image includes evaluation information related to the image. The entertainment system generates an image on the basis of the learning information, and thus can provide an image that is highly satisfactory to the user.