267 results about "Virtual cinematography" patented technology

The invention relates to the field of video processing, in particular to a video data processing method and device, equipment and a medium. In a background replacement link, based on precise operation of video processing requirements, an adaptive algorithm can be selected according to scene characteristics, and errors are preliminarily reduced. And subsequently, error compensation is carried out on the generated intermediate video data, the error region is corrected in a targeted manner, the edge is filled and optimized by utilizing the edge pixel characteristics of the foreground region, and iteration processing is carried out until the error is lower than a preset value, so that the accuracy of background replacement is greatly improved. And finally, the target video data is injected into the virtual camera of the cloud mobile phone, the method is applied to a mobile terminal scene, the background and the foreground are naturally fused under high-precision scenes such as live broadcast and virtual conferences, the image flaws are remarkably reduced, the strict requirements of a user on the video image quality are met with a high-precision background replacement effect, and the overall user experience is improved.

A splat generation system and associated methods generate a splat representation of a three-dimensional (3D) model with varying detail based on an unequal or non-uniform capture of the 3D model. The system receives the 3D model. The system analyzes variation in the position or visual characteristics of the 3D model primitives, attributes different levels-of-importance to different surfaces or regions of the 3D model based on the variation, and defines a non-uniform placement of virtual cameras around the 3D model according to the different levels-of-importance that are attributed to the different surfaces or regions of the 3D model. The system generates the splats for the splat representation that reconstruct the different surfaces or regions with differing amounts of detail that match the detail captured for the different surfaces or regions in images generated from the non-uniform placement of the virtual cameras.

Embodiments of the present application provide a method, an apparatus, a device, a medium, and a program for generating a cover image of a virtual object. The method includes receiving a generation instruction of a cover image of a virtual object; determining a position of a virtual camera for shooting the virtual object; shooting the virtual object according to the position of the virtual camera; and generating, according to an image of the virtual object shot by the virtual camera, a cover image corresponding to the virtual object. The cover image of the virtual object shot by this method is more complete and aesthetically pleasing.

This disclosure provides an AI filmmaking workflow including AI-assisted storyboarding, AI animation, and post-production processes for creating films. The workflow provides techniques for reconstructing 3D digital environments and characters, and for virtual camera control. The workflow also provides techniques for capturing 2D live-action performances and extracting visual cues. The AI animation process generates synthetic images and video using prompts that are based on virtual camera control in case of 3D digitization and / or visual cues in case of 2D camera capturing. Further, the workflow provides techniques for compositing with AI assistance, to generate a composited video based on the AI-animated video and inputs resulting from 3D digitization and / or 2D video processing. Advanced post-processing techniques are also provided for generating a complete film based on the composited video. This framework is designed to facilitate creative collaborative networks by using a hybrid digitization approach to enhance consistency, directability, and scalability in AI filmmaking.

There is provided an information processing method to easily recognize a region focused by a shooting camera. The information processing method according to the present disclosure includes: placing a virtual camera in a virtual environment space obtained by modeling a target environment in which a mobile object equipped with a shooting camera is allowed to move, the virtual camera being associated with the shooting camera; determining a virtual focus region in the virtual environment space on the basis of an image corresponding to the field range of the virtual camera, the virtual focus region corresponding to a region focused by the shooting camera in the target environment; and displaying region-specific information on a display screen, the region-specific information specifying the virtual focus region.

In a virtual camera calibration method, a target object model of a physical camera device is obtained. The physical camera device includes a camera and a contact plane. The target object model with an operation controller is output for display through a head-mounted display device. The contact plane of the target object model and a contact plane of the operation controller are in an attached state. A camera position of the target object model corresponds to a camera position of the physical camera device. An indication that a camera of the target object model and the camera of the physical camera device are in an overlapping state is output for display. A virtual camera is calibrated based on spatial information of the operation controller and a spatial calibration operation for the virtual camera. The spatial information includes target position information and a target orientation.

A method for extracting at least one image feature from at least one image generated by at least one real camera, present in a motor vehicle, for monitoring the environment of the motor vehicle. The method includes, in a first step a), the image generated by the camera is transformed into a transformed image by means of a virtual camera which is assigned to the real camera and the optical axis of which extends along a horizontal direction with respect to the motor vehicle, according to which, in a second step b), at least one image feature is extracted from the transformed image.

The invention discloses a video frame sharing output processing method and a related device, and relates to the technical field of software, and the method comprises the steps: obtaining an original video frame collected by a camera; the original video frame is converted into a first target video frame according to the format configuration of the stream pushing end, the original video frame is converted into a second target video frame according to the format configuration of the virtual camera, and the stream pushing end and the virtual camera are pre-created with respective shared memories; and writing the first target video frame into a shared memory of the stream pushing end, and writing the second target video frame into a shared memory of the virtual camera. According to the method, the architecture design of single-source processing and multi-target distribution can be realized, repeated calculation is avoided, in addition, cross-process access can be supported, and the effect of isolated storage of double shared memories is achieved.

The invention relates to the technical field of computer graphics, and provides a model data adaptation processing method for a graphics rendering engine, which comprises the following steps of: importing and analyzing model files from different geometric modeling engines, and extracting original geometric data, original topological data and auxiliary information in the model files; converting the original geometric data into a unified standard geometric data structure for representation and storage; converting the original topological data into a standard topological data structure based on a boundary representation method for representation and storage; creating, analyzing or setting spatial position and direction information of the model entity and the virtual camera in a world coordinate system; analyzing material attributes, surface textures and animation information in the affiliated information of the model file, and packaging the materials, the surface textures and the animation information into corresponding standard data structures; and combining the standardized geometric data, topological data, coordinate system information and affiliated information into a complete standardized model data packet which can be directly used by a graphic rendering engine.

There is provided with an image processing system. A first imaging parameter and a second imaging parameter of a virtual camera corresponding to a virtual viewpoint image generated based on a plurality of captured images is set, the second imaging parameter being different from the first imaging parameter. A first virtual viewpoint image is generated based on the first imaging parameter and a second virtual viewpoint image is generated based on the second imaging parameter. A composite image is generated by combining the first virtual viewpoint image and the second virtual viewpoint image. Content of operation of a user for the first imaging parameter or the second imaging parameter is obtained. The generated composite image is displayed.

The invention discloses an energy flow interface 3D interaction method, and relates to the technical field of vehicle electronics, and the method comprises the steps: collecting a real-time operation message of each subsystem of a vehicle through a whole vehicle communication network, and analyzing the real-time operation message into an engineering value with a physical quantity line; determining the running state of the vehicle based on the engineering numerical value, and dynamically generating an energy flow direction topology table defining a source node and a target node; calculating a three-dimensional energy flux vector containing a direction vector and a modulus length scalar according to the node anchor point coordinates; calculating a target observation matrix of the virtual camera based on the three-dimensional energy flux vector, so that the sight line direction and the space direction of the vector meet a preset geometric projection relationship; and driving a graphic rendering pipeline, and generating an interactive interface comprising the three-dimensional part model and the dynamic particle flow according to the engineering numerical value and the target observation matrix. According to the method, self-adaptive adjustment of a visual angle is realized by constructing an energy flux vector, the optimal visibility of an energy transmission path is ensured, and real-time visualization of physical data driving is realized.

A method includes identifying a transformation associated with a video see-through (VST) extended reality (XR) device using registration and parallax errors. The registration and parallax errors are based on one or more differences between (i) one or more actual positions of contents of a scene as imaged using a see-through camera and (ii) one or more perceived positions of the contents of the scene at a virtual camera associated with a viewpoint of a user when viewing a display panel. The method also includes obtaining an image that captures an object using the see-through camera, applying the transformation to the image in order to generate a modified image, and rendering the modified image for presentation on the display panel. Applying the transformation modifies the image such that a perceived position of the object substantially matches an actual position of the object when the display panel is viewed by the user.

The invention discloses an immersive off-road mode switching mode, and relates to the field of vehicle electronic technology and intelligent cabin man-machine interaction, and the method comprises the steps: responding to a switching instruction, and controlling a virtual camera to move towards an off-road scene along a planned path while preloading resources. The system divides a control state according to a transition progress: in a pre-interaction state that resources are ready but transition is not completed, the off-road instrument assembly is controlled to fade in display and open input, a user pre-operation instruction is temporarily stored in an instruction buffer queue through de-duplication logic, and a physical signal is temporarily not issued through a vehicle bus interface; and when the transition time is over and a fully activated state is entered, the queue is locked, and an instruction is converted into a standard protocol data unit to be sent to a chassis electronic control unit. Through the staged state machine and instruction buffer logic, three-dimensional visual rendering and a bottom layer control time sequence are decoupled, and continuity of interactive operation and deterministic transmission of a control instruction are realized while scene switching smoothness is ensured.

Provided is a device including a communication module that receives a drone image from a drone, and a processor that generates an AR image by merging the virtual object in virtual space with the drone image. The processor converts first location information of the drone in real space into second location information in virtual space, generates the AR image based on a field of view (FOV) of a virtual camera positioned at a location corresponding to the second location information in the virtual space, calculates a similarity between the AR image and the drone image, and corrects the second location information when the calculated similarity is lower than a predetermined similarity.

The invention discloses a method, a system, a medium and equipment for panoramic display of underground facilities, and belongs to the technical field of augmented reality visualization. The method comprises the following steps: real picture data of a real camera in a target area is acquired in real time, and the real picture data of the real camera are acquired based on pose data of the real camera; synchronously adjusting the pose state of a virtual camera configured in the fused three-dimensional model; wherein the fused three-dimensional model is obtained by performing space alignment based on an underground facility three-dimensional model and a ground three-dimensional model; according to the pose state, performing perspective projection rendering and image matting processing on the fused three-dimensional model to obtain an underground facility image only containing a view angle corresponding to the current pose state; and carrying out picture fusion on the real picture data and the underground facility image to obtain a virtual-real fused perspective image, and displaying the virtual-real fused perspective image. By implementing the method and the device, the problem that the underground facility shielded by the ground cannot be accurately and stably displayed in a real-time picture of a common camera in the prior art can be solved.

The application provides a display control method and device in a game, an electronic device and a storage medium. The method comprises the following steps: in response to a game image drawing instruction, identifying a target line-shaped element in a visual range; determining a feature adjustment value of each vertex on the target line-shaped element according to a positional relationship between each vertex and a virtual camera; and performing game image drawing based on the feature adjustment value of each vertex on the target line-shaped element. Through the application, the calculation consumption can be effectively reduced.

The invention discloses a BIM model and building drawing collaborative management method and device, and belongs to the technical field of building data processing, the method comprises the steps that a first BIM model and a first building drawing are acquired, and the first BIM model and the first building drawing are used for indicating the same building; generating a visual description data set of the first BIM model by adopting a virtual camera and a large language model; generating a primitive feature vector corresponding to each primitive in the first architectural drawing; the similarity between the visual description of each data point and the primitive feature vector of each primitive is calculated pairwise, a plurality of matching pairs are obtained based on the similarity, each matching pair comprises one data point and one primitive, and the matching pairs are used for collaborative management of the BIM model and the architectural drawing. According to the method, the management efficiency of the BIM model and the architectural drawing can be improved.

The invention relates to the technical field of XR operation, and discloses a WebXR-based panoramic immersive robot teleoperation system and method. The method comprises the following steps: carrying out distortion correction and splicing fusion on original images collected by a double-fisheye lens to obtain a panoramic image frame; encoding the panoramic image frame into a video code stream, transmitting the video code stream to a browser end, and decoding the video code stream at the browser end to obtain a panoramic video texture; mapping the panoramic video texture to the inner surface of a sphere, setting a virtual camera at the center of the sphere, and constructing a panoramic sphere rendering model; and converting the attitude quaternion of the VR head-mounted display into a sight decoupling rotation matrix, performing local GPU rendering on the panoramic sphere rendering model to obtain a real-time visual angle picture, and mapping a rocker shaft value of the gamepad into a control instruction to be sent to a robot dog end. In the whole view angle switching process, vertex transformation and texture sampling are completed at the browser end, no pan-tilt rotation instruction is generated or sent to the robot dog end through the network, and delay is reduced.

The entertainment system of the present invention provides an image with high satisfaction to a user on the basis of learning information relating to the image. The entertainment system places at least one virtual camera in a virtual space. And generating an image which can be seen from the virtual camera. The learning information related to the image includes evaluation information related to the image, and the image is generated based on the learning information. In an entertainment system, learning information related to an image includes evaluation information related to the image. The entertainment system generates an image on the basis of the learning information, and thus can provide an image that is highly satisfactory to the user.

A method for providing navigation assistance in a three-dimensional (3D) virtual environment includes a plurality of virtual characters corresponding to a plurality of users, wherein the plurality of virtual characters communicates with each other in the 3D virtual environment and a plurality of virtual cameras corresponding to the plurality of virtual characters. Further, the given virtual camera being movable according to a movement of the corresponding virtual character. Further, providing at least one predefined navigation path in the 3D virtual environment for directing the plurality of virtual characters to move towards at least one virtual area in the 3D virtual environment. Furthermore, providing an indication of scene details in the at least one virtual area. Moreover, capturing a plurality of video streams using the plurality of virtual cameras and sending the plurality of video streams to the plurality of user devices for display thereat.

The present disclosure relates to a video recording method and device in a virtual scene, a storage medium and an electronic device, and relates to the technical field of computers. The method comprises: controlling a first virtual camera to collect first picture data of the virtual scene under a camera view angle; and controlling an audio engine to perform spatialization processing on an original audio signal triggered by a sound-emitting body based on first pose information of the first virtual camera and second pose information of the sound-emitting body in the virtual scene, to obtain first audio data, and combining the first audio data and the first picture data to obtain a first recording video. In this way, the sound and the picture in the first recording video are matched, which conforms to the video recording in a real situation and greatly increases the authenticity of the video recorded in the virtual scene.

Systems and methods are described for generating an AR image are described herein. A physical camera is used to capture a video of a physical object in front of a physical background. The system then accesses data defining a virtual environment and selects a first position of a virtual camera in the virtual environment. While capturing the video, the system displays captured video of the physical object, such that the physical background is replaced with a view of the virtual environment from the first position of the virtual camera. In response to detecting a movement of the physical camera, the system selects a second position of the virtual camera in the virtual environment based on the detected movement. The system then displays the captured video of the physical object, wherein the view of the physical background is replaced with a view of the virtual environment from the second position of the virtual camera.

To improve user experience. [Solution] The program causes the computer to function as a control means that operates operation objects and user objects placed in a virtual space based on the user's operations in a predetermined area, and an image processing means that displays a virtual space image, which is an image of the virtual space based on a virtual camera placed in the virtual space. When the control means detects the user's first operation outside the predetermined area, it places a position designation object in the virtual space that specifies the destination of the user object, and moves the user object to the destination in a specific manner that is faster than normal movement.

This invention relates to the fields of wildfire monitoring, computer vision, and digital twin technology. It proposes a method and system for real-time wildfire spread simulation using digital twins and dynamic parameter inversion. The method dynamically inverts the surface combustible moisture content through white balance adaptive correction and HSV color feature extraction; maps physical camera parameters to a virtual camera; and uses a spatial ray casting algorithm and a digital elevation model to calculate the three-dimensional geographic coordinates of the fire point; it determines the wildfire spread direction by weighting the wind field vector and the maximum upslope vector in real time; it calculates the true slope of the dynamic path by taking points forward from the fire point as the starting point and using the grid accuracy of the digital elevation model as the step size; and it inputs the dynamic parameters into the wildfire spread model for simulation to generate the fire spread boundary. This invention significantly improves the physical realism and practical accuracy of wildfire spread simulation in complex environments through virtual-real fusion and physical correction mechanisms.

The application discloses an automatic driving continuous testing method based on an adversarial attack, takes end-to-end automatic driving software as a testing object, takes a picture as an input, outputs a deflection angle for controlling a virtual car, sets a billboard area in the input picture as a testing area, sets an expected driving track as a testing target, positions a current position of the testing object, calculates an expected deflection angle of the testing object based on the testing target, positions the testing area in the input, adds Gaussian disturbance noise to simulate the influence of environmental factors, calculates a gradient about the input picture, updates the input of the testing object based on a sub-gradient iteration, extracts and uses affine transformation and interpolation transformation to convert the testing area image into a billboard size, inputs the testing area image into a virtual camera, and finally outputs the testing area image to the billboard in a testing scene, and completes the continuous testing based on feedback information and control information. The application improves the robustness and safety of automatic driving software based on machine learning and deep learning.

A blurred image is generated by blurring an image of a virtual space in a range of view from a virtual camera with a degree of blurring depending on a distance from the virtual camera. The blurred image is generated with the degree of blurring additionally depending on an imaging direction of the virtual camera. The blurred image is output on a display screen.

Systems and methods are described for imparting dynamic, non-linear and realistic movement and look and feel to a player's / virtual character's first-person limbs and hand-held object model, and procedurally animating a first-person virtual camera such that it simulates the movement of a camera handheld by the player / virtual character. To impart chaotic or random motion to the first-person limbs and hand-held object model a first module defines and implements first and second two dimensional mass-spring-damper systems, each of which is linked to the player's / virtual vector's view vector. Procedural animation or rotational shake is implemented by a second module by applying a coherent noise function to each of the six axes of the first-person virtual camera.

The invention discloses a digital optical simulation test method and device, a storage medium and a product, and relates to the technical field of simulation tests.The digital optical simulation test method comprises the steps that modeling parameters and modeling objects are obtained, a corresponding target scene model is established, the modeling objects comprise a target vehicle, and the modeling parameters comprise the modeling parameters and the modeling objects; the modeling parameters comprise environmental parameters, physical optical parameters and motion parameters, establishing a virtual camera and a virtual sensor in the target scene model, and generating a simulation image based on the environmental parameters, the physical optical parameters, the motion parameters, the virtual camera and the virtual sensor, and performing a simulation test on the auxiliary driving system of the target vehicle in a pure digital environment. According to the invention, the simulation test is carried out by establishing the model, the real vehicle does not need to run for a long distance on the road, and the test efficiency is improved. And simulation testing can be performed on different environments, object optical materials and vehicle driving scenes by setting modeling parameters, so that the comprehensiveness of the test scene is improved.

The invention provides a virtual prop control method and device, electronic equipment and a storage medium. The method comprises the steps that a game scene picture obtained by shooting a game scene through a first virtual camera is displayed in a graphical user interface; when a virtual shooting prop held by the controlled virtual object is in a non-opened state, in response to a first sliding operation executed on the graphical user interface, determining a rotation parameter for the virtual shooting prop according to an operation parameter of the first sliding operation; and when the first sliding operation is finished, the direction of the shooting opening of the virtual shooting prop is controlled to be adjusted according to the rotating parameters. The difficulty of operating virtual shooting props by a user can be reduced, the game experience of players is improved, and the retention rate is increased.