166 results about "Virtual cinematography" patented technology

This disclosure provides an AI filmmaking workflow including AI-assisted storyboarding, AI animation, and post-production processes for creating films. The workflow provides techniques for reconstructing 3D digital environments and characters, and for virtual camera control. The workflow also provides techniques for capturing 2D live-action performances and extracting visual cues. The AI animation process generates synthetic images and video using prompts that are based on virtual camera control in case of 3D digitization and / or visual cues in case of 2D camera capturing. Further, the workflow provides techniques for compositing with AI assistance, to generate a composited video based on the AI-animated video and inputs resulting from 3D digitization and / or 2D video processing. Advanced post-processing techniques are also provided for generating a complete film based on the composited video. This framework is designed to facilitate creative collaborative networks by using a hybrid digitization approach to enhance consistency, directability, and scalability in AI filmmaking.

In a virtual camera calibration method, a target object model of a physical camera device is obtained. The physical camera device includes a camera and a contact plane. The target object model with an operation controller is output for display through a head-mounted display device. The contact plane of the target object model and a contact plane of the operation controller are in an attached state. A camera position of the target object model corresponds to a camera position of the physical camera device. An indication that a camera of the target object model and the camera of the physical camera device are in an overlapping state is output for display. A virtual camera is calibrated based on spatial information of the operation controller and a spatial calibration operation for the virtual camera. The spatial information includes target position information and a target orientation.

A method for extracting at least one image feature from at least one image generated by at least one real camera, present in a motor vehicle, for monitoring the environment of the motor vehicle. The method includes, in a first step a), the image generated by the camera is transformed into a transformed image by means of a virtual camera which is assigned to the real camera and the optical axis of which extends along a horizontal direction with respect to the motor vehicle, according to which, in a second step b), at least one image feature is extracted from the transformed image.

The invention discloses a video frame sharing output processing method and a related device, and relates to the technical field of software, and the method comprises the steps: obtaining an original video frame collected by a camera; the original video frame is converted into a first target video frame according to the format configuration of the stream pushing end, the original video frame is converted into a second target video frame according to the format configuration of the virtual camera, and the stream pushing end and the virtual camera are pre-created with respective shared memories; and writing the first target video frame into a shared memory of the stream pushing end, and writing the second target video frame into a shared memory of the virtual camera. According to the method, the architecture design of single-source processing and multi-target distribution can be realized, repeated calculation is avoided, in addition, cross-process access can be supported, and the effect of isolated storage of double shared memories is achieved.

The invention relates to the technical field of computer graphics, and provides a model data adaptation processing method for a graphics rendering engine, which comprises the following steps of: importing and analyzing model files from different geometric modeling engines, and extracting original geometric data, original topological data and auxiliary information in the model files; converting the original geometric data into a unified standard geometric data structure for representation and storage; converting the original topological data into a standard topological data structure based on a boundary representation method for representation and storage; creating, analyzing or setting spatial position and direction information of the model entity and the virtual camera in a world coordinate system; analyzing material attributes, surface textures and animation information in the affiliated information of the model file, and packaging the materials, the surface textures and the animation information into corresponding standard data structures; and combining the standardized geometric data, topological data, coordinate system information and affiliated information into a complete standardized model data packet which can be directly used by a graphic rendering engine.

The invention discloses an energy flow interface 3D interaction method, and relates to the technical field of vehicle electronics, and the method comprises the steps: collecting a real-time operation message of each subsystem of a vehicle through a whole vehicle communication network, and analyzing the real-time operation message into an engineering value with a physical quantity line; determining the running state of the vehicle based on the engineering numerical value, and dynamically generating an energy flow direction topology table defining a source node and a target node; calculating a three-dimensional energy flux vector containing a direction vector and a modulus length scalar according to the node anchor point coordinates; calculating a target observation matrix of the virtual camera based on the three-dimensional energy flux vector, so that the sight line direction and the space direction of the vector meet a preset geometric projection relationship; and driving a graphic rendering pipeline, and generating an interactive interface comprising the three-dimensional part model and the dynamic particle flow according to the engineering numerical value and the target observation matrix. According to the method, self-adaptive adjustment of a visual angle is realized by constructing an energy flux vector, the optimal visibility of an energy transmission path is ensured, and real-time visualization of physical data driving is realized.

The invention discloses an immersive off-road mode switching mode, and relates to the field of vehicle electronic technology and intelligent cabin man-machine interaction, and the method comprises the steps: responding to a switching instruction, and controlling a virtual camera to move towards an off-road scene along a planned path while preloading resources. The system divides a control state according to a transition progress: in a pre-interaction state that resources are ready but transition is not completed, the off-road instrument assembly is controlled to fade in display and open input, a user pre-operation instruction is temporarily stored in an instruction buffer queue through de-duplication logic, and a physical signal is temporarily not issued through a vehicle bus interface; and when the transition time is over and a fully activated state is entered, the queue is locked, and an instruction is converted into a standard protocol data unit to be sent to a chassis electronic control unit. Through the staged state machine and instruction buffer logic, three-dimensional visual rendering and a bottom layer control time sequence are decoupled, and continuity of interactive operation and deterministic transmission of a control instruction are realized while scene switching smoothness is ensured.

Provided is a device including a communication module that receives a drone image from a drone, and a processor that generates an AR image by merging the virtual object in virtual space with the drone image. The processor converts first location information of the drone in real space into second location information in virtual space, generates the AR image based on a field of view (FOV) of a virtual camera positioned at a location corresponding to the second location information in the virtual space, calculates a similarity between the AR image and the drone image, and corrects the second location information when the calculated similarity is lower than a predetermined similarity.

The invention discloses a method, a system, a medium and equipment for panoramic display of underground facilities, and belongs to the technical field of augmented reality visualization. The method comprises the following steps: real picture data of a real camera in a target area is acquired in real time, and the real picture data of the real camera are acquired based on pose data of the real camera; synchronously adjusting the pose state of a virtual camera configured in the fused three-dimensional model; wherein the fused three-dimensional model is obtained by performing space alignment based on an underground facility three-dimensional model and a ground three-dimensional model; according to the pose state, performing perspective projection rendering and image matting processing on the fused three-dimensional model to obtain an underground facility image only containing a view angle corresponding to the current pose state; and carrying out picture fusion on the real picture data and the underground facility image to obtain a virtual-real fused perspective image, and displaying the virtual-real fused perspective image. By implementing the method and the device, the problem that the underground facility shielded by the ground cannot be accurately and stably displayed in a real-time picture of a common camera in the prior art can be solved.

The application provides a display control method and device in a game, an electronic device and a storage medium. The method comprises the following steps: in response to a game image drawing instruction, identifying a target line-shaped element in a visual range; determining a feature adjustment value of each vertex on the target line-shaped element according to a positional relationship between each vertex and a virtual camera; and performing game image drawing based on the feature adjustment value of each vertex on the target line-shaped element. Through the application, the calculation consumption can be effectively reduced.

The invention discloses a BIM model and building drawing collaborative management method and device, and belongs to the technical field of building data processing, the method comprises the steps that a first BIM model and a first building drawing are acquired, and the first BIM model and the first building drawing are used for indicating the same building; generating a visual description data set of the first BIM model by adopting a virtual camera and a large language model; generating a primitive feature vector corresponding to each primitive in the first architectural drawing; the similarity between the visual description of each data point and the primitive feature vector of each primitive is calculated pairwise, a plurality of matching pairs are obtained based on the similarity, each matching pair comprises one data point and one primitive, and the matching pairs are used for collaborative management of the BIM model and the architectural drawing. According to the method, the management efficiency of the BIM model and the architectural drawing can be improved.

The invention relates to the technical field of XR operation, and discloses a WebXR-based panoramic immersive robot teleoperation system and method. The method comprises the following steps: carrying out distortion correction and splicing fusion on original images collected by a double-fisheye lens to obtain a panoramic image frame; encoding the panoramic image frame into a video code stream, transmitting the video code stream to a browser end, and decoding the video code stream at the browser end to obtain a panoramic video texture; mapping the panoramic video texture to the inner surface of a sphere, setting a virtual camera at the center of the sphere, and constructing a panoramic sphere rendering model; and converting the attitude quaternion of the VR head-mounted display into a sight decoupling rotation matrix, performing local GPU rendering on the panoramic sphere rendering model to obtain a real-time visual angle picture, and mapping a rocker shaft value of the gamepad into a control instruction to be sent to a robot dog end. In the whole view angle switching process, vertex transformation and texture sampling are completed at the browser end, no pan-tilt rotation instruction is generated or sent to the robot dog end through the network, and delay is reduced.

To improve user experience. [Solution] The program causes the computer to function as a control means that operates operation objects and user objects placed in a virtual space based on the user's operations in a predetermined area, and an image processing means that displays a virtual space image, which is an image of the virtual space based on a virtual camera placed in the virtual space. When the control means detects the user's first operation outside the predetermined area, it places a position designation object in the virtual space that specifies the destination of the user object, and moves the user object to the destination in a specific manner that is faster than normal movement.

This invention relates to the fields of wildfire monitoring, computer vision, and digital twin technology. It proposes a method and system for real-time wildfire spread simulation using digital twins and dynamic parameter inversion. The method dynamically inverts the surface combustible moisture content through white balance adaptive correction and HSV color feature extraction; maps physical camera parameters to a virtual camera; and uses a spatial ray casting algorithm and a digital elevation model to calculate the three-dimensional geographic coordinates of the fire point; it determines the wildfire spread direction by weighting the wind field vector and the maximum upslope vector in real time; it calculates the true slope of the dynamic path by taking points forward from the fire point as the starting point and using the grid accuracy of the digital elevation model as the step size; and it inputs the dynamic parameters into the wildfire spread model for simulation to generate the fire spread boundary. This invention significantly improves the physical realism and practical accuracy of wildfire spread simulation in complex environments through virtual-real fusion and physical correction mechanisms.

The application discloses an automatic driving continuous testing method based on an adversarial attack, takes end-to-end automatic driving software as a testing object, takes a picture as an input, outputs a deflection angle for controlling a virtual car, sets a billboard area in the input picture as a testing area, sets an expected driving track as a testing target, positions a current position of the testing object, calculates an expected deflection angle of the testing object based on the testing target, positions the testing area in the input, adds Gaussian disturbance noise to simulate the influence of environmental factors, calculates a gradient about the input picture, updates the input of the testing object based on a sub-gradient iteration, extracts and uses affine transformation and interpolation transformation to convert the testing area image into a billboard size, inputs the testing area image into a virtual camera, and finally outputs the testing area image to the billboard in a testing scene, and completes the continuous testing based on feedback information and control information. The application improves the robustness and safety of automatic driving software based on machine learning and deep learning.

A blurred image is generated by blurring an image of a virtual space in a range of view from a virtual camera with a degree of blurring depending on a distance from the virtual camera. The blurred image is generated with the degree of blurring additionally depending on an imaging direction of the virtual camera. The blurred image is output on a display screen.

Systems and methods are described for imparting dynamic, non-linear and realistic movement and look and feel to a player's / virtual character's first-person limbs and hand-held object model, and procedurally animating a first-person virtual camera such that it simulates the movement of a camera handheld by the player / virtual character. To impart chaotic or random motion to the first-person limbs and hand-held object model a first module defines and implements first and second two dimensional mass-spring-damper systems, each of which is linked to the player's / virtual vector's view vector. Procedural animation or rotational shake is implemented by a second module by applying a coherent noise function to each of the six axes of the first-person virtual camera.

The invention discloses a digital optical simulation test method and device, a storage medium and a product, and relates to the technical field of simulation tests.The digital optical simulation test method comprises the steps that modeling parameters and modeling objects are obtained, a corresponding target scene model is established, the modeling objects comprise a target vehicle, and the modeling parameters comprise the modeling parameters and the modeling objects; the modeling parameters comprise environmental parameters, physical optical parameters and motion parameters, establishing a virtual camera and a virtual sensor in the target scene model, and generating a simulation image based on the environmental parameters, the physical optical parameters, the motion parameters, the virtual camera and the virtual sensor, and performing a simulation test on the auxiliary driving system of the target vehicle in a pure digital environment. According to the invention, the simulation test is carried out by establishing the model, the real vehicle does not need to run for a long distance on the road, and the test efficiency is improved. And simulation testing can be performed on different environments, object optical materials and vehicle driving scenes by setting modeling parameters, so that the comprehensiveness of the test scene is improved.

An example method includes receiving images of an environment. The environment may include a building. The images may be captured by an aerial drone. A 3D representation of the environment may be generated, based on the images. The 3D representation may include Gaussian splats representing the environment, including the building. Particular regions in the 3D representation in which a virtual camera for viewing the 3D representation may move as the 3D representation is navigated may be identified. The virtual camera may be constrained to move only in the particular regions. The particular regions may be less than an entirety of the 3D representation. The 3D representation may be provided for display. Inputs to navigate the 3D representation by moving the virtual camera in the 3D representation may be received. The virtual camera may be moved, based on the inputs, only in the particular regions in the 3D representation.

The present disclosure provides a screen projection method, a videoconferencing device, and a system. The screen projection method includes: receiving a to-be-projected video stream sent by a screen projection initiator; decoding the to-be-projected video stream to generate a plurality of to-be-projected images; creating a virtual camera to enable a videoconferencing screen projection application to control the virtual camera through a standard camera interface to collect each to-be-projected image; and performing screen projection on the collected to-be-projected image by the videoconferencing screen projection application. The present disclosure can enable the videoconferencing screen projection application to interface with an operating system through a standard wireless screen projection collection interface to obtain the to-be-projected image for screen projection.

The application discloses a camera pose conversion method and system of a camera robot system, and the method comprises the following steps: presetting parameters of a pose converter; receiving pose data of a camera in the camera robot; the pose data comprises position information and attitude information; converting the pose data of the camera into pose data conforming to a FREE-D protocol through the pose converter; and sending the pose data conforming to the FREE-D protocol to a virtual production platform. Through the processing scheme, accurate and high-frequency pose data conversion can be realized, and the virtual camera movement in the virtual environment is coherent and smooth, and lens pose jump errors do not occur.

This invention provides a video generation device, a video generation system, and a video generation method that enable the low-cost, real-time generation of composite images combining real-world footage and 3DCG. [Solution] The system acquires images of the real space from a camera that captures the real space, acquires the motion of an actor playing an avatar, places the avatar acting with the acquired motion and a mask corresponding to a predetermined object generated based on the acquired images of the real space, generates a virtual space in which images of the predetermined object in the real space can be displayed corresponding to the mask, and outputs an image which is a composite of the images of the real space and images from a virtual camera that captures the virtual space, in which the avatar is occluded from the predetermined object placed in the real space.

This invention provides a video generation device, a video generation system, and a video generation method that enable the low-cost, real-time generation of composite images combining real-world footage and 3DCG. [Solution] The system acquires images of the real space from a camera that captures the real space, acquires the motion of an actor playing an avatar, places the avatar acting with the acquired motion and a mask corresponding to a predetermined object generated based on the acquired images of the real space, generates a virtual space in which images of the predetermined object in the real space can be displayed corresponding to the mask, and outputs an image which is a composite of the images of the real space and images from a virtual camera that captures the virtual space, in which the avatar is occluded from the predetermined object placed in the real space.

The invention provides a transformer substation virtual camera system fused with 3D Gaussian point cloud. The transformer substation virtual camera system fused with 3D Gaussian point cloud comprises a scene building module for building a transformer substation 3DGS model for a transformer substation; the virtual camera setting module obtains virtual camera external parameters set by a user in the 3DGS model of the transformer substation, analyzes virtual camera external parameter information in real time through a space coordinate-pose automatic mapping algorithm, and determines pose information of a virtual camera; the differential rendering module adopts a differential rendering technology to process the 3DGS model of the transformer substation, dynamically analyzes optical parameters of a camera, adjusts the rendering scale and density parameters of Gaussian point cloud according to the optical parameters, and steplessly simulates the optical zoom effect of a real lens to obtain a virtual image; and the imaging output module is used for outputting and presenting the virtual image on the universal hardware. According to the method, the high-precision restoration of the transformer substation is realized by fusing the 3D Gaussian point cloud, the error of the virtual scene of the transformer substation is reduced, the construction efficiency of the virtual scene can be improved, and the cost consumption is reduced.

A racing game in which a player object and a plurality of other moving objects are caused to move on a field in a virtual space, is performed. In the racing game, an example of an information processing system sets a virtual camera in the virtual space at a position behind the player object, in a direction in which at least the player object is included in a field of view of the virtual camera, so that the virtual camera follows movement of the player object. Based on the virtual camera, the information processing system performs rendering of the objects in the virtual space, and during the rendering, enlarges and renders at least the other moving object among the objects in the virtual space by using a vertex shader, at a magnification that increases as at least a distance from the virtual camera becomes farther within a first range.

The application provides a game information display method, device and electronic equipment, in response to a game match starting instruction, a controlled virtual character is controlled to enter a game match scene, and a game match picture displayed through a graphical user interface is displayed; in response to a first target game event of the controlled virtual character, the controlled virtual character is controlled to leave the game match scene; game data of a teammate virtual character is acquired, and the game match picture is changed into a first game observation picture, which includes a picture formed by a virtual camera collecting the game match scene and a game result picture. In the method, the game real-time pictures and the game result pictures of the virtual characters are displayed through multiple display areas, so that the players can quickly and simultaneously know the game states of the virtual characters, the players can avoid missing the changes of the game states of the other virtual characters, the information acquisition of the players in the waiting process is enriched, the emotional connection feeling between the players and the virtual characters is enhanced, and the game experience of the players is improved.

Methods, systems, and apparatus, including computer programs encoded on computer storage media relate to a method for head tracking for video communications in a virtual environment. The system may provide a video conference session in a virtual environment. The system may provide a digital representation of the video conference participant in the virtual environment. The system may display one or more views of the virtual environment in the video conference. The system may track movement of the video conference participant to generate user movement information and may display movement of the video conference participant on the digital representation.

------31 / 05 / 2567------(OCR) This disclosure provides a system, methodology, computer program product, and intermediary media used to record computer-readable data for synchronizing virtual scene content and real-world scene content. First, the virtual scene, the virtual representative of the augmented reality device, and the virtual avatar of the virtual reality device are modeled to place the virtual representative and virtual avatar in the virtual scene, and parameters and time stamps from the augmented reality device and from the virtual reality device are obtained to apply them to the virtual representative and virtual avatar, respectively. In this way, the virtual camera perspective screens of the virtual representative and virtual avatar are controlled respectively, and then the virtual camera perspective screen of the virtual representative is signaled to the augmented reality device, and the virtual camera perspective screen of the virtual avatar is signaled to the virtual reality device, thus allowing the augmented reality user and the virtual reality user to interact on the same timeline. ------------