Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

583 results about "Virtual cinematography" patented technology

Virtual cinematography is the set of cinematographic techniques performed in a computer graphics environment. This includes a wide variety of subjects like photographing real objects, often with stereo or multi-camera setup, for the purpose of recreating them as three-dimensional objects and algorithms for automated creation of real and simulated camera angles.

Method and apparatus for generating surround view monitoring image for ship

The present disclosure relates to a method and an apparatus of generating a surround view monitoring (SVM) image. The method includes: obtaining installation information of an actual camera installed on a ship; setting a virtual camera to orient toward a ground plane perpendicularly within a world coordinate system; calculating a conversion relationship between the virtual camera and the actual camera, based on the installation information of the actual camera; generating the SVM image based on the calculated conversion relationship; and controlling the ship based on the generated SVM image.
Owner:AVIKUS CO LTD

Image processing apparatus, method for image processing, and storage medium

An image processing apparatus for generating a virtual viewpoint video includes a first viewpoint determination unit arranged to generate a camera parameter of a first virtual camera based on an input value from a first input device, a playback-position determination unit arranged to determine a playback position of a virtual viewpoint image based on the input value from the first input device, a first-video generation unit arranged to generate a first virtual viewpoint video based on the first virtual camera and the playback position, a second viewpoint determination unit arranged to generate a camera parameter of a second virtual camera based on the input value from the first input device and an input value from a second input device, and a second video generation unit arranged to generate a second virtual viewpoint video based on the second virtual camera and the playback position.
Owner:CANON KK

Video sequence generation method and device, computer equipment and storage medium

The embodiment of the invention belongs to the field of image processing, and relates to a video sequence generation method and device, computer equipment and a storage medium, and the method comprises the following steps: obtaining text key information, and generating text description information according to the text key information; extracting spatial position relation information, and constructing an initial virtual scene according to the scene elements and the spatial position relation information; key content information is extracted, and effective virtual camera shooting parameters are acquired according to the key content information; converting a video sequence according to the effective virtual camera shooting parameters; judging whether the video sequence meets a preset quality threshold requirement or not; if not, the virtual camera shooting parameters are adjusted, and the video sequence is converted and adjusted according to the adjusted virtual camera shooting parameters; and extracting deep key information, searching deep scene elements according to the deep key information, and integrating the deep scene elements into the adjusted video sequence to obtain an effective video sequence. According to the method, the effective video sequence conforming to the content of the text information can be effectively and accurately generated according to the input text information.
Owner:PING AN TECH (SHENZHEN) CO LTD

Video data processing method and device, equipment and medium

The invention relates to the field of video processing, in particular to a video data processing method and device, equipment and a medium. In a background replacement link, based on precise operation of video processing requirements, an adaptive algorithm can be selected according to scene characteristics, and errors are preliminarily reduced. And subsequently, error compensation is carried out on the generated intermediate video data, the error region is corrected in a targeted manner, the edge is filled and optimized by utilizing the edge pixel characteristics of the foreground region, and iteration processing is carried out until the error is lower than a preset value, so that the accuracy of background replacement is greatly improved. And finally, the target video data is injected into the virtual camera of the cloud mobile phone, the method is applied to a mobile terminal scene, the background and the foreground are naturally fused under high-precision scenes such as live broadcast and virtual conferences, the image flaws are remarkably reduced, the strict requirements of a user on the video image quality are met with a high-precision background replacement effect, and the overall user experience is improved.
Owner:启朔(深圳)科技有限公司

Method and device for aligning laser point cloud and image based on deep learning

A method for aligning a laser point cloud and an image based on deep learning includes: collecting data by using a laser ladar and a camera, to obtain laser point cloud data and a two-dimensional (2D) image respectively; dividing preprocessed point cloud data into triangular meshes to obtain a three-dimensional (3D) mesh model of the point cloud data; determining a relative location relationship between a laser radar and the multi-function camera, and constructing a virtual camera in the 3D mesh model to capture a simulated 2D image at a same location and angle as those of the camera; and aligning, by using a convolution neural network (CNN), the 2D image captured by the camera and the simulated 2D image captured by the virtual camera to generate aligned images that map onto each other.
Owner:CHINA UNIV OF GEOSCIENCES (WUHAN) +1

Human-assisted constraint annotation for visual simultaneous localization and mapping

The system obtains a first recording of a construction site captured at a first time, and a first virtual trajectory of a first virtual camera, and creates a first data structure representing the first recording. The system obtains a second recording of the construction site captured at a second time, and creates a second data structure representing the second recording. The system establishes a correspondence between the first and second data structures by creating a map between a second image in the second recording and a first image in the first recording by efficiently searching the first data structure for the first image similar to the second image. The system obtains a first location of the first virtual camera corresponding to the first image and, based on the map between the first and second image, determines a second location of a second virtual camera corresponding to the second image.
Owner:DOXEL INC

Systems and methods for selective non-uniform splat generation

A splat generation system and associated methods generate a splat representation of a three-dimensional (3D) model with varying detail based on an unequal or non-uniform capture of the 3D model. The system receives the 3D model. The system analyzes variation in the position or visual characteristics of the 3D model primitives, attributes different levels-of-importance to different surfaces or regions of the 3D model based on the variation, and defines a non-uniform placement of virtual cameras around the 3D model according to the different levels-of-importance that are attributed to the different surfaces or regions of the 3D model. The system generates the splats for the splat representation that reconstruct the different surfaces or regions with differing amounts of detail that match the detail captured for the different surfaces or regions in images generated from the non-uniform placement of the virtual cameras.
Owner:MIRIS INC

Method, apparatus, device, medium and program for generating cover image of virtual object

Embodiments of the present application provide a method, an apparatus, a device, a medium, and a program for generating a cover image of a virtual object. The method includes receiving a generation instruction of a cover image of a virtual object; determining a position of a virtual camera for shooting the virtual object; shooting the virtual object according to the position of the virtual camera; and generating, according to an image of the virtual object shot by the virtual camera, a cover image corresponding to the virtual object. The cover image of the virtual object shot by this method is more complete and aesthetically pleasing.
Owner:BEIJING ZITIAO NETWORK TECH CO LTD

Image generation apparatus and control method for image generation apparatus

An image generation apparatus includes one or more memories storing instructions; and one or more processors that, upon execution of the stored instructions, are configured to operate as a first acquisition unit configured to acquire 3D data and a defective area of the 3D data, a second acquisition unit configured to acquire a movable range of a virtual camera, and a generation unit configured to generate mask data based on the movable range of the virtual camera and the defective area such that the defective area is not visible in the movable range of the virtual camera.
Owner:CANON KK

Digitization for ai filmmaking in collaborative networks

This disclosure provides an AI filmmaking workflow including AI-assisted storyboarding, AI animation, and post-production processes for creating films. The workflow provides techniques for reconstructing 3D digital environments and characters, and for virtual camera control. The workflow also provides techniques for capturing 2D live-action performances and extracting visual cues. The AI animation process generates synthetic images and video using prompts that are based on virtual camera control in case of 3D digitization and / or visual cues in case of 2D camera capturing. Further, the workflow provides techniques for compositing with AI assistance, to generate a composited video based on the AI-animated video and inputs resulting from 3D digitization and / or 2D video processing. Advanced post-processing techniques are also provided for generating a complete film based on the composited video. This framework is designed to facilitate creative collaborative networks by using a hybrid digitization approach to enhance consistency, directability, and scalability in AI filmmaking.
Owner:TCL TECHNOLOGY GROUP CORPORATION

Multiplexing video streams in an aggregate stream for a three-dimensional virtual environment

In an aspect, a computer-implemented method allows for navigation in a three-dimensional (3D) virtual environment. In the method, data specifying a three-dimensional virtual space is received. A position and orientation in the three-dimensional virtual space is received. The position and orientation input by a first user and representing a first virtual camera used to render the three-dimensional virtual space to the first user. A video stream captured from a camera positioned to capture the first user is received. A second virtual camera is navigated according to an input of a second user.
Owner:KATMAI TECH INC

Multi-source video data robot skill learning method and system

The invention provides a multi-source video data robot skill learning method and system. According to the exercise skill text description, an example video collection module automatically collects example videos related to the skill and carries out data expansion to obtain exercise example video data; constructing and instantiating a virtual robot and a virtual camera, cooperating with a robot control strategy and a camera mirror operation strategy, combining an intelligent agent, and generating and recording robot motion video recording data; a video intelligent scoring model is constructed through a motion skill video scoring module, and a scoring result of robot motion video recording data is generated; and through an intelligent agent learning module, setting an award feedback collaborative optimization robot control strategy and a camera mirror-moving strategy of a neural network scoring model, and updating the award feedback collaborative optimization robot control strategy and the camera mirror-moving strategy to the intelligent agent.
Owner:BEIJING INSTITUTE FOR GENERAL ARTIFICIAL INTELLIGENCE

Data display overlays for Esport streams

Methods and systems are provided for selecting a viewport into a video game for a spectator viewing a video game played by a player. The method includes identifying a plurality of virtual cameras for providing a plurality of viewports into scenes of the video game. The method includes accessing a spectator playbook, the spectator playbook is stored in association with a profile of the spectator. The spectator playbook identifies viewing history of the spectator for types of video games viewed by the spectator. The method includes accessing a player playbook, the player playbook is stored in association with a profile of the player. The player playbook identifies performance of the player for types of video games played by the player. The method includes accessing gameplay data for the video game played by the player. The method includes selecting a viewport from the plurality of viewports into the video game. The selected viewport is dynamically updated based on processing the spectator playbook, the player playbook, and changes in the gameplay data. The method includes streaming a spectator video stream for the spectator. The spectator video stream automatically changes based on the dynamic updating of the viewport while the spectator views the video game. In this way, viewports into a video game are selected and dynamically updated to provide the spectator with a customized viewing experience.
Owner:SONY INTERACTIVE ENTERTAINMENT LLC

Volume object rendering method and device, equipment and storage medium

The embodiment of the invention discloses a volume object rendering method and device, equipment and a storage medium, and relates to the technical field of image rendering. Comprises: obtaining a shape profile of a volume object, the volume object being a heterogeneous volume object, the shape profile being a volume texture comprising a narrow-band level set of density; performing density sampling on the shape section according to the observation direction of the virtual camera, and determining the transmissivity of the sampling points in the observation direction according to the density of the sampling points; performing shadow sampling on the sampling points in the shape section to obtain the radiance of the sampling points; according to the transmissivity and the radiance of each sampling point, determining the target radiance of the volume object in the observation direction; the volumetric object is rendered according to the target emissivity in each viewing direction. According to the scheme provided by the embodiment of the invention, the rendering efficiency and the rendering effect can be taken into account in the real-time rendering scene.
Owner:TENCENT TECHNOLOGY (SHENZHEN) CO LTD

Information processing method, information processing device, communication system, and computer program

There is provided an information processing method to easily recognize a region focused by a shooting camera. The information processing method according to the present disclosure includes: placing a virtual camera in a virtual environment space obtained by modeling a target environment in which a mobile object equipped with a shooting camera is allowed to move, the virtual camera being associated with the shooting camera; determining a virtual focus region in the virtual environment space on the basis of an image corresponding to the field range of the virtual camera, the virtual focus region corresponding to a region focused by the shooting camera in the target environment; and displaying region-specific information on a display screen, the region-specific information specifying the virtual focus region.
Owner:SONY GROUP CORP

Virtual camera calibration

In a virtual camera calibration method, a target object model of a physical camera device is obtained. The physical camera device includes a camera and a contact plane. The target object model with an operation controller is output for display through a head-mounted display device. The contact plane of the target object model and a contact plane of the operation controller are in an attached state. A camera position of the target object model corresponds to a camera position of the physical camera device. An indication that a camera of the target object model and the camera of the physical camera device are in an overlapping state is output for display. A virtual camera is calibrated based on spatial information of the operation controller and a spatial calibration operation for the virtual camera. The spatial information includes target position information and a target orientation.
Owner:TENCENT TECHNOLOGY (SHENZHEN) CO LTD

Patrol point PTZ parameter rapid configuration method and system in substation patrol system

The invention provides a rapid configuration method and system for PTZ parameters of inspection points in a substation inspection system, and the method comprises the steps: importing a virtual scene of a substation into the inspection system, and setting a virtual camera in the virtual scene; wherein the position of the virtual camera in the virtual scene is matched with the position of an inspection camera in the transformer substation; acquiring a reference space position preset by the inspection camera, and determining a virtual reference position corresponding to the reference space position and the position of the inspection point in the virtual scene; obtaining a first PTZ parameter when the virtual camera shoots the virtual reference position; generating a second PTZ parameter corresponding to the inspection point based on the position of the inspection point, the virtual reference position and the first PTZ parameter; and the patrol point and the second PTZ parameter are stored in an associated manner, and patrol configuration information of the patrol point is obtained. According to the mode, the configuration operation of the PTZ parameters is simplified, the configuration efficiency is improved, and the configuration requirements of large-scale inspection points can be met.
Owner:ZHUHAI UNITECH POWER TECHNOLOGY CO LTD +1

Method and system for estimating 3D camera pose based on 2d image features and application thereof

Method and system for estimating 3D camera pose based on 2D features. 3D virtual camera poses are generated, each of which is used to determine a perspective to project a 3D model of a target organ to create a 2D image of the target organ. 2D features are extracted from each 2D image and paired with the corresponding 3D virtual camera pose to represent a mapping. A 2D feature-camera pose mapping model is obtained based on the pairs. Input 2D features extracted from a real-time 2D image of the target organ are used to map, via the 2D feature-camera pose mapping model, to a 3D pose estimate of a laparoscopic camera, which is then refined to derive an estimated 3D camera pose of the laparoscopic camera via differential rendering of the 3D model with respect to the 3D pose estimate.
Owner:EDDA TECHNOLOGY INC

Vehicle-mounted virtual reality synchronization system

The invention provides a vehicle-mounted virtual reality synchronization system, which can solve the problem of motion sickness caused by mismatching of vehicle dynamic motion and visual perception in a vehicle-mounted environment of traditional VR. The system collects the acceleration, angular velocity and GPS position information of a vehicle through the sensor module, and the data analysis module maps the information to a virtual camera coordinate system in real time. The virtual camera motion control module ensures that the motion of the virtual camera is synchronized with the actual motion of the vehicle. And the dynamic scene response module adjusts the virtual scene according to the vehicle state to enhance the immersion. Finally, the virtual reality equipment provides a dynamic VR picture synchronous with the vehicle motion, the motion sickness symptom is reduced, and the user experience is improved. Furthermore, the system has the design of light weight and low power consumption, is suitable for various vehicles, and has a wide application prospect.
Owner:TSINGHUA SHENZHEN INTERNATIONAL GRADUATE SCHOOL

Stabilizing video by accounting for a location of a feature in a stabilized view of a frame

The subject matter described in this disclosure can be embodied in methods and systems for stabilizing video. A computing system determines a stabilized location of a facial feature in a frame of video accounting for its location in a previous frame. The computing system determines a physical camera pose in virtual space and maps the frame into virtual space. The computing system determines an optimized virtual camera pose using an optimization process that determines (1) a difference between the stabilized location of the facial feature and a location of the facial feature when viewed from a potential virtual camera pose, (2) a difference between the potential virtual camera pose and a previous virtual camera pose, and (3) a difference between the potential virtual camera pose and the physical camera pose. The computing system generates the stabilized view of the frame using the optimized virtual camera pose.
Owner:GOOGLE LLC

Methods and systems for enabling spectator selection and modification of video game storylines

In a multiplayer video game, virtual cameras are controlled by continually assessing and ranking storylines relating to the interactions of various players during a game session. A ranking for each storyline may be based on various factors such as, but not limited to, what the players can see, the distance between certain players, nearby game items or in-game. Subsequently, at least one virtual camera is navigated to provide a view of the highest-ranking storyline, subject to certain limitations on how the camera can move, transition, or otherwise display the interactions between players. A set of rules including rules of cinematography, are used to provide additional control of the movement of the virtual camera. Movements of a human camera-person are used on a mocap system to control the movement of the virtual camera.
Owner:ACTIVISION PUBLISHING INC

Allocating a stream budget for transferring video to generate avatars in a three-dimensional virtual environment

In an aspect, a computer-implemented method allows for navigation in a three-dimensional (3D) virtual environment. In the method, data specifying a three-dimensional virtual space is received. A position and orientation in the three-dimensional virtual space is received. The position and orientation input by a first user and representing a first virtual camera used to render the three-dimensional virtual space to the first user. A video stream captured from a camera positioned to capture the first user is received. A second virtual camera is navigated according to an input of a second user.
Owner:KATMAI TECH INC

Novel view synthesis for facilitating eye-to-eye contact during videoconferencing

A computer-implemented method includes receiving at a first computing device a first machine-learned latent space model of a first scene located proximate a second computing device where the first scene includes a first face. The first machine-learned latent space model of the first scene is decoded to produce first generated imagery corresponding to the first scene from a first viewpoint defined by a first virtual camera. The first virtual camera is positioned in alignment with a display screen of the second computing device.
Owner:IKIN INC

Systems and methods for augmented reality video generation

Systems and methods are described for generating an AR image are described herein. A physical camera is used to capture a video of a physical object in front of a physical background. The system then accesses data defining a virtual environment and selects a first position of a virtual camera in the virtual environment. While capturing the video, the system displays captured video of the physical object, such that the physical background is replaced with a view of the virtual environment from the first position of the virtual camera. In response to detecting a movement of the physical camera, the system selects a second position of the virtual camera in the virtual environment based on the detected movement. The system then displays the captured video of the physical object, wherein the view of the physical background is replaced with a view of the virtual environment from the second position of the virtual camera.
Owner:ADEIA GUIDES INC

Video frame sharing output processing method and related device

The invention discloses a video frame sharing output processing method and a related device, and relates to the technical field of software, and the method comprises the steps: obtaining an original video frame collected by a camera; the original video frame is converted into a first target video frame according to the format configuration of the stream pushing end, the original video frame is converted into a second target video frame according to the format configuration of the virtual camera, and the stream pushing end and the virtual camera are pre-created with respective shared memories; and writing the first target video frame into a shared memory of the stream pushing end, and writing the second target video frame into a shared memory of the virtual camera. According to the method, the architecture design of single-source processing and multi-target distribution can be realized, repeated calculation is avoided, in addition, cross-process access can be supported, and the effect of isolated storage of double shared memories is achieved.
Owner:GUANGZHOU QIANJUN NETWORK TECH CO LTD

Method for avoiding virtual camera preemption and control system

The invention discloses a method for avoiding preemption of virtual cameras and a control system, and the method comprises the steps: enabling a camera to virtualize a plurality of virtual cameras, and enabling each virtual camera to correspond to an ID; the App requests to access the camera, and preempts the ID according to a preemption mechanism; and after the ID is preempted, establishing a communication connection relationship between the App and the camera. The system comprises a judgment module used for judging the priority of the App according to a preemption mechanism; the confirmation module is used for determining the applications existing in the high-priority application list as the high-priority applications; the cut-off module is used for generating a cut-off connection instruction, sending the cut-off connection instruction to the camera and cutting off the communication connection relationship between the App and the camera; and the connection module is used for generating a connection permission instruction and sending the connection permission instruction to the camera, so that the App and the camera establish a communication connection relationship. According to the method and the device, a plurality of virtual cameras are arranged, and different virtual cameras correspond to different priorities, so that crash of a certain APP is avoided, and smooth, stable and normal operation of the application is ensured.
Owner:RIVOTEK TECH (JIANGSU) CO LTD

Model data adaptation processing method and device for graphic rendering engine and storage medium

The invention relates to the technical field of computer graphics, and provides a model data adaptation processing method for a graphics rendering engine, which comprises the following steps of: importing and analyzing model files from different geometric modeling engines, and extracting original geometric data, original topological data and auxiliary information in the model files; converting the original geometric data into a unified standard geometric data structure for representation and storage; converting the original topological data into a standard topological data structure based on a boundary representation method for representation and storage; creating, analyzing or setting spatial position and direction information of the model entity and the virtual camera in a world coordinate system; analyzing material attributes, surface textures and animation information in the affiliated information of the model file, and packaging the materials, the surface textures and the animation information into corresponding standard data structures; and combining the standardized geometric data, topological data, coordinate system information and affiliated information into a complete standardized model data packet which can be directly used by a graphic rendering engine.
Owner:SHENZHEN POISSON SOFTWARE TECH CO LTD

Computer-Implemented Method For Generating Reverb In A Video Game Environment

Disclosed herein is a computer-implemented method for generating reverb on an audio signal in a video game environment during gameplay. The method comprises receiving data from a virtual camera arranged in the video game environment during gameplay. The method also comprises processing the virtual camera data to determine one or more features of the video game environment that influence the reverb on an audio signal within the video game environment. The method further comprises generating reverb on an audio signal based on the one or more features of the video game environment.
Owner:SONY COMP ENTERTAINMENT EURO LTD

Digital special effect simulation online preview platform

The invention discloses a digital special effect simulation online preview platform, which comprises a segmentation module, a splicing module and a special effect simulation system, the special effect simulation system comprises a simulation module, a special effect integration module and a special effect generation module, and the segmentation module is used for collecting historical existing special effect videos, extracting special effect images from the collected special effect videos and generating the special effect images; determining a segmentation position and a segmentation shape of the special effect image according to the position of the special effect element in the special effect image, and segmenting the special effect image to form sub-images; calculating sub-image segmentation values according to the sub-images; building a special effect simulation system according to the formed special effect elements; the method comprises the following steps: setting a virtual camera, shooting special effect elements by using the virtual camera, evaluating the special effect elements shot by the virtual camera, adjusting parameters of a virtual special effect according to an evaluation result, and selecting a corresponding segmentation method according to a segmentation position and a segmentation shape, so that the accuracy and efficiency of special effect segmentation are improved, and the accuracy and integrity of sub-images are ensured.
Owner:ZHENGZHOU MINGJIANG NETWORK TECH CO LTD