35 results about "Stereoscopic video" patented technology

The invention relates to the technical field of stereoscopic vision, and discloses a synchronous speed visual matching method and system, electronic equipment and a storage medium, and the method comprises the steps: synchronously collecting a stereoscopic video sequence with a predefined frame rate; executing multi-target hybrid tracking and motion induction detection, and outputting target motion information including position and velocity vectors; extracting hierarchical motion features of the target from continuous multiple frames of the stereoscopic video sequence, and performing unified space-time coding; under geometric constraints of stereoscopic vision, scale cosine similarity, direction similarity and trajectory consistency measurement are calculated and serve as observation evidences to be input into the probabilistic reasoning model for fusion, and a posterior probability representing matching reliability is output; the weight distribution of the speed similarity and the direction similarity is adjusted according to the motion characteristics of the targets in the scene, and the stable corresponding matching relation between the left view target and the right view target is established. According to the method, high-time-resolution information can be utilized, motion features and geometric constraints can be effectively fused, and the method has self-adaptive capacity.

Systems and methods are described for reducing thermal distortion in an optical display for use in a 3D stereoscopic video conferencing system. The thermal distortion can arise from operation of an array of LEDs in a back light unit of the display. Forming cut-outs in the display can interrupt the flow of heat to maintain geometric stability of precision cameras mounted to the display edges while also allowing sufficient heat dissipation paths for the LEDs. Structural reinforcement bars can be added, and an opaque film can be used to block light loss from the LEDs.

The invention discloses a stereoscopic video automatic separation and synchronization signal generation method and system based on an embedded identifier. A SyncMark synchronization mark is integrated on the basis of an original StereoMark scheme, stereo format description and synchronization parameters are embedded in a video coding layer at the same time through double SEI messages, and double backup is carried out on a container layer. And the playing end generates high-precision left and right frame synchronization signals according to the synchronization parameters, and outputs the high-precision left and right frame synchronization signals through interfaces such as HDMI VRR, DP Adaptive Sync and the like, so that the synchronization precision less than 1ms is realized. Adaptive network delay compensation and compatibility of multiple display devices are supported, and the 3D film watching experience is remarkably improved. The system is suitable for VR head-mounted display, vehicle-mounted 5D cabins, sports live broadcast and other scenes.

A model predicts the geometry of both visible and occluded traversable surfaces from input images. The model may be trained from stereo video sequences, using camera poses, per-frame depth, and semantic segmentation to form training data, which is used to supervise an image to image network. In various embodiments, the model is applied to a single RGB image depicting a scene to produce information describing traversable space of the scene that includes occluded traversable. The information describing traversable space can include a segmentation mask of traversable space (both visible and occluded) and non-traversable space and a depth map indicating an estimated depth to traversable surfaces corresponding to each pixel determined to correspond to traversable space.

The invention provides a video generation method and device, electronic equipment and a storage medium, and relates to the field of image processing, and the main technical characteristics comprise the following steps: responding to description information of a first image input by a user, carrying out semantic expansion on the description information, and generating a semantic description text containing a front and back depth-of-field relationship; generating a second image according to the first image and the semantic description text, and marking a key area corresponding to the description information in the second image; generating a dynamic video according to the second image; determining a pixel offset according to depth information of each frame in the dynamic video, and performing floating adjustment on a stereo parameter of the key area to generate a left-eye and right-eye parallax image; and generating a target video according to the left and right eye parallax image, thereby effectively improving the layering sense and stability of the 3D visual effect, meeting the stereoscopic visual experience requirement of a user, and highlighting the key point and spatial level of the stereoscopic video.

Systems and techniques are described herein for processing video data. For example, a machine-learning based stereo video coding system can obtain video data including at least a right-view image of a right view of a scene and a left-view image of a left view of the scene. The machine-learning based stereo video coding system can compress the right-view image and the left-view image in parallel to generate a latent representation of the right-view image and the left-view image. The right-view image and the left-view image can be compressed in parallel based on inter-view information between the right-view image and the left-view image, determined using one or more parallel autoencoders.

A method for creating a combined representative 3D and stereoscopic video output for use within robotic surgery. A 3D model 116 of a patient is first visualised by a user device 118 and therein can be

Some multi-view video compression solutions fail to reduce cross-camera redundancy, or they only work for stereo-video with two source inputs. To address this, an element-wise video management approach is used to compress single and multi-view video streams. A four-dimensional scenario is decomposed into a background model and one or more foreground object models. The models fully compress across three-dimensional spatial dimensions and cross-camera redundancy and can be transmitted to a decoder offline or stored locally with the decoder. A decoder can render video frames based on one or more camera poses and one or more foreground object poses, which compress across the time dimension and take extremely low transmission bandwidth. To improve reconstruction of the video frame, a compressed residual can be transmitted to the decoder. The decoder can use the compressed residual to remove artifacts in a reconstructed frame.

The invention discloses a video fusion ecological environment monitoring system, and relates to the technical field of ecological environment monitoring. The system comprises a data acquisition module, a three-dimensional space registration module, a space service publishing module, a video fusion display module and a database module. The data acquisition module selects a video monitoring camera and captures a real-time monitoring video stream; the three-dimensional space registration module completes the space registration of the monitoring video and the three-dimensional scene by using a registration tool and a plurality of algorithm models; the space service publishing module is fused with the three-dimensional live-action three-dimensional model to complete service publishing; the video fusion display module realizes query display of an ecological service three-dimensional fusion scene and a monitoring video; and the database module provides data storage support. According to the invention, the problems of video picture isolation and three-dimensional scene static state in traditional monitoring are solved, and more intuitive and stereoscopic video data are provided for ecological environment management decision.

The embodiment of the invention belongs to the video processing technology, and provides video processing equipment, terminal equipment and a video processing method, and the video processing equipment comprises a processor which is used for generating a three-dimensional space model of a scene according to an obtained image of the scene where the video processing equipment is located; receiving scene real-time pictures acquired by a plurality of acquisition sub-modules in the acquisition module, wherein different acquisition sub-modules are located at different positions of a scene; generating a single-point stereoscopic video corresponding to the acquisition sub-module based on the scene real-time picture and the stereoscopic space model; the single-point stereoscopic video is a video of a current scene observed from the position of the acquisition sub-module; and sending the target stereoscopic video set obtained based on the single-point stereoscopic video of the plurality of acquisition sub-modules to the terminal equipment, so that the terminal equipment adjusts the picture form of the displayed scene based on the target stereoscopic video set and the operation of the user when the user operates, so that the displayed scene picture presents a stereoscopic effect, the field substitution sense is improved, and the user experience is improved. And the user experience is improved.

This disclosure provides techniques and apparatuses for displaying stereoscopic video data associated with different viewing angles of a target surgical site. An example ophthalmic imaging apparatus includes a first camera head mounted in a first orbital position above a target surgical site associated with an eye of a patient, wherein the first camera head includes at least one stereoscopic lens set providing a first viewing angle of the target surgical site. Additionally, the ophthalmic imaging apparatus includes at least a second camera head mounted in a second orbital position above the target surgical site, wherein the second camera head includes at least one additional stereoscopic lens set providing a second viewing angle of the target surgical site different from the first viewing angle of the target surgical site.

The invention relates to the technical field of stereoscopic video signal processing and interactive television terminal energy efficiency management, and discloses an energy-saving interactive screen projection control system based on image perception, which is characterized in that a multi-channel load demand mapping unit analyzes an input signal flow into power demand space distribution of each node of a load network; the gradient threshold power isolation logic unit defines a power supply cut-off region according to the power gradient mutation characteristics; the distributed current injection regulator carries out truncation zero level operation on the load nodes in the cut-off region, and carries out time domain damping modulation on the non-cut-off region according to migration vector data. By constructing a differential power supply protocol of a physical level, the dynamic voltage stabilization precision of the core load nodes is ensured, and meanwhile, time domain damping modulation is carried out on the non-cut-off region according to the migration vector data. Redundant electric energy input of a low-demand background area is cut off, and the energy utilization efficiency of the interactive stereoscopic display system and the stability of video picture depth reconstruction are improved.

A method and apparatus for encoding stereoscopic video in patch-based atlas format in different length intra-periods is disclosed. A first atlas layout is constructed for a first sequence of 3D scenes. The number of 3D scenes in the sequence is chosen to fit the size of the GoP of the codec. A second sequence is iteratively built by appending the next 3D scene of the sequence when the number of patches of the layout constructed for the second sequence is less than or equal to the number of patches of the first layout. At the end of the iteration, one of the layouts is chosen to generate each atlas of the group. In this way, the size of the metadata is reduced and the compression is enhanced.

The mark-up apparatus includes a fiducial marking arrangement for being manually securely placed on a cable strain relief for visually distinctively marking the cable strain relief, a stereo camera for acquiring a live stereo video of an ultrasound scan probe scanning a patient's region of interest and a mark-up module for processing the live stereo video of the ultrasound scan probe scanning the patient's region of interest and overlaying navigation pointer mark-up(s) to the marked-up live video for instructing a human operator how to manipulate the ultrasound scan probe relative to the patient's region of interest.

According to an embodiment of the present disclosure, a method of generating a stereoscopic video includes: obtaining video data; extracting at least one multiple viewpoint video data from the video data; identifying an object associated with the video data; generating tracking information for the object based on the at least one multiple viewpoint video data; and performing rendering on the object based on a depth value corresponding to the tracking information.

A method for stereoscopic telestration in a 3D display system, and system therefore includes the steps of, and hardware for, aligning a telestration base plane to a reference object visible in a stereoscopic video stream; fusing a telestration overlay at the telestration base plane to ensure accurate depth alignment; and repositioning the telestration overlay to a moved telestration plane in front of or behind the telestration base plane by adjusting left and right eye overlays symmetrically. The repositioning may be performed without losing positional accuracy relative to the stereoscopic image stream.

The invention relates to a three-dimensional virtual simulation stereoscopic rendering video generation method and device, equipment and a medium, and aims to adapt to the eye distance or scene depth of a user by dynamically adjusting the distance between a left virtual camera assembly and a right virtual camera assembly, so that the visual comfort of a stereoscopic video is remarkably improved. And meanwhile, a high-precision picture synchronization technology is adopted, so that the picture time sequence consistency of the left and right virtual camera assemblies is ensured, the picture tearing and delay phenomena are avoided, and the immersion feeling is improved. Through path smooth interpolation and real-time adjustment technologies, a continuous and smooth camera motion track is generated, and creation flexibility is enhanced. In addition, the application of the parallax perception compression algorithm optimizes the code rate and the image quality of the video file, so that the video generation efficiency is higher and the file size is smaller. The introduction of the visual editing panel supports the user to adjust and preview the camera spacing, the mirror moving track and the compression parameters in real time, avoids frequent re-rendering, and significantly improves the working efficiency.

Various embodiments of an apparatus, methods, systems and computer program products described herein are directed to an Interaction Engine. According to various embodiments, Interaction Engine generates within a unified three-dimensional (3D) coordinate space, a virtual 3D medical model positioned according to a model pose. The Interaction Engine receives video data from a plurality of video sources. The Interaction Engine renders a first Augmented Reality (AR) display that includes concurrent display of the virtual 3D medical model and visualization of at least a portion of video data from a first video source. The Interaction Engine renders a second Augmented Reality (AR) display that includes concurrent display of the virtual 3D medical model and visualization of at least a portion of video data from a second video source.

Methods and systems for stereoscopic 3D video are described. Input HDR stereoscopic views in a first codeword representation are merged together by a first merging function to generate an input merged view to optimize a reshaping operation which generates a reshaped merged view in a second codeword representation and associated composer metadata. The reshaped merged view may be split and re-merged by a second frame packing function to optimize video encoding efficiency of an output coded bitstream based on the reshaped merged view. In a decoder, after extracting the reshaped merged view from the coded bitstream, a composer function applies the composer metadata to the decoded reshaped merge view to generate an output merged view in the first codeword representation. Then it generates output HDR stereoscopic views based on the output merged view.

To enable many persons to observe a stereoscopic image (including a stereoscopic moving image) in a specific space by a device with naked eyes "at the same time".SOLUTION: A large number of voxel elements capable of assuming several kinds of colors in a non-light emitting state in addition to a transparent state are three dimensionally connected and a stereoscopic image is displayed in the transparent connection space.SELECTED DRAWING: None

The invention discloses a high-speed stereo imaging method and device based on monocular pulse time domain modulation, and the method comprises the steps: introducing a periodic time domain modulation signal into a light path, and printing a unique time label for an image at a specific visual angle in a mixed light intensity signal; by means of the capturing capacity of the pulse camera for high-frequency modulation signals, mixed images which are originally difficult to separate in space can be effectively distinguished in the time domain, and therefore the advantages of being compact in hardware and free of geometric distortion of a monocular system are kept, high-frame-rate and high-precision stereoscopic video reconstruction is achieved at the same time, and the high-resolution and high-precision stereoscopic video reconstruction is achieved. And the technical blank in the field of high-speed monocular stereoscopic vision is effectively filled.

A system and method for navigation in complete darkness with thermal imaging and virtual-reality headset provide adjustable-base stereopsis and maintain long-range situational awareness. Such a system includes a multiple-aperture thermal imaging subsystem with non-collinear sensors with parallel optical axes and an image processing device, resulting in a significantly more accurate depth map than perceived with a normal human stereo acuity from a pair of raw thermal images. The stereo-video presented to the user is synthetic, allowing vantage point and stereo-base adjustment; it augments natural objects' texture with the generated one to allow a 3D perception of the negative obstacles and other horizontal features that do not provide stereo cues for the horizontal binocular vision. Additional wide-field-of-view thermal sensors may be used to compare current real-world views with the predicted from the earlier captured 3D data to communicate results to the user and supplement the 3D model with the structure-from-motion algorithm.

A stereoscopic video display device includes: an image display unit configured to display an image; an observer position detection unit configured to detect a position of a nearby observer; a rendering unit configured to form an image of a virtual object corresponding to the position of the observer detected by the observer position detection unit; a rotation unit configured to rotate the image display unit to a position facing the observer detected by the observer position detection unit; a background image obtainment unit configured to obtain an image of a background behind the image display unit; and an image composition processing unit configured to generate a composite image in which the image of the virtual object formed by the rendering unit is superimposed on the image of the background obtained by the background image obtainment unit, and display the composite image on the image display unit.

A surgical robotic system includes an image processing device configured to receive an endoscopic video feed and generate a stereoscopic video feed with confidence shading overlays on display. The confidence shading is based on a level of confidence associated with uncertain regions within images making up the stereoscopic video feed.

A method for stereoscopic telestration in a 3D display system, and system therefore includes the steps of, and hardware for, aligning a telestration base plane to a reference object visible in a stereoscopic video stream; fusing a telestration overlay at the telestration base plane to ensure accurate depth alignment; and repositioning the telestration overlay to a moved telestration plane in front of or behind the telestration base plane by adjusting left and right eye overlays symmetrically. The repositioning may be performed without losing positional accuracy relative to the stereoscopic image stream.

The application provides a stereo video compression method with double-branch attention, comprising the following steps: dividing a stereo video into a left video frame sequence and a right video frame sequence; inputting a video frame of the stereo video at time t, a time-adjacent reconstructed frame and a view-adjacent reconstructed frame of the video frame into a DAN stereo video compressor to obtain a video reconstructed frame at time t; wherein the DAN stereo video compressor comprises the following modules: a feature extraction module, a motion estimation module, a disparity estimation module, an LGEDB-based coding and decoding module, a motion compensation module, a disparity compensation module, a double-branch high-frequency information fusion module and an image reconstruction module; and the LGEDB and the DHFFM can realize higher-quality image reconstruction with the same or lower Bits Per Pixel (BPP).

Various implementations disclosed herein include devices, systems, and methods that incorporate enhanced metadata into spatial and / or mixed reality capture environments. For example, a process may include capturing an original video content recording that includes one or more frames depicting a first view provided by a head mounted device (HMD) at one or more instants in time. The process may further generate an adapted video content recording by adapting brightness of the one or more frames of the original video content recording to account for a difference between a first viewing condition associated with the first view and a second viewing condition associated with non-immersive viewing. The process may further generate metadata comprising information associated with the first viewing condition and the metadata may be associated with the adapted video content recording.

A minimally invasive surgical system is disclosed including a processor coupled to a stereoscopic endoscope and a stereoscopic video display device. The processor generates an operative image of an anatomic structure in the surgical site, overlays the operative image onto the captured stereo video images for display on the stereoscopic video display device, generates and overlays a pointer onto the operative image or the captured stereo video images to display the pointer on the stereoscopic video display device with a three dimensional appearance, and switches between a first mode for input devices of a surgeon console used to couple motion into surgical instruments and a second mode used to control an interactive graphical user interface to allow interactions with the pointer and the operative image in three dimensions using input devices having at least three degrees of freedom.

Embodiments disclose a real-time surgery method and apparatus for displaying a stereoscopic augmented view of a patient from a static or dynamic viewpoint of the surgeon, which employs real-time three-dimensional surface reconstruction for preoperative and intraoperative image registration. Stereoscopic cameras provide real-time images of the scene including the patient. A stereoscopic video display is used by the surgeon, who sees a graphical representation of the preoperative or intraoperative images blended with the video images in a stereoscopic manner through a see-through display.

Techniques are disclosed for addressing “stereoscopic window violations” in stereoscopic multimedia content. Stereoscopic window violations result in the stereoscopic effect becoming “broken” for the viewer and may occur, e.g., when the left and right stereo eye views in the stereoscopic content are mismatched. Stereoscopic mismatch often occurs at the edges of the left and right eye video image frames (wherein, e.g., a depicted shape may become cut off for a left eye view but not a corresponding right eye view). According to the techniques disclosed herein, rather than permanently masking or otherwise editing the stereoscopic video content to account for any window violations, accompanying stereoscopic window violation metadata information may be generated for the stereoscopic video, which may be used to define a particular geometry for each left and right eye video image frame pair, and used at playback time to crop, mask, or otherwise modify the video image frames.