7206results about "Steroscopic systems" patented technology

The invention provides a game cartoon character display method based on a virtual reality technology. The method comprises the following steps: acquiring three-dimensional model data of a game cartoon character in a target display area through a user interaction terminal; the virtual reality content management platform determines a dynamic rendering precision level according to the model data, and generates a real-time rendering strategy including a model patch reduction coefficient, a texture compression rate and a skeleton animation updating frequency in combination with terminal performance parameters; the strategy is sent to a virtual reality supervision platform and a user interaction terminal, and a virtual reality rendering engine platform is instructed to execute real-time rendering; and the virtual reality supervision platform monitors the frame rate fluctuation data of the head-mounted display device, calculates the scene rendering stability, sends a rendering optimization instruction if the scene rendering stability is lower than a threshold value, and adjusts the model data acquisition frequency and the video memory cleaning period to optimize the performance. The rendering efficiency and the system stability can be improved, and the hardware load and the frame rate fluctuation are reduced.

There is provided methods and apparatus of encoding / decoding a point cloud representing a physical object. Points are captured by a spinning sensors head and are represented by sensor indices associated with sensors that captured the points, azimuthal angles representing capture angles of said sensors, and radius values of spherical coordinates of the point. Points are ordered based order indices obtained from the azimuthal angles and the sensor indices. Order index differences are encoded. An order index difference represents a difference between order indices associated with two consecutive ordered points. Optionally, the method encodes radius values, residual azimuthal angles associated with ordered points and residuals of three-dimensional cartesian coordinates of ordered points based on their three-dimensional cartesian coordinates, decoded azimuthal angles based on azimuthal angles, decoded radius values and sensor indices.

The invention relates to the technical field of vision, in particular to an object monitoring method based on a multi-camera joint calibration technology and a monitoring camera thereof. The method comprises the following steps: driving all cameras to synchronously shoot a calibration reference object with known geometric characteristics, and solving internal and external parameters of each camera and an accurate space pose relationship between the internal and external parameters by utilizing shot images to form a joint space relationship chain; controlling the camera array to synchronously shoot a target object, and correspondingly converting the two-dimensional image points acquired by the cameras into spatial point coordinates in a unified three-dimensional coordinate system by using the joint spatial relation chain to generate three-dimensional point cloud data of the target object; and processing the generated three-dimensional point cloud data, extracting key geometric features of the target object in real time, performing comparative analysis on the extracted features and a preset standard or a historical state, and outputting a state monitoring result of the target object. According to the invention, the influence of temperature drift and mechanical vibration on the measurement precision is effectively suppressed, and the stability of long-term monitoring of an industrial field is guaranteed.

The invention relates to the technical field of equipment operation and maintenance, can be applied to business scenes of financial science and technology, medical health and the like, and discloses a multi-terminal scene synchronization control method, which comprises the following steps: a control terminal receives current virtual scene position and current virtual scene view angle information sent when a user terminal starts a virtual scene, and generates a synchronization preview picture based on the information; the control terminal triggers an anti-control mode and sends an operation authority forbidding instruction to the user terminal, and the user terminal forbids an operation input signal acquisition function after receiving the instruction; and the control terminal sets a target virtual scene position and a target virtual scene view angle parameter of the user terminal through the interactive interface, generates a rendering execution instruction based on the target parameter, and controls the user terminal to load the instruction to complete virtual scene rendering. The target virtual scene position and the view angle parameter of the user terminal are set at the control end, dynamic guidance and picture control of the control end on the user terminal are achieved, and view angle conflicts are avoided in cooperation with an operation authority forbidding mechanism.

The invention discloses a naked-eye 3D display optimization method based on real-time eyeball tracking, and particularly relates to the technical field of naked-eye 3D display, and the method comprises the steps: capturing eyeball movement data in real time through a visual angle tracking sensor, and collecting illumination information in combination with an ambient light sensor; depth perception parameters are calculated based on pupil diameter variation and frequency, and a time sequence prediction type dynamic compensation coefficient is generated in combination with eyeball movement acceleration; acquiring an initial fixation point coordinate by using an improved spherical projection mapping model, and performing compensation coefficient correction to obtain a real-time coordinate; and finally, according to the real-time coordinates, dynamically adjusting the refractive index distribution of the nanostructure layer, the rotation angle of the polarizer, the focal length of the optical lens and other optical modulation parameters. The real-time distance is calculated through the binocular parallax algorithm, the depth mapping value is generated by combining the focal length of the camera and the baseline distance, the method can adapt to the illumination change and the user view angle, and the 3D display effect is optimized.

Methods and apparatus for generative rendering. In some embodiments, an input visual content is operated on by a computational to perform a computer vision function and output generative display content. The generative display content may overlay the input content to be shown on a display system. In some embodiments, the generative display content replaces the video input stream for display.

The embodiment of the invention discloses a naked eye three-dimensional interaction method and device and computer equipment. The method comprises the following steps: determining at least one three-dimensional virtual object corresponding to a target preset naked eye three-dimensional interaction scene, and determining an initial display parameter corresponding to the at least one three-dimensional virtual object; controlling the at least one three-dimensional virtual object to perform motion display in the target preset naked-eye three-dimensional interaction scene according to the initial display parameter so as to generate a naked-eye three-dimensional picture corresponding to the at least one three-dimensional virtual object; obtaining interaction feedback information generated when the user interacts with the at least one three-dimensional virtual object according to the naked eye three-dimensional picture; and according to the interaction feedback information, generating an update display parameter corresponding to the at least one three-dimensional virtual object, and based on the update display parameter, controlling the at least one three-dimensional virtual object to perform motion update display in the naked eye three-dimensional picture. Therefore, a user watches and interacts with the three-dimensional virtual object which is movably displayed in the naked-eye three-dimensional picture, the sight distance can be improved and adjusted, and asthenopia can be relieved.

The invention discloses a naked-eye 3D display system based on a light field reconstruction algorithm, particularly relates to the technical field of naked-eye 3D, and comprises a controlled scattering medium light field acquisition environment, scattering feature enhanced light field data analysis, a hierarchical depth optimization engine and dynamic wavefront modulation display control. According to the invention, through the controlled scattering medium environment design, a scattering signal which is regarded as interference in the traditional technology is converted into a depth characteristic carrier, the data acquisition quality in a complex optical environment is obviously improved, richer and more reliable basic data are provided for light field reconstruction, and the data acquisition efficiency is improved. An innovative hierarchical deep optimization engine is combined with a multi-scale confidence evaluation and discontinuous region processing method, so that the problem of edge blur in a shielding boundary and a geometric structure complex scene is effectively solved, and the geometric consistency and detail fidelity of a reconstructed light field are greatly improved.

The invention relates to the technical field of projectors, in particular to an intelligent picture geometric distortion control method based on machine vision and an image projector, and the method comprises the steps: obtaining image data of a to-be-corrected projection picture, and carrying out the feature analysis of the image data, so as to obtain a distortion feature value; matching a correction optimization model corresponding to the distortion characteristic value, so as to call a correction parameter from a preset correction parameter library through the correction optimization model; simulating a correction process corresponding to the projection picture to be corrected according to the correction parameter; the correction parameters are adjusted according to the correction process, and the projection picture to be corrected is corrected according to the adjusted correction parameters, the corresponding correction optimization model is matched based on the characteristic values, the adaptive correction parameters can be dynamically called from the preset parameter library, the limitation of a traditional fixed algorithm is changed, and the correction efficiency is improved. The correction strategy is highly coupled with the actual distortion scene, and the correction efficiency and pertinence are remarkably improved.

The invention relates to a three-dimensional model compression transmission method and system based on dynamic feature perception, and relates to the technical field of three-dimensional live-action modeling, and the method comprises the steps: obtaining the original three-dimensional data of a three-dimensional model, carrying out the multi-modal feature extraction based on a model scene, dividing a key region, a transition region and a non-key region, and generating a three-dimensional model partition map, compressing each region according to the partition map label and a preset compression algorithm to generate a multi-resolution LOD sequence, determining a transmission data hierarchy in combination with a network state and equipment parameters, and finally rendering the model according to the transmission data hierarchy, user behavior information and an environment state to obtain a target three-dimensional model. The technical effects of effectively compressing, transmitting and rendering the three-dimensional model according to various factors such as different area characteristics, network states, equipment parameters and user behaviors of the model and improving the transmission efficiency and the rendering quality are achieved.

The invention discloses a method and system for generating a visual special effect video, and relates to the technical field of video generation, and the method comprises the steps: carrying out the collection and preprocessing of multi-modal data, synchronously collecting an RGB video, a depth map and environment illumination data, and generating a registered 3D point cloud; carrying out time-space domain combined motion compensation image matting, and extracting a moving object Alpha mask; by means of edge purification of self-adaptive illumination separation, illumination pollution and edge color overflow of a green screen scene are eliminated; the multi-scale transparency estimation network outputs a transparency graph; dynamic special effect synthesis and output guarantee video fluency; and the special effect video is intelligently recommended, and a self-adaptive output strategy is realized. The image matting and edge processing precision is improved, the transparency estimation and special effect synthesis effect is enhanced, intelligent recommendation and resource optimization are realized, and the defects in dynamic scene processing in the prior art are overcome.

An image pickup apparatus includes an image sensor having a plurality of pixels configured to receive light beams passing through a plurality of different pupil partial areas in an imaging optical system including a first optical system and a second optical system arranged in parallel with the first optical system, and a processor configured to acquire, based on a pair of signals from the plurality of pixels, a first defocus amount in a first focus detecting area at a first image height based on a first optical axis of the first optical system and a second defocus amount in a second focus detecting area at a second image height based on a second optical axis of the second optical system, and control the imaging optical system based on an average defocus amount of the first defocus amount and the second defocus amount.

Disclosed are methods and apparatuses for decoding an image. A method includes receiving a bitstream obtained by encoding the image; dividing a first coding block into a plurality of second coding blocks; generating a prediction block of a second coding block based on syntax information obtained from the bitstream; and reconstructing the second coding block based on the prediction block and a residual block of the second coding block, the residual block being obtained by performing a dequantization and an inverse-transform on quantized transform coefficients from the bitstream. The first coding block has a recursive division structure. The first coding block is divided based on at least one of a quad tree division, a binary tree division or a triple tree division.

The invention relates to the technical field of industrial internet of things operation and maintenance, and particularly provides a remote maintenance auxiliary method integrating video monitoring and three-dimensional modeling. The method comprises the following steps: acquiring engineering graphic data and point cloud scanning data of maintenance equipment, and collecting video stream data of a maintenance equipment site; the video stream data is used for describing the operation state of maintenance equipment; the video stream data comprises a plurality of video frames; matching the point cloud scanning data with the engineering graphic data, and constructing a watertight three-dimensional grid model according to a matching result; mapping texture features of the maintenance equipment in a target video frame to the surface of the watertight three-dimensional grid model to obtain a target three-dimensional model; and receiving a first maintenance instruction marked in the target three-dimensional model by a remote expert, and sending the first maintenance instruction to a video picture of a client of an on-site maintainer. According to the technical scheme provided by the invention, the time consumption for positioning the overhaul part can be reduced.

Embodiments of the present application disclose a four-dimensional scene reconstruction method and apparatus, and an electronic device. A specific implementation of the method includes: obtaining a multi-view video, where the multi-view video includes multi-view images, which include a video frame at an initial moment in the multi-view video; generating a three-dimensional scene model corresponding to the multi-view images; determining a deformable network corresponding to the multi-view video based on the three-dimensional scene model, the multi-view video, and camera pose information corresponding to the multi-view video; and determining a four-dimensional scene model corresponding to the multi-view video based on the three-dimensional scene model and the deformable network.

The invention discloses a spatio-temporal data compression method and system based on lightweight processing, and relates to the technical field of image data processing, and the method comprises the steps: based on spatio-temporal data to be compressed, establishing standardized data entries, forming a window set through time axis segmentation, carrying out the periodic discrimination of windows according to the frequency domain energy distribution, and constructing spatio-temporal blocks, establishing an error control parameter table based on the global error budget; generating a time coding stream, performing integerization on the three-dimensional coordinates and the attribute values, generating a space coding stream through double difference and run length coding, performing edge folding lightweight and texture compression on the grid data, and generating a joint coding result; and based on a joint coding result, dividing the compressed data into a base layer and a plurality of enhancement layers, and establishing a relevance hierarchical storage structure and a block-level index table to generate the compressed data capable of being transmitted in a streaming manner. According to the method, collaborative compression can be carried out by utilizing spatial-temporal data internal relevance.

The invention discloses an AR glasses blogger live video anti-shake processing method and processing system, and the method specifically comprises the steps: carrying out the calculation based on an original video stream and equipment motion data, and generating a preliminary stable frame sequence; based on the preliminary stable frame sequence, marking a key semantic region as a strong stability demand region, and segmenting a foreground main body and a background region; performing fine stabilization on the strong stability demand area and the foreground main body by applying non-rigid transformation, performing stabilization on the background area by applying rigid transformation and retaining the depth of the scene, and obtaining a frame sequence after partition correction; predicting a future multi-frame equipment motion track based on the frame sequence after partition correction, the equipment motion data and the segmentation information of the foreground main body / background region; and calculating and executing prospective canvas motion compensation in advance based on the future multi-frame equipment motion trail and the segmentation information of the foreground main body / background region. According to the invention, efficient anti-shake processing of the live video of the AR glasses is realized, and the stability of the live picture and the user experience are effectively improved.

A viewpoint setting unit of an image data generation device sets a reference viewpoint on a basis of position and orientation information regarding a head-mounted display, and a reference image drawing unit generates a reference image in a field of view corresponding to the reference viewpoint. An additional data generation unit acquires color information regarding an occluded part not represented in the reference image from a different viewpoint as additional sampling data. A reprojection unit of the head-mounted display transforms the reference image into an image from a latest viewpoint and determines a pixel value of the hidden part using the additional sampling data.

A method for decoding an image includes receiving information on image partitioning for the image included in a bitstream; obtaining a plurality of image partitions included in the image based on the information on image partitioning; and decoding the plurality of image partitions. Each image partition comprises a plurality of default encoding parts, each default encoding part is selected from a plurality of candidate default encoding parts, each candidate default encoding part is composed of one or more encoding sub-units. The bitstream includes information on rotation of the image.

The invention discloses a real-time data stream processing method for multi-device collaborative management of a dome cinema, which relates to the technical field of cinema device data management, and comprises the following steps of: establishing communication connection between a central management node and a plurality of playing devices, collecting device identifiers, projection area numbers and geometric position parameters of the playing devices, and establishing a central management node; generating an equipment mapping relation table; realizing local clock correction of the playing equipment based on a unified time synchronization protocol; the central management node generates a control instruction stream according to the equipment mapping relation and the playing content, the instruction stream comprises space frame distribution information and fusion control parameters, and the space frame distribution information and the fusion control parameters are distributed to the playing equipment through communication channel numbers; and the playing device completes image geometric transformation and edge fusion processing according to the received control instruction and then executes synchronous playing. According to the invention, multi-device automatic mapping is realized, the time synchronization precision is improved, the image playing is coordinated and consistent, and the collaborative display capability and the playing stability of the dome cinema are improved.

A multi-modal stereo vision system includes one or more stereo vision units. Each stereo vision unit includes a plurality of stereo camera pairs. Each image pair includes a first image and a second image. The plurality of stereo camera pairs can capture multi-modal image data.

A method for decoding a 360-degree image includes: receiving a bitstream obtained by encoding a 360-degree image; generating a prediction image by making reference to syntax information obtained from the received bitstream; combining the generated prediction image with a residual image obtained by dequantizing and inverse-transforming the bitstream, so as to obtain a decoded image; and reconstructing the decoded image into a 360-degree image according to a projection format. Here, generating the prediction image includes: checking, from the syntax information, prediction mode accuracy for a current block to be decoded; determining whether the checked prediction mode accuracy corresponds to most probable mode (MPM) information obtained from the syntax information; and when the checked prediction mode accuracy does not correspond to the MPM information, reconfiguring the MPM information according to the prediction mode accuracy for the current block.

The invention provides an LED spherical screen video image coordinate generation method and system, a medium, a program product and a terminal, and the method comprises the steps: obtaining a configuration file of an LED spherical screen, and carrying out the analysis, so as to obtain the spatial geometric parameters of the LED spherical screen; obtaining a to-be-displayed video image of the LED spherical screen, and analyzing and screening the to-be-displayed video image to obtain an effective pixel data set; and calculating latitude and longitude coordinates corresponding to the pixel coordinates of the to-be-displayed video image by adopting a nonlinear mapping method based on the spatial geometric parameters of the LED spherical screen and the effective pixel data set of the to-be-displayed video image. By preloading spatial geometric parameters of a sphere, image pixels are dynamically analyzed, and efficient and accurate conversion from pixel coordinates to latitude and longitude coordinates is realized by adopting a nonlinear mapping algorithm. Meanwhile, the batch writing optimization and dynamic buffer management technology is adopted, the processing speed and the system operation stability are remarkably improved, and the method can be widely applied to the fields of LED spherical screen content manufacturing, display correction and the like.

Electronic equipment for displaying a floating image, according to an embodiment, comprises: a display configured to display the floating image to be floated and spaced apart in an upward direction; and a 3D plate having the display arranged in an inner area thereof, and configured to display the floating image in an inclined state in an upper area thereof, wherein an active area of the display is configured to be larger than a floating area in which the floating image is displayed. The electronic equipment may further comprise a camera which is arranged in an inner plate in the inner area and configured to track the gaze of a user present outside the 3D plate.

The invention relates to a naked eye 3D binocular image acquisition and real-time processing system based on hardware synchronous triggering, and belongs to the technical field of image processing and three-dimensional display. According to the system, a hardware synchronous triggering mechanism is adopted, a time sequence synchronous control unit is used for sending a synchronous pulse signal to a binocular image sensor, and strict synchronization of left and right viewpoint image acquisition is ensured. The image signal processing unit processes collected original data, the stereo parallax correction module performs epipolar correction, and the sub-pixel interleaving module generates a composite view frame according to grating parameters of the display terminal. The system realizes high-speed data transmission through a double-buffer direct memory access DMA mechanism. The problems of visual tearing and weak stereoscopic impression caused by asynchronous binocular image acquisition in the prior art are solved, nanosecond-level synchronization precision is realized, optical crosstalk is reduced, and smoothness and comfort of stereoscopic display are ensured.

Disclosed are methods and apparatuses for decoding an image. A method includes receiving a bitstream obtained by encoding the image; dividing a first coding block into a plurality of second coding blocks; generating a prediction block of a second coding block based on syntax information obtained from the bitstream; and reconstructing the second coding block based on the prediction block and a residual block of the second coding block, the residual block being obtained by performing a dequantization and an inverse-transform on quantized transform coefficients from the bitstream. The first coding block has a recursive division structure. The first coding block is divided based on at least one of a quad tree division, a binary tree division or a triple tree division.

The embodiment of the invention discloses a naked eye three-dimensional image display method and device, computer equipment and a storage medium. The method comprises the following steps: acquiring a plurality of three-dimensional virtual sub-objects and initial display parameters corresponding to the plurality of three-dimensional virtual sub-objects in a target naked-eye three-dimensional scene, wherein the plurality of three-dimensional virtual sub-objects have a logic association relationship; displaying initial naked-eye three-dimensional pictures corresponding to the plurality of three-dimensional virtual sub-objects in the naked-eye three-dimensional display screen according to the initial display parameters; generating space display parameters of the plurality of three-dimensional virtual sub-objects according to the logic association relationship; and dynamically adjusting the three-dimensional space positions of at least part of the three-dimensional virtual sub-objects in the plurality of three-dimensional virtual sub-objects according to the space display parameters so as to update the initial naked-eye three-dimensional picture to obtain a target naked-eye three-dimensional picture. In this way, the spatial display parameters are generated through the logic incidence relation to adjust the three-dimensional space position of the three-dimensional virtual sub-object, and simulation stimulation of the human brain in the three-dimensional space can be achieved when the human eyes watch the three-dimensional virtual sub-object.

The embodiment of the invention provides a real-time 2D-3D conversion method, device, product and system. The method comprises the following steps: acquiring a 2D video stream to be converted, wherein the 2D video stream comprises a plurality of 2D frames; and asynchronously and concurrently executing the following steps of depth reasoning and 3D rendering on the plurality of 2D frames: performing depth reasoning on the 2D frames by using a depth reasoning model to obtain a corresponding depth map; performing 3D rendering on the 2D frame based on the obtained depth map to obtain a 3D frame corresponding to the 2D frame; and outputting the obtained 3D frame in real time. Depth reasoning of the 2D frames and the 3D rendering process are decoupled, asynchronous parallel execution of depth calculation of the multiple 2D frames in the 2D video stream and the 3D rendering process is achieved, the end-to-end delay of converting the 2D video into the 3D video is greatly shortened, and the real-time performance of converting the 2D video into the 3D video is improved.