13264results about "Steroscopic systems" patented technology

Some examples of the disclosure are directed to systems and methods for facilitating display of content and avatars in a multi-communication session including a first electronic device and a second electronic device. In some examples, the first electronic device presents a computer-generated environment including an avatar corresponding to a user of the second electronic device and a first object, wherein the computer-generated environment is presented based on a first set of display parameters satisfying a first set of criteria, including a spatial parameter for the user of the second electronic device, a spatial parameter for the first object, and a display mode parameter for the first object. In response to detecting a change in one or more of the first set of display parameters, the first electronic device updates presentation of the computer-generated environment in accordance with the one or more changes of the first set of display parameters.

In some embodiments, a computer system displays media playback controls at a position based on an arrangement between a user and media content. In some embodiments, a computer system displays captions concurrently with media content at a position based on a spatial arrangement between the computer system and a reference point corresponding to the media content. In some embodiments, a computer system changes the spatial arrangement between captions and the viewpoint of the user based on user input.

In some embodiments, a computer system displays a caption for a media item at different depths depending on the depth of the portion of the media item over which the caption is displayed. In some embodiments, a computer system displays a user interface element that includes information associated with the media item at different locations relative to the media item depending on attention of the user. In some embodiments, a computer system displays a user interface element that includes information associated with the media item with different visual appearances depending on visual characteristics of the portion of the media item over which the user interface element is displayed.

Disclosed is a method for constructing a bionic binocular active visual simultaneous localization and mapping (SLAM) system. The method includes: S1, constructing a binocular active visual system, peripheral vision is simulated using a panoramic camera, a panoramic value map is constructed based on the panoramic camera, and a binocular bionic eye gaze control strategy based on the panoramic value map is proposed; S2, designing a SLAM algorithm framework which is suitable for motion of the two bionic eyes, where relative pose optimization of left and right cameras based on a Perspective-n-Point algorithm and depth calculation for binocular matching points based on triangulation are adopted in a SLAM tracking thread; and S3, with the assistance of camera poses estimated by the SLAM system and sparse landmark point coordinates, training a self-supervised depth estimation network, to provide dense depth estimation for a mapping module of the SLAM system, achieving dense mapping.

An illustrative method may include receiving images of a site captured at a same time by a camera, the images comprising a single visible color component image, a first non-visible image associated with first excitation illumination having a first wavelength outside a visible spectrum, and a second non-visible image associated with second excitation illumination having a second wavelength outside the visible spectrum and different than the first wavelength; generating, based on the single visible color component image, a monochromatic image; generating, based on the single visible color component image and the first non-visible image, a first alternate image representative of a first alternate imaging characteristic of the site; generating, based on the single visible color component image and the second non-visible image, a second alternate image representative of a second alternate imaging characteristic of the site; and displaying the monochromatic image combined with the first and second alternate images.

An illustrative system may include a stereoscopic imaging device comprising: a first image sensor having a first pixel array and configured to provide a first windowed output comprising first image information associated with pixels included within a first window of the first pixel array, the first window having a first position; and a second image sensor having a second pixel array and configured to provide a second windowed output comprising second image information associated with pixels included within a second window of the second pixel array, the second window having a second position; and an imaging control system that may be configured to: determine a working distance between a target surface within a scene and the stereoscopic imaging device; and adjust one or more of the first position of the first window within the first pixel array or the second position of the second window within the second pixel array.

Systems and methods for generating and providing a virtual walkthrough interface can include generating a virtual walkthrough video based on view synthesis renderings generated by neural radiance field model. The neural radiance field model can be trained based on a plurality of images of an environment and may generate the view synthesis renderings based on processing positions along a determined walkthrough path. The generated virtual walkthrough video can then be scrubbed through to provide the virtual walkthrough interface.

The present disclosure generally relates to user interfaces. In some examples, the electronic device transitions between user interfaces for capturing photos based on data received from a first camera and a second camera. In some examples, the electronic device provides enhanced zooming capabilities that result in visual pleasing results for a displayed digital viewfinder and for captured videos. In some examples, the electronic device provides user interfaces for transitioning a digital viewfinder between a first camera with an applied digital zoom to a second camera with no digital zoom. In some examples, the electronic device prepares to capture media at various magnification levels. In some examples, the electronic device enhanced capabilities for navigating through a plurality of values.

The invention relates to a multi-defense-area intelligent linkage alarm method based on an AIoT gateway and related equipment, and the method comprises the following steps: fusing the environment data of an Internet of Things sensor of a plurality of defense areas with a video image stream to generate three-dimensional reconstruction data of a defense area scene; and monitoring and analyzing the data, and extracting an environment feature sequence and a trajectory analysis sequence. And when it is detected that the threat levels of the multiple defense areas exceed a threshold value, causal inference is carried out in combination with gateway historical alarm data, and a cross-defense-area association event chain is generated. According to the method and the system, the AIoT gateway is used as a core, then a cooperative response strategy preset by the AIoT gateway is matched, and the SP voice call module is linked through a 4G / 5G network, so that multi-channel alarm pushing is realized, and the technical problem that comprehensive understanding and dynamic modeling of a defense area scene are difficult to form due to the lack of deep fusion and cooperative analysis means between video image data and environment sensor data is solved.

Systems and techniques are described for performing foveated sensing. In some aspects, a method (e.g., implemented by an image sensor) can include capturing sensor data for a frame associated with a scene, obtaining information corresponding to a region of interest (ROI) associated with the scene, generating a first portion (having a first resolution) of the frame corresponding to the ROI, generating a second portion of the frame having a second resolution, and outputting (e.g., to an image signal processor (ISP)) the first portion and the second portion. In some aspects, a method (e.g., implemented by an ISP) can receive, from an image sensor, sensor data for a frame associated with a scene, generating a first version (having a first resolution) of the frame based on an ROI associated with the scene, and generating a second version of the frame having a second resolution (lower than the first resolution).

Methods, apparatus, devices, subsystems, and systems for holographically displaying three-dimensional objects are provided. In one aspect, a system includes a display and a controller. The display includes: a backplane having a plurality of circuits and a plurality of display elements arranged on the backplane. The plurality of display elements form an irregular pattern. Each of the plurality of display elements is coupled to a respective circuit of the plurality of circuits. The controller is coupled to the display and configured to transmit at least one control signal to at least one display element of the display for modulating at least one property of the at least one display element.

The present disclosure relates to a method and an apparatus of generating a surround view monitoring (SVM) image. The method includes: obtaining installation information of an actual camera installed on a ship; setting a virtual camera to orient toward a ground plane perpendicularly within a world coordinate system; calculating a conversion relationship between the virtual camera and the actual camera, based on the installation information of the actual camera; generating the SVM image based on the calculated conversion relationship; and controlling the ship based on the generated SVM image.

An illustrative point cloud segmentation system generates an instance-wise semantic mask for a particular source image of a set of source images that has been used to construct a 3D point cloud representing a scene that includes one or more objects. The point cloud segmentation system maps a set of 3D points from the 3D point cloud to corresponding 2D points of the particular source image, then labels, based on contours defined by the instance-wise semantic mask to demarcate the one or more objects, the mapped set of 3D points in accordance with where the corresponding 2D point for each mapped 3D point is positioned with respect to the contours. Based on the labeling of the mapped 3D points, the point cloud segmentation system produces a segmented 3D point cloud including an instance-wise segmentation of the one or more objects at the scene. Corresponding methods and systems are also disclosed.

Provided in the present invention are an interaction and generation method for obtaining a three-dimensional model by means of photographing, a method for obtaining a picture by means of a three-dimensional model, and a part machining and manufacturing method. The interaction and generation method comprises: a user using a terminal to capture scene information, wherein the scene information can be an outdoor or indoor scene, the terminal can be a smart phone, an AR / VR device or other smart terminals having a photographic function, and the captured scene information is RGB and / or RGBD (including depth) information; and sending an RGB image and / or RGBD image I to a monocular three-dimensional reconstruction algorithm, so as to obtain a corresponding three-dimensional model, which can be displayed on an interaction interface and superimposed with a real scene, or can be displayed on a single page.

The present disclosure provides devices, systems, and methods for capturing and analyzing behavioral and physiological data of subjects for treatment, modification, and manipulation discovery. In some embodiments, a method for classifying a drug is provided. The method includes obtaining observational data concerning an animal subject to which the drug is administered, the observational data acquired using an enclosure for the animal subject, the enclosure instrumented with at least one sensing device. The method also includes extracting features by applying the observational data to a machine-learning feature-extraction component. The method further includes predicting a class label of the drug by applying the features to a machine-learning classifier component, the machine-learning classifier component trained to predict the class label of the drug from, at least in part, the features. The method further includes providing an indication of the class label.

The invention provides a game cartoon character display method based on a virtual reality technology. The method comprises the following steps: acquiring three-dimensional model data of a game cartoon character in a target display area through a user interaction terminal; the virtual reality content management platform determines a dynamic rendering precision level according to the model data, and generates a real-time rendering strategy including a model patch reduction coefficient, a texture compression rate and a skeleton animation updating frequency in combination with terminal performance parameters; the strategy is sent to a virtual reality supervision platform and a user interaction terminal, and a virtual reality rendering engine platform is instructed to execute real-time rendering; and the virtual reality supervision platform monitors the frame rate fluctuation data of the head-mounted display device, calculates the scene rendering stability, sends a rendering optimization instruction if the scene rendering stability is lower than a threshold value, and adjusts the model data acquisition frequency and the video memory cleaning period to optimize the performance. The rendering efficiency and the system stability can be improved, and the hardware load and the frame rate fluctuation are reduced.

The invention discloses an intelligent head-mounted device with a camera capable of rotating along with the camera, and the device comprises an eye movement tracking camera which is used for collecting and measuring the image data of the iris of the two eyes of a wearer; the IMU sensor is used for detecting head movement data of a wearer; the image acquisition and processing module is used for generating eyeball movement data according to the image data of the iris of the two eyes, and converting the eyeball movement data and the head movement data into a rotation instruction; the binocular camera motion control device executes the rotation instruction, drives the binocular camera to move, moves along with the iris and the eyeball, and collects image data in real time to realize line-of-sight tracking; and the image acquisition and processing module is also used for carrying out image and / or video fusion processing according to the received image acquired by the binocular camera in combination with the head movement data and the eyeball movement data. According to the invention, the problem of limitation in the aspects of acquiring depth information and expanding the visual field can be solved, and a more flexible camera tracking and adjusting mechanism is designed, so that wider and clearer image acquisition is realized.

The disclosure relates to a data processing method and a related device for point cloud media. The method includes: obtaining a media file of point cloud media, the media file comprising a point cloud bitstream and cross-attribute dependency indication information of the point cloud media, and the cross-attribute dependency indication information being for indicating an encoding and decoding dependency relationship between attribute data in the point cloud bitstream; and decoding the point cloud bitstream based on the cross-attribute dependency indication information to present the point cloud media.

A request signal that indicates a quality for a determination of an orientation of a road user is received. The orientation of the road user is determined based on a) image data when the request signal indicates the quality is below a predetermined quality for the determination of the orientation of the road user, or b) on LIDAR data and image data when the request signal indicates the quality is the predetermined quality.

There is provided methods and apparatus of encoding / decoding a point cloud representing a physical object. Points are captured by a spinning sensors head and are represented by sensor indices associated with sensors that captured the points, azimuthal angles representing capture angles of said sensors, and radius values of spherical coordinates of the point. Points are ordered based order indices obtained from the azimuthal angles and the sensor indices. Order index differences are encoded. An order index difference represents a difference between order indices associated with two consecutive ordered points. Optionally, the method encodes radius values, residual azimuthal angles associated with ordered points and residuals of three-dimensional cartesian coordinates of ordered points based on their three-dimensional cartesian coordinates, decoded azimuthal angles based on azimuthal angles, decoded radius values and sensor indices.

The invention relates to the technical field of vision, in particular to an object monitoring method based on a multi-camera joint calibration technology and a monitoring camera thereof. The method comprises the following steps: driving all cameras to synchronously shoot a calibration reference object with known geometric characteristics, and solving internal and external parameters of each camera and an accurate space pose relationship between the internal and external parameters by utilizing shot images to form a joint space relationship chain; controlling the camera array to synchronously shoot a target object, and correspondingly converting the two-dimensional image points acquired by the cameras into spatial point coordinates in a unified three-dimensional coordinate system by using the joint spatial relation chain to generate three-dimensional point cloud data of the target object; and processing the generated three-dimensional point cloud data, extracting key geometric features of the target object in real time, performing comparative analysis on the extracted features and a preset standard or a historical state, and outputting a state monitoring result of the target object. According to the invention, the influence of temperature drift and mechanical vibration on the measurement precision is effectively suppressed, and the stability of long-term monitoring of an industrial field is guaranteed.

The invention relates to the technical field of equipment operation and maintenance, can be applied to business scenes of financial science and technology, medical health and the like, and discloses a multi-terminal scene synchronization control method, which comprises the following steps: a control terminal receives current virtual scene position and current virtual scene view angle information sent when a user terminal starts a virtual scene, and generates a synchronization preview picture based on the information; the control terminal triggers an anti-control mode and sends an operation authority forbidding instruction to the user terminal, and the user terminal forbids an operation input signal acquisition function after receiving the instruction; and the control terminal sets a target virtual scene position and a target virtual scene view angle parameter of the user terminal through the interactive interface, generates a rendering execution instruction based on the target parameter, and controls the user terminal to load the instruction to complete virtual scene rendering. The target virtual scene position and the view angle parameter of the user terminal are set at the control end, dynamic guidance and picture control of the control end on the user terminal are achieved, and view angle conflicts are avoided in cooperation with an operation authority forbidding mechanism.

According to the panoramic interaction display method and system based on AI multi-modal fusion provided by the invention, efficient and accurate multi-modal fusion is realized by integrating the visual and audio information of the current panoramic material and combining multiple pieces of panoramic interaction hotspot information, a panoramic interaction model with rich interactivity is generated, and the interaction effect of the panoramic interaction model is improved. And hotspot interaction space features are further extracted, so that panoramic display can automatically adjust a visual angle according to a user demand or a preset situation and trigger a corresponding commentary audio or interaction animation, immersion and interactivity of panoramic display are remarkably improved, user experience is optimized, seamless connection of audio playing and user interaction operation is realized, and user experience is improved. Therefore, the dynamic display and interaction of the panoramic content can be realized conveniently.

Disclosed are methods and apparatuses for decoding an image. A method includes receiving a bitstream obtained by encoding the image; dividing a first coding block into a plurality of second coding blocks; generating a prediction block of a second coding block based on syntax information obtained from the bitstream; and reconstructing the second coding block based on the prediction block and a residual block of the second coding block, the residual block being obtained by performing a dequantization and an inverse-transform on quantized transform coefficients from the bitstream. The first coding block has a recursive division structure. The first coding block is divided based on at least one of a quad tree division, a binary tree division or a triple tree division.

A client device may be enabled to render a three-dimensional [3D] scene comprising one or more objects. At a server system, a video-based representation of an object may be streamed as one or more video streams to the client device. At the client device, the scene may be rendered from a viewing position within the scene to obtain a rendered view of the scene. Furthermore, a relative position between the viewing position and a position of the object in the scene may be determined. At the server system, the one or more video streams may be generated to show the object from a limited set of viewing angles, wherein the limited set of viewing angles is selected based on the relative position. At the client device, a viewing angle may be selected from the limited set of viewing angles and the video-based representation of the object may be placed at said selected viewing angle in the scene.

A hybrid display system for a force measurement assembly, an exercise device, or an interactive game is disclosed herein. The hybrid display system includes a head-mounted visual display device having an output screen; at least one camera or a substantially transparent lens for enabling a system user to see one or more images of a real-world environment outside of the head-mounted visual display device; and a data processing device configured to generate a virtual reality environment and display the virtual reality environment on the output screen of the head-mounted visual display device, and the one or more images of the real-world environment being visible through the substantially transparent lens or the data processing device further configured to project at least a portion of the one or more images of the real-world environment captured by the at least one camera into the display of the virtual reality environment.

Methods, apparatus, devices, and systems for displaying three-dimensional objects by individually diffracting different colors of light are provided. In one aspect, an optical device includes: a first optically diffractive component including a first diffractive structure configured to diffract a first color of light having a first incident angle at a first diffracted angle, a second optically diffractive component including a second diffractive structure configured to diffract a second color of light having a second incident angle at a second diffracted angle, a first reflective layer configured to totally reflect the first color of light having the first incident angle and transmit the second color of light, and a second reflective layer configured to totally reflect the second color of light having the second incident angle. The first reflective layer is between the first and second diffractive structures, and the second diffractive structure is between the first and second reflective layers.

The invention relates to the technical field of projection display, and discloses a projection curtain light field display gain method and system used under ambient light. According to the method, environment light data, projection curtain data and original output signals of projection equipment are collected in real time, and a dynamic light field distribution model is established after fusion processing. And based on the dynamic light field distribution model, adopting an adaptive genetic algorithm to optimize a compensation weight, generating a light field compensation parameter set, performing reverse compensation processing of brightness gain, contrast and chromaticity offset on an original output signal, and generating an enhanced projection signal. The system comprises a multi-source data acquisition module, a light field feature extraction module, a dynamic compensation calculation module, a signal enhancement processing module and a closed-loop feedback control module, ensures that the projection image keeps an optimal display effect under different ambient light conditions, and remarkably improves the watching experience of audiences.