42 results about "3d sensing" patented technology

Broadly speaking, embodiments of the present techniques provide apparatus and methods for generating a three-dimensional (3D) representation of a scene (also known as 3D sensing) using a time-of-flight imaging system. In particular, the present techniques provide an apparatus comprising a time-of-flight imaging camera system that emits illumination having a spatially-nonuniform intensity over a field of view of the sensor that is moved across at least part of the field of view of a sensor using an actuation mechanism.

Robotic systems and associated methods are described herein. The robotic system may collect measurements from various sensors corresponding to motion of the robotic system, the surrounding environment of the robotic system, or both. The robotic system may generate measurement data based on the collected measurements. Measurements from a particular sensor may be processed in conjunction with different sensors of the robotic system, which may facilitate more accurate or more useful measurement data. The systems and methods of the present disclosure enable the detection, labeling, and locating of features in real time or near real time using the robotic system with little or no reliance on human interaction to detect and map the features. The disclosure provides enhanced accuracy and efficiency as it enhances the functionality and reduces the reliance on human detection of features.

The invention discloses an energy-saving adaptive three-dimensional sensing system. An adaptive 3D sensing system includes one or more camera devices and one or more projectors. An adaptive 3D sensing system captures an image of a real-world scene using one or more camera devices and computes a depth estimate and a depth estimate confidence value for pixels of the image. The adaptive 3D sensing system calculates an attention mask based on the one or more depth estimation confidence values, and commands the one or more projectors to send a distributed laser beam into one or more regions of the real-world scene based on the attention mask. An adaptive 3D sensing system captures 3D sensed image data of one or more regions of a real-world scene and generates 3D sensed data of the real-world scene based on the 3D sensed image data.

A layered pulse generator for a vertical-cavity surface-emitting laser (“VCSEL”) driver is disclosed consisting of three elements: a low-speed pulse generator, a high-speed pulse generator, and a pulse generator selector, all of which are on-chip with the VCSEL driver. By providing these elements on-chip, overall system power and complexity are reduced while allowing for significantly higher pulse train frequencies compared with known systems. The high-speed pulse generator is capable of generating pulses faster and with higher resolution than that of the low-speed pulse generator. The high-speed pulse generator uses multiple clock outputs, phase shifted, and synthesized into a single pulse waveform capable of wide-ranging frequencies, duty cycles and pulse counts.

An energy-efficient adaptive 3D sensing system. The adaptive 3D sensing system includes one or more cameras and one or more projectors. The adaptive 3D sensing system captures images of a real-world scene using the one or more cameras and computes depth estimates and depth estimate confidence values for pixels of the images. The adaptive 3D sensing system computes an attention mask based on the one or more depth estimate confidence values and commands the one or more projectors to send a distributed laser beam into one or more areas of the real-world scene based on the attention mask. The adaptive 3D sensing system captures 3D sensing image data of the one or more areas of the real-world scene and generates 3D sensing data for the real-world scene based on the 3D sensing image data.

This invention relates to the field of park management technology, specifically to a park intelligent management system and method based on optoelectronic 3D imaging digital twins. The system includes: a generation module that uses optoelectronic 3D sensing technology to generate a complete 3D point cloud model of the park, the 3D point cloud model including a digital twin; a real-time sensing module that senses real-time park information, the real-time park information including multimodal data; and a control module that controls the actions of the digital twin based on the real-time park information. Based on optoelectronic information technology, high-precision 3D sensing of the park at the centimeter or even sub-millimeter level can be achieved, providing solid data support for refined management. Through continuous point cloud data acquisition and automatic reconstruction mechanisms, the system ensures real-time synchronization between the digital twin model and the physical world. Managers can directly query 3D spatial information, understand scene status, and issue spatial operation commands through natural language, without requiring specialized 3D software operation skills.

The invention discloses an addressable VCSEL array chip for laser radar and 3D sensing, a driving circuit and a driving method, all light-emitting units on a substrate are divided into two light-emitting areas, a sharing area is arranged between every two adjacent light-emitting areas, when the chip is in a first scanning time period T1, the light-emitting areas are divided into two light-emitting areas through a multiplexer, the light-emitting areas are divided into two light-emitting areas, and the light-emitting areas are divided into two light-emitting areas; simultaneously activating a first driving electrode group and a shared electrode group, and lightening a first light-emitting area and a shared area; when the chip is in a second scanning period T2, activating a second driving electrode group and a shared electrode group at the same time through the multiplexer, and lightening a second light-emitting area and a shared area; according to the invention, through the innovative design of the shared electrode group, the light-emitting units at the junction can be multiplexed by adjacent areas in a time-sharing manner, so that seamless connection of illumination light spots in the scanning process is ensured, and a blind area is thoroughly eliminated; the scheme can be directly integrated in a driving framework of an existing pure solid-state laser radar, a core partition scanning working mode does not need to be changed, and the implementation cost is low.

An actuation assembly comprising: a support structure; a movable element movable relative to the support structure, the movable element having a principal axis; and an actuator arrangement for driving movement of the movable element with respect to the support structure, wherein said movement includes rotational movement of the movable element about an axis which is perpendicular to said principal axis and does not pass through the centre of the movable element, and wherein said movement also includes translational movement of the movable element in a direction perpendicular to the principal axis. The actuation assembly may be used to perform optical image stabilisation or to improve the performance of a 3D sensing system.

A 3D sensing system including a liquid crystal lens, a projector, an image sensor and a circuit. The projector provides a light beam to the liquid crystal lens which applies a pattern to the light beam to generate a structured light. The image sensor captures an image corresponding to the structured light. The circuit calculates first depth information according to the pattern and the image, and determines if the image satisfies a quality requirement. If the image does not satisfy the quality requirement, the pattern is modified and another image is captured for calculating second depth information. The first and second depth information are combined to generate a depth map.

The present disclosure provides a lithography system including a radiation source and a control system. The control system includes a laser beam monitor configured to monitor laser beam generated from the radiation source and collect laser beam data, an analysis module configured to analyze the laser beam data and generate an analysis result, and a control module configured to adjust the radiation source according to the analysis result from the analysis module.

The utility model relates to the technical field of sensors, in particular to a tactile sensor, which comprises a flexible part used for receiving extrusion force from a contact object and generating deformation; and the camera module is arranged opposite to the flexible part and is used for shooting the deformed flexible part. The camera module comprises a first lens, a second lens, a bracket, a photosensitive chip and a circuit board, the first lens and the second lens are both installed on the support, the support is arranged on the circuit board, the photosensitive chip is arranged on the circuit board and located under the first lens and the second lens, and the first lens and the second lens share one photosensitive chip. The first lens and the second lens are jointly installed on the same support and share the same photosensitive chip, the interval between the first lens and the second lens is reduced, and 3D sensing application in the macro field is achieved. Meanwhile, the size of the camera module is reduced, and the miniaturization design requirement is met; and the cost of the touch sensor can be reduced by sharing the photosensitive chip.

The embodiment of the invention provides a 3D video generation method and electronic equipment. The method is applied to the electronic equipment and comprises the steps that 3D video material data are acquired based on captured data, and the captured data comprise 2D videos and / or 2D images; analyzing a 3D video scene type based on the 3D video material data; obtaining a new view angle generation model corresponding to the 3D video scene type according to the 3D video scene type; and generating 3D video data according to the 3D video material data by using the new view angle generation model corresponding to the 3D video scene type. According to the method provided by the embodiment of the invention, in a 3D video data generation stage, the corresponding new view angle generation model is called according to the 3D video scene type, so that a more complete scene synthesis view angle can be obtained based on a new view angle synthesis algorithm of deep learning and artificial intelligence, and when the 3D video data is played, the user experience is improved. A user can watch different angles of 3D video content in an immersive manner, and stronger 3D feeling and richer 3D video content are provided.

This invention discloses a sorting system and method based on FPGA image processing. In the system, both the first and second outer conveyor mechanisms input unsorted products, while the middle conveyor mechanism stores different types of sorted products in various areas. The FPGA image processing module identifies the type of each product on the first and second outer conveyor mechanisms and locates the position of each product based on 3D data acquired by a 3D sensing device. Based on the positions of different types of products on the first and second outer conveyor mechanisms and the available positions in different types of areas on the middle conveyor mechanism, it determines whether there is an execution conflict when the first and second sorting actuators sort the corresponding types of products to their respective available positions. Combinations of sorted products and available positions that do not conflict are used as the target combinations for the next sorting by the first and second sorting actuators. This invention enables parallel operation of two sorting actuators, significantly improving sorting efficiency.

The invention provides a sensing method and a communication device, in the method, first equipment performs joint sensing based on first information and second information and determines information of a sensing target, the first information is obtained by sensing the sensing target based on a 3D sensing node, and the first information indicates information of a surface where the sensing target is located; the second information is obtained by sensing a sensing target based on a two-dimensional (2D) sensing node, and the second information indicates information that each key point in a plurality of key points of a 2D sensing result of the sensing target is reversely projected to a corresponding projection straight line in the 3D space. The method can improve the sensing performance and optimize the sensing result.

The devices and methods herein relate to a Mie Avalanche Photodiode (Mie-APD). A Mie-APD leverages Mie resonant scattering and avalanche multiplication to generate current. The Mie-APD features a material layer, an absorption region, and a multiplication region. The multiplication region is configured for multiplying free carriers generated when the absorption region absorbs an electromagnetic perturbation. The material layer serves as a substrate for the absorption region and includes the multiplication region. The structure of the Mie-APD allows for the enhancement of spatial resolution, dynamic range, noise characteristics, and data acquisition speed in applications such as hazard detection, 3D sensing, low light imaging, astronomy, and medical imaging, among others. Variations to the structure, design, and fabrication of the Mie-APD can provide further improved performance and functionality such as enhanced response to specific wavelengths and / or polarizations.WO

A multi-unmanned aerial vehicle cooperative 3D sensing method based on channel adaptation relates to the field of communication, and comprises establishing a multi-unmanned aerial vehicle cooperative 3D sensing framework based on channel adaptation, a BEV semantic coding module and a BEV semantic decoding module. And the unmanned aerial vehicle encodes and fuses the acquired image into semantic features and shares the semantic features to other unmanned aerial vehicles through a complex channel environment, and receives the decoded semantic features of the unmanned aerial vehicle to enhance the 3D perception ability of the unmanned aerial vehicle. The BEV semantic coding module is used for adjusting and adapting a process of fusing self multi-view features into BEV features according to a channel state and compressing and coding the BEV features into semantic features by the unmanned aerial vehicle at the transmitting end; and the BEV semantic decoding module is used for the receiving end unmanned aerial vehicle to decode the semantic features according to the channel state and fuse a plurality of unmanned aerial vehicle features into a perceptible feature vector. According to the method, the interference of channel noise on cooperative 3D sensing is reduced, and the cooperative 3D sensing performance of multiple unmanned aerial vehicles in a complex channel environment is improved.

The invention discloses a depth information camera module and a 3D sensing device, the depth information camera module comprises a packaging main body, a driving chip and a light source chip, the packaging main body is provided with a projection end, a circuit board is arranged in the projection end, the driving chip is coated with a packaging substrate, the packaging substrate and the light source chip are sequentially stacked on the side, close to an object, of the circuit board, and the light source chip is arranged in the packaging main body. The driving chip and the light source chip are connected through a plurality of first conductive circuits, the driving chip and the circuit board are connected through a second conductive circuit, and a first electronic element is arranged between the packaging substrate and the light source chip. Therefore, mutual inductance is greatly reduced, mutual inductance between parasitic inductors is reduced, inductance between capacitors and equivalent inductors is reduced, and even mutual inductance between resistors and equivalent inductors is reduced.

A 3D sensing depth camera involves a time-frequency multiplexed frequency-modulated continuous wave (FMCW) LiDAR technique. A sample arm of such a system for 3D depth sensing includes a scanner for beam scanning in a first axis and a diffractive optical element for spectrally encoded scanning along a second axis. The sample arm can further include beam shaping optics such as a collimator and a lens. Processing of an interferogram comprising depth information at a different position along the second axis for each frequency sweep of the light source involves applying a windowed spectral estimator at a particular spectral window size with zero-padding and according to a specified lateral sampling approach.

The present application provides a 3D sensing module, a 3D sensing method and an electronic device. The 3D sensing module includes a transmitting end and a receiving end; the transmitting end is used to transmit a first outgoing light beam in a depth imaging mode, or to transmit a second outgoing light beam in a proximity sensing mode; the receiving end is used to open all pixels in the depth imaging mode to form a first detection channel with the transmitting end to receive a first reflected light beam (obtained by reflection of the first outgoing light beam) and generate a depth image of the target object, or to open some pixels in the proximity sensing mode to form a second detection channel with the transmitting end to receive a second reflected light beam (obtained by reflection of the second outgoing light beam) and generate distance information between the 3D sensing module and the target object; wherein the field of view angle of the first outgoing light beam is greater than the field of view angle of the second outgoing light beam. The present application no longer needs to form a camera device with a proximity sensor and a 3D sensing module, thereby reducing the volume, quality and manufacturing cost of the camera device.

The embodiments of the present invention relate to the field of 3D sensing measurement technology, and disclose a method, electronic device, and storage medium for acquiring scene depth information. The present invention includes: performing several rounds of seed growth on a scene image captured by an image acquisition device; acquiring target disparity information of the growth pixels that have successfully grown in each round; obtaining depth information of the scene image based on the target disparity information of each round; acquiring target disparity information of the growth pixels that have successfully grown in each round includes: acquiring disparity information of the seed pixels in the current round and the seed neighborhood of the seed pixels; correcting the initial disparity information of each growth pixel in the seed neighborhood to obtain target disparity information, and the initial disparity information is set as the disparity information of the seed pixels. By adopting this embodiment, the variable structured light system can increase the speed of resolving the depth information of the scene and improve the accuracy of the depth information.

A sensor system may include an object, a magnet, and a magnetic sensor. The magnet may be connected to the object such that a center of the magnet is offset from an axis of the object. The magnetic sensor may include a first three-dimensional (3D) sensing pixel and a second 3D sensing pixel. The magnetic sensor may be arranged such that the first 3D sensing pixel and the second 3D sensing pixel are at different distances from a tilt point of the object. The magnetic sensor may be arranged such that the first 3D sensing pixel and the second 3D sensing pixel are at different distances from the center of the magnet.

An energy-efficient adaptive 3D sensing system. The adaptive 3D sensing system includes one or more cameras and one or more projectors. The adaptive 3D sensing system captures images of a real-world scene using the one or more cameras and computes depth estimates and depth estimate confidence values for pixels of the images. The adaptive 3D sensing system computes an attention mask based on the one or more depth estimate confidence values and commands the one or more projectors to send a distributed laser beam into one or more areas of the real-world scene based on the attention mask. The adaptive 3D sensing system captures 3D sensing image data of the one or more areas of the real-world scene and generates 3D sensing data for the real-world scene based on the 3D sensing image data.

A time-of-flight (ToF) three-dimensional (3D) sensing system includes a projector that generates an emitted light corresponding to an emitted signal; a sensor that generates a received signal according to a reflected light; and a decoder that determines a distance between the sensor and the object according to the received signal. The emitted signal associated with the emitted light is generated in a basis period, and the received signal associated with the reflected light is generated by the sensor with a first phase shift with respect to a beginning of the basis period. No emitted light is generated in a supplemental period following the basis period, and the received signal has a second phase shift with respect to a beginning of the supplemental period. The distance between the sensor and the object is determined according to the first phase shift and the second phase shift.

The invention relates to the technical field of intelligent sensing cooking, in particular to an Internet of Things sensing, storage and calculation integrated 3D intelligent sensing cooking system. The system obtains three-dimensional point cloud data of food materials in real time through a 3D sensing device, solves the shrinkage rate and the form coefficient, and carries out millisecond-level dynamic fine adjustment on the pose and the heating power of an execution mechanism in combination with a physicochemical evolution model. By using a cloud and mist collaborative architecture, the system realizes experience sharing and resource mutual exclusion scheduling among devices in the same area through a real-time cooking feature cache library. And the cloud module realizes continuous evolution and differential issuing of a global model through feature clustering and gradient updating of incremental data. The problems that a traditional cooking robot is single in sensing dimension and poor in multi-machine collaborative conflict and model self-adaption are effectively solved, and the accuracy of automatic cooking and the group intelligence level are remarkably improved.

The invention discloses a metasurface optical element, a 3D sensing module and terminal equipment. The metasurface optical element comprises a light source and a metasurface structure. The light source comprises a substrate and a plurality of light-emitting pieces arranged on the substrate. The metasurface structure comprises a substrate and a structure layer arranged on the substrate, the structure layer comprises a plurality of micro-nano structure units used for forming phase distribution, and the phase distribution comprises a collimation phase and a diffraction phase; wherein the collimation phase is configured to be used for collimating a plurality of light beams emitted by the plurality of light emitting parts to form a plurality of collimated light beams projected to a plurality of different directions, and the diffraction phase is configured to be used for performing diffraction modulation on the plurality of collimated light beams to form a plurality of target light beams which can be combined into a hemispherical projection light spot range. According to the invention, illumination is effectively improved to hemispherical projection illumination in a larger range, and a larger illumination range is provided for terminal equipment, so that more sensing blind areas are eliminated.

An actuation assembly comprising: a support structure; a movable element movable relative to the support structure, the novable element having a principal axis; and an actuator arrangement for driving movement of the movable element with respect to the support structure, wherein said movement includes rotational movement of the movable element about an axis which is perpendicular to said principal axis and does not pass through the centre of the movable element, and wherein said movement also includes translational movement of the movable element in a direction perpendicular to the principal axis. The actuation assembly may be used to perform optical image stabilisation or to improve the performance of a 3D sensing system.

This invention provides a semantic localization method, electronic device, and machine-readable storage medium that combine dynamic and static features. The semantic localization method includes: real-time acquisition of 3D sensing information of the road where the vehicle is located by sensors; processing the 3D sensing information to obtain road semantic information, which includes static and dynamic semantic features; generating 3D road observation data including static and dynamic semantic features based on the road semantic information; semantically registering the road 3D observation data with a pre-constructed feature map; and obtaining the optimal registration pose through a cost function optimization method, thereby achieving vehicle localization. The solution of this invention creatively utilizes dynamic information, which was originally considered noise, in the localization process; that is, it extends the alignment from single static feature information to the joint alignment of dynamic and static feature information, improving the robustness and accuracy of the localization process.