33 results about "3d sensing" patented technology

A layered pulse generator for a vertical-cavity surface-emitting laser (“VCSEL”) driver is disclosed consisting of three elements: a low-speed pulse generator, a high-speed pulse generator, and a pulse generator selector, all of which are on-chip with the VCSEL driver. By providing these elements on-chip, overall system power and complexity are reduced while allowing for significantly higher pulse train frequencies compared with known systems. The high-speed pulse generator is capable of generating pulses faster and with higher resolution than that of the low-speed pulse generator. The high-speed pulse generator uses multiple clock outputs, phase shifted, and synthesized into a single pulse waveform capable of wide-ranging frequencies, duty cycles and pulse counts.

An energy-efficient adaptive 3D sensing system. The adaptive 3D sensing system includes one or more cameras and one or more projectors. The adaptive 3D sensing system captures images of a real-world scene using the one or more cameras and computes depth estimates and depth estimate confidence values for pixels of the images. The adaptive 3D sensing system computes an attention mask based on the one or more depth estimate confidence values and commands the one or more projectors to send a distributed laser beam into one or more areas of the real-world scene based on the attention mask. The adaptive 3D sensing system captures 3D sensing image data of the one or more areas of the real-world scene and generates 3D sensing data for the real-world scene based on the 3D sensing image data.

This invention relates to the field of park management technology, specifically to a park intelligent management system and method based on optoelectronic 3D imaging digital twins. The system includes: a generation module that uses optoelectronic 3D sensing technology to generate a complete 3D point cloud model of the park, the 3D point cloud model including a digital twin; a real-time sensing module that senses real-time park information, the real-time park information including multimodal data; and a control module that controls the actions of the digital twin based on the real-time park information. Based on optoelectronic information technology, high-precision 3D sensing of the park at the centimeter or even sub-millimeter level can be achieved, providing solid data support for refined management. Through continuous point cloud data acquisition and automatic reconstruction mechanisms, the system ensures real-time synchronization between the digital twin model and the physical world. Managers can directly query 3D spatial information, understand scene status, and issue spatial operation commands through natural language, without requiring specialized 3D software operation skills.

The invention discloses an addressable VCSEL array chip for laser radar and 3D sensing, a driving circuit and a driving method, all light-emitting units on a substrate are divided into two light-emitting areas, a sharing area is arranged between every two adjacent light-emitting areas, when the chip is in a first scanning time period T1, the light-emitting areas are divided into two light-emitting areas through a multiplexer, the light-emitting areas are divided into two light-emitting areas, and the light-emitting areas are divided into two light-emitting areas; simultaneously activating a first driving electrode group and a shared electrode group, and lightening a first light-emitting area and a shared area; when the chip is in a second scanning period T2, activating a second driving electrode group and a shared electrode group at the same time through the multiplexer, and lightening a second light-emitting area and a shared area; according to the invention, through the innovative design of the shared electrode group, the light-emitting units at the junction can be multiplexed by adjacent areas in a time-sharing manner, so that seamless connection of illumination light spots in the scanning process is ensured, and a blind area is thoroughly eliminated; the scheme can be directly integrated in a driving framework of an existing pure solid-state laser radar, a core partition scanning working mode does not need to be changed, and the implementation cost is low.

A 3D sensing system including a liquid crystal lens, a projector, an image sensor and a circuit. The projector provides a light beam to the liquid crystal lens which applies a pattern to the light beam to generate a structured light. The image sensor captures an image corresponding to the structured light. The circuit calculates first depth information according to the pattern and the image, and determines if the image satisfies a quality requirement. If the image does not satisfy the quality requirement, the pattern is modified and another image is captured for calculating second depth information. The first and second depth information are combined to generate a depth map.

The present disclosure provides a lithography system including a radiation source and a control system. The control system includes a laser beam monitor configured to monitor laser beam generated from the radiation source and collect laser beam data, an analysis module configured to analyze the laser beam data and generate an analysis result, and a control module configured to adjust the radiation source according to the analysis result from the analysis module.

The utility model relates to the technical field of sensors, in particular to a tactile sensor, which comprises a flexible part used for receiving extrusion force from a contact object and generating deformation; and the camera module is arranged opposite to the flexible part and is used for shooting the deformed flexible part. The camera module comprises a first lens, a second lens, a bracket, a photosensitive chip and a circuit board, the first lens and the second lens are both installed on the support, the support is arranged on the circuit board, the photosensitive chip is arranged on the circuit board and located under the first lens and the second lens, and the first lens and the second lens share one photosensitive chip. The first lens and the second lens are jointly installed on the same support and share the same photosensitive chip, the interval between the first lens and the second lens is reduced, and 3D sensing application in the macro field is achieved. Meanwhile, the size of the camera module is reduced, and the miniaturization design requirement is met; and the cost of the touch sensor can be reduced by sharing the photosensitive chip.

The embodiment of the invention provides a 3D video generation method and electronic equipment. The method is applied to the electronic equipment and comprises the steps that 3D video material data are acquired based on captured data, and the captured data comprise 2D videos and / or 2D images; analyzing a 3D video scene type based on the 3D video material data; obtaining a new view angle generation model corresponding to the 3D video scene type according to the 3D video scene type; and generating 3D video data according to the 3D video material data by using the new view angle generation model corresponding to the 3D video scene type. According to the method provided by the embodiment of the invention, in a 3D video data generation stage, the corresponding new view angle generation model is called according to the 3D video scene type, so that a more complete scene synthesis view angle can be obtained based on a new view angle synthesis algorithm of deep learning and artificial intelligence, and when the 3D video data is played, the user experience is improved. A user can watch different angles of 3D video content in an immersive manner, and stronger 3D feeling and richer 3D video content are provided.

This invention discloses a sorting system and method based on FPGA image processing. In the system, both the first and second outer conveyor mechanisms input unsorted products, while the middle conveyor mechanism stores different types of sorted products in various areas. The FPGA image processing module identifies the type of each product on the first and second outer conveyor mechanisms and locates the position of each product based on 3D data acquired by a 3D sensing device. Based on the positions of different types of products on the first and second outer conveyor mechanisms and the available positions in different types of areas on the middle conveyor mechanism, it determines whether there is an execution conflict when the first and second sorting actuators sort the corresponding types of products to their respective available positions. Combinations of sorted products and available positions that do not conflict are used as the target combinations for the next sorting by the first and second sorting actuators. This invention enables parallel operation of two sorting actuators, significantly improving sorting efficiency.

The invention provides a sensing method and a communication device, in the method, first equipment performs joint sensing based on first information and second information and determines information of a sensing target, the first information is obtained by sensing the sensing target based on a 3D sensing node, and the first information indicates information of a surface where the sensing target is located; the second information is obtained by sensing a sensing target based on a two-dimensional (2D) sensing node, and the second information indicates information that each key point in a plurality of key points of a 2D sensing result of the sensing target is reversely projected to a corresponding projection straight line in the 3D space. The method can improve the sensing performance and optimize the sensing result.

The devices and methods herein relate to a Mie Avalanche Photodiode (Mie-APD). A Mie-APD leverages Mie resonant scattering and avalanche multiplication to generate current. The Mie-APD features a material layer, an absorption region, and a multiplication region. The multiplication region is configured for multiplying free carriers generated when the absorption region absorbs an electromagnetic perturbation. The material layer serves as a substrate for the absorption region and includes the multiplication region. The structure of the Mie-APD allows for the enhancement of spatial resolution, dynamic range, noise characteristics, and data acquisition speed in applications such as hazard detection, 3D sensing, low light imaging, astronomy, and medical imaging, among others. Variations to the structure, design, and fabrication of the Mie-APD can provide further improved performance and functionality such as enhanced response to specific wavelengths and / or polarizations.WO

A multi-unmanned aerial vehicle cooperative 3D sensing method based on channel adaptation relates to the field of communication, and comprises establishing a multi-unmanned aerial vehicle cooperative 3D sensing framework based on channel adaptation, a BEV semantic coding module and a BEV semantic decoding module. And the unmanned aerial vehicle encodes and fuses the acquired image into semantic features and shares the semantic features to other unmanned aerial vehicles through a complex channel environment, and receives the decoded semantic features of the unmanned aerial vehicle to enhance the 3D perception ability of the unmanned aerial vehicle. The BEV semantic coding module is used for adjusting and adapting a process of fusing self multi-view features into BEV features according to a channel state and compressing and coding the BEV features into semantic features by the unmanned aerial vehicle at the transmitting end; and the BEV semantic decoding module is used for the receiving end unmanned aerial vehicle to decode the semantic features according to the channel state and fuse a plurality of unmanned aerial vehicle features into a perceptible feature vector. According to the method, the interference of channel noise on cooperative 3D sensing is reduced, and the cooperative 3D sensing performance of multiple unmanned aerial vehicles in a complex channel environment is improved.

The invention discloses a depth information camera module and a 3D sensing device, the depth information camera module comprises a packaging main body, a driving chip and a light source chip, the packaging main body is provided with a projection end, a circuit board is arranged in the projection end, the driving chip is coated with a packaging substrate, the packaging substrate and the light source chip are sequentially stacked on the side, close to an object, of the circuit board, and the light source chip is arranged in the packaging main body. The driving chip and the light source chip are connected through a plurality of first conductive circuits, the driving chip and the circuit board are connected through a second conductive circuit, and a first electronic element is arranged between the packaging substrate and the light source chip. Therefore, mutual inductance is greatly reduced, mutual inductance between parasitic inductors is reduced, inductance between capacitors and equivalent inductors is reduced, and even mutual inductance between resistors and equivalent inductors is reduced.

A 3D sensing depth camera involves a time-frequency multiplexed frequency-modulated continuous wave (FMCW) LiDAR technique. A sample arm of such a system for 3D depth sensing includes a scanner for beam scanning in a first axis and a diffractive optical element for spectrally encoded scanning along a second axis. The sample arm can further include beam shaping optics such as a collimator and a lens. Processing of an interferogram comprising depth information at a different position along the second axis for each frequency sweep of the light source involves applying a windowed spectral estimator at a particular spectral window size with zero-padding and according to a specified lateral sampling approach.

The embodiments of the present invention relate to the field of 3D sensing measurement technology, and disclose a method, electronic device, and storage medium for acquiring scene depth information. The present invention includes: performing several rounds of seed growth on a scene image captured by an image acquisition device; acquiring target disparity information of the growth pixels that have successfully grown in each round; obtaining depth information of the scene image based on the target disparity information of each round; acquiring target disparity information of the growth pixels that have successfully grown in each round includes: acquiring disparity information of the seed pixels in the current round and the seed neighborhood of the seed pixels; correcting the initial disparity information of each growth pixel in the seed neighborhood to obtain target disparity information, and the initial disparity information is set as the disparity information of the seed pixels. By adopting this embodiment, the variable structured light system can increase the speed of resolving the depth information of the scene and improve the accuracy of the depth information.

An energy-efficient adaptive 3D sensing system. The adaptive 3D sensing system includes one or more cameras and one or more projectors. The adaptive 3D sensing system captures images of a real-world scene using the one or more cameras and computes depth estimates and depth estimate confidence values for pixels of the images. The adaptive 3D sensing system computes an attention mask based on the one or more depth estimate confidence values and commands the one or more projectors to send a distributed laser beam into one or more areas of the real-world scene based on the attention mask. The adaptive 3D sensing system captures 3D sensing image data of the one or more areas of the real-world scene and generates 3D sensing data for the real-world scene based on the 3D sensing image data.

A time-of-flight (ToF) three-dimensional (3D) sensing system includes a projector that generates an emitted light corresponding to an emitted signal; a sensor that generates a received signal according to a reflected light; and a decoder that determines a distance between the sensor and the object according to the received signal. The emitted signal associated with the emitted light is generated in a basis period, and the received signal associated with the reflected light is generated by the sensor with a first phase shift with respect to a beginning of the basis period. No emitted light is generated in a supplemental period following the basis period, and the received signal has a second phase shift with respect to a beginning of the supplemental period. The distance between the sensor and the object is determined according to the first phase shift and the second phase shift.

The invention relates to the technical field of intelligent sensing cooking, in particular to an Internet of Things sensing, storage and calculation integrated 3D intelligent sensing cooking system. The system obtains three-dimensional point cloud data of food materials in real time through a 3D sensing device, solves the shrinkage rate and the form coefficient, and carries out millisecond-level dynamic fine adjustment on the pose and the heating power of an execution mechanism in combination with a physicochemical evolution model. By using a cloud and mist collaborative architecture, the system realizes experience sharing and resource mutual exclusion scheduling among devices in the same area through a real-time cooking feature cache library. And the cloud module realizes continuous evolution and differential issuing of a global model through feature clustering and gradient updating of incremental data. The problems that a traditional cooking robot is single in sensing dimension and poor in multi-machine collaborative conflict and model self-adaption are effectively solved, and the accuracy of automatic cooking and the group intelligence level are remarkably improved.

The invention discloses a metasurface optical element, a 3D sensing module and terminal equipment. The metasurface optical element comprises a light source and a metasurface structure. The light source comprises a substrate and a plurality of light-emitting pieces arranged on the substrate. The metasurface structure comprises a substrate and a structure layer arranged on the substrate, the structure layer comprises a plurality of micro-nano structure units used for forming phase distribution, and the phase distribution comprises a collimation phase and a diffraction phase; wherein the collimation phase is configured to be used for collimating a plurality of light beams emitted by the plurality of light emitting parts to form a plurality of collimated light beams projected to a plurality of different directions, and the diffraction phase is configured to be used for performing diffraction modulation on the plurality of collimated light beams to form a plurality of target light beams which can be combined into a hemispherical projection light spot range. According to the invention, illumination is effectively improved to hemispherical projection illumination in a larger range, and a larger illumination range is provided for terminal equipment, so that more sensing blind areas are eliminated.

An actuation assembly comprising: a support structure; a movable element movable relative to the support structure, the novable element having a principal axis; and an actuator arrangement for driving movement of the movable element with respect to the support structure, wherein said movement includes rotational movement of the movable element about an axis which is perpendicular to said principal axis and does not pass through the centre of the movable element, and wherein said movement also includes translational movement of the movable element in a direction perpendicular to the principal axis. The actuation assembly may be used to perform optical image stabilisation or to improve the performance of a 3D sensing system.

This invention provides a semantic localization method, electronic device, and machine-readable storage medium that combine dynamic and static features. The semantic localization method includes: real-time acquisition of 3D sensing information of the road where the vehicle is located by sensors; processing the 3D sensing information to obtain road semantic information, which includes static and dynamic semantic features; generating 3D road observation data including static and dynamic semantic features based on the road semantic information; semantically registering the road 3D observation data with a pre-constructed feature map; and obtaining the optimal registration pose through a cost function optimization method, thereby achieving vehicle localization. The solution of this invention creatively utilizes dynamic information, which was originally considered noise, in the localization process; that is, it extends the alignment from single static feature information to the joint alignment of dynamic and static feature information, improving the robustness and accuracy of the localization process.

Aspects of the disclosure relate to depth sensing using a device. An example device includes a first light projector configured to project light toward a second light projector configured to project light toward the first light projector. The example device includes a reflection assembly located between the first light projector and the second light projector, the reflection assembly configured to: redirect the light projected by the first light projector onto a first portion of a scene, and redirect the light projected by the second light projector onto a second portion of the scene, and the first and second portions of the scene are adjacent to each other and non-overlapping with respect to each other. The example device includes a receiver configured to detect reflections of the redirected light projected by the first light projector and the second light projector.

Inventory on a rack of store shelves is monitored by a camera-equipped system that senses when items have been removed. Image data is desirably sensed at plural spectral bands, to enhance item identification by digital watermark and / or other image recognition techniques. The system can be alert to the presence of nearby shoppers, and change its mode of operation in response, e.g., suppressing flash illumination or suspending image capture. The system may self-calibrate to the geometry of shelving in its field of view, and affine-correct captured imagery based on the camera's viewpoint. A great many other features and arrangements are also detailed.

Here discloses a 3D sensing apparatus with AI-controlled Ferroelectric Liquid Crystal beam steering for enhanced dot illumination. The illumination unit for a three-dimensional depth-sensing device includes a light source for emitting an illumination light; a diffuser that diffuses the illumination light into diffused illumination light; and a dual-layer Ferroelectric Liquid Crystal unit, positioned immediately after the diffuser, wherein the dual-layer Ferroelectric Liquid Crystal unit includes a first ferroelectric liquid crystal layer and a second ferroelectric liquid crystal layer, wherein the first ferroelectric liquid crystal layer adjusts a direction of the diffused illumination light, and wherein the second ferroelectric liquid crystal layer corrects a polarization change of the illumination light induced by the first ferroelectric liquid crystal layer. This novel illumination unit features dual-layer Ferroelectric Liquid Crystal technology that enhances the precision and speed of beam steering in 3D depth-sensing devices.

A 3D sensing system is provided. The 3D sensing system includes a first sensing device, a second sensing device and a controller. The first sensing device provides at least one first emitting light and receives a first sensing signal based on a first sensing timing. The second sensing device provides at least one second emitting light and receives a second sensing signal based on a second sensing timing. The controller adjusts at least one of the first sensing timing and the second sensing timing according to an interference result of the second sensing signal by the first sensing device.

The application discloses a device and a method for automatically controlling signal intensity of a direct time-of-flight 3D sensing system, the device comprising: a controller coupled with a transmitting device and a receiving device, and configured to adjust at least one of light intensity of the transmitting device, photosensitivity of the receiving device, and signal-to-noise ratio of a measurement result according to a signal histogram; the transmitting device coupled with the controller and configured to emit light; and the receiving device coupled with the controller and configured to receive light reflected by a measured object and generate a signal histogram.

A hybrid 3D sensing system including a time-of-flight (ToF) projector, a structured light (SL) projector, a ToF sensor, a ToF processor, and a SL processor. The ToF projector projects a modulated light on an object in a ToF mode. The SL projector projects a structured light on the object in a SL mode. The ToF sensor receives reflections from the object and correspondingly generates video data. The ToF processor receives the video data and generates ToF depth information according to the video data in the ToF mode. The SL processor receives a 2D image from the ToF processor and generates SL depth information according to the 2D image in the SL mode.

The present disclosure provides an extreme ultraviolet (EUV) lithography system including a radiation source and an EUV control system integrated with the radiation source. The EUV control system includes a 3-dimensional diagnostic module (3DDM) designed to collect a laser beam profile of a laser beam from the radiation source in a 3-dimensional (3D) mode, an analysis module designed to analyze the laser beam profile, a database designed to store the laser beam profile, and an EUV control module designed to adjust the radiation source. The analysis module is coupled with the database and the EUV control module. The database is coupled with the 3DDM and the analysis module. The EUV control module is coupled with the analysis module and the radiation source.

Systems and methods disclosed herein include an illumination module for 3D sensing applications. The illumination module can include a vertical cavity surface emitting laser (VCSEL) array that emits light, a driver configured to provide current to the VCSEL array, and an optical element configured to receive the light emitted by the VCSEL array and output a light pattern from the illumination module.