66 results about "3d sensing" patented technology

Broadly speaking, embodiments of the present techniques provide apparatus and methods for generating a three-dimensional (3D) representation of a scene (also known as 3D sensing) using a time-of-flight imaging system. In particular, the present techniques provide an apparatus comprising a time-of-flight imaging camera system that emits illumination having a spatially-nonuniform intensity over a field of view of the sensor that is moved across at least part of the field of view of a sensor using an actuation mechanism.

Robotic systems and associated methods are described herein. The robotic system may collect measurements from various sensors corresponding to motion of the robotic system, the surrounding environment of the robotic system, or both. The robotic system may generate measurement data based on the collected measurements. Measurements from a particular sensor may be processed in conjunction with different sensors of the robotic system, which may facilitate more accurate or more useful measurement data. The systems and methods of the present disclosure enable the detection, labeling, and locating of features in real time or near real time using the robotic system with little or no reliance on human interaction to detect and map the features. The disclosure provides enhanced accuracy and efficiency as it enhances the functionality and reduces the reliance on human detection of features.

A vertical cavity surface emitting laser diode (VCSEL) includes a substrate, a lower Bragg reflector (DBR) layer, an active region, an upper Bragg reflector (DBR) layer, and a current confinement layer. The lower DBR layer is on the substrate. The active region is on the lower DBR layer on the active region. The current confinement layer is inside or outside the active region. When the current confinement layer comprises a compound containing phosphorus, such as AlAsP or AlGaAsP, and the phosphorus (P) content is within a specific range, the insulation rate of the current confinement layer will not be excessively fast to the point of being difficult to control. Additionally, the reproducibility of the aperture in the current confinement layer between batches of the VCSEL production is improved. Furthermore, the divergence angle of the VCSEL can be further reduced, thereby significantly enhancing the sensing capabilities of Lidar or 3D sensing.

The invention discloses a 3D sensing circuit, a sensing, storage and calculation integrated macro-cell circuit, a system and a data processing method, and the 3D sensing circuit comprises a 3D light signal sensing unit which is used for converting light flight time into a time pulse signal; the time conversion analog circuit is used for converting the flight time of the photons into analog current signals or analog voltage signals according to the time pulse signals; the time conversion analog circuit comprises a control module, an integration module and a reading module, and the control module is used for controlling the integration starting and ending of the integration module, outputting a starting signal when photons are emitted, and outputting a stopping signal when time pulse signals are received; the integration module is used for carrying out integration on the current after receiving the initial signal and ending the integration after receiving the stop signal; and the read-out module is used for converting the integral signal into a voltage signal and a current signal required by a system post-stage.

The invention discloses an energy-saving adaptive three-dimensional sensing system. An adaptive 3D sensing system includes one or more camera devices and one or more projectors. An adaptive 3D sensing system captures an image of a real-world scene using one or more camera devices and computes a depth estimate and a depth estimate confidence value for pixels of the image. The adaptive 3D sensing system calculates an attention mask based on the one or more depth estimation confidence values, and commands the one or more projectors to send a distributed laser beam into one or more regions of the real-world scene based on the attention mask. An adaptive 3D sensing system captures 3D sensed image data of one or more regions of a real-world scene and generates 3D sensed data of the real-world scene based on the 3D sensed image data.

Disclosed is a volume measurement method performed by a computing device. The method may include acquiring, by a 3D sensing unit, a target depth image for a target object positioned on a reference surface. The 3D sensing unit has a sensing direction which is an acute angle with respect to the reference surface. The method may include acquiring point cloud data for a sensing coordinate system based on the target depth image. The method may include acquiring point cloud data for a reference surface coordinate system by using transformation relationship information between the sensing coordinate system and the reference surface coordinate system for the sensing direction.

A layered pulse generator for a vertical-cavity surface-emitting laser (“VCSEL”) driver is disclosed consisting of three elements: a low-speed pulse generator, a high-speed pulse generator, and a pulse generator selector, all of which are on-chip with the VCSEL driver. By providing these elements on-chip, overall system power and complexity are reduced while allowing for significantly higher pulse train frequencies compared with known systems. The high-speed pulse generator is capable of generating pulses faster and with higher resolution than that of the low-speed pulse generator. The high-speed pulse generator uses multiple clock outputs, phase shifted, and synthesized into a single pulse waveform capable of wide-ranging frequencies, duty cycles and pulse counts.

The utility model belongs to the technical field of 3D sensing, and especially relates to a depth camera. The depth camera comprises a three-dimensional imaging module, a mainboard support, a mainboard, an elastic piece and an adapter support, the three-dimensional imaging module comprises a laser emission module, an acquisition module and a photoelectric support, and the laser emission module and the acquisition module are arranged on the photoelectric support; the mainboard bracket is arranged on the back side of the photoelectric bracket and a gap is formed between the mainboard bracket and the back of the photoelectric bracket; the mainboard is installed on the mainboard support and is electrically connected with the laser emission module and the acquisition module. The two ends of each adapter bracket are respectively connected to the photoelectric bracket and the mainboard bracket, and the at least two adapter brackets are respectively connected to at least two sides of the photoelectric bracket and the mainboard bracket, so that the photoelectric bracket is connected to the mainboard bracket in a suspended manner; and the elastic piece is arranged between the adapter bracket and the mainboard bracket, and / or between the adapter bracket and the photoelectric bracket. The depth camera is good in impact resistance, and high precision can be guaranteed when the depth camera is impacted.

An energy-efficient adaptive 3D sensing system. The adaptive 3D sensing system includes one or more cameras and one or more projectors. The adaptive 3D sensing system captures images of a real-world scene using the one or more cameras and computes depth estimates and depth estimate confidence values for pixels of the images. The adaptive 3D sensing system computes an attention mask based on the one or more depth estimate confidence values and commands the one or more projectors to send a distributed laser beam into one or more areas of the real-world scene based on the attention mask. The adaptive 3D sensing system captures 3D sensing image data of the one or more areas of the real-world scene and generates 3D sensing data for the real-world scene based on the 3D sensing image data.

This invention relates to the field of park management technology, specifically to a park intelligent management system and method based on optoelectronic 3D imaging digital twins. The system includes: a generation module that uses optoelectronic 3D sensing technology to generate a complete 3D point cloud model of the park, the 3D point cloud model including a digital twin; a real-time sensing module that senses real-time park information, the real-time park information including multimodal data; and a control module that controls the actions of the digital twin based on the real-time park information. Based on optoelectronic information technology, high-precision 3D sensing of the park at the centimeter or even sub-millimeter level can be achieved, providing solid data support for refined management. Through continuous point cloud data acquisition and automatic reconstruction mechanisms, the system ensures real-time synchronization between the digital twin model and the physical world. Managers can directly query 3D spatial information, understand scene status, and issue spatial operation commands through natural language, without requiring specialized 3D software operation skills.

The invention discloses an addressable VCSEL array chip for laser radar and 3D sensing, a driving circuit and a driving method, all light-emitting units on a substrate are divided into two light-emitting areas, a sharing area is arranged between every two adjacent light-emitting areas, when the chip is in a first scanning time period T1, the light-emitting areas are divided into two light-emitting areas through a multiplexer, the light-emitting areas are divided into two light-emitting areas, and the light-emitting areas are divided into two light-emitting areas; simultaneously activating a first driving electrode group and a shared electrode group, and lightening a first light-emitting area and a shared area; when the chip is in a second scanning period T2, activating a second driving electrode group and a shared electrode group at the same time through the multiplexer, and lightening a second light-emitting area and a shared area; according to the invention, through the innovative design of the shared electrode group, the light-emitting units at the junction can be multiplexed by adjacent areas in a time-sharing manner, so that seamless connection of illumination light spots in the scanning process is ensured, and a blind area is thoroughly eliminated; the scheme can be directly integrated in a driving framework of an existing pure solid-state laser radar, a core partition scanning working mode does not need to be changed, and the implementation cost is low.

An actuation assembly comprising: a support structure; a movable element movable relative to the support structure, the movable element having a principal axis; and an actuator arrangement for driving movement of the movable element with respect to the support structure, wherein said movement includes rotational movement of the movable element about an axis which is perpendicular to said principal axis and does not pass through the centre of the movable element, and wherein said movement also includes translational movement of the movable element in a direction perpendicular to the principal axis. The actuation assembly may be used to perform optical image stabilisation or to improve the performance of a 3D sensing system.

A 3D sensing system including a liquid crystal lens, a projector, an image sensor and a circuit. The projector provides a light beam to the liquid crystal lens which applies a pattern to the light beam to generate a structured light. The image sensor captures an image corresponding to the structured light. The circuit calculates first depth information according to the pattern and the image, and determines if the image satisfies a quality requirement. If the image does not satisfy the quality requirement, the pattern is modified and another image is captured for calculating second depth information. The first and second depth information are combined to generate a depth map.

The present disclosure provides a lithography system including a radiation source and a control system. The control system includes a laser beam monitor configured to monitor laser beam generated from the radiation source and collect laser beam data, an analysis module configured to analyze the laser beam data and generate an analysis result, and a control module configured to adjust the radiation source according to the analysis result from the analysis module.

The utility model relates to the technical field of sensors, in particular to a tactile sensor, which comprises a flexible part used for receiving extrusion force from a contact object and generating deformation; and the camera module is arranged opposite to the flexible part and is used for shooting the deformed flexible part. The camera module comprises a first lens, a second lens, a bracket, a photosensitive chip and a circuit board, the first lens and the second lens are both installed on the support, the support is arranged on the circuit board, the photosensitive chip is arranged on the circuit board and located under the first lens and the second lens, and the first lens and the second lens share one photosensitive chip. The first lens and the second lens are jointly installed on the same support and share the same photosensitive chip, the interval between the first lens and the second lens is reduced, and 3D sensing application in the macro field is achieved. Meanwhile, the size of the camera module is reduced, and the miniaturization design requirement is met; and the cost of the touch sensor can be reduced by sharing the photosensitive chip.

The embodiment of the invention provides a 3D video generation method and electronic equipment. The method is applied to the electronic equipment and comprises the steps that 3D video material data are acquired based on captured data, and the captured data comprise 2D videos and / or 2D images; analyzing a 3D video scene type based on the 3D video material data; obtaining a new view angle generation model corresponding to the 3D video scene type according to the 3D video scene type; and generating 3D video data according to the 3D video material data by using the new view angle generation model corresponding to the 3D video scene type. According to the method provided by the embodiment of the invention, in a 3D video data generation stage, the corresponding new view angle generation model is called according to the 3D video scene type, so that a more complete scene synthesis view angle can be obtained based on a new view angle synthesis algorithm of deep learning and artificial intelligence, and when the 3D video data is played, the user experience is improved. A user can watch different angles of 3D video content in an immersive manner, and stronger 3D feeling and richer 3D video content are provided.

The devices and methods herein relate to a Mie Avalanche Photodiode (Mie- APD). A Mie-APD leverages Mie resonant scattering and avalanche multiplication to generate current. The Mie-APD features a material layer, an absorption region, and a multiplication region. The multiplication region is configured for multiplying free carriers generated when the absorption region absorbs an electromagnetic perturbation. The material layer serves as a substrate for the absorption region and includes the multiplication region. The structure of the Mie-APD allows for the enhancement of spatial resolution, dynamic range, noise characteristics, and data acquisition speed in applications such as hazard detection, 3D sensing, low light imaging, astronomy, and medical imaging, among others. Variations to the structure, design, and fabrication of the Mie-APD can provide further improved performance and functionality such as enhanced response to specific wavelengths and / or polarizations.

This invention discloses a sorting system and method based on FPGA image processing. In the system, both the first and second outer conveyor mechanisms input unsorted products, while the middle conveyor mechanism stores different types of sorted products in various areas. The FPGA image processing module identifies the type of each product on the first and second outer conveyor mechanisms and locates the position of each product based on 3D data acquired by a 3D sensing device. Based on the positions of different types of products on the first and second outer conveyor mechanisms and the available positions in different types of areas on the middle conveyor mechanism, it determines whether there is an execution conflict when the first and second sorting actuators sort the corresponding types of products to their respective available positions. Combinations of sorted products and available positions that do not conflict are used as the target combinations for the next sorting by the first and second sorting actuators. This invention enables parallel operation of two sorting actuators, significantly improving sorting efficiency.

The invention provides a sensing method and a communication device, in the method, first equipment performs joint sensing based on first information and second information and determines information of a sensing target, the first information is obtained by sensing the sensing target based on a 3D sensing node, and the first information indicates information of a surface where the sensing target is located; the second information is obtained by sensing a sensing target based on a two-dimensional (2D) sensing node, and the second information indicates information that each key point in a plurality of key points of a 2D sensing result of the sensing target is reversely projected to a corresponding projection straight line in the 3D space. The method can improve the sensing performance and optimize the sensing result.

The three-dimensional sensing device (1) comprises a light irradiation unit (10) that forms a light irradiation area (100) extending in a first direction (Y) and moves the light irradiation area (100) in a second direction (X), an imaging unit (20) that performs an imaging operation to image a line imaging range (200) extending in the first direction (Y) and moves the line imaging range (200) in the second direction (X), and a control unit (30) that controls the light irradiation unit (10) and the imaging unit (20) so that a light curtain (300) is formed and controls the imaging unit (30). and a control unit (30) that detects an object (400) overlapping the light curtain (300) based on an image captured by the imaging unit (20), and the control unit (30) changes the position of the light curtain (300) in the depth direction (Z) corresponding to the distance from the imaging unit (20) by controlling the light irradiation direction of the light irradiation unit (10) and the line of sight direction of the imaging unit (20) and changes the thickness of the light curtain (300) in the depth direction (Z) by controlling the exposure time of the imaging unit (20).

The devices and methods herein relate to a Mie Avalanche Photodiode (Mie-APD). A Mie-APD leverages Mie resonant scattering and avalanche multiplication to generate current. The Mie-APD features a material layer, an absorption region, and a multiplication region. The multiplication region is configured for multiplying free carriers generated when the absorption region absorbs an electromagnetic perturbation. The material layer serves as a substrate for the absorption region and includes the multiplication region. The structure of the Mie-APD allows for the enhancement of spatial resolution, dynamic range, noise characteristics, and data acquisition speed in applications such as hazard detection, 3D sensing, low light imaging, astronomy, and medical imaging, among others. Variations to the structure, design, and fabrication of the Mie-APD can provide further improved performance and functionality such as enhanced response to specific wavelengths and / or polarizations.WO

The present invention provides a component for realizing 3D sensing in a single Hall region, and relates to the technical field of Hall effect sensors. The component for realizing 3D sensing in a single Hall region includes a substrate, a buffer layer, a functional layer, a sensing layer, a magnetic core and a plurality of electrodes, wherein the buffer layer, the functional layer and the sensing layer are formed in sequence; two groups of electrodes are arranged on the sensing layer, and each group includes at least 4 electrodes distributed along the same circumference, and the two groups of electrodes are arranged staggered in the circumferential direction and are centrally symmetrical; the magnetic core is arranged on the sensing layer; the cross section of the magnetic core is a symmetrical structure, and the projection center overlaps with the distribution center of the plurality of electrodes. Compared with the prior art, the present invention has a compact structure, can effectively save space, is compatible with conventional planar processes, reduces production difficulty and cost, and has high symmetry in design, good sensing performance, high directional uniformity, extremely convenient and simple calibration, and the output voltage has high linearity in three directions.

A multi-unmanned aerial vehicle cooperative 3D sensing method based on channel adaptation relates to the field of communication, and comprises establishing a multi-unmanned aerial vehicle cooperative 3D sensing framework based on channel adaptation, a BEV semantic coding module and a BEV semantic decoding module. And the unmanned aerial vehicle encodes and fuses the acquired image into semantic features and shares the semantic features to other unmanned aerial vehicles through a complex channel environment, and receives the decoded semantic features of the unmanned aerial vehicle to enhance the 3D perception ability of the unmanned aerial vehicle. The BEV semantic coding module is used for adjusting and adapting a process of fusing self multi-view features into BEV features according to a channel state and compressing and coding the BEV features into semantic features by the unmanned aerial vehicle at the transmitting end; and the BEV semantic decoding module is used for the receiving end unmanned aerial vehicle to decode the semantic features according to the channel state and fuse a plurality of unmanned aerial vehicle features into a perceptible feature vector. According to the method, the interference of channel noise on cooperative 3D sensing is reduced, and the cooperative 3D sensing performance of multiple unmanned aerial vehicles in a complex channel environment is improved.

The invention discloses a depth information camera module and a 3D sensing device, the depth information camera module comprises a packaging main body, a driving chip and a light source chip, the packaging main body is provided with a projection end, a circuit board is arranged in the projection end, the driving chip is coated with a packaging substrate, the packaging substrate and the light source chip are sequentially stacked on the side, close to an object, of the circuit board, and the light source chip is arranged in the packaging main body. The driving chip and the light source chip are connected through a plurality of first conductive circuits, the driving chip and the circuit board are connected through a second conductive circuit, and a first electronic element is arranged between the packaging substrate and the light source chip. Therefore, mutual inductance is greatly reduced, mutual inductance between parasitic inductors is reduced, inductance between capacitors and equivalent inductors is reduced, and even mutual inductance between resistors and equivalent inductors is reduced.

To provide a volume measuring method and device for a volume measuring system that can efficiently measure the weights and volumes of various sizes of objects in order to increase the efficiency of loading and transport in physical distribution.SOLUTION: A volume measuring method executed by a volume measuring device includes the steps of: determining information related to the conversion relationship between a sensing coordinate system related to a sensing direction and a reference plane coordinate system; acquiring, by a 3D sensing unit, a target depth image related to a target object located on a reference plane; acquiring point group data related to the sensing coordinate system on the basis of the target depth image; acquiring point group data related to the reference plane coordinate system by using the information related to the conversion relationship between the sensing coordinate system related to the sensing direction and the reference plane coordinate system; and determining the volume of the target object on the basis of the point group data related to the reference plane coordinate system.SELECTED DRAWING: Figure 10

The invention provides a vehicle end camera 3D marking method based on roadside perception and a related device. In the scheme, the sensing result of the roadside equipment is adopted to label the data of the vehicle-side camera. A fixed target on the ground serves as a known and stable reference point, the roadside equipment converts an obtained initial 3D sensing result into a world coordinate system based on latitude and longitude information of related equipment, and the 3D sensing result under the world coordinate system is obtained and sent to a target vehicle. And the vehicle converts the 3D perception result under the world coordinate system into a local coordinate system of the vehicle, the 3D perception result under the local coordinate system of the vehicle is obtained and then is projected into an image acquired by the vehicle, and marking of the perception result of the roadside equipment on the pure visual image of the vehicle end is completed. Through the method, the problems of high cost, long time and limited quantity of the existing vehicle end pure vision 3D detection data acquisition technology are solved, and the quality and acquisition efficiency of the 3D training data are improved.

A 3D sensing depth camera involves a time-frequency multiplexed frequency-modulated continuous wave (FMCW) LiDAR technique. A sample arm of such a system for 3D depth sensing includes a scanner for beam scanning in a first axis and a diffractive optical element for spectrally encoded scanning along a second axis. The sample arm can further include beam shaping optics such as a collimator and a lens. Processing of an interferogram comprising depth information at a different position along the second axis for each frequency sweep of the light source involves applying a windowed spectral estimator at a particular spectral window size with zero-padding and according to a specified lateral sampling approach.