Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data fusion method and device of event camera and standard camera, equipment and medium

A data fusion and camera technology, applied in the field of robot vision, can solve problems such as low fusion efficiency, low precision, and high dynamic range, and achieve the effects of reducing real-time calculations, high matching accuracy, and high fusion efficiency

Active Publication Date: 2022-07-05
JIHUA LAB
View PDF17 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Among them, the event camera obtains information by sensing the dynamic changes of scene light intensity, and has the characteristics of high time resolution, low delay characteristics (microsecond level), high dynamic range (140Db compared with 60dB for standard cameras) and low power consumption. ; When event cameras are applied to outdoor robots, they often output event information to be fused with the image data acquired by standard cameras to obtain high-precision fusion data. The existing data fusion methods of event cameras and standard cameras generally have data processing calculations Disadvantages such as large size, low fusion efficiency, and low precision
[0005] For the above problems, there is no effective technical solution

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data fusion method and device of event camera and standard camera, equipment and medium
  • Data fusion method and device of event camera and standard camera, equipment and medium
  • Data fusion method and device of event camera and standard camera, equipment and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045] The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. The components of the embodiments of the present application generally described and illustrated in the drawings herein may be arranged and designed in a variety of different configurations. Thus, the following detailed description of the embodiments of the application provided in the accompanying drawings is not intended to limit the scope of the application as claimed, but is merely representative of selected embodiments of the application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without creative work fall within the protection scope of the present application.

[0046] It sh...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the technical field of robot vision, and particularly discloses a data fusion method, device and equipment for an event camera and a standard camera, and a medium, and the method comprises the following steps: dividing depth image information into a plurality of pieces of point cloud block information according to the resolution of event information; obtaining forward probability information and backward probability information according to the probability density of the point cloud block information and the event information, wherein the forward probability information and the backward probability information are the forward probability and the backward probability of the event information migrated to the position of the point cloud block information respectively; obtaining correlation information of the point cloud block information and the event information according to the forward probability information and the backward probability information; obtaining conditional probabilities of the event information and the point cloud block information according to the correlation information and a total probability formula; fusing the point cloud block information and the event information according to the maximized conditional probability; the method has the characteristics of high matching precision, small calculation amount and high fusion efficiency.

Description

technical field [0001] The present application relates to the field of robot vision technology, and in particular, to a data fusion method, device, device and medium of an event camera and a standard camera. Background technique [0002] Common outdoor robots include unmanned vehicles, drones, and quadruped robots. This outdoor mobile robot is usually used to undertake tasks such as inspection, target tracking, and handling. In the process of completing the above tasks, the visual recognition function as the "eye" of the robot plays an extremely important role. [0003] Outdoor robots generally rely on various visual sensors to obtain images and use the analyzed image data as the result of environmental recognition. The quality of the image directly affects the robot's ability to achieve autonomous navigation, target tracking, gesture recognition, and 3D reconstruction. So how to solve or improve these image problems is of great significance and practical value. [0004] A...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06V10/80G06V10/75G06V10/30G06K9/62
CPCG06F18/22G06F18/25
Inventor 邓涛张晟东张立华古家威李志建
Owner JIHUA LAB
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com