Unlock instant, AI-driven research and patent intelligence for your innovation.

Peripheral image generation device, peripheral image generation method, and program

A technology for generating devices and images, which is applied in the generation of 2D images, optical observation devices, neural learning methods, etc., and can solve problems that are difficult to intuitively grasp

Pending Publication Date: 2022-03-18
DENSO CORP
View PDF1 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] In the above-mentioned top-view image, if you want to synthesize an area of ​​more than several meters, the area blocked by the surrounding objects will become a steep image, and the closer to the screen edge, the more difficult it is to grasp this situation intuitively.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Peripheral image generation device, peripheral image generation method, and program
  • Peripheral image generation device, peripheral image generation method, and program
  • Peripheral image generation device, peripheral image generation method, and program

Examples

Experimental program
Comparison scheme
Effect test

no. 1 approach

[0020] figure 1 It is a diagram showing the configuration of the peripheral video generation device 1 according to the first embodiment. The surrounding video generation device 1 is connected to four cameras 20 mounted on a vehicle and a display 21 . The four cameras 20 are cameras 20 that take pictures of the front, rear, left, and right sides of the vehicle, respectively. The display 21 can also be used as the display 21 of the navigation device, and displays images captured by the camera 20 .

[0021] Peripheral image generating device 1 has: image input unit 10, input the peripheral image data captured by four cameras 20; image processing unit 11, processing the peripheral image data input to image input unit 10 to generate a top view image; image output Section 17, which outputs the top view image; memory 18; and power supply section 19. Video output unit 17 sends video data to display 21 .

[0022] The image processing unit 11 includes: an image synthesizing unit 12,...

no. 2 approach

[0041] Figure 4 It is a figure which shows the structure of the surrounding video generation apparatus 2 of 2nd Embodiment. The surrounding video generation device 2 of the second embodiment includes a detection data acquisition unit 23 that acquires detection data from the LIDAR 22 in addition to the configuration described in the first embodiment. In the second embodiment, the three-dimensional shape estimating unit 13 estimates the three-dimensional shape of an object located around the vehicle using detection data acquired from the LIDAR 22 .

[0042] Figure 5 It is a diagram showing the operation of the peripheral video generation device 2 according to the second embodiment.

[0043] The surrounding image generating device 2, when image data is input from the four cameras 20 (S20), synthesizes the image data of the four cameras 20 to generate a top view image (S21). In addition, in parallel with this, the peripheral video generation device 2 acquires data from the LI...

no. 3 approach

[0048] Image 6 It is a figure which shows the structure of the surrounding video generation apparatus 3 of 3rd Embodiment. The surrounding video generation device 3 of the third embodiment is different in that it does not use deep learning to estimate the video of the occlusion area, but uses the image generation of the environment where the vehicle is placed.

[0049] The peripheral video generation device 3 of the third embodiment has a communication unit 24 and communicates with a parking lot management device 30 that manages a parking lot. The parking lot management device 30 includes a storage unit that stores images of managed parking lots. The parking lot management device 30 transmits the image to the surrounding image generating device 3 upon requesting transmission of an image of the parking lot from the surrounding image generating device 3 mounted on the vehicle.

[0050] The video processing unit 11 of the surrounding video generation device 3 according to the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a peripheral image generation device, a peripheral image generation method, and a program. A peripheral image generation device (1) is provided with: an image input unit (10) for inputting peripheral image data captured by a plurality of cameras (20); an image synthesis unit (12) that synthesizes the peripheral image data to generate a synthesized image observed from a predetermined viewpoint; a three-dimensional shape estimation unit (13) that estimates the three-dimensional shape of an object located in the periphery on the basis of the peripheral image data; an occlusion region estimation unit (14) that estimates an occlusion region that cannot be observed from a predetermined viewpoint in the composite video using the estimation result of the three-dimensional shape; an estimation unit (15) that estimates an image of the occlusion region using deep learning; and a video superimposition unit (16) that superimposes the video estimated by the estimation unit (15) on the occlusion region of the composite video.

Description

[0001] Cross References to Related Applications [0002] This application claims priority to Patent Application No. 2019-147985 filed on August 9, 2019, the entire contents of which are hereby incorporated by reference. technical field [0003] The present disclosure relates to a peripheral image generation device, a peripheral image generation method, and a program. Background technique [0004] Conventionally, in order to accurately recognize the situation around the vehicle, there is known a device that provides the driver with an image captured by a camera mounted on the vehicle. For example, Patent Document 1 discloses an invention of a peripheral image generation device that corrects images captured by cameras installed in the front, rear, left, and right sides of a vehicle into a top view format and provides the driver with the surrounding image. [0005] Patent Document 1: Japanese PCT Publication No. 2012-514558 [0006] In the above-mentioned top-view image, if i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): B60R1/27H04N7/18G08G1/16G06T7/55G06V20/56G06N3/04G06N3/08
CPCB60R1/00H04N7/181G08G1/166G06T7/55G06N3/08B60R2300/105B60R2300/303G06T2207/10028G06T2207/20081G06T2207/20084G06T2207/30252G06N3/045G08G1/16H04N7/18G06T1/00G06T7/579G06T2207/10016G06T7/50G06T11/00
Inventor 小口贵弘服部阳介关川雄介
Owner DENSO CORP