Display control device and display control method
The display control device improves rear visibility in vehicles by adjusting image processing conditions based on detected lanes and roads, minimizing blind spots and enhancing safety during maneuvers.
Patent Information
- Application Number
- JP2023500522
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2021-02-18
- Filing Date
- 2021-10-12
- Publication Date
- 2025-07-03
- Estimated Expiration
- 2041-10-12
AI Technical Summary
Conventional display systems in vehicles with electronic mirrors struggle to provide clear visibility of the rear area, leading to potential blind spots and increased risk of overlooking vehicles or pedestrians during maneuvers like lane changes.
A display control device that includes a detection unit to determine the number of roads and lanes, adjusting processing conditions for captured images to ensure essential areas are displayed clearly, with varying compression rates based on the detected environment to minimize blind spots.
Enhances the visibility of vehicles and pedestrians in the rear area by optimizing image compression based on the detected environment, reducing the likelihood of missed observations during vehicle maneuvers.
Smart Images

Figure 0007702214000001 
Figure 0007702214000002 
Figure 0007702214000003
Abstract
Description
Technical Field
[0001] The present disclosure relates to a display control device and a display control method.
Background Art
[0002] In recent years, vehicles equipped with an electronic mirror that captures an image of the surroundings of the host vehicle with a camera and displays the captured video on a display device have been increasing. The surroundings of the host vehicle are, for example, the rear of the host vehicle. However, similar to the case of rearward confirmation with an optical mirror, there may be a blind spot in the rear side of the video displayed on the electronic mirror. Therefore, in order for the driver to confirm a vehicle or the like existing in the rear side, direct visual observation is still required. Therefore, for example, when changing lanes or the like, the driver is likely to overlook the forward view.
[0003] On the other hand, as an area behind the vehicle, a technique has been proposed in which an area beyond the range visible with an optical mirror is captured with a camera, and the captured image is compressed so that the compression rate in the vehicle width direction gradually increases from the inside to the outside of the vehicle and is displayed on a display device (see, for example, Patent Document 1).
Prior Art Documents
Patent Documents
[0004]
Patent Document 1
Summary of the Invention
[0005] However, in the conventional technology, since the compression rate of the area for displaying the rear side of the host vehicle is high, it may be difficult for the driver to visually recognize. Therefore, when the driver changes lanes or the like, there is a possibility of overlooking a vehicle existing in the rear side.
[0006] The present disclosure has been made in view of the above, and an object thereof is to make it easier to visually recognize a vehicle existing in the rear side.
[0007] In order to achieve the above object, the display control device of the present disclosure includes a first detection unit that detects the number of roads including the road on which the host vehicle travels, and according to the number of roads detected by the first detection unit, among the captured images of the surroundings of the host vehicle, a determination unit that determines processing conditions for areas other than the essential display area indicating a predetermined display area, and a display control unit that processes the captured image according to the processing conditions determined by the determination unit and performs control to be displayed on a display device.
[0008] According to the present disclosure, it is possible to make it easier to visually recognize a vehicle or the like existing in the rear side. Note that the effects described here are not necessarily limited, and any of the effects described in this specification may be applicable.
Brief Description of the Drawings
[0009]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13
Figure 14
Figure 15
Figure 16
Figure 17
Figure 18
Figure 19
Figure 20
BEST MODE FOR CARRYING OUT THE INVENTION
[0010] Hereinafter, embodiments of the display control device and the display control method according to the present disclosure will be described with reference to the drawings.
[0011] [First Embodiment] (Example of Vehicle Configuration) FIG. 1 is a schematic diagram showing an example of a vehicle 5 including a drive recorder unit 10 according to the first embodiment. As shown in FIG. 1, the vehicle 5 of the first embodiment includes, for example, a drive recorder unit 10, a rear camera 32, and a display device 25. The vehicle 5 may include a front camera 31 and a display 45. Hereinafter, an example in which the vehicle 5 includes the front camera 31 and the display 45 will be described.
[0012] The front camera 31 is disposed, for example, on the front windshield of the vehicle 5. The front camera 31 images the outside of the vehicle 5 and generates a front video signal. The front camera 31 images, for example, the front of the vehicle 5. The front video signal includes, for example, information on the front video. The front video is, for example, a video obtained by imaging the front of the vehicle 5 with the front camera 31.
[0013] The rear camera 32 is disposed, for example, on the rear windshield of the vehicle 5. The rear camera 32 images the outside of the vehicle 5 and generates a rear video signal. The rear camera 32 images, for example, the rear of the vehicle 5. The rear camera 32 may be capable of wide-angle shooting. The rear video signal includes, for example, information on the rear video. The rear video is, for example, a video obtained by imaging the rear of the vehicle 5 with the rear camera 32 capable of wide-angle shooting.
[0014] The drive recorder unit 10 is housed, for example, in the console box of the vehicle 5. The processing of the drive recorder unit 10 will be described later. The drive recorder unit 10 is an example of a display control device.
[0015] The display device 25 displays the rear of the vehicle 5. The display device 25 displays, for example, the rear video of the vehicle 5. The display device 25 is, for example, a liquid crystal display. The display device 25 may be a mirror-type display device imitating a mirror for checking the rear of the vehicle 5. The display device 25 is, for example, an electronic mirror.
[0016] The display device 25 displays a rear image that has been subjected to predetermined processing by, for example, an electronic control unit (ECU) integrally formed with the display device 25. In the present embodiment, the display device 25 is an electronic mirror in the form of a rearview mirror.
[0017] Although the display device 25 is described as an electronic mirror in the form of a rearview mirror in FIG. 1, when the display device 25 is an electronic mirror, the display device 25 may be another form of electronic mirror for rearward confirmation. The display device 25 may be, for example, an electronic mirror having the form of a door mirror or a fender mirror.
[0018] The display 45 displays information regarding the vehicle 5. The display 45 displays, for example, a front image of the vehicle 5. The display 45 is, for example, a liquid crystal display. The display 45 may be, for example, a panel-type liquid crystal display embedded in an instrument panel or the like.
[0019] The display 45 may display an image of another camera (not shown) provided on the side or inside of the vehicle 5. Further, the display 45 may display an image synthesized from images of a plurality of cameras that image the outside of the vehicle, including the front camera 31 and the rear camera 32. The image synthesized from the images of the plurality of cameras is, for example, an omnidirectional bird's-eye view image.
[0020] (Configuration example of the display control system) FIG. 2 is a block diagram showing an example of the configuration of the display control system 1 according to the first embodiment.
[0021] As shown in FIG. 2, the display control system 1 of the first embodiment includes a drive recorder unit 10, a display unit 20, and a rear camera 32. The display control system 1 of the first embodiment is configured to be mountable on, for example, the vehicle 5 described above. The display control system 1 may include a front camera 31 and a display unit 40. Hereinafter, an example in which the display control system 1 includes the front camera 31 and the display unit 40 will be described.
[0022] The drive recorder unit 10 includes a microcomputer 11, a serializer 13m, and a deserializer 14m. The drive recorder unit 10 may include a serializer 13p and a deserializer 14p. Hereinafter, an example in which the drive recorder unit 10 includes the serializer 13p and the deserializer 14p will be described.
[0023] The microcomputer 11 is, for example, a computer including a CPU (Central Processing Unit), a ROM (Read Only Memory), and a RAM (Random Access Memory). The microcomputer 11 is configured as an SoC (System on Chip) including, for example, an image processing processor 11p and a control unit 11c. The control unit 11c controls the image processing processor 11p.
[0024] The microcomputer 11 can control the serializer 13m by transmitting a control signal SG3 to the serializer 13m. Also, the microcomputer 11 can control the deserializer 14m by transmitting a control signal SG4 to the deserializer 14m.
[0025] The microcomputer 11 controls the serializer 13p by transmitting a control signal SG1 to the serializer 13p. Also, the microcomputer 11 controls the deserializer 14p by transmitting a control signal SG2 to the deserializer 14p. Specifically, the control unit 11c controls the serializer 13m, the deserializer 14m, the serializer 13p, and the deserializer 14p by transmitting the respective control signals.
[0026] When the microcomputer 11 receives the video signal SGr1 as a rear video signal from the rear camera 32, it transmits a control signal SG4 to the deserialzier 14m to receive the video signal SGr1 from the rear camera 32. The video signal SGr1 received by the deserialzier 14m is, for example, a serialized video signal.
[0027] When the deserialzier 14m receives the control signal SG4 from the microcomputer 11, it receives the video signal SGr1 transmitted from the rear camera 32. The deserialzier 14m transmits the video signal SGr1 to the microcomputer 11 and the serializer 13m. The deserialzier 14m may transmit the received video signal SGr1 after converting it into parallel data.
[0028] When the microcomputer 11 receives the video signal SGf1 as a front video signal from the front camera 31, it transmits a control signal SG2 to the deserialzier 14p to receive the video signal SGf1 from the front camera 31. The video signal SGf1 received by the deserialzier 14p is, for example, a serialized video signal.
[0029] When the deserialzier 14p receives the control signal SG2 from the microcomputer 11, it receives the video signal SGf1 transmitted from the front camera 31. The deserialzier 14p transmits the video signal SGf1 to the microcomputer 11. The deserialzier 14p may transmit the received video signal SGf1 after converting it into parallel data.
[0030] The microcomputer 11 receives the rear video signal generated by the rear camera 32 as the video signal SGr1 from the deserialzier 14m. Specifically, the image processing processor 11p receives the video signal SGr1 from the deserialzier 14m.
[0031] The image processing processor 11p performs video processing such as extraction processing and compression processing, which will be described later, on the video signal SGr1 to generate a video signal SGr2. The video signal SGr2 is a signal for displaying the processed rear video.
[0032] The image processing processor 11p transmits the video signal SGr2 to the serializer 13m. In other words, the microcomputer 11 transmits the video signal SGr2 to the serializer 13m. The microcomputer 11 may convert the video signal SGr2 into parallel data and then transmit it to the serializer 13m.
[0033] The microcomputer 11 receives the front video signal generated by the front camera 31 as a video signal SGf1 from the deserialzer 14p. Specifically, the image processing processor 11p receives the video signal SGf1 from the deserialzer 14p.
[0034] The image processing processor 11p performs video processing such as color and contrast adjustment on the video signal SGf1 to generate a video signal SGf2. The image processing processor 11p transmits the video signal SGf2 and the video signal SGr2 to the serializer 13p.
[0035] In other words, the microcomputer 11 transmits the video signal SGf2 and the video signal SGr2 to the serializer 13p. The microcomputer 11 may convert the video signal SGf2 and the video signal SGr2 into parallel data and then transmit them to the serializer 13p.
[0036] When the serializer 13m receives the control signal SG3 from the microcomputer 11, it transmits the video signal SGr2 received from the microcomputer 11 to the display unit 20. For example, when the serializer 13m receives the video signal SGr2 converted into parallel data from the microcomputer 11, it may convert it into serial data and then transmit the video signal SGr2.
[0037] The microcomputer 11 controls the serializer 13p to transmit the video signal SGf2 and the video signal SGr2 to the display unit 40 by sending the control signal SG1.
[0038] When the serializer 13p receives the control signal SG1 from the microcomputer 11, it transmits the video signal SGf2 and the video signal SGr2 received from the microcomputer 11 to the display unit 40. For example, when the serializer 13p receives the video signal SGf2 and the video signal SGr2 converted from parallel data from the microcomputer 11, it may transmit the video signal SGf2 after converting it into serial data.
[0039] Note that the transmission of the control signal SG1 from the microcomputer 11 to the serializer 13p, the transmission of the control signal SG2 to the deserializer 14p, the transmission of the control signal SG3 to the serializer 13m, and the transmission of the control signal SG4 to the deserializer 14m are performed, for example, in the I2C (Inter-Integrated Circuit) format.
[0040] Also, the transmission of the video signal SGf1 from the deserializer 14p to the microcomputer 11, the transmission of the video signal SGf2 and the video signal SGr2 from the microcomputer 11 to the serializer 13p, the transmission of the video signal SGr1 from the deserializer 14m to the microcomputer 11, and the transmission of the video signal SGr2 from the microcomputer 11 to the serializer 13m are performed, for example, in the MIPI (Mobile Industry Processor Interface) format.
[0041] Also, the transmission of the video signal SGr1 from the rear camera 32 to the deserializer 14m, the transmission of the video signal SGr2 from the serializer 13m to the display unit 20, the transmission of the video signal SGf1 from the front camera 31 to the deserializer 14p, and the transmission of the video signal SGf2 and the video signal SGr2 from the serializer 13p to the display unit 40 are performed, for example, in the FPD-Link III (Flat Panel Display-Link III) format.
[0042] These video transmissions may be performed by wired communication or wireless communication. For example, video transmission may be performed by wired communication using a coaxial cable. For example, video transmission may be performed by wireless communication using Wi-Fi (registered trademark).
[0043] The display unit 40 includes a display 45. The display unit 40 is configured as part of, for example, an in-vehicle infotainment (IVI) system.
[0044] The display unit 40 transmits the received video signal SGf2 and video signal SGr2 to the display 45. The display 45 can display a forward video based on the received video signal SGf2. Also, the display 45 can display a rearward video based on the received video signal SGr2.
[0045] The display unit 20 includes a display device 25. The display unit 20 may include an ECU (Electronic Control Unit) 21. Hereinafter, an example in which the display unit 20 includes the ECU 21 will be described. The ECU 21 is a computer including, for example, a CPU, a ROM, and a RAM.
[0046] The display unit 20 transmits the received video signal SGr2 to the ECU 21. The ECU 21 performs video processing on the video signal SGr2. The video processing is, for example, adjustment of color and contrast performed so as to be suitable for display on the display device 25.
[0047] The video signal SGr2 subjected to video processing by the ECU 21 is passed to the display device 25. The display device 25 displays a rearward video that is a video generated based on the video signal SGr2.
[0048] (Functional Configuration of Drive Recorder Unit of First Embodiment) Next, the functional configuration of the drive recorder unit 10 according to the first embodiment will be described with reference to FIG. 3. FIG. 3 is a functional block diagram showing an example of the functional configuration of the microcomputer 11 of the drive recorder unit 10 according to the first embodiment.
[0049] The microcomputer 11 of the drive recorder unit 10 expands the control program stored in the ROM of the microcomputer 11 to the RAM and operates the CPU and the image processing processor 11p, thereby realizing, as functional units, the acquisition unit 111, the first detection unit 112, the first determination unit 113, the second determination unit 114, the generation unit 115, and the display control unit 116 shown in FIG. 3.
[0050] The acquisition unit 111 acquires a captured image of an area around the host vehicle including the rear side of the host vehicle. In the present disclosure, "acquire" also includes receiving transmitted information, signals, images, etc. Specifically, the acquisition unit 111 acquires the rear video generated by the rear camera 32. For example, the acquisition unit 111 acquires the video signal SGr1. Further, the acquisition unit 111 acquires the front video generated by the front camera 31. For example, the acquisition unit 111 acquires the video signal SGf1.
[0051] FIG. 4 is a diagram showing an example of the rear video of the host vehicle captured by the rear camera 32 according to the first embodiment. In the rear video D shown in FIG. 4, vehicle A1, vehicle A2, lane B1, lane B2, and lane B3 are drawn. In this example, the rear video D is a video obtained by capturing the rear of the host vehicle traveling in lane B2 with the wide-angle rear camera 32. Vehicle A1 is traveling in lane B2, the same as the host vehicle, and vehicle A2 is traveling in lane B3 to the left of the host vehicle.
[0052] The first detection unit 112 detects the number of roads indicating the number of one or more roads including the road on which the host vehicle is traveling. In this specification, the number of roads represents the total number of lanes on which vehicles travel and sidewalks on which pedestrians walk. In other words, a road includes a lane and a sidewalk.
[0053] Specifically, the first detection unit 112 detects the number of lanes by detecting a lane change line, the boundary between a road lane and a sidewalk, or the like from the rear image acquired by the acquisition unit 111. The rear image is an example of a captured image. The boundary between a road lane and a sidewalk is, for example, a curb. For example, in the example of FIG. 4, since there are three lanes, namely lane B1, lane B2, and lane B3, the first detection unit 112 detects that the number of lanes is "3".
[0054] Note that the first detection unit 112 may not count the number of lanes for vehicles traveling in the opposite direction to the host vehicle as the number of lanes. Hereinafter, a lane for a vehicle traveling in the opposite direction to the host vehicle may be referred to as an oncoming lane.
[0055] As a method for discriminating an oncoming lane, for example, there is a method of detecting a median strip or a center line in the rear image and discriminating whether or not the lane is an oncoming lane based on the positional relationship between the median strip or the center line and the lane. Further, for example, it may be discriminated whether or not the lane is an oncoming lane from the traveling direction of a vehicle traveling in the lane in the rear image.
[0056] Further, for example, information regarding the lane may be acquired based on the reception result of a positioning signal, which is a signal transmitted from an artificial satellite in the sky and indicates the position of the vehicle 5, and it may be discriminated whether or not the lane is an oncoming lane.
[0057] Further, for example, it may be discriminated whether or not the lane is an oncoming lane by performing vehicle-to-roadside-infrastructure communication with a device installed on the road to acquire information regarding the lane.
[0058] In the present embodiment, the first detection unit 112 detects the number of lanes from the captured image acquired by the acquisition unit 111, but the first detection unit 112 may detect the number of lanes based on the reception result of the positioning signal.
[0059] Further, the first detection unit 112 may detect the number of roads by performing vehicle-to-roadside communication to obtain information regarding the road.
[0060] The first determination unit 113 determines a cut-out area according to the number of roads detected by the first detection unit 112. The first determination unit 113 is an example of a determination unit. The cut-out area is an area of the captured image that is displayed on the display device 25. The determination of the cut-out area is an example of a processing condition.
[0061] Specifically, the first determination unit 113 first determines an essential display area indicating a predetermined area in the rear video acquired by the acquisition unit 111. The essential display area is determined by the first determination unit 113 according to predetermined conditions.
[0062] The conditions for determining the essential display area can be freely set in principle as long as they satisfy the regulations regarding the field of view of Rule 46 (UN-R46: United Nations - Regulation 46) defined by the United Nations.
[0063] The regulations regarding the field of view of UN-R46 are as follows: "The field of view shall be such that the driver can visually observe at least a 20 m wide flat horizontal portion of the road centered on the vertical longitudinal center plane of the vehicle, and from 60 m behind the driver's eye point to the horizontal line."
[0064] FIG. 5 is an image diagram showing an example of the determination process of the essential display area according to the first embodiment. As shown in FIG. 5, the first determination unit 113 determines a predetermined area (the area within the black frame) in the rear video D as the essential display area E.
[0065] After determining the essential display area E, the first determination unit 113 determines a cut-out area including the essential display area E according to the number of roads detected by the first detection unit 112. For example, the first determination unit 113 determines the cut-out area centered on the essential display area E based on a table associating the number of roads detected by the first detection unit 112 with the size of the cut-out area.
[0066] In principle, the larger the number of roads, the larger the cut-out area, and the smaller the number of roads, the smaller the cut-out area. However, when the number of roads is too large, the cut-out area may become too large. Therefore, the first determination unit 113 may set an upper limit on the size of the cut-out area so that the size does not exceed the upper limit.
[0067] FIG. 6 is an image diagram showing an example of the determination process of the cut-out area according to the first embodiment. First, the first determination unit 113 determines the size of the cut-out area corresponding to the number of roads "3" detected by the first detection unit 112. Then, as shown in FIG. 6, the first determination unit 113 determines a cut-out area C centered on the essential display area E.
[0068] The cut-out area C is composed of an essential display area E, a left area L located on the left side of the essential display area E in the video, and a right area R located on the right side of the essential display area E in the video.
[0069] Returning to FIG. 3, the description continues. The second determination unit 114 determines processing conditions for areas other than the essential display area within the cut-out area of the captured image that captures the surroundings of the host vehicle according to the number of roads detected by the first detection unit 112. Hereinafter, among the areas within the cut-out area of the captured image, the areas other than the essential display area may be referred to as compression target areas. The second determination unit 114 is an example of a determination unit. Note that the second determination unit 114 may also have the function of the above-described first determination unit 113. Further, the first determination unit 113 may also have the function of the second determination unit 114.
[0070] For the compression target areas within the cut-out area, the second determination unit 114 determines the compression rate of the display in the vehicle width direction according to the number of roads detected by the first detection unit 112. In the example of FIG. 6, the compression target areas are the left area L and the right area R. The compression rate of the display in the vehicle width direction indicates how much the captured image is compressed and displayed in the vehicle width direction.
[0071] For example, the second determination unit 114 determines the compression ratio of the compression target area within the cutout area based on a table associating the number of roads detected by the first detection unit 112 with the compression ratio.
[0072] In principle, the compression ratio increases as the number of roads increases and decreases as the number of roads decreases. However, when the number of roads is too large, the compression ratio may become too high. Therefore, the first determination unit 113 may set an upper limit for the compression ratio so that the compression ratio does not exceed the upper limit.
[0073] In the example of FIG. 6, the second determination unit 114 determines the compression ratio corresponding to the number of roads "3" detected by the first detection unit 112 as the compression ratio of the left area L and the right area R. The second determination unit 114 determines to compress the left area L and the right area R, for example, twice in the vehicle width direction.
[0074] Returning to FIG. 3 and continuing the explanation, the generation unit 115 generates a display image for display on the display device by processing the captured image according to the processing conditions determined by the first determination unit 113 and the second determination unit 114.
[0075] Specifically, the generation unit 115 first cuts out the cutout area C determined by the first determination unit 113 from the rear video D. Next, the generation unit 115 performs a process of compressing the left area L and the right area R of the cutout area C according to the compression ratio determined by the second determination unit 114, and generates a display image for display on the display device 25. For example, the generation unit 115 performs a process of compressing the left area L and the right area R twice in the vehicle width direction. The display image here is an image displayed based on, for example, the video signal SGr2.
[0076] In addition, the generation unit 115 performs video processing such as color and contrast adjustment on the front video acquired by the acquisition unit 111 to generate a display image. The display image here is an image displayed based on, for example, the video signal SGf2.
[0077] The display control unit 116 processes the captured image according to the processing conditions determined by the first determination unit 113 and the second determination unit 114, and performs control to display it on the display device. Specifically, the display control unit 116 performs control to display the display image generated by the generation unit 115 on the display device 25. Also, the display control unit 116 performs control to display the display image generated by the generation unit 115 on the display 45.
[0078] FIG. 7 is an example of a display image displayed on the display device 25 according to the first embodiment. In the example of FIG. 7, the display image W is composed of a left compression region LP, an essential display region E, and a right compression region RP. The essential display region E is displayed on the display device 25 at the same scale as the rear video D by the display control unit 116.
[0079] The left compression region LP is a region obtained by compressing the left region L of the cutout region C in FIG. 6 by a factor of two in the vehicle width direction. The right compression region RP is a region obtained by compressing the right region R of the cutout region C in FIG. 6 by a factor of two in the vehicle width direction. Note that the frames such as the black frames in FIG. 7 are drawn for convenience of explanation, and no frame is displayed in the display image W actually displayed on the display device 25.
[0080] Also, in the above example, the second determination unit 114 has determined to uniformly compress the compression target region of the cutout region C by a factor of two in the vehicle width direction, but the compression ratio may vary depending on the position within the compression region. For example, the second determination unit 114 may determine the compression ratio so that the compression ratio of the compression region gradually increases as it goes from the center of the cutout region C toward the outside.
[0081] FIG. 8 is an image diagram showing an example of the cutout region before compression in the case where the compression ratio is changed according to the position within the compression region according to the first embodiment. In the example of FIG. 8, the cutout region C is composed of a first left region L1, a second left region L2, an essential display region E, a first right region R1, and a second right region R2. Note that the first detection unit 112 and the first determination unit 113 perform the same processing as the processing described with reference to FIGS. 5 and 6.
[0082] The second determination unit 114 determines the compression ratios corresponding to the number of roads “3” detected by the first detection unit 112. For example, the second determination unit 114 determines that the first left region L1 and the first right region R1 are compressed by a factor of 2 in the vehicle width direction, and the second left region L2 and the second right region R2 are compressed by a factor of 4 in the vehicle width direction.
[0083] The generation unit 115 cuts out the cutout region C according to the determination of the first determination unit 113. Then, the generation unit 115 compresses the first left region L1 and the first right region R1 of the cutout region C by a factor of 2 in the vehicle width direction and the second left region L2 and the second right region R2 by a factor of 4 in the vehicle width direction according to the compression ratios determined by the second determination unit 114, and generates a display image W for display on the display device 25. The display control unit 116 displays the display image W generated by the generation unit 115 on the display device 25.
[0084] FIG. 9 is an example of a display image displayed on the display device 25 according to the first embodiment. In the example of FIG. 9, the display image W is composed of a first left compression region LP1, a second left compression region LP2, an essential display region E, a first right compression region RP1, and a second right compression region RP2. The essential display region E is displayed on the display device 25 at the same scale as the rear video D by the display control unit 116.
[0085] The first left compression region LP1 is a region obtained by compressing the first left region L1 of the cutout region C in FIG. 8 by a factor of 2 in the vehicle width direction. The second left compression region LP2 is a region obtained by compressing the second left region L2 by a factor of 4 in the vehicle width direction.
[0086] The first right compression region RP1 is a region obtained by compressing the first right region R1 by a factor of 2 in the vehicle width direction. The second right compression region RP2 is a region obtained by compressing the second right region R2 by a factor of 4 in the vehicle width direction. Note that the frames such as the black frames in FIG. 9 are drawn for convenience of explanation, and no frames are displayed in the display image W actually displayed on the display device 25.
[0087] In this way, by the second determination unit 114 determining the compression ratio so that the compression ratio in the vehicle width direction gradually increases from the inside to the outside of the host vehicle with respect to the captured image, for example, an area close to the host vehicle can be displayed at a scale close to the rear video D, and an area far from the host vehicle can be displayed at a higher compression ratio. As a result, it is possible to display the display image W while reducing the blind spot area and without reducing the visibility of the area highly important to the user.
[0088] Note that the second determination unit 114 may determine whether to make the compression ratio uniform or change the compression ratio for each area according to the number of lanes. For example, when the number of lanes is within 3, the second determination unit 114 may make the compression ratio uniform as shown in FIG. 7, and when it exceeds 3, the compression ratio may be changed stepwise as shown in FIG. 9.
[0089] (Processing of the drive recorder unit according to the first embodiment) Next, the processing executed by the drive recorder unit 10 according to the first embodiment will be described. FIG. 10 is a flowchart showing an example of the processing executed by the drive recorder unit 10 according to the first embodiment.
[0090] First, the acquisition unit 111 acquires, as a captured image, the rear video generated by the rear camera 32 (step S1).
[0091] Next, the first detection unit 112 detects the number of lanes based on the rear video acquired by the acquisition unit 111 (step S2).
[0092] Next, the first determination unit 113 determines the essential display area of the rear video. Then, the first determination unit 113 determines a cutout area centered on the essential display area according to the number of lanes detected by the first detection unit 112 (step S3).
[0093] Next, the second determination unit 114 determines the compression ratio of the compression target area in the cutout area according to the number of lanes detected by the first detection unit 112 (step S4).
[0094] Next, the generation unit 115 cuts out the cut-out area determined by the first determination unit 113 from the rear video. Then, the generation unit 115 performs a process of compressing the compression target area in the cut-out area in the vehicle width direction according to the compression rate determined by the second determination unit 114, and generates a display screen for display on the display device 25 (step S5).
[0095] Next, the display control unit 116 performs control to display the display image generated by the generation unit 115 on the display device 25 (step S6).
[0096] Next, the display control unit 116 determines whether to end the display of the display image (step S7). For example, when a predetermined time has elapsed since the power source such as the engine of the vehicle 5 was stopped, the display control unit 116 determines to end the display.
[0097] If the display of the display image is not ended (step S7: No), the process proceeds to the process of step S1. On the other hand, when the display of the display image is ended (step S7: Yes), the display control unit 116 ends this process.
[0098] (Effect of the drive recorder unit according to the first embodiment) Next, the effect of the drive recorder unit 10 according to the first embodiment will be described. The drive recorder unit 10 according to the present embodiment determines the processing conditions for areas other than the above-described essential display areas among the captured images of the surroundings of the host vehicle according to the number of roads including one or more roads on which the host vehicle travels.
[0099] More specifically, in the present embodiment, the second determination unit 114 determines the processing conditions so as to increase the compression rate in proportion to the number of roads. Therefore, when the number of roads is small, the compression rate is low. For this reason, it is possible to prevent a situation in which the captured image is compressed at a high compression rate despite the small number of roads, making it difficult for the vehicle behind to visually recognize. That is, according to the drive recorder unit 10 according to the present embodiment, it is possible to make it easier to visually recognize a vehicle or the like existing at the rear side.
[0100] In addition, "road" includes sidewalks. Therefore, by looking at the display device 25, the user can also confirm the actions of pedestrians behind and to the side.
[0101] [Second Embodiment] Next, the drive recorder unit 10 according to the second embodiment will be described.
[0102] The drive recorder unit 10 according to the second embodiment differs from the drive recorder unit 10 according to the first embodiment in that it includes a second detection unit 117 as a functional unit. Hereinafter, the drive recorder unit 10 according to the second embodiment will be described with reference to FIGS. 11 to 20. For the same configurations and operations as those described in the first embodiment, the same reference numerals will be used, and the description thereof will be omitted or simplified.
[0103] (Functional Configuration of the Drive Recorder Unit in the Second Embodiment) The functional configuration of the drive recorder unit 10 according to the second embodiment will be described with reference to FIG. 11. FIG. 11 is a functional block diagram showing an example of the functional configuration of the microcomputer 11 of the drive recorder unit 10 according to the second embodiment.
[0104] The drive recorder unit 10 according to the second embodiment further includes a second detection unit 117 in addition to the functional units included in the drive recorder unit 10 according to the first embodiment.
[0105] The second detection unit 117 detects the traveling position of the host vehicle. The second detection unit 117 is an example of a detection unit. Specifically, the second detection unit 117 detects lane change lines, the boundary between the road and the sidewalk, etc. from the rear image acquired by the acquisition unit 111, and detects the traveling position of the host vehicle from the positional relationship in these rear images.
[0106] In this embodiment, the second detection unit 117 detects the traveling position of the host vehicle from the captured image acquired by the acquisition unit 111. However, the second detection unit 117 may detect the traveling position of the host vehicle based on the reception result of the positioning signal. Further, the second detection unit 117 may perform vehicle-road communication with devices installed on the road and detect the traveling position of the host vehicle based on the communication result or the like. The communication result includes, for example, the communication speed and the signal strength.
[0107] Note that the second detection unit 117 may also function as the first detection unit 112 described above. Further, the first detection unit 112 may also function as the second detection unit 117.
[0108] FIG. 12 is a diagram showing an example of a rear view image of the host vehicle captured by the rear camera 32 according to the second embodiment. In the rear view image D shown in FIG. 12, a vehicle A1, a vehicle A2, a lane B1, a lane B2, and a lane B3 are drawn. In this example, the rear view image D is an image captured by the wide-angle rear camera 32 of the rear of the host vehicle traveling in the lane B1. The vehicle A1 is traveling in the same lane B1 as the host vehicle, and the vehicle A2 is traveling in the lane B3.
[0109] In the example of FIG. 12, the second detection unit 117 detects that the traveling position of the host vehicle is "the leftmost lane on the image" from the positional relationship between the lanes B1, B2, and B3 in the rear view image D. The leftmost lane on the image is the lane B1.
[0110] The first determination unit 113 determines the cutout area according to the number of roads detected by the first detection unit 112 and the traveling position of the host vehicle detected by the second detection unit 117.
[0111] Specifically, the first determination unit 113 performs the same processing as in the first embodiment to determine the size of the cutout area. Next, the first determination unit 113 determines how to cut out the cutout area according to the traveling position of the host vehicle detected by the second detection unit 117.
[0112] For example, when there is no lane or sidewalk on the left side of the host vehicle, the importance of the information on the left side of the host vehicle decreases. Therefore, in this case, the first determination unit 113 determines the cutting method such that the left end of the essential display area coincides with the left end of the cut-out area.
[0113] FIG. 13 is an image diagram showing an example of the determination process of the cut-out area according to the second embodiment. As shown in FIG. 13, in response to the running position of the host vehicle detected by the second detection unit 117 being "the leftmost lane on the image", the first determination unit 113 determines the cutting method such that the left end of the essential display area E coincides with the left end of the cut-out area C.
[0114] In the example of FIG. 13, the cut-out area C is composed of the essential display area E and the compression target area O located on the right side of the essential display area E on the image.
[0115] The second determination unit 114 determines the processing conditions for the area other than the essential display area in the captured image according to the number of lanes detected by the first detection unit 112 and the running position of the host vehicle detected by the second detection unit 117.
[0116] The second determination unit 114 determines, for example, the compression method for the compression target area in the cut-out area based on a table associating the number of lanes detected by the first detection unit 112, the running position detected by the second detection unit 117, and the compression method including the compression rate.
[0117] The running position is represented by a numerical value such that, for example, the leftmost lane or sidewalk visible in the captured image is "1", and the lane to the left of it is "2". The compression method represents, for example, the compression rate of the area on the left side of the essential display area and the compression rate of the area on the right side of the essential display area. In addition, the compression method may also define whether to change the compression rate step by step, etc.
[0118] For example, when the host vehicle is traveling in the leftmost lane, the second determination unit 114 increases the compression rate of the area on the left side of the essential display area and decreases the compression rate of the area on the right side. Note that the second determination unit 114 may determine that the compression rate on the right side or the left side is "not displayed". An area whose compression rate is determined to be "not displayed" by the second determination unit 114 is not displayed by the display device 25. Determining that the compression rate of the area on the right side or the left side is "not displayed" can be rephrased as compressing the area on the right side or the left side at an infinite compression rate.
[0119] In the example of FIG. 13, the second determination unit 114 determines, as the compression method for the compression target area O, the compression method corresponding to the number of lanes "3" detected by the first detection unit 112 and the driving position "1" detected by the second detection unit 117. For example, the second determination unit 114 determines that the left side of the essential display area E is not displayed and the right side of the essential display area E is compressed twice in the vehicle width direction. The driving position "1" is the leftmost lane on the image as described above.
[0120] Since the processes of the generation unit 115 and the display control unit 116 are the same as those in the first embodiment, the description thereof is omitted. FIG. 14 is an example of a display image displayed on the display device 25 according to the second embodiment. In the example of FIG. 14, the display image W includes an essential display area E and a compressed display area OP. The essential display area E is displayed on the display device 25 at the same scale as the rear video D by the display control unit 116.
[0121] The compressed display area OP is an area obtained by compressing the compression target area O on the right side of the cutout area C in FIG. 13 twice in the vehicle width direction. Note that the frames such as the black frames in FIG. 13 are drawn for convenience of explanation, and no frame is displayed in the display image W actually displayed on the display device 25.
[0122] Also, in the above example, the second determination unit 114 uniformly compresses the compression target area of the cutout area C twice in the vehicle width direction. However, as in the first embodiment, the compression rate may vary depending on the position within the compression area. For example, the second determination unit 114 may determine the compression rate so that the compression rate of the compression area gradually increases as it goes from the center of the cutout area C toward the outside.
[0123] FIG. 15 is an image diagram showing an example of a cutout area before compression when the compression rate is changed according to the position within the compression area according to the second embodiment. In the example of FIG. 15, the cutout area C is composed of an essential display area E, a first compression target area O1, and a second compression target area O2. Note that the first detection unit 112, the second detection unit 117, and the first determination unit 113 perform the same processing as the processing described with reference to FIG. 13.
[0124] The second determination unit 114 determines a compression method corresponding to the number of roads “3” detected by the first detection unit 112 and the driving position “1” detected by the second detection unit 117. For example, the second determination unit 114 determines that the first compression target area O1 is compressed twice in the vehicle width direction, and the second compression target area O2 is compressed four times in the vehicle width direction.
[0125] The generation unit 115 cuts out the cutout area C according to the determination of the first determination unit 113. Then, the generation unit 115 performs a process of compressing the first compression target area O1 of the cutout area C twice in the vehicle width direction and the second compression target area O2 four times in the vehicle width direction according to the compression method determined by the second determination unit 114, and generates a display image W for display on the display device 25. The display control unit 116 displays the display image W generated by the generation unit 115 on the display device 25.
[0126] FIG. 16 is an example of a display image displayed on the display device 25. In the example of FIG. 16, the display image W is composed of an essential display area E, a first compressed display area OP1, and a second compressed display area OP2. The essential display area E is displayed on the display device 25 at the same scale as the rear video D by the display control unit 116.
[0127] The first compressed display area OP1 is an area obtained by compressing the first compression target area O1 of the cutout area C in FIG. 15 twice in the vehicle width direction. The second compressed display area LP2 is an area obtained by compressing the second compression target area O2 four times in the vehicle width direction. The frames such as the black frames in FIG. 15 are drawn for convenience of explanation, and no frames are displayed in the display image W actually displayed on the display device 25.
[0128] Note that the second determination unit 114 may determine a compression method for each area according to the number of lanes and the driving position. For example, when the number of lanes is within 3, the second determination unit 114 may make the compression ratio uniform as shown in FIG. 14, and when it exceeds 3, the compression ratio may be changed stepwise as shown in FIG. 16.
[0129] In addition, the second determination unit 114 may change the compression method on the left and right sides of the essential display area according to the driving position. For example, in the cut-out area, when the area on the right side of the essential display area is larger than the area on the left side, the second determination unit 114 may determine the compression ratio so that the compression ratio of the area on the right side is higher than that of the area on the left side. The second determination unit 114 may determine, for example, that the area on the left side is compressed twice in the vehicle width direction, the area of the right side close to the essential display area is compressed twice in the vehicle width direction, and the area of the right side far from the essential display area is compressed four times in the vehicle width direction.
[0130] (Processing of the drive recorder unit according to the second embodiment) Next, the processing executed by the drive recorder unit 10 according to the second embodiment will be described. FIG. 17 is a flowchart showing an example of the processing executed by the drive recorder unit 10 according to the second embodiment.
[0131] First, the acquisition unit 111 acquires, as a captured image, the rear video generated by the rear camera 32 (step S11).
[0132] Next, the first detection unit 112 detects the number of lanes based on the rear video acquired by the acquisition unit 111 (step S12).
[0133] Next, the second detection unit 117 detects the driving position based on the rear video acquired by the acquisition unit 111 (step S13).
[0134] Next, the first determination unit 113 determines the essential display area of the rear video. Then, the first determination unit 113 determines the size and the cutting method of the cut-out area according to the number of roads detected by the first detection unit 112 and the driving position detected by the second detection unit 117 (step S14).
[0135] Next, the second determination unit 114 determines the compression method of the compression target area according to the number of roads and the driving position detected by the first detection unit 112 (step S15).
[0136] Next, the generation unit 115 cuts out the cut-out area determined by the first determination unit 113 from the rear video. Then, the generation unit 115 performs a process of compressing the compression target area in the vehicle width direction according to the compression method determined by the second determination unit 114, and generates a display screen for display on the display device 25 (step S16).
[0137] Next, the display control unit 116 performs control to display the display image generated by the generation unit 115 on the display device 25 (step S17).
[0138] Next, the display control unit 116 determines whether to end the display of the display image (step S18). For example, when a predetermined time has elapsed after the power source such as the engine of the vehicle 5 is stopped, the display control unit 116 determines to end the display.
[0139] If the display of the display image is not ended (step S18: No), the process proceeds to the process of step S11. On the other hand, if the display of the display image is ended (step S18: Yes), the display control unit 116 ends this process.
[0140] (Effect of the drive recorder unit according to the second embodiment) Next, the effect of the drive recorder unit 10 according to the second embodiment will be described. The drive recorder unit 10 according to the present embodiment determines the processing conditions of the area other than the above essential display area according to the driving position of the own vehicle.
[0141] More specifically, in the present embodiment, when the host vehicle is traveling in the leftmost lane, the second determination unit 114 increases the compression rate of the area on the left side of the essential display area and decreases the compression rate of the area on the right side. This is because when the host vehicle is traveling in the leftmost lane, there are no vehicles or the like on the left side of the host vehicle, so there is little need to pay attention to the left side of the host vehicle. On the other hand, since there may be vehicles or the like on the right side of the host vehicle, there is a high need to pay attention.
[0142] Therefore, the drive recorder unit 10 according to the present embodiment can display only the portions of high importance in a state with a low compression rate that is easy to visually recognize. That is, it is possible to make it easier to visually recognize vehicles or the like existing in the rear side.
[0143] Note that the above-described embodiment can also be appropriately modified and implemented by changing a part of the configuration or function of the display control system 1. Therefore, some modification examples according to the above-described embodiment will be described as other embodiments below. In the following, the points different from the above-described embodiment will be mainly described, and detailed descriptions of the points common to the already described content will be omitted. Further, the modification examples described below may be implemented individually or in appropriate combination.
[0144] (Modification Example 1) In the above-described first and second embodiments, the form in which the display control system 1 is composed of the drive recorder unit 10, the display unit 20, the front camera 31, the rear camera 32, and the display unit 40 has been described. However, the display control system 1 may be composed of only the display unit 20 and the rear camera 32.
[0145] In this case, the ECU 21 of the display unit 20 expands the control program stored in the ROM of the ECU 21 to the RAM and operates the CPU to realize each functional unit. The ECU 21 realizes, for example, the acquisition unit 111, the first detection unit 112, the first determination unit 113, the second determination unit 114, the generation unit 115, and the display control unit 116 provided in the microcomputer 11 as each functional unit.
[0146] (Modification Example 2) In the above-described first and second embodiments, the form of displaying the rear image subjected to the compression process on the display device 25 has been described. However, the display control unit 116 may perform control to display the rear image subjected to the compression process on the display 45. Further, the display control unit 116 may perform control to display the rear image subjected to the compression process on a head-up display (HUD) or the like mounted on the vehicle 5.
[0147] (Modification Example 3) In the above-described first and second embodiments, the form of displaying only the rear image on the display device 25 has been described. However, an image obtained by synthesizing the front image with the rear image may be displayed on the display device 25.
[0148] In this modification example, the generation unit 115 generates, for example, a display image to be displayed on the display device 25 by synthesizing an image of the front left side of the host vehicle cut out from the front image on the left side of the rear image subjected to the compression process and an image of the front right side of the host vehicle cut out from the front image on the right side.
[0149] Note that the generation unit 115 may detect a pedestrian or a bicycle from the front image and generate a display image to be displayed on the display device 25 by synthesizing the front image with the rear image only when there is a pedestrian or a bicycle. Further, the generation unit 115 may generate a display screen by synthesizing the rear image and the front image such that only the roadway is the display target for the rear image and only the sidewalk is the display target for the front image.
[0150] By generating a display image in which the rear image and the front image are combined by the generation unit 115, the user can obtain information on both the rear and the front from one screen. As a result, it becomes easier for the user to visually recognize the surroundings of the host vehicle, and thus the possibility of an accident can be reduced.
[0151] (Modification Example 4) In the second embodiment described above, the form in which the second determination unit 114 determines the compression method of the captured image based on the number of roads and the driving position has been described. However, in addition to these, the second determination unit 114 may determine the compression method based on the presence or absence of vehicles or the like. Here, the vehicle includes a two-wheeled vehicle.
[0152] The second determination unit 114 of this modification example increases the compression rate of the region in the captured image where no other vehicle or the like exists.
[0153] FIG. 18 is a diagram showing an example of a rear image of the host vehicle according to Modification Example 3. In the example of FIG. 18, no vehicle exists in the region ON, and vehicle A2 exists in the region OE. In this case, the second determination unit 114 increases the compression rate of the region ON and makes the compression rate of the region OE lower than that of the region ON.
[0154] FIG. 19 is an example of a display image to be displayed on the display device 25 according to Modification Example 3. In the example of FIG. 19, the display image W is composed of an essential display region E, a high compression region NP, and a low compression region EP. The essential display region E is displayed on the display device 25 at the same scale as the rear image D by the display control unit 116.
[0155] The high compression region NP is a region obtained by compressing the region ON of the cutout region C in FIG. 18 four times in the vehicle width direction. The low compression region EP is a region obtained by compressing the region OE of the cutout region C in FIG. 18 two times in the vehicle width direction. Note that the frames such as the black frames in FIG. 19 are drawn for convenience of explanation, and no frame is displayed in the display image W actually displayed on the display device 25.
[0156] In this way, by setting a high compression ratio for areas where there are no vehicles or the like and a low compression ratio for areas where there are vehicles or the like, the second determination unit 114 makes it easier to visually recognize objects to be noted existing in the rear side. Therefore, the drive recorder unit 10 of this modified example can make it easier to visually recognize vehicles or the like existing in the rear side.
[0157] (Modified Example 5) The first determination unit 113 and the second determination unit 114 may determine the processing conditions of the captured image in conjunction with the operation of the direction indicator by the user.
[0158] When the user operates the direction indicator, the first determination unit 113 of this modified example determines the cut-out area according to the user's operation. For example, the first determination unit 113 determines in advance the size and the way of cutting out the cut-out area when the direction indicator indicates the left side, and the size and the way of cutting out the cut-out area when the direction indicator indicates the right side, and determines the cut-out area according to the user's operation.
[0159] The second determination unit 114 determines the compression ratio of the compression target area in conjunction with the operation of the direction indicator by the user. For example, the second determination unit 114 determines the processing conditions so that the compression ratio of the area on the side indicated by the direction indicator is lower with reference to the essential display area.
[0160] Here, consider a case where, with the display image W of FIG. 7 being displayed on the display device 25, the user operates the direction indicator to indicate the right side in order to change lanes to the left. In this case, the first determination unit 113 determines the size and the way of cutting out the cut-out area when the direction indicator indicates the right side. In this example, the first determination unit 113 determines the essential display area E and the right side area R in FIG. 7 as the cut-out area C.
[0161] Next, the second determination unit 114 reduces the compression ratio of the side indicated by the direction indicator on the video. In this example, the second determination unit 114 reduces the compression ratio of the right side area R in FIG. 7 and determines it to be uncompressed.
[0162] FIG. 20 shows an example of a display image to be displayed on the display device 25 according to Modification 4. In the example of FIG. 20, the display image W is composed of an essential display area E and a right area R. The essential display area E and the right area R are displayed on the display device 25 at the same scale as the rear video D by the display control unit 116. Note that the frames such as the black frames in FIG. 20 are drawn for convenience of explanation, and no frame is displayed in the display image W actually displayed on the display device 25.
[0163] In this way, when the second determination unit 114 reduces the compression rate of the side indicated by the direction indicator on the video, for example, when the user makes a right turn or changes lanes to the right lane, it becomes easier to visually recognize the left rear side. That is, according to this modification, it is possible to make it easier to visually recognize a vehicle or the like existing in the rear side.
[0164] (Modification 6) The first determination unit 113 and the second determination unit 114 may determine the processing conditions of the captured image in conjunction with the operation of the steering wheel by the user.
[0165] The first determination unit 113 of this modification determines the cutout area in accordance with the user's operation when the user operates the steering wheel. For example, the first determination unit 113 determines in advance the size and method of cutting out the cutout area when the steering wheel is turned to the left, and the size and method of cutting out the cutout area when the steering wheel is turned to the right, and determines the cutout area in accordance with the user's operation.
[0166] Note that the determination as to whether the steering wheel is turned to the left or right is made, for example, based on whether the steering angle exceeds a threshold value.
[0167] The second determination unit 114 determines the compression rate of the compression target area in conjunction with the operation of the steering wheel by the user. For example, the second determination unit 114 determines the processing conditions so that the compression rate of the area on the side where the steering wheel is turned is lower with respect to the essential display area.
[0168] Here, consider a case where the user turns the steering wheel to the right to change lanes to the right while the display image W in FIG. 7 is being displayed on the display device 25. In this case, the first determination unit 113 determines the size and the cutting method of the cut-out area when the steering wheel is turned to the right. In this example, the first determination unit 113 determines the essential display area E and the right area R in FIG. 7 as the cut-out area C.
[0169] Next, the second determination unit 114 reduces the compression rate on the side where the steering wheel is turned on the video. In this example, the second determination unit 114 reduces the compression rate of the right area R in FIG. 7 and determines it to be uncompressed. Since the image of the display image is the same as in Modification 4, the illustration and description are omitted.
[0170] In this way, when the second determination unit 114 reduces the compression rate on the side where the steering wheel is turned on the video, for example, when the user makes a right turn or changes lanes to the right, it becomes easier to visually recognize the left rear. That is, according to this modification, it is possible to make it easier to visually recognize a vehicle or the like existing in the rear side.
[0171] (Modification 7) The first determination unit 113 and the second determination unit 114 may determine the processing conditions of the captured image in conjunction with the movement of the user's line of sight.
[0172] The first determination unit 113 of this modification determines the cut-out area according to the movement of the user's line of sight when the user moves the line of sight. For example, the first determination unit 113 previously determines the size and the cutting method of the cut-out area when the user turns the line of sight to the left, and the size and the cutting method of the cut-out area when the user turns the line of sight to the right, and determines the cut-out area according to the movement of the user's line of sight.
[0173] Note that the movement of the user's line of sight is detected, for example, by providing a camera or the like capable of photographing the user in the vehicle 5 and analyzing the video captured by the camera. The user is, for example, a driver.
[0174] The second determination unit 114 determines the compression rate of the compression target area in conjunction with the movement of the user's line of sight. For example, the second determination unit 114 determines the processing conditions so that the compression rate of the area on the side where the line of sight is directed is lower with reference to the essential display area.
[0175] Here, consider a case where the user turns the line of sight to the right in order to change lanes to the left while the display image W of FIG. 7 is being displayed on the display device 25. In this case, the first determination unit 113 determines the size and the cutting method of the cut-out area when the user turns the line of sight to the right. In this example, the first determination unit 113 determines the essential display area E and the right area R in FIG. 7 as the cut-out area C.
[0176] Next, the second determination unit 114 reduces the compression rate on the side where the user's line of sight is directed on the video. In this example, the second determination unit 114 reduces the compression rate of the right area R in FIG. 7 and determines it to be uncompressed. Since the image of the display image is the same as that of Modification 4, the illustration and description thereof are omitted.
[0177] In this way, when the second determination unit 114 reduces the compression rate on the side where the user's line of sight is directed on the video, for example, when the user makes a right turn or changes lanes to the right lane, it becomes easier to visually recognize the left rear side. That is, according to this modification, it is possible to make it easier to visually recognize a vehicle or the like existing in the rear side.
[0178] (Modification 8) The first determination unit 113 and the second determination unit 114 may determine the processing conditions of the captured image in conjunction with the route guidance.
[0179] The first determination unit 113 of this modification determines the cut-out area in accordance with the route guidance. For example, the first determination unit 113 previously determines the size and the cutting method of the cut-out area when guiding a left turn, and the size and the cutting method of the cut-out area when guiding a right turn, and determines the cut-out area in accordance with the route guidance.
[0180] The route guidance identifies the current position and traveling direction of the host vehicle by analyzing, for example, the positioning signal, and guides the route to the destination.
[0181] The second determination unit 114 determines the compression rate of the compression target area in accordance with the route guidance. For example, the second determination unit 114 determines the processing conditions such that the compression rate of the area on the side indicated by the route guidance is lower based on the essential display area.
[0182] Here, consider a case where a right turn is indicated by the route guidance while the display image W of FIG. 7 is being displayed on the display device 25. In this case, the first determination unit 113 determines the size and the cutting method of the cut-out area when guiding a right turn. In this example, the first determination unit 113 determines the essential display area E and the right area R in FIG. 7 as the cut-out area C.
[0183] Next, the second determination unit 114 reduces the compression rate of the side indicated by the route guidance on the video. In this example, the second determination unit 114 reduces the compression rate of the right area R in FIG. 7 and determines it to be uncompressed. Since the image of the display image is the same as that of the fourth modification example, illustration and description are omitted.
[0184] In this way, by the second determination unit 114 reducing the compression rate of the side indicated by the route guidance on the video, the user can check the state of the rear side with a display image with less discomfort before operating the direction indicator. That is, according to this modification example, it is possible to make it easier to visually recognize a vehicle or the like existing on the rear side.
[0185] (Modification Example 9) The first determination unit 113 and the second determination unit 114 may determine the processing conditions of the captured image according to the traveling speed of the host vehicle.
[0186] In this modification example, when the speed of the host vehicle is lower than a predetermined threshold value, the first determination unit 113 determines a predetermined area in the captured image as a cut-out area regardless of the number of lanes and the driving position. When the driving speed of the host vehicle is lower than a predetermined threshold value, the second determination unit 114 sets the compression ratio of the compression target area to 0. A compression ratio of 0 means no compression.
[0187] Further, the user may be able to manually switch between whether the first determination unit 113 and the second determination unit 114 perform the process of determining the processing conditions of the captured image based on the number of lanes and the driving position or perform the above-described process.
[0188] According to the drive recorder unit 10 according to this modification example, in a scene where there is little need to pay attention to the rear side such as when the host vehicle is stopped, it is possible to display an uncompressed natural display image on the display device 25. Thereby, it is possible to reduce the scenes in which the user feels a sense of discomfort with the display image.
[0189] (Modification Example 10) The first determination unit 113 and the second determination unit 114 may determine the processing conditions of the captured image according to the inter-vehicle distance.
[0190] In this modification example, when the inter-vehicle distance exceeds a predetermined threshold value, the first determination unit 113 determines a predetermined area in the captured image as a cut-out area regardless of the number of lanes and the driving position. When the inter-vehicle distance exceeds a predetermined threshold value, the second determination unit 114 sets the compression ratio of the compression target area to 0. A compression ratio of 0 means no compression.
[0191] Note that the inter-vehicle distance between the host vehicle and another vehicle is calculated by analyzing the rear view image D.
[0192] According to the drive recorder unit 10 according to this modification example, in a scene where there is little need to pay attention to the rear side, such as when the inter-vehicle distance exceeds a certain distance, it is possible to display a natural display image that is not compressed on the display device 25. Thereby, it is possible to reduce the scenes in which the user feels a sense of incongruity with the display image.
[0193] (Modification Example 11) In the above-described Modification Example 3, the second determination unit 114 described the form of reducing the compression rate of the area where the vehicle or the like exists. However, the second determination unit 114 may reduce the compression rate of the area of the lane where the entrance of the service area or the like exists. Here, the service area or the like includes, for example, a service area and a parking area.
[0194] The second determination unit 114 of this modification example reduces the compression rate of the area of the lane where the entrance of the service area or the like exists in the captured image. The lane where the entrance of the service area or the like exists may be detected by analyzing the captured image, or may be detected from the reception result of the positioning signal or the like. Further, the second determination unit 114 may perform the above processing only when a certain time has elapsed since the start of driving or the previous break.
[0195] By reducing the compression rate of the area of the lane where the entrance of the service area or the like exists in this way, when the user changes lanes to the lane where the entrance of the service area or the like exists in order to enter the service area or the like, it becomes easier to check the rear side.
[0196] As described above, each embodiment of the present disclosure has been described. However, the above-described embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the gist of the invention. These novel embodiments and their modifications are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalent scope thereof. Furthermore, components according to different embodiments and modification examples may be appropriately combined.
[0197] Moreover, the effects in each of the embodiments described in this specification are merely examples and are not limiting, and there may be other effects.
Description of Reference Numerals
[0198] 1 Display control system 5 Vehicle 10 Drive recorder unit 11 Microcomputer 20 Display unit 25 Display device 31 Front camera 32 Rear camera 40 Display unit 45 Display 111 Acquisition unit 112 First detection unit 113 First determination unit 114 Second determination unit 115 Generation unit 116 Display control unit 117 Second detection unit
Claims
1. A first detection unit that detects the number of roads including one or more roads on which the host vehicle travels; A determination unit that determines processing conditions for a compression target region in a captured image including a mandatory display region indicating a predetermined region captured around the host vehicle and a compression target region that is a region other than the mandatory display region, according to the number of roads detected by the first detection unit; A display control unit that processes the captured image according to the processing conditions determined by the determination unit and performs control to display it on a display device; Comprising; The determination unit determines a compression rate in the vehicle width direction of the compression target region according to the number of roads detected by the first detection unit; The display control unit displays the mandatory display region on the display device at the same scale as the captured image; A display control device.
2. The roads include sidewalks on which pedestrians walk and lanes on which vehicles travel; The display control device according to claim 1.
3. Further comprising a second detection unit that detects the traveling position of the host vehicle; The determination unit determines the processing conditions for the compression target region in the captured image according to the number of roads detected by the first detection unit and the traveling position of the host vehicle detected by the second detection unit; The display control device according to claim 1 or 2.
4. The determination unit determines the processing conditions such that the compression rate of the display in the vehicle width direction gradually increases from the inside to the outside of the host vehicle with respect to the captured image; The display control device according to claim 3.
5. The determination unit determines the processing conditions such that the compression rate of the display in the vehicle width direction in a region where no other vehicle exists in the captured image is high; The display control device according to claim 3 or 4.
6. The determination unit determines the processing conditions including the compression rate of the display in the vehicle width direction of the compression target region in conjunction with an operation of a direction indicator by the user; The display control device according to any one of claims 3 to 5.
7. The determination unit determines the processing conditions such that the compression rate of the display in the vehicle width direction in a region existing on the side indicated by the direction indicator is low with respect to the mandatory display region; The display control device according to claim 6.
8. The determination unit determines the processing conditions including the compression rate of the display in the vehicle width direction of the compression target region in conjunction with an operation of a steering wheel by the user; The display control device according to any one of claims 3 to 7.
9. The determination unit determines the processing conditions such that the compression rate of the display in the vehicle width direction of the area existing on the side where the steering wheel is turned is low, with reference to the mandatory display area. The display control device according to claim 8.
10. The determination unit determines the processing conditions including the compression rate of the display in the vehicle width direction of the area to be compressed, in conjunction with the movement of the user's line of sight. The display control device according to any one of claims 3 to 9.
11. The determination unit determines the processing conditions such that the compression rate of the display in the vehicle width direction of the area existing on the side where the line of sight is directed is low, with reference to the mandatory display area. The display control device according to claim 10.
12. The determination unit determines the processing conditions including the compression rate of the display in the vehicle width direction of the area to be compressed, in accordance with the route guidance. The display control device according to any one of claims 3 to 11.
13. The determination unit determines the processing conditions such that the compression rate of the display in the vehicle width direction of the area existing on the side indicated by the route guidance is low, with reference to the mandatory display area. The display control device according to claim 12.
14. When the traveling speed of the host vehicle is lower than a predetermined threshold value, the determination unit determines the processing conditions such that the compression rate of the display in the vehicle width direction becomes zero. The display control device according to any one of claims 3 to 13.
15. When the inter-vehicle distance exceeds a predetermined threshold value, the determination unit determines the processing conditions such that the compression rate of the display in the vehicle width direction becomes zero. The display control device according to any one of claims 3 to 14.
16. A display control method by a display control device, comprising: a detection step of detecting the number of roads including the road on which the host vehicle travels; a determination step of determining the processing conditions of the area to be compressed in a captured image including a mandatory display area indicating a predetermined area captured around the host vehicle and an area to be compressed which is an area other than the mandatory display area, according to the number of roads detected in the detection step; a display control step of processing the captured image according to the processing conditions determined in the determination step and performing control to display on a display device; and including the determination step includes a compression rate determination step of determining the compression rate in the vehicle width direction of the area to be compressed according to the number of roads detected in the detection step. The display control step includes a display step of causing the display device to display the mandatory display area at the same scale as the captured image. A display control method.
Citation Information
Patent Citations
Method for processing moving image for vehicle and processor for moving image for vehicle
JP1999150726A
On-vehicle driving supporting information displaying device
JP2001116567A
Navigation device
JP2011079338A
Vehicle display device
JP2018006936A
Visual recognition device for vehicle
JP2019145982A