Display control device and display control method
Patent Information
- Application Number
- CN202180093993.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2021-02-18
- Filing Date
- 2021-10-12
- Publication Date
- 2026-10-27
- Estimated Expiration
- 2041-10-12
AI Technical Summary
[0010]根据本公开,能够使得容易对存在于后侧方的车辆等进行视觉确认。此外,在此记载的效果不一定是限定性的,可以是本说明书中记载的任意效果。
Smart Images

Figure CN116918320B_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to a display control device and a display control method. Background Technology
[0002] In recent years, the number of vehicles equipped with electronic mirrors has been increasing. These mirrors use cameras to capture images of the vehicle's surroundings and display them on a display device. The surroundings may include, for example, the area behind the vehicle. However, similar to using optical mirrors to check the rear, blind spots may exist in the image displayed on the electronic mirror. Therefore, drivers still need to visually inspect for vehicles and other objects behind them. Consequently, drivers may easily neglect to look ahead when changing lanes, for example.
[0003] In response, the following technique has been proposed: using a camera to capture an area beyond the range that can be visually confirmed by an optical lens, which is the area behind the vehicle, and compressing the captured image in such a way that the compression rate in the vehicle width direction gradually increases from the inside of the vehicle to the outside, and then displaying it on a display device (for example, see Patent Document 1).
[0004] Existing technical documents
[0005] Patent documents
[0006] Patent Document 1: Japanese Patent Application Publication No. 2019-145982 Summary of the Invention
[0007] However, in previous technologies, the compression ratio of the area displaying the rear side of the vehicle was high, making it sometimes difficult for the driver to visually confirm. Therefore, when the driver is making lane changes, they may miss vehicles located to the rear side.
[0008] This disclosure was made in view of the above circumstances, and its purpose is to facilitate visual identification of vehicles located on the rear side.
[0009] To achieve the above objectives, the display control device of this disclosure includes: a first detection unit that detects the number of roads, the number of roads representing the number of one or more roads including the road on which the vehicle travels; a determination unit that determines processing conditions for areas other than a pre-determined display area in a photographic image of the area surrounding the vehicle, based on the number of roads detected by the first detection unit; and a display control unit that controls the processing of the photographic image according to the processing conditions determined by the determination unit and displays it on a display device.
[0010] According to this disclosure, it is possible to easily visually confirm vehicles, etc., located to the rear or side. Furthermore, the effects described herein are not necessarily limiting and may be any of the effects described in this specification. Attached Figure Description
[0011] Figure 1 This is a schematic diagram illustrating an example of a vehicle equipped with the driving recorder unit according to the first embodiment.
[0012] Figure 2 This is a block diagram illustrating an example of the structure of the display control system according to the first embodiment.
[0013] Figure 3 This is a functional block diagram illustrating an example of the functional structure of the microcomputer in the vehicle recorder unit according to the first embodiment.
[0014] Figure 4 This is a diagram showing an example of a rear view of the vehicle according to the first embodiment.
[0015] Figure 5 This is an image illustrating an example of the decision-making process for the area that must be displayed according to the first embodiment.
[0016] Figure 6 This is an image illustrating an example of the determination process for the shearing region involved in the first embodiment.
[0017] Figure 7 This is a diagram illustrating an example of a display image according to the first embodiment.
[0018] Figure 8 This is an image diagram showing an example of the shear region before compression in the case where the compression ratio changes according to the position within the compression region, as described in the first embodiment.
[0019] Figure 9 This is a diagram illustrating an example of a display image according to the first embodiment.
[0020] Figure 10 This is a flowchart illustrating an example of the processing of the dashcam unit according to the first embodiment.
[0021] Figure 11 This is a functional block diagram illustrating an example of the functional structure of the microcomputer in the vehicle recorder unit according to the second embodiment.
[0022] Figure 12 This is a diagram showing an example of the rear view of the vehicle according to the second embodiment.
[0023] Figure 13This is an image illustrating an example of the determination process for the shearing region involved in the second embodiment.
[0024] Figure 14 This is a diagram illustrating an example of a display image according to the second embodiment.
[0025] Figure 15 This is an image diagram illustrating an example of the shear region before compression in the case where the compression ratio changes according to the position within the compression region, as described in the second embodiment.
[0026] Figure 16 This is a diagram illustrating an example of a display image according to the second embodiment.
[0027] Figure 17 This is a flowchart illustrating an example of the processing of the dashcam unit according to the second embodiment.
[0028] Figure 18 This is a diagram showing an example of the rear view of the vehicle involved in Modification Example 4.
[0029] Figure 19 This is a diagram illustrating an example of the display image involved in Variation Example 4.
[0030] Figure 20 This is a diagram illustrating an example of the display image involved in Variation 5. Detailed Implementation
[0031] Hereinafter, embodiments of the display control device and display control method involved in this disclosure will be described with reference to the accompanying drawings.
[0032] [First Implementation Method]
[0033] (Example of vehicle structure)
[0034] Figure 1 This is a schematic diagram illustrating an example of a vehicle 5 equipped with the dashcam unit 10 according to the first embodiment. Figure 1 As shown, the vehicle 5 in the first embodiment includes, for example, a driving recorder unit 10, a rear-facing camera 32, and a display device 25. The vehicle 5 may also include a front-facing camera 31 and a display 45. An example of a vehicle 5 including a front-facing camera 31 and a display 45 will be described below.
[0035] A front-facing camera 31 is disposed, for example, on the windshield of the vehicle 5. The front-facing camera 31 captures images of the exterior of the vehicle 5 and generates a forward image signal. For example, the front-facing camera 31 captures images of the front of the vehicle 5. The forward image signal contains, for example, information about the forward image. The forward image is, for example, an image obtained by capturing the front of the vehicle 5 using the front-facing camera 31.
[0036] A rear-facing camera 32 is, for example, disposed on the rear windshield of vehicle 5. The rear-facing camera 32 captures images of the exterior of vehicle 5 and generates a rearward image signal. The rear-facing camera 32, for example, captures images of the rear of vehicle 5. The rear-facing camera 32 may also be capable of wide-angle photography. The rearward image signal, for example, contains information about the rearward image. The rearward image, for example, is an image obtained by capturing the rear of vehicle 5 using a rear-facing camera 32 capable of wide-angle photography.
[0037] The dashcam unit 10 is housed, for example, in the center console box of vehicle 5. The processing of the dashcam unit 10 will be described later. The dashcam unit 10 is an example of a display control device.
[0038] Display device 25 displays the rear of vehicle 5. Display device 25 may display, for example, an image of the rear of vehicle 5. Display device 25 may be, for example, a liquid crystal display (LCD). Display device 25 may also be, for example, a mirror-type display device used to confirm the rear of vehicle 5. Display device 25 may be, for example, an electronic mirror.
[0039] Display device 25 displays, for example, a rear view obtained by a predetermined process performed by an electronic control unit (ECU) integrated with display device 25. In this embodiment, display device 25 is an electronic mirror shaped like a rearview mirror.
[0040] In addition, Figure 1 In this document, the display device 25 is described as an electronic mirror in the shape of a rearview mirror, but while the display device 25 is an electronic mirror, it can also be an electronic mirror of other shapes used for rearward confirmation. For example, the display device 25 can also be an electronic mirror in the shape of a door mirror or a fender mirror.
[0041] Display 45 displays information related to vehicle 5. For example, display 45 may display a view of the front of vehicle 5. Display 45 may be, for example, a liquid crystal display (LCD). Display 45 may also be a panel-type LCD embedded in an instrument panel, etc.
[0042] The display 45 can also display images from other cameras (not shown) located on the side or inside the vehicle 5. Additionally, the display 45 can also display an image obtained by combining images from multiple cameras, including the front camera 31 and the rear camera 32, used to capture images of the exterior of the vehicle. The image obtained by combining images from multiple cameras could be, for example, a panoramic bird's-eye view.
[0043] (Example of a display control system structure)
[0044] Figure 2 This is a block diagram illustrating an example of the structure of the display control system 1 according to the first embodiment.
[0045] like Figure 2 As shown, the display control system 1 of the first embodiment includes a driving recorder unit 10, a display unit 20, and a rear-facing camera 32. The display control system 1 of the first embodiment is configured, for example, to be mounted on the aforementioned vehicle 5. The display control system 1 may also include a front-facing camera 31 and a display unit 40. Hereinafter, an example of a display control system 1 including a front-facing camera 31 and a display unit 40 will be described.
[0046] The dashcam unit 10 includes a microcomputer 11, a serializer 13m, and a deserializer 14m. The dashcam unit 10 may also include a serializer 13p and a deserializer 14p. An example of a dashcam unit 10 including a serializer 13p and a deserializer 14p will be described below.
[0047] The microcomputer 11 is, for example, a computer equipped with a Central Processing Unit (CPU), ROM (Read-Only Memory), and RAM (Random Access Memory). The microcomputer 11 is, for example, configured as a System-on-Chip (SoC) including a graphics processor 11p and a control unit 11c. The control unit 11c controls the graphics processor 11p.
[0048] The microcomputer 11 can control the serializer 13m by sending the control signal SG3 to the serializer 13m. Additionally, the microcomputer 11 can control the deserializer 14m by sending the control signal SG4 to the deserializer 14m.
[0049] The microcomputer 11 controls the serializer 13p by sending control signal SG1 to the serializer 13p. Similarly, the microcomputer 11 controls the deserializer 14p by sending control signal SG2 to the deserializer 14p. Specifically, the control unit 11c controls the serializer 13m, deserializer 14m, serializer 13p, and deserializer 14p by sending various control signals.
[0050] When the image signal SGr1, which is a rear image signal, is sent from the rear camera 32, the microcomputer 11 receives the image signal SGr1 from the rear camera 32 by sending a control signal SG4 to the deserializer 14m. The image signal SGr1 received by the deserializer 14m is, for example, a serialized image signal.
[0051] When the deserializer 14m receives the control signal SG4 from the microcomputer 11, it receives the image signal SGr1 sent from the rear camera 32. The deserializer 14m sends the image signal SGr1 to the microcomputer 11 and the serializer 13m. The deserializer 14m can also convert the received image signal SGr1 into parallel data before sending it.
[0052] When the front-facing camera 31 sends an image signal SGf1 as a front-facing image signal, the microcomputer 11 receives the image signal SGf1 from the front-facing camera 31 by sending a control signal SG2 to the deserializer 14p. The image signal SGf1 received by the deserializer 14p is, for example, a serialized image signal.
[0053] When the deserializer 14p receives the control signal SG2 from the microcomputer 11, it receives the image signal SGf1 sent from the front-facing camera 31. The deserializer 14p then sends the image signal SGf1 to the microcomputer 11. Alternatively, the deserializer 14p can convert the received image signal SGf1 into parallel data before sending it.
[0054] The microcomputer 11 receives the rear image signal generated by the rear camera 32 from the deserializer 14m as the image signal SGr1. Specifically, the image processor 11p receives the image signal SGr1 from the deserializer 14m.
[0055] The image processor 11p performs image processing on the image signal SGr1, such as cropping and compression, as described later, to generate the image signal SGr2. The image signal SGr2 is used to display the rear image obtained by the image processing.
[0056] The image processor 11p sends the image signal SGr2 to the serializer 13m. In other words, the microcomputer 11 sends the image signal SGr2 to the serializer 13m. The microcomputer 11 can also convert the image signal SGr2 into parallel data and then send it to the serializer 13m.
[0057] The microcomputer 11 receives the frontal image signal generated by the front-facing camera 31 from the deserializer 14p as the image signal SGf1. Specifically, the image processor 11p receives the image signal SGf1 from the deserializer 14p.
[0058] Image processor 11p performs image processing such as color and contrast adjustment on image signal SGf1 to generate image signal SGf2. Image processor 11p sends image signal SGf2 and image signal SGr2 to serializer 13p.
[0059] In other words, the microcomputer 11 sends the image signals SGf2 and SGr2 to the serializer 13p. The microcomputer 11 can also convert the image signals SGf2 and SGr2 into parallel data and then send them to the serializer 13p.
[0060] When the serializer 13m receives the control signal SG3 from the microcomputer 11, it sends the image signal SGr2 received from the microcomputer 11 to the display unit 20. Alternatively, when the serializer 13m receives the image signal SGr2, which has been converted into parallel data, from the microcomputer 11, it converts the image signal SGr2 into serial data and then sends it.
[0061] The microcomputer 11 controls the serializer 13p to send image signals SGf2 and SGr2 to the display unit 40 by sending control signal SG1.
[0062] When the serializer 13p receives the control signal SG1 from the microcomputer 11, it sends the image signal SGf2 and image signal SGr2 received from the microcomputer 11 to the display unit 40. For example, when the serializer 13p receives the image signal SGf2 and image signal SGr2, which have been converted into parallel data, from the microcomputer 11, it converts the image signal SGf2 into serial data and then sends it.
[0063] Furthermore, for example, control signals SG1, SG2, SG3, and SG4 can be sent from the microcomputer 11 to the serializer 13p, the microcomputer 11 to the deserializer 14p, the microcomputer 11 to the serializer 13m, and the microcomputer 11 to the deserializer 14m via I2C (Inter-Integrated Circuit).
[0064] Alternatively, for example, image signals SGf1 can be sent from deserializer 14p to microcomputer 11, image signals SGf2 and SGr2 can be sent from microcomputer 11 to serializer 13p, image signals SGr1 can be sent from deserializer 14m to microcomputer 11, and image signals SGr2 can be sent from microcomputer 11 to serializer 13m via MIPI (Mobile Industrial Processor Interface).
[0065] Alternatively, for example, image signals SGr1 can be sent from the rear camera 32 to the deserializer 14m, image signals SGr2 can be sent from the serializer 13m to the display unit 20, image signals SGf1 can be sent from the front camera 31 to the deserializer 14p, and image signals SGf2 and SGr2 can be sent from the serializer 13p to the display unit 40 via FPD-Link III (Flat Panel Display-Link III).
[0066] These image transmissions can be performed via either wired or wireless communication. For example, image transmission can be performed via wired communication using coaxial cables. Alternatively, image transmission can be performed via wireless communication using Wi-Fi (registered trademark).
[0067] The display unit 40 includes a display 45. The display unit 40 is configured, for example, as part of an in-vehicle infotainment (IVI) system.
[0068] The display unit 40 transmits the received image signal SGf2 and image signal SGr2 to the display 45. The display 45 can display the foreground image based on the received image signal SGf2. Additionally, the display 45 can display the background image based on the received image signal SGr2.
[0069] The display unit 20 includes a display device 25. The display unit 20 may also include an ECU (Electronic Control Unit) 21. An example of a display unit 20 including an ECU 21 will be described below. The ECU 21 is, for example, a computer equipped with a CPU, ROM, and RAM.
[0070] The display unit 20 sends the received image signal SGr2 to the ECU 21. The ECU 21 performs image processing on the image signal SGr2. Image processing includes, for example, adjustments to color and contrast in a manner suitable for display in the display device 25.
[0071] The image signal SGr2 obtained by the image processing performed by the ECU 21 is transmitted to the display device 25. The display device 25 displays the image generated based on the image signal SGr2, i.e., the rear image.
[0072] (Functional structure of the dashcam unit in the first embodiment)
[0073] Next, use Figure 3 The functional structure of the vehicle recorder unit 10 involved in the first embodiment will be explained. Figure 3This is a functional block diagram illustrating an example of the functional structure of the microcomputer 11 of the vehicle recorder unit 10 according to the first embodiment.
[0074] The microcomputer 11 of the dashcam unit 10 expands the control program stored in the ROM of the microcomputer 11 into the RAM, and performs actions by causing the CPU and the image processor 11p to... Figure 3 The receiving unit 111, first detection unit 112, first decision unit 113, second decision unit 114, generation unit 115, and display control unit 116 shown are implemented as functional units. It can also be said that the dashcam unit 10 includes the receiving unit 111, first detection unit 112, first decision unit 113, second decision unit 114, generation unit 115, and display control unit 116. The receiving unit 111, first detection unit 112, first decision unit 113, second decision unit 114, generation unit 115, and display control unit 116 can be implemented by different hardware.
[0075] The receiving unit 111 receives photographic images obtained by capturing images of the area surrounding the vehicle, including the rear side of the vehicle. In this disclosure, "receiving" also includes receiving transmitted information, signals, and images. Specifically, the receiving unit 111 receives rear images generated by the rear camera 32. For example, the receiving unit 111 receives image signal SGr1. In addition, the receiving unit 111 receives front images generated by the front camera 31. For example, the receiving unit 111 receives image signal SGf1.
[0076] Figure 4 This is an example of a rear view of the vehicle captured by the rear-mounted camera 32 according to the first embodiment. Figure 4 The rear view image D shown depicts vehicle A1, vehicle A2, lane B1, lane B2, and lane B3. In this example, rear view image D is an image obtained by taking a picture of the rear of the vehicle traveling in lane B2 using a wide-angle rear camera 32. Vehicle A1 is traveling in lane B2, the same lane as this vehicle, and vehicle A2 is traveling in lane B3, which is adjacent to the left side of this vehicle.
[0077] The first detection unit 112 detects the number of roads, including the road on which the vehicle travels. Furthermore, in this specification, the number of roads refers to the total number of vehicle lanes and pedestrian walkways. In other words, a road includes both lanes and pedestrian walkways.
[0078] Specifically, the first detection unit 112 detects lane change lines or lane-to-pedestrian boundary lines, etc., based on the rear image received by the receiving unit 111, thereby detecting the number of roads. The rear image is an example of a photographic image. The lane-to-pedestrian boundary is, for example, a curb. For example, in... Figure 4 In the example, since there are three lanes, lane B1, lane B2 and lane B3, the first detection unit 112 detects the number of roads as "3".
[0079] Furthermore, the first detection unit 112 may not count the number of lanes used by vehicles traveling in the opposite direction to this vehicle as the number of roads. Hereinafter, the lanes used by vehicles traveling in the opposite direction to this vehicle will be referred to as oncoming lanes.
[0080] As a method for identifying oncoming lanes, examples include: detecting the central divider or center line in the rear view image and determining whether the lane is an oncoming lane based on the positional relationship between the central divider or center line and the lane. Alternatively, for example, the direction of travel of vehicles traveling in the lane in the rear view image can also be used to determine whether the lane is an oncoming lane.
[0081] Alternatively, for example, information related to the lane can be received based on the reception results of the positioning signal, which indicates the position of vehicle 5, sent from an artificial satellite overhead, and it can be determined whether the lane is an oncoming lane.
[0082] Alternatively, it can communicate with roadside equipment to receive lane-related information, thereby determining whether the lane is an oncoming lane.
[0083] In this embodiment, the first detection unit 112 detects the number of roads based on the photographic images received by the receiving unit 111, but the first detection unit 112 may also detect the number of roads based on the reception result of the positioning signal.
[0084] In addition, the first detection unit 112 can also perform road-to-road communication to receive road-related information, thereby detecting the number of roads.
[0085] The first decision unit 113 determines the cut-off region based on the number of roads detected by the first detection unit 112. The first decision unit 113 is an example of a decision unit. The cut-off region is the area in the photographic image displayed on the display device 25. The determination of the cut-off region is an example of processing conditions.
[0086] Specifically, the first decision unit 113 first determines the area that must be displayed in the rear image received by the receiving unit 111, which represents a predetermined area. The first decision unit 113 determines the area that must be displayed according to predetermined conditions.
[0087] The conditions for determining which areas must be displayed can be set freely in principle, as long as they comply with the field-of-view provisions of United Nations Regulation 46 (UN-R46).
[0088] The UN-R46 definition of field of vision is "a field of vision that is defined as a flat, horizontal portion of the road at least 20 meters wide, centered on the vertical long side of the vehicle, and extending 60 meters behind the driver's eye point to the horizontal line."
[0089] Figure 5 This is an image illustrating an example of the decision-making process for the area that must be displayed according to the first embodiment. For example... Figure 5 As shown, the first decision unit 113 determines the pre-determined area (the area within the black frame) in the rear image D as the area that must be displayed, E.
[0090] After determining the area E that must be displayed, the first decision unit 113 determines a cutoff region that includes the area E based on the number of roads detected by the first detection unit 112. For example, the first decision unit 113 determines the cutoff region centered on the area E based on a table that corresponds the number of roads detected by the first detection unit 112 to the size of the cutoff region.
[0091] Furthermore, in principle, the more roads there are, the larger the shearing region will be, and the fewer roads there are, the smaller the shearing region will be. However, in the case of too many roads, the shearing region may become too large. Therefore, the first decision unit 113 may also predetermine an upper limit for the size of the shearing region to avoid it exceeding the upper limit.
[0092] Figure 6 This is an image illustrating an example of the shearing region determination process according to the first embodiment. First, the first determination unit 113 determines the size of the shearing region corresponding to the road number "3" detected by the first detection unit 112. Then, as... Figure 6 As shown, the first decision unit 113 determines the clipping region C centered on the region E that must be displayed.
[0093] The clipping region C consists of the area that must be displayed, the left region L located to the left of the area that must be displayed, and the right region R located to the right of the area that must be displayed,.
[0094] Return to Figure 3Continuing with the explanation, the second decision unit 114 determines the processing conditions for the area outside the displayable area within the cropped area of the photographic image obtained from the first detection unit 112, based on the number of roads detected by the first detection unit 112. Hereinafter, the area outside the displayable area within the cropped area of the photographic image is sometimes referred to as the compression target area. The second decision unit 114 is one example of a decision unit. Furthermore, the second decision unit 114 may also possess the functions of the first decision unit 113 described above. Additionally, the first decision unit 113 may also possess the functions of the second decision unit 114.
[0095] The second decision unit 114 determines the displayed compression rate in the vehicle width direction of the compression target area within the shearing region based on the number of roads detected by the first detection unit 112. Figure 6 In the example, the compression target areas are the left region L and the right region R. The compression ratio displayed in the vehicle width direction refers to the degree to which the photographic image is compressed before display in the vehicle width direction.
[0096] For example, the second decision unit 114 determines the compression ratio of the compression target region within the shearing region based on a table that corresponds the number of roads detected by the first detection unit 112 to the compression ratio.
[0097] Furthermore, in principle, the more roads there are, the higher the compression ratio, and the fewer roads there are, the lower the compression ratio. However, in cases where there are too many roads, the compression ratio may become too high. Therefore, the second decision unit 114 can also predetermine an upper limit for the compression ratio to avoid exceeding the upper limit.
[0098] exist Figure 6 In the example, the second decision unit 114 determines the compression rate corresponding to the road number "3" detected by the first detection unit 112 as the compression rate of the left region L and the right region R. The second decision unit 114 decides to compress the left region L and the right region R, for example, in the vehicle width direction, at a compression rate of 2.
[0099] Return to Figure 3 The explanation continues. The generation unit 115 processes the photographic image according to the processing conditions determined by the first decision unit 113 and the second decision unit 114, thereby generating a display image for display on a display device.
[0100] Specifically, the generation unit 115 first cuts out the cropping region C determined by the first determination unit 113 from the rear image D. Next, the generation unit 115 performs a process to compress the left region L and the right region R of the cropping region C according to a compression rate determined by the second determination unit 114, thereby generating a display image for display on the display device 25. For example, the generation unit 115 performs a process to compress the left region L and the right region R in the vehicle width direction at a compression rate of twice the normal value. The display image here is, for example, an image displayed based on the image signal SGr2.
[0101] Furthermore, the generation unit 115 performs image processing such as color and contrast adjustment on the front image received by the receiving unit 111 to generate a display image. The display image here is, for example, an image displayed based on the image signal SGf2.
[0102] The display control unit 116 performs the following control: processes the photographic image according to the processing conditions determined by the first decision unit 113 and the second decision unit 114, and displays it on the display device. Specifically, the display control unit 116 controls the display image generated by the generation unit 115 to be displayed on the display device 25. In addition, the display control unit 116 controls the display image generated by the generation unit 115 to be displayed on the monitor 45.
[0103] Figure 7 This is an example of a display image displayed in the display device 25 according to the first embodiment. Figure 7 In this example, the displayed image W consists of a left compression area LP, a must-display area E, and a right compression area RP. The must-display area E is displayed on the display device 25 by the display control unit 116 at the same scale as the rear image D.
[0104] The left compression region LP is to Figure 6 The left region L of the shear region C is the region after being compressed at a compression ratio of 2 in the vehicle width direction. The right compression region RP is the region after... Figure 6 The region R to the right of the sheared region C is the region after being compressed at a compression ratio of 2 in the vehicle width direction. Furthermore, Figure 7 The black borders and other borders in the text are for illustrative purposes only; in reality, there are no borders in the display image W displayed on the display device 25.
[0105] Furthermore, in the example above, the second decision unit 114 decides to compress the compression target area of the shear region C uniformly at a compression rate of twice in the vehicle width direction, but the compression rate may vary depending on the position within the compression area. For example, the second decision unit 114 may also determine the compression rate in such a way that the compression rate of the compression area gradually increases from the center of the shear region C outwards.
[0106] Figure 8 This is an image illustrating an example of the shear region before compression in the case where the compression ratio changes according to the position within the compression region, as described in the first embodiment. Figure 8 In the example, the shearing region C is composed of a first left-side region L1, a second left-side region L2, a region that must be displayed E, a first right-side region R1, and a second right-side region R2. Furthermore, the first detection unit 112 and the first decision unit 113 perform [interaction / action] with [other components / processes]. Figure 5 and Figure 6 The same processing as described above.
[0107] The second decision unit 114 determines the compression rate corresponding to the number of roads "3" detected by the first detection unit 112. For example, the second decision unit 114 decides to compress the first left-side region L1 and the first right-side region R1 in the vehicle width direction at a compression rate of 2 times, and to compress the second left-side region L2 and the second right-side region R2 in the vehicle width direction at a compression rate of 4 times.
[0108] The generation unit 115 cuts out the cutting region C according to the decision of the first decision unit 113. Then, the generation unit 115 performs a process that compresses the first left region L1 and the first right region R1 of the cutting region C at a compression rate of 2 times in the vehicle width direction, and compresses the second left region L2 and the second right region R2 at a compression rate of 4 times in the vehicle width direction, according to the compression rate determined by the second decision unit 114, to generate a display image W for display on the display device 25. The display control unit 116 displays the display image W generated by the generation unit 115 on the display device 25.
[0109] Figure 9 This is an example of a display image displayed in the display device 25 according to the first embodiment. Figure 9 In this example, the displayed image W is composed of a first left compression area LP1, a second left compression area LP2, a displayable area E, a first right compression area RP1, and a second right compression area RP2. The displayable area E is displayed on the display device 25 by the display control unit 116 at the same scale as the rear image D.
[0110] The first left compression region LP1 is to... Figure 8 The first left-hand region L1 of the sheared region C is the region after being compressed at a compression ratio of 2 in the vehicle width direction. The second left-hand compressed region LP2 is the region after the second left-hand region L2 is compressed at a compression ratio of 4 in the vehicle width direction.
[0111] The first right-side compression region RP1 is the region formed by compressing the first right-side region R1 in the vehicle width direction at a compression ratio of 2. The second right-side compression region RP2 is the region formed by compressing the second right-side region R2 in the vehicle width direction at a compression ratio of 4. Furthermore, Figure 9 The black borders and other borders in the text are for illustrative purposes only; in reality, there are no borders in the display image W displayed on the display device 25.
[0112] In this way, the second decision unit 114 determines the compression rate of the photographic image in a manner that the compression rate in the vehicle width direction gradually increases from the inside to the outside of the vehicle. This allows, for example, areas close to the vehicle to be displayed at a scale similar to the rear image D, while areas far from the vehicle are displayed at a higher compression rate. Thus, the image W can be displayed without reducing blind spots or compromising the visibility of areas of high importance to the user.
[0113] Furthermore, the second decision unit 114 can also determine whether to uniformly change the compression ratio or to vary the compression ratio according to each region, based on the number of roads. For example, when the number of roads is 3 or less, the second decision unit 114 can set the compression ratio as follows: Figure 7 Such uniform changes, in cases exceeding 3, the second determining part 114 makes the compression ratio as follows: Figure 9 That kind of phased change.
[0114] (Processing of the dashcam unit in the first embodiment)
[0115] Next, the processing performed by the vehicle recorder unit 10 according to the first embodiment will be described. Figure 10 This is a flowchart illustrating an example of the processing performed by the vehicle recorder unit 10 according to the first embodiment.
[0116] First, the receiving unit 111 receives the rear image generated by the rear camera 32 as a photographic image (step S1).
[0117] Next, the first detection unit 112 detects the number of roads based on the rear image received by the receiving unit 111 (step S2).
[0118] Next, the first decision unit 113 determines the area that must be displayed in the rear image. Then, the first decision unit 113 determines the clipping region centered on the area that must be displayed based on the number of roads detected by the first detection unit 112 (step S3).
[0119] Next, the second decision unit 114 determines the compression ratio of the compression target region in the shearing region based on the number of roads detected by the first detection unit 112 (step S4).
[0120] Next, the generation unit 115 cuts out the cut area determined by the first determination unit 113 from the rear image. Then, the generation unit 115 performs a process of compressing the compression target area in the cut area in the vehicle width direction according to the compression rate determined by the second determination unit 114 to generate a display screen for display on the display device 25 (step S5).
[0121] Next, the display control unit 116 controls the display image generated by the generation unit 115 to be displayed on the display device 25 (step S6).
[0122] Next, the display control unit 116 determines whether to end the display of the image (step S7). For example, if a predetermined time has elapsed since the power source such as the engine of the vehicle 5 stopped, the display control unit 116 determines that the display should end.
[0123] If the display of the image is not terminated (step S7: "No"), the process proceeds to step S1. On the other hand, if the display of the image is terminated (step S7: "Yes"), the display control unit 116 terminates this process.
[0124] (Effects of the dashcam unit according to the first embodiment)
[0125] Next, the effects of the dashcam unit 10 according to the first embodiment will be explained. The dashcam unit 10 according to this embodiment determines the processing conditions for areas other than the aforementioned mandatory display area in the photographic images obtained by capturing images of the area around the vehicle, based on the number of roads, which represents the number of roads including the road on which the vehicle is traveling.
[0126] More specifically, in this embodiment, the second decision unit 114 determines the processing conditions by increasing the compression rate proportionally to the number of roads. Therefore, when the number of roads is small, the compression rate is low. This prevents situations where the photographic image is compressed at a high compression rate even with a small number of roads, making it difficult to visually identify vehicles behind. In other words, the dashcam unit 10 according to this embodiment makes it easy to visually identify vehicles such as those behind.
[0127] In addition, "road" includes sidewalks. Therefore, users can also visually confirm the behavior of pedestrians behind and to the side by observing the display device 25.
[0128] [Second Implementation]
[0129] Next, the vehicle recorder unit 10 according to the second embodiment will be described.
[0130] The difference between the dashcam unit 10 according to the second embodiment and the dashcam unit 10 according to the first embodiment is that it includes a second detection unit 117 as a functional unit. Hereinafter, using... Figures 11 to 17 The dashcam unit 10 according to the second embodiment will be described. For structures and operations that are the same as those described in the first embodiment, their descriptions will be omitted or simplified by using the same reference numerals.
[0131] (Functional structure of the dashcam unit in the second embodiment)
[0132] use Figure 11 The functional structure of the vehicle recorder unit 10 involved in the second embodiment will be explained. Figure 11 This is a functional block diagram illustrating an example of the functional structure of the microcomputer 11 of the vehicle recorder unit 10 according to the second embodiment.
[0133] The dash cam unit 10 according to the second embodiment, in addition to having the functional parts of the dash cam unit 10 according to the first embodiment, also has a second detection part 117.
[0134] The second detection unit 117 detects the vehicle's driving position. The second detection unit 117 is an example of a detection unit. Specifically, the second detection unit 117 detects lane change lines, lane and pedestrian boundaries, etc., based on the rear images received by the receiving unit 111, and detects the vehicle's driving position based on their positional relationship in the rear images.
[0135] Furthermore, in this embodiment, the second detection unit 117 detects the vehicle's position based on the photographic image received by the receiving unit 111. However, the second detection unit 117 may also detect the vehicle's position based on the reception result of a positioning signal. Additionally, the second detection unit 117 may communicate with roadside equipment and detect the vehicle's position based on the communication results. Communication results may include, for example, communication speed and signal strength.
[0136] Furthermore, the second detection unit 117 can also perform the functions of the first detection unit 112. Additionally, the first detection unit 112 can also perform the functions of the second detection unit 117.
[0137] Figure 12 This is an example of a rear view of the vehicle captured by the rear-mounted camera 32 according to the second embodiment. Figure 12The rear view image D shown depicts vehicle A1, vehicle A2, lane B1, lane B2, and lane B3. In this example, rear view image D is an image obtained by taking a picture of the rear of the vehicle traveling in lane B1 using a wide-angle rear camera 32. Vehicle A1 is traveling in the same lane B1 as the vehicle, and vehicle A2 is traveling in lane B3.
[0138] exist Figure 12 In the example, the second detection unit 117 detects the vehicle's driving position as "the leftmost lane in the image" based on the positional relationship between lanes B1, B2, and B3 in the rear image D. The leftmost lane in the image is lane B1.
[0139] The first decision unit 113 determines the cutting area based on the number of roads detected by the first detection unit 112 and the vehicle's driving position detected by the second detection unit 117.
[0140] Specifically, the first decision unit 113 performs the same process as in the first embodiment to determine the size of the shearing region. Next, the first decision unit 113 determines the shearing method for the shearing region based on the vehicle's driving position detected by the second detection unit 117.
[0141] For example, if there is no lane or sidewalk on the left side of the vehicle, the importance of information on the left side of the vehicle becomes lower. Therefore, in this case, the first decision unit 113 determines the cutting method in such a way that the left end of the area to be displayed coincides with the left end of the cutting area.
[0142] Figure 13 This is an image illustrating an example of the determination process for the shearing region involved in the second embodiment. For example... Figure 13 As shown, the first decision unit 113 determines the cutting method based on the fact that the vehicle's driving position detected by the second detection unit 117 is "the leftmost lane in the image", in a way that the left end of the display area E must be consistent with the left end of the cutting area C.
[0143] exist Figure 13 In the example, the clipping region C consists of the area that must be displayed, E, and the compressed object region O on the image located to the right of the area that must be displayed, E.
[0144] The second decision unit 114 determines the processing conditions for areas in the photographic image other than the area that must be displayed, based on the number of roads detected by the first detection unit 112 and the vehicle's driving position detected by the second detection unit 117.
[0145] The second decision unit 114 determines the compression method of the compression target region within the shearing region, for example, based on a table that corresponds to the number of roads detected by the first detection unit 112, the driving position detected by the second detection unit 117, and the compression method including the compression ratio.
[0146] For example, the driving position can be represented numerically, such as designating the leftmost lane or sidewalk that can be identified through a photographic image as "1" and the lane to its right as "2". Furthermore, the compression method may, for example, show the compression ratio of the area to the left of the area that must be displayed and the compression ratio of the area to the right of the area that must be displayed. In addition, the compression method may specify whether to change the compression ratio in stages, etc.
[0147] For example, when the vehicle is traveling in the leftmost lane, the second decision unit 114 increases the compression ratio of the area to the left of the area that must be displayed and decreases the compression ratio of the area to the right. Furthermore, the second decision unit 114 can also determine that the compression ratio of the right or left side is "not displayed". Areas whose compression ratio is determined to be "not displayed" by the second decision unit 114 are not displayed by the display device 25. Determining that the compression ratio of the right or left side is "not displayed" can be interpreted as compressing the right or left side area at an infinitely high compression ratio.
[0148] exist Figure 13 In this example, the second decision unit 114 determines the compression method corresponding to the road number "3" detected by the first detection unit 112 and the driving position "1" detected by the second detection unit 117 as the compression method for the compression target area O. For example, the second decision unit 114 decides not to display the left side of the area E that must be displayed, and to compress the right side of the area E that must be displayed in the vehicle width direction at a compression rate of 2. As described above, the driving position "1" is the leftmost lane in the image.
[0149] The processing of the generation unit 115 and the display control unit 116 is the same as in the first embodiment, so the description is omitted. Figure 14 This is an example of a display image displayed in the display device 25 according to the second embodiment. Figure 14 In this example, the displayed image W consists of a mandatory display area E and a compressed display area OP. The mandatory display area E is displayed on the display device 25 by the display control unit 116 at the same scale as the rear image D.
[0150] Compressed display area OP is to Figure 13 The compression target region O to the right of the shear region C is the region after being compressed at a compression ratio of 2 times in the vehicle width direction. Furthermore, Figure 13 The black borders and other borders in the text are for illustrative purposes only; in reality, there are no borders in the display image W displayed on the display device 25.
[0151] Furthermore, in the example above, the second determination unit 114 compresses the compression target area of the shear region C uniformly in the vehicle width direction at a compression ratio of 2. However, similar to the first embodiment, the compression ratio can also vary depending on the position within the compression area. For example, the second determination unit 114 can also determine the compression ratio in such a way that the compression ratio of the compression area gradually increases from the center of the shear region C outwards.
[0152] Figure 15 This is an image illustrating an example of the shear region before compression in the case where the compression ratio changes according to the position within the compression region, as described in the second embodiment. Figure 15 In this example, the cut-out region C is composed of the displayable region E, the first compressed object region O1, and the second compressed object region O2. Furthermore, the first detection unit 112, the second detection unit 117, and the first decision unit 113 perform operations related to... Figure 13 The same processing as described above.
[0153] The second decision unit 114 determines the compression method corresponding to the road number "3" detected by the first detection unit 112 and the driving position "1" detected by the second detection unit 117. For example, the second decision unit 114 decides to compress the first compression target area O1 in the vehicle width direction at a compression rate of 2 times and the second compression target area O2 in the vehicle width direction at a compression rate of 4 times.
[0154] The generation unit 115 cuts out the cutting region C according to the decision of the first decision unit 113. Then, the generation unit 115 performs a compression process according to the compression method determined by the second decision unit 114, compressing the first compression target region O1 of the cutting region C at a compression ratio of 2 times in the vehicle width direction and the second compression target region O2 at a compression ratio of 4 times in the vehicle width direction, to generate a display image W for display on the display device 25. The display control unit 116 displays the display image W generated by the generation unit 115 on the display device 25.
[0155] Figure 16 This is an example of a display image shown on the display device 25. Figure 16 In this example, the displayed image W consists of a mandatory display area E, a first compressed display area OP1, and a second compressed display area OP2. The mandatory display area E is displayed on the display device 25 by the display control unit 116 at the same scale as the rear image D.
[0156] The first compressed display area OP1 is to... Figure 15The first compression target area O1 of the shearing region C is the area after being compressed at a compression ratio of 2 times in the vehicle width direction. The second compression display area LP2 is the area after the second compression target area O2 is compressed at a compression ratio of 4 times in the vehicle width direction. Figure 15 The black borders and other borders in the text are for illustrative purposes only; in reality, there are no borders in the display image W displayed on the display device 25.
[0157] Furthermore, the second decision unit 114 can also determine the compression method for each region based on the number of roads and the driving position. For example, when the number of roads is 3 or less, the second decision unit 114 can set the compression rate as follows: Figure 14 Such uniform changes, in cases exceeding 3, the second determining part 114 makes the compression ratio as follows: Figure 16 That kind of phased change.
[0158] Furthermore, the second decision unit 114 can also change the compression method on the left and right sides of the area to be displayed based on the driving position. For example, if, within the shearing area, the area to the right of the area to be displayed is larger than the area to the left of the area to be displayed, the second decision unit 114 may determine the compression rate by making the compression rate of the right area higher than that of the left area. For example, the second decision unit 114 may also decide to compress the left area at twice the compression rate in the vehicle width direction, compress the area of the right area closer to the area to be displayed at twice the compression rate in the vehicle width direction, and compress the area of the right area farther from the area to be displayed at four times the compression rate in the vehicle width direction.
[0159] (Processing of the dashcam unit in the second embodiment)
[0160] Next, the processing performed by the vehicle recorder unit 10 according to the second embodiment will be described. Figure 17 This is a flowchart illustrating an example of the processing performed by the vehicle recorder unit 10 according to the second embodiment.
[0161] First, the receiving unit 111 receives the rear image generated by the rear camera 32 as a photographic image (step S11).
[0162] Next, the first detection unit 112 detects the number of roads based on the rear image received by the receiving unit 111 (step S12).
[0163] Next, the second detection unit 117 detects the driving position based on the rear image received by the receiving unit 111 (step S13).
[0164] Next, the first decision unit 113 determines the area that must be displayed in the rear image. Then, the first decision unit 113 determines the size of the cut area and the cut method based on the number of roads detected by the first detection unit 112 and the driving position detected by the second detection unit 117 (step S14).
[0165] Next, the second decision unit 114 determines the compression method of the compression target area based on the number of roads and driving position detected by the first detection unit 112 (step S15).
[0166] Next, the generation unit 115 cuts out the cropping area determined by the first determination unit 113 from the rear image. Then, the generation unit 115 performs a compression process to compress the compression target area in the vehicle width direction according to the compression method determined by the second determination unit 114, so as to generate a display screen for display on the display device 25 (step S16).
[0167] Next, the display control unit 116 controls the display image generated by the generation unit 115 to be displayed on the display device 25 (step S17).
[0168] Next, the display control unit 116 determines whether to end the display of the image (step S18). For example, if a predetermined time has elapsed since the power source such as the engine of the vehicle 5 stopped, the display control unit 116 determines that the display should end.
[0169] If the display of the image is not terminated (step S18: "No"), the process proceeds to step S11. On the other hand, if the display of the image is terminated (step S18: "Yes"), the display control unit 116 terminates this process.
[0170] (Effects of the dashcam unit according to the second embodiment)
[0171] Next, the effects of the dashcam unit 10 according to the second embodiment will be explained. The dashcam unit 10 according to this embodiment determines the processing conditions for areas other than the aforementioned mandatory display area based on the vehicle's driving position.
[0172] More specifically, in this embodiment, when the vehicle is traveling in the leftmost lane, the second decision unit 114 increases the compression ratio of the area to the left of the area to be displayed and decreases the compression ratio of the area to the right. This is because, when the vehicle is traveling in the leftmost lane, there are no vehicles or the like on the left side of the vehicle, so the need to pay attention to the left side of the vehicle is low. On the other hand, since there may be vehicles or the like on the right side of the vehicle, the need to pay attention is high.
[0173] Therefore, the dashcam unit 10 according to this embodiment can display only the parts of high importance in a low compression ratio that is easy to visually confirm. In other words, it makes it easy to visually confirm vehicles such as those located to the rear.
[0174] Furthermore, the above-described embodiments can also be appropriately modified and implemented by changing a portion of the structure or function of the display control system 1. Therefore, several variations of the above-described embodiments will be described below as other embodiments. Furthermore, the following mainly describes the differences from the above-described embodiments; details of the same points as those already described are omitted. Additionally, the variations described below can be implemented individually or in appropriate combinations.
[0175] (Variation Example 1)
[0176] In the first and second embodiments described above, the display control system 1 was described as consisting of a dashcam unit 10, a display unit 20, a front-facing camera 31, a rear-facing camera 32, and a display unit 40. However, the display control system 1 may also consist of only the display unit 20 and the rear-facing camera 32.
[0177] In this case, the ECU 21 of the display unit 20 expands the control program stored in the ROM of the ECU 21 into the RAM, and implements each functional unit by causing the CPU to operate. For example, the ECU 21 implements the receiving unit 111, the first detection unit 112, the first decision unit 113, the second decision unit 114, the generation unit 115, and the display control unit 116 of the microcomputer 11 as each functional unit.
[0178] (Variation Example 2)
[0179] In the first and second embodiments described above, the method of displaying the rear image obtained through compression processing on the display device 25 has been explained. However, the display control unit 116 can also control the display of the rear image obtained through compression processing on the display screen 45. In addition, the display control unit 116 can also control the display of the rear image obtained through compression processing on a head-up display (HUD) or the like mounted on the vehicle 5.
[0180] (Variation Example 3)
[0181] In the first and second embodiments described above, the method of displaying only the rear image on the display device 25 was explained. However, it is also possible to display an image obtained by synthesizing the front image on the display device 25.
[0182] In this modified example, the generation unit 115 generates a display image displayed on the display device 25 by synthesizing, for example, an image of the left front of the vehicle cropped from the front image on the left side of the rear image obtained by performing compression processing, and an image of the right front of the vehicle cropped from the front image on the right side.
[0183] Furthermore, the generation unit 115 can also detect pedestrians and bicycles based on the foreground image, and synthesize the foreground image from the background image only when pedestrians or bicycles are present, to generate a display image displayed on the display device 25. Alternatively, the generation unit 115 can also synthesize the background image and the foreground image, using only the lane in the background image as the display object and only the sidewalk in the foreground image as the display object, to generate a display screen.
[0184] The generation unit 115 generates a display image that combines the rear image and the front image, allowing the user to obtain information from both the rear and front directions from a single view. This makes it easier for the user to visually assess the surroundings of the vehicle, thus reducing the likelihood of accidents.
[0185] (Variation Example 4)
[0186] In the second embodiment described above, the method by which the second determination unit 114 determines the compression method of the photographic image based on the number of roads and the driving position has been explained. However, in addition to determining the number of roads and the driving position, the second determination unit 114 may also determine the compression method based on the presence or absence of vehicles, etc. Here, vehicles include two-wheeled vehicles.
[0187] The second determination part 114 of this variation increases the compression rate of areas in the photographic image where there are no other vehicles, etc.
[0188] Figure 18 This is a diagram illustrating an example of the rear view of the vehicle involved in Modification Example 4. Figure 18 In the example, there is no vehicle in region ON, but vehicle A2 exists in region OE. In this case, the second decision unit 114 increases the compression ratio of region ON, making the compression ratio of region OE lower than that of region ON.
[0189] Figure 19 This is an example of the display image displayed in the display device 25 involved in Modification Example 4. Figure 19 In this example, the displayed image W consists of a displayable area E, a high-compression area NP, and a low-compression area EP. The displayable area E is displayed on the display device 25 by the display control unit 116 at the same scale as the rear image D.
[0190] The high-compression region NP is to Figure 18The shear region C is the region ON after being compressed at a compression ratio of 4 times in the vehicle width direction. The low-compression region EP is... Figure 18 The region OE of the shear region C is the region after being compressed at a compression ratio of 2 in the vehicle width direction. Furthermore, Figure 19 The black borders and other borders in the text are for illustrative purposes only; in reality, there are no borders in the display image W displayed on the display device 25.
[0191] In this way, the second decision unit 114 sets a high compression rate for areas where there are no vehicles or the like and a low compression rate for areas where there are vehicles or the like, thereby making it easy to visually confirm objects that should be noticed in the rear. Therefore, the dashcam unit 10 of this modified example can easily visually confirm vehicles or the like in the rear.
[0192] (Variation Example 5)
[0193] Alternatively, the first decision unit 113 and the second decision unit 114 may determine the processing conditions of the photographed image in conjunction with the user's action on the direction indicator.
[0194] When the user operates the direction indicator, the first decision unit 113 of this modification determines the cutting region based on the user's operation. For example, the first decision unit 113 pre-determines the size and cutting method of the cutting region when the direction indicator points to the left, and the size and cutting method of the cutting region when the direction indicator points to the right, and determines the cutting region based on the user's operation.
[0195] In conjunction with the user's operation of the direction indicator, the second decision unit 114 determines the compression ratio of the compression target area. For example, the second decision unit 114 determines the processing conditions in such a way that, based on the area that must be displayed, the compression ratio of the area on the side indicated by the direction indicator becomes lower.
[0196] Here, consider the following situation: The display device 25 displays... Figure 7 In the state of the displayed image W, the user operates the direction indicator to indicate right in order to change lanes to the right. In this case, the first decision unit 113 determines the size of the cutting area and the cutting method when the direction indicator indicates right. In this example, the first decision unit 113 will... Figure 6 The area E that must be displayed and the area R on the right are determined as the clipping area C.
[0197] Next, the second decision unit 114 reduces the compression rate on the side indicated by the orientation indicator on the image. In this example, the second decision unit 114 reduces the compression rate on the side indicated by the orientation indicator on the image. Figure 6 The compression ratio of the right region R decreases, which determines that there is no compression.
[0198] Figure 20 This is an example of the display image displayed in the display device 25 involved in Modification 5. Figure 20 In the example, the displayed image W consists of a displayable area E and a right-side area R. The displayable area E and the right-side area R are displayed on the display device 25 by the display control unit 116 at the same scale as the rear image D. Furthermore, Figure 20 The black borders and other borders in the text are for illustrative purposes only; in reality, there are no borders in the display image W displayed on the display device 25.
[0199] In this way, the second decision unit 114 reduces the compression ratio of the side indicated by the direction indicator on the image, thereby making it easier to visually confirm the right rear, for example, when the user makes a right turn or changes lanes to the right. In other words, according to this modified example, it is possible to easily visually confirm vehicles such as those present on the rear side.
[0200] (Variation Example 6)
[0201] Alternatively, the first decision unit 113 and the second decision unit 114 may determine the processing conditions of the photographic image in conjunction with the user's operation of the steering wheel.
[0202] When the user operates the steering wheel, the first decision unit 113 of this modification determines the cutting area based on the user's operation. For example, the first decision unit 113 pre-determines the size and cutting method of the cutting area when turning the steering wheel to the left, and the size and cutting method of the cutting area when turning the steering wheel to the right, and determines the cutting area based on the user's operation.
[0203] In addition, the determination of whether the steering wheel was turned to the left or right can be based on whether the steering angle exceeds a threshold.
[0204] In conjunction with the user's operation of the steering wheel, the second decision unit 114 determines the compression ratio of the compression target area. For example, the second decision unit 114 determines the processing conditions in such a way that, based on the area that must be displayed, the compression ratio of the area on the side where the steering wheel is turned becomes lower.
[0205] Here, consider the following situation: The display device 25 displays... Figure 7 In the state of the displayed image W, the user turns the steering wheel to the right to change lanes. In this case, the first decision unit 113 determines the size of the cutting area and the cutting method when the steering wheel is turned to the right. In this example, the first decision unit 113 will... Figure 6 The area E that must be displayed and the area R on the right are determined as the clipping area C.
[0206] Next, the second decision unit 114 reduces the compression ratio on the side of the image in the direction the steering wheel is turned. In this example, the second decision unit 114 reduces the compression ratio on the side of the image in the direction the steering wheel is turned. Figure 6 The compression ratio of the right-hand region R decreases, thus it is determined to be uncompressed. The image displayed is the same as in variant example 5, therefore illustrations and explanations are omitted.
[0207] In this way, the second decision unit 114 reduces the compression ratio on the side of the image where the steering wheel is turned, thereby making it easier to visually confirm the right rear, for example, when the user makes a right turn or changes lanes to the right. In other words, according to this modified example, it is possible to easily visually confirm vehicles such as those located to the rear.
[0208] (Variation Example 7)
[0209] Alternatively, the first decision unit 113 and the second decision unit 114 may determine the processing conditions of the photographed image in conjunction with the movement of the user's gaze.
[0210] When the user moves their gaze, the first decision unit 113 of this modification determines the clipping region based on the movement of the user's gaze. For example, the first decision unit 113 pre-determines the size and clipping method of the clipping region when the user's gaze is directed to the left, and the size and clipping method of the clipping region when the user's gaze is directed to the right, and determines the clipping region based on the movement of the user's gaze.
[0211] Furthermore, for example, a camera capable of capturing images of the user can be installed inside vehicle 5, and the movement of the user's gaze can be detected by analyzing the images captured by the camera. The user is, for example, the driver.
[0212] In conjunction with the movement of the user's gaze, the second decision unit 114 determines the compression ratio of the compression target area. For example, the second decision unit 114 determines the processing conditions in such a way that, based on the area that must be displayed, the compression ratio of the area on the side towards which the gaze is directed becomes lower.
[0213] Here, consider the following situation: The display device 25 displays... Figure 7 In the state of the displayed image W, the user turns their gaze to the right in order to change lanes to the right. In this case, the first decision unit 113 determines the size of the clipping region and the clipping method when the user's gaze is turned to the right. In this example, the first decision unit 113 will... Figure 6 The area E that must be displayed and the area R on the right are determined as the clipping area C.
[0214] Next, the second decision unit 114 reduces the compression rate on the side of the image that the user's gaze is directed towards. In this example, the second decision unit 114 reduces the compression rate on the side of the image that the user's gaze is directed towards. Figure 6The compression ratio of the right-hand region R decreases, thus it is determined to be uncompressed. The image displayed is the same as in variant example 5, therefore illustrations and explanations are omitted.
[0215] In this way, the second decision unit 114 reduces the compression rate of the image on the side in which the user's line of sight is directed, thereby making it easier to visually confirm the right rear, for example, when the user is making a right turn or changing lanes to the right. In other words, according to this modified example, it is possible to easily visually confirm vehicles such as those located to the rear.
[0216] (Variation Example 8)
[0217] Alternatively, in conjunction with path guidance, the first decision unit 113 and the second decision unit 114 determine the processing conditions of the photographic image.
[0218] In this variation, the first decision unit 113 determines the cutting region in accordance with the path guidance. For example, the first decision unit 113 pre-determines the size and cutting method of the cutting region when a left turn is guided, and the size and cutting method of the cutting region when a right turn is guided, and determines the cutting region in accordance with the path guidance.
[0219] Furthermore, regarding route guidance, for example, the current position and direction of travel of the vehicle are determined by analyzing positioning signals, and a route is guided to the destination.
[0220] The second decision unit 114 determines the compression ratio of the compression target area in accordance with the path guidance. For example, the second decision unit 114 determines the processing conditions in such a way that, based on the area that must be displayed, the compression ratio of the area on the side indicated by the path guidance becomes lower.
[0221] Here, consider the following situation: The display device 25 displays... Figure 6 In the state of the displayed image W, a right turn is indicated by path guidance. In this case, the first decision unit 113 determines the size of the clipping region and the clipping method when a right turn is indicated. In this example, the first decision unit 113 will... Figure 7 The area E that must be displayed and the area R on the right are determined as the clipping area C.
[0222] Next, the second decision unit 114 reduces the compression rate on the side of the image indicated by the path guidance. In this example, the second decision unit 114 reduces the compression rate on the side indicated by the path guidance. Figure 6 The compression ratio of the right-hand region R decreases, thus it is determined to be uncompressed. The image displayed is the same as in variant example 5, therefore illustrations and explanations are omitted.
[0223] In this way, the second decision unit 114 reduces the compression ratio of the side indicated by the path guidance on the image, thereby allowing the user to confirm the situation on the rear side based on the display image with less incongruity before operating the direction indicator. In other words, according to this modified example, it is possible to easily visually confirm vehicles or the like present on the rear side.
[0224] (Variation Example 9)
[0225] The first decision unit 113 and the second decision unit 114 can also determine the processing conditions of the photographic image based on the vehicle's travel speed.
[0226] In this variation, when the vehicle's speed is below a predetermined threshold, the first determination unit 113 determines a predetermined region in the photographic image as the clipping region, regardless of the number of roads or the driving position. When the vehicle's speed is below the predetermined threshold, the second determination unit 114 sets the compression ratio of the compression target region to 0. A compression ratio of 0 means no compression.
[0227] Alternatively, the user can manually switch between the first decision unit 113 and the second decision unit 114 to perform processing based on the number of roads and driving position to determine the processing conditions of the photographed image, or to perform the above-mentioned processing.
[0228] According to the dashcam unit 10 involved in this modification, when the vehicle is stationary or there is little need to pay attention to the rear and sides, an uncompressed and natural display image can be displayed on the display device 25. This reduces the likelihood of the user experiencing visual disorientation from the displayed image.
[0229] (Variation Example 10)
[0230] The first decision unit 113 and the second decision unit 114 can also determine the processing conditions of the photographic image based on the workshop distance.
[0231] In this modified example, when the vehicle distance exceeds a predetermined threshold, the first determination unit 113 determines a predetermined area in the photographic image as the clipping region, regardless of the number of roads or the driving position. When the vehicle distance exceeds the predetermined threshold, the second determination unit 114 sets the compression ratio of the compression target region to 0. A compression ratio of 0 means no compression.
[0232] In addition, the vehicle's inter-vehicle distance to other vehicles is calculated by analyzing the rear image D.
[0233] According to the dashcam unit 10 involved in this modification, when the need to pay attention to the rear and sides is low, such as when the vehicle distance exceeds a fixed distance, an uncompressed and natural display image can be displayed on the display device 25. This reduces situations where the user feels uncomfortable with the displayed image.
[0234] (Variation Example 11)
[0235] In the above-described variation 4, the method by which the second determination unit 114 reduces the compression ratio of the area where vehicles or the like exist was explained. However, the second determination unit 114 can also reduce the compression ratio of the area of the lane where the entrance to the service area or the like exists. Here, service areas or the like include, for example, service areas and parking lots.
[0236] In this modified example, the second determination unit 114 reduces the compression ratio of the area of the lane where the entrance to the service area or the like exists in the photographic image. The lane where the entrance to the service area or the like exists can be detected either by analyzing the photographic image or by the results of receiving positioning signals. Furthermore, the second determination unit 114 can also perform the above processing only if a fixed time has elapsed since the start of operation or the last break.
[0237] In this way, by reducing the compression ratio of the area of the lane where the entrance to the service area is located, it is easier for users to visually confirm the rear and side when changing lanes to the lane where the entrance to the service area is located in order to enter the service area.
[0238] While the various embodiments of this disclosure have been described above, they are presented as examples and are not intended to limit the scope of the invention. These new embodiments can be implemented in various other ways, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These new embodiments and their variations are included within the scope and spirit of the invention, and are included within the scope of the invention as described in the claims and its equivalents. Furthermore, the constituent elements involved in different embodiments and variations can be appropriately combined.
[0239] Furthermore, the effects of the various embodiments described in this specification are merely illustrative and not intended to limit the scope; other effects may also apply.
[0240] Explanation of reference numerals in the attached figures
[0241] 1: Display control system; 5: Vehicle; 10: Driving recorder unit; 11: Microcomputer; 20: Display unit; 25: Display device; 31: Front camera; 32: Rear camera; 40: Display unit; 45: Display; 111: Receiver; 112: First detector; 113: First decision unit; 114: Second decision unit; 115: Generator; 116: Display control unit; 117: Second detector.
Claims
1. A display control device, comprising: The first detection unit detects the number of roads, where the number of roads refers to the number of roads including the road on which the vehicle is traveling; The decision unit, based on the number of roads detected by the first detection unit, determines the processing conditions for the compressed object region in a photographic image obtained from the area surrounding the vehicle, which includes a mandatory display area representing a predetermined area and a compressed object region representing an area outside the mandatory display area; and The display control unit controls the processing of the photographic image according to the processing conditions determined by the decision unit and displays it on the display device. in, The decision unit determines the compression ratio in the vehicle width direction of the compression target area based on the number of roads detected by the first detection unit, such that the more roads there are, the higher the compression ratio, and the fewer roads there are, the lower the compression ratio. The display control unit displays the required display area on the display device at the same scale as the photographed image, and compresses the compression target area in the vehicle width direction with the compression ratio and displays the compression target area on the display device.
2. The display control device according to claim 1, wherein, The road includes pedestrian walkways and vehicle lanes.
3. The display control device according to claim 1 or 2, wherein, It also includes a second detection unit, which detects the driving position of the vehicle. The decision unit determines the processing conditions of the compressed object region in the photographic image based on the number of roads detected by the first detection unit and the driving position of the vehicle detected by the second detection unit.
4. The display control device according to claim 3, wherein, The decision unit determines the processing conditions by the compression ratio of the photographed image displayed in the vehicle width direction gradually increasing from the inside to the outside of the vehicle.
5. The display control device according to claim 3, wherein, The decision unit determines the processing conditions by increasing the compression ratio displayed in the vehicle width direction of areas in the photographed image where no other vehicles are present.
6. The display control device according to claim 3, wherein, In conjunction with the user's operation of the direction indicator, the decision unit determines the processing conditions for the compression ratio displayed in the vehicle width direction, which includes the compression target area.
7. The display control device according to claim 6, wherein, The decision unit determines the processing conditions in such a way that, based on the area that must be displayed, the compression rate of the display in the vehicle width direction in the area on the side indicated by the direction indicator becomes lower.
8. The display control device according to claim 3, wherein, In conjunction with the user's operation of the steering wheel, the decision unit determines the processing conditions for the compression ratio displayed in the vehicle width direction, which includes the compression target area.
9. The display control device according to claim 8, wherein, The decision unit determines the processing conditions in such a way that, based on the area that must be displayed, the compression ratio of the display in the vehicle width direction in the area on one side of the direction in which the steering wheel is turned becomes lower.
10. The display control device according to claim 3, wherein, In conjunction with the movement of the user's gaze, the decision unit determines the processing conditions for the compression ratio displayed in the vehicle width direction, which includes the compression target area.
11. The display control device according to claim 10, wherein, The decision unit determines the processing conditions in such a way that, based on the area that must be displayed, the compression rate of the display in the vehicle width direction of the area existing on the side that the line of sight is directed towards is reduced.
12. The display control device according to claim 3, wherein, The decision unit determines the processing conditions for the displayed compression rate in the vehicle width direction, which includes the compression target area, in accordance with the path guidance.
13. The display control device according to claim 12, wherein, The decision unit determines the processing conditions in such a way that, based on the area that must be displayed, the compression rate of the display in the vehicle width direction of the area on the side indicated by the path guide becomes lower.
14. The display control device according to claim 3, wherein, The decision unit determines the processing conditions in the following manner: when the vehicle's speed is lower than a predetermined threshold, the displayed compression ratio in the vehicle width direction becomes 0.
15. The display control device according to claim 3, wherein, The decision unit determines the processing conditions in the following manner: when the distance between the workshops exceeds a predetermined threshold, the displayed compression rate in the vehicle width direction becomes 0.
16. A display control method, executed by a display control device, the display control method comprising the following steps: The detection step involves detecting the number of roads, where the number of roads refers to the number of roads including the one or more roads that the vehicle is traveling on. The decision step determines the processing conditions of the compressed object area in the photographic image obtained by taking pictures of the area around the vehicle, which includes a must-display area representing a predetermined area and a compressed object area that is an area other than the must-display area, based on the number of roads detected in the detection step. as well as The display control step involves controlling the processing of the photographic image according to the processing conditions determined in the decision step and displaying it on a display device. The determination step includes a compression ratio determination step, in which the compression ratio in the vehicle width direction of the compression target area is determined based on the number of roads detected in the detection step, such that the more roads there are, the higher the compression ratio, and the fewer roads there are, the lower the compression ratio. The display control steps include a display step in which the area to be displayed is displayed on the display device at the same scale as the photographed image, and the compressed object area is compressed in the vehicle width direction at the compression ratio and displayed on the display device.
Citation Information
Patent Citations
Visual recognition device for vehicle
JP2019145982A
Vehicle display device and vehicular display method
CN107533795A
Image transmission method and image transmitter
US20100290522A1
Image compressing apparatus, image compressing method and vehicle-mounted image recording apparatus
US20110267452A1
Visual field support image generation device and image conversion method
US20200307456A1