DISPLAY CONTROL DEVICE AND IMAGE DISPLAY SYSTEM

Abstract

In a display control unit, an acquisition unit acquires image data representing an image of the area behind a motorcycle, captured by an image capture device. A control unit performs control to display an image based on the image data acquired by the acquisition unit and to overlay and display a vehicle width image, representing the vehicle width of the motorcycle, onto the image. For example, the control unit overlays and displays a vehicle width image (62) onto a rear image (60) of the rear area.

Description

TECHNICAL AREA

[0001] The present disclosure relates to a display control device and an image display system. STATE OF THE ART

[0002] JP-A No. 2008-100596 discloses a rearview camera system comprising an image capture device with a wide-angle lens, an image display device, and a control device, wherein the control device, depending on the actuation of a direction indicator control element, performs a control operation to extract a rearward image, a left blind spot image, and a right blind spot image from an area captured by the image capture device, to switch between the images, and to display them on the image display device.

[0003] Furthermore, JP-A No. 2012-140106 proposes a rear view assistance system comprising an image acquisition device that captures an image of the area behind a vehicle in order to acquire a vehicle-rear image, a control device that crops a portion of the vehicle-rear image and defines a cropped image according to the vehicle's condition, and a display device provided in a cabin that displays the cropped image, wherein the control device places a mask over a lower section of the cropped image and performs a display corresponding to the rear section of the carrier vehicle in the cropped image.

[0004] JP-A No. 2021-111854 discloses a display of a combined image on an electronic interior mirror, in which a rear-facing image captured by a rear camera and images of rear side areas captured by external camera units are processed and combined in such a way that they are continuous with each other, generating a carrier vehicle virtual image that virtually represents the carrier vehicle, and superimposing and displaying the carrier vehicle virtual image on the combined image, and generating a trajectory virtual image that extends from rear wheels in the rearward direction of the vehicle in the combined image, and superimposing and displaying the trajectory virtual image on the combined image. SUMMARY OF THE INVENTION Technical Problem

[0005] Compared to automobiles, motorcycles have a narrower width relative to the lanes they travel in, making it difficult to get a sense of their width on a display screen. Especially with two-wheeled vehicles, it's challenging to estimate their width by displaying their trajectory, as is possible with conventional technologies, leaving room for improvement.

[0006] The present disclosure was prepared taking into account the circumstances mentioned above with the aim of providing a display control device and an image display system that can make it easier to get a sense of the distance of a motorcycle in the vehicle's width direction from a display image. For the purposes of this disclosure, the term "image" includes both a moving image and a still image. Solution to the problem

[0007] To achieve the above-mentioned objective, a display control unit, with respect to a first aspect, includes an acquisition unit which acquires image data representing an image captured by an image capture device which captures an image of the area behind a motorcycle, and a control unit which performs control to display an image based on the image data acquired by the acquisition unit, and control to overlay and display a vehicle width image representing the vehicle width of the motorcycle onto the image.

[0008] According to the first aspect, the acquisition unit acquires image data representing an image captured by an image capture device that captures an image of the area behind a motorcycle.

[0009] The control unit performs a control to display an image based on the image data acquired by the acquisition unit, and a control to overlay and display a vehicle width image, representing the width of the motorcycle, onto the image. Therefore, the vehicle width image is overlaid and displayed on the image of the rear area, making it easier to get a sense of the motorcycle's distance in the direction of its width.

[0010] A display control unit with respect to a second aspect is the display control unit with respect to the first aspect, wherein the control unit sets the display position of the vehicle width image according to an area in which the image is displayed.

[0011] According to the second aspect, even if the area in which the image is displayed is changed, the display position of the vehicle width image is adjusted according to the area in which the image is displayed, so that the vehicle width image can be displayed in a suitable position.

[0012] A display control unit with respect to a third aspect is the display control unit with respect to the first or second aspect, wherein the control unit sets the display position of the vehicle width image based on a detection result obtained by a detection unit that detects the inclination of the vehicle body of the motorcycle.

[0013] According to the third aspect, even if the vehicle body is moving while tilted, the display position of the vehicle width image is adjusted based on the detection result of the tilt of the vehicle body, so that the vehicle width image can be displayed in a suitable position.

[0014] A display control device with respect to a fourth aspect is the display control device with respect to one of the first to third aspects, wherein the vehicle width image includes at least one from a distance image representing distance and an offset image representing an offset in the vehicle width direction.

[0015] According to the fourth aspect, the rearward distance on the display screen can be perceived more clearly if the vehicle width image includes a distance image, and if the vehicle width image includes an offset image, it becomes even easier to understand the vehicle width image and to get a sense of distance in the vehicle width direction.

[0016] A display control unit with respect to a fifth aspect is the display control unit with respect to one of the first to fourth aspects, wherein, when the vehicle body of the motorcycle appears in the image, the control unit displays the vehicle body section of the vehicle width image in a display mode different from other sections.

[0017] According to the fifth aspect, the vehicle body section of the vehicle width image is displayed differently from other sections in a display mode, making it easier to understand on the display screen that the vehicle body section of the vehicle width image corresponds to the vehicle width on the road.

[0018] An image display system with respect to a sixth aspect includes the display control device with respect to one of the first to fifth aspects, the image acquisition device, and a display device that displays the image.

[0019] According to the sixth aspect, an image display system can be provided which can make it easier to get a sense of the distance of a motorcycle in the vehicle width direction on a display image. Advantageous effects of the invention

[0020] As previously described in the present disclosure, this has the advantageous effect that a display control device and an image display system can be provided which can make it easier to obtain a sense of the distance of a motorcycle in the vehicle width direction on a display image. BRIEF DESCRIPTION OF THE IMAGES Fig. Figure 1 is a schematic representation showing an example of the configuration of an image display system with respect to one embodiment. Fig. Figure 2 is a schematic representation showing an example of the arrangement of a display device and an operating device. Fig. Figure 3 is a block diagram showing an example of the electrical configuration of the image display system with respect to the embodiment. Fig. Figure 4 is a functional block diagram, which shows an example of functional configurations of a control device with respect to the embodiment. Fig. Figure 5 is a flowchart showing an example of a sequence of processes that are carried out as a result of a control unit of the image display system executing an "image display program" with respect to the embodiment. Fig. Figure 6 is a representation showing an example of a rear view of the area behind a motorcycle. Fig. Figure 7 is a representation showing an example where a vehicle width image is overlaid and displayed on the rear image. Fig. Figure 8 is a representation showing an example in which the vehicle width image includes a distance image (for example, a line image in the vehicle width direction) that is displayed in a display mode such as a different color for each predetermined distance. Fig. Figure 9 is a representation showing an example in which the vehicle width image includes offset line images. Fig. Figure 10 is a representation showing an example in which the vehicle width image is displayed with dashed lines indicating the section in a vehicle body and solid lines indicating the section on a road. Fig. Figure 11 is a flowchart showing a first example modification of the sequence of processes that are carried out as a result of the control unit of the image display system executing the “image display program” with respect to the embodiment. Fig. Figure 12 is a representation to describe position settings where the vehicle width image is displayed in response to switching a display area. Fig. Figure 13 is a flowchart showing a second example modification of the sequence of processes that are carried out as a result of the control unit of the image display system executing the “image display program” with respect to the embodiment. Fig. Figure 14 is a representation showing an example where the vehicle width image is overlaid and displayed at a position adapted based on the inclination of the vehicle body. DESCRIPTION OF THE EXECUTION FORMS

[0021] An example of an embodiment of the disclosure is described in detail below with reference to the drawings. The image display system of the disclosure is an image display system for a motorcycle and shows the rider an image of the area behind the carrier vehicle. Here, "motorcycle" means a two-wheeled motor vehicle, a three-wheeled motor vehicle, or a four-wheeled motor vehicle below saddle-like vehicles, which is driven by a rider sitting astride the vehicle. The motorcycle includes a motorcycle driven by a power unit and a motorcycle driven by an engine. Examples of motorcycles include scooters and electric scooters. The following describes a case in which the motorcycle is a two-wheeled motor vehicle. (Configuration of the image display system)

[0022] First, the configuration of an image display system is described. Fig. Figure 1 is a schematic representation showing an example of the configuration of an image display system with respect to the embodiment.

[0023] As in Fig. As shown in Figure 1, an image display system 10 includes an image acquisition device 12, a display device 14, a control device 16, which serves as an example of a display control device, and an operating device 18. Although Fig. 1 shows only one of each device, the image acquisition device 12, the display device 14 and the operating device 18 can each be provided multiple times.

[0024] The image acquisition device 12 is arranged on the rear section of a body 11 of the motorcycle and captures an image of the area behind the vehicle. The image acquisition device 12 can be a camera with a viewing angle of less than 60 degrees or a camera with a wide-angle lens with a viewing angle equal to or greater than 60 degrees. For example, a digital video camera with an image sensor, such as a CCD or CMOS image sensor, can be used as the image acquisition device 12.

[0025] The display unit 14 shows the image of the area behind the vehicle captured by the image acquisition unit 12. Display unit 40 (see Fig. 3) The display device 14 can, for example, use a display such as a liquid crystal display, an organic EL display, or a touchscreen display, where a sensor screen or touch panel is applied to these displays. The display device 14 is installed in front of the driver in a position that is easily visible to the driver.

[0026] A display device 14 can be a display provided in the dashboard of the vehicle body 11 or an additional display. For example, as shown in Fig. Figure 2 shows that the display device 14 can be positioned in the center of the instrument panel when using an existing display. Furthermore, with an additional display, the display device 14 can be positioned near the gauge. In this case, it is easier for the driver to focus on the display device 14 if the distance between the driver and the display instruments (e.g., the gauge) is essentially the same as the distance between the driver and the display device 14.

[0027] The control unit 16 is an electronic control unit (i.e., an ECU: Electronic Control Unit) provided for controlling the display unit 14. The control unit 16 is installed within the vehicle body 11, for example by being embedded in the seat.

[0028] The control device 18 is a device that allows the rider to input controls. A handlebar switch or similar device mounted near the handlebars can be used as the control device 18. The rider can also input controls while moving, according to the handlebar switch. As described in Fig. As shown in Figure 2, the operating device 18 can, for example, be a push-button switch and be attached to the left handle. Alternatively, a direction indicator switch can also be used as the operating device 18, as described below. (Electrical configuration of the image display system)

[0029] Next, the electrical configuration of the image display system 10 will be described with reference to Fig. 3 described. Fig. Figure 3 is a block diagram showing an example of the electrical configuration of the image display system 10 with respect to the embodiment.

[0030] The control unit 16 includes a central processing unit 30 (CPU), a read-only memory 32 (ROM), a random access memory 34 (RAM), and a non-volatile memory 36. A "display program," described below, is pre-stored in the ROM 32 or the non-volatile memory 36. The CPU 30 reads pre-stored programs and executes them using the RAM 34 as the workspace.

[0031] The image acquisition device 12, the display device 14, and the operating device 18 are each connected to the control unit 16 either wired or wirelessly, enabling them to exchange data with the control unit 16. Similarly, various types of sensors 20, a communication unit 22, and a storage unit 24 are connected to the control unit 16 either wired or wirelessly, allowing them to exchange data with the control unit 16. The control unit 16 exchanges information with each component and controls each component.

[0032] The sensors 20 detect various types of vehicle motion states. For example, the sensors 20 include an inclination sensor (detecting the tilt of the vehicle body 11), a speed sensor (detecting the vehicle speed), and an acceleration sensor. The communication unit 22 is an interface for communication with an external device 28. The storage unit 24 stores data, such as image data for various types of displays, which are described below. Various types of storage media, such as a hard disk drive (HDD) or a memory card (such as an SD card), can be used for the storage unit 24. The control unit 16, together with the communication unit 22 and the storage unit 24, is housed in a single enclosure and installed as an ECU within the vehicle body 11.

[0033] The display unit 14 comprises a display unit 40, an operating unit 42, a sensor 44, and a loudspeaker 46. The display unit 40 is a display for showing an image based on image data. The operating unit 42 is a switch or button for inputting commands. The sensor 44 is an accelerometer for detecting the orientation of the display unit 14. The loudspeaker 46 is a device that outputs audio based on audio data.

[0034] The configurations described above are an example, and other elements can be added or omitted. For example, the image display system 10 can include a microphone 26 for collecting audio data in the vehicle's environment. The microphone 26 can, for instance, be a microphone integrated into the image acquisition device 12, as shown in the figures.

[0035] The following briefly describes the operation of the image display system 10. An image of the area behind the vehicle is captured by the image acquisition device 12, and the acquired image data is output to the control unit 16. The control unit 16 processes the acquired image data and outputs the processed image data to the display unit 14. The display unit 14 displays an image based on the acquired image data. In this embodiment, it is possible to change the display area by cropping and displaying a partial area from the image represented by the image data and by modifying the cropped area within the image.

[0036] Furthermore, the control unit 16 performs a control operation to overlay and display a vehicle width image, which represents the vehicle width of the motorcycle, onto the rear image.

[0037] The driver can also give various types of instructions via the control unit 18, such as an instruction to change the screen displayed on the display unit 14 and an instruction to zoom in or out.

[0038] In response to a driver instruction, the control unit 16 changes the display area, for example, to a screen showing an image centered on the area directly behind the vehicle, a screen showing more of the left than the right side of the vehicle, or a screen showing more of the right than the left side of the vehicle. Furthermore, in response to a driver instruction, the control unit 16 zooms in or out on and displays an image. Driver input can also be given via the control unit 42 of the display unit 14 or via a control screen displayed on the display unit 40 of the display unit 14.

[0039] Furthermore, the image display system 10 can also function as a trip recorder, recording the image data received from the image acquisition device 12. In this case, the control unit 16 also performs a process to store the image data in a storage device inside or outside the vehicle. If the image display system 10 includes multiple image acquisition devices, the control unit 16 combines several sets of image data received simultaneously from each of the devices and stores them in a storage device. Alternatively, the control unit 16 can generate composite image data and store it in the storage device, representing an image composed of multiple images.

[0040] The image data can be stored in the storage unit 24 or transmitted externally via the communication unit 22 and stored in an external storage device. For example, the image data can be stored on the PC or smartphone of the driver or another user.

[0041] Furthermore, the image display system 10 can be configured to link with image and recording data representing the area around the vehicle. Examples of data representing the area around the vehicle include audio data and data captured by various types of sensors.

[0042] For example, the image display system 10 can include a microphone 26 for collecting audio near the vehicle. The microphone 26 can, for example, be a microphone integrated into the image acquisition device 12, as shown in the figures, or it can be an additional microphone. Audio data acquired simultaneously with the image data can be linked to the image data and stored in the memory unit 24. (Functional configurations of the control unit)

[0043] Next, the functional configurations of the control unit 16 will be described with reference to Fig. 4 described. Fig. Figure 4 is a functional block diagram which shows an example of functional configurations of the control device 16 with respect to the embodiment.

[0044] The control unit 16 has the functions of an acquisition unit 50 and a control unit 52, and these functions are realized as a result of the CPU 30 loading and executing a display control program stored in the ROM 32 into the RAM 34.

[0045] The acquisition unit 50 acquires the image data representing the image of the area behind the motorcycle captured by the image acquisition device 12.

[0046] The control unit 52 performs a control to display an image based on the image data acquired by the acquisition unit 50, and a control to overlay and display a vehicle width image representing the motorcycle's width onto the image. For example, the control unit performs a control to overlay and display preset line images corresponding to the motorcycle's width onto the image of the area behind the motorcycle. This makes it easier to get a sense of the motorcycle's distance in the direction of its width on the display screen. Furthermore, displaying the vehicle width image makes it easier to understand the position directly behind the motorcycle on the display screen.In particular, if the display device 14 is not positioned offset from the center point at the front, it is more difficult to perceive the position directly behind the motorcycle, the motorcycle's position in the vehicle's width direction, and a sense of the motorcycle's distance in the vehicle's width direction on the display screen than if the display device 14 is positioned directly in front. Consequently, overlaying and displaying the vehicle width image 62 on the screen facilitates the effective perception of the position directly behind the motorcycle, the motorcycle's position in the vehicle's width direction, and a sense of the motorcycle's distance in the vehicle's width direction on the display screen.

[0047] The vehicle width display can be set, for example, as a result of the rider operating control unit 18 or similar to enter the motorcycle's width value, or as a result of the rider operating control unit 18 while viewing the screen to change the width of the vehicle width display. Alternatively, vehicle width displays for different vehicle models can be pre-stored, and the corresponding vehicle width display can be set by entering the vehicle model.

[0048] The display of the vehicle width image can be configured so that it can be switched on and off, for example via the handlebar switch of the control unit 18. (Image viewing program)

[0049] Next, the image viewer will be referred to as follows: Fig. 5 described. Fig. Figure 5 is a flowchart illustrating an example of a sequence of processes that occur as a result of the control unit 52 of the image display system 10 executing the "image display program" according to the embodiment. The image display program is executed by the CPU 30 of the control unit 16 and starts, for example, when the display unit 14 is switched on. Furthermore, an example case is described below in which the display of the vehicle width image is configured so that it can be switched on and off by the operating unit 18.

[0050] In step 100, CPU 30 starts acquiring the rear-captured image, and the process proceeds to step 102. That is, the acquisition unit 50 begins acquiring the image data representing the image of the area behind the motorcycle captured by the image acquisition device 12.

[0051] In step 102, CPU 30 begins displaying the image, and the process proceeds to step 104. That is, control unit 52 begins controlling the display of the image on display unit 40 of display device 14 based on the image data acquired by acquisition unit 50.

[0052] In step 104, CPU 30 determines whether the vehicle width display is switched off. Specifically, CPU 30 determines whether the vehicle width display was switched off by the control unit 18. If the result is NO, the process proceeds to step 106; if the result is YES, the process proceeds to step 108.

[0053] In step 106, the CPU 30 overlays and displays the vehicle width image on the image of the area behind the motorcycle, and the process proceeds to step 112. That is, the control unit 52 performs a control operation to overlay and display the vehicle width image, representing the vehicle width of the motorcycle, on the image. As in Fig. As shown in Figure 7, the control unit 52, for example, overlays and displays the vehicle width image 62 on a rear image 60 of the area behind the motorcycle, as shown in Figure 7. Fig. 6 shown. Fig. Figure 6 is an illustration showing an example of a rear view image 60 of the area behind the motorcycle, and Fig. Figure 7 is an illustration showing an example of an image in which the vehicle width image 62 is superimposed and displayed on the rear image 60.

[0054] In step 108, CPU 30 determines whether the vehicle width image 62 is currently overlaid. In this determination, CPU 30 checks whether step 106 has already been executed and whether the vehicle width image 62 is currently displayed. If the determination is YES, the process proceeds to step 110, and if the determination is NO, the process proceeds to step 112.

[0055] In step 110, the CPU 30 hides the vehicle width image 62 and the process moves on to step 112.

[0056] In step 112, the CPU 30 determines whether the display should be terminated.

[0057] In this determination, CPU 30, for example, determines whether display unit 14 has been switched off. If the determination is NO, the process returns to step 104, and the processes of steps 104 to 112 are repeated; if the determination in step 112 is YES, the process flow is terminated.

[0058] By carrying out the processes in this way, as in Fig. 7, the vehicle width image is overlaid and displayed on the rear image 60 of the area behind the motorcycle, making it easier to get a sense of the distance in the vehicle width direction on the display screen.

[0059] Furthermore, the vehicle width image 62 makes it easier to perceive the position directly behind the motorcycle on the display screen.

[0060] In particular, when the display device 14 is arranged offset from the center at the front, it is more difficult to perceive the position directly behind the motorcycle, the position of the motorcycle in the vehicle width direction, and a sense of the distance of the motorcycle in the vehicle width direction on the display screen than when the display device 14 is arranged directly in front, and therefore the overlay and display of the vehicle width image 62 facilitates the effective perception of the position directly behind the motorcycle, the position of the motorcycle in the vehicle width direction, and a sense of the distance of the motorcycle in the vehicle width direction on the display screen.

[0061] The line length of the line images 62A of the vehicle width image 62 can be changed according to the vehicle speed. For example, the line length can be increased if the vehicle speed increases.

[0062] Furthermore, in the example of the vehicle width image 62 in Fig. 7. While the linear line images 62A are shown as an example of the vehicle width image 62, the vehicle width image 62 is not limited to this. For example, the vehicle width image 62 can be, as in Fig. Figure 8 shows that, in addition to the line images representing the vehicle width, Figure 62A includes a distance image representing the distance, which is displayed in a different display mode, such as a different color or line type for each predetermined distance (e.g. 5m). Fig. Figure 8 shows an example where the vehicle width image 62 includes a distance image (e.g., a line image 62B in the vehicle width direction) displayed in a mode where the line type differs for each predetermined distance (e.g., 5 m) (e.g., a solid line, a long-dash-short-dash line, and a dashed line). By displaying the vehicle width image 62, which includes the distance image, the distance behind the motorcycle can be perceived on the display screen. Alternatively, as shown in Fig. Figure 9 shows that the vehicle width image 62 contains the line images 62A, which represent the vehicle width, and offset line images 62C. By displaying the vehicle width image 62, which includes the offset images, it becomes easier to understand the vehicle width image 62 and to get a sense of the distance in the vehicle width direction. Fig. Figure 9 is an illustration showing an example of the vehicle width image 62, which includes the offset line images 62C.

[0063] Furthermore, the vehicle width image 62, as in Fig. As shown in Figure 10, when part of the vehicle body 11 appears in the rear image 60, the section within the vehicle body 11 and the section on the road are displayed in different display modes. This makes it easier to understand that the vehicle body section of the vehicle width image corresponds to the vehicle width on the road on the display screen. Fig. Figure 10 shows an example in which the vehicle width image 62 is displayed with dashed lines indicating the section within the vehicle body 11 and solid lines indicating the section on the road. The display modes of the vehicle body section and the road section can also be distinguished by methods other than line type, such as line thickness, color, and / or transparency. <Erste Beispielmodifikation>

[0064] In the above embodiment, it could happen that the vehicle width image 62 is not displayed in a suitable position when the driver operates the control device 18 or similar to give an instruction to switch screens or to zoom in or out.

[0065] Therefore, in a first example modification, the control unit 52 performs a control operation to adjust and display the vehicle width image 62 according to a change in the display area or a zoom in or out.

[0066] Next, an example modification of the image display program will be described. Fig. Figure 11 is a flowchart showing a first example modification of the sequence of processes that are carried out as a result of the control unit 52 of the image display system 10 executing the "image display program" with respect to the embodiment. The image display program is executed by the CPU 30 of the control unit 16 and is started, for example, when the display unit 14 is switched on. Furthermore, an example case is described below in which the display of the vehicle width image is configured so that it can be switched on and off by the operating unit 18. Processes that are carried out with Fig. Items that have 5 in common receive the same reference symbols and are described accordingly.

[0067] In step 100, CPU 30 starts acquiring the rear-captured image, and the process proceeds to step 102. This means that acquisition unit 50 begins acquiring the image data representing the image of the area behind the motorcycle, captured by image acquisition device 12.

[0068] In step 102, CPU 30 begins displaying the image, and the process proceeds to step 104. That is, control unit 52 begins controlling the display of the image on display unit 40 of display device 14 based on the image data acquired by acquisition unit 50.

[0069] In step 104, the CPU 30 determines whether the vehicle width display is switched off. Specifically, the CPU 30 determines whether the display of the vehicle width display was switched off by operating the control unit 18. If the determination is NO, the process proceeds to step 105, and if the determination is YES, the process proceeds to step 108.

[0070] In step 105, the CPU 30 determines whether an instruction to change the display area or to zoom in or out has been given. For example, in this determination, the CPU 30 determines whether an instruction to change the display area or to zoom in or out was given by operating the control device 18. Alternatively, in a case where the display area is changed in conjunction with the direction indicator switch, the CPU 30 determines whether the direction indicator switch has been operated. If the determination is NO, the process proceeds to step 106, and if the determination is YES, the process proceeds to step 107.

[0071] In step 106, the CPU 30 overlays and displays the vehicle width image 62 on the image of the rear area, and the process proceeds to step 112. That is, the control unit 52 performs a control operation to overlay and display the vehicle width image 62, representing the vehicle width of the motorcycle, on the image. As in Fig. As shown in Figure 7, the control unit 52, for example, overlays and displays the vehicle width image 62 on the rear image 60 of the area behind the motorcycle, as shown in Figure 7. Fig. 6 shown.

[0072] In step 107, the CPU 30 adjusts the vehicle width image 62 according to the display and overlays and displays the adjusted vehicle width image 62 on the image of the area behind the motorcycle, and the process proceeds to step 112. That is, the control unit 52 performs a control operation to adjust and display the vehicle width image 62 according to changes in the display area or zooming in / out. Specifically, the control unit 52 adjusts, as shown in Fig. Figure 12 shows the position where the vehicle width image 62 is displayed, corresponding to the change in the display area. That is, as shown on the left side of Fig. As shown in Figure 12, in the case of a display area where more of the left side of the vehicle is shown than the right, the center of the vehicle body 11 is on the right side of the rear image 60, so that the control unit 52 displays the vehicle width image 62 according to the center position of the vehicle body 11 on the rear image 60. As shown in the middle of Fig. As shown in Figure 12, in the case where an image is displayed centered on the area directly behind the vehicle body 11, the center of the vehicle body 11 is in the middle of the rear image 60, so that the control unit 52 displays the vehicle width image 62 in the middle of the rear image 60 according to the center position of the vehicle body 11 in the rear image 60. And as shown on the right side of Fig. As shown in Figure 12, if more of the right side of the vehicle is displayed than the left, the center of the vehicle body 11 is on the left side of the rear image 60, so that the control unit 52 displays the vehicle width image 62 according to the center position of the vehicle body 11 on the rear image 60. Conversely, when zooming in or out of the image, the control unit 52 enlarges or reduces the vehicle width image 62 accordingly. This allows the vehicle width image 62 to be displayed in a suitable position and at a size appropriate to the zoom level.

[0073] In step 108, CPU 30 determines whether vehicle width image 62 is currently overlaid. During this determination, CPU 30 checks whether step 106 or step 107 has already been executed and whether vehicle width image 62 is currently displayed. If the answer is YES, the process proceeds to step 110, and if the answer is NO, the process proceeds to step 112.

[0074] In step 110, the CPU 30 hides the vehicle width image 62, and the process moves on to step 112.

[0075] In step 112, CPU 30 determines whether the display should be terminated. For example, CPU 30 determines whether display unit 14 has been switched off. If the determination is NO, the process returns to step 104 and the processes of steps 104 to 112 are repeated. If the determination in step 112 is YES, the process flow is terminated. <Zweite Beispielmodifikation>

[0076] In this context, motorcycles (especially two-wheeled ones) lean when turning, so that when the image captured by the image capture device 12 is displayed, the image also becomes a tilted image, and the actual center position of the vehicle body 11 may deviate from the center position of the rear image 60.

[0077] In a second example modification, the control unit 52 therefore adjusts the display position of the vehicle width image 62 based on the result of a detection of the inclination of the vehicle body 11 and overlays and displays the vehicle width image 62 at the adjusted position on the image of the area behind the motorcycle. This allows the vehicle width image 62 to be displayed in a suitable position.

[0078] The inclination of the vehicle body 11 can be detected, for example, by a sensor 20 such as an inclination sensor, or the control unit 52 can detect the inclination by image recognition from the captured image. In this case, the sensor 20 or the control unit 52 corresponds to a detection unit.

[0079] Next, an example modification of the image display program will be described. Fig. Figure 13 is a flowchart showing a second example modification of the sequence of processes that are carried out as a result of the control unit 52 of the image display system executing the "image display program" with respect to the embodiment. The image display program is executed by the CPU 30 of the control unit 16 and is started, for example, when the display unit 14 is switched on. Furthermore, an example case is described below in which the display of the vehicle width image is configured so that it can be switched on and off by the operating unit 18. Processes that are carried out with Fig. Items that have 5 in common receive the same reference symbols and are described accordingly.

[0080] In step 100, CPU 30 starts acquiring the rear-captured image, and the process proceeds to step 102. That is, acquisition unit 50 begins acquiring the image data representing the image of the area behind the motorcycle captured by image acquisition device 12.

[0081] In step 102, CPU 30 begins displaying the image, and the process proceeds to step 104. That is, control unit 52 begins controlling the display of the image on display unit 40 of display device 14 based on the image data acquired by acquisition unit 50.

[0082] In step 104, the CPU 30 determines whether the vehicle width display is switched off. Specifically, the CPU 30 determines whether the vehicle width display 62 has been switched off by operating the control unit 18. If the determination is NO, the process proceeds to step 105A, and if the determination is YES, the process proceeds to step 108.

[0083] In step 105A, the CPU 30 adjusts the display position of the vehicle width image 62 based on the tilt of the vehicle body 11, and the process proceeds to step 106. That is, the control unit 52 adjusts the display position of the vehicle width image 62 based on the tilt of the vehicle body 11 detected by the sensor 20, or the tilt of the vehicle body 11 detected by image recognition of the area behind the motorcycle.

[0084] In step 106, the CPU 30 overlays and displays the vehicle width image 62 on the image of the area behind the motorcycle, and the process proceeds to step 112. That is, the control unit 52 performs a control operation to overlay and display the vehicle width image 62, representing the vehicle width of the motorcycle, on the image. As in Fig. As shown in Figure 7, the control unit 52, for example, overlays and displays the vehicle width image 62 on the rear image 60 of the area behind the motorcycle, as shown in Figure 7. Fig. 6 shown. Furthermore, the control unit 52 overlays and displays when the vehicle body 11 is inclined, as shown in Fig. Figure 14 shows the vehicle width image 62 in a position adapted to the inclination of the vehicle body 11 from the center position of the display screen. This allows the vehicle width image 62 to be displayed in a suitable position even when the vehicle body 11 is inclined. Fig. Figure 14 is a representation showing an example where the vehicle width image 62 is superimposed and displayed on the rear image 60 in a position adapted based on the inclination of the vehicle body 11.

[0085] In step 108, CPU 30 determines whether the vehicle width image 62 is currently overlaid. During this determination, CPU 30 checks whether step 106 has already been executed and whether the vehicle width image 62 is currently displayed. If the determination is YES, the process proceeds to step 110, and if the determination is NO, the process proceeds to step 112.

[0086] In step 110, the CPU 30 hides the vehicle width image 62, and the process moves on to step 112.

[0087] In step 112, CPU 30 determines whether the display should be terminated. For example, CPU 30 determines whether display unit 14 has been switched off. If the determination is NO, the process returns to step 104, and the processes of steps 104 through 112 are repeated. If the determination in step 112 is YES, the process is terminated.

[0088] By carrying out the processes in this way, as in the second example modification, Fig. As shown in Figure 14, the vehicle width image 62 can be superimposed and displayed in a suitable position on the rear image 60 even when the vehicle body 11 is moving at an angle.

[0089] Even if the position in which the vehicle width image 62 is displayed is adjusted in the second example modification, the rear image 60 can also be rotated so that the tilted image is horizontal, and the vehicle width image 62 can be superimposed on the rotated rear image 60 and displayed.

[0090] Furthermore, although the embodiment and the example modifications have been described individually, they are not limited to these, and at least two of them can be combined.

[0091] Furthermore, although the above embodiment and example modifications describe an example in which a portion of the image represented by the image data is cropped and displayed, and the display area is changed by modifying the cropped area, the method for changing the display area is not limited to this. For example, the image acquisition device 12 can be configured to be rotatable, and the image acquisition area can be changed by rotating the image acquisition device 12 to change the image acquisition direction.

[0092] Furthermore, in the above embodiment and the example modifications, if the image display system 10 functions as a trip recorder, an image can be recorded in which the vehicle width image 62 is superimposed on the rear image 60 and displayed.

[0093] Although the above embodiment and example modifications describe an example in which the display device 14 is installed in the instrument panel gauge, the display device 14 simply needs to be installed in front of the rider, in a position easily visible to the rider, regardless of whether a gauge is present. For example, the display device can be installed on the handlebars, on a mirror mount, on top of the fuel tank, inside the fairing, or on top of the gauge.

[0094] Although the above embodiment and example modifications also describe an example in which the image display system 10 is equipped with the dedicated display unit 14, a portable information processing device such as a smartphone or tablet can also be used as the display unit 14. In this case, the portable information processing device uses a dedicated application program pre-installed on it to execute various types of processes in cooperation with the ECU, which is the control unit 16. For example, a smartphone can be wirelessly connected to the communication unit 22 via short-range wireless communication such as Wi-Fi (registered trademark) or Bluetooth (registered trademark), and an image based on the image data stored on the memory unit 24 can be displayed on the screen of the portable information processing device.

[0095] Furthermore, although the processes performed by the control unit 16 in the respective embodiments and example modifications described above are software processes realized by executing a program, they are not limited to this. For example, they can also be processes executed by hardware such as a graphics processing unit (GPU), an application-specific integrated circuit (ASIC), or a field-programmable gate array (FPGA). Alternatively, they can be processes that combine software and hardware. Furthermore, in cases where the processes are software-based, the program can be stored and distributed on various types of storage media.

[0096] Furthermore, the revelation is not limited to what has been described above and can, of course, be modified and implemented in many ways in addition to what has been described above, without deviating from its spirit.

[0097] This application claims priority from Japanese patent application No. 2023-115477, filed on July 13, 2023, the entire disclosure of which is hereby incorporated by reference. QUOTES INCLUDED IN THE DESCRIPTION

[0000] This list of documents cited by the applicant was automatically generated and is included solely for the reader's convenience. The list is not part of the German patent or utility model application. The DPMA accepts no liability for any errors or omissions. Cited patent literature

[0000] JP 2008-100596

[0002] JP 2012-140106

[0003] JP 2021-111854

[0004] JP 2023-115477

[0097]

Claims

[1] Display control unit with an acquisition unit that acquires image data representing an image captured by an image capture device that captures an image of an area behind a motorcycle, and a control unit which performs control to display an image based on the image data acquired by the acquisition unit, and control to overlay and display a vehicle width image representing the vehicle width of the motorcycle onto the image. [2] Display control device according to claim 1, wherein the control unit sets a display position of the vehicle width image for a display according to an area in which the image is displayed. [3] Display control device according to claim 1 or 2, wherein the control unit sets a display position of the vehicle width image based on a detection result obtained by a detection unit that detects an inclination of a vehicle body of the motorcycle. [4] Display control device according to one of claims 1 to 3, wherein the vehicle width image includes at least one from a distance image representing distance or an offset image of an offset in a vehicle width direction. [5] Display control device according to one of claims 1 to 4, wherein, when a vehicle body of the motorcycle appears in the image, the control unit displays a vehicle body section of the vehicle width image in a display mode different from other sections. [6] Image display system with the display control device according to one of claims 1 to 5, the image acquisition device, and a display device that shows the image.

Images