Display controller and picture display system
The video display system for motorcycles enhances visibility of vehicle width and distance by superimposing a vehicle width image on the rear view, addressing the challenge of narrow vehicle width perception on conventional displays.
Patent Information
- Application Number
- JP2023115477
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-07-13
- Publication Date
- 2025-01-24
AI Technical Summary
Motorcycles face challenges in accurately grasping the vehicle width and distance in the width direction due to their narrower width compared to driving lanes, making it difficult to understand the driving trajectory on conventional display screens.
A video display system for motorcycles that includes an imaging device to capture the rear view, a control unit to superimpose a vehicle width image on the displayed image, and adjust its position based on vehicle tilt and display range, enhancing visibility of the vehicle width and distance.
The system facilitates easier understanding of the vehicle's width and distance in the width direction by clearly displaying a vehicle width image, aiding in better navigation and positioning on the display screen.
Smart Images

Figure 2025012565000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a display control device and a video display system. [Background technology]
[0002] Patent Document 1 proposes a rearview device that includes an imaging device with a wide-angle lens, an image display device, and a control device, in which the control device, in conjunction with the operation of a turn signal operator, extracts an image including the area directly behind, an image including the blind spot to the left, and an image including the blind spot to the right from the area captured by the imaging device, and controls switching between the images to be displayed on the image display device.
[0003] Furthermore, Patent Document 2 proposes that in a rear visibility support system that includes an imaging means for imaging the area behind the vehicle to obtain a vehicle rear image, a control means for cutting out a part of the vehicle rear image depending on the state of the vehicle to set a cut-out image, and a display means that is provided within the vehicle cabin and displays the cut-out image, the control means overlays a mask on the bottom of the cut-out image and displays a display corresponding to the rear of the vehicle in the cut-out image.
[0004] Patent Document 3 also proposes displaying a composite image on an electronic inner mirror by performing image processing on a rear image captured by a rear camera and a rear side image captured by an outer camera unit so that the two images are continuous, generating a virtual image of the host vehicle that virtually shows the host vehicle and superimposing the virtual image of the host vehicle on the composite image, and generating a virtual image of the driving trajectory extending from the rear wheels toward the rear of the vehicle in the composite image and superimposing it on the composite image. [Prior art documents] [Patent documents]
[0005] [Patent Document 1] JP 2008-100596 A [Patent Document 2] JP 2012-140106 A [Patent Document 3] JP 2021-111854 A Summary of the Invention [Problem to be solved by the invention]
[0006] Compared to automobiles, motorcycles have a smaller vehicle width compared to the lane they are traveling in, so it is difficult to get a sense of distance in the vehicle width direction on the display screen. In particular, for motorcycles, there is room for improvement because it is difficult to understand the vehicle width by displaying the driving trajectory as in conventional technology.
[0007] The present invention has been made in consideration of the above-mentioned circumstances, and aims to provide a display control device and an image display system that make it easier to grasp the sense of distance in the width direction of a motorcycle on a displayed image. [Means for solving the problem]
[0008] In order to achieve the above object, the display control device according to the first aspect includes an acquisition unit that acquires video data representing an image captured by an imaging device that captures an image of the rear of a motorcycle, and a control unit that performs control to display an image based on the video data acquired by the acquisition unit, and control to superimpose a vehicle width image representing the width of the motorcycle on the image.
[0009] According to the first aspect, the acquisition unit acquires video data representing an image captured by an imaging device that captures an image of the rear of the motorcycle.
[0010] The control unit controls the display of an image based on the image data acquired by the acquisition unit, and controls the display of a vehicle width image representing the vehicle width of the motorcycle superimposed on the image. As a result, the vehicle width image is superimposed on the image captured behind the vehicle, making it easier to grasp the sense of distance in the vehicle width direction of the motorcycle.
[0011] A display control device according to a second aspect is the display control device according to the first aspect, wherein the control unit adjusts a display position of the vehicle width image in accordance with a range in which the video is displayed.
[0012] According to the second aspect, even if the range in which the image is displayed is changed, the display position of the vehicle width image is adjusted in accordance with the range in which the image is displayed, so that the vehicle width image can be displayed in an appropriate position.
[0013] A display control device according to a third aspect is the display control device according to the first or second aspect, wherein the control unit adjusts the display position of the vehicle width image based on the detection result of a detection unit that detects the inclination of the motorcycle body.
[0014] According to the third aspect, even if the vehicle body is traveling with an inclination, the display position of the vehicle width image is adjusted based on the detection result of the inclination of the vehicle body, so that the vehicle width image can be displayed at an appropriate position.
[0015] A display control device according to a fourth aspect is a display control device according to any one of the first to third aspects, wherein the vehicle width image includes at least one of a distance image representing distance and an offset image offset in the vehicle width direction.
[0016] According to the fourth aspect, when the vehicle width image includes a distance image, the rear distance on the display screen can be more easily recognized, and when the vehicle width image includes an offset image, the vehicle width image becomes even easier to understand. This makes it easier to see the distance between the vehicle widths. do.
[0017] A display control device according to a fifth aspect is a display control device according to any one of the first to fourth aspects, wherein when the body of the motorcycle is reflected in the image, the control unit displays the vehicle width image of the body part in a display mode different from the others.
[0018] According to the fifth aspect, the vehicle width image of the vehicle body part is displayed in a display mode different from the others, so that it is easy to see on the display screen that the vehicle width image of the vehicle body part corresponds to the vehicle width on the road.
[0019] A video display system according to a sixth aspect includes the display control device according to any one of the first to fifth aspects, the imaging device, and a display device that displays the video.
[0020] According to the sixth aspect, it is possible to provide an image display system that makes it easier to grasp the sense of distance in the width direction of the motorcycle on the displayed image. Effect of the Invention
[0021] As described above, the present invention has the effect of providing a display control device and an image display system that can make it easier to grasp the sense of distance in the width direction of the motorcycle on a displayed image. [Brief description of the drawings]
[0022] [Figure 1] 1 is a schematic diagram showing an example of a configuration of a video display system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a schematic diagram showing an example of the arrangement of a display device and an operation device. [Diagram 3] 2 is a block diagram showing an example of an electrical configuration of the video display system according to the present embodiment. FIG. [Figure 4] FIG. 2 is a functional block diagram showing an example of a functional configuration of a control device according to the present embodiment. [Diagram 5] 5 is a flowchart showing an example of the flow of processing performed by a control unit of the image display system according to the present embodiment by executing an "image display program." [Figure 6] FIG. 2 is a diagram showing an example of a rear image captured behind a motorcycle. [Figure 7] FIG. 13 is a diagram showing an example in which a vehicle width image is superimposed on a rear image; [Figure 8] FIG. 11 is a diagram showing an example of a vehicle width image including a distance image (for example, a line image in the vehicle width direction) in a display mode such as a different color for each predetermined distance; [Figure 9] FIG. 13 is a diagram showing an example of a vehicle width image including an offset line image. [Figure 10] FIG. 13 is a diagram showing an example of a vehicle width image in which the vehicle body portion is shown with a dotted line and the portion on the road is shown with a solid line. [Figure 11] 10 is a flowchart showing a first modified example of the flow of processes performed by the control unit of the image display system according to the present embodiment by executing the "image display program." [Figure 12] 13 is a diagram for explaining adjustment of the position at which the vehicle width image is displayed in response to switching of the display range. FIG. [Figure 13] 13 is a flowchart showing a second modified example of the flow of processes performed by the control unit of the image display system according to the present embodiment by executing the "image display program." [Figure 14] 13 is a diagram showing an example in which a vehicle width image is superimposed and displayed at a position adjusted based on the inclination of a vehicle body. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0023] An example of an embodiment of the present invention will be described in detail below with reference to the drawings. The image display system of the present disclosure is an image display system for a motorcycle, and displays an image behind the vehicle to the rider. Here, "motorcycle" refers to a two-wheeled motor vehicle, three-wheeled motor vehicle, or four-wheeled motor vehicle among saddle-riding vehicles on which a rider straddles. Motorcycles include those that use an engine as a drive source and those that use a motor as a drive source. Examples of motorcycles include motorcycles, scooters, and electric scooters. Below, a case where the motorcycle is a two-wheeled motor vehicle will be described.
[0024] (Video display system configuration) First, the configuration of the image display system will be described. Fig. 1 is a schematic diagram showing an example of the configuration of the image display system according to this embodiment.
[0025] As shown in Fig. 1, the image display system 10 includes an imaging device 12, a display device 14, a control device 16 as an example of a display control device, and an operation device 18. Although Fig. 1 illustrates one of each device, a plurality of imaging devices 12, display devices 14, and operation devices 18 may be provided.
[0026] The imaging device 12 is provided at the rear of the motorcycle body 11 and captures an image of the rear of the vehicle. The imaging device 12 may be a camera with a viewing angle of less than 60 degrees, or a camera equipped with a wide-angle lens with a viewing angle of 60 degrees or more. As the imaging device 12, for example, a digital video camera equipped with an image sensor such as a CCD image sensor or a CMOS image sensor can be used.
[0027] The display device 14 displays an image of the rear of the vehicle captured by the imaging device 12. As a display unit 40 (see FIG. 3) of the display device 14, for example, a liquid crystal display, an organic EL display, a touch panel display configured by overlaying a touch panel on such a display, or the like can be used. The display device 14 is installed in a position in front of the rider where it is easy to see.
[0028] The display device 14 may be a display mounted on the instrument panel of the vehicle body 11, or a display that is attached later. For example, as shown in FIG. 2, when a mounted display is used, the display device 14 can be disposed in the center of the instrument panel. When a display is attached later, the display device 14 can be disposed near the meter display. In this case, the distance from the rider to the instruments (e.g., the meter display) is made approximately the same as the distance from the rider to the display device 14, making it easier for the rider to focus.
[0029] The control device 16 is an electronic control unit (ECU) provided for controlling the display device 14. The control device 16 is installed inside the vehicle body 11, for example, by being embedded inside a seat.
[0030] The operation device 18 is a device that allows the rider to perform operation input. A handlebar switch or the like that is attached near the handlebar can be used as the operation device 18. The handlebar switch allows operation input even while riding. The operation device 18 is, for example, a push button type switch as shown in FIG. 2, and can be attached to the left grip. Also, as described later, a turn switch can also be used as the operation device 18.
[0031] (Electrical configuration of the video display system) Next, the electrical configuration of the image display system 10 will be described with reference to Fig. 3. Fig. 3 is a block diagram showing an example of the electrical configuration of the image display system 10 according to this embodiment.
[0032] The control device 16 includes a CPU (Central Processing Unit) 30, a ROM (Read Only Memory) 32, a RAM (Random Access Memory) 34, and a non-volatile memory 36. A "video display program" (described later) is pre-stored in the ROM 32 or the non-volatile memory 36. The CPU 30 reads out the pre-stored program and executes the program using the RAM 34 as a work area.
[0033] The imaging device 12, the display device 14, and the operation device 18 are connected to the control device 16 by wire or wirelessly so as to transmit and receive data to and from the control device 16. In addition, the various sensors 20, the communication unit 22, and the storage unit 24 are also connected to the control device 16 by wire or wirelessly so as to transmit and receive data to and from the control device 16. The control device 16 transmits and receives information to and from each unit, and controls each unit.
[0034] The sensor 20 detects various driving conditions of the vehicle. For example, the sensor 20 may be an inclination sensor that detects the inclination of the vehicle body 11, a vehicle speed sensor that detects the vehicle speed, an acceleration sensor that detects the acceleration, or other sensors. The communication unit 22 is an interface for communicating with an external device 28. The storage unit 24 stores data such as image data of various screens described below. For example, various storage media such as an HDD (Hard Disk Drive) and a memory card (e.g., an SD card) may be used for the storage unit 24. The control device 16 is housed in a case together with the communication unit 22 and the storage unit 24, and is installed inside the vehicle body 11 as an ECU.
[0035] The display device 14 includes a display unit 40, an operation unit 42, a sensor 44, and a speaker 46. The display unit 40 is a display for displaying images based on image data. The operation unit 42 is a switch or button for inputting operations. The sensor 44 is an acceleration sensor for detecting the orientation of the display device 14. The speaker 46 is a device for outputting sound based on audio data.
[0036] The above-described configuration is an example, and other components may be added, or some components may be omitted. For example, the image display system 10 may include a microphone 26 for collecting sounds around the vehicle. The microphone 26 may be, for example, a microphone built into the imaging device 12 as shown in the figure.
[0037] Here, the operation of the image display system 10 will be briefly described. An image of the rear of the vehicle is captured by the imaging device 12, and the obtained image data is output to the control device 16. The control device 16 processes the obtained image data and outputs it to the display device 14. The display device 14 displays the image based on the obtained image data. Note that in this embodiment, a part of an area is cut out from the image represented by the image data and displayed, and the display range can be changed by changing the cut-out range in the image.
[0038] The control device 16 also controls the display of a vehicle width image representing the vehicle width of the motorcycle, superimposed on the rear image.
[0039] The rider can also give various instructions via the operation device 18, such as an instruction to switch the screen displayed on the display device 14 or an instruction to enlarge or reduce the screen. In response to an instruction from the rider, the control device 16 changes the display range to, for example, a screen that displays an image centered on the area directly behind the vehicle, a screen that displays more of the left side of the vehicle than the right side, a screen that displays more of the right side of the vehicle than the left side, etc. In addition, the control device 16 enlarges or reduces the image and displays it in response to an instruction from the rider. Note that the operation input by the rider can also be performed via the operation unit 42 of the display device 14, or can also be performed via an operation screen displayed on the display unit 40 of the display device 14.
[0040] The image display system 10 may also function as a drive recorder that records image data obtained from the imaging device 12. In this case, the control device 16 also performs processing to store the image data in a storage device inside or outside the vehicle. In the case where multiple imaging devices are provided, multiple image data obtained from the devices at the same time are stored in the storage device in association with each other. Alternatively, composite image data representing a composite image of multiple images may be generated and the composite image data may be stored in the storage device.
[0041] The video data may be stored in the storage unit 24, or may be transmitted to the outside via the communication unit 22 and stored in an external storage device. For example, the video data may be stored in a personal computer, smartphone, or the like of the rider or other users.
[0042] Furthermore, the image display system 10 may record data representing the situation around the vehicle in association with the image data. Examples of the data representing the situation around the vehicle include audio data and data from various sensors.
[0043] For example, the video display system 10 may include a microphone 26 for collecting sounds around the vehicle. The microphone 26 may be, for example, a microphone built into the imaging device 12 as shown in the figure, or may be a microphone that is attached later. Sound data obtained at the same time as the video data may be stored in the storage unit 24 in association with the video data.
[0044] (Functional configuration of the control device) Next, the functional configuration of the control device 16 will be described with reference to Fig. 4. Fig. 4 is a functional block diagram showing an example of the functional configuration of the control device 16 according to this embodiment.
[0045] The control device 16 has the functions of an acquisition unit 50 and a control unit 52, and these functions are realized by the CPU 30 loading a display control program stored in the ROM 34 into the RAM 34 and executing it.
[0046] The acquisition unit 50 acquires image data representing an image captured by the imaging device 12 behind the motorcycle.
[0047] The control unit 52 controls the display of an image based on the image data acquired by the acquisition unit 50, and the superimposition of a vehicle width image representing the vehicle width of the motorcycle on the image. For example, a line image set in advance according to the vehicle width is superimposed as a vehicle width image on an image captured from the rear. This makes it easier to grasp the sense of distance in the vehicle width direction of the motorcycle on the display screen. Also, by displaying the vehicle width image, the position directly behind the motorcycle on the display screen becomes easier to understand. In particular, when the display device 14 is positioned away from the front, it is more difficult to grasp the position directly behind the motorcycle, the position in the vehicle width direction, and the sense of distance on the display screen than when the display device 14 is positioned directly in front, so by superimposing and displaying the vehicle width image 62, it becomes easier to effectively recognize the position directly behind the motorcycle, the position in the vehicle width direction, and the sense of distance on the display screen.
[0048] The vehicle width image may be set, for example, by operating the operation device 18 or the like to input the value of the motorcycle's width, or may be set by changing the width of the vehicle width image by operating the operation device 18 or the like while watching the screen. Alternatively, vehicle width images for each vehicle type may be stored in advance, and the corresponding vehicle width image may be set by inputting the vehicle type.
[0049] The display of the vehicle width image may be turned on and off by a handle switch of the operation device 18 or the like.
[0050] (Video display program) Next, the image display program will be described with reference to Fig. 5. Fig. 5 is a flow chart showing an example of the flow of processing performed by the control unit 52 of the image display system 10 according to this embodiment executing the "image display program". The image display program is executed by the CPU 30 of the control device 16, and starts, for example, when the display device 14 is turned on. In the following, a case where the vehicle width image can be turned on and off by the operation device 18 will be described as an example.
[0051] In step 100, the CPU 30 starts acquiring a captured rear image, and the process proceeds to step 102. That is, the acquisition unit 50 starts acquiring image data representing an image captured by the imaging device 12 behind the motorcycle.
[0052] In step 102, the CPU 30 starts displaying an image, and the process proceeds to step 104. That is, the control unit 52 starts control to display an image on the display unit 40 of the display device 14, based on the image data acquired by the acquisition unit 50.
[0053] In step 104, the CPU 30 determines whether or not the vehicle width image is turned off. This is done by determining whether or not the display of the vehicle width image has been turned off by the operation device 18. If the determination is negative, the process proceeds to step 106, and if the determination is positive, the process proceeds to step 108.
[0054] In step 106, the CPU 30 displays a vehicle width image superimposed on the captured rearward image, and then proceeds to step 112. That is, the control unit 52 performs control to superimpose a vehicle width image representing the motorcycle width on the image. For example, as shown in FIG. 7, a vehicle width image 62 is superimposed on a rearward image 60 captured behind the motorcycle, as shown in FIG. 6. FIG. 6 is a diagram showing an example of a rearward image 60 captured behind the motorcycle, and FIG. 7 is a diagram showing an example of the vehicle width image 62 superimposed on the rearward image 60.
[0055] On the other hand, in step 108, the CPU 30 determines whether or not the vehicle width image 62 is being superimposed. This is done by determining whether or not the above-mentioned step 106 has already been executed and the vehicle width image 62 is being displayed. If the determination is affirmative, the process proceeds to step 110, and if not, the process proceeds to step 112.
[0056] In step 110 , the CPU 30 makes the vehicle width image 62 non-displayable and proceeds to step 112 .
[0057] In step 112, the CPU 30 judges whether or not to end the display. For example, the judgment is made by judging whether or not the display device 14 has been turned off. If the judgment is negative, the process returns to step 104 and the above-mentioned processing is repeated, and if the judgment is positive, the series of processing is ended.
[0058] By performing this processing, as shown in FIG. 7, a vehicle width image 62 is superimposed on a rear image 60 captured behind the motorcycle, making it easier to grasp the sense of distance in the vehicle width direction on the display screen due to the vehicle width image 62.
[0059] Moreover, the vehicle width image 62 makes it easier to recognize the position directly behind the motorcycle on the display screen.
[0060] In particular, when the display device 14 is positioned away from the front, it is more difficult to grasp the position directly behind, the position in the vehicle width direction, and the sense of distance on the display screen than when the display device 14 is positioned directly ahead, so by displaying the vehicle width image 62 in a superimposed manner, it becomes easier to effectively recognize the position directly behind, the position in the vehicle width direction, and the sense of distance on the display screen.
[0061] The length of the line in the line image 62A of the vehicle width image 62 may be changed according to the vehicle speed. For example, the length of the line may be increased as the vehicle speed increases.
[0062] In addition, in the example of the vehicle width image 62 in FIG. 7, a linear line image 62A is shown as an example of the vehicle width image 62, but the vehicle width image 62 is not limited to this. For example, as shown in FIG. 8, the vehicle width image 62 may include a distance image that represents distance in a different display mode such as a different color or line type for each predetermined distance (for example, 5 m, etc.) in addition to the line image 62A representing the vehicle width. For example, the example of FIG. 8 shows an example of a vehicle width image 62 that includes a distance image (for example, a line image 62B in the vehicle width direction) in which the line type is displayed in a different display mode (solid line, dashed dot line, dotted line, etc.) for each predetermined distance (for example, 5 m, etc.). By displaying the vehicle width image 62 including the distance image, the rear distance on the display screen can be recognized. Alternatively, as shown in FIG. 9, a vehicle width image 62 including a line image 62A representing the vehicle width and an offset line image 62C may be displayed. By displaying the vehicle width image 62 including the offset image, the vehicle width image 62 becomes easier to understand. This makes it easier to see the distance between the vehicle widths. Fig. 9 is a diagram showing an example of a vehicle width image 62 including an offset line image 62C.
[0063] Also, as shown in Fig. 10, when a part of the vehicle body 11 is shown in the rear image 60, the vehicle width image 62 may be displayed in a different manner between the vehicle body 11 and the part on the road. This makes it easy to see that the vehicle width image of the vehicle body part on the display screen corresponds to the vehicle width on the road. In the example of Fig. 10, the vehicle width image 62 is displayed with the vehicle body 11 part shown as a dotted line and the part on the road shown as a solid line. As for the display manner, in addition to the line type, the display manner may be made different between the vehicle body part and the road part by other methods such as line thickness, color, transparency, etc.
[0064] <First Modification> In the above embodiment, when an instruction to switch the screen or to enlarge or reduce the screen is given by operating the operation device 18 or the like, the vehicle width image 62 may not be displayed in an appropriate position.
[0065] Therefore, in the first modified example, the control unit 52 performs control to adjust and display the vehicle width image 62 in accordance with changes in the display range and enlargement / reduction.
[0066] Next, a modified example of the image display program will be described. FIG. 11 is a flow chart showing a first modified example of the flow of processing performed by the control unit 52 of the image display system 10 according to this embodiment executing the "image display program". The image display program is executed by the CPU 30 of the control device 16, and starts, for example, when the display device 14 is turned on. In the following, a case where the vehicle width image can be turned on and off by the operation device 18 will be described as an example. Processes common to those in FIG. 5 will be described with the same reference numerals.
[0067] In step 100, the CPU 30 starts acquiring a captured rear image, and the process proceeds to step 102. That is, the acquisition unit 50 starts acquiring image data representing an image captured by the imaging device 12 behind the motorcycle.
[0068] In step 102, the CPU 30 starts displaying an image, and the process proceeds to step 104. That is, the control unit 52 starts control to display an image on the display unit 40 of the display device 14, based on the image data acquired by the acquisition unit 50.
[0069] In step 104, the CPU 30 judges whether or not the vehicle width image 62 is turned off. This judges whether or not the display of the vehicle width image 62 has been turned off by the operation device 18. If the judgement is negative, the process proceeds to step 105, and if the judgement is positive, the process proceeds to step .
[0070] In step 105, the CPU 30 judges whether or not a change in the display range or an instruction to enlarge or reduce the display range has been given. For example, the CPU 30 judges whether or not an instruction to change the display range or an instruction to enlarge or reduce the display range has been given by the operation device 18. Alternatively, in the case where the display range is changed in conjunction with a turn switch, the CPU 30 judges whether or not the turn switch has been operated. If the judgment is negative, the CPU 30 proceeds to step 106, and if the judgment is positive, the CPU 30 proceeds to step 107.
[0071] In step 106, the CPU 30 displays the vehicle width image 62 superimposed on the captured rearward image, and then proceeds to step 112. That is, the control unit 52 performs control to superimpose the vehicle width image 62 representing the vehicle width of the motorcycle on the image. For example, as shown in Fig. 7, the vehicle width image 62 is superimposed on the rearward image 60 captured rearward as shown in Fig. 6.
[0072] Also, in step 107, the CPU 30 adjusts the vehicle width image 62 according to the display, superimposes the vehicle width image 62 on the image captured behind the vehicle, and then proceeds to step 112. That is, the control unit 52 performs control to adjust and display the vehicle width image 62 according to the change in the display range and the enlargement / reduction. Specifically, as shown in FIG. 12, the position where the vehicle width image 62 is displayed is adjusted according to the switching of the display range. That is, in the case of a display range in which the left side of the vehicle is displayed more than the right side, the center of the vehicle body 11 is on the right side of the rear image 60, so the vehicle width image 62 is displayed according to the center position of the vehicle body 11 on the rear image 60. In addition, in the case of displaying an image centered on the rear of the vehicle body 11, the center of the vehicle body 11 is in the center of the rear image 60, so the vehicle width image 62 is displayed in the center of the rear image 60 according to the center position of the vehicle body 11 on the rear image 60. In addition, in the case of displaying the right side of the vehicle more than the left side, the center of the vehicle body 11 is on the left side of the rear image 60, so the vehicle width image 62 is displayed according to the center position of the vehicle body 11 on the rear image 60. On the other hand, when the image is enlarged or reduced, the vehicle width image 62 is enlarged or reduced accordingly. This allows the vehicle width image 62 to be displayed at an appropriate position and at a size that matches the enlargement or reduction.
[0073] On the other hand, in step 108, the CPU 30 determines whether or not the vehicle width image 62 is being superimposed. This is done by determining whether or not the above-mentioned step 106 or step 107 has already been executed and the vehicle width image 62 is being displayed. If the determination is affirmative, the process proceeds to step 110, and if the determination is negative, the process proceeds to step 112.
[0074] In step 110 , the CPU 30 makes the vehicle width image 62 non-displayable and proceeds to step 112 .
[0075] In step 112, the CPU 30 judges whether or not to end the display. For example, the judgment is made by judging whether or not the display device 14 has been turned off. If the judgment is negative, the process returns to step 104 and the above-mentioned processing is repeated, and if the judgment is positive, the series of processing is ended.
[0076] <Second Modification> Incidentally, since motorcycles (particularly two-wheeled vehicles) lean when turning, when the image captured by the imaging device 12 is displayed, the image is also tilted, and the actual center position of the body 11 may deviate from the center position of the rear image 60.
[0077] Therefore, in the second modified example, the control unit 52 adjusts the display position of the vehicle width image 62 based on the detection result of the inclination of the vehicle body 11, and displays it superimposed on the image of the captured rear view. This makes it possible to display the vehicle width image 62 at an appropriate position.
[0078] The inclination of the vehicle body 11 may be detected by, for example, a sensor 20 such as an inclination sensor, or the inclination may be detected by image recognition from an image captured by the control unit 52. In this case, the sensor 20 or the control unit 52 corresponds to the detection unit.
[0079] Next, a modified example of the image display program will be described. FIG. 13 is a flow chart showing a second modified example of the flow of processing performed by the control unit 52 of the image display system 10 according to this embodiment executing the "image display program." The image display program is executed by the CPU 30 of the control device 16, and starts, for example, when the display device 14 is turned on. In the following, a case where the vehicle width image can be turned on and off by the operation device 18 will be described as an example. Processes common to those in FIG. 5 will be described with the same reference numerals.
[0080] In step 100, the CPU 30 starts acquiring a captured rear image, and the process proceeds to step 102. That is, the acquisition unit 50 starts acquiring image data representing an image captured by the imaging device 12 behind the motorcycle.
[0081] In step 102, the CPU 30 starts displaying an image, and the process proceeds to step 104. That is, the control unit 52 starts control to display an image on the display unit 40 of the display device 14, based on the image data acquired by the acquisition unit 50.
[0082] In step 104, the CPU 30 judges whether or not the vehicle width image 62 is turned off. This judges whether or not the display of the vehicle width image 62 has been turned off by the operation device 18. If the judgement is negative, the process proceeds to step 105A, and if the judgement is positive, the process proceeds to step .
[0083] In step 105A, the CPU 30 adjusts the display position of the vehicle width image 62 based on the inclination of the vehicle body 11, and proceeds to step 106. That is, the control unit 52 adjusts the display position of the vehicle width image 62 based on the inclination of the vehicle body 11 detected by the sensor 20 or the inclination of the vehicle body 11 detected by image recognition of the image of the rear side.
[0084] In step 106, the CPU 30 displays the vehicle width image 62 superimposed on the image captured behind the vehicle, and then proceeds to step 112. That is, the control unit 52 performs control to display the vehicle width image 62 representing the vehicle width of the motorcycle superimposed on the image. For example, as shown in FIG. 7, the vehicle width image 62 is superimposed on the rear image 60 captured behind the vehicle, as shown in FIG. 6. Furthermore, when the vehicle body 11 is tilted, as shown in FIG. 14, the vehicle width image 62 is superimposed and displayed at a position adjusted from the center position of the display screen based on the tilt of the vehicle body 11. This allows the vehicle width image 62 to be displayed at an appropriate position when the vehicle body 11 is tilted. Note that FIG. 14 is a diagram showing an example in which the vehicle width image 62 is superimposed and displayed at a position adjusted based on the tilt of the vehicle body 11.
[0085] On the other hand, in step 108, the CPU 30 determines whether or not the vehicle width image 62 is being superimposed. This is done by determining whether or not the above-mentioned step 106 has already been executed and the vehicle width image 62 is being displayed. If the determination is affirmative, the process proceeds to step 110, and if not, the process proceeds to step 112.
[0086] In step 110 , the CPU 30 makes the vehicle width image 62 non-displayable and proceeds to step 112 .
[0087] In step 112, the CPU 30 judges whether or not to end the display. For example, the judgment is made by judging whether or not the display device 14 has been turned off. If the judgment is negative, the process returns to step 104 and the above-mentioned processing is repeated, and if the judgment is positive, the series of processing is ended.
[0088] By carrying out the process in this manner, in the second modified example, as shown in FIG. 14, when the vehicle body 11 is traveling with an inclination, the vehicle width image 62 can be displayed superimposed at an appropriate position.
[0089] In the second modified example, the position where the vehicle width image 62 is displayed is adjusted. However, the vehicle width image 62 may be superimposed and displayed by adjusting the rotation so that the tilted image is horizontal.
[0090] Although the above embodiment and modified examples have been described individually, the present invention is not limited to these, and a form in which at least two of them are combined may be used.
[0091] In the above embodiment and modified example, a part of the image represented by the video data is cut out and displayed, and the display range is changed by changing the cut-out range. However, the method of changing the display range is not limited to this. For example, the imaging device 12 may be made rotatable, and the imaging range may be changed by rotating the imaging device 12 to change the imaging direction.
[0092] In the above embodiment and modified examples, when the image display system 10 functions as a drive recorder, the image on which the vehicle width image 62 is superimposed may be recorded.
[0093] In the above embodiment and modified examples, the display device 14 is installed in the meter display of the instrument panel, but the display device 14 may be installed in a position that is easy for a rider in front of the rider to see, regardless of whether a meter display is present or not. For example, the display device may be installed on the handlebars, in a mirror mounting portion, on top of the fuel tank, inside the cowl, or above the meter display.
[0094] In the above embodiment and modified examples, an example in which a dedicated display device 14 is provided has been described, but a portable information processing device such as a smartphone or tablet may be used as the display device 14. In this case, the portable information processing device executes various processes by using a dedicated application program pre-installed and working with an ECU, which is the control device 16. For example, a smartphone is wirelessly connected to the communication unit 22 by short-range wireless communication such as Wi-Fi (registered trademark) or Bluetooth (registered trademark), and can display an image based on the image data stored in the storage unit 24 on the screen of the portable information processing device.
[0095] In addition, the processing performed by the control device 16 in each of the above embodiments and modifications has been described as software processing performed by executing a program, but is not limited to this. For example, the processing may be performed by hardware such as a GPU (Graphics Processing Unit), an ASIC (Application Specific Integrated Circuit), and an FPGA (Field-Programmable Gate Array). Alternatively, the processing may be a combination of both software and hardware. In addition, when the processing is performed by software, the program may be stored in various storage media and distributed.
[0096] Furthermore, the present invention is not limited to the above, and it goes without saying that various modifications can be made without departing from the spirit and scope of the present invention. [Explanation of symbols]
[0097] 10 image display system, 11 vehicle body, 12 imaging device, 14 display device, 16 control device, 20 sensor, 30 CPU, 50 acquisition unit, 52 control unit, 62 rear image, 62 vehicle width image, 62A to 62C line image
Claims
1. an acquisition unit that acquires image data representing an image captured by an imaging device that captures an image of the rear of the motorcycle; a control unit that controls displaying an image based on the image data acquired by the acquisition unit, and controls displaying a vehicle width image representing a vehicle width of the motorcycle by superimposing it on the image; A display control device comprising:
2. The display control device according to claim 1 , wherein the control unit adjusts a display position of the vehicle width image in accordance with a range in which the image is to be displayed.
3. The display control device according to claim 1 , wherein the control unit adjusts the display position of the vehicle width image based on a detection result of a detection unit that detects an inclination of a body of the motorcycle.
4. The display control device according to claim 1 , wherein the vehicle width image includes at least one of a distance image representing a distance and an offset image offset in a vehicle width direction.
5. The display control device according to claim 1 , wherein, when a body of the motorcycle is captured in the image, the control unit displays the vehicle width image of the part of the body in a display mode different from other parts.
6. A display control device according to claim 1 ; The imaging device; A display device for displaying the image; and A video display system comprising:
Citation Information
Patent Citations
Display control device, display control method, and display control program
JP2020140603A
Driving auxiliary system
JP2021051489A
Rear side visual recognition device
JP2008100596A
Rear visibility support system
JP2012140106A
Electronic mirror system for vehicle
JP2021111854A