Video processing apparatus and video processing system

Abstract

To provide a video processing apparatus and a video processing system, capable of realizing a display of a video image with a good visibility while suppressing deterioration of information amount.SOLUTION: A video processing apparatus that controls a display device arranged at a front side of a rider of a motor cycle, comprises: a memory; and a processor connected to the memory. The processor executes steps of: acquiring a video image data from an imaging device that images a rear side of the motor cycle at the time of traveling the motor cycle; storing the video image data acquired into the memory; acquiring inclination information from a sensor that detects an inclination of the imaging device; correcting the video image data so that a video image displayed onto the video image device is rotated in accordance with the inclination information acquired; and displaying the video image on the basis of the video image data to be corrected to the display device.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a video processing device and a video processing system. [Background technology]

[0002] 2. Description of the Related Art Conventionally, there is known a technique for providing a rider with visual information about the area behind a motorcycle by displaying an image captured behind the motorcycle on a display device.

[0003] When a motorcycle or other motorbike makes a turn, the body of the vehicle tilts. When the body tilts, the camera attached to the body also tilts. This may cause the area that the user wants to see to not be displayed on the display device. In order to solve this problem, it is possible to correct the tilt of the captured image. For example, Patent Document 1 describes a method of correcting the captured image captured by a camera unit installed at the rear of the vehicle body using a gyro sensor or the like.

[0004] On the other hand, there is a need to store video data captured while driving, because in the event of an accident, this video data can be used as evidence to prove the circumstances of the accident. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2019-68343 A Summary of the Invention [Problem to be solved by the invention]

[0006] However, when tilt correction is performed, a part of the captured image data is lost. If the image data is to be stored as evidence, such a reduction in the amount of information is undesirable.

[0007] An object of the present invention is to provide an image processing device and an image processing system that can realize the display of an image with good visibility while suppressing a decrease in the amount of information. [Means for solving the problem]

[0008] A first aspect of the present disclosure is an image processing device that controls a display device positioned in front of a rider of a motorcycle, comprising a memory and a processor connected to the memory, wherein the processor acquires image data from an imaging device that images the rear of the motorcycle while the motorcycle is traveling, stores the acquired image data in the memory, acquires tilt information from a sensor that detects the tilt of the imaging device, corrects the image data so that an image displayed on the display device is rotated in accordance with the acquired tilt information, and causes the display device to display an image based on the corrected image data.

[0009] A second aspect of the present disclosure is an image processing system including an imaging device that captures an image of the area around a motorcycle, a display device that is positioned in front of a rider and displays an image based on image data acquired from the imaging device, a sensor that detects the tilt of the imaging device, and a control device that performs a first control to store the image data acquired from the imaging device in a storage device while the motorcycle is traveling, and a second control to correct the image data so that the image displayed on the display device is rotated in accordance with the tilt information obtained from the sensor, and to display an image based on the corrected image data on the display device. Effect of the Invention

[0010] According to the present invention, it is possible to realize display of an image with good visibility while suppressing a decrease in the amount of information. [Brief description of the drawings]

[0011] [Figure 1] 1 is a schematic diagram showing an example of a configuration of a video processing system according to an embodiment of the present invention. [Diagram 2]1 is a block diagram showing an example of an electrical configuration of a video processing system according to an embodiment of the present invention. [Diagram 3] FIG. 1 is a perspective view showing an example of a configuration of an imaging device. [Figure 4] 1 is a schematic cross-sectional view taken along an optical axis illustrating an example of a configuration of an imaging device. [Diagram 5] 11 is a schematic cross-sectional view taken along the optical axis and showing another example of the configuration of an imaging device. FIG. [Figure 6] FIG. 1 is a schematic diagram illustrating alignment of an image sensor and a tilt sensor. [Figure 7] FIG. 2 is a schematic diagram showing an example of an arrangement of display devices. [Figure 8] FIG. 2 is a functional block diagram illustrating an example of a functional configuration of a control device according to an embodiment of the present invention. [Figure 9] 11(A) to 11(C) are a flowchart showing an example of a processing flow of a video processing program according to an embodiment of the present invention. [Figure 10] 1A to 1C are diagrams illustrating tilt correction of an image. [Figure 11] 13(A) and 13(B) are schematic diagrams showing an example of a display image. [Figure 12] FIG. 2 is a schematic diagram showing an example of a stored image. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] An embodiment of the present invention will now be described in detail with reference to the drawings.

[0013] The image processing system of the present disclosure is an image processing system for motorcycles, which displays images of the surroundings (for example, rear, backward and forward) of the vehicle to the rider. Here, "motorcycle" refers to a two-wheeled, three-wheeled or four-wheeled vehicle among saddle-riding vehicles on which a rider straddles. Motorcycles include those powered by an engine and those powered by a motor. Examples of motorcycles include motorbikes, scooters and electric scooters. Below, a description will be given of the case where the motorcycle is a two-wheeled motor vehicle.

[0014] (Video Processing System Configuration) First, the configuration of the video processing system will be described. Fig. 1 is a schematic diagram showing an example of the configuration of a video processing system. As shown in Fig. 1, a video processing system 10 includes an imaging device 12, a display device 14, a control device 16, and an operation device 18. Although Fig. 1 shows one of each device, each of the imaging device 12, the display device 14, and the operation device 18 may be provided in multiple units, or may be integrated.

[0015] The imaging device 12 is a device that captures images of the surroundings of the vehicle body 11. As the imaging device 12, for example, a digital video camera equipped with an image sensor such as a CCD image sensor or a CMOS image sensor can be used. The imaging device 12 can be, for example, a square camera as shown in FIG.

[0016] One or more imaging devices 12 may be installed. For example, as shown in FIG. 1, imaging device 12R for imaging the rear of the vehicle may be installed at the rear of the vehicle body 11, and imaging device 12F for imaging the front of the vehicle may be installed at the front of the vehicle body 11. Imaging devices 12R and 12F are preferably arranged on the center line of the vehicle body 11. In this arrangement, the imaging range of the imaging device is set to a range of a predetermined angle to the left and right from the center line of the vehicle body including the area directly behind the vehicle body width. The imaging device 12 may be only imaging device 12R, or more imaging devices may be installed. For example, imaging devices for imaging the sides of the vehicle may be installed on the sides of the vehicle body 11.

[0017] The display device 14 is a device that displays an image behind the vehicle to the rider. As a display unit 40 (see FIG. 2) of the display device 14, for example, a liquid crystal display, an organic EL display, a touch panel display configured by overlaying a touch panel on such a display, or the like can be used. The display device 14 is installed in a position in front of the rider where it is easy for the rider to see.

[0018] The display device 14 may be a display mounted on the instrument panel of the vehicle body 11, or a display that is attached later. For example, as shown in Fig. 7, when a meter display for displaying vehicle information is disposed in the center of the instrument panel, the display device 14 may be disposed inside or near the meter display. When disposing the display device 14, the distance from the rider to the instruments (e.g., the meter display) is made approximately the same as the distance from the rider to the display device 14, making it easier for the rider to focus.

[0019] The control device 16 is a control function part of an electronic control unit (ECU) provided for controlling the display device 14. The control device 16 is installed inside the vehicle body 11, for example, by being embedded inside a seat.

[0020] The operation device 18 is a device that allows the rider to perform operation input. A handlebar switch or the like that is attached near the handlebar can be used as the operation device 18. The handlebar switch allows operation input to be performed even while riding. The operation device 18 can be attached to the left grip, for example.

[0021] (Electrical configuration of the video processing system) Next, the electrical configuration of the video processing system 10 will be described. 2 is a block diagram showing an example of the electrical configuration of the video processing system 10. The control device 16 includes a CPU (Central Processing Unit) 30, a ROM (Read Only Memory) 32, a RAM (Random Access Memory) 34, and a non-volatile memory 36. A "video processing program" (described later) is stored in advance in the ROM 32 or the non-volatile memory 36. The CPU 30 reads out the program stored in advance and executes the program using the RAM 34 as a work area.

[0022] The imaging device 12, the display device 14, and the operation device 18 are connected to the control device 16 by wire or wirelessly so as to transmit and receive data to and from the control device 16. In addition, the various sensors 20, the communication unit 22, and the storage unit 24 are also connected to the control device 16 by wire or wirelessly so as to transmit and receive data to and from the control device 16. The control device 16 transmits and receives information to and from each unit, and controls each unit.

[0023] The sensor 20 is a sensor for acquiring various vehicle information. For example, the sensor 20 may include a sensor such as a radar (e.g., a millimeter wave sensor) that detects the distance and direction to an obstacle around the vehicle, or a LiDAR (Laser Imaging Detection and Ranging).

[0024] The communication unit 22 is an interface for communicating with an external device 28. The storage unit 24 is an external storage device such as a hard disk drive (HDD) or a portable recording medium (for example, a memory card such as an SD card). The storage unit 24 stores image data of various screens, which will be described later. The control device 16, together with the communication unit 22 and the storage unit 24, is installed inside the vehicle body 11 as an ECU. The control device 16, the communication unit 22, and the storage unit 24 may be stored in a common case. The portable recording medium is detachable from the ECU.

[0025] The imaging device 12 is equipped with a tilt sensor 26 for detecting the tilt of the imaging device 12. The tilt sensor 26 may be a two- or more-axis acceleration sensor as long as it can detect the direction of gravity. The tilt sensor 26 of this embodiment is preferably a two-axis acceleration sensor or a three-axis acceleration sensor.

[0026] The display device 14 includes a display unit 40, an operation unit 42, a sensor 44, and a speaker 46. The display unit 40 is a display for displaying images based on image data. The operation unit 42 is a switch or button for inputting operations. As described above, the display unit 40 may be a touch panel display, in which case the touch panel display also corresponds to the operation unit 42. The sensor 44 is an acceleration sensor for detecting the orientation of the display device 14. The speaker 46 is a device for outputting sound based on audio data.

[0027] The configuration described above is one example, and other members may be added, or some members may be omitted.

[0028] (Configuration of imaging device) Here, we will explain the configuration of the imaging device 12. Fig. 3 is a perspective view showing an example of the configuration of the imaging device 12. Figs. 4 and 5 are schematic cross-sectional views taken along the optical axis showing an example of the configuration of the imaging device 12.

[0029] The imaging device 12 may take the form of a so-called rectangular camera, and includes a rectangular parallelepiped housing 50 and an attachment portion 52 for attaching the housing 50 to the vehicle body 11. The imaging device 12 may also include a pilot lamp 68 on one surface of the housing 50. During recording, the pilot lamp 68 can be turned on to notify following vehicles that recording is in progress.

[0030] The imaging device 12 includes an imaging optical system 54 such as a lens, and a board 56 on which an image sensor 58 is mounted. The imaging optical system 54 and the board 56 on which the image sensor 58 is mounted are housed within a housing 50 as a main body. A wiring cord 60 for connecting the main body to an external device is drawn out from the housing 50.

[0031] Also, a tilt sensor 26 is attached to the imaging device 12. By attaching the tilt sensor 26 to the imaging device 12, even if the imaging device 12 is attached at an angle to the vehicle body 11, the tilt of the imaging device 12 (i.e., the tilt of the image) can be detected regardless of how the imaging device 12 is attached or the tilt of the vehicle body 11. This reduces the user's effort in attaching the imaging device 12 horizontally to the vehicle body 11. Note that the tilt due to how the imaging device 12 is attached may be corrected before the image is captured.

[0032] 4, the tilt sensor 26 is attached to the outside of the housing 50. The tilt sensor 26 is housed in a rectangular parallelepiped housing 62. A wiring cord 64 for connecting the tilt sensor 26 to an external device is drawn out from the housing 62. The housing 62 housing the tilt sensor 26 is stacked on the housing 50 housing the main body of the imaging device 12, and is fixed to the housing 50 by a fixture, adhesive, or the like. The housing 62 is formed so as to protrude forward from the front surface of the housing 50, thereby also functioning as a awning structure.

[0033] 5, the tilt sensor 26 is attached inside the housing 50. The tilt sensor 26 is mounted on a board 66 different from the board 56 on which the image sensor 58 is mounted, and is housed inside the housing 50.

[0034] In either arrangement, it is preferable that the tilt sensor 26 is attached so that the horizontal direction of the tilt sensor 26 coincides with the horizontal direction of the image captured by the imaging device 12. If the tilt sensor 26 is tilted with respect to the image sensor 58, the image will be tilted even if the tilt sensor 26 indicates horizontal. This tilt of the image can be corrected by image processing, but if the horizontal direction coincides from the beginning, correction is not necessary.

[0035] For example, as shown in Fig. 6, the longitudinal axis of the image sensor 58 is the X-axis, the transverse axis is the Y-axis, and the optical axis direction passing through the center O is the Z-axis. The axis of the tilt sensor 26 that detects the direction of gravity is the y-axis, the axis facing the optical axis direction is the z-axis, and the axis intersecting these is the x-axis. In this case, the X-axis of the image sensor 58 and the x-axis of the tilt sensor 26 are made to coincide. It is more preferable to make the Z-axis of the image sensor 58 and the z-axis of the tilt sensor 26 coincide. In other words, it is more preferable to make the three axial directions of the image sensor 58 and the three axial directions of the tilt sensor 26 coincide.

[0036] As shown in FIG. 4, when the tilt sensor 26 is attached to the outside of the housing 50, if the imaging device 12 is a rectangular camera, the housing 50 has a rectangular parallelepiped shape, making it easy to align the horizontal directions (i.e., axial directions) of the tilt sensor 26 and the image sensor 58.

[0037] (Video processing system operation) Here, the operation of the video processing system 10 will be briefly described. An image of the rear of the vehicle is captured by the imaging device 12, and the obtained image data is output to the control device 16. The control device 16 acquires tilt information from the tilt sensor 26 of the imaging device 12, corrects the tilt of the obtained image data in accordance with the tilt information, and outputs the corrected image data to the display device 14. The display device 14 displays an image based on the obtained image data.

[0038] The image processing system 10 also functions as a drive recorder that records image data obtained from the imaging device 12. For this reason, the control device 16 also performs processing to store image data in a storage device inside or outside the vehicle. When multiple imaging devices are provided, multiple image data obtained from each device at the same time are associated with each other and stored in the storage device. Alternatively, composite image data representing a composite image of multiple images may be generated and stored in the storage device.

[0039] The video data may be stored in the storage unit 24, or may be transmitted to the outside via the communication unit 22 and stored in an external storage device. For example, the video data may be stored in a personal computer, smartphone, or the like of the rider or other users. The following describes a case where the video data is stored in the storage unit 24 inside the vehicle body 11.

[0040] The rider can also give various instructions via the operation device 18. For example, the image displayed on the display device 14 is switched in response to an instruction from the rider input via the operation device 18. Operation input by the rider can be performed via an operation unit 42 of the display device 14, or can be performed via an operation screen displayed on the display unit 40 of the display device 14.

[0041] The image processing system 10 may also record data representing the situation around the vehicle in association with the image data. Examples of data representing the situation around the vehicle include audio data and detection data from various sensors. These data obtained at the same time as the image data may be stored in the storage unit 24 in association with the image data.

[0042] (Functional configuration of the control device) Next, the functional configuration of the control device 16 will be described. 8 is a functional block diagram showing an example of the functional configuration of the control device 16. The control device 16 includes an image data acquisition unit 70 that acquires image data from the imaging device 12 that captures an image of the rear of the motorcycle while the motorcycle is traveling, an image data storage unit 72 that stores the acquired image data in a memory, an inclination information acquisition unit 74 that acquires inclination information from the inclination sensor 26 that detects the inclination of the imaging device 12, an inclination correction unit 76 that corrects the image data so that the image displayed on the display device is rotated according to the acquired inclination information, and a display control unit 78 that causes the display device 14 to display an image based on the corrected image data. Each of these functional units is realized by the CPU 30 of the control device 16 executing an "image processing program" described later.

[0043] (Video Processing Program) Next, the "video processing program" will be described. 9A is a flowchart showing an example of the processing flow of the "video processing program." The video processing program is executed by the CPU 30 of the control device 16, and is started when the power is turned on by operating a power switch such as a key or a switch.

[0044] First, in step S100, the CPU 30 determines whether or not an instruction to display a video has been given. The instruction to display a video may be given, for example, by operating the operation device 18. If an instruction to display a video has not been given, the CPU 30 makes a negative decision in step S100 and proceeds to step S102. Then, in step S102, the CPU 30 executes an "video storage process."

[0045] On the other hand, if an instruction to display a video has been issued, an affirmative decision is made in step S100, and the process proceeds to step S104. Then, in step S104, the CPU 30 executes an "video storage and display process".

[0046] That is, in the image processing system of this embodiment, the saving of image data starts at the same time as the power is turned on, and the saving of the image data continues until the power is turned off. Also, in the image processing system of this embodiment, when an instruction to display an image is given by the rider, the image data is saved and the rear image is displayed on the display device 14.

[0047] Next, in step S106, the CPU 30 judges whether or not to end the routine. For example, when an instruction to turn off the power is given by operating a switch such as a power switch, an affirmative decision is made in step S106 and the routine ends. On the other hand, when the routine does not end, a negative decision is made in step S106 and the process returns to step S100. Therefore, the processes in steps S100 to S106 are repeatedly executed until the routine ends.

[0048] (Video storage processing) Next, the flow of the "video storage process" executed in step S102 will be described with reference to FIG.

[0049] First, in step S110, the CPU 30 acquires video data from the imaging device 12. Here, the unprocessed video data acquired from the imaging device 12 is referred to as "captured video data". Next, in step S112, the CPU 30 performs image processing on the captured video data acquired from the imaging device 12 into a form suitable for storage, and generates video data for storage to be stored in the storage unit 24. Here, the video data for storage is referred to as "stored video data". Note that the image processing into a form suitable for storage may be, for example, a process of cutting out the video without changing the angle of view of the captured video. Next, in step S114, the CPU 30 stores the stored video data in the storage unit 24, and ends the routine.

[0050] (Video storage and display processing) Next, the flow of the "video storage and display process" executed in step S104 will be described with reference to FIG.

[0051] First, in step S120, the CPU 30 acquires captured video data from the imaging device 12. Next, in step S122, the CPU 30 performs image processing on the captured video data acquired from the imaging device 12 into a form suitable for storage, thereby generating stored video data. Next, in step S124, the CPU 30 stores the stored video data in the storage unit 24.

[0052] Next, in step S126, CPU 30 acquires tilt information from tilt sensor 26. Next, in step S128, CPU 30 corrects the captured image data so that the image is rotated according to the acquired tilt information. For example, if the tilt angle is θ, the image is rotated by angle θ in the opposite direction to the tilt direction, and the image is corrected so that it becomes horizontal.

[0053] Next, in step S130, CPU 30 performs image processing on the corrected captured image data to generate display image data to be displayed on display device 14. Here, the display image data is referred to as "display image data." For example, a partial area of ​​the captured image range is cut out as a display range, and the image of the display range is flipped left and right to generate display image data. Next, in step S132, CPU 30 outputs the display image data to display device 14, and causes display device 14 to display an image based on the display image data.

[0054] Although the imaging device 12 captures a wide range behind the vehicle, what the rider wants to see is the blind spot area directly behind the rider himself. Therefore, by cutting out an area including the center part of the imaging range and setting it as the display range, the range that the rider wants to see can be displayed in a large size. In addition, the image is flipped left and right because it is easier for the rider to grasp the situation behind the vehicle if the image displayed on the display device 14 is oriented in the same direction as the mirror image reflected in the rearview mirror.

[0055] Next, in step S134, the CPU 30 determines whether or not to end the image display. For example, when an instruction to end the image display is given by operating the operating device 18, an affirmative determination is made in step S134, and the routine is ended. For example, when an instruction to end the image display is given by the rider while riding, the image display is ended and the routine is ended. On the other hand, when the image display is not to be ended, a negative determination is made in step S134, and the process returns to step S120. Therefore, the processes of steps S120 to S134 are repeatedly executed until an instruction to end the image display is given.

[0056] In the above, an example is described in which the image display is terminated in response to an instruction, but the image display may be terminated when a predetermined time has elapsed. In addition, in the above, an example is described in which a part of the imaging range is cut out and used as the display image, but a first image in which a first area in the imaging range is cut out and displayed, and a second image in which a second area (wider than the first area) in the imaging range is cut out and displayed may be switchably displayed.

[0057] (Tilt correction effect) The effect of the tilt correction will be described with reference to FIGS. 10(A) shows a captured image 80 captured when the vehicle is tilted. A part of the captured image 80 in the center of the imaging range is cut out and used as a display image 82. Inversion is omitted here. As can be seen from the figure, because the vehicle body 11 and imaging device 12 are tilted, only the ground is displayed, and the area that the user wants to see, such as a following vehicle, is not displayed in the center.

[0058] Therefore, as shown in Fig. 10(B), the captured image 80 is rotated so that the image is horizontal. In the corrected image 84 after tilt correction, a part of the area in the center of the captured image range is cut out and used as a display image 86. Inversion is omitted here. As can be seen from Fig. 10(C), the area that the user wants to see is displayed in the center due to the tilt correction, improving visibility.

[0059] 11(A) shows an example in which a rear image 82 is superimposed on a front image 90. When the vehicle body 11 and the imaging device 12 are tilted, the front image 90 and the rear image 82 are tilted in opposite directions. Therefore, when the tilt is corrected as shown in FIG. 11(B), the front image 92 and the rear image 86 become horizontal, and visibility is significantly improved.

[0060] On the other hand, as can be seen from Fig. 10(B), the image data of the shaded portion of the captured image 80 is lost due to the tilt correction. Also, there is no data of the portion of the corrected image 84 that does not overlap with the captured image 80. That is, the captured image data before tilt correction contains more visual information than the captured image data after correction. Therefore, if the data of the corrected image 84 is saved, the amount of information will be significantly reduced compared to when the data of the captured image 80 is saved.

[0061] For this reason, in this embodiment, when displaying an image, tilt correction is performed to display an image with high visibility, and when saving the image, data of the image that has not been tilt corrected is saved, thereby suppressing a decrease in the amount of information.

[0062] Although the tilt correction has been described above, various types of image processing such as rotation correction, distortion correction, color correction, noise removal, etc. may be performed when generating each of the saved image data and the displayed image data. For example, image processing when generating the saved image data may include a process of removing unnecessary parts from the captured image data, a process of adding tilt information, etc.

[0063] Although tilt correction is not performed on the saved image, it is preferable to record the degree to which the image is tilted as information. Therefore, tilt information acquired at the same time may be associated with the saved image data and stored in the storage unit 24. Alternatively, the image data may be processed to add tilt information, and the image data to which the tilt information has been added may be stored. For example, as shown in FIG. 12, the tilt of the image can be recorded by superimposing at least one of a line H representing the horizontal direction and a line V representing the vertical direction on the saved image, or by superimposing the value of the tilt angle θ on the saved image.

[0064] In the above, the display image is cut out after the tilt correction, but the cut-out range may be rotated with respect to the captured image. It goes without saying that the same effect can be obtained whether the captured image or the cut-out range is rotated. Furthermore, the stored image data can be appropriately played back using a playback device (not shown).

[0065] As described above, according to the video processing system of this embodiment, it is possible to obtain various effects as described below.

[0066] When displaying an image, tilt correction is performed to display an image with high visibility, and when saving the image, the data of the image that has not been tilt corrected is saved, so that it is possible to realize display of an image with good visibility while suppressing a decrease in the amount of information. In the event of an accident, the saved image data can also be used as evidence to prove the circumstances of the accident.

[0067] In addition, since a tilt sensor is attached to the imaging device, even if the imaging device is mounted at an angle relative to the vehicle body, the tilt of the imaging device (i.e., the tilt of the image) can be detected regardless of how the imaging device is mounted or the tilt of the vehicle body, reducing the effort required by the user to mount the imaging device horizontally.

[0068] In addition, the control device (ECU) for display control is made multifunctional and controls the storage of captured image data in a storage device, so that captured image data can be stored without adding a new ECU.

[0069] In addition, by recording image data from multiple imaging devices in association with each other, and by recording tilt information, audio data, and detection data from various sensors in association with image data, it is possible to obtain more information from the stored data.

[0070] In addition, the control device, into which a portable recording medium such as an SD card is inserted as the memory unit, is installed inside the vehicle body. Therefore, unlike commercially available add-on drive recorders, the recording medium cannot be easily removed, thereby preventing theft of the recording medium on which the video data is saved.

[0071] In addition, dangerous behavior such as aggressive driving can be deterred by, for example, lighting the pilot light of the imaging device to notify following vehicles that recording is in progress.

[0072] <Modification> It should be noted that the configurations of the video processing device and video processing system described in the above embodiments are merely examples, and it goes without saying that the configurations may be changed without departing from the spirit of the present invention.

[0073] In the above embodiment, the image is displayed in response to an instruction from the rider, but the image may be displayed in response to the detection results of various sensors equipped in the vehicle. The various sensors include a BSM (blind spot monitor) that detects the approach of a vehicle from behind the vehicle, a sensor that detects the inclination of the vehicle, a vehicle speed sensor, etc. For example, the image may be displayed in response to an alarm from the BSM.

[0074] In the above embodiment, an example has been described in which the storage of video data is started at the same time as the power is turned on, the storage of video data continues until the power is turned off, and the video is displayed in response to an instruction from the rider, that is, only when the rider wants to view the video, but the timing of the storage of video data and the timing of the display of the video are not limited to this example. The timing of the display of the video may be the same as or different from the timing of the storage of the video data, but it is desirable that the two are different as described in the above embodiment. In addition, it is desirable that the storage of video data is performed constantly while traveling, but the timing of starting the storage of video data is not limited to when the power is turned on, and the storage of video data may be started in response to, for example, an instruction from the rider or a state determination of a sensor.

[0075] In the above embodiment, an example was described in which the display device was installed on the right or left side (as seen from the rider) of the meter display on the instrument panel, but the display device may be installed in a position in front of the rider that is easy to see, regardless of whether or not there is a meter display. For example, the display device may be installed on the handlebars, in the mounting portion of the mirror, on top of the fuel tank, inside the cowl, or above or integral with the meter display.

[0076] In the above embodiment, an example in which a dedicated display device is provided has been described, but a portable information processing device such as a smartphone or tablet may be used as the display device. In this case, the portable information processing device executes various processes by using an installed dedicated application program and working with an ECU, which is a control device. For example, a smartphone is wirelessly connected to the communication unit 22 via Bluetooth (registered trademark), and can display on the screen an image based on image data stored in the storage unit 24 (see FIG. 2).

[0077] <Additional Notes> The features of the present invention are as follows. [Appendix 1] An image processing device that controls a display device disposed in front of a rider of a motorcycle, A memory and a processor connected to the memory, The processor, acquiring image data from an imaging device that images an area behind the motorcycle while the motorcycle is traveling; storing the acquired video data in the memory; acquiring tilt information from a sensor that detects a tilt of the imaging device; correcting the image data so that the image displayed on the display device is rotated in accordance with the acquired tilt information; and displaying an image based on the corrected image data on the display device. Image processing device. [Appendix 2] 2. The image processing device according to claim 1, wherein the processor stores in the memory the tilt information acquired from the sensor at the time the image data is acquired in association with the image data. [Appendix 3] The image processing device according to claim 1 or 2, wherein before storing the image data, the processor processes the image data so that a line representing at least one of a horizontal direction and a vertical direction is superimposed on the image based on the tilt information acquired from the sensor at the time the image data is acquired, and stores the processed image data in the memory. [Appendix 4] 3. The image processing device according to claim 1, wherein before storing the image data, the processor processes the image data so that a value representing a tilt of the image is superimposed on the image based on the tilt information acquired from the sensor at the time the image data was acquired, and stores the processed image data in the memory. [Appendix 5] an imaging device that captures an image of the surroundings of the motorcycle; A display device is disposed in front of a rider and displays an image based on the image data acquired from the imaging device; a sensor for detecting a tilt of the imaging device; a first control for storing the image data acquired from the imaging device in a storage device while the motorcycle is traveling; a control device that performs second control to correct the image data so that the image displayed on the display device is rotated in accordance with the tilt information obtained from the sensor, and to display an image based on the corrected image data on the display device; and An image processing system comprising: [Appendix 6] 6. The image processing system of claim 5, wherein the sensor is attached to the outside of a housing of the imaging device. [Appendix 7] The housing of the imaging device is a rectangular parallelepiped, The image processing system of claim 6, wherein the sensor is housed in a rectangular second housing, and the second housing is attached to an upper surface of the housing so as to be placed on a housing of the imaging device. [Appendix 8] 6. The image processing system of claim 5, wherein the sensor is mounted inside a housing of the imaging device. [Appendix 9] 9. The image processing system of claim 6, wherein the sensor is positioned relative to an image sensor of the imaging device so that a horizontal direction of the sensor coincides with a horizontal direction of the image. [Appendix 10] The image processing system according to any one of appendix 5 to appendix 9, wherein, in the first control, the control device stores in the storage device the tilt information acquired from the sensor at the time the image data is acquired in association with the image data. [Appendix 11] the imaging device includes a first imaging device that images a rear area of ​​the motorcycle, the control device, in the first control, stores in the storage device first image data acquired from the first imaging device; the control device, in the second control, displays a first image acquired from the first imaging device. 10. The image processing system according to claim 5, [Appendix 12] The imaging device further includes a second imaging device that images a front or side of the motorcycle, the control device, in the first control, stores in the storage device the second image data acquired from the second imaging device in association with the first image data acquired from the first imaging device; In the second control, the control device displays a first image acquired from the first imaging device and a second image acquired from the second imaging device on one screen. 12. The video processing system of claim 11. [Explanation of symbols]

[0078] 10 image processing system, 11 vehicle body, 12 imaging device, 14 display device, 16 control device, 18 operation device, 26 tilt sensor

Claims

1. An image processing device that controls a display device disposed in front of a rider of a motorcycle, A memory and a processor connected to the memory, The processor, acquiring image data from an imaging device that images an area behind the motorcycle while the motorcycle is traveling; storing the acquired video data in the memory; acquiring tilt information from a sensor that detects a tilt of the imaging device; correcting the image data so that the image displayed on the display device is rotated in accordance with the acquired tilt information; and displaying an image based on the corrected image data on the display device. Image processing device.

2. The image processing device according to claim 1 , wherein the processor stores the tilt information acquired from the sensor at the time the image data was acquired in the memory in association with the image data.

3. 2. The image processing device according to claim 1, wherein, before storing the image data, the processor processes the image data so that a line representing at least one of a horizontal direction and a vertical direction is superimposed on the image based on the tilt information acquired from the sensor at the time the image data was acquired, and stores the processed image data in the memory.

4. 2. The image processing device according to claim 1, wherein, before storing the image data, the processor processes the image data so that a value representing a tilt of the image is superimposed on the image based on the tilt information acquired from the sensor at the time the image data was acquired, and stores the processed image data in the memory.

5. an imaging device that captures an image of the surroundings of the motorcycle; A display device is disposed in front of a rider and displays an image based on the image data acquired from the imaging device; a sensor for detecting a tilt of the imaging device; a first control for storing the image data acquired from the imaging device in a storage device while the motorcycle is traveling; a control device that performs second control to correct the image data so that the image displayed on the display device is rotated in accordance with the tilt information obtained from the sensor, and to display an image based on the corrected image data on the display device; and An image processing system comprising:

6. The image processing system according to claim 5 , wherein the sensor is attached to an outside of a housing of the imaging device.

7. The housing of the imaging device is a rectangular parallelepiped, The image processing system according to claim 6 , wherein the sensor is housed in a second housing having a rectangular parallelepiped shape, and the second housing is attached to an upper surface of the housing so as to be placed on a housing of the imaging device.

8. The image processing system according to claim 5 , wherein the sensor is attached inside a housing of the imaging device.

9. 9. The image processing system according to claim 6, wherein the sensor is positioned with respect to the image sensor of the imaging device such that a horizontal direction of the sensor coincides with a horizontal direction of the image.

10. The image processing system according to claim 5 , wherein the control device, in the first control, stores the tilt information acquired from the sensor at the time the image data was acquired in the storage device in association with the image data.

11. the imaging device includes a first imaging device that images a rear area of ​​the motorcycle, The control device, under the first control, stores in the storage device first video data acquired from the first imaging device; the control device, in the second control, displays a first image acquired from the first imaging device. The video processing system according to claim 5 .

12. The imaging device further includes a second imaging device that images a front or side of the motorcycle, the control device, in the first control, stores in the storage device the second image data acquired from the second imaging device in association with the first image data acquired from the first imaging device; In the second control, the control device displays a first image acquired from the first imaging device and a second image acquired from the second imaging device on one screen. The video processing system according to claim 11.

Images