Control device and control method

Abstract

To provide a control device and a control method capable of ensuring comfort when driving a saddle-ride type vehicle using a smart helmet.SOLUTION: In a control device and a control method according to the present invention, when it is determined that imaging by a rear camera of a driver's smart helmet worn by a driver of a saddle-ride type vehicle is correct, a driver image captured by the rear camera of the driver's smart helmet is displayed on a display device within a driver's field of view. On the other hand, when it is determined that the imaging by the rear camera of the driver's smart helmet is improper, improper-time control corresponding to a determination result indicating that the imaging is improper is executed.SELECTED DRAWING: Figure 4

Description

Technical Field

[0001] This disclosure relates to a control device and a control method capable of ensuring comfort in the operation of a saddle-type vehicle using a smart helmet.

Background Art

[0002] In recent years, helmets equipped with various electronic devices have been developed, and such helmets are called smart helmets. For example, Patent Document 1 discloses a technology related to a smart helmet equipped with electronic devices such as a wireless transmission module, a camera, earphones, and a projection module.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] There are various uses for smart helmets, and in recent years, development of smart helmets for saddle-type vehicles has also been underway. Here, as a smart helmet for a saddle-type vehicle, there is one equipped with a rear camera provided rearward at the rear of the smart helmet. By displaying an image captured by the rear camera to the driver, the driver can check the rear without visually recognizing the side mirror. In this way, the rear camera of the smart helmet is expected to be used as an electronic mirror or a drive recorder for rear shooting.

[0005] Incidentally, in the rear imaging using a smart helmet, unlike the rear imaging using an in-vehicle camera or the like fixed at an optimal position, situations where imaging becomes difficult are likely to occur. And if the imaging by the rear camera of the smart helmet for the driver is inappropriate, the display of the driver image to the driver may rather become a factor that hinders the driving of the saddle-type vehicle.

[0006] The present invention has been made against the background of the above problems, and obtains a control device and a control method capable of ensuring the comfort in driving a saddle-type vehicle using a smart helmet.

Means for Solving the Problems

[0007] The control device according to the present invention is a control device that controls the display of a driver image captured by a rear camera provided rearward at the rear of a smart helmet for a driver worn by a driver of a saddle-type vehicle, and determines whether the imaging by the rear camera of the smart helmet for the driver is appropriate, and includes a control unit that executes control regarding the display of the driver image according to the determination result. When the control unit determines that the imaging by the rear camera of the smart helmet for the driver is appropriate, the control unit causes the display device within the driver's field of view to display the driver image. When the control unit determines that the imaging by the rear camera of the smart helmet for the driver is inappropriate, the control unit executes inappropriate-time control corresponding to the determination result indicating that the imaging is inappropriate.

[0008] The control method according to the present invention is a control method for controlling, by a control device, the display of a driver image captured by a rear camera provided rearward on the rear part of a driver smart helmet worn by a driver of a straddle-type vehicle. The control method includes a determination step of determining whether imaging by the rear camera of the driver smart helmet is appropriate, and a control step of executing control regarding the display of the driver image according to the determination result. In the control step, when it is determined that imaging by the rear camera of the driver smart helmet is appropriate, the driver image is displayed on a display device within the driver's field of view, and when it is determined that imaging by the rear camera of the driver smart helmet is inappropriate, inappropriate-time control corresponding to the determination result indicating that the imaging is inappropriate is executed.

Effect of the Invention

[0009] In the control device and the control method according to the present invention, when it is determined that imaging by the rear camera of the driver smart helmet worn by a driver of a straddle-type vehicle is appropriate, the driver image captured by the rear camera of the driver smart helmet is displayed by a display device within the driver's field of view. On the other hand, when it is determined that imaging by the rear camera of the driver smart helmet is inappropriate, inappropriate-time control corresponding to the determination result indicating that the imaging is inappropriate is executed. Thereby, when imaging by the rear camera of the driver smart helmet is inappropriate, it is possible to suppress the driving from being hindered due to the driver image being displayed to the driver. Therefore, it is possible to ensure the comfort in driving a straddle-type vehicle using a smart helmet.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Mode for Carrying Out the Invention

[0011] Hereinafter, a control device according to the present invention will be described with reference to the drawings.

[0012] In the following, a control device used for a two-wheeled motorcycle will be described. However, the control device according to the present invention may be used for a straddle-type vehicle other than a two-wheeled motorcycle (for example, a three-wheeled motorcycle, a buggy, a bicycle, etc.). Note that a straddle-type vehicle means a vehicle on which a driver (that is, a rider) rides straddling.

[0013] Also, in the following, a case where a control device (specifically, control device 33) corresponding to an example of the control device according to the present invention is mounted on a smart helmet (specifically, smart helmet 3 for a driver) will be described. However, the control device according to the present invention may be mounted on something other than a smart helmet, and may be mounted on a straddle-type vehicle such as a motorcycle, for example.

[0014] Next, in the following, a control device (specifically, control device 33) corresponding to an example of the control device according to the present invention will be described for the case of causing an image captured by a rear camera of a smart helmet (specifically, a driver image or a passenger image described later) to be displayed on a display device of the smart helmet. However, the control device according to the present invention may cause an image captured by a rear camera of the smart helmet to be displayed on a display device within the driver's field of view. For example, the display device may be mounted on a saddle-type vehicle such as a motorcycle. Further, in such a case, the display device may be constituted by a notification device for inappropriate notification, or may be constituted by a device different from the notification device for inappropriate notification.

[0015] In addition, the configurations and operations described below are examples, and the control device and control method according to the present invention are not limited to cases where such configurations and operations are as described.

[0016] In the following, the same or similar descriptions are appropriately simplified or omitted. Also, in each figure, the same or similar members or parts are either not marked with reference numerals or are marked with the same reference numerals. Further, the illustration of the detailed structure is appropriately simplified or omitted.

[0017] <Configuration of Driver's Smart Helmet> With reference to FIGS. 1 to 5, the configuration of the driver's smart helmet 3 equipped with the control device 33 according to the embodiment of the present invention will be described.

[0018] FIGS. 1 and 2 are a schematic side view and a schematic top view, respectively, showing a state in which a driver 2 wearing the driver's smart helmet 3 is riding on a motorcycle 1.

[0019] The driver's smart helmet 3 corresponds to one mounted on the driver 2 among smart helmets equipped with various electronic devices. Specifically, as shown in FIG. 1, the driver's smart helmet 3 includes a display device 31, a rear camera 32, and a control device 33.

[0020] The display device 31 is a device that displays an image within the field of view of the driver 2. Specifically, the display device 31 includes a light-transmissive member provided at the upper front part of the smart helmet 3 for the driver, and projects an image onto the member to display the image to the driver 2. Note that the display device 31 only needs to be able to display an image within the field of view of the driver 2, and does not necessarily need to utilize the technology called a head-up display as described above.

[0021] The rear camera 32 is a camera provided at the rear of the smart helmet 3 for the driver and facing rearward. Therefore, during driving, as shown in FIGS. 1 and 2, the field of view FV3 of the rear camera 32 extends rearward from the rear camera 32 toward the rear of the motorcycle 1. The rear camera 32 captures an image showing such a field of view FV3 during driving. The driver image captured by the rear camera 32 is appropriately displayed by the display device 31 as will be described later.

[0022] The rear camera 32 includes, for example, an imaging device such as a CMOS (Complementary Metal Oxide Semiconductor) image sensor and an image processing device such as an ISP (Image Signal Processor).

[0023] Note that other electronic devices other than the above-described electronic devices may be mounted on the smart helmet 3 for the driver. For example, earphones and a microphone may be mounted on the smart helmet 3 for the driver as other electronic devices. In this case, the driver 2 can drive while conversing with the passenger 4 described later using, for example, the earphones and the microphone.

[0024] The control device 33 is a device that controls the display of the driver image captured by the rear camera 32 provided at the rear of the smart helmet 3 for the driver and mounted on the driver 2 of the motorcycle 1 and facing rearward. Specifically, the control device 33 controls the display of the driver image captured by the rear camera 32 on the display device 31.

[0025] In addition, the control device 33 has a function of receiving a passenger image captured by a rear camera 52 (see FIGS. 4 and 5) mounted on the passenger smart helmet 5 worn by the passenger 4, and may be provided with a communication device (for example, a WiFi (registered trademark) module, etc.) for realizing this function. Furthermore, the control device 33 may have a function of receiving vehicle information (vehicle speed, rotation speed, etc.) via the communication device as necessary and outputting it as an image to the display device 31.

[0026] Note that, hereinafter, the process for using the image captured by the rear camera 32 or the rear camera 52 as an electronic mirror by displaying it on the display device 31 will be mainly described. However, the control device 33 may use the image captured by these cameras by recording it in a storage element and using it as a rear-view driving recorder.

[0027] For example, part or all of the control device 33 is composed of a microcomputer, a microprocessor unit, etc. Also, for example, part or all of the control device 33 may be composed of something updatable such as firmware, or may be a program module executed according to instructions from a CPU or the like. The control device 33 may be, for example, one, or may be divided into a plurality.

[0028] FIG. 3 is a block diagram showing an example of the functional configuration of the control device 33.

[0029] As shown in FIG. 3, the control device 33 includes, for example, an acquisition unit 331 and a control unit 332.

[0030] The acquisition unit 331 acquires information output from each device outside the control device 33 and outputs it to the control unit 332. Note that the acquisition of the information output from each device outside by the acquisition unit 331 is realized by communication performed between the control device 33 and each device outside.

[0031] For example, the acquisition unit 331 can acquire information output from each device mounted on the motorcycle 1. Here, as shown in FIG. 1, the motorcycle 1 is equipped with a front stroke sensor 11 and a rear stroke sensor 12. The front stroke sensor 11 detects the stroke amount of the front suspension or another physical quantity that can be substantially converted into the stroke amount, and outputs the detection result. Further, the rear stroke sensor 12 detects the stroke amount of the rear suspension or another physical quantity that can be substantially converted into the stroke amount, and outputs the detection result. Therefore, the acquisition unit 331 can acquire the detection results output from the front stroke sensor 11 and the rear stroke sensor 12.

[0032] Also, for example, the acquisition unit 331 can acquire information output from the rear camera 32 mounted on the driver's smart helmet 3. That is, the acquisition unit 331 can acquire the driver image captured by the rear camera 32.

[0033] Also, for example, the acquisition unit 331 can acquire information output from the rear camera 52 (see FIGS. 4 and 5) mounted on the passenger smart helmet 5 worn by the passenger 4. That is, the acquisition unit 331 can acquire the passenger image captured by the rear camera 52.

[0034] Here, with reference to FIGS. 4 and 5, the case where the motorcycle 1 is traveling with two passengers will be described.

[0035] FIGS. 4 and 5 are a schematic side view and a schematic top view showing the state in which the passenger 4 is riding on the motorcycle 1 and the motorcycle 1 is traveling with two passengers, respectively.

[0036] Since the passenger 4 sits on the rear seat of the motorcycle 1, when riding two-up, the passenger 4 is located behind the driver 2. In FIGS. 4 and 5, an example is shown in which the passenger 4 is wearing the passenger smart helmet 5. The passenger smart helmet 5 corresponds to the one mounted on the passenger 4 among the smart helmets. Specifically, as shown in FIG. 4, the passenger smart helmet 5 includes a display device 51, a rear camera 52, and a control device 53. Note that the display device 51 may be omitted from the configuration of the passenger smart helmet 5.

[0037] The display device 51 is a device that displays an image within the field of view of the passenger 4. For example, similar to the display device 31 of the driver smart helmet 3 described above, it uses a technology called a head-up display to display an image to the passenger 4.

[0038] The rear camera 52 is a camera provided at the rear of the passenger smart helmet 5 facing rearward. During driving, the rear camera 52 captures an image showing the visual field FV5 that spreads rearward from the motorcycle 1.

[0039] The control device 53 is capable of communicating with the display device 51 and the rear camera 52, and appropriately displays the passenger image captured by the rear camera 52 on the display device 51.

[0040] Note that the control device 53 of the passenger smart helmet 5 is paired and stored in the control device 33 according to the user's settings. Therefore, the control device 33 can identify the driver smart helmet 3 and the passenger smart helmet 5.

[0041] The control unit 332 executes control regarding the display of the driver image captured by the rear camera 32. The control unit 332 includes, for example, a display control unit 332a, a notification control unit 332b, and a determination unit 332c.

[0042] The display control unit 332a controls the display of an image on the display device 31 by outputting a control command to the display device 31. For example, the display control unit 332a can cause the display device 31 to display a driver image captured by the rear camera 32. Thereby, the driver 2 can drive while visually recognizing the driver image showing the rear of the motorcycle 1.

[0043] The notification control unit 332b controls the notification of various information to the driver 2. Specifically, the notification control unit 332b controls the notification of various information to the driver 2 by controlling the operation of the notification device 13 that performs the notification of various information. Here, as shown in FIG. 1, the notification device 13 is mounted on the motorcycle 1. For example, the notification device 13 is a device provided at the front part of the body of the motorcycle 1 and displays an image, and is located within the field of view of the driver 2. Various information is notified to the driver 2 using the notification device 13. The notification device 13 may notify various information using voice or the like. Further, the notification device 13 may be mounted on the driver's smart helmet 3.

[0044] The determination unit 332c makes various determinations using the information acquired by the acquisition unit 331. The determination result by the determination unit 332c is used for the processing by the display control unit 332a and the notification control unit 332b.

[0045] By the way, when the motorcycle 1 is being driven, a situation may occur in which imaging by the rear camera 32 of the driver's smart helmet 3 becomes inappropriate. For example, when the motorcycle 1 is traveling with two passengers, as shown in FIGS. 4 and 5, it is conceivable that the head of the passenger 4 enters the field of view FV3 of the rear camera 32 of the driver's smart helmet 3. In this case, the head of the passenger 4 is reflected in the driver image captured by the rear camera 32 of the driver's smart helmet 3, and the driver image becomes unsuitable as an image showing the rear. When the imaging by the rear camera 32 of the driver's smart helmet 3 is inappropriate in this way, the display of the driver image to the driver 2 can be a factor that hinders driving.

[0046] As described above, in the control device 33, the control unit 332 executes control regarding the display of the driver image captured by the rear camera 32. Here, the control unit 332 determines whether the imaging by the rear camera 32 of the driver smart helmet 3 is appropriate, and executes control regarding the display of the driver image according to the determination result. Specifically, when the control unit 332 determines that the imaging by the rear camera 32 of the driver smart helmet 3 is appropriate, the control unit 332 causes the driver image to be displayed on the display device 31 within the field of view of the driver 2, and when the control unit 332 determines that the imaging by the rear camera 32 of the driver smart helmet 3 is inappropriate, the control unit 332 executes inappropriate-time control corresponding to the determination result indicating that the imaging is inappropriate. Thereby, it is realized to ensure the comfort in the driving of the motorcycle 1 using the smart helmet. The processing performed by such a control device 33 will be described in detail later.

[0047] <Operation of the control device> With reference to FIGS. 6 and 7, the operation of the control device 33 according to an embodiment of the present invention will be described.

[0048] Note that hereinafter, as examples of the flow of the processing performed by the control device 33, a first example and a second example will be described in this order.

[0049] FIG. 6 is a flowchart showing a first example of the flow of the processing performed by the control device 33. For example, the control flow according to the first example shown in FIG. 6 is repeatedly performed during the activation of the driver smart helmet 3. Also, step S510 and step S590 in FIG. 6 correspond to the start and end of the control flow shown in FIG. 6, respectively.

[0050] The first example of the process flow performed by the control device 33 corresponds to an example in which control for restricting the display of the driver image by a display device (specifically, the display device 31) within the driver's field of view is executed as inappropriate-time control corresponding to a determination result indicating that imaging by the rear camera 32 of the driver smart helmet 3 is inappropriate. Thus, the inappropriate-time control includes control for restricting the display of the driver image by the display device within the driver's field of view.

[0051] When the control flow according to the first example shown in FIG. 6 is started, in step S511, the determination unit 332c of the control unit 332 determines whether the imaging by the rear camera 32 of the driver smart helmet 3 is appropriate. If it is determined that the imaging by the rear camera 32 is appropriate (step S511 / YES), the process proceeds to step S513. On the other hand, if it is determined that the imaging by the rear camera 32 is inappropriate (step S511 / NO), the process proceeds to step S515.

[0052] The determination unit 332c can determine whether the imaging by the rear camera 32 of the driver smart helmet 3 is appropriate, for example, by determining whether the motorcycle 1 is traveling with two passengers. Specifically, when the determination unit 332c determines that the motorcycle 1 is traveling with two passengers, it determines that the imaging by the rear camera 32 is inappropriate. Note that the determination unit 332c can determine whether the motorcycle 1 is traveling with two passengers based on, for example, the stroke amounts of the front suspension and the rear suspension indicated by the detection results of the front stroke sensor 11 and the rear stroke sensor 12.

[0053] Note that even when the determination unit 332c determines that the motorcycle 1 is traveling with two passengers, it may determine that imaging by the rear camera 32 is appropriate when specific conditions are met. For example, the determination unit 332c estimates the seat height of the passenger 4 based on the weight of the passenger 4, and determines that the imaging by the rear camera 32 is appropriate when it is determined that the seat height of the passenger 4 is low enough that the field of view FV3 of the rear camera 32 is not blocked by the passenger 4. The weight of the passenger 4 by the control device 33 may be detected by providing a sensor for detecting the weight on the motorcycle 1, or may be estimated based on the stroke amount of the suspension. Here, since the height of the seat for the passenger 4 varies depending on the vehicle type of the motorcycle 1, the threshold value of the seat height used to determine whether the seat height of the passenger 4 is low enough that the field of view FV3 of the rear camera 32 is not blocked by the passenger 4 may vary depending on the vehicle type.

[0054] Further, the determination unit 332c may determine whether imaging by the rear camera 32 of the driver's smart helmet 3 is appropriate by a method other than determining whether the motorcycle 1 is traveling with two passengers. For example, the determination unit 332c performs image recognition processing on the driver image captured by the rear camera 32 to determine whether something that blocks the field of view FV3 of the rear camera 32 (for example, the head of the passenger 4, luggage, etc.) is reflected in the driver image, and may determine that imaging by the rear camera 32 is inappropriate when it is determined that something that blocks the field of view FV3 is reflected in the driver image. Also, for example, when the driver's smart helmet 3 is applicable to various motorcycles including other motorcycles that are not suitable for rear imaging (for example, motorcycles equipped with a roof that extends to the rear of the driver), the determination unit 332c may determine whether imaging by the rear camera 32 of the driver's smart helmet 3 is appropriate by determining the type of the motorcycle 1 on which the driver wearing the driver's smart helmet 3 is riding.

[0055] If it is determined YES in step S511, in step S513, the display control unit 332a of the control unit 332 causes the display device 31 within the field of view of the driver 2 to display the driver image. Thereby, the driver image is displayed for the driver 2, and the driver 2 can drive while visually recognizing the driver image. When the driver image is used as an electronic mirror in this way (that is, displayed on the display device 31), specifically, the driver image is displayed by the display device 31 as a mirror image that is horizontally reversed.

[0056] Next, the control flow shown in FIG. 6 ends.

[0057] If it is determined NO in step S511, in step S515, the determination unit 332c of the control unit 332 determines whether the transmission of the passenger image to the display device 31 is normal. If it is determined that the transmission of the passenger image to the display device 31 is normal (step S515 / YES), the process proceeds to step S517. On the other hand, if it is determined that the transmission of the passenger image to the display device 31 is abnormal (step S515 / NO), the process proceeds to step S519. It is assumed that the control device 33 of the driver smart helmet 3 and the control device 53 of the passenger smart helmet 5 are paired in advance.

[0058] When the transmission of the passenger image to the display device 31 is normal, it corresponds to the case where the control device 33 can normally receive the passenger image captured by the rear camera 52 of the passenger smart helmet 5 and can normally transmit the received passenger image to the display device 31.

[0059] For example, when the passenger smart helmet 5 is not activated and the rear camera 52 is not capturing an image of the passenger, the determination unit 332c determines that the transmission of the passenger image to the display device 31 is defective. Also, for example, when the rear camera 52 is capturing an image of the passenger but the communication between the control device 33 and the rear camera 52 or the communication between the control device 33 and the display device 31 is not being carried out normally, the determination unit 332c determines that the transmission of the passenger image to the display device 31 is defective.

[0060] If it is determined to be YES in step S515, in step S517, the display control unit 332a of the control unit 332 causes the display device 31 to display the passenger image. For example, if the driver image is being displayed by the display device 31 before step S515 is performed, the display control unit 332a switches the image displayed by the display device 31 from the driver image to the passenger image. In this way, by causing the display device 31 to display the passenger image, the display of the driver image by the display device 31 is restricted.

[0061] Note that the control for restricting the display of the driver image by the display device 31 includes, in addition to the control for causing the display device 31 to display the passenger image, for example, the control for stopping the display of the image by the display device 31 performed in step S519 described later. Furthermore, the control for restricting the display of the driver image by the display device 31 includes other controls, and may include, for example, control for blurring (e.g., defocusing) the driver image displayed by the display device 31.

[0062] Next, the control flow shown in FIG. 6 ends.

[0063] If the determination in step S515 is NO, in step S519, the display control unit 332a of the control unit 332 stops the display of the image by the display device 31. In this way, the display control unit 332a restricts the display of the passenger image by the display device 31. Specifically, as control for restricting the display of the passenger image by the display device 31, the display control unit 332a executes control to stop the display of the image by the display device 31, for example.

[0064] Note that in step S519, as control for restricting the display of the passenger image by the display device 31, the display control unit 332a may execute control to blur (for example, make hazy) the passenger image displayed by the display device 31, for example.

[0065] Next, the control flow shown in FIG. 6 ends.

[0066] As described above, in the control flow shown in FIG. 6, when the control unit 332 determines that the imaging by the rear camera 32 of the driver's smart helmet 3 is inappropriate, as inappropriate-time control corresponding to the determination result indicating that the imaging is inappropriate, the control unit 332 executes control to restrict the display of the driver image by the display device (specifically, the display device 31) within the driver 2's field of view. Specifically, in the control flow shown in FIG. 6, as control for restricting the display of the driver image, the control unit 332 executes control to display the passenger image captured by the rear camera 52 of the passenger smart helmet 5 on the display device (specifically, the display device 31) within the driver 2's field of view. In this way, the control for restricting the display of the driver image includes control to display the passenger image on the display device within the driver 2's field of view.

[0067] Here, when it is determined that the imaging by the rear camera 32 of the driver smart helmet 3 is inappropriate, as an inappropriate-time control, by executing control to limit the display of the driver image on the display device within the field of view of the driver 2, it is possible to suppress the display of an image that becomes a factor interfering with driving to the driver 2. Therefore, when the imaging by the rear camera 32 of the driver smart helmet 3 is inappropriate, it is possible to appropriately suppress the driving from being hindered due to the display of the driver image to the driver 2, so that the comfort during driving can be appropriately ensured.

[0068] In particular, as control for restricting the display of the driver image, by executing control to display the co-rider image on the display device within the field of view of the driver 2, while suppressing the display of an image that becomes a factor interfering with driving to the driver 2, it is possible to display an image that appropriately shows the rear of the motorcycle 1 to the driver 2.

[0069] FIG. 7 is a flowchart showing a second example of the flow of processing performed by the control device 33. For example, similar to the control flow according to the first example shown in FIG. 6 described above, the control flow according to the second example shown in FIG. 7 is repeatedly performed while the driver smart helmet 3 is activated. Also, step S610 and step S690 in FIG. 7 correspond to the start and end of the control flow shown in FIG. 7, respectively.

[0070] The second example of the flow of processing performed by the control device 33 corresponds to an example in which, as an inappropriate-time control corresponding to the determination result that the imaging by the rear camera 32 of the driver smart helmet 3 is inappropriate, control is executed to cause the notification device 13 to execute an inappropriate-time notification corresponding to the determination result that the imaging by the rear camera 32 of the driver smart helmet 3 is inappropriate. Thus, the inappropriate-time control includes control to cause the notification device 13 to execute an inappropriate-time notification.

[0071] In the control flow according to the second example shown in FIG. 7, when it is determined YES in step S511 (that is, when it is determined that the imaging by the rear camera 32 is appropriate), as in the control flow according to the first example shown in FIG. 6 described above, the process proceeds to step S513. On the other hand, when it is determined NO in step S511 (that is, when it is determined that the imaging by the rear camera 32 is inappropriate), unlike the control flow according to the first example shown in FIG. 6 described above, the process proceeds to step S611.

[0072] In step S611, the notification control unit 332b of the control unit 332 causes the notification device 13 to execute an inappropriate-time notification. For example, information indicating the content of the inappropriate-time notification is displayed by the notification device 13. The inappropriate-time notification is a notification corresponding to the determination result that the imaging by the rear camera 32 of the driver smart helmet 3 is inappropriate.

[0073] For example, the notification control unit 332b causes the notification device 13 of the motorcycle 1 to execute a notification indicating that the imaging by the rear camera 32 of the driver smart helmet 3 is inappropriate as the inappropriate-time notification. Thereby, the driver 2 can be notified that there is a high possibility that the driving is hindered due to the driver image being displayed to the driver 2. In this notification, in addition to a character indicating that the imaging by the rear camera 32 of the driver smart helmet 3 is inappropriate, a figure or symbol indicating the same may be displayed.

[0074] Here, the driver 2 may be able to switch the image displayed by the display device 31 between the driver image and the passenger image by operating an input device such as a button provided on the driver's smart helmet 3. In this case, for example, the notification control unit 332b causes the notification device 13 to execute a notification indicating a function of switching the image displayed by the display device 31 from the driver image to the passenger image as an inappropriate-time notification. Thereby, the driver 2 can be prompted to switch the image displayed by the display device 31 from the driver image to the passenger image. In this notification, in addition to a character indicating a function of switching the image displayed by the display device 31 from the driver image to the passenger image being displayed by the notification device 13, a figure or symbol indicating the same may also be displayed.

[0075] Next, the control flow shown in FIG. 7 ends.

[0076] As described above, in the control flow shown in FIG. 7, when the control unit 332 determines that the imaging by the rear camera 32 of the driver's smart helmet 3 is inappropriate, as inappropriate-time control corresponding to the determination result indicating that the imaging is inappropriate, the control unit 332 executes control to cause the notification device 13 to execute inappropriate-time notification.

[0077] Here, when it is determined that the imaging by the rear camera 32 of the driver's smart helmet 3 is inappropriate, by executing control to cause the notification device 13 to execute inappropriate-time notification as inappropriate-time control, information for suppressing the driving from being hindered due to the driver image being displayed to the driver 2 can be notified to the driver 2. Therefore, when the imaging by the rear camera 32 of the driver's smart helmet 3 is inappropriate, it is possible to appropriately suppress the driving from being hindered due to the driver image being displayed to the driver 2, and thus the comfort in driving can be appropriately ensured.

[0078] <Effect of the control device> The effect of the control device 33 according to the embodiment of the present invention will be described.

[0079] The control device 33 includes a control unit 332 that determines whether the imaging by the rear camera 32 of the driver smart helmet 3 is appropriate, and executes control regarding the display of the driver image according to the determination result. Specifically, when the control unit 332 determines that the imaging by the rear camera 32 of the driver smart helmet 3 is appropriate, the control unit 332 causes the driver image to be displayed on a display device (for example, the display device 31) within the field of view of the driver 2. When the control unit 332 determines that the imaging by the rear camera 32 of the driver smart helmet 3 is inappropriate, the control unit 332 executes control during inappropriate imaging corresponding to the determination result indicating that the imaging is inappropriate. Thereby, when the imaging by the rear camera 32 of the driver smart helmet 3 is inappropriate, it is possible to suppress the driving from being hindered due to the driver image being displayed to the driver 2. Therefore, it is possible to ensure the comfort in the driving of the straddle-type vehicle (for example, the motorcycle 1) using the smart helmet.

[0080] Preferably, in the control device 33, the control during inappropriate imaging includes control for restricting the display of the driver image by the display device 31. By executing such control as the control during inappropriate imaging, it is possible to suppress an image that becomes a factor hindering driving from being displayed to the driver 2. Therefore, when the imaging by the rear camera 32 of the driver smart helmet 3 is inappropriate, it is possible to appropriately suppress the driving from being hindered due to the driver image being displayed to the driver 2, so that the comfort in driving can be appropriately ensured.

[0081] Preferably, in the control device 33, the control for restricting the display of the driver image includes control for causing an image of a passenger imaged by the rear camera 52 of the passenger smart helmet 5 to be displayed on a display device (for example, the display device 31) within the field of view of the driver 2. By executing such control as the control during inappropriate imaging, while suppressing an image that becomes a factor hindering driving from being displayed to the driver 2, it is possible to display an image that appropriately shows the rear of the motorcycle 1 to the driver 2. Thereby, it is possible to more appropriately ensure the comfort in driving.

[0082] Preferably, in the control device 33, when the control unit 332 determines that the imaging by the rear camera 32 of the driver's smart helmet 3 is inappropriate, and when the transmission of the passenger image to the display device (for example, the display device 31) within the field of view of the driver 2 is defective, the control device 33 restricts the display of the passenger image by the display device. Thereby, in such a case, as control for restricting the display of the driver image by the display device 31, by performing control other than the control of displaying the passenger image on the display device within the field of view of the driver 2 (for example, control for stopping the display of the image by the display device 31, etc.), it is possible to appropriately suppress the display of an image that becomes a factor interfering with driving to the driver 2.

[0083] Preferably, in the control device 33, the control at the time of abnormality includes control for causing the notification device 13 to execute notification at the time of abnormality corresponding to the determination result that the imaging by the rear camera 32 of the driver's smart helmet 3 is inappropriate. By executing such control as the control at the time of abnormality, it is possible to notify the driver 2 of information for suppressing the driving from being hindered due to the driver image being displayed to the driver 2. Therefore, when the imaging by the rear camera 32 of the driver's smart helmet 3 is inappropriate, it is possible to appropriately suppress the driving from being hindered due to the driver image being displayed to the driver 2, so that the comfort in driving can be appropriately ensured.

[0084] Preferably, in the control device 33, the inappropriate notification includes a notification indicating that the imaging by the rear camera 32 of the driver's smart helmet 3 is inappropriate. By executing such a notification as the inappropriate notification, it is possible to notify the driver 2 that there is a high possibility that the driving is hindered due to the display of the driver image to the driver 2. Therefore, for example, the driver 2 can be prompted to manually stop the display of the driver image by the driver's smart helmet 3. Further, for example, when the start and stop of the display of the image by the driver's smart helmet 3 can be switched by the operation of the driver 2, it is possible to suppress the driver 2 from being surprised by the display of a driver image that is not suitable as an image showing the rear to the driver 2 along with the start of the display of the image. Therefore, when the imaging by the rear camera 32 of the driver's smart helmet 3 is inappropriate, it is possible to effectively suppress the driving from being hindered due to the display of the driver image to the driver 2.

[0085] Preferably, in the control device 33, the inappropriate notification includes a notification indicating a function of switching the image displayed by the display device (for example, the display device 31) within the field of view of the driver 2 from the driver image to the passenger image. By executing such a notification as the inappropriate notification, the driver 2 can be prompted to switch the image displayed by the display device 31 from the driver image to the passenger image. Therefore, it is possible to suppress the display of a driver image that is not suitable as an image showing the rear to the driver 2. Therefore, when the imaging by the rear camera 32 of the driver's smart helmet 3 is inappropriate, it is possible to effectively suppress the driving from being hindered due to the display of the driver image to the driver 2.

[0086] Preferably, in the control device 33, when the control unit 332 determines that the motorcycle 1 is traveling as a two-seater, the control unit 332 determines that the imaging by the rear camera 32 of the driver's smart helmet 3 is inappropriate. Thereby, it is possible to appropriately determine whether or not the imaging by the rear camera 32 of the driver's smart helmet 3 is inappropriate.

[0087] The present invention is not limited to the descriptions of the embodiments. For example, all or part of each embodiment may be combined, or only part of each embodiment may be implemented.

Description of Reference Numerals

[0088] 1 Motorcycle, 2 Driver, 3 Smart Helmet for Driver, 4 Passenger, 5 Smart Helmet for Passenger, 11 Front Stroke Sensor, 12 Rear Stroke Sensor, 13 Notification Device, 31 Display Device, 32 Rear Camera, 33 Control Device, 51 Display Device, 52 Rear Camera, 53 Control Device, 331 Acquisition Unit, 332 Control Unit, 332a Display Control Unit, 332b Notification Control Unit, 332c Determination Unit.

Claims

1. A control device (33) for controlling the display of a driver image captured by a rear camera (32) provided rearward at the rear part of a driver smart helmet (3) worn by a driver (2) of a straddle-type vehicle (1), comprising a control unit (332) that determines whether imaging by the rear camera (32) of the driver smart helmet (3) is appropriate and executes control regarding the display of the driver image according to the determination result, wherein the control unit (332), when determining that imaging by the rear camera (32) of the driver smart helmet (3) is appropriate, causes the driver image to be displayed on a display device (31) within the field of view of the driver (2), when determining that imaging by the rear camera (32) of the driver smart helmet (3) is inappropriate, executes control during inappropriate imaging corresponding to the determination result indicating that the imaging is inappropriate, the control during inappropriate imaging includes control for causing a passenger image captured by a rear camera (52) of a passenger smart helmet (5) worn by a passenger (4) of the straddle-type vehicle (1) to be displayed on the display device (31), the control unit (332) restricts the display of the passenger image on the display device (31) when the transmission of the passenger image to the display device (31) is defective when determining that imaging by the rear camera (32) of the driver smart helmet (3) is inappropriate, determines whether an object blocking the field of view of the rear camera (32) of the driver smart helmet (3) is reflected in the driver image by performing image recognition processing on the driver image, and when determining that an object blocking the field of view is reflected in the driver image, determines that imaging by the rear camera (32) of the driver smart helmet (3) is inappropriate, A control device.

2. The control during inappropriate times includes control for causing a notification device (13) to execute an inappropriate-time notification corresponding to a determination result indicating that imaging by the rear camera (32) of the smart helmet (3) for the driver is inappropriate. The control device according to claim 1.

3. The inappropriate-time notification includes a notification indicating that imaging by the rear camera (32) of the smart helmet (3) for the driver is inappropriate. The control device according to claim 2.

4. The inappropriate-time notification includes a notification indicating a function of switching an image displayed by the display device (31) from the driver image to the passenger image. The control device according to claim 2 or 3.

5. When the control unit (332) determines that the saddle-riding type vehicle (1) is traveling with two passengers, it determines that imaging by the rear camera (32) of the smart helmet (3) for the driver is inappropriate. The control device according to any one of claims 1 to 4.

6. A control method for controlling the display of a driver image captured by a rear camera (32) provided rearward on the rear of a smart helmet (3) for a driver mounted on a driver (2) of a saddle-riding type vehicle (1) by a control device (33), A determination step in which the control unit (332) of the control device (33) determines whether imaging by the rear camera (32) of the smart helmet (3) for the driver is appropriate, A control step in which the control unit (332) executes control regarding the display of the driver image according to the determination result, and In the control step, the control unit (332) When it is determined that imaging by the rear camera (32) of the smart helmet (3) for the driver is appropriate, causes the driver image to be displayed on a display device (31) within the field of view of the driver (2). When it is determined that the imaging by the rear camera (32) of the driver's smart helmet (3) is inappropriate, execute control during inappropriate times corresponding to the determination result indicating that the imaging is inappropriate. The control during inappropriate times includes control to cause the display device (31) to display an image of the passenger captured by the rear camera (52) of the passenger smart helmet (5) worn by the passenger (4) of the saddle-riding type vehicle (1). In the control step, when it is determined in the determination step that the imaging by the rear camera (32) of the driver's smart helmet (3) is inappropriate, and when the transmission of the image of the passenger to the display device (31) is defective, the control unit (332) restricts the display of the image of the passenger by the display device (31). Determine whether or not something that blocks the field of view of the rear camera (32) of the driver's smart helmet (3) is reflected in the driver image by performing image recognition processing on the driver image. When it is determined that something that blocks the field of view is reflected in the driver image, determine that the imaging by the rear camera (32) of the driver's smart helmet (3) is inappropriate. Control method.

Images