Display system, display control method, and computer program
The display system addresses the challenge of unclear driver intention communication by using motion detection to display associated content, enhancing safety through clear visual cues.
Patent Information
- Application Number
- JP2023081394
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-17
- Publication Date
- 2024-11-28
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing display systems in vehicles do not adequately consider the timing and method for conveying driver intentions, leading to potential misunderstandings and increased risk of accidents.
A display system equipped with motion detection means to recognize predetermined driver actions and display associated content on display means, including a display control method to ensure clear communication of intentions.
Facilitates easy and reliable communication of driver intentions to the surroundings, reducing the risk of misunderstandings and accidents by using intuitive and immediate visual cues.
Smart Images

Figure 2024165303000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a display system, a display control method, a computer program, and the like for a moving object. [Background technology]
[0002] Conventional means of expressing intentions between car drivers or between car drivers and pedestrians include flashing lights on the car or displaying the intentions on the outside of the car. For example, Patent Document 1 describes a configuration for expressing intentions using a display or lights. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] International Publication No. 2019 / 111565 Summary of the Invention [Problem to be solved by the invention]
[0004] However, the conventional technology disclosed in Patent Document 1 does not give sufficient consideration to the timing and method of activating the display and lamp. Therefore, if communication cannot be executed in an emergency, it may lead to an accident.
[0005] Therefore, one object of the present invention is to provide a display system that can easily display the driver's intentions to the surroundings of a moving body. [Means for solving the problem]
[0006] One aspect of the present invention is a display system provided in a moving object, comprising: A display means for displaying the surroundings of the moving object; A motion detection means for detecting a predetermined motion registered in advance by a driver of the vehicle; and a display control means for causing the display means to display predetermined display content stored in association with the motion detected by the motion detection means. Effect of the Invention
[0007] According to the present invention, it is possible to provide a display system that can easily display the driver's intentions to the surroundings of a moving object. [Brief description of the drawings]
[0008] [Figure 1] FIG. 1 is a front perspective view for explaining a schematic configuration of a moving body according to a first embodiment of the present invention. [Diagram 2] FIG. 2 is a rear perspective view illustrating a schematic configuration of a moving body according to the first embodiment of the present invention. [Diagram 3] FIG. 1 is a diagram illustrating an example of the internal configuration of a vehicle 100 according to a first embodiment of the present invention. [Figure 4] 2 is a diagram showing a schematic configuration example of the periphery of a handle 7 according to the first embodiment of the present invention. FIG. [Diagram 5] 1 is a functional block diagram of a display system 500 according to a first embodiment of the present invention. [Figure 6] 5 is a flowchart showing an example of a display control method for controlling a display system provided in a moving object according to the first embodiment of the present invention. [Figure 7] 13 is a flowchart showing an operation example of the gesture display mode in step S103. [Figure 8] 1A to 1C are diagrams illustrating an example of the operation of a driver 1 according to a first embodiment of the present invention. [Figure 9] 1 is a diagram showing an example of display content 80 displayed on the forward display means 50A according to the first embodiment of the present invention. FIG. [Figure 10] FIG. 1 is a diagram showing an example of a situation in which a pedestrian is waiting at a pedestrian crossing for a vehicle to pass; [Figure 11] 13 is a diagram showing examples of other display contents including display content 80 according to the second embodiment of the present invention. FIG. [Figure 12] 13 is a diagram showing a display example using an acceleration detector 20 and a direction indicator operation member 10 according to a third embodiment. FIG. [Figure 13] 13 is a flowchart illustrating an example of a display control method according to a third embodiment. [Figure 14] FIG. 11 is a diagram illustrating an example of a display control method according to a fourth embodiment of the present invention. [Figure 15] 13 is a flowchart showing an example of starting and stopping a gesture display mode according to Example 4 of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] Hereinafter, the present invention will be described by way of examples with reference to the drawings. However, the present invention is not limited to the following examples. In each drawing, the same members or elements are given the same reference numbers, and duplicated descriptions are omitted or simplified.
[0010] <Example 1> Fig. 1 is a front perspective view that illustrates a schematic configuration of a moving body according to a first embodiment of the present invention. A vehicle 100, which is an automobile as a moving body shown in Fig. 1, is driven and operated by a driver 1 (a driver or an operator) as described later. In the following description, the directions of the front, rear, left, right, up, and down with respect to the vehicle 100 are the directions shown in the figure.
[0011] Vehicle 100 is provided with headlights 2 on the left and right sides that illuminate the area ahead of vehicle 100. Vehicle 100 is also provided with direction indicators 3 that indicate to the surroundings the direction in which vehicle 100 is moving, with front right direction indicator 3a provided on the front right side of vehicle 100 and front left direction indicator 3b provided on the front left side.
[0012] The vehicle 100 is also equipped with a display means 50 that is a display device capable of displaying various images and characters. In this embodiment, the display means 50 includes a front display means 50A in the front portion of the vehicle 100 and a rear display means 50B, which will be described later, in the rear portion.
[0013] These display means 50 function as a means for displaying the intentions of the driver 1 who is driving and operating the vehicle 100 (such as the intention to give way to other moving bodies, the driver's intention to perform the movement of the moving body before other moving bodies in the vicinity) around the vehicle 100 as a moving body.
[0014] The display means 50 are arranged in two places, the front and rear of the vehicle 100, so as to be able to display a wide range of the vehicle 100, and in this embodiment, the same content is displayed on both the front display means 50A and the rear display means 50B. As shown in the figure, the front display means 50A is arranged inside a recess 100A having a concave shape provided in the front center part of the vehicle 100.
[0015] 2 is a rear perspective view illustrating a schematic configuration of a moving body according to the first embodiment of the present invention. A pair of tail lights 5, which are tail lights that inform following vehicles of the presence of the vehicle 100 and that the vehicle 100 is decelerating, are arranged at the rear of the vehicle 100.
[0016] Further, a rear right direction indicator 3c arranged on the rear right side and a rear left direction indicator 3d arranged on the rear left side are provided as the above-mentioned direction indicators 3. Further, the above-mentioned rear display means 50B is provided below the rear window portion 6 which is a window portion.
[0017] 3 is a diagram illustrating an example of the internal configuration of a vehicle 100 according to the first embodiment of the present invention. The vehicle 100 is driven by a driver 1 who drives the vehicle 100 using a steering wheel 7 that determines the traveling direction of the vehicle 100, and an accelerator pedal and a brake pedal (not shown) that accelerate and decelerate the vehicle 100.
[0018] An imaging device 30 for capturing images of the driver's movements and face is disposed inside the vehicle 100. The imaging device 30 may be disposed in any position as long as it is possible to capture an image of the driver 1. The vehicle 100 is also provided with an acceleration detector 20 (not shown) as a driving condition detection unit for detecting the driving condition of the vehicle 100.
[0019] 4 is a diagram illustrating a schematic configuration example of the periphery of the steering wheel 7 according to the first embodiment of the present invention. A start switch 8 is provided around the steering wheel 7 as a driving operation starting unit for operating the vehicle 100. Pressing the start switch 8 switches between starting and stopping the operation of the engine, motor, and the like of the vehicle 100.
[0020] The steering wheel 7 is provided with a gesture display mode switch 9 as a switching means for switching between starting and stopping a gesture display mode, which will be described later. Here, the gesture display mode switch 9 functions as a mode switch for switching between starting and stopping a gesture display mode that displays predetermined display contents associated with predetermined actions of the driver.
[0021] In the first embodiment, the gesture display mode switch 9 is a slide switch, and the gesture display mode is switched on / off by sliding the gesture display mode switch 9 between the ON position / OFF position.
[0022] In addition, a direction indicator operating member 10 for operating the blinking operation of the above-mentioned direction indicator 3 is arranged around the handle 7 of the moving body, and by operating this direction indicator operating member 10, the direction indicator 3 is caused to blink, thereby indicating to the surroundings the direction in which the vehicle 100 is moving.
[0023] For example, if the driver 1 wishes to turn the vehicle 100 right at an intersection, he or she operates the turn indicator operating member 10 in the direction A in the figure, causing the front right turn indicator 3a and the rear right turn indicator 3c in Figures 1 and 2 to flash, indicating to those around him or her that he or she intends to turn right.
[0024] Similarly, if you want to turn left, by operating the turn signal operating member 10 in the direction B in the figure, the front left turn signal 3b and the rear left turn signal 3d in Figures 1 and 2 will flash, indicating to those around you that you intend to turn left.
[0025] The vehicle 100 is also provided with an emergency flasher activation button 11 for activating emergency flashers (hazard lights) in order to alert people in the vicinity during an emergency stop. When the driver 1 presses this emergency flasher activation button 11, the front right direction indicator 3a, the front left direction indicator 3b, the rear right direction indicator 3c, and the rear left direction indicator 3d, which are the direction indicators 3 in Figures 1 and 2 described above, start flashing simultaneously to alert people in the vicinity.
[0026] In this embodiment, various operation members such as the direction indicator operation member 10, the emergency flasher activation button 11, etc., used by the driver 1 to operate the vehicle 100 function as vehicle operation means.
[0027] The emergency flasher indicator light is used to notify those around that the vehicle 100 is stopped in the event of an emergency, but may also be used as a means of expressing intent between vehicles while the vehicle is traveling.
[0028] That is, the hazard warning indicator light may be flashed for a short period of time to show other vehicles, for example, to say "thank you." Also, the action of flashing the headlights 2 several times may be used to express the intention to give way to other vehicles or pedestrians.
[0029] However, these methods of expression may not be understood by the other person, may be misunderstood, and may cause discomfort. Moreover, when performing these actions, the driver needs to operate operating members such as the hazard flasher activation button 11, so there is a risk of driving errors in an emergency.
[0030] Therefore, in this embodiment, instead of the above-mentioned expression methods, an example of a display system that can clearly and reliably convey the driver's intention and can also be used in emergency situations will be shown.
[0031] Fig. 5 is a functional block diagram of a display system 500 according to a first embodiment of the present invention. In Fig. 5, 500 is a display system according to this embodiment, which is mounted on a vehicle 100 as a moving body, and has functional blocks as shown within a dotted line in Fig. 5.
[0032] Some of the functional blocks shown in FIG. 5 are realized by causing a CPU or the like serving as a computer (not shown) included in the display system 500 to execute a computer program stored in a memory serving as a storage medium (not shown).
[0033] However, some or all of these may be realized by hardware. For the hardware, a dedicated circuit (ASIC) or a processor (reconfigurable processor, DSP) may be used. Furthermore, each functional block shown in Fig. 5 does not have to be built in the same housing, and may be configured by separate devices connected to each other via signal paths.
[0034] Reference numeral 39 denotes a driving operation starting unit, which includes a start switch 8 for the engine or motor of the vehicle 100, etc. Reference numeral 40 denotes a vehicle control unit, which controls the driving and stopping of the wheels of the vehicle, changing of the traveling direction, etc. Reference numeral 41 denotes an expression output unit including a display means 50. Reference numeral 42 denotes a display control unit as a display control means, and the display control unit 42 is provided with a judgment unit 43 and a memory unit 44.
[0035] The situation recognition unit 45 includes a driver monitoring unit 46, a driving state detection unit 47, and a mobile object operation detection unit 48. The driver monitoring unit 46 has an imaging device 30 as an imaging means for imaging the driver, and functions as an operation detection means for detecting a predetermined operation registered in advance by the driver of the mobile object.
[0036] The running state detection unit 47 functions as a running state detection means for detecting the running state of the moving body, and detects the speed and acceleration of the vehicle 100 as the moving body by the acceleration detector 20. In addition, the moving body operation detection unit 48 functions as an operation detection means for detecting the operation state of an operation member for operating the moving body, and detects the operation state of the direction indicator operation member 10. Reference numeral 49 denotes a switching means, and is provided with a gesture display mode switch 9.
[0037] When the driver 1 presses the start switch 8, which is a driving operation starting means, the engine or motor of the vehicle 100 is started by the vehicle control unit 40. In this state, if the gesture display mode switch 9 is in the ON position, or if the gesture display mode switch 9 is operated from the OFF position to the ON position, the gesture display mode is started.
[0038] Moreover, when the gesture display mode switch 9 is operated from the ON position to the OFF position, the gesture display mode is stopped.
[0039] Fig. 6 is a flowchart showing an example of a display control method for controlling a display system provided in a moving object according to the first embodiment of the present invention. Note that the operation of each step in the flowchart of Fig. 6 is performed sequentially by a CPU or the like as a computer in the display system 500 executing a computer program stored in a memory.
[0040] In step S101, it is detected that the driving operation of the vehicle 100 has been started by the start switch 8. In step S102, it is determined whether the gesture display mode switch 9 is in the ON position.
[0041] If it is in the ON position, the process proceeds to step S103. If it is in the OFF position, the process returns to step S102. In step S103, the gesture display mode is started. Here, step S103 functions as a display step for displaying the surroundings of the moving object.
[0042] Next, in step S104, it is determined whether the gesture display mode switch 9 is in the OFF position. If it is in the OFF position, the process proceeds to step S105, and if it is in the ON position, the process returns to step S104. In step S105, the gesture display mode is stopped.
[0043] Fig. 7 is a flowchart showing an operation example of the gesture display mode in step S103. Note that the operation of each step of the flowchart in Fig. 7 is performed sequentially by a CPU or the like as a computer in the display system 500 executing a computer program stored in a memory.
[0044] When the gesture display mode is started in step S103, the imaging device 30 starts monitoring the behavior of the driver 1 in step S201, and the judgment unit 43 discriminates the monitored behavior of the driver 1 by image recognition. At this time, the face of the driver 1 is also image-recognized to identify the driver. Here, step S201 functions as a behavior detection step for detecting a predetermined behavior registered in advance by the driver of the moving object.
[0045] Meanwhile, the memory unit 44 prestores display contents to be displayed on the display means 50, which are associated with various actions of each driver. That is, the memory unit 44 functions as a storage means for storing display contents associated with actions detected by the driver monitoring unit 46 as an action detection means. In addition, in step S202, the discrimination unit determines whether the image-recognized action of each driver matches the action stored in the memory unit 44.
[0046] In order to store in advance in the storage unit 44 the display contents associated with the various actions of each driver, the desired action of the driver 1 is imaged by the imaging device 30, and the display contents to be associated with the action are selected, for example, from a menu and registered in advance. At that time, the driver's face is image-recognized so that the registered contents can be set for each driver.
[0047] Therefore, in step S201, the face of the driver is image-recognized, and display content associated with a previously registered action of the image-recognized driver is read from the storage unit 44. That is, the display control unit 42 reads display content associated with the action detected by the action detection means from the storage unit 44 serving as the storage means.
[0048] If it is determined that the action matches the stored action, the process proceeds to step S203, and if not, the process returns to step S202. In step S203, the associated display content is read out from the storage unit 44 and displayed on the display means 50.
[0049] Here, steps S201 to S203 function as a display control step (display control means) for displaying, in a display step, predetermined display content stored in association with the motion detected in the motion detection step.
[0050] In this manner, in this embodiment, the display content to be communicated to those around the vehicle 100 is stored in advance in the memory unit 44, and the driver 1 performs a predetermined action associated with the content to be communicated, thereby displaying the content that the driver 1 wants to communicate to those around him / her.
[0051] That is, the display control unit 42 controls the display contents based on the result of image recognition of the driver's predetermined actions.Furthermore, the display control unit 42 controls the display contents based on the result of image recognition of the driver's face.Therefore, by simply performing a desired action for each driver, the intention or intent can be easily and clearly displayed to the surroundings of the moving body.
[0052] Next, the actions of the driver 1 in the gesture display mode and the associated display contents will be specifically described.
[0053] Fig. 8 is a diagram showing a schematic example of a motion of the driver 1 according to the first embodiment of the present invention. In Fig. 8, a motion 70 of the driver 1 is an example of a gesture (motion) made together with a statement such as "please go ahead" when yielding something to another person, and shows an example of a motion of holding out a hand with a palm facing up.
[0054] Fig. 9 is a diagram showing an example of display content 80 displayed on the forward display means 50A according to the first embodiment of the present invention, and shows a state in which the display content stored in association with the action 70 shown in Fig. 7 is read out from the storage unit 44 and displayed on the forward display means 50A. Note that display is performed on at least one of the forward display means 50A, the rearward display means 50B, etc., depending on the situation around the moving object.
[0055] The display content 80 shown in the figure indicates that the driver 1 of the vehicle 100 has the intention (intent) to give way to other moving objects (pedestrians or other vehicles) in the vicinity, and is display content that can be understood at a glance by a wide range of age groups.
[0056] The display contents may be icon notation based on figures and symbols, pictograms, etc. In other words, it is not limited to the use of figures and characters as in this embodiment, and may be any display contents that can clearly express the intention (intention) of the driver 1.
[0057] In this embodiment, the display content displayed on the display means 50 based on an action (gesture) may be at least one of figures, symbols, icons, pictograms, characters, still images, videos, expressions in other languages, audio expressions, etc.
[0058] Fig. 10 is a diagram showing an example of a situation in which a pedestrian is waiting near a crosswalk for a vehicle to pass, and an example of using the gesture display mode will be described with reference to Fig. 10. In the situation shown in Fig. 10, it is assumed that a pedestrian 60 is waiting near a crosswalk 61 and is waiting for a vehicle to pass in order to cross the crosswalk 61. The driver of the vehicle 100 slows down or stops the vehicle 100 to let the pedestrian 60 cross (give way).
[0059] Even if the vehicle 100 is decelerating or stopped, the pedestrian 60 cannot see the driver's facial expressions and actions through the front window, and considering the safety of crossing, the pedestrian may be unsure whether it is OK to cross the crosswalk. In such a situation, the driver 1 of the vehicle 100 performs the action 70 in Fig. 8, which causes the display content 80 to be displayed on the forward display means 50A, and the pedestrian 60 can check the display and cross the crosswalk 61 with confidence.
[0060] Conventionally, in such a situation, the driver 1 may blink the headlights 2 of the vehicle 100 to inform the pedestrian 60 that it is safe to cross. However, as described above, depending on the pedestrian 60, the driver 1's intention may not be understood or may be misunderstood.
[0061] In contrast to this, in this embodiment, by displaying the display content 80 as shown in FIG. 9 on the forward display means 50A, it is possible to have the effect of clearly conveying the intention (intention) of the driver 1 to the pedestrian 60.
[0062] <Example 2> 11 is a diagram showing examples of other display contents including the display content 80 according to the second embodiment of the present invention. The display content 80 has already been described, so the description will be omitted. The display content 81 is an example of the display content used by the driver 1 to express his / her intention when he / she wants to change the driving lane of the vehicle 100, or when he / she wants to turn right or left to merge with the road ahead.
[0063] In the second embodiment, the action of the driver 1 raising his / her hand is associated with the display content 81 and is stored in advance in the storage unit 44. As a result, when the driver 1 wants to change lanes or turn right or left in relation to other vehicles, the display content 81 is displayed on the display means 50 by simply raising his / her hand, making it possible to clearly express his / her intention to surrounding vehicles.
[0064] The display content 82 is an example of the display content when expressing gratitude when the vehicle 100, which is the vehicle itself, is allowed to change lanes or turn right or left. The driver may perform an action such as bowing at that time. Meanwhile, the action of the driver 1 bowing and the display content 82 are associated with each other and stored in the storage unit 44 in advance.
[0065] As a result, when the driver 1 makes a lane change or turns right or left, for example by bowing, the display means 50 will display display content 82 showing a bow as shown in FIG. 11, making it possible to clearly express gratitude for the consideration shown by other vehicles.
[0066] Display content 83 shows an example of the display content that is displayed in response to another moving object (another vehicle, pedestrian, etc.) expressing gratitude to the vehicle when the vehicle gives way to the other moving object (another vehicle, pedestrian, etc.).
[0067] For example, when the driver 1 makes a gesture such as raising one hand to show a smiling expression or making a gesture such as a thumbs-up, the gesture is associated with the display content 83 and stored in advance in the storage unit 44.
[0068] When storing the actions and the display contents in association with each other for each driver, a common display content may be stored in association with a plurality of actions. In other words, the same display content may be displayed regardless of any of a plurality of actions.
[0069] Alternatively, when storing the associated display contents for each driver, one display content may be stored in association with a combination of a series of multiple actions. In other words, a predetermined display content may be displayed when multiple actions are performed in a predetermined order, not just one action.
[0070] As a result, when the driver 1 raises his hand and smiles in response to a thank you from another moving body (another vehicle, a pedestrian, etc.), the display content 83 is displayed on the display means 50, making it possible to clearly express a response to the other moving body (another vehicle, a pedestrian, etc.).
[0071] As described above, in the first and second embodiments, the actions habitually used in daily life of the driver 1 are registered and stored in advance as actions to be associated with the display contents. Therefore, even if the driver wants to display something on the display means 50 instantly, the driver can display it instinctively without thinking about it.
[0072] In addition, since the desired actions are stored in association with the display contents for each driver, even if the driver changes, the characteristic action patterns of the driver can be accurately determined.
[0073] Furthermore, compared to the conventional method of displaying intentions by flashing hazard lights or headlights, many other expressions can be displayed clearly and with simple actions (gestures, etc.). This allows smooth expression of intentions with other moving objects (people, other vehicles, etc.), making it possible to prevent troubles and accidents caused by lack of communication or misunderstandings.
[0074] <Example 3> Next, a description will be given of a display system according to Example 3. In Example 3, an acceleration detector 20 and a direction indicator operation member 10 are additionally used, making it possible to display more detailed display contents.
[0075] In the third embodiment, in the configuration shown in FIG. 5, in addition to various actions of each driver, the memory unit 44 also stores the speed state of the vehicle 100 detected by the acceleration detector 20 and the operation state of the turn signal operating member 10 in association with the display contents.
[0076] The determination unit 43 determines whether the face and movements of the driver 1 monitored by the imaging device 30, the speed of the vehicle 100 detected by the acceleration detector 20, and further the presence or absence of an input operation by the direction indicator operating member 10 match those stored in the memory unit 44. If it is determined that they match, the display content associated with them is displayed on the display means 50, which is the expression output unit.
[0077] Fig. 12 is a diagram showing a display example using the acceleration detector 20 and the direction indicator operation member 10 according to the third embodiment. All of the display contents 84 to 87 shown in Fig. 12 are display contents that display the display content 81 shown in Fig. 11 in more detail. As described above, when the driver 1 only raises his / her hand, for example, the display content 81 is displayed on the display means 50.
[0078] On the other hand, as shown in FIG. 12, in addition to the driver 1 raising his / her hand, one of the display contents 84 to 87 is displayed depending on the speed of the vehicle 100 (whether it is moving or stopped) and whether the turn signal operating member 10 is operated or not.
[0079] Fig. 13 is a flowchart for explaining an example of a display control method in Example 3. Note that the operation of each step of the flowchart in Fig. 13 is performed sequentially by a CPU or the like as a computer in the display system 500 executing a computer program stored in a memory.
[0080] In step S301, the imaging device 30 performs image recognition of the movements and facial recognition by monitoring the movements of the driver 1. In step S302, the determination unit 43 determines whether the movement of the driver 1 identified by image recognition (whether the driver raised his / her hand) matches the movement stored in the memory unit 44.
[0081] If the driver 1 has raised his / her hand, the process proceeds to step S303, and if the driver 1 has not raised his / her hand, the process returns to step S301. In step S303, the moving object operation detection unit 48 determines whether or not an input operation has been performed on the direction indicator operation member 10, and if an input operation has been performed, the process proceeds to step S304, and if an input operation has not been performed, the process proceeds to step S311.
[0082] In step S311, for example, the display content 81 is presented on the display means 50. In step S304, the acceleration detector 20 determines whether the vehicle 100 is moving (whether it is moving or stopped), and if it is moving (moving), the process proceeds to step S305, and if it is not moving (stopped), the process proceeds to step S306.
[0083] In this embodiment, the speed judgment in step S304 described above is based on whether the vehicle is moving or stopped, that is, whether the speed is zero or not, but a threshold value may be set for the speed to be judged, and a very slow speed state may be included in addition to a stopped state. That is, in step S304, if the speed is equal to or greater than a predetermined speed, it may be judged as being moving (moving), and if the speed is less than the predetermined speed, it may be judged as not being moving (stopped).
[0084] In step S305, the moving object operation detection unit 48 determines whether the operation direction of the direction indicator operation member 10 is rightward or leftward, and if it is rightward, the process proceeds to step S307, and if it is leftward, the process proceeds to step S308. In step S307, the display content 84 is displayed on the display means 50. In step S308, the display content 85 is displayed on the display means 50.
[0085] In this way, in steps S307 and S308, when a predetermined action of the driver is detected, the speed of the moving body is equal to or greater than a predetermined value, and the turn signal is being operated, the display means 50 displays display content corresponding to a lane change to the right or left.
[0086] In step S306, the moving object operation detection unit 48 determines whether the operation direction of the direction indicator operation member 10 is rightward or leftward, and if it is rightward, the process proceeds to step S309, and if it is leftward, the process proceeds to step S310. In step S309, the display content 86 is displayed on the display means 50. In step S310, the display content 87 is displayed on the display means 50.
[0087] In this way, in steps S309 and S310, when a predetermined action of the driver is detected, the speed of the moving object is less than a predetermined value, and the turn signal is being operated, the display means 50 displays display content corresponding to a right turn or a left turn.
[0088] Here, steps S307 to S311 function as display steps for displaying the surroundings of the moving object.
[0089] As described above, by determining in association not only the operation of the driver 1 but also the speed state of the vehicle 100 detected by the acceleration detector 20 and the presence or absence of an input of operation of the turn signal operating member 10, more detailed display is possible.
[0090] In the third embodiment, the display control unit 42 controls the display contents using the detection results of both the traveling condition detection unit 47 as the traveling condition detection means and the mobile object operation detection unit 48 as the operation detection means. However, the display contents on the display unit 50 may be controlled based on at least one of the detection results of the traveling condition detection means and the operation detection means.
[0091] <Example 4> 14 is a diagram illustrating an example of a display control method according to Example 4 of the present invention. Unlike the above-described gesture display mode switch 9, the gesture display mode switch 12 in Example 4 is a push button switch whose state changes every time it is pressed.
[0092] Therefore, unlike the gesture display mode switch 9, it is not possible to determine whether the gesture display mode is started or stopped based on the ON / OFF position of the gesture display mode switch 12. Hereinafter, the start of the gesture display mode by the gesture display mode switch 12 in the fourth embodiment will be described. The gesture display mode switch 12 may be a touch panel switch.
[0093] Fig. 15 is a flowchart showing an example of starting and stopping the gesture display mode according to the fourth embodiment of the present invention. Note that the operation of each step in the flowchart in Fig. 15 is performed sequentially by a CPU or the like as a computer in the display system 500 executing a computer program stored in a memory.
[0094] When it is detected in step S401 that the driving operation of the vehicle 100 has been activated, the gesture display mode is turned off in step S402. That is, immediately after the driving operation is activated, the gesture display mode is in a stopped state.
[0095] In step S403, it is determined whether or not the gesture display mode switch 12 has been operated (pressed). If it has been operated, the process proceeds to step S404, and if it has not been operated, the process returns to step S403.
[0096] In step S404, the gesture display mode is started. In step S405, it is determined whether the gesture display mode switch 12 has been operated (pressed), and if it has been operated, the process proceeds to step S406, and if it has not been operated, the process returns to step S405. In step S406, the gesture display mode is stopped.
[0097] In the fourth embodiment, the gesture display mode is stopped immediately after the driving operation of the vehicle 100 is started, but a setting menu or the like may be provided so that the gesture display mode is turned on immediately after the driving operation is started according to the preference of the driver 1. That is, a setting means may be provided for setting whether the mode switch is set to off or on when the moving body is started, so that the user can switch the setting.
[0098] Although the present invention has been described above based on the preferred embodiments, the present invention is not limited to these specific embodiments, and various forms within the scope of the present invention are also included in the present invention. In addition, the above-mentioned embodiments may be combined as appropriate.
[0099] In the embodiment, the display means 50 is used as a display means for displaying to the surroundings. However, the display means may include other display devices such as the headlights 2, the direction indicators 3, the taillights 5, and a speaker (audio display device), and basic display contents or detailed display contents may be expressed by changing the blinking intervals and lighting conditions of each of them.
[0100] In this embodiment, the display means 50 includes two display means, a front display means 50A and a rear display means 50B, but the number and locations of the display means 50 are not limited to this. For example, the display means 50 may be disposed on the side or top of the vehicle 100.
[0101] In this embodiment, the same content is displayed on the front display means 50A and the rear display means 50B, but different notations may be used as necessary. Also, the content may be displayed on only one of them. In other words, the moving body may have multiple display means, and the display control unit 42 may be able to select one or more of the multiple display means depending on the display content and the situation around the moving body.
[0102] The display contents and associated driver actions etc. described in this embodiment are merely examples and are not limited to these. Other display contents and other driver actions etc. may be used.
[0103] In addition, in the embodiment, an example of an automobile vehicle has been described as a moving body, but the moving body is not limited to an automobile, and may be anything that can move, such as a ship, an airplane, a drone, a robot, etc. In addition, the present invention includes the following combinations.
[0104] (Configuration 1) A display system provided in a moving body, comprising: a display means for displaying information around the moving body; a motion detection means for detecting a predetermined motion registered in advance by a driver of the moving body; and a display control means for causing the display means to display predetermined display content stored in association with the motion detected by the motion detection means.
[0105] (Configuration 2) A display system as described in Configuration 1, further comprising a memory means for storing the display content associated with the action detected by the action detection means, and the display control means reads out from the memory means the display content associated with the action detected by the action detection means.
[0106] (Configuration 3) A display system as described in configuration 1 or 2, characterized in that it has a driving condition detection means for detecting the driving condition of the moving body, and an operation detection means for detecting the operation state of an operating member for operating the moving body, and the display control means controls the display content based on at least one detection result of the driving condition detection means and the operation detection means.
[0107] (Configuration 4) The display system according to configuration 3, wherein the running condition detection means detects the speed of the moving object.
[0108] (Configuration 5) The display system according to configuration 3, wherein the operation detection means detects an operation state of a direction indicator by the driver.
[0109] (Configuration 6) The display system described in Configuration 5, characterized in that the display control means causes the display means to display display content corresponding to a right turn or a left turn when the motion is detected by the motion detection means, the speed of the moving body is less than a predetermined value, and the turn indicator is operated.
[0110] (Configuration 7) The display system described in Configuration 5, characterized in that the display control means causes the display means to display display content corresponding to a lane change to the right or left when the motion is detected by the motion detection means, the speed of the moving body is equal to or greater than a predetermined value, and the turn signal is being operated.
[0111] (Configuration 8) The display system according to any one of configurations 1 to 7, wherein the display control means controls the display contents based on a result of image recognition of the driver's movement.
[0112] (Configuration 9) The display system according to any one of configurations 1 to 8, wherein the display control means controls the display contents based on a result of image recognition of the driver's face.
[0113] (Configuration 10) A display system according to any one of configurations 1 to 9, characterized in that the display content includes at least one of figures, symbols, icons, pictograms, characters, still images, videos, expressions in other languages, and audio expressions.
[0114] (Configuration 11) The display system according to any one of configurations 1 to 10, further comprising a mode switch for switching whether or not the display content is to be displayed.
[0115] (Configuration 12) The display system described in Configuration 11, characterized in that it has a setting means for setting whether the mode switch is set to off or on when the moving body is started up, characterized in that it has a setting means for setting whether the mode switch is set to off or on when the moving body is started up.
[0116] (Method) A display control method for controlling a display system provided on a moving body, comprising: a display step for displaying information around the moving body; a motion detection step for detecting a predetermined motion registered in advance by the driver of the moving body; and a display control step for displaying predetermined display content stored in association with the motion detected by the motion detection step by the display step.
[0117] (Program) A computer program for controlling each means of the display system according to any one of configurations 1 to 12 by a computer.
[0118] In order to realize a part or all of the control in the above-described embodiment, a computer program for realizing the functions of the above-described embodiment may be supplied to a display system or the like via a network or various storage media.
[0119] The computer (or CPU, MPU, etc.) in the display system etc. may read and execute the program. In this case, the program and the storage medium on which the program is stored constitute the present invention. [Explanation of symbols]
[0120] 1: Driver 3: Turn signal 3a: Front right direction indicator 3b: Front left direction indicator 3c: Rear right direction indicator 3d: Rear left direction indicator 5:Tail light 8: Start switch 9: Gesture display mode switch 10: Turn signal operating member 11: Emergency flasher activation button 12: Gesture display mode switch 20: Acceleration detector 30: Imaging device 40: Vehicle control unit 41: Expression output section 42: Display control unit 43: Judgment Department 44: Storage part 45: Situational Awareness Department 50:Display means
Claims
1. A display system provided in a moving object, A display means for displaying the surroundings of the moving object; A motion detection means for detecting a predetermined motion registered in advance by a driver of the vehicle; and a display control means for causing the display means to display predetermined display content stored in association with the motion detected by the motion detection means.
2. a storage means for storing the display content associated with the motion detected by the motion detection means, 2. The display system according to claim 1, wherein the display control means reads out from the storage means the display content associated with the motion detected by the motion detection means.
3. a running state detection means for detecting a running state of the moving body; and an operation detection means for detecting an operation state of an operation member for operating the movable body, 2. The display system according to claim 1, wherein the display control means controls the display contents based on at least one of the detection results of the driving condition detection means and the operation detection means.
4. 4. The display system according to claim 3, wherein said running condition detection means detects a speed of said moving object.
5. 4. The display system according to claim 3, wherein the operation detection means detects an operation state of a direction indicator by the driver.
6. The display system according to claim 5, characterized in that the display control means causes the display means to display display content corresponding to a right turn or a left turn when the motion is detected by the motion detection means, the speed of the moving body is less than a predetermined value, and the turn indicator is being operated.
7. The display system according to claim 5, characterized in that the display control means causes the display means to display display content corresponding to a lane change to the right or left when the motion is detected by the motion detection means, the speed of the moving body is equal to or greater than a predetermined value, and the turn signal is being operated.
8. 2. The display system according to claim 1, wherein the display control means controls the display contents based on a result of image recognition of the driver's movement.
9. 2. The display system according to claim 1, wherein the display control means controls the display contents based on a result of image recognition of the driver's face.
10. 2. The display system according to claim 1, wherein the display contents include at least one of figures, symbols, icons, pictograms, characters, still images, videos, expressions in other languages, and audio expressions.
11. 2. The display system according to claim 1, further comprising a mode switch for switching whether or not the display contents are to be displayed.
12. 12. The display system according to claim 11, further comprising a setting means for setting the mode switch to either off or on when the moving body is started.
13. A display control method for controlling a display system provided in a moving object, comprising: a display step for displaying the surroundings of the moving object; A motion detection step of detecting a predetermined motion registered in advance by a driver of the moving body; a display control step of displaying, by the display step, predetermined display content stored in association with the motion detected by the motion detection step.
14. A computer program for controlling each unit of the display system according to any one of claims 1 to 12 by a computer.
Citation Information
Patent Citations
Vehicle communication system, vehicle module, a front composite module, and vehicle lamp
WO2019111565A1
