Display system, display control method, and computer program

The display system addresses the complexity of driver interactions by using motion and situation recognition to provide contextually relevant display outputs, simplifying vehicle operations.

JP2024165280AInactive Publication Date: 2024-11-28CANON KK
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023081347
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-17
Publication Date
2024-11-28
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Existing display systems for vehicles do not adequately consider the driver's actions and display contents, leading to potentially complicated operations.

Method used

A display system that includes a display means, situation recognition means, motion detection means, and display control means to output appropriate display contents based on the driver's motions and driving situations, reducing the complexity of operations.

Benefits of technology

The system simplifies driver interactions by providing intuitive and contextually relevant display outputs, reducing the need for complex actions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024165280000001_ABST
    Figure 2024165280000001_ABST
Patent Text Reader

Abstract

To provide a display system capable of reducing complicated operation for an operator.SOLUTION: A display system included in a movable body includes: display means which displays display contents to surroundings of the movable body; a situation recognition means which recognizes a situation during operation of the movable body; action detecting means which detects an action taken by an operator; and display control means which switches whether a first display content or a second display content which is more detailed than the first display content is output to the display means according to the action detected by the action detecting means and the situation during the operation recognized by the situation recognition means.SELECTED DRAWING: Figure 6
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a display system, a display control method, a computer program, and the like for a moving object. [Background technology]

[0002] Conventionally, there has been a method for expressing intentions between car drivers or between car drivers and pedestrians, which displays the driver's intentions on an external display. For example, Patent Document 1 describes a method for displaying display contents associated with the voice uttered by the car driver on an external display. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 8-282372 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the configuration of Patent Document 1 does not fully consider the actions that the driver takes to display the display and the contents of the display, and the driver may be required to perform complicated actions.

[0005] SUMMARY OF THE PRESENT EMBODIMENT An object of the present invention is to provide a display system capable of reducing the number of complicated operations required of the driver. [Means for solving the problem]

[0006] A display system provided in a moving object, a display means for displaying display content around the moving object; A situation recognition means for recognizing a situation when the moving body is being driven; A motion detection means for detecting a motion by a driver; The vehicle is characterized by having a display control means that switches between outputting a first display content to the display means or outputting a second display content, which is more detailed than the first display content, to the display means, depending on the operation detected by the operation detection means and the driving situation recognized by the situation recognition means. Effect of the Invention

[0007] According to the present invention, it is possible to provide a display system that can reduce the complicated operations required of the driver. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a front perspective view for explaining a schematic configuration of a moving body according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a rear perspective view illustrating a schematic configuration of a moving body according to an embodiment of the present invention. [Diagram 3] 1 is a diagram illustrating a schematic example of the internal configuration of a vehicle 100. FIG. [Figure 4] 2 is a diagram showing a schematic configuration example of the periphery of a handle 7. FIG. [Diagram 5] FIG. 5 is a functional block diagram of a display system 500 according to an embodiment. [Figure 6] 11 is a diagram showing an example of a display content group A displayed on the display means 50 in this embodiment. FIG. [Figure 7] 7 is a flowchart showing an example of a display control method in the display example of FIG. 6. [Figure 8] 11 is a diagram showing an example of a display content group B displayed on the display means 50 in this embodiment. FIG. [Figure 9] 9 is a flowchart showing an example of a display control method in the display example of FIG. 8. [Figure 10] FIG. 1 is a diagram showing an example of a situation in which a pedestrian is waiting at a pedestrian crossing for a vehicle to pass; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, the embodiment of the present invention will be described with reference to the drawings. However, the present invention is not limited to the following embodiment. In each drawing, the same members or elements are given the same reference numerals, and duplicated descriptions are omitted or simplified.

[0010] Fig. 1 is a front perspective view that illustrates a schematic configuration of a moving body according to an embodiment of the present invention. An automobile vehicle 100 as a moving body illustrated in Fig. 1 is driven and operated by a driver 1 (driver or operator), as described below. In the following description, the directions of front, rear, left, right, up, and down with respect to the vehicle 100 are the directions shown in the figure.

[0011] Vehicle 100 is provided with headlights 2 on the left and right sides that illuminate the area ahead of vehicle 100. Vehicle 100 is also provided with direction indicators 3 that indicate to the surroundings the direction in which vehicle 100 is moving, with front right direction indicator 3a provided on the front right side of vehicle 100 and front left direction indicator 3b provided on the front left side.

[0012] The vehicle 100 is also equipped with a display means 50 that is a display device capable of displaying various images and characters. In this embodiment, the display means 50 includes a front display means 50A in the front portion of the vehicle 100 and a rear display means 50B, which will be described later, in the rear portion.

[0013] These display means 50 function as a means for displaying the intentions of the driver 1 who is driving and operating the vehicle 100 (such as the intention to give way to other moving bodies, the driver's intention to perform the movement of the moving body before other moving bodies in the vicinity) around the vehicle 100 as a moving body.

[0014] The display means 50 are arranged in two places, the front and rear of the vehicle 100, so as to be able to display a wide range of the vehicle 100, and in this embodiment, the same content is displayed on both the front display means 50A and the rear display means 50B. As shown in the figure, the front display means 50A is arranged inside a recess 100A having a concave shape provided in the front center part of the vehicle 100.

[0015] 2 is a rear perspective view illustrating a schematic configuration of a moving body according to an embodiment of the present invention. A pair of tail lights 5 are arranged on the left and right at the rear of the vehicle 100 to inform following vehicles of the presence of the vehicle 100 and that it is decelerating.

[0016] Further, a rear right direction indicator 3c arranged on the rear right side and a rear left direction indicator 3d arranged on the rear left side are provided as the above-mentioned direction indicators 3. Further, the above-mentioned rear display means 50B is provided below the rear window portion 6 which is a window portion.

[0017] 3 is a diagram showing a schematic diagram of an example of the internal configuration of the vehicle 100. The vehicle 100 is driven by a driver 1 who drives the vehicle 100 using a steering wheel 7 that determines the traveling direction of the vehicle 100, and an accelerator pedal and a brake pedal (not shown) that accelerate and decelerate the vehicle 100.

[0018] Inside the vehicle 100, an imaging device 30 is disposed as a monitoring unit that monitors the situation around the vehicle 100, and in this embodiment, is disposed so as to be able to mainly monitor the situation ahead. The vehicle 100 is also provided with an acceleration detector 20 (not shown) as a running condition detection unit that detects the running condition of the vehicle 100.

[0019] 4 is a diagram showing a schematic configuration example of the periphery of the steering wheel 7. A start switch 8 is provided around the steering wheel 7 as a driving operation starting unit for operating the vehicle 100, and pressing the start switch 8 switches between starting and stopping the driving operation of the vehicle 100.

[0020] A microphone 10, which is a microphone unit for picking up the voice uttered by the driver 1, is provided around the steering wheel 7, and when the driver 1 presses an activation button 9 provided on the steering wheel 7, sound collection from the microphone 10 begins. As will be described later, depending on the content of the collected voice, the display means 50 will display the corresponding display content.

[0021] In addition, a direction indicator operating member 11 for operating the blinking operation of the above-mentioned direction indicator 3 is arranged around the handle 7 of the moving body, and by operating this direction indicator operating member 11, the direction indicator 3 is caused to blink, thereby indicating to the surroundings the direction in which the vehicle 100 is moving.

[0022] For example, if the driver 1 wishes to turn the vehicle 100 right at an intersection, he or she operates the turn indicator operating member 11 in the direction A in the figure, which causes the front right turn indicator 3a and the rear right turn indicator 3c in Figures 1 and 2 to flash, indicating to those around him or her that he or she intends to turn right.

[0023] Similarly, if you want to turn left, by operating the turn signal operating member 11 in the direction B in the figure, the front left turn signal 3b and the rear left turn signal 3d in Figures 1 and 2 will flash, indicating to those around you that you intend to turn left.

[0024] The vehicle 100 is also provided with an emergency flasher activation button 12 for activating emergency flashers (hazard lights) in order to alert people in the vicinity during an emergency stop. When the driver 1 presses the emergency flasher activation button 12, the front right direction indicator 3a, the front left direction indicator 3b, the rear right direction indicator 3c, and the rear left direction indicator 3d, which are the direction indicators 3 in Figures 1 and 2 described above, start flashing simultaneously to alert people in the vicinity.

[0025] In this embodiment, various operation members such as the direction indicator operation member 11, the emergency flasher activation button 12, etc., used by the driver 1 to operate the vehicle 100 function as vehicle operation means.

[0026] FIG. 5 is a functional block diagram of a display system 500 according to the embodiment, and the display system 500 for displaying the intention of the driver 1 on the display means 50 in this embodiment will be described with reference to FIG.

[0027] In Fig. 5, 500 denotes a display system according to this embodiment, which is mounted on a vehicle 100 as a moving body, and has functional blocks as shown within a dotted line in Fig. 5. Some of the functional blocks shown in Fig. 5 are realized by causing a CPU or the like as a computer (not shown) included in the display system 500 to execute a computer program stored in a memory as a storage medium (not shown).

[0028] However, some or all of these may be realized by hardware. For the hardware, a dedicated circuit (ASIC) or a processor (reconfigurable processor, DSP) may be used. Furthermore, each functional block shown in Fig. 5 does not have to be built in the same housing, and may be configured by separate devices connected to each other via signal paths.

[0029] Reference numeral 39 denotes a driving action activation unit, which includes a start switch 8 for the engine or motor of the vehicle 100, etc. Reference numeral 40 denotes a vehicle control unit, which controls the driving and stopping of the wheels of the vehicle, changes in the direction of travel, etc. Reference numeral 46 denotes an expression activation detection unit that detects the activation of display content that the driver 1 causes to be displayed by the display means 50, and in this embodiment, when the driver 1 presses an activation button 9, sound collection by the microphone 10 is started and the action (voice, etc.) of the driver 1 is detected.

[0030] The expression activation detection unit 46 functions as a motion detection means for detecting a motion (e.g., a voice) by the driver. In this embodiment, the motion by the driver includes a motion regarding whether or not the driver intends to give way to other moving objects (intending to have the other moving object act before the driver's own moving object).

[0031] For example, a voice saying "Please" indicates an intention to give way to other moving objects. On the other hand, a voice saying "Excuse me (I'll go first)" indicates an intention of the driver to perform the operation of the moving object before other moving objects around.

[0032] The display control unit 42 is provided with a judgment unit 43 and a memory unit 44. The memory unit 44, which serves as a storage means, stores display contents associated with the voice uttered by the driver, and the judgment unit 43 recognizes the voice of the driver 1 detected by the expression utterance detection unit 46 and judges whether it matches the voice stored in the memory unit 44. If there is a match, the display contents stored in association with the memory unit 44 are displayed on the display means 50, which serves as the expression output unit 41.

[0033] In this embodiment, it further has a situation recognition unit 45, which is equipped with a driving condition detection unit 47 (moving object operation detection means), a moving object operation detection unit 48 (moving object operation detection means), and a surrounding condition detection unit 49 (surrounding condition detection means).

[0034] Here, the situation recognition unit 45 functions as a situation recognition means for recognizing the situation when the moving object is being driven. The situation recognition means has at least one of a moving object operation detection means for detecting the operation state of the moving object, a running state detection means for detecting the running state of the moving object, and a surrounding situation detection means for detecting the surrounding situation of the moving object.

[0035] The running state detection unit 47 detects the speed and acceleration of the vehicle 100 as a moving body by the acceleration detector 20. Furthermore, the moving body operation detection unit 48 detects the operation state of the direction indicator operation member 11. Furthermore, the surrounding situation detection unit 49 detects the surrounding situation based on an image acquired by the imaging device 30 as an imaging means for imaging the surroundings of the moving body.

[0036] The display contents stored in the memory unit 44 include not only the voice of the driver 1, but also display contents associated with the recognition status of the situation recognition unit 45, and depending on the recognition status of the situation recognition unit 45, more detailed display contents are displayed on the display means 50.

[0037] The display control unit 42 functions as a display control means for switching between outputting the first display content to the display unit and outputting the second display content, which is more detailed than the first display content, to the display unit according to the driver's actions and the driving situation. Details of the first display content, the second display content, etc. will be described later.

[0038] Next, an example of the display contents will be described. Fig. 6 is a diagram showing an example of the display contents group A displayed on the display means 50 in this embodiment. The display contents 80, 81, 82, and 83 shown in the figure are all stored in the storage unit 44 in association with voices uttered by the driver 1, such as "Please go ahead" (or "You go first").

[0039] These display contents are displayed when the driver 1 who drives the vehicle 100 intends to give way to other moving objects (pedestrians, other vehicles, etc.) in the vicinity. In this embodiment, one type of voice and the display contents associated with the intention to give way are treated as one display content group.

[0040] The display content group associated with this voice saying "please" is referred to as display content group A. Here, display content 80 is the basic display content in display content group A, and is display content that can be used generally when driver 1 who drives vehicle 100 expresses an intention to give way to other moving bodies (pedestrians, other vehicles, etc.).

[0041] The display content 80 is used, for example, when a pedestrian shows signs of wanting to cross the road, when a vehicle ahead shows signs of wanting to change course, etc. In this embodiment, each display content group thus has one basic display content, which is called the basic display content (first display content).

[0042] In contrast, display content 81 is a more detailed version of display content 80, which is the basic display content, and includes more characters (text) and the like to make it easier for pedestrians crossing the crosswalk to recognize that they are being given the right of way.

[0043] The display content 81 is stored in the storage unit 44 in association with the detection of a crosswalk and a waiting pedestrian as the surrounding situation detected by the imaging device 30. That is, the storage unit 44 stores the display content associated with the driver's behavior detected by the behavior detection means and the driving situation.

[0044] The display content 82 is also a more detailed version of the display content 80, with additional text added to make it easier for a driver waiting to turn right to know that he or she is being given the right of way. The display content 82 is stored in the memory unit 44 in association with the detection of an oncoming vehicle with its right turn signal activated as a surrounding situation detected by the imaging device 30.

[0045] The display content 83 is also a more detailed version of the display content 80, with additional text added to make it easier for a driver who wants to change lanes to recognize that he or she is being given the right of way. The display content 83 is stored in the storage unit 44 in association with the detection of a vehicle running alongside with its turn signal activated, as a surrounding situation detected by the imaging device 30.

[0046] In this embodiment, in addition to the general-purpose basic display content such as the display content 80, the display content has, as more detailed display contents (second display contents), the display content 81, the display content 82, and the display content 83. Furthermore, the display control unit 42 selects from the storage unit 44 the display content associated with the driver's behavior detected by the behavior detection means and the driving situation.

[0047] Fig. 7 is a flowchart showing an example of a display control method for the display example of Fig. 6. Note that the operation of each step of the flowchart of Fig. 7 is performed sequentially by a CPU or the like as a computer in the display system 500 executing a computer program stored in a memory.

[0048] In step S101, the expression activation detection unit 46 detects the driver 1's behavior (vocalization of "please go ahead"). That is, in step S101, it is detected whether the driver intends to give way to other moving bodies (people, vehicles, etc.) in the vicinity based on the driver's behavior (vocalization, etc.), and if the driver's intention to give way is detected based on the voice "please go ahead", the process proceeds to step S102.

[0049] In step S102, the situation recognition unit 45 determines whether the imaging device 30 has detected a pedestrian waiting near the crosswalk ahead (in the traveling direction of the moving object). If it has been detected, the process proceeds to step S104, and if it has not been detected, the process proceeds to step S103.

[0050] In step S104, the display content 81 is displayed on the display means 50. That is, when it is determined that a pedestrian is present near the crosswalk ahead, in step S104, it is possible to display, as the second display content, an intention to cross the road to the pedestrian.

[0051] In step S103, the situation recognition unit 45 determines whether the imaging device 30 has detected an oncoming vehicle with its right turn indicator activated. If it has been detected, the process proceeds to step S106, and if it has not been detected, the process proceeds to step S105.

[0052] In step S106, the display content 82 is displayed on the display means 50. That is, when it is determined that there is an oncoming vehicle waiting to turn right, in step S106, it is possible to display an intention to give way to the oncoming vehicle as the second display content.

[0053] In step S105, the situation recognition unit 45 determines whether the imaging device 30 has detected a vehicle traveling alongside with its turn indicator activated. If it has been detected, the process proceeds to step S107, and if it has not been detected, the process proceeds to step S108.

[0054] In step S107, the display means 50 displays the display content 83. That is, when it is determined that there is a parallel vehicle with its direction indicator operating, in step S107, it is possible to display, as the second display content, an intention to give way to the parallel vehicle.

[0055] In step S108, the display means 50 displays the display content 80. That is, in step S108, it is possible to display, as the first display content, an intention to give way to other moving bodies in the vicinity.

[0056] In the above, step S104 and steps S106 to S108 function as display steps for displaying display contents to the surroundings, and steps S102 to S103 and S105 function as situation recognition steps for recognizing the situation when the moving object is being driven.

[0057] Moreover, step S101 functions as a motion detection step for detecting a motion by the driver (utterance of "please go ahead"). Moreover, steps S101 to S108 function as a display control step for switching whether to output the first display content or the second display content to the display unit, depending on the motion detected in the motion detection step and the driving situation recognized in the situation recognition step.

[0058] Next, another display example will be described. Fig. 8 is a diagram showing an example of the display content group B displayed on the display means 50 in this embodiment, which is a display content when the driver intends to operate the vehicle 100 as a moving body before other moving bodies in the vicinity.

[0059] In addition, the display contents 90, 91, and 92 shown in FIG. 8 are all stored in the memory unit 44 in association with the actions of the driver 1 (such as utterances of "Excuse me" (or "I'll be going first")).

[0060] Moreover, display content 90 is a basic display content, and display content 91 and display content 92 are examples of detailed display content for display content 90. Display content 90, which is a basic display content, is a display content that is expressed in advance when the driver 1 who drives the vehicle 100 wishes other moving objects, such as surrounding vehicles, to accept the operation intention of the vehicle 100.

[0061] For example, as shown in FIG. 8, the display content can be used generally in situations where the driver 1 of the vehicle 100 wants to parallel park, slow down to park on the side of the road, or the like, and wants those around him or her to accept the action they are about to take.

[0062] The display content 91, which is the detailed display content, is a display content to which characters are added to clearly express the intention to change lanes to the right. The display content 91 is stored in the storage unit 44 in association with the operation of the turn signal operating member 11 and the detection by the acceleration detector 20 that the vehicle is traveling (detection that the speed is equal to or higher than a predetermined speed, etc.).

[0063] The display content 92, which is the detailed display content, is a detailed display content to which characters are added to clearly express the intention to make a right turn. The display content 92 is stored in the storage unit 44 in association with the operation of the turn signal operating member 11 and the detection by the acceleration detector 20 of the fact that the vehicle is stopped (detection that the speed is less than a predetermined speed, etc.).

[0064] Fig. 9 is a flowchart showing an example of a display control method in the display example of Fig. 8, and the operation from detection of the movement (utterance) of the driver 1 to display will be described with reference to Fig. 9. Note that the operation of each step in the flowchart of Fig. 9 is performed sequentially by a CPU or the like as a computer in the display system 500 executing a computer program stored in a memory.

[0065] In step S201, the expression activation detection unit 46 detects the driver 1's action (utterance of "Excuse me (to go first)"), and in that case it is detected that the driver intends to operate the moving body before other moving bodies in the vicinity.

[0066] In step S202, the situation recognition unit 45 detects the operation situation of the direction indicator operation member 11. If the operation of the direction indicator operation member 11 is detected, the process proceeds to step S203, and if not, the process proceeds to step S206.

[0067] In step S206, the display content 90 is displayed on the display means 50. That is, when it is detected in step S201 that the driver intends to operate the moving body before other moving bodies in the vicinity, it becomes possible to display, as the first display content, in step S206, the intention to operate the moving body before other moving bodies in the vicinity.

[0068] In step S203, the situation recognition unit 45 detects the speed of the vehicle 100 using the acceleration detector 20. If the speed is equal to or greater than a predetermined value (if the vehicle is moving), the process proceeds to step S204, and if the speed is less than the predetermined value (if the vehicle is stopped), the process proceeds to step S205.

[0069] In step S204, the display content 91 is displayed on the display means 50. That is, when it is determined that the moving body is traveling and a right or left direction is being indicated by the direction indicator, in step S204, it is possible to display, as the second display content, that a lane change will be performed.

[0070] In step S205, the display content 92 is displayed on the display means 50. That is, when it is determined that the moving object is stopped and a right or left direction is being indicated by the direction indicator, in step S205, it is possible to display, as the second display content, that a right turn or a left turn will be made in the surroundings, respectively.

[0071] 10 is a diagram showing an example of a situation in which a pedestrian is waiting for a vehicle to pass near a pedestrian crossing. That is, in this situation, it is assumed that a pedestrian 60 is waiting for a vehicle to pass in order to cross a pedestrian crossing 61.

[0072] The driver of the vehicle 100 slows down or stops the vehicle 100 to let the pedestrian 60 cross (give way) and issues a voice message saying "please go ahead." At this time, the vehicle 100 detects that the pedestrian 60 is waiting near the crosswalk 61, and the front display means 50A displays the display content 81, which is the detailed display content, instead of the display content 80, which is the basic display content in FIG. 6.

[0073] Considering the safety of crossing, the display content 81, which is displayed in more detail than the display content 80, makes it easier for the pedestrian 60 to understand that the vehicle 100 is giving way to him / her, and therefore the pedestrian can cross the road with less hesitation.

[0074] In this way, in this embodiment, it is possible to display basic display contents that can be commonly used for actions (such as vocalizations) such as "please" and "excuse me." Furthermore, depending on the situation detected by the situation recognition unit 45, it is possible to display more detailed display contents without emitting a new voice. Therefore, the driver 1 can easily express the intended expression to those around him / her without using many complicated voices.

[0075] Although the present invention has been described in detail based on the preferred embodiments, the present invention is not limited to these specific embodiments, and various forms within the scope of the present invention are also included in the present invention. In addition, parts of the above-mentioned embodiments may be combined as appropriate.

[0076] The basic display contents and the detailed display contents in this embodiment may be represented in any manner, including icon representation based on figures and symbols, representation using figures such as pictograms, still images, videos, expressions in other languages, and voice representations that are more polite or detailed than the spoken content, and are not limited to those using characters as in this embodiment.

[0077] In addition, in this embodiment, the detailed display content is expressed by adding text notation to the basic display content, but this is not limited to this, and the display content may be changed to one that shows the display content itself in detail using figures, etc., without using text.

[0078] In this embodiment, the driver 1 presses the activation button 9 to start collecting sound with the microphone 10 and to display the display content associated with the voice uttered by the driver 1, but the activation button 9 does not have to be used. That is, for example, the microphone 10 may be kept in operation at all times while the power of the vehicle 100 is on, and a predetermined voice may be used in place of the activation button 9 to display the display content associated with the subsequent voice.

[0079] Furthermore, in this embodiment, the display content is associated with the voice content as the driver 1's actions, but this is not limited to this. For example, by using another imaging device instead of the microphone 10, the display content may be associated with the actions (gestures, etc.) performed by the driver 1.

[0080] Similarly, instead of voice, a plurality of buttons or other switches may be operated. In this case, basic display contents of different display content groups may be associated with each of the plurality of buttons or other switches and stored in the storage unit 44, and detailed display contents may be displayed according to the detection situation of the situation recognition unit 45.

[0081] In other words, in the embodiments, detection of the driver's actions includes detection of at least one of voice, gestures, switch switching status by switch operation, etc., and includes detection of these actions to detect whether or not the driver has the intention (intent to give way to other moving vehicles).

[0082] In addition, regarding the display on the display means 50 in this embodiment, a mode in which the display is performed on the display means 50 and a mode in which the display is not performed may be separately set, and the mode may be switched at the discretion of the driver 1. For example, a mode changeover switch may be set, and after the driving operation of the vehicle 100 is started by the start switch 8, the changeover switch may be set to a mode in which the display is performed, thereby enabling the display.

[0083] Similarly, the operation of displaying the display contents detailed according to the recognition status of the situation recognition unit 45 may be selectively operated as a detailed mode, and the detailed mode may be selectively operated by the driver 1. In a basic mode in which the detailed mode is not operated (detailed display contents are not displayed), the basic display contents may be always displayed regardless of the status of the situation recognition unit 45.

[0084] In the embodiment, the display means 50 is used as a display means for displaying to the surroundings, but this is not limited to this. The display means may include other display devices such as the headlights 2, the direction indicators 3, the taillights 5, and speakers (audio display devices) described above, and basic display contents or detailed display contents may be expressed by changing the blinking intervals and lighting conditions of each of them.

[0085] Furthermore, these display means may be combined to express basic display contents and detailed display contents. For example, the display means 50 may be used for basic display contents, and other display devices such as the headlights 2 may be additionally used for detailed display contents.

[0086] In this embodiment, two display means 50, a front display means 50A and a rear display means 50B, are provided as the display means 50, but the number and locations of the display means 50 are not limited to this. For example, the display means 50 may be provided on the side or top of the vehicle 100.

[0087] In this embodiment, the same content is displayed on the front display means 50A and the rear display means 50B, but different notations may be used as necessary. Also, the content may be displayed on only one of them. In other words, the moving body may have multiple display means, and the display control unit 42 may be able to select one or more of the multiple display means depending on the display content.

[0088] In this embodiment, the image capturing device 30 is disposed to monitor the front, but it is sufficient if it can monitor the necessary surrounding conditions, and it may also capture images of the rear or sides. Furthermore, a plurality of image capturing devices may be provided so that images can be captured in a plurality of directions simultaneously.

[0089] In addition, in the embodiment, an example of an automobile vehicle has been described as a moving body, but the moving body is not limited to an automobile, and may be anything that can move, such as a ship, an airplane, a drone, a robot, etc. In addition, the above embodiment includes the following combinations.

[0090] (Configuration 1) A display system provided in a moving body, comprising: a display means for displaying display content around the moving body; and a situation recognition means for recognizing a situation when the moving body is being driven. A display system comprising: a motion detection means for detecting a motion by a driver; and a display control means for switching between outputting a first display content to the display means or outputting a second display content, which is more detailed than the first display content, to the display means, depending on the motion detected by the motion detection means and the driving situation recognized by the situation recognition means.

[0091] (Configuration 2) A display system as described in configuration 1, further comprising a memory means for storing display content associated with the action detected by the action detection means and the driving situation, and the display control means for selecting from the memory means display content associated with the action detected by the action detection means and the driving situation.

[0092] (Configuration 3) The situation recognition means includes: The display system according to configuration 1 or 2, characterized in having at least one of a mobile object operation detection means for detecting an operation state of the mobile object, a running state detection means for detecting a running state of the mobile object, and a surrounding condition detection means for detecting a surrounding condition of the mobile object.

[0093] (Configuration 4) The display system according to configuration 3, wherein the moving object operation detection means detects an operation state of a direction indicator provided on the moving object.

[0094] (Configuration 5) The display system according to configuration 3 or 4, wherein the running condition detection means detects the speed of the moving object.

[0095] (Configuration 6) The display system according to any one of configurations 3 to 5, wherein the surrounding situation detection means detects the surrounding situation based on an image acquired by an imaging means for imaging the surroundings of the moving object.

[0096] (Configuration 7) The moving body has a plurality of display means, 7. The display system according to any one of configurations 1 to 6, wherein the display control means is capable of selecting the plurality of display means.

[0097] (Configuration 8) The display system according to any one of configurations 1 to 7, wherein the motion detection means detects, based on the motion, whether or not the driver intends to give way to other moving objects in the vicinity.

[0098] (Configuration 9) A display system described in any one of configurations 1 to 8, characterized in that when the motion detection means detects that the driver intends to give way to other moving bodies in the vicinity, the display control means is capable of displaying, as the first display content, an intention to give way to the other moving bodies in the vicinity.

[0099] (Configuration 10) The display system according to any one of configurations 1 to 9, wherein the display control means is capable of displaying, as the second display content, an intention of the pedestrian to cross the road to the pedestrian when it is determined that a pedestrian is present near a crosswalk ahead.

[0100] (Configuration 11) A display system described in any one of configurations 1 to 10, characterized in that when the display control means determines that there is an oncoming vehicle waiting to turn right, it is capable of displaying an intention to give way to the oncoming vehicle as the second display content.

[0101] (Configuration 12) The display system described in any one of configurations 1 to 12, characterized in that when the display control means determines that there is a parallel vehicle with its turn signal activated, it is capable of displaying, as the second display content, an intention to give way to the parallel vehicle.

[0102] (Configuration 13) A display system described in any one of configurations 1 to 12, characterized in that when the motion detection means detects that the driver intends to operate the moving body before other moving bodies in the vicinity, the display control means is capable of displaying, as the first display content, an intention to operate the moving body before the other moving bodies in the vicinity.

[0103] (Configuration 14) A display system according to any one of configurations 1 to 13, characterized in that, when it is determined that the moving body is stopped and a right or left direction is being indicated by a turn indicator, the display control means is capable of displaying, as the second display content, an indication that a right turn or a left turn is to be made in the surrounding area, respectively.

[0104] (Configuration 15) A display system according to any one of configurations 1 to 14, characterized in that the display control means is capable of displaying, as the second display content, an indication that a lane change will be made when it is determined that the moving body is moving and a right or left direction is being indicated by a turn indicator.

[0105] (Method) A display control method using a display system provided on a moving body, comprising: a display step for displaying display content to the surroundings; a situation recognition step for recognizing the situation when the moving body is being driven; a motion detection step for detecting actions by the driver; and a display control step for switching between displaying a first display content or displaying a second display content that is more detailed than the first display content, depending on the action detected in the motion detection step and the situation when driving recognized in the situation recognition step.

[0106] (Program) A computer program for controlling each means of the display system according to any one of configurations 1 to 15 by a computer.

[0107] In order to realize a part or all of the control in the above-mentioned embodiment, a computer program for realizing the functions of the above-mentioned embodiment may be supplied to a display system or the like via a network or various storage media. Then, a computer (or a CPU, MPU, or the like) in the display system or the like may read and execute the program. In this case, the program and the storage medium storing the program constitute the present invention. [Explanation of symbols]

[0108] 1: Driver 3: Turn signal 3a: Front right direction indicator 3b: Front left direction indicator 3c: Rear right direction indicator 3d: Rear left direction indicator 5:Tail light 8: Start switch 9: Activation button 10: Microphone 11: Turn signal operating member 20: Acceleration detector 30: Imaging device 40: Vehicle control unit 41: Expression output section 42: Display control unit 43: Judgment Department 44: Storage part 45: Situational Awareness Department 46: Expression activation detection unit 47: Driving condition detection unit 48: Mobile object operation detection unit

Claims

1. A display system provided in a moving object, A display means for displaying display content around the moving object; A situation recognition means for recognizing a situation when the moving body is being driven; A motion detection means for detecting a motion by a driver; and a display control means for switching between outputting a first display content to the display means or outputting a second display content, which is more detailed than the first display content, to the display means depending on the operation detected by the operation detection means and the driving situation recognized by the situation recognition means.

2. a storage means for storing display content associated with the motion detected by the motion detection means and the driving situation, 2. The display system according to claim 1, wherein the display control means selects from the storage means display contents associated with the motion detected by the motion detection means and the driving situation.

3. The situation recognition means includes: The display system according to claim 1, further comprising at least one of a mobile object operation detection means for detecting an operation state of the mobile object, a driving state detection means for detecting a driving state of the mobile object, and a surrounding condition detection means for detecting a surrounding condition of the mobile object.

4. 4. The display system according to claim 3, wherein the mobile object operation detection means detects an operation state of a direction indicator provided on the mobile object.

5. 4. The display system according to claim 3, wherein said running condition detection means detects a speed of said moving object.

6. 4. The display system according to claim 3, wherein the surrounding situation detection means detects the surrounding situation based on an image captured by an image capturing means for capturing an image of the surroundings of the moving object.

7. The moving object has a plurality of display means, 2. The display system according to claim 1, wherein said display control means is capable of selecting one of said plurality of display means.

8. 2. The display system according to claim 1, wherein the movement detection means detects whether the driver intends to give way to other moving objects in the vicinity based on the movement.

9. The display system according to claim 1, characterized in that when the motion detection means detects that the driver intends to give way to other moving bodies in the vicinity, the display control means is capable of displaying, as the first display content, an intention to give way to the other moving bodies in the vicinity.

10. The display system according to claim 1, characterized in that, when it is determined that a pedestrian is present near a crosswalk ahead, the display control means is capable of displaying, as the second display content, an intention of the pedestrian to cross the road.

11. The display system according to claim 1, characterized in that, when the display control means determines that there is an oncoming vehicle waiting to turn right, it is capable of displaying, as the second display content, an intention to give way to the oncoming vehicle.

12. The display system according to claim 1, characterized in that, when it is determined that there is a parallel vehicle with its turn signal activated, the display control means is capable of displaying, as the second display content, an intention to give way to the parallel vehicle.

13. The display system according to claim 1, characterized in that when the motion detection means detects that the driver intends to operate the moving body before other moving bodies in the vicinity, the display control means is capable of displaying, as the first display content, an intention to operate the moving body before the other moving bodies in the vicinity.

14. The display system according to claim 1, characterized in that when the display control means determines that the moving body is stopped and that a right or left direction is being indicated by a turn indicator, the second display content can display an indication in the surrounding area that a right turn or a left turn is to be made, respectively.

15. The display system according to claim 1, characterized in that the display control means is capable of displaying, as the second display content, a message indicating that a lane change is to be made when it is determined that the moving body is moving and a right or left direction is being indicated by a turn indicator.

16. A display control method using a display system provided in a moving object, comprising: a display step for displaying the display content to the surroundings; A situation recognition step of recognizing a situation when the moving body is being driven; A motion detection step of detecting a motion by a driver; a display control step of switching between displaying a first display content or displaying a second display content that is more detailed than the first display content, depending on the operation detected in the operation detection step and the driving situation recognized in the situation recognition step.

17. A computer program for controlling each unit of the display system according to any one of claims 1 to 15 by a computer.

Citation Information

Patent Citations

  • Intervehicle information exchanging device

    JP1996282372A