Information presentation control device, information presentation control method and program

Abstract

To provide an information presentation control device which can present information regarding a road sign, etc. according to a situation, and provide more appropriate and beneficial information for an occupant.SOLUTION: An information presentation control device comprises: a detection unit which detects a sign or marking including a road sign or road marking existing around a mobile object; and a presentation control unit which performs control regarding presentation of guide information including information regarding a first sign or marking detected by the detection unit to an occupant of the mobile object, in which the presentation control unit presents the guide information in a mode based on a degree of interest of the occupant to a sign or marking of the same type as that of the first sign or marking in the past.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an information presentation control device, and more particularly to an information presentation control device, an information presentation control method, and a program for controlling the presentation of information to a passenger of a moving body, for example. [Background technology]

[0002] When a mobile object is traveling, it is important for passengers, including the driver of the mobile object, to recognize road markings and road signs (hereinafter, simply referred to as "signs and signs"), including road signs (road signs, etc.), and to understand the meanings of the road signs, etc. Devices are used that assist passengers in recognizing road signs, etc. by presenting information about road signs, etc. that exist around the mobile object to the passengers.

[0003] For example, Patent Document 1 discloses a display device for road signs, etc., which includes extraction means for extracting road signs, etc. from an image captured by an on-board camera, recording means for recording the images of road signs, etc., display means for displaying a car navigation image, and image output means for editing the image and outputting it to the display means so that the images of road signs, etc. and the car navigation image can be displayed simultaneously. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2005-4410 A Summary of the Invention [Problem to be solved by the invention]

[0005] For a passenger of a moving body, what information about a road sign is useful varies depending on the situation. One example of a problem with the above-mentioned road sign display device is that information that is not appropriate for the situation may be displayed.

[0006] The present invention has been made in consideration of the above-mentioned points, and one of its objectives is to provide an information presentation control device that is capable of presenting information regarding road signs, etc. according to the situation, and can provide more appropriate and useful information to occupants. [Means for solving the problem]

[0007] The invention described in claim 1 comprises a detection unit that detects signs or markings, including road signs or road markings, present in the vicinity of a moving body, and a presentation control unit that controls the presentation of guide information, including information regarding a first sign or marking detected by the detection unit, to a passenger of the moving body, wherein the presentation control unit causes the guide information to be presented in a manner based on the passenger's past interest in signs or markings of the same type as the first sign or marking.

[0008] The invention described in claim 10 is a method for presenting guide information including information regarding signs or markings, including road signs or road markings, by an information presentation control device, comprising: a detection step in which a detection unit detects the signs or markings present in the vicinity of a moving body; and a presentation control step in which a presentation control unit controls the presentation of guide information including information regarding a first sign or marking detected by the detection unit to a passenger of the moving body, wherein the presentation control unit, in the presentation control step, presents the guide information in a manner based on the passenger's past interest in signs or markings of the same type as the first sign or marking.

[0009] The invention described in claim 11 is an information presentation control program executed by an information presentation control device having a computer, which causes the computer to function as a detection unit that detects signs or markings, including road signs or road markings, that are present in the vicinity of a moving body, and a presentation control unit that controls the presentation of guide information to a passenger of the moving body, including information regarding a first sign or marking detected by the detection unit, and is characterized in that the presentation control unit presents the guide information in a manner based on the passenger's past interest in signs or markings of the same type as the first sign or marking. [Brief description of the drawings]

[0010] [Figure 1] 1 is a block diagram showing an example of a configuration of an information presentation control device according to a first embodiment of the present invention. [Figure 2A] FIG. 2 is a diagram showing an example of a display screen presented by the information presentation control device according to the first embodiment. [Figure 2B] FIG. 2 is a diagram showing an example of a display screen presented by the information presentation control device according to the first embodiment. [Figure 3A] FIG. 4 is a diagram illustrating an example of information related to control in the information presentation control device according to the first embodiment. [Figure 3B] FIG. 4 is a diagram illustrating an example of information related to control in the information presentation control device according to the first embodiment. [Figure 3C] FIG. 4 is a diagram illustrating an example of information related to control in the information presentation control device according to the first embodiment. [Figure 4] 4 is a flowchart showing an example of a presentation control routine performed by the information presentation control device according to the first embodiment. [Diagram 5] FIG. 11 is a block diagram showing an example of a configuration of an information presentation control device according to a second embodiment of the present invention. [Figure 6A] FIG. 11 is a diagram illustrating an example of information related to control in an information presentation control device according to a second embodiment. [Figure 6B] FIG. 11 is a diagram illustrating an example of information related to control in an information presentation control device according to a second embodiment. [Figure 6C] FIG. 11 is a diagram illustrating an example of information related to control in an information presentation control device according to a second embodiment. [Figure 7] 13 is a flowchart showing an example of a presentation control routine performed by the information presentation control device according to the second embodiment. [Figure 8] FIG. 11 is a block diagram showing an example of a configuration of an information presentation control system according to a third embodiment of the present invention. [Figure 9A] FIG. 11 is a block diagram showing an example of a configuration of an information presentation control device according to a third embodiment of the present invention. [Figure 9B] FIG. 11 is a block diagram showing an example of a configuration of an information presentation control server according to a third embodiment of the present invention. [Figure 10] FIG. 11 is a diagram illustrating an example of information related to control in an information presentation control device according to a third embodiment. [Figure 11] 13 is a flowchart showing an example of a presentation control routine by the information presentation control system according to the third embodiment. [Figure 12] FIG. 11 is a block diagram showing an example of a configuration of an information presentation control device according to a fourth embodiment of the present invention. [Figure 13A] FIG. 13 is a diagram showing an example of a display screen presented by an information presentation control device according to a fourth embodiment. [Figure 13B] FIG. 13 is a diagram showing an example of a display screen presented by an information presentation control device according to a fourth embodiment. [Figure 13C] FIG. 13 is a diagram showing an example of a display screen presented by an information presentation control device according to a fourth embodiment. [Figure 14] 13 is a flowchart showing an example of a presentation control routine performed by the information presentation control device according to the fourth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS In the following description and accompanying drawings, substantially the same or equivalent parts are designated by the same reference numerals. EXAMPLES

[0012] A configuration of an information presentation control device 10 according to a first embodiment of the present invention will be described with reference to Fig. 1. The information presentation control device 10 is mounted on a moving body such as a vehicle, and controls presentation of guide information, which is information including information on road signs or road markings present around the moving body, to passengers including a driver of the moving body. For example, the guide information includes the contents of traffic regulations or instructions indicated by road signs or road markings. In this embodiment, an example in which the information presentation control device 10 is mounted on a vehicle will be described.

[0013] The storage unit 11 is a storage device such as a hard disk, a flash memory, a solid state drive (SSD), or a random access memory (RAM). The storage unit 11 appropriately stores programs executed in the information presentation control device 10, data necessary for the operation of the information presentation control device 10, data generated during the operation of the information presentation control device 10, and data imported from the outside. For example, the storage unit 11 stores navigation information such as map information or route information. The storage unit 11 also stores information including the contents of traffic regulations and instructions indicated by road signs or road markings.

[0014] The control unit 13 includes a central processing unit (CPU), and performs control necessary for the operation of the information presentation control device 10. For example, the control unit 13 reads map information or route information related to the mobile object on which the information presentation control device 10 is mounted from the storage unit 11, and performs control necessary for displaying the information or route information.

[0015] The control unit 13 includes a presentation control unit 13A. The presentation control unit 13A is a functional unit that acquires information required for presenting guide information, which is information including information on road signs or road markings present around the moving body, to a passenger of the moving body from each unit, and generates information for presenting the guide information and supplies it to each unit. For example, the presentation control unit 13A generates information that associates road signs or the like present around the moving body with the contents of the road signs or the like stored in the storage unit 11. For example, the guide information includes the contents of traffic regulations or instructions indicated by road signs or road markings.

[0016] The display unit 15 is a display device such as a liquid crystal display, an organic electroluminescence display, or a head-up display (HUD), and is provided so as to be visible to the passenger. The display unit 15 displays a screen showing information such as navigation information and guide information in response to an instruction from the control unit 13. For example, the display unit 15 displays map information of the surrounding area where the mobile object is traveling. The display unit 15 also displays images of road signs and the like present in the surrounding area of ​​the mobile object, and characters indicating the contents of the traffic regulations indicated by the road signs and the like.

[0017] The audio output unit 16 is an audio device that outputs information displayed by the display unit 15, such as navigation information and guide information, as audio. For example, the audio output unit 16 outputs part of route information as audio. In addition, for example, the audio output unit 16 outputs the names and contents of road signs and the like as audio.

[0018] The travel information acquisition unit 17 is a device group including at least one device that acquires information about the travel of the mobile object. The travel information acquisition unit 17 includes a position identification device such as a GPS (Global Positioning System) device, and acquires information about the position of the mobile object. The travel information acquisition unit 17 may also include sensors such as an acceleration sensor and a gyro sensor, and may acquire information such as the acceleration and traveling direction of the mobile object. For example, the control unit 13 generates route information using the position information acquired by the travel information acquisition unit 17.

[0019] The operation input unit 19 is an input device such as a remote controller or a touch panel. The operation input unit 19 accepts operation input from a passenger regarding the display unit 15 or the audio output unit 16. For example, the operation input unit 19 accepts operation input such as an input requesting the display of route information, an input of a destination, etc.

[0020] Furthermore, the operation input unit 19 as an operation unit accepts operations such as input for stopping presentation of a guide information image, which is an image when guide information is displayed by the display unit 15. Furthermore, the operation input unit 19 as an operation unit may accept input for changing the volume or stopping the guide information voice, which is a voice regarding road signs and the like reported by the voice output unit 16.

[0021] The surrounding photographing unit 21 is an imaging device such as an in-vehicle camera, and supplies image data obtained by photographing the surroundings of the moving object to the control unit 13. For example, the surrounding photographing unit 21 photographs the scenery ahead of the moving object and supplies the image data to the control unit 13. The control unit 13 generates navigation information including the image photographed by the surrounding photographing unit 21 from the image data of the image, and causes the display unit 15 to display the navigation information.

[0022] Furthermore, the control unit 13 detects road signs and the like from image data of the scenery ahead of the moving object, including road signs and the like, photographed by the surrounding photographing unit 21. The control unit 13 analyzes the image data, for example, by template matching, and detects road signs and the like contained in the image. In this case, the surrounding photographing unit 21, together with the control unit 13, functions as a detection unit that detects road signs and the like present around the moving object. Note that the surrounding photographing unit 21 may include multiple cameras, and may be configured and arranged so as to be able to capture images in multiple directions, for example, in front of and to the sides of the vehicle.

[0023] The vehicle interior monitor unit 23 is a device such as a camera that captures the interior of the vehicle interior or a sensor that detects changes in the vehicle interior. For example, the vehicle interior monitor unit 23 supplies data obtained by observing the direction or movement of the driver's line of sight or the movement of the head or other body of the driver of the vehicle to the control unit 13. In addition, it may be possible to identify the driver from an image captured by a camera that captures the interior of the vehicle interior.

[0024] For example, the presentation control unit 13A can obtain the length of time that the driver gazes at road signs or the like present around the moving object (sign gaze time) from data related to the direction or movement of the driver's line of sight. Also, for example, the presentation control unit 13A can obtain the length of time that the driver gazes at guide information displayed on the display unit 15 (guide gaze time) from data related to the direction or movement of the driver's line of sight.

[0025] The driver identification information acquisition unit 25 is a recognition device capable of recognizing passengers including the driver. For example, the driver identification information acquisition unit 25 may be a device that recognizes a terminal carried by a passenger, such as a smartphone or a wearable device. The driver identification information acquisition unit 25 may also be a biometric authentication device capable of recognizing veins, fingerprints, or the like.

[0026] For example, when a driver gets into a vehicle, the driver identification information acquisition unit 25 detects identification information of a smartphone carried by the driver and supplies the information to the control unit 13. For example, the identification information is an identification number unique to a terminal, such as an International Mobile Equipment Identifier (IMEI).

[0027] For example, when a driver gets into the vehicle for the first time, the identification information detected for the first time by the driver identification information acquisition unit 25 is stored in the storage unit 11. Then, when the driver gets into the vehicle again, the driver identification information acquisition unit 25 detects the identification information of the smartphone again. The presentation control unit 13A collates the identification information of the driver stored in the storage unit 11 to identify the driver. That is, the driver identification information acquisition unit 25 and the presentation control unit 13A function as an identification unit that identifies the driver.

[0028] As described above, the in-vehicle monitor unit 23 acquires data on the gaze time, which is the length of time the driver gazes at a road sign, etc., or the length of time the driver gazes at guide information corresponding to the road sign, etc. The gaze time is an index of the degree of interest of the driver in the road sign, etc. For example, an interest level indicating the degree of interest of the driver can be calculated based on the gaze time.

[0029] For example, when the driver does not have a good understanding of or is not familiar with road signs, etc., the interest level is considered to be high. For example, when the interest level is high, it can be considered that the driver has a high degree of need for guide information corresponding to the road signs, etc., that is, information including the contents of traffic regulations indicated by the road signs, etc. On the other hand, when the interest level is low, it can be considered that the driver does not have a high degree of need for guide information corresponding to the road signs, etc., and the necessity level is low.

[0030] For example, when the presentation control unit 13A causes the display unit 15 to display guide information, the guide information can be presented in a manner based on the driver's interest level, making it possible to present the guide information according to the driver's degree of necessity. For example, when the driver has a high interest level in a road sign or the like, the guide information screen corresponding to the road sign or the like is displayed in a larger and more noticeable manner. When the driver has a low interest level, the guide information screen is displayed in a less noticeable manner.

[0031] FIG. 2A shows an example in which guide information is displayed on the display screen 30 of the display unit 15 in a less conspicuous (less emphasized) manner. In FIG. 2A, an image 31 of the road ahead of the moving object is displayed. The image 31 of the road ahead of the moving object includes a road sign 31A. Guide information 32 corresponding to the road sign 31A is displayed below the image 31 of the road ahead. The guide information 32 includes an image 32A showing the road sign 31A and characters 32B showing the contents of the road sign 31A. It should be noted that an area 33 of navigation information such as map information may be displayed in a part of the display screen 30 together with the guide information.

[0032] Fig. 2B shows an example in which guide information is displayed on the display screen 30 of the display unit 15 in a more prominent (emphasized) manner than in Fig. 2A. In Fig. 2B, an image 31 of the area ahead of the moving object and an area 33 of navigation information are displayed, similar to Fig. 2A. Road signs 31A are included in the image 31 of the area ahead of the moving object. Guide information 34 corresponding to the road signs 31A is displayed below the image 31 of the area ahead.

[0033] In Fig. 2B, the guide information 34 includes an image 34A showing a road sign 31A and characters 34B showing the contents of the road sign 31A. The image 34A is displayed larger and more emphasized than the image 32A in Fig. 2A. The characters 34B are larger than the characters 32B in Fig. 2A and are displayed in a more emphasized manner. Also, similar to the case of Fig. 2A, the navigation information area 33 is displayed.

[0034] 3A shows an example of sign detection data, which is information used by the presentation control unit 13A to control the presentation of guide information. The sign detection data is stored in, for example, the storage unit 11, and whenever a new road sign or the like is detected, information corresponding to the road sign or the like is added.

[0035] In Fig. 3A, the "date and time" when a road sign or the like was detected, the "road sign details" which are detailed information about the road sign or the like, and the "type" are shown in association with each other. Some road signs or the like have numbers indicating speed limits or the like. For example, road signs or the like that differ only in numbers indicating limits on maximum speed, minimum speed, height, maximum width, weight, time, etc. may be treated as being of the same type. Also, for example, signs that differ only in the number or direction of the arrows displayed and otherwise have the same meaning may be treated as being of the same type.

[0036] In Figure 3A, "Type" treats road signs, etc. that differ only in numbers as being of the same type. For example, in Figure 3A, "Maximum speed 60km", "Maximum speed 80km", and "Maximum speed 40km" all have "Maximum speed" written in the "Type" column.

[0037] Also included are "driver identification information" which is the driver's identification information when each of the road signs, etc. is detected, and the driver's "gazing time (sec)". For example, when guide information is presented as an image, the gazing time is the time spent gazing at the image. Also, when no guide information is presented, the gazing time may be the time spent gazing at a road sign, etc. in front of the moving object.

[0038] That is, in FIG. 3A, road signs and the like detected from the image acquired by the surroundings photographing unit 21, the driver's gaze time corresponding thereto, and the driver's identification information are stored in association with each other.

[0039] Fig. 3B shows an example in which the average gaze time of Driver A in a predetermined period is calculated for each type of road sign, etc., based on the sign detection data, and an interest level is assigned based on the calculation result. Fig. 3B shows an example in which the interest level is assigned as follows: when the average gaze time is less than 0.5 seconds, the interest level is "low," when the average gaze time is 0.5 seconds or more but less than 1 second, the interest level is "medium," and when the average gaze time is 1 second or more, the interest level is "high."

[0040] In Fig. 3B, the average gaze time for the category "maximum speed" is 0.8 seconds, and the interest level is assigned as "medium." The average gaze time for the category "pedestrian only" is 0.4 seconds, and the interest level is assigned as "low." The average gaze time for the category "height limit" is 1.2 seconds, and the interest level is assigned as "high."

[0041] Fig. 3C shows an example of criteria for determining the presentation mode according to the interest level when the presentation control unit 13A controls the presentation of guide information in a mode based on the interest level in Fig. 3B. According to the criteria in Fig. 3C, when the interest level is "low", the guide information is not presented. When the interest level is "medium", normal presentation control of the guide information is performed in an inconspicuous and unemphasized mode as shown in Fig. 2A. When the interest level is "high", emphasis presentation control of the guide information is performed in a more prominent and emphasized mode as shown in Fig. 2B.

[0042] For example, when the guide information is notified by the audio output unit 16, the guide information may be notified in a louder voice or with a more unusual notification sound when the interest level is "high" compared to when the interest level is "medium." Also, when the guide information is presented by the HUD, the transparency may be controlled to be lower when the interest level is "high" compared to when the interest level is "medium."

[0043] For example, when the level of interest is less than a first predetermined value (first predetermined value), the presentation control unit 13A does not present the guide information. When the level of interest is equal to or greater than the first predetermined value and less than a second predetermined value (second predetermined value) that is greater than the first predetermined value, the guide information may be presented normally in an inconspicuous presentation manner. When the level of interest is equal to or greater than the second predetermined value, the guide information may be presented in an emphasized manner in a more conspicuous manner.

[0044] [Presentation control routine RT1] 4, a presentation control routine RT1 executed by the presentation control unit 13A in the information presentation control device 10 will be described. The presentation control unit 13A starts the presentation control routine RT1 when an accessory power supply (hereinafter referred to as an ACC power supply) of a vehicle in which the information presentation control device 10 is mounted is turned on. Note that the presentation control unit 13A may start the presentation control routine RT1 when the engine of the vehicle starts or when the vehicle starts traveling.

[0045] When the presentation control routine RT1 starts, the presentation control unit 13A executes authentication of the passenger (step S11). In step S11, the presentation control unit 13A acquires an identification number unique to the terminal carried by the driver who drives the vehicle from the driver identification information acquisition unit 25, and identifies the driver by collating the identification number with the identification information stored in the storage unit 11. If the driver boards the vehicle for the first time, or if the identification number is not stored in the storage unit 11, the identification number acquired in step S11 is stored in the storage unit 11 to newly register the identification number.

[0046] After executing step S11, the presentation control unit 13A starts acquiring an image of the vehicle periphery by causing the surroundings photographing unit 21 to start photographing the vehicle periphery (step S12). After executing step S12, the presentation control unit 13A determines whether or not a road sign or the like has been detected (step S13). If the presentation control unit 13A determines in step S13 that a road sign or the like has not been detected (step S13: NO), the presentation control unit 13A executes step S13 again and determines again whether or not a road sign or the like has been detected.

[0047] When the presentation control unit 13A determines in step S13 that a road sign or the like has been detected (step S13: YES), it determines whether or not guide information corresponding to the detected road sign or the like should be presented (step S14). In step S14, the presentation control unit 13A determines whether or not a certain number of pieces of past information ( FIG. 3A ) corresponding to road signs or the like of the same type as the detected road sign or the like have been accumulated in the storage unit 11. If it is determined in step S14 that a certain number of pieces of information including the driver's gaze duration when the same type of road sign or the like was detected in the past have not been accumulated as sign detection information, it is determined that guide information should be presented.

[0048] Furthermore, when it is determined in step S14 that a certain number or more of sign detection data have been accumulated, the presentation control unit 13A refers to the driver's past gazing time or the driver's past interest level obtained from the gazing time from the sign detection data. For example, in step S14, when the referred interest level is "low" (FIG. 3C), it is determined that guide information should not be presented. Also, for example, when the interest level is less than a predetermined threshold (less than a first predetermined value), it is determined that guide information should not be presented.

[0049] When the presentation control unit 13A determines in step S14 that the guide information should be presented (step S14: YES), it determines whether or not to present the guide information in an emphasized manner (step S15). For example, in step S15, the presentation control unit 13A determines whether or not the interest level referred to in step S14 is "high" (FIG. 3C). Also, for example, if it is determined in step S14 that a certain amount or more of sign detection data has not been accumulated, it may be determined in step S15 to display the guide information in an emphasized manner.

[0050] When the presentation control unit 13A determines in step S15 that the guide information is not to be presented in an emphasized manner (step S15: NO), the presentation control unit 13A causes the display unit 15 to normally present the guide information (step S16). For example, in step S16, the guide information is presented in an inconspicuous manner as shown in FIG. 2A.

[0051] When the presentation control unit 13A determines in step S15 that the guide information is to be presented in an emphasized manner (step S15: YES), the presentation control unit 13A causes the display unit 15 to present the guide information in an emphasized manner (step S17). For example, in step S17, the guide information is presented in an emphasized manner as shown in FIG. 2B.

[0052] After executing step S16 or step S17, the presentation control unit 13A determines whether or not the driver has finished checking the guide information (step S18). For example, in step S18, the presentation control unit 13A acquires data on the direction of the driver's line of sight from the in-vehicle monitor unit 23, and determines whether or not the checking has been completed. For example, in step S18, if the driver's line of sight is directed toward the display screen of the display unit 15 on which the guide information image is displayed and then moves away from the display screen, the presentation control unit 13A determines that the checking has been completed.

[0053] Also, for example, in step S18, if the driver's gaze is not directed at the guide information image at all or continues to be directed at the guide information image, the presentation control unit 13A determines that confirmation has ended when a certain time has passed since the guide information image was displayed. Note that in step S18, if the operation input unit 19 receives an operation to stop displaying the guide information image, it may be determined that confirmation of the guide information has ended. Also, the interest level may be calculated based on the time until the operation is received.

[0054] If the presentation control unit 13A determines in step S18 that the confirmation of the guide information has not been completed (step S18: NO), the presentation control unit 13A repeats step S18. If the presentation control unit 13A determines in step S18 that the confirmation of the guide information has been completed (step S18: YES), the presentation control unit 13A ends the presentation of the guide information (step S19).

[0055] After execution of step S19 or when it is determined in step S14 that guide information should not be presented (step S14: NO), the presentation control unit 13A accumulates sign detection information (step S20). For example, the sign detection information includes the date and time when a road sign or the like was detected in this presentation control routine RT1, details of the road sign or the like, the type of the road sign or the like, the time the driver gazed at the road sign or the like or the guide information (gazing time), and the driver's identification information. In step S20, the presentation control unit 13A stores the sign detection information in the storage unit 11.

[0056] After executing step S20, the presentation control unit 13A returns to the beginning of the presentation control routine RT1 and repeats the presentation control routine RT1.

[0057] As described above, in the presentation control routine RT1, the presentation control unit 13A presents the guide information in a presentation mode based on the driver's past interest level. However, after the presentation, the present driver's current interest level in the road signs, etc. detected in step S13 of this routine may be determined based on the gaze time of the road signs, etc. or the guide information, and the guide information may be presented in a mode based on the current interest level.

[0058] That is, the presentation control unit 13A may present guide information in a manner that changes the mode based on the driver's past interest level to a mode based on the driver's current interest level in detected road signs and the like.

[0059] For example, even if it is determined in step S14 that guide information should not be presented (step S14: NO), if the driver has been gazing at a road sign or the like detected in step S13 for a long time and the level of interest is determined to be high (for example, the level of interest is "medium (1)" or "high (2)"), then, for example, step S16 or step S17 may be executed to present the guide information.

[0060] Also, for example, even if it is determined in step S15 that the guide information should not be highlighted and normal presentation is performed (for example, the interest level is "medium (1)"), if the driver has been gazing at road signs or normally displayed guide information for a long time and it is determined that the interest level is high, step S17 may be executed to highlight the guide information.

[0061] As described above in detail, according to the information presentation control device 10 of the first embodiment, the driver's interest in road signs, etc. is adopted as an index of how much the driver needs guide information including the contents of road signs, etc. detected while the moving object is traveling, that is, how beneficial it is for the driver to be presented with the guide information, and the guide information can be provided to the driver in a mode based on the interest level. Therefore, it is possible to provide an information presentation control device that can provide information beneficial to the driver in an appropriate mode according to the situation, such as how much the driver understands each road sign, etc., how familiar he or she is with them, etc. EXAMPLES

[0062] A configuration of an information presentation control device 40 according to a second embodiment of the present invention will be described with reference to Fig. 5. The information presentation control device 40, like the information presentation control device 10 according to the first embodiment, is mounted on a moving body such as a vehicle, and is an information presentation control device that controls presentation of guide information, which is information about road signs or road markings present around the moving body, when the guide information is presented to passengers including a driver of the moving body. For example, the guide information includes the contents of traffic regulations or instructions indicated by road signs or road markings. In this embodiment, an example in which the information presentation control device 40 is mounted on a vehicle will be described.

[0063] 5, the information presentation control device 40 differs from the information presentation control device 10 in that it does not have an in-vehicle monitor unit 23 and has a presentation control unit 13B, but otherwise has a similar configuration. In this embodiment, the presentation control unit 13B counts the number of detections, which is the number of times a road sign or the like is detected.

[0064] 6A shows an example of a sign detection data table TB2 that the presentation control unit 13B uses to control the presentation of guide information in Example 2. The sign detection data table TB2 is stored in the storage unit 11. Every time a road sign or the like is newly detected, sign detection information that is information corresponding to the road sign or the like is added to the sign detection data table TB2. The sign detection information includes information such as the date and time when the road sign or the like was detected, details such as the name and written contents of the detected road sign or the like, and driver identification information.

[0065] 6A, the "date and time" when a road sign, etc. was detected, the "road sign, etc. details" which are detailed information such as the name and written matter of the road sign, etc., and the "type" of the road sign, etc. are associated with each other and are listed in chronological order. In Fig. 6A, as in the case of the sign detection data table TB1 of the first embodiment, road signs, etc. that have the same name but different numbers displayed are treated as being of the same type.

[0066] In addition, in Fig. 6A, "driver identification information" which is the identification information of the driver at the time when each of the road signs, etc. is detected is described in association with each other. In this way, in Fig. 6A, the road signs, etc. detected from the image acquired by the surroundings photographing unit 21 and the driver's identification information are stored in association with each other.

[0067] 6B shows the result of the presentation control unit 13B tallying up the detection count, which is the number of times that road signs and the like were detected when Driver A was in the vehicle and traveling, based on the sign detection data table TB2. In FIG. 6B, the "accumulated detection count" shows the number of detections by "type" per 10 hours of traveling time, which is the time that the same driver drove the vehicle.

[0068] The integrated detection number may be the number of detections per other predetermined driving time. It may also be the number of detections per driving distance, which is the distance traveled by the driver while driving the vehicle, or the total number of detections since the driver first got into the vehicle. In this way, the presentation control unit 13B counts the number of detections by type of road sign, etc. for each driver.

[0069] Fig. 6B shows an example of the result of calculating the encounter frequency, which is the frequency with which Driver A encountered road signs of different types, from the accumulated detection count. Fig. 6B shows an example in which the encounter frequency is calculated as "1 (low)" when the accumulated detection count is less than 3, as "2 (medium)" when the accumulated detection count is 3 or more and less than 20, as "2 (medium)" when the accumulated detection count is 3 or more and less than 20, as "3 (high)" when the accumulated detection count is 20 or more, as "3 (high)" when the accumulated detection count is 20 or more.

[0070] The encounter frequency may be calculated as the total number of detections per driving time, per driving distance, or since the driver first got into the vehicle for each type of road sign, etc. The encounter frequency may also be calculated as the ratio of the number of detections per type to the total number of detections, which is the total number of detections of road signs, etc. Furthermore, the encounter frequency may be calculated by combining these calculation methods.

[0071] In FIG. 6B, the cumulative number of detections for the type “maximum speed” is 50, so the encounter frequency is calculated as “3 (high).” The cumulative number of detections for “pedestrian only” is 18, so the encounter frequency is calculated as “2 (medium).” The encounter frequency for “with roundabout” is 1, so the encounter frequency is calculated as “1 (low).”

[0072] In addition, the types and frequency of encounters of road signs, etc. detected vary depending on the route the driver takes while driving the vehicle. For example, when the encounter frequency is low, it is considered that the driver is unfamiliar with, unfamiliar with, or has a low level of understanding of road signs, etc. that are encountered infrequently. On the other hand, when the encounter frequency is high, it is considered that the driver is familiar with, familiar with, or has a high level of understanding of road signs, etc. that are encountered infrequently.

[0073] Therefore, when the encounter frequency is low, it can be considered that the driver has a high degree of need for guide information corresponding to the road sign, etc., that is, information including details of traffic regulations indicated by the road sign, etc. On the other hand, when the encounter frequency is high, it can be considered that the driver does not have much need for guide information corresponding to the road sign, etc., and the degree of need is low.

[0074] Fig. 6C shows an example of a criterion for the presentation mode according to the encounter frequency when the presentation control unit 13B controls the presentation of the guide information by displaying it as an image on the display screen of the display unit 15 in a mode based on the encounter frequency in Fig. 6B. According to the criterion in Fig. 6C, when the encounter frequency is "3 (high)", the guide information is not presented.

[0075] Also, when the encounter frequency is "2 (medium)", normal presentation control of the guide information is performed in a normal manner that is not conspicuous and is not emphasized, as exemplified in Fig. 2A in Example 1. When the encounter frequency is "1 (low)", emphasis presentation control of the guide information is performed in a more conspicuous and emphasized manner, as exemplified in Fig. 2B in Example 1.

[0076] In this way, when the presentation control unit 13B displays guide information on the display unit 15, by controlling the presentation of the guide information in a manner based on the driver's encounter frequency, it is possible to present the guide information according to the driver's degree of necessity.

[0077] When the presentation control unit 13B causes the audio output unit 16 to announce the guide information, the presentation control unit 13B may cause the guide information to be announced in a louder voice or with a more unusual announcement sound when the encounter frequency is "1 (low)" compared to when the encounter frequency is "2 (medium)." When the presentation control unit 13B causes the guide information to be presented by the HUD, the presentation control unit 13B may perform control such that the transparency is lowered to make the guide information easier to recognize when the encounter frequency is "1 (low)" compared to when the encounter frequency is "2 (medium)."

[0078] 6B and 6C, the example in which the presentation control unit 13B calculates the encounter frequency as "1 (low)", "2 (medium)", and "3 (high)" has been described, but the present invention is not limited to this. The encounter frequency may be calculated as any other value.

[0079] That is, one example of control of the presentation mode is where the presentation control unit 13B determines that the guide information should not be presented when the encounter frequency value is equal to or greater than a first predetermined value (first predetermined value), where the guide information is normally presented in an inconspicuous presentation mode when the encounter frequency is less than the first predetermined value and equal to or greater than a second predetermined value (second predetermined value) that is smaller than the first predetermined value, and where the guide information is highlighted and presented in a more noticeable mode when the encounter frequency is less than the second predetermined value.

[0080] In the above, an example was described in which the encounter frequency is calculated by dividing it into three stages using two predetermined values, the first predetermined value and the second predetermined value, as threshold values, but this is not limited thereto, and the predetermined value may be one or three or more. In other words, it is sufficient that a judgment criterion for deciding to present guide information according to the encounter frequency is set.

[0081] For example, in addition to "1 (low)", "2 (medium)", and "3 (high)", a "4 (very high)" may be defined as an encounter frequency even higher than "3 (high)" and equal to or greater than a third predetermined value that is greater than the first predetermined value. If the encounter frequency is "3 (high)", it is assumed that the sign is familiar and guide information is not presented, but if the encounter frequency is "4 (very high)", it is assumed that the sign is an important road sign or the like and guide information is presented.

[0082] [Presentation control routine RT2] 7, a description will be given of the presentation control routine RT2 executed by the presentation control unit 13B in the information presentation control device 40. The presentation control unit 13B starts the presentation control routine RT2 when the engine of the vehicle in which the information presentation control device 40 is mounted is started. Note that the presentation control unit 13B may start the presentation control routine RT2 when an accessory power source (hereinafter referred to as an ACC power source) of the vehicle is turned on.

[0083] When the presentation control routine RT2 starts, the presentation control unit 13B executes authentication of the occupant (step S31). In step S31, the presentation control unit 13B acquires the identification information of the occupant from the driver identification information acquisition unit 25 and performs authentication.

[0084] For example, in step S31, the presentation control unit 13B acquires an identification number unique to the terminal carried by the driver who is driving the vehicle from the driver identification information acquisition unit 25, and recognizes the driver by collating this with the identification information stored in the storage unit 11. If the identification number is not stored in the storage unit 11, for example, when the driver gets into the vehicle for the first time, the identification number acquired in step S31 is stored in the storage unit 11 to newly register the identification number.

[0085] After executing step S31, the presentation control unit 13B causes the surroundings photographing unit 21 to start photographing the surroundings of the vehicle and starts acquiring an image of the surroundings of the vehicle (step S32). After executing step S32, the presentation control unit 13B determines whether or not a road sign or the like has been detected (step S33). If the presentation control unit 13B determines in step S33 that a road sign or the like has not been detected (step S33: NO), it executes step S33 again and determines again whether or not a road sign or the like has been detected.

[0086] When the presentation control unit 13B determines in step S33 that a road sign or the like has been detected (step S33: YES), it determines whether or not guide information corresponding to the detected road sign or the like should be presented (step S34). In step S34, the presentation control unit 13B determines whether or not a certain number of pieces of sign detection information ( FIG. 6A ) for the driver corresponding to the same type of road sign or the like as the detected road sign or the like have been accumulated in the storage unit 11. If it is determined in step S34 that the certain number of pieces of information including the detection number have not been accumulated, it is determined that guide information should be presented.

[0087] Furthermore, when it is determined in step S34 that a certain amount of information including the detection count has been accumulated, the presentation control unit 13B calculates the frequency of the driver's past encounters with the same type of road sign, etc. Then, based on the frequency of encounters, it determines whether or not to present guide information.

[0088] For example, in step S34, when the calculated encounter frequency is "3 (high)" (FIG. 6C) or is equal to or greater than a first predetermined value, the presentation control unit 13B determines that guide information should not be presented. For example, when the encounter frequency is "2 (medium)" or "1 (low)", or is less than a predetermined threshold (less than the first predetermined value), the presentation control unit 13B determines that guide information should be presented.

[0089] When the presentation control unit 13B determines in step S34 that the guide information should be presented (step S34: YES), it determines whether or not to present the guide information in an emphasized manner (step S35). For example, in step S35, the presentation control unit 13B determines whether or not the encounter degree calculated in step S34 is "1 (low)" (FIG. 6C). Also, for example, if it is determined in step S34 that a certain amount or more of sign detection information has not been accumulated, it may be determined in step S35 that the guide information should be displayed in an emphasized manner.

[0090] When the presentation control unit 13B determines in step S35 that the guide information is not to be presented in an emphasized manner (step S35: NO), the presentation control unit 13B causes the display unit 15 to normally present the guide information (step S36). For example, in step S36, the guide information is presented continuously for a predetermined time in an inconspicuous manner as shown in FIG. 2A.

[0091] When the presentation control unit 13B determines in step S35 that the guide information is to be presented in an emphasized manner (step S35: YES), the presentation control unit 13B causes the display unit 15 to present the guide information in an emphasized manner (step S37). For example, in step S37, the guide information is presented for a predetermined period of time in an emphasized manner as shown in FIG.

[0092] After executing step S36 or step S37, the presentation control unit 13B ends the presentation of the guide information by the display unit 15 (step S38). Note that, when the operation input unit 19 accepts an operation to stop the display of the guide information image in step S38, the presentation control unit 13B may end the presentation of the guide information even if the predetermined time has not elapsed. Also, a history of the acceptance of the operation may be written and stored together with the sign detection information.

[0093] After execution of step S38 or when it is determined in step S34 that guide information should not be presented (step S34: NO), the presentation control unit 13B accumulates sign detection information (step S39). For example, the sign detection information includes the date and time when a road sign or the like was detected in this presentation control routine RT2, details of the road sign or the like, the type of the road sign or the like, the accumulated number of detections, and the driver's identification information. For example, in step S39, the presentation control unit 13B stores the sign detection information in the storage unit 11.

[0094] After executing step S39, the presentation control unit 13B determines whether the engine of the vehicle is ON (step S40). If the presentation control unit 13B determines in step S40 that the engine is ON (step S40: YES), the presentation control unit 13B returns to step S33 and again determines whether a road sign or the like has been detected.

[0095] When the presentation control unit 13B determines in step S40 that the engine is not turned on (step S40: NO), the presentation control routine RT2 ends.

[0096] In addition, the information presentation control device 40 of this embodiment may have an in-vehicle monitor unit 23 as in the case of embodiment 1, and may be capable of acquiring data such as the driver's eye movement and identifying the driver from an image captured by a camera capturing the inside of the vehicle cabin.

[0097] As described above in detail, according to the information presentation control device 40 of this embodiment, the number of road signs, etc. detected while the mobile body is traveling is tallied to calculate the encounter frequency, and the encounter frequency can be used as an index indicating the degree to which the driver needs guide information including the contents of road signs, etc. detected while the mobile body is traveling, that is, the degree to which presenting the guide information to the driver is beneficial to the driver. Then, the guide information can be provided to the driver in a mode based on the encounter frequency. Therefore, it is possible to provide an information presentation control device that can provide information beneficial to the driver in an appropriate mode according to the situation of how much the driver has encountered each road sign, etc. EXAMPLES

[0098] A configuration of a presentation control system 100 including an information presentation control device 50 according to a third embodiment of the present invention will be described with reference to Fig. 8, Fig. 9A, and Fig. 9B. As shown in Fig. 8, the presentation control system 100 includes the information presentation control device 50 and an information presentation control server 60 as an information processing device. The information presentation control device 50 is mounted on a vehicle M.

[0099] The information presentation control device 50 and the information presentation control server 60, which is an external device of the information presentation control device 50, can transmit and receive data (communication connection) between them via a network (communication path). For example, a communication protocol such as TCP / IP is used for the transmission and reception. The network can be constructed by Internet communication including wireless communication such as a mobile communication network, Wi-Fi (registered trademark), and wired communication.

[0100] The information presentation control server 60 is capable of transmitting and receiving data to and from each of the multiple information presentation control devices 50 mounted on the multiple vehicles M.

[0101] Fig. 9A shows a configuration of the information presentation control device 50. As shown in Fig. 9A, the information presentation control device 50 differs from the information presentation control device 40 of the second embodiment in that it has a communication unit 51 and a presentation control unit 13C, but is otherwise configured in the same manner.

[0102] The communication unit 51 is a network adapter such as a NIC (Network Interface Card) for transmitting and receiving data to and from the outside in accordance with an instruction from the presentation control unit 13C. For example, the communication unit 51 transmits identification information of a driver who is in the vehicle M. Furthermore, when a road sign or the like is detected while the vehicle M is traveling, the communication unit 51 transmits sign detection information, which is information related to the road sign or the like. The sign detection information includes details such as the name and display content of the detected road sign or the like, or the type of the detected road sign or the like.

[0103] For example, the information on the road signs, etc. is transmitted to the information presentation control server 60 using a communication protocol such as TCP / IP. In addition, the communication unit 51 receives information on the presentation of guide information including the information on the road signs, etc. to the driver of the vehicle M.

[0104] When the presentation control unit 13C receives the information related to the presentation, it controls the display unit 15 or the audio output unit 16 to provide guide information to the driver in accordance with the contents of the instructions included in the information.

[0105] 9B shows the configuration of the information presentation control server 60. The server communication unit 61 is a network adapter such as a NIC, and transmits and receives data to and from one or more vehicles M. The server communication unit 61 receives identification information of a driver in the vehicle M and sign detection information related to road signs and the like detected while the vehicle M is traveling.

[0106] The server storage unit 62 is a storage device such as a hard disk, a flash memory, a solid state drive (SSD), a random access memory (RAM), etc. The server storage unit 62 stores various programs such as an operating system and software for the server.

[0107] The server storage unit 62 also stores a driver history database (driver history DB) 62A. The driver history DB 62A stores driver history information that is information indicating the history of each driver's encounter with road signs and the like when he or she got into one or more vehicles M. For example, the driver history information includes a count result of the number of detections of each type of road signs and the like.

[0108] The server control unit 63 is configured with a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM, etc., and functions as a computer. The server control unit 63 realizes various functions by reading and executing various programs stored in the server storage unit 62. The server control unit 63 includes a server presentation control unit 63A.

[0109] The server presentation control unit 63A controls the presentation or notification of guide information based on the driver history information stored in the driver history DB 62A. For example, the server presentation control unit 63A acquires the driver's identification information and the detected sign detection information of road signs, etc. from the server communication unit 61 and adds them to the driver history information to count the number of detections. For example, the detection number is counted by type of road signs, etc. The server presentation control unit 63A functions as a counting unit that counts the number of detections of road signs, etc. by type.

[0110] Furthermore, when the server presentation control unit 63A acquires sign detection information from the server communication unit 61, it calculates an encounter frequency from the count result of the detection count included in the driver history information corresponding to the sign detection information, and determines whether or not to present guide information corresponding to the detected road sign, etc. based on the encounter frequency. The server presentation control unit 63A causes the server communication unit 61 to transmit data including the result of this determination to the information presentation control device 50.

[0111] Fig. 10 shows an example of a sign detection data table TB3 stored as driver history information in the driver history DB 62A. In Fig. 10, information on the detection of road signs and the like detected when Driver A got into different vehicles M1, M2, and M3 is shown in chronological order.

[0112] As shown in Fig. 10, the same type of road sign, etc. is detected even when the driver is in a different vehicle. For example, a road sign, etc. of the type "Road Works Underway" is detected while the driver is in vehicle M2, and then detected while the driver is in vehicle M3.

[0113] Also, as in the case of the first and second embodiments, road signs etc. that have the same name but different numbers etc. displayed on them may be treated as being of the same type. For example, in Fig. 10, road signs etc. that say "Maximum speed 60km" and "Maximum speed 80km" are both written as being of the same type, "Maximum speed".

[0114] Based on the driver history information shown in Fig. 10, the server presentation control unit 63A counts the number of detected road signs, etc., calculates the encounter frequency at which the driver A encountered the road signs, etc., and determines the presentation mode of the guide information based on the encounter frequency. For example, as in the case shown in Fig. 6B in the second embodiment, the encounter frequency can be calculated as "3 (high)" when it is equal to or greater than a first predetermined value, "2 (medium)" when it is less than the first predetermined value and equal to or greater than a second predetermined value, and "1 (low)" when it is less than the second predetermined value.

[0115] For example, as in the case shown in Fig. 6C in Example 2, it may be determined that guide information should not be presented when the encounter frequency is "3 (high)." Also, it may be determined that guide information should be presented in normal presentation, which is an inconspicuous presentation mode, when the encounter frequency is "2 (medium)," and in highlighted presentation, which is a conspicuous presentation mode, when the encounter frequency is "1 (low)."

[0116] [Presentation control routine RT3] A presentation control routine RT3 executed in the presentation control system 100 will be described with reference to Fig. 11. The dashed lines in Fig. 11 diagrammatically show data transmission and reception. In Fig. 11, the routine executed by the information presentation control device 50 is shown as routine RT3A, and the routine executed by the information presentation control server 60 is shown as routine RT3B.

[0117] The presentation control unit 13C of the information presentation control device 50 starts the routine RT3A by starting the engine of the vehicle M. The presentation control unit 13C may start the routine RT3A when the ACC power supply of the vehicle M is turned on.

[0118] When starting the routine RT3A, the presentation control unit 13C acquires the driver identification information of the vehicle M from the driver identification information acquisition unit 25, and controls the communication unit 51 to transmit the information presentation control server 60 (step S51A). In step S51A, the driver identification information is transmitted by the communication unit 51 together with the device ID of the information presentation control device 50. In step S51A, the communication unit 51 functions as a transmission unit.

[0119] For example, the presentation control unit 13C acquires an identification number unique to the terminal carried by the driver from the driver identification information acquisition unit 25 and transmits the acquired number together with the device ID of the information presentation control device 50 in step S51A.

[0120] For example, in step S51A, the driver identification information acquisition unit 25 may acquire the driver's identification information by biometric authentication such as fingerprint authentication or iris authentication. In addition to the biometric authentication information, the driver identification information acquisition unit 25 may acquire password input information from the driver and provide it to the presentation control unit 13C.

[0121] For example, the device ID is an identifier in a communication protocol used between the information presentation control device 50 and the information presentation control server 60. In addition, the information transmitted in step 51A may include a vehicle ID that is identification information of the vehicle M.

[0122] The server presentation control unit 63A of the information presentation control server 60 starts the routine RT3B when the information presentation control server 60 is started. When the server presentation control unit 63A starts the routine RT3B, it waits for reception of the driver identification information (step S51B).

[0123] After executing step S51B, the server presentation control unit 63A determines whether or not the driver identification information has been received (step S52B). In step S52B, the server presentation control unit 63A determines whether or not information including the driver identification information and the device ID of the information presentation control device 50 has been received by the server communication unit 61. In step S52B, the server communication unit 61 functions as a receiving unit.

[0124] When the server presentation control unit 63A determines that the driver identification information has not been received (step S52B: NO), the server presentation control unit 63A waits for reception of the driver identification information for a certain period of time, and executes step S52B again.

[0125] When the server presentation control unit 63A determines that the driver identification information has been received (step S52B: YES), it determines whether or not the driver identification information has already been registered in the driver history DB 62A of the server storage unit 62 (step S53B). The determination in step S53B is made based on whether or not the driver identification information received in step S52B is written in the sign detection data table TB3.

[0126] When the server presentation control unit 63A determines in step S53B that the driver identification information is not registered (step S53B: NO), the server presentation control unit 63A newly registers the driver identification information received in step S52B (step S54B). The registration in step S54B is performed by a process of newly writing and saving the received driver identification information in the sign detection data table TB3.

[0127] After executing step S51A, the presentation control unit 13C starts acquiring an image of the vehicle periphery by having the periphery photographing unit 21 start photographing the vehicle periphery (step S52A). After executing step S52A, the presentation control unit 13C determines whether or not a road sign or the like has been detected (step S53A). If the presentation control unit 13C determines in step S53A that a road sign or the like has not been detected (step S53A: NO), the presentation control unit 13C executes step S53A again and determines again whether or not a road sign or the like has been detected.

[0128] When the presentation control unit 13C determines in step S53A that a road sign or the like has been detected (step S53A: YES), the presentation control unit 13C transmits sign detection information of the detected road sign or the like to the information presentation control server 60 (step S54A).

[0129] If the server presentation control unit 63A determines in step S53B that the driver identification information is registered (step S53B: YES) or after executing step S54B, the server presentation control unit 63A waits for sign detection information (step S55B). After that, the server presentation control unit 63A determines whether or not the sign detection information has been received (S56B).

[0130] If the server presentation control unit 63A determines in step S56B that the sign detection information has not been received (step S56B: NO), the server presentation control unit 63A repeats step S56B. If the server presentation control unit 63A determines in step S56B that the sign detection information has been received (step S56B: YES), the server presentation control unit 63A determines whether or not to present guide information (step S57B).

[0131] In step S57B, from the driver history information stored in the driver history DB 62A, the encounter frequency is calculated (FIG. 6B) and the presentation mode is determined (FIG. 6C) based on the encounter frequency, as in the second embodiment. For example, in step S57B, the server presentation control unit 63A determines that the guide information should not be presented when the encounter frequency is equal to or greater than a first predetermined value, and determines that the guide information should be presented when the encounter frequency is less than the first predetermined value.

[0132] Furthermore, the server presentation control unit 63A may determine in step S57B that guide information should be presented if a certain amount or more of driver history information has not been accumulated.

[0133] When the server presentation control unit 63A determines in step S57B that guide information should be presented (step S57B: YES), it transmits a guide information output request (presentation request), which is information including information requesting output of guide information, to the information presentation control device 50 (step S58B). For example, in step S58B, the server presentation control unit 63A generates information including information requesting output of guide information and information indicating the presentation mode of the guide information, and causes the server communication unit 61 to transmit the information. In step S58B, the server communication unit 61 functions as a transmission unit.

[0134] After executing step S54A, the presentation control unit 13C determines whether or not a guide information output request has been received (step S55A). In step S55A, the presentation control unit 13C determines whether or not the communication unit 51 has received the guide information output request. In step S55A, the communication unit 51 functions as a receiving unit. For example, in step S55A, the presentation control unit 13C repeats the determination of whether or not a guide information output request has been received for a predetermined period of time.

[0135] When the presentation control unit 13C determines in step S55A that a guide information output request has been received (step S55A: YES), the presentation control unit 13C presents the guide information (step S56A). For example, in step S56A, the presentation control unit 13C causes the display screen of the display unit 15 to display the guide information for a predetermined time. Also, the presentation mode in step 56A may be an inconspicuous normal presentation mode or a conspicuous emphasized presentation mode according to an instruction included in the guide information output request. Also, for example, in step S56A, the presentation control unit 13C may cause the audio output unit 16 to output a voice reading out the guide information.

[0136] After executing step S56A, the presentation control unit 13C ends the presentation of the guide information (step S57A). After executing step S57A or if it is determined in step S55A that the guide information output request has not been received (step S55A: NO), the presentation control unit 13C determines whether the engine of the vehicle M is ON (step S58A).

[0137] When the presentation control unit 13C determines in step S58A that the engine is ON (step S58A: YES), the presentation control unit 13C returns to step S53A and determines again whether or not a road sign or the like has been detected.

[0138] When the presentation control unit 13C determines in step S58A that the engine is not ON (step S58A: NO), the presentation control unit 13C transmits driving end information indicating that the driving of the vehicle M has ended to the information presentation control server 60 (step S59A). After executing step S59A, the presentation control unit 13C ends the routine RT3A.

[0139] After executing step S58B, the server presentation control unit 63A determines whether or not the traveling end information of the vehicle M has been received (step S59B). If the server presentation control unit 63A determines in step S59B that the traveling end information has not been received (step S59B: NO), the process returns to step S55B and waits for the sign detection information again. If the server presentation control unit 63A determines in step S59B that the traveling end information has been received (step S59B: YES), the routine RT3B ends.

[0140] In this embodiment, a case has been described in which the information presentation control server 60 determines whether or not to present guide information, but this is not the only option. The determination may be performed by the presentation control unit 13C of the information presentation control device 50. For example, the server presentation control unit 63A of the information presentation control server 60 may transmit information including the number of detections or the frequency of encounters of corresponding road signs, etc., to the information presentation control device 50, instead of a guide information output request.

[0141] In this case, the presentation control unit 13C of the information presentation control device 50 may count the number of detections, and may determine whether or not to present guide information and the presentation mode based on the number of detections or the encounter frequency. It is sufficient that the number of detections for each driver regarding multiple vehicles is counted in the driver history DB 62A, and the encounter frequency can be calculated by the server presentation control unit 63A or the presentation control unit 13C.

[0142] As described above in detail, according to the presentation control system 100 of the third embodiment, the frequency of past encounters by drivers who are driving different vehicles can be tallied for each type of road sign, etc., regardless of the difference in the vehicle, in the information presentation control server 60. Then, guide information can be presented to the drivers in a form based on the encounter frequency that differs for each driver.

[0143] Therefore, for example, when a driver uses rental vehicles such as car sharing or rental cars and has the opportunity to ride in multiple vehicles, and the driver does not always ride in the same vehicle, the frequency with which the driver encounters road signs, etc. can be compiled for each driver, and guide information can be presented based on the frequency of encounters for each driver.

[0144] Therefore, it is possible to provide an information presentation control device and an information presentation control server that are capable of providing information that is useful to the driver in a manner appropriate for the driver. EXAMPLES

[0145] An information presentation control device 70 according to a fourth embodiment will be described below with reference to the accompanying drawings. Fig. 12 shows the configuration of the information presentation control device 70. The information presentation control device 70 is configured similarly to the information presentation control device 40 according to the second embodiment, and differs in that it has a presentation control unit 13D that is capable of control different from the presentation control unit 13B.

[0146] The information presentation control device 70 is mounted on a vehicle that can switch between automatic driving and manual driving modes. In this specification, automatic driving refers to a driving mode that does not require human involvement. In addition, in this specification, manual driving refers to a driving mode that requires human involvement (non-automatic driving), and includes partial manual driving. Partial manual driving refers to a driving mode in which at least some of the operations or confirmation of the surroundings must be performed by a human, and some human involvement is required.

[0147] In addition, in this specification, a vehicle that can be switched between automatic driving and manual driving refers to a vehicle that can run in automatic driving mode, and can run in manual driving mode when environmental conditions such as surrounding road conditions or weather are poor, or when the automatic driving is canceled by the driver's will. For example, a vehicle that can be driven at level 3 or higher in the SAE J3016 standard corresponds to this.

[0148] The presentation control unit 13D controls the presentation of guide information including information about road signs, etc., based on whether the driving mode of the vehicle is autonomous driving or not. Specifically, while driving in the autonomous driving mode (during autonomous driving), the presentation control unit 13D causes the guide information to be presented in a manner showing detailed content including more information, such as including an explanation of traffic rules, penalties for violating traffic rules, or information about more types of road signs, etc.

[0149] During driving in the manual driving mode (during manual driving), the presentation control unit 13D presents simplified guide information including less information such as only the names of road signs, etc. The determination as to whether or not the vehicle is in automatic driving is performed, for example, by acquiring information from the vehicle.

[0150] For example, a predetermined criterion may be set to select which type of guide information to present among the types of road signs, etc. For example, when the vehicle is not in autonomous driving (non-autonomous driving), the presentation control unit 13D causes the presentation of guide information for non-autonomous driving related to road signs, etc. of a type that satisfies a first criterion. Also, for example, when the vehicle is in autonomous driving, the presentation control unit 13D may cause the presentation of guide information for autonomous driving related to signs or markings of a type that satisfies a second criterion that is easier to satisfy than the first criterion.

[0151] For example, the predetermined criterion may be the passenger's interest in road signs, etc., or the frequency with which the passenger encounters road signs, etc., as in the cases of Examples 1 to 3. For example, guide information corresponding to road signs, etc. of a type with a higher interest level than a predetermined value, or road signs, etc. of a type with a lower encounter frequency than a predetermined value, may be displayed. Then, by setting the predetermined value low during automatic driving and setting the predetermined value high during manual driving, guide information containing more information can be presented during automatic driving, and guide information containing less information can be presented during manual driving.

[0152] The function of the presentation control unit 13D can also be realized in the information presentation control device 10 in the first embodiment (FIG. 1), the information presentation control device 40 in the second embodiment (FIG. 5), or the presentation control system 100 in the third embodiment (FIGS. 8 and 9A).

[0153] Therefore, in the information presentation control device 70, the driver's level of interest in road signs, etc. or the frequency of encounters with road signs, etc., may be adopted as an index showing the degree of necessity, which is the degree to which the information is needed by the passengers including the driver, and guide information may be presented to the driver in a manner based on the level of interest or frequency of encounters.

[0154] Fig. 13A shows an example of a display screen including guide information, which is displayed on the display screen 30 of the display unit 15 during autonomous driving in Example 4. In Fig. 13A, an image 31 of the front of the vehicle is displayed. The image 31 of the front of the vehicle includes a road sign 31A indicating a maximum speed. Below the image 31 of the front of the vehicle, guide information 35 corresponding to the road sign 31A is displayed.

[0155] The guide information 35 includes an image 35A showing a road sign 31A and characters 35B showing detailed information about the road sign 31A. The characters 35B show not only the name of the road sign 31A but also the meaning displayed by the road sign 31A. In addition to the guide information 35, an area 33 of navigation information such as map information may be displayed in a part of the display screen 30.

[0156] Fig. 13B shows another example of a display screen including guide information, which is displayed on the display screen 30 of the display unit 15 during automatic driving in Example 4. In Fig. 13B, an image 36 of the front of the vehicle is displayed. The image 36 of the front of the vehicle includes a road sign 36A indicating a stop. Below the image 36 of the front of the vehicle, guide information 37 corresponding to the road sign 36A is displayed.

[0157] The guide information 37 includes an image 37A showing a road sign 36A and characters 37B showing detailed information about the road sign 36A. The characters 37B show not only the name of the road sign 36A, but also the detailed information including the meaning and penalties displayed.

[0158] 13B is presented, a voice reading out the characters 37B may be output from the voice output unit 16. For example, the guide information 37 is displayed on the display screen 30 accompanied by a voice saying, "This is a stop sign. Even if you slow down, it is a violation. The violation points are 2 points, and the fine for a standard vehicle is 7,000 yen."

[0159] The detailed information as exemplified in Fig. 13B may be used for the driver's learning. In addition to the guide information, an area 38 of navigation information such as map information may be displayed in a part of the display screen 30.

[0160] FIG. 13C shows another example of a display screen in the quiz mode displayed on the display screen 30 of the display unit 15 during automatic driving in the fourth embodiment. The quiz mode is used, for example, to check the driver's learning results or understanding. In FIG. 13C, an image of a road sign and a question for selecting the correct meaning of the road sign are displayed. For example, the driver can learn about road signs and the like during automatic driving, when he or she does not need to be involved in driving, and this can be useful for recognizing road signs when switching to manual driving.

[0161] [Presentation control routine RT4] 14, a presentation control routine RT4 executed by the presentation control unit 13D will be described as an example of a routine executed in the fourth embodiment. The presentation control unit 13D starts the presentation control routine RT4 when the engine of a vehicle equipped with the information presentation control device of the fourth embodiment is started. The presentation control unit 13D may start the presentation control routine RT4 when the ACC power supply of the vehicle is turned on.

[0162] When the presentation control routine RT4 starts, the presentation control unit 13D executes authentication of passengers including the driver of the vehicle (step S61). In step S61, the presentation control unit 13D acquires identification information of the passengers from the driver identification information acquisition unit 25 and performs authentication.

[0163] For example, in step S61, the presentation control unit 13D acquires the identification number of the terminal carried by the driver or the biometric information of the driver, and authenticates the driver by comparing it with identification information stored in advance and registered in the storage unit 11. If the identification information of the driver is not stored in the storage unit 11, the identification information acquired in step S61 is stored in the storage unit 11 and newly registered.

[0164] After executing step S61, the presentation control unit 13D causes the surroundings photographing unit 21 to start photographing the surroundings of the vehicle and starts acquiring an image of the surroundings of the vehicle (step S62). After executing step S62, the presentation control unit 13D determines whether or not a road sign or the like has been detected (step S63). If the presentation control unit 13D determines in step S63 that a road sign or the like has not been detected (step S63: NO), it executes step S63 again and determines again whether or not a road sign or the like has been detected.

[0165] When the presentation control unit 13D determines in step S63 that a road sign or the like has been detected (step S63: YES), the presentation control unit 13D determines whether the driving mode of the vehicle is the automatic driving mode (step S64).

[0166] When the presentation control unit 13D determines in step S64 that the driving mode is not automatic (step S64: NO), the presentation control unit 13D performs control to display guide information in a simplified form that does not include detailed information (non-automated driving guide information presentation mode) (step S65). In step S65, the presentation control unit 13D displays the guide information for a certain period of time in the simplified form as shown in FIG. 2A in the first embodiment, for example.

[0167] When the presentation control unit 13D determines in step S64 that the mode is the autonomous driving mode (step S64: YES), it performs control to present detailed guide information including a lot of information (autonomous driving guide information presentation mode) (step S66). In step S66, the presentation control unit 13D presents detailed guide information such as that shown in Fig. 13A or detailed guide information accompanied by audio such as that shown in Fig. 13B for a certain period of time. In addition, in step S66, the presentation control unit 13D presents detailed guide information including a quiz mode such as that shown in Fig. 13C for a certain period of time.

[0168] In the presentation control in steps S65 and S66, the presentation control unit 13D may further control the presentation mode of the guide information based on the interest level or the encounter frequency. For example, when the interest level is low or the encounter frequency is high, it may be determined not to present the guide information.

[0169] After executing step S65 or step S66, the presentation control unit 13D saves a history regarding the presentation of guide information (step S67). In step S67, the presentation control unit 13D stores sign detection information including the date and time of detection of a newly detected road sign, etc., in the storage unit 11. In addition, in step S67, the presentation control unit 13D may store in the storage unit 11 information regarding whether the presented guide information was detailed or not, the driver's understanding, etc.

[0170] After executing step S67, the presentation control unit 13D determines whether the engine of the vehicle is ON (step S68). If the presentation control unit 13D determines in step S68 that the engine is ON (step S68: YES), the presentation control unit 13D returns to step S63 and again determines whether a road sign or the like has been detected.

[0171] When the presentation control unit 13D determines in step S68 that the engine is not ON (step S68: NO), it causes the surroundings photographing unit 21 to end photographing the surroundings of the vehicle, and ends the presentation control routine RT4.

[0172] As described above in detail, according to the information presentation control device or information presentation control system of Example 4 of the present invention, which is mounted on a vehicle capable of switching between autonomous driving and non-autonomous driving modes, detailed information including more information on road signs, etc. can be provided to the driver in autonomous driving mode in which the driver does not need to be involved in driving.

[0173] It is possible to provide drivers with an opportunity to review or learn about the content indicated by road signs, etc., as well as related rules and penalties, enabling drivers to maintain their knowledge of road signs, etc., even when using autonomous driving mode.

[0174] Therefore, according to the information presentation control device or information presentation control system of Example 4, it is possible to present information about road signs, etc. in an appropriate amount and manner depending on whether the vehicle is in autonomous driving mode or not, thereby providing useful information to passengers. [Explanation of symbols]

[0175] 10, 40, 50, 70 Information display control device 11 Storage section 13 Control section 13A Presentation control unit 15 Display section 16 Audio output section 17 Driving information acquisition unit 19 Operation input section 21 Peripheral Photography Department 23 Vehicle interior monitor section 25 Driver recognition information acquisition unit 51 Communications Department 60 Information presentation control server 61 Server Communication Department 62 Server memory section 62A Driver History DB 63 Server control section 63A Server presentation control unit

Claims

[Claim 1] A detection unit that detects signs or markings, including road signs or road markings, present around the moving object; a presentation control unit that controls presentation of guide information including information regarding the first sign or marking detected by the detection unit to a passenger of the moving body, The information presentation control device is characterized in that the presentation control unit presents the guide information in a manner based on the passenger's past interest in signs or markings of the same type as the first sign or marking.

Images