Information processing device, information processing method, and information processing program
The information processing device controls information updates based on driving automation levels and environmental conditions to prevent driver distraction, enhancing safety by ensuring timely and relevant information presentation.
Patent Information
- Application Number
- JP2024145031
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-08-27
- Publication Date
- 2024-11-15
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing information processing systems in vehicles often distract drivers by updating information in real-time regardless of the driving situation, leading to a lack of concentration on driving.
An information processing device that acquires updateable output information and controls its update based on state information such as driving automation levels and surrounding environment, ensuring information is updated only when appropriate.
This approach allows drivers to concentrate on driving by finely controlling when information is updated, considering the vehicle's automation level and environmental conditions.
Smart Images

Figure 2024161116000001_ABST
Abstract
Description
[Technical field]
[0001] The present application belongs to the technical field of information processing devices and the like that perform update control of information output by an output unit. [Background technology]
[0002] With the recent spread of so-called mobile computing, users can obtain a wide variety of information output by terminal devices. Such information includes information that is updated at any time, such as weather information, currency exchange information, stock price information, transportation operation information, information posted to SNS (Social Networking Service), and POI (Point of Interest) information displayed on a map of a navigation device.
[0003] Furthermore, Patent Document 1 below discloses a technique for delivering information that takes into consideration the user's preferences and the situation at the time and that better reflects the user's tastes. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2007-272616 A Summary of the Invention [Problem to be solved by the invention]
[0005] Here, in the above-mentioned terminal device that presents information to the user and the technology described in Patent Document 1, it is common to present information that is updated at any time to the user while updating it sequentially in accordance with the updates. However, for example, if the information displayed on a display device of a mobile body such as an automobile is updated in real time regardless of the driving conditions or the intentions of the passengers, there is a problem that, for example, the driver may be distracted by the updated information and not be able to concentrate on driving.
[0006] The present application has been made in consideration of these circumstances, and one example of the objective of the application is to provide an information processing device, etc. that, when presenting information that is updated at any time to a driver of a mobile vehicle, is capable of controlling the updating of information according to the situation, thereby allowing the driver to concentrate on driving. [Means for solving the problem]
[0007] In order to solve the above problem, the invention described in claim 1 comprises an output information acquisition means for acquiring updatable output information that is output to an output means provided in a moving body, a status information acquisition means for acquiring status information indicating a control status regarding movement in the moving body, and a control means for controlling whether or not to update the output information based on the acquired status information.
[0008] In order to solve the above problem, the invention described in claim 7 is an information processing method executed in an information processing device, comprising an output information acquisition step of acquiring output information that is output to an output means provided in a moving body and that can be updated, a status information acquisition step of acquiring status information that indicates a control status regarding movement in the moving body, and a control step of controlling whether or not to update the output information based on the acquired status information.
[0009] In order to solve the above problem, the invention described in claim 8 causes a computer connected to the output means to function as the information processing device described in any one of claims 1 to 6. [Brief description of the drawings]
[0010] [Figure 1] 1 is a block diagram showing a schematic configuration of an information processing device according to an embodiment. [Diagram 2] FIG. 4 is a diagram showing an example of a screen on a display of the navigation device according to the embodiment. [Diagram 3] 1 is a block diagram showing a schematic configuration of a navigation device according to an embodiment; [Figure 4]1 is an external view illustrating an example of the layout of a display and the like in a navigation device according to an embodiment, as viewed from a driver's seat. [Diagram 5] 4 is a flowchart showing an overall operation example of the navigation device according to the embodiment. [Figure 6] 5 is a flowchart showing details of an example of the operation of the navigation device according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0011] An embodiment of the present invention will be described with reference to FIG.
[0012] As shown in FIG. 1, the information processing device 1 according to the embodiment includes an output information acquisition means 111A, a status information acquisition means 111B, a control means 111C, an ambient environment information acquisition means 111D, and a detection means 111E, and is connected to an external output means 2.
[0013] In this configuration, the output information acquisition means 111A acquires updatable output information that is output to the output means 2 provided in the moving object. The output information that is updatable and output to the output means 2 includes weather information, exchange rate information, stock price information, transportation operation information, information posted to SNS, and the like.
[0014] The state information acquisition means 111B acquires state information indicating a control state regarding the movement of a moving object. A moving object is, for example, an automobile, a bicycle, a train, a ship, an airplane, etc. The control state is, for example, the degree to which the judgment or driving technique of the user of the moving object (for example, the driver when the moving object is a vehicle) is involved in the movement of the moving object, and is the so-called automatic driving state of the moving object.
[0015] The control means 111C controls whether or not to update the output information based on the state information acquired by the state information acquisition means 111B. Here, "updating" the output information means i) a process of updating output information already output to the output means 2 with new output information (for example, a process of updating already output exchange information A with other exchange information B), and ii) A process of controlling whether or not to output to the output means 2 output information that has not yet been output (i.e., the output means 2 switches from a state in which no output information is being output to the output means 2 to a state in which new output information is being output, etc.) Both are included (hereinafter the same).
[0016] Therefore, according to the information processing device 1 of the embodiment, whether or not to update the output information is controlled based on the control state regarding the movement of the moving body, so that whether or not to update the output information can be controlled in a fine and appropriate manner, allowing the driver to concentrate on driving.
[0017] In addition, in the information processing device 1 of the embodiment, the control state of the moving body is a state of automation of driving of the moving body with multiple levels set in advance, and the state information acquired by the state information acquisition means 111B is configured to be state information indicating the level of automation of the current driving automation of the moving body.
[0018] Therefore, the control state regarding the movement of the mobile body is the state of its driving automation, which has multiple predefined levels, and the status information indicates the level of automation of the current driving of the mobile body, so that it is possible to finely and appropriately control whether or not to update the output information depending on the level of driving automation of the mobile body, allowing the driver to concentrate on driving.
[0019] Furthermore, in the information processing device 1 of the embodiment, the control state of the moving body is either a fully automated driving state in which all of the acceleration, steering, and braking during driving are automated and the driver is not involved in the driving at all, or a driving state of the moving body other than the fully automated driving state, and the state information acquired by the state information acquisition means 111B is state information indicating either of the driving states, and the control means 111C controls to prohibit updating of the output information when the state information indicates that the above driving state is a driving state of the moving body other than the fully automated driving state.
[0020] Therefore, when the control state regarding the movement of the moving body is either a fully automated driving state or a driving state of the moving body other than the fully automated driving state, the state information is state information indicating either of the driving states, and it is indicated that the driving state of the moving body is a driving state of the moving body other than the fully automated driving state, the update of the output information is controlled to be prohibited.This makes it possible to finely and appropriately control whether or not to update the output information, allowing the driver to concentrate on driving.
[0021] Furthermore, in the information processing device 1 according to the embodiment, the surrounding environment information acquiring means 111D acquires surrounding environment information relating to the surrounding environment of the moving object.
[0022] The control means 111C controls whether or not to update the output information based on the control state of the moving object indicated by the status information acquired by the status information acquisition means 111B and the surrounding environment related to the surrounding environment information acquired by the surrounding environment information acquisition means 111D.
[0023] Therefore, since whether or not to update the output information is controlled based on the control state of the moving body and the surrounding environment, whether or not to update the output information can be controlled more finely and appropriately, allowing the driver to concentrate on driving.
[0024] In addition, in the information processing device 1 according to the embodiment, the control state of the moving body is either a fully automated driving state in which acceleration, steering, and braking in driving the moving body are all automated and the driver is not involved in the driving at all, or a driving state of the moving body other than the fully automated driving state, and the status information acquired by the status information acquisition means 111B is status information indicating either of the above driving states.
[0025] The control means 111C controls to update the output information when the status information indicates that the driving state of the moving body is a fully automated driving state, and controls to prohibit updating the output information when the status information indicates that the driving state is a driving state other than a fully automated driving state and the surrounding environment information indicates that the surrounding environment related to the surrounding environment information acquired by the surrounding environment information acquisition means 111D is not suitable for updating the output information.
[0026] Therefore, when the control state regarding the movement of the moving body is either a fully automated driving state or a driving state of the moving body other than the fully automated driving state, and the state information is state information indicating either of the driving states, and it is indicated that the driving state of the moving body is a fully automated driving state, the output information is controlled to be updated, and when it is indicated that the driving state is a driving state other than a fully automated driving state and it is indicated that the surrounding environment is not suitable for updating the output information, the update of the output information is prohibited, so that it is possible to finely and appropriately control whether or not to update the output information, allowing the driver to concentrate on driving.
[0027] Furthermore, in the information processing device 1 according to the embodiment, the detection means 111E detects the motion of a passenger other than the driver of the moving object.
[0028] Then, when the output information is the subject of an action detected by the detection means 111E, the control means 111C performs control so as to allow updating of the output information regardless of the surrounding environment related to the surrounding environment information acquired by the surrounding environment information acquisition means 111D.
[0029] Therefore, when the output information is subject to the action of a passenger other than the driver, the output information is controlled to be updated regardless of the surrounding environment, so that the output information can be appropriately updated when it is subject to the action of a passenger other than the driver. EXAMPLES
[0030] Next, specific examples corresponding to the above-mentioned embodiment will be described with reference to Figures 2 to 6. The examples described below are examples in which the above-mentioned embodiment is applied to an in-vehicle device mounted on a vehicle (one example of a "moving body"). Here, examples of the in-vehicle device according to the examples described below include, for example, a navigation device that guides the movement of the vehicle in which the in-vehicle device is mounted, and a display device that displays content such as videos and SNS posted information inside the vehicle.
[0031] (I) Overview of the in-vehicle device according to the embodiment First, an overview of the information update function characteristic of the in-vehicle device NV according to the embodiment will be described. The information update function is a function for controlling the updating of output information that is updated over time when it is displayed on a display.
[0032] The in-vehicle device NV according to the embodiment acquires time information, exchange rate information, and SNS posted information, which are output information updated over time. The timing of acquiring each piece of information may be periodically, or each time the information is updated. The SNS posted information is, for example, information indicating posted articles including keywords set by the user. That is, when the keyword "Hokkaido" is set, the in-vehicle device NV acquires information indicating posted articles related to Hokkaido.
[0033] Next, the in-vehicle device NV displays the acquired output information in separate areas as shown in FIG. 2. Specifically, the in-vehicle device NV displays time information in a time display area 401 of the screen 400, displays currency exchange information in a currency exchange display area 402, and displays SNS posted information in a posted information display area 403. At this time, if the surrounding environment of the vehicle in which the in-vehicle device NV is mounted is not appropriate for updating information during the movement, the in-vehicle device NV does not update the SNS posted information displayed in the posted information display area 403 with the new SNS posted information even if the new SNS posted information is acquired. Here, the surrounding environment that is not appropriate for updating information during the movement of the vehicle refers to a surrounding environment that imposes, for example, a psychological, physical, or mental burden on the driver of the vehicle, such as a heavy rain in the surroundings, a traffic jam on the road currently being traveled, or a very narrow road. Furthermore, even if the SNS posted information is the subject of the user's action, i.e., the user's gaze is directed at the SNS posted information, or the user is performing an operation (e.g., a scroll operation) on the posted information display area 403 in which the SNS posted information is displayed, the in-vehicle device NV does not update the SNS posted information displayed in the posted information display area 403 with the new SNS posted information, even if the new SNS posted information is acquired. On the other hand, with regard to time information, the in-vehicle device NV updates the time information displayed in the time display area 401, etc. with the new time information, regardless of whether the surrounding environment of the vehicle indicates that the situation is not appropriate for updating information while the vehicle is moving, and regardless of whether the time information is the subject of the user's action (the same applies to the exchange rate information and the exchange rate display area 402). That is, the in-vehicle device NV displays the latest information for the time information.
[0034] Furthermore, the on-vehicle device NV controls whether or not to update the output information depending on the level of automation of driving in the vehicle that the on-vehicle device NV is installed in. In this case, the level of automation can basically be set arbitrarily, but examples include levels 1 to 4 shown in Table 1 below.
[0035] [Table 1]
[0036] The automation levels shown in Table 1 are the automation levels defined on page 5 of the "Public-Private ITS Initiative and Roadmap 2016-2020 Towards the Realization of Automated Driving on Expressways and Unmanned Automated Driving Mobility Services in Limited Areas" announced by the Strategic Headquarters for the Promotion of an Advanced Information and Communications Network Society on May 20, 2016. According to the definitions in Table 1, a system that realizes the automation level 1 shown in Table 1 is a "safe driving support system," a system that realizes the automation levels 2 and 3 shown in Table 1 is a "semi-automated driving system," and a system that realizes the automation level 4 shown in Table 1 is a "safe automated driving system." The classification of "information provision type" in Table 1 includes "safe driving support devices (on-board devices)" that provide information and alert the driver. In addition, in any of the automation levels in Table 1, the driver of the vehicle is allowed to intervene in the control of the automated driving system at any time. That is, in the case of automation level 4, for example, the driver can stop the automated driving system by pressing the system deactivation stop button or the like as necessary. However, if the driver intervenes in the autonomous driving system at level 4 automation, it will no longer be level 4 automation at that point.
[0037] (II) Configuration of the in-vehicle device according to the embodiment Next, the configuration of the on-vehicle device NV according to the embodiment will be described with reference to Fig. 3. As shown in Fig. 3, the on-vehicle device NV according to the embodiment includes a control unit 211, a storage device 212 including a HDD or the like, an input device 213, a display unit 214, a bus line 215, an input / output interface unit 220, a vehicle speed sensor 221, an angular velocity sensor 222, an acceleration sensor 223, a steering angle sensor 224, a GPS (Global Positioning System) receiving unit 225, a data transmitting / receiving unit 226, a gaze detection camera 227, an outside vehicle camera 228, and an outside vehicle sensor 229. 4, it is preferable that the external sensor 229 is provided outside the vehicle as seen from the driver's seat, the input device 213 is provided at the position of the steering wheel H, and the display unit 214 and the gaze detection camera 227 are provided at the position of the front panel FP beside the steering wheel H. When there is an updated portion in the image HD of the head-up display displayed (projected) at the position of the driver's gaze through the windshield FG, the control of the update according to the embodiment can also be applied.
[0038] In the above configuration, the vehicle speed sensor 221 detects the current speed of the vehicle using a speed detection process using a vehicle speed pulse acquired from the vehicle in which the on-board device NV is mounted, and outputs speed data. The angular velocity sensor 222 detects the angular velocity of, for example, a change in direction of the vehicle, and outputs angular velocity data and relative direction data per unit time. The acceleration sensor 223 detects the acceleration of the vehicle in, for example, the forward / rearward direction, and outputs acceleration data per unit time. The steering angle sensor 224 detects the steering angle of the vehicle, and outputs steering angle data, etc. The GPS receiver 225 receives navigation radio waves from a GPS satellite, and outputs vehicle position information such as latitude, longitude, and altitude data, absolute direction data in the vehicle's traveling direction, and GPS speed data as GPS positioning data. The data transmitter / receiver 226 performs processing related to transmission and reception of data between the server device and the server device via a network. The gaze detection camera 227 is provided inside the vehicle in which the in-vehicle device NV is mounted, and is a camera for detecting the gaze of the user (the driver and passengers; the same applies below), and outputs a captured image to the control unit 211. The exterior camera 228 is provided outside the vehicle in which the in-vehicle device NV is mounted, and is a camera for detecting the surrounding environment of the vehicle, and outputs a captured image to the control unit 211. The exterior sensor 229 is a sensor for detecting the temperature, humidity, amount of rain, etc. outside the vehicle, and outputs the detection result to the control unit 211 via the input / output interface unit 220 and the bus line 215.
[0039] The storage device 212 stores various programs such as an operating system and application programs. The various programs may be acquired from a server device or the like via a network, or may be read and executed from a recording medium such as a CD (Compact Disc), a DVD (Digital Versatile Disc), or a USB (Universal Serial Bus) memory.
[0040] The storage device 212 also stores map image data for displaying a map on the display unit 214, map information used when searching for a route, road link information, and the like. The storage device 212 also stores information indicating so-called near-miss points such as intersections, railroad crossings, and highway junctions where accidents are likely to occur. The storage device 212 also stores operation history information indicating the operation history of the user on the in-vehicle device NV, or gaze movement history information indicating the movement history of the user's gaze. At this time, the operation history information and gaze movement history information are stored together with identification information indicating which user they are from. The control unit 211 identifies the identification information based on the captured image output by the gaze detection camera 227.
[0041] In addition, the storage device 212 stores road information related to the map information and road link information, such as road type information indicating the type of road (e.g., type of expressway, general road, one-way road, etc.), road width information indicating the width of the road, shoulder presence / absence information indicating the presence / absence of a shoulder on each road, shoulder width information indicating the width of the shoulder if the shoulder exists, lane number information indicating the number of lanes on each road, center lane position information indicating the position of the center lane on each road, parking space presence / absence information indicating the presence / absence of a parking space on each road, parking space position information indicating the position of the parking space if the parking space exists, etc. Furthermore, the storage device 212 stores parking lot information including parking lot type information indicating the type of parking lot (service area, shopping mall parking lot, etc.) and parking lot position information indicating the position of each parking lot. At this time, the parking lot position information includes position information indicating the longitude / latitude of the vertices of each side constituting the parking lot when the corresponding parking lot is viewed as a planar shape (range), and is configured so that the range connecting each vertex can be recognized as a parking lot based on the position information. More specifically, the parking lot location information is configured so that, for example, if the planar shape (area) of the corresponding parking lot is rectangular, the area within those four points can be recognized as a parking lot based on the location information indicated by the longitude / latitude of its four vertices.
[0042] The information stored in the storage device 212 may be stored in a server device (not shown) outside the vehicle-mounted device NV and may be received and used as needed.
[0043] The input device 213 is composed of a touch sensor, a touch panel, a keyboard, a mouse, a pressure detection sensor, a jog dial, other controllers, etc., and receives input operations from the user and transmits to the control unit 211 an operation signal indicating the content of the operation.
[0044] The display unit 214 displays various display data under the control of the control unit 211. The display unit 214 includes a graphics controller 214a, a buffer memory 214b including a memory such as a VRAM (Video RAM), and a display 214c including a liquid crystal display. In this configuration, the graphics controller 214a controls the entire display unit 214 based on control data sent from the control unit 211 via a bus line 215. The buffer memory 214b temporarily stores image information that can be displayed instantly. An image is then displayed on the display 214c based on the image data output from the graphics controller 214a.
[0045] The control unit 211 is composed of a CPU 211a for controlling the entire control unit 211, a ROM 211b in which a control program for controlling the control unit 211 and the like are stored in advance, and a RAM 211c for temporarily storing various data. The control unit 211 is connected to a vehicle speed sensor 221, an angular velocity sensor 222, an acceleration sensor 223, a steering angle sensor 224, and a GPS receiving unit 225 via a bus line 215 and an input / output interface unit 220, and controls the entire in-vehicle device NV based on speed data, angular velocity data, relative direction data, steering angle data, GPS positioning data, absolute direction data of the vehicle's traveling direction, acceleration data, and the like outputted from each of them, and also controls the operation of each of the various components such as the display unit 214.
[0046] The control unit 211 acquires time information from the system clock, and acquires currency exchange information and SNS posting information from a server device (not shown). As the currency exchange information, information indicating the exchange rate between currencies set by the user is acquired, and as the SNS posting information, information indicating posted articles including keywords set by the user is acquired. The control unit 211 acquires the time information and the exchange rate at a predetermined interval, and acquires the SNS posting information every time a new posted article is uploaded to the server device (not shown).
[0047] The control unit 211 specifies the configuration of the screen currently displayed on the display 214c. For example, it specifies the position and display contents of the part to be updated on the screen (for example, the time display area 401, the exchange display area 402, and the posted information display area 403 in FIG. 2), the position of the part on the screen that the user can operate, and the like. The control unit 211 also specifies which acquired information is information for updating the information displayed in which part to be updated. On the other hand, the control unit 211 specifies the surrounding environment such as the weather outside the vehicle and the road conditions based on the captured image output by the outside-vehicle camera 228 and the detection result by the outside-vehicle sensor 229, respectively. The control unit 211 also specifies the direction of the user's gaze based on the captured image output by the gaze detection camera 227. Specifically, it specifies which user is directing his / her gaze to which area of the time display area 401, the exchange display area 402, and the posted information display area 403 on the screen displayed on the display 214c.
[0048] Then, the control unit 211 determines whether to update the display contents of the time display area 401, the exchange rate display area 402, and the posted information display area 403 based on the acquired time information, exchange rate information, and SNS posted information. For example, based on at least one of the following rules (1) to (5), it can determine whether to update the part to be updated based on the acquired information (hereinafter, sometimes referred to as the "update part"). (1) If the acquired information is for updating the part of the page on which the user's gaze is directed, the update using the acquired information will be suspended (meaning prohibiting the update at that time; the same applies below). (2) If the acquired information is for updating the update portion that is the target of the user's operation, the update using the acquired information will be suspended. (3) If the current location is a near-miss point and the user is the driver of a vehicle equipped with an on-board device according to the third embodiment, the update using the acquired information is suspended after taking into consideration the conditions according to the more detailed embodiment described below (hereinafter referred to as the "detailed conditions according to the embodiment") and the current level of automation of the driving of the vehicle (see Table 1). On the other hand, even if the current location is a near-miss point, if the user is a passenger other than the driver, the update is performed regardless of the level of automation. (4) When the current surrounding environment is not suitable for updating information while the vehicle equipped with the on-board device NV is moving, that is, as described above, when there is heavy rain around, when the road currently being traveled is congested, or when the road currently being traveled is an extremely narrow road, and the user is the driver, the update using the acquired information is suspended after taking into account the detailed conditions according to the embodiment and the level of automation. On the other hand, even if the current surrounding environment is not suitable for updating information while the vehicle is moving, if the user is the passenger, the update is performed regardless of the level of automation. (5) If the acquired information is for updating an update portion where a user has operated (directed his / her gaze) within a set time period and the user is the driver, the update using the acquired information is suspended. On the other hand, even if the acquired information is for updating an update portion where a user has operated (directed his / her gaze) within a set time period, the update is performed if the user is a passenger.
[0049] However, if the acquired information is information for which it is preferable to display the latest information, such as time information, then the information will always be updated even if the above rules (1) to (5) apply (i.e., whether or not it is subject to the user's action, whether or not the surrounding environment is inappropriate for updating information while the vehicle is moving, or regardless of the level of automation described above).On the other hand, if the SNS posted information falls under the above rules (1) to (5) (i.e., if it is subject to the user's action, or if the surrounding environment is inappropriate for updating information while the vehicle is moving), then the information will not be updated according to the level of automation described above.
[0050] (III) Operation example of the in-vehicle device according to the embodiment Next, an operation example of the in-vehicle device NV according to the embodiment will be described with reference to the flowchart of Fig. 5. It is assumed that calibration of the gaze detection of the vehicle occupant by the gaze detection camera 227 has been completed. The control unit 211 detects the gaze of the user, stores the gaze movement history in the storage device 212, and stores the operation history in the storage device 212 when the user performs an operation.
[0051] First, the control unit 211 acquires output information (time information, currency exchange information, or SNS posted information) (step S11). Next, the control unit 211 specifies an update portion (time display area 401, currency exchange display area 402, or posted information display area 403) to be updated by the output information acquired in the process of step S11 (step S12). For example, if the acquired output information is time information, the control unit 211 specifies the time display area 401 as the update portion, and if the acquired output information is SNS posted information, the control unit 211 specifies the posted information display area 403 as the update portion.
[0052] Next, the control unit 211 judges whether the output information acquired in the process of step S11 is information that does not require the suspension of update (step S13). In this embodiment, for convenience of explanation, it is assumed that the time information is output information that does not require the suspension of update, while it is assumed that the exchange information and the SNS posting information are not output information that does not require the suspension of update (i.e., output information that requires the suspension of update). If the control unit 211 judges that the acquired output information is information (time information) that does not require the suspension of update (step S13: YES), the control unit 211 updates the information of the update part (time display area 401) identified in the process of step S12 by the acquired output information (time information) (step S24), and proceeds to the process of step S11. On the other hand, if the control unit 211 judges that the acquired output information is not information that does not require the suspension of update (i.e., if it is determined that it is exchange information or SNS posting information) (step S13: NO), then it acquires the user's current gaze information and operation information (step S14).
[0053] Next, the control unit 211 acquires user information indicating a user of the in-vehicle device NV based on an image from the line-of-sight detection camera 227, information from a seat sensor (not shown), etc. (Step S15). The user information in this case includes, for example, information on whether the driver is sitting in the driver's seat or not, or whether a passenger other than the driver is sitting in the passenger seat or the back seat or not.
[0054] Next, the control unit 211 judges whether the driver's gaze is directed to the update portion identified in the process of step S12 based on the gaze information acquired in the process of step S14 (step S16). At this time, when the control unit 211 judges that the driver's gaze is directed to the update portion (step S16: YES), the control unit 211 refrains from updating the information displayed on the update portion identified in the process of step S12 by the output information acquired in step S11 (step S25) and proceeds to the process of step S11. As a result, even if new output information is acquired for the update portion to which the driver is looking, the information of the update portion is not updated by the output information, so that the driver's understanding of the content of the output information is deepened. On the other hand, when the control unit 211 judges that the driver's gaze is not directed to the update portion (step S16: NO), the control unit 211 then judges whether the driver's operation target is the update portion identified in the process of step S12 based on the operation information acquired in the process of step S14 (step S17). At this time, for example, if the output information acquired in the process of step S11 is SNS posted information and the driver is performing a scroll operation on the posted information display area 403, the result is determined to be "YES."
[0055] When the control unit 211 determines that the driver's operation target is the update portion identified by the processing of step S12 (step S17: YES), it refrains from updating the information displayed in the update portion identified by the processing of step S12 using the output information acquired in step S11 (step S25), and proceeds to the processing of step S11. As a result, even if new output information is acquired for the update portion being operated by the driver, the information in the update portion is not updated by the output information, so that the driver's understanding of the content of the output information is deepened. On the other hand, when the control unit 211 determines that the driver's current operation target is not the update portion identified by the processing of step S12 (step S17: NO), it then acquires the driver's operation history information, line-of-sight movement history information, current position information, and surrounding environment information (step S18). Specifically, the control unit 211 acquires the driver's operation history information and line-of-sight movement history information from the storage device 212, acquires latitude, longitude, and altitude data output by the GPS receiving unit 225 as current position information, and acquires surrounding environment information by analyzing the image of the outside of the vehicle output by the exterior camera 228 and the detection result output by the exterior sensor 229. The surrounding environment information is information indicating whether the current surrounding environment is inappropriate for updating information when the vehicle is moving, and is acquired by the control unit 211 by calculating it based on the captured image output by the exterior camera 228 and the detection result output by the exterior sensor 229, and based on the weather and road conditions outside the vehicle. For example, if it is heavy rain, if the road currently being traveled is congested, or if the road currently being traveled is an extremely narrow road, surrounding environment information indicating that the situation is inappropriate for updating information when the vehicle is moving is acquired. The control unit 211 may transmit the current position of the vehicle via a network to a server device (not shown) that holds information indicating weather, road conditions, etc. for each position, obtain the information corresponding to the current position from the server device, and calculate surrounding environment information based on the information.In addition, the control unit 211 may transmit the current position of the vehicle via a network to a server device that calculates inappropriateness information indicating the degree to which the environment surrounding each position is inappropriate for information updates while the vehicle is moving, and obtain the inappropriateness information from the server device as surrounding environment information.
[0056] Next, the control unit 211 judges whether the automation level in the current driving state of the vehicle is level 4 shown in Table 1 above, that is, whether the vehicle equipped with the on-board device NV is moving in a fully automated driving state (step S19). For the judgment in step S19, for example, automated driving state information output from an automated driving control unit (not shown) can be used. The detection process of this automation level itself can use a method similar to that of the past. In the judgment in step S19, if the automation level in the current driving state of the vehicle is level 4 shown in Table 1 above (step S19: YES), the control unit 211 proceeds to step S24 and updates the necessary update parts.
[0057] On the other hand, if the determination in step S19 indicates that the automation level is a level other than level 4 (step S19: NO), the control unit 211 then determines whether or not the current user of the in-vehicle device NV is the driver based on the user information acquired in step S15 (step S20). If the determination in step S20 indicates that the current user of the in-vehicle device NV is a passenger other than the driver (step S20: NO), the control unit 211 proceeds to step S24 and updates the required update portion. On the other hand, if the determination in step S20 indicates that the current user of the in-vehicle device NV is the driver (step S20: YES), the control unit 211 then determines whether or not the update portion identified in the process of step S12 is an update portion that has been the object of operation or the gaze of the driver within a predetermined time from the present based on the operation history information and gaze movement history information of the driver acquired in the process of step S18 (step S21). For example, the control unit 211 determines whether or not the update portion is an update portion that has been the object of operation or the gaze of the driver within 30 seconds from the present. When the control unit 221 determines that the update part is the part that has been the object of operation or the line of sight within the predetermined time (step S21: YES), the control unit 221 refrains from updating the information displayed in the update part identified by the processing of step S12 using the output information acquired in step S11 (step S25), and proceeds to the processing of step S11. As a result, even if new output information is acquired for the update part on which the driver has been looking or the part that has been the object of operation until the predetermined time ago, the information of the update part is not updated by the output information, so that when the driver looks at the information again to view the information, the same output information as before can be viewed. On the other hand, when the control unit 211 determines that the update part is not the part that has been the object of operation or the line of sight within the predetermined time (step S21: NO), the control unit 211 then determines whether the current position is the near-miss point or its vicinity (for example, within 50 meters from the near-miss point; the same applies below) based on the current position information acquired in the processing of step S18 and the information indicating the near-miss point stored in the storage device 212 (step S22).
[0058] When it is determined in step S22 that the current position is at or near the near-miss point (step S22: YES), the control unit 211 next determines which level of automation the current driving state of the vehicle is at except for level 4 (see step S19) shown in Table 1 above, that is, whether the vehicle in which the on-board device NV is mounted is moving at any level of automation other than the fully automated driving state (step S26). The determination in step S26 can also use, for example, the automated driving state information, as in the determination in step S19. When it is determined in step S26 that the level of automation the current driving state of the vehicle is level 3 shown in Table 1 above (step S26:3), the control unit 211 proceeds to step S23, which will be described later. On the other hand, in the determination of step S26, if the level of automation in the current driving state of the vehicle is level 1 or level 2 shown in Table 1 (step S26: 1, 2), the control unit 211 next determines whether to suspend the update of the information displayed in the update portion identified by the processing of step S12 using the output information acquired in step S11 based on the detailed conditions according to the embodiment (step S27). In the determination of step S27, if the update of the information based on the detailed conditions is to be suspended (step S27: YES), the control unit 211 suspends the update of the information (step S25) and proceeds to the processing of step S11. As a result, in the case where the current position is a near-miss point, the level of automation is low, and the update of the information is suspended based on the detailed conditions, the information in the update portion is not updated by the output information even if new output information is acquired, so the driver can concentrate on driving. On the other hand, when the control unit 211 determines in step S27 that the information update is not to be postponed based on the detailed conditions (that is, the information is to be updated) (step S27: NO), the process proceeds to step S23 described later.
[0059] On the other hand, if it is determined in step S22 that the current location is not at or near a near-miss point (step S22: NO), the control unit 211 determines whether or not the surrounding environment is highly unsuitable for updating information while the vehicle is moving, based on the surrounding environment information acquired in the processing of step S18 (step S23).
[0060] If it is determined in step S23 that the surrounding environment does not have a high degree of this (step S23: NO), the control unit 211 updates the information of the update part (exchange rate display area 402 or posted information display area 403) identified in the processing of step S12 using the output information (exchange rate information or SNS posted information) acquired in the processing of step S11 (step S24), and proceeds to the processing of step S11.
[0061] On the other hand, in the judgment of step S23, if it is judged that the surrounding environment is in a situation where the degree of the situation where the surrounding environment is not appropriate for updating information while the vehicle is moving is high (step S23: YES), the control unit 211 next judges again whether the level of automation in the current driving state of the vehicle is a level other than level 4 (see step S19) shown in the above Table 1, that is, whether the vehicle equipped with the on-board device NV is moving at a level of automation other than the fully automated driving state (step S28). In the judgment of this step S28, similar to the judgment of the above step S19 or the above step S26, for example, the above-mentioned automated driving state information, etc. can be used. In the judgment of step S28, if the level of automation in the current driving state of the vehicle is level 2 or level 3 shown in the above Table 1 (step S28: 2, 3), the control unit 211 proceeds to step S24. On the other hand, in the judgment of step S28, if the level of automation in the current driving state of the vehicle is level 1 shown in Table 1 (step S28:1), the control unit 211 next judges whether to suspend the update of the information displayed in the update portion identified by the processing of step S12 using the output information acquired in step S11 based on the detailed conditions according to the embodiment similar to that of step S27 (step S29). In the judgment of step S29, if the update of the information based on the detailed conditions is to be suspended (step S29: YES), the control unit 211 suspends the update of the information (step S25) and proceeds to the processing of step S11. As a result, in the case where the surrounding environment is of a high degree, the level of automation is low, and the update of the information is to be suspended based on the detailed conditions, even if new output information is acquired, the information in the update portion is not updated by the output information, so that the driver can concentrate on driving. On the other hand, in the judgment of step S29, if the update of the information is not to be suspended based on the detailed conditions (i.e., the information is to be updated) (step S29: NO), the control unit 211 proceeds to step S24.
[0062] The determination in step S28 above is premised on the premise that the control unit 211 can determine the degree based on the captured images output by the exterior camera 228 and the detection results output by the exterior sensor 229. In contrast, in a special case where the control unit 211 cannot determine the degree based on the captured images output by the exterior camera 228 and the detection results output by the exterior sensor 229 due to, for example, an extremely strong rainstorm, it is preferable that the control unit 211 proceeds to step S29 as the determination in step S28 above for all automation levels other than level 4, that is, does not perform (skips) the determination in step S28 itself.
[0063] Next, the decision to postpone based on the detailed conditions of the embodiment in the above steps S27 and S29 will be specifically described with reference to Fig. 6. Note that the decision to postpone based on the detailed conditions of the embodiment in the above step S27 and the decision to postpone based on the detailed conditions in the above step S29 are the same, so they will be collectively described with reference to Fig. 6.
[0064] 6, when the determination in step S26 is "1,2" (step S27) or when the determination in step S28 is "1" (step S29), the control unit 211 first acquires the road information and parking lot information from the storage device 212 (step SA), and then detects the current position of the vehicle in which the on-board device NV is mounted based on the current position information from the GPS receiving unit 225 (step SB). Next, the control unit 211 determines whether or not the vehicle is currently located outside the road based on the current position detected in step SB (step SC).
[0065] Here, the above-mentioned "off the road" in the embodiment refers to a location or area where the vehicle equipped with the on-board device NV2 in the second embodiment or the on-board device in the third embodiment is permitted to park or stop under the Road Traffic Act (Act No. 105 of June 25, 1960). More specifically, the above-mentioned "off the road" refers to the following locations or areas, for example. "Side strips" as defined by the Road Traffic Act, excluding "no parking / stopping side strips" and "pedestrian-only side strips" as defined by the Road Traffic Act - When a sidewalk is provided separately along a roadway, the area of the roadway that is outside the outer side line of the roadway as seen from the center line of the roadway So-called parking lots or parking spaces (e.g. time-limited parking spaces on the road, etc.) If it is determined in step SC that the vehicle is not currently located outside the road (i.e., the vehicle is located inside a road other than the road outside the road) (step SC: NO), the control unit 211 determines "YES" in the determination of step S27 or step S29, and proceeds to step S25 in Figure 5.
[0066] On the other hand, if the determination in step SC indicates that the vehicle is currently off the road (step SC: YES), the control unit 211 then determines whether or not the vehicle is currently stopped based on the vehicle position detected in step SB (step SD). If the determination in step SD indicates that the vehicle is not currently stopped (i.e., the vehicle is moving) (step SD: NO), the control unit 211 determines "YES" in step S27 or step S29, and proceeds to step S25.
[0067] On the other hand, if the determination in step SD is that the vehicle is currently stopped (step SD: YES), the control unit 211 determines "NO" as the determination in step S27 or step S29, and proceeds to step S23 (in the case of step S27) or step S24 (in the case of step S29).
[0068] The above-described examples of operation of the in-vehicle device NV, including the judgment in step S26 and the judgment in step S28, are performed mainly by the control unit 211. For example, if the driver's gaze is not directed toward the part to be updated in the judgment in step S16 above (see step S16: NO in Figure 5), and the driver's operation target is not the part to be updated (see step S17: NO in Figure 5), then if the level of automation in the current driving state of the vehicle is level 4 shown in Table 1 above (see step S19: YES), the vehicle is in a fully autonomous driving state, and therefore the information in the part to be updated is updated (see step S24 in Figure 5).
[0069] Furthermore, for example, if the driver's gaze is not directed toward the update part in the judgment of step S16 above (see step S16 in Figure 5: NO), and furthermore, the driver's operation target is not the update part (see step S17 in Figure 5: NO), if the level of automation in the current driving state of the vehicle is level 3 shown in Table 1 above (step S26 in Figure 5: NO), and there is no congestion on the roads and the weather is fine (step S23 in Figure 5: NO), then even if the current position of the vehicle at the time when the output information for updating is acquired in step S11 above is at or near the near-miss point (see step S22 in Figure 5: YES), it is considered that there is no problem, and therefore the information for the update part will be updated (see step S24 in Figure 5).
[0070] Furthermore, for example, if the driver's gaze is not directed toward the update part in the judgment in step S16 above (see step S16 in Figure 5: NO) and the driver's operation target is not the update part (see step S17 in Figure 5: NO), if the level of automation in the current driving state of the vehicle is level 3 shown in Table 1 above (step S28 in Figure 5: 2, 3), even if there is no congestion on the road but the external sensor 229 detects an amount of rain that may interfere with the driving of the vehicle (see step S23 in Figure 5: YES), it is considered that there is no problem, and the information in the update part will be updated (see step S24 in Figure 5).
[0071] As described above, in the control of updating of output information by the control unit 211 of the in-vehicle device NV according to the embodiment (one example of "output information acquiring means," "status information acquiring means," "control means," "ambient environment information acquiring means," and "detection means"), whether or not to update the output information is controlled based on the control state regarding movement in the vehicle, so that whether or not to update the output information can be controlled in a fine-grained and appropriate manner, allowing the driver to concentrate on driving.
[0072] Furthermore, in controlling whether or not to update the output information by the control unit 211, the above control state is a state of vehicle driving automation with multiple levels preset (see Table 1), and the state information acquired by the control unit 211 indicates the level of automation of the current vehicle driving, so that whether or not to update the output information can be finely and appropriately controlled according to the level of vehicle driving automation, allowing the driver to concentrate on driving.
[0073] Furthermore, the control unit 211 controls whether or not to update the output information based on the vehicle control state and the surrounding environment, so that it is possible to control whether or not to update the output information more finely and appropriately, allowing the driver to concentrate on driving.
[0074] Furthermore, in controlling whether or not to update the output information by the control unit 211, when it is indicated that the driving state of the vehicle is in a fully automated driving state, control is performed so that the output information is updated, whereas when it is indicated that the driving state is an automated state corresponding to automation level 1 (see step S28:1 in Figure 5) and the surrounding environment is not suitable for updating the output information (see step S23: YES in Figure 5), updating of the output information is prohibited. This makes it possible to finely and appropriately control whether or not to update the output information, allowing the driver to concentrate on driving.
[0075] In addition, in controlling whether or not to update the output information by the control unit 211, when the output information is subject to the action of a passenger other than the driver (FIG. 5, step S20: NO), control is performed so that the output information can be updated regardless of the surrounding environment, so that the output information can be appropriately updated when it is subject to the action of a passenger other than the driver.
[0076] In addition, in the control by the control unit 211 of whether or not to update the output information, when the control state of the vehicle is either a fully autonomous driving state corresponding to automation level 4, or an autonomous driving state other than the fully autonomous driving state, and the state information acquired by the control unit 211 is state information indicating either of the driving states, and it is indicated that the driving state of the vehicle is a driving state of the vehicle other than the fully autonomous driving state, the control unit 211 controls to prohibit updating of the output information in the above special case, it is possible to finely and appropriately control whether or not to update the output information, allowing the driver to concentrate on driving.
[0077] In the above embodiment, the processing in step S22 determines whether the current location is a near-miss point, and the processing in step S23 determines whether the surrounding environment is inappropriate for updating information when the vehicle is moving. However, even if the current location is a near-miss point, it is considered that the surrounding environment is inappropriate for updating information when the vehicle is moving. Therefore, in the present invention, "the surrounding environment is inappropriate for updating information when moving" also includes the case where the current location is a near-miss point.
[0078] (IV) Variations Next, modified examples of the above embodiment will be described. Note that the modified examples described below can be combined as appropriate.
[0079] (IV.1) First Modification In the above embodiment, the display 214c is exemplified as a device for outputting information, but in addition to this, other output devices (for example, HUD (Head-Up Display), see FIG. 4) may be provided and updates of information output from a plurality of output devices may be controlled. In this case, the control unit 211 is capable of identifying the configuration of the screens displayed on the display 214c and the HUD.
[0080] (IV.2) Second Modification In the above embodiment, the gaze of the user (driver, passenger) is detected based on the captured image output by the gaze detection camera 227, but the gaze of the user may also be detected based on data output by an electrooculography sensor.
[0081] (IV.3) Third Modification In the above embodiment, in the process of step S22, it is determined whether the current position is a near-miss point, but it may be determined whether the current position is approaching a near-miss point. As a result, if the current position is approaching a near-miss point or is a near-miss point, the update is postponed, and the user (driver) can concentrate on driving.
[0082] (IV.4) Fourth Variation In the above embodiment, after the updating is suspended in the processing of step S25, the process proceeds to step S11 to obtain the next output information, so that the output information obtained in the most recent processing of step S11 is discarded without being updated with the output information obtained in the processing of step S11. However, in order to ensure that the updating is performed with the output information obtained in the processing of step S11, the output information obtained in the processing of step S11 is stored in the storage device 212, and when the processing of step S24 is executed, the stored output information may be used for updating in order from the oldest output information (FIFO (First In First Out)).
[0083] (IV.5) Fifth Variation In the above embodiment, the information processing device is an in-vehicle device NV mounted on a vehicle, but the present invention can be applied to any device that moves with a moving object and outputs information, such as a personal computer (PC), a notebook PC, a smartphone, a tablet, etc.
[0084] (IV.6) Sixth Variation In the flowchart of FIG. 5 according to the above embodiment, steps S16 and S17, steps S18 to S23, and steps S26 to S29 may be interchanged while maintaining the order within each processing (step) group. [Explanation of symbols]
[0085] 1. Information processing device 111A Output information acquisition means 111B Status information acquisition means 111C Control means 111D Means for acquiring surrounding environment information 111E Detection means 2. Output Method 211 Control Unit 211a CPU 211b ROM 211c RAM 212 Storage device 213 Input Device 214 Display unit 214a Graphics Controller 214b Buffer memory 214c Display 215 Bus Line 220 Input / Output Interface Section 221 Vehicle speed sensor 222 Angular Rate Sensor 223 Acceleration Sensor 224 Steering Angle Sensor 225 GPS receiver 226 Data transmission and reception unit 227 Eye-gaze detection camera 228 Exterior Camera 229 External Sensor NV in-vehicle equipment
Claims
[Claim 1] an output information acquiring means for acquiring updatable output information that is output to an output means provided in the moving object; a state information acquiring means for acquiring state information indicating a control state regarding the movement of the moving object; a control means for controlling whether or not the output information is to be updated based on the acquired state information; An information processing device comprising:
Citation Information
Patent Citations
Service presentation device for vehicle
JP2008241309A
Information display system
JP2014091440A
Vehicle notification control device, and vehicle notification control system
JP2015193365A
On-vehicle information display control device
JP2015217798A
Information distribution system
JP2007272616A
