Information Processing Systems

Abstract

To provide a technique which can perform appropriate handling when a user (a passenger) has failed to see or hear a suggestion related to use of a function provided by a vehicle.SOLUTION: A server 20 according to an embodiment of the present disclosure comprises a propose history storage unit 202 that, in a vehicle 10 having a function suggesting device 13 which suggests use of a function provided by the vehicle 10 to a passenger in accordance with at least one of a state of the vehicle 10 and a surrounding environment of the vehicle 10, stores specifics of a function in question when a suggestion related to use of the function was made, together with at least one of information related to the state of the vehicle 10 and information related to the surrounding environment of the vehicle 10 at the time.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] This disclosure relates to information processing system Regarding. [Background technology]

[0002] For example, a method is known in which a user is suggested to use a function of a vehicle depending on the state of the vehicle and the environment around the vehicle (see Patent Document 1).

[0003] Patent Document 1 discloses a method of suggesting wiper intermittent times to a vehicle occupant (driver) through a speaker, a display, or the like, depending on the vehicle speed and the visibility around the vehicle. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2018-39281 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, there is a possibility that the vehicle occupant may miss or miss some or all of the suggestions, which may lead to confusion or discomfort for the user, for example, as they may not be able to ascertain what function was suggested and under what circumstances.

[0006] In view of the above-mentioned problems, the object is to provide a technology that can deal more appropriately with situations in which a user (passenger) misses or fails to hear a suggestion regarding the use of a vehicle's functions. [Means for solving the problem]

[0007] In order to achieve the above object, in one embodiment of the present disclosure, a storage unit configured to store information on a combination of the content of a function of a vehicle that is proposed to a passenger in accordance with at least one of a vehicle state and a surrounding environment of the vehicle, and information on the state of the vehicle at that time and information on the surrounding environment of the vehicle; a notification unit that notifies a user of the vehicle of information about the combination, The function can be used without being suggested for use by the suggesting device. the law of nature, The notification unit, in response to a request from a user, notifies the user of a history of information on the combinations stored in the storage unit that correspond to proposals regarding the use of the functions made before the request. Ru, An information processing system is provided. [Effects of the Invention]

[0008] According to the above-described embodiment, it is possible to deal more appropriately with the case where a user (passenger) misses or fails to hear a suggestion regarding the use of a function of the vehicle. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 illustrates an example of a configuration of a function proposal system. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, an embodiment will be described with reference to the drawings.

[0011] [Overview of the feature suggestion system] An overview of a function proposal system 1 according to this embodiment will be described with reference to FIG.

[0012] FIG. 1 is a block diagram showing an example of the configuration of a function proposal system 1. As shown in FIG.

[0013] As shown in FIG. 1, the function proposal system 1 includes a vehicle 10, a server 20, and a terminal device 30.

[0014] The function suggestion system 1 suggests to the user (passenger) of the vehicle 10 to use various functions of the vehicle 10 depending on the state of the vehicle 10, the environment around the vehicle 10, and the like.

[0015] The functions of the vehicle 10 are functions that are activated in response to requests (predetermined inputs) from the user of the vehicle 10 (passengers including the driver). The functions of the vehicle 10 include, for example, various driving modes. The various driving modes include, for example, a sport mode, an eco mode, and a snow mode. The sport mode is a driving mode that achieves sporty driving by setting the dynamic performance of the vehicle 10, such as response to accelerator operation, acceleration performance, response to braking operation, braking performance, response to steering, and turning performance, relatively high. The eco mode is a driving mode that reduces energy consumption by slowing down the response to accelerator operation, braking operation, steering, etc. The snow mode is a driving mode that prevents brake lock, skidding, etc. of the vehicle 10 on snowy roads, for example. The functions of the vehicle 10 also include, for example, a brake hold function. The brake hold function is a function that can maintain the vehicle 10 in a stopped state without maintaining the brake operation when the vehicle 10 is stopped. The functions of the vehicle 10 also include, for example, adaptive cruise control (ACC). ACC is a function that maintains a constant distance from a preceding vehicle ahead of the vehicle 10 and follows the preceding vehicle, regardless of accelerator operation by the driver. The functions of the vehicle 10 also include, for example, a lane departure prevention function. The lane departure prevention function includes, for example, a lane departure warning (LDW) that outputs an alarm when the vehicle 10 deviates from its lane, and a lane keeping assist system (LKAS) that prevents the vehicle 10 from deviating from its lane and assists the vehicle 10 in staying in its lane.

[0016] The vehicle 10 runs by driving drive wheels with the power of a prime mover such as an engine (internal combustion engine) or a motor (electric motor). The vehicle 10 may run under the driving operation of a user (passenger), or may run autonomously without the operation of a user.

[0017] Furthermore, the vehicle 10 suggests to the user (passenger) to use the functions of the vehicle 10 depending on the state of the vehicle 10 and the environment around the vehicle 10.

[0018] Furthermore, the vehicle 10 is communicatively connected to the server 20 via a predetermined communication line, and transmits various information (data) related to the vehicle 10 to the server 20. For example, the vehicle 10 transmits to the server 20 information related to the history of proposals of functions possessed by the vehicle 10 to the user (passenger) of the vehicle 10 (hereinafter referred to as "function proposal history information").

[0019] The predetermined communication line includes, for example, a wide area network (WAN). The wide area network includes, for example, a mobile communication network with a base station as a terminal, a satellite communication network, etc. The predetermined communication line includes a satellite communication network, the Internet, etc. Furthermore, the predetermined communication line includes, for example, a local area network (LAN). Furthermore, the predetermined communication line includes, for example, a short-distance communication line based on a predetermined communication standard such as Bluetooth (registered trademark) or WiFi. The same may be said for the communication line connecting the server 20 and the terminal device 30 below.

[0020] The function proposal system 1 may include one or more vehicles 10.

[0021] The server 20 (an example of an information processing device) is communicably connected to the vehicle 10, and acquires (collects) various pieces of information related to the vehicle 10 from the vehicle 10.

[0022] The server 20 is also communicatively connected to the terminal device 30 via a predetermined communication line, and provides the user with various information related to the vehicle 10 via the terminal device 30. The information provided to the user via the terminal device 30 may be the information itself transmitted from the vehicle 10 to the server 20, or may be information that has been processed or edited by the server 20.

[0023] The terminal device 30 is used by the user of the vehicle 10. As described above, the terminal device 30 is communicably connected to the server 20 via a predetermined communication line, and provides the user with various information about the vehicle 10 that is transmitted (downloaded) from the server 20. The terminal device 30 may provide the user with information visually, for example, via a liquid crystal display or an organic EL (Electroluminescence) display, or may provide the user with information audibly via a speaker or the like.

[0024] [Configuration of the function proposal system] Next, the configuration of the function proposal system 1 will be described with reference to FIG.

[0025] As shown in FIG. 1, a vehicle 10 includes an information acquisition device 11, a communication device 12, and a function proposal device 13.

[0026] The information acquisition device 11 acquires information about the state of the vehicle 10 (hereinafter referred to as "vehicle state information") and information about the environment around the vehicle 10 (hereinafter referred to as "vehicle surrounding environment information").

[0027] The information acquisition device 11 includes, for example, various sensors (hereinafter referred to as "vehicle state sensors" for convenience) that acquire measurement information (measurement data) and detection information (detection data) related to the state of the vehicle 10. The various vehicle state sensors include, for example, a wheel speed sensor that measures the rotational speed of the wheels of the vehicle 10, an acceleration sensor that measures the acceleration of the vehicle 10, a gyro sensor (angular velocity sensor) that measures the angular velocity of the vehicle 10, etc. The various vehicle state sensors also include a GNSS (Global Navigation Satellite System) sensor that measures the position of the vehicle 10, etc.

[0028] The information acquisition device 11 also includes, for example, various ECUs (Electronic Control Units) that acquire (generate) control information (control data) related to the state of the vehicle 10. The various ECUs include, for example, an ECU that controls an engine or a motor serving as a prime mover of the vehicle 10, an ECU that controls a braking device of the vehicle 10, an ECU that controls a steering device of the vehicle 10, and the like.

[0029] The information acquisition device 11 also includes various sensors (hereinafter, for convenience, referred to as "surrounding environment sensors") that acquire, for example, measurement information (measurement data) and detection information (detection data) related to the environment around the vehicle 10. The various surrounding environment sensors include, for example, an outside air temperature sensor that measures the temperature around the vehicle 10, a raindrop sensor that detects raindrops on the road where the vehicle 10 is traveling, and an illuminance sensor that measures the illuminance on the road where the vehicle 10 is traveling. The various surrounding environment sensors also include, for example, a camera (image sensor) that detects objects around the vehicle 10. The various surrounding environment sensors also include, for example, a distance sensor that measures the distance to objects around the vehicle 10, such as a LIDAR (Light Detecting and Ranging) or a millimeter-wave radar.

[0030] The information acquisition device 11 also includes, for example, a communication device described below. In this case, the communication device 12 acquires external information (external data) related to the environment around the vehicle 10 through a predetermined communication line. The external information includes, for example, information related to the weather around the vehicle 10, information related to traffic congestion on roads around the vehicle 10, etc.

[0031] The information acquisition device 11 includes, as functional units, an information acquisition unit 111 and an information transmission unit 112. The functions of the information acquisition device 11 may be realized by any hardware or any combination of hardware and software.

[0032] The information acquisition unit 111 acquires vehicle state information and vehicle surrounding environment information at predetermined intervals from when the vehicle 10 is started (for example, when the ignition is turned on) to when the vehicle 10 is stopped (for example, when the ignition is turned off).

[0033] The information transmitting unit 112 transmits (outputs) the information acquired by the information acquiring unit 111 to the function proposal device 13 via an in-vehicle network such as a one-to-one communication line, a CAN (Controller Area Network), or an in-vehicle Ethernet.

[0034] The communication device 12 communicates with an external device through a predetermined communication line. The communication device 12 is, for example, a DCM (Data Communication Module).

[0035] The function suggestion device 13 (an example of an information processing device) suggests functions of the vehicle 10 to the occupant in accordance with the vehicle state information and vehicle surrounding environment information received from the information acquisition device 11. The function suggestion device 13 is, for example, a navigation device mounted on the vehicle 10, and suggests the use of the functions of the vehicle 10 to the occupant in a visual or auditory manner through a display device mounted on the device itself or a speaker installed in the cabin of the vehicle 10.

[0036] The function proposal device 13 includes, as functional units, an information receiving unit 131, a determining unit 132, a function proposal unit 133, a recording unit 134, a proposal history storage unit 135, and a proposal history transmitting unit 136.

[0037] The functions of the function proposal device 13 may be realized by any hardware or any combination of hardware and software. For example, the function proposal device 13 is mainly configured with a computer including a CPU (Central Processing Unit), a memory device, an auxiliary storage device, an interface device, an input device, a display device, etc. The functions of the information receiving unit 131, the determining unit 132, the function proposal unit 133, the recording unit 134, and the proposal history transmitting unit 136 are realized, for example, by loading a program installed in the auxiliary storage device into the memory device and executing it on the CPU. The functions of the proposal history storage unit 135 are realized, for example, by a storage area defined in the memory device or the auxiliary storage device. The memory device is, for example, a static random access memory (SRAM). The auxiliary storage device is, for example, an electrically erasable programmable read-only memory (EEPROM) or a flash memory. The interface device includes, for example, an external interface for connecting to a recording medium and a communication interface for communicating with other devices inside the vehicle 10. This allows the function proposal device 13 to, for example, load various programs from a recording medium via an external interface, or load various programs from other devices via a communication interface. The display device is, for example, a liquid crystal display or an organic EL (Electroluminescence) display. The input device includes, for example, an operation input device capable of mechanical operation such as a button, a toggle, a lever, or a touch panel. The input device also includes, for example, a voice input device capable of voice input, a gesture input device capable of gesture input, or a biometric input device capable of biometric input using fingerprint authentication, iris authentication, or the like.

[0038] The information receiving unit 131 receives the vehicle state information and the vehicle surrounding environment information transmitted from the information acquiring device 11 (information transmitting unit 112) at predetermined intervals.

[0039] The determination unit 132 determines, for each function of the vehicle 10, whether to suggest to the occupant of the vehicle 10 that the function be used, based on the vehicle state information and the vehicle surrounding environment information received by the information receiving unit 131 at predetermined intervals. The determination period of the determination unit 132 may be the same as or different from the period at which the vehicle state information and the vehicle surrounding environment information are received from the vehicle 10 by the information receiving unit 131. Specifically, for each function of the vehicle 10, conditions related to at least one of the state of the vehicle 10 and the surrounding environment of the vehicle 10 that make the function suitable for use (hereinafter referred to as "suitability for use conditions") are specified. Then, based on the vehicle state information and the vehicle surrounding environment information received by the information receiving unit 131 at predetermined intervals, the determination unit 132 determines, for each function of the vehicle 10, whether the function is inactive and the suitability for use conditions are met.

[0040] For example, in the case of the snow mode, the usage suitability condition is that "snow is falling or there is snow accumulation exceeding a predetermined standard within a predetermined range including the driving location of the vehicle 10." Also, for example, in the case of the brake hold function, the usage suitability condition is that "the number of times the vehicle 10 has repeatedly started and stopped within a predetermined time period exceeds a predetermined standard." Also, for example, in the case of the ACC, the usage suitability condition is that "the vehicle 10 is driving on a specific road section such as an expressway."

[0041] If the function is inactive and the conditions for suitability for use are met, the determination unit 132 determines that the use of the function should be suggested to the passenger of the vehicle 10 .

[0042] The function suggestion unit 133 suggests to the occupants of the vehicle 10 the use of a target function among the functions possessed by the vehicle 10 that the judgment unit 132 has determined to be suggested for use to the occupants of the vehicle 10, through a display device, speaker, etc.

[0043] When the function suggestion unit 133 suggests the use of a function of the vehicle 10, the recording unit 134 records the content of the function together with (links to) at least one of the vehicle state information and the vehicle surrounding environment information at the time the use of the function was suggested in the proposal history storage unit 135. For example, the recording unit 134 records, as function proposal history information, the content of the target function together with the location information of the vehicle 10 at the time the use of the target function was suggested. Furthermore, for example, the recording unit 134 records, as function proposal history information, the content of the target function together with the vehicle state information and the vehicle surrounding environment information related to the use suitability conditions at the time the target function was suggested.

[0044] The proposal history storage unit 135 (an example of a storage unit) stores function proposal history information recorded by the recording unit 134. Specifically, the proposal history storage unit 135 may store the history of record information including the contents of the functions proposed by the function proposal unit 133 and the vehicle state information and vehicle surrounding environment information at the time the functions were proposed, so that the chronological relationship can be confirmed. For example, the function proposal history information (record information) includes a number indicating the acquisition order and information indicating the acquisition time (for example, information indicating the date and time).

[0045] The proposal history transmission unit 136 transmits the function proposal history information stored in the proposal history storage unit 135 to the server 20 via the communication device 12. The proposal history transmission unit 136 may transmit the proposal history information to the server 20 each time the latest proposal history information is recorded in the proposal history storage unit 135, or may collectively transmit the latest proposal history information group to the server 20 at a timing when a certain amount of proposal history information has been accumulated in chronological order. For example, when the vehicle 10 is stopped or started, the proposal history transmission unit 136 collectively transmits the function proposal history information for the most recent trip of the vehicle 10 (i.e., from start to stop of the vehicle 10) to the server 20.

[0046] The proposal history information in the proposal history storage unit 135 may be deleted at a predetermined timing after being transmitted (uploaded) to the server 20 by the proposal history transmission unit 136. This is because the memory resources of the vehicle 10 are very limited.

[0047] The server 20 includes, as functional units, a proposal history receiving unit 201, a proposal history storage unit 202, a request receiving unit 203, and a proposal history transmitting unit 204.

[0048] The functions of the server 20 may be realized by any hardware or any combination of hardware and software. For example, the server 20 is configured mainly by a computer including a CPU, a memory device, an auxiliary storage device, an interface device, an input device, a display device, etc. The functions of the proposal history receiving unit 201, the request receiving unit 203, and the proposal history sending unit 204 are realized, for example, by loading a program installed in the auxiliary storage device into the memory device and running it on the CPU. Furthermore, the proposal history storage unit 202 is realized, for example, by a storage area defined in the memory device or the auxiliary storage device. The memory device may be, for example, SRAM or DRAM (Dynamic Random Access Memory). andom Access The auxiliary storage device may be, for example, a hard disk drive (HDD), a solid state drive (SSD), or a flash memory. The interface device may include, for example, an external interface for connecting to a recording medium and a communication interface for communicating with an external device of the server 20. This allows the server 20 to, for example, import various programs from a recording medium via the external interface or download various programs from an external device via the communication interface. The server 20 may also communicate with the vehicle 10 or the terminal device 30 via the communication interface. The input device may include, for example, an operation input device capable of mechanical operation, such as a keyboard, a mouse, or a touch panel. The input device may also include, for example, a voice input device capable of voice input, a gesture input device capable of gesture input, or a biometric input device capable of biometric input using fingerprint authentication, iris authentication, or the like. The display device may be, for example, a liquid crystal display or an organic electroluminescence (EL) display.

[0049] The proposal history receiving unit 201 receives function proposal history information transmitted from the vehicle 10 .

[0050] The proposal history storage unit 202 (an example of a storage unit) stores function proposal history information received from the vehicle 10 by the proposal history receiving unit 201 in chronological order.

[0051] The request receiving unit 203 receives a request to send function proposal history information transmitted from the terminal device 30 .

[0052] When the request receiving unit 203 receives a request to send function proposal history information, the proposal history sending unit 204 extracts function proposal history information for the period specified in the transmission request from the proposal history storage unit 202 and sends it to the terminal device 30.

[0053] The terminal device 30 includes a request sending unit 301, a proposal history receiving unit 302, and a proposal history notifying unit 303 as functional units.

[0054] The functions of the terminal device 30 may be realized by any hardware or any combination of hardware and software. For example, the functions of the terminal device 30 are mainly configured by a computer including a CPU, a memory device, an auxiliary storage device, an interface device, an input device, a display device, etc. For example, the functions of the request sending unit 301, the proposal history receiving unit 302, and the proposal history notifying unit 303 may be realized by, for example, loading a program installed in the auxiliary storage device into the memory device and executing it on the CPU. Specifically, the functions of the request sending unit 301, the proposal history receiving unit 302, and the proposal history notifying unit 303 may be enabled by launching an application program installed in the auxiliary storage device that allows the user to check function proposal history information after the fact. The memory device may be, for example, an SRAM or a DRAM. The auxiliary storage device may be, for example, an HDD, an SSD, a flash memory, etc. The interface device may include, for example, an external interface for connecting to a recording medium and a communication interface for communicating with an external device of the terminal device 30. As a result, the terminal device 30 can, for example, import various programs from a recording medium via an external interface, or download various programs from an external device via a communication interface. The terminal device 30 can also communicate with the server 20 via the communication interface. The input device includes, for example, an operation input device capable of mechanical operation, such as a keyboard, a mouse, or a touch panel. The input device also includes, for example, a voice input device capable of voice input, a gesture input device capable of gesture input, or a biometric input device capable of biometric input using fingerprint authentication, iris authentication, or the like. The display device is, for example, a liquid crystal display, an organic EL (Electroluminescence) display, or the like.

[0055] In response to a notification request (predetermined input) for function proposal history information from a user received via an input device, the request sending unit 301 sends a transmission request for function proposal history information to the server 20. The transmission request includes information indicating the period of the target function proposal history information, which is specified in the notification request (predetermined input) for function proposal history information from the user.

[0056] The proposal history receiving unit 302 receives function proposal history information transmitted from the server 20 (proposal history transmitting unit 204).

[0057] The proposal history notification unit 303 notifies the user of the function proposal history information received by the proposal history receiving unit 302. Specifically, the proposal history notification unit 303 notifies the user visually or audibly via a display device, speaker, etc., of the history of combinations of the contents of functions proposed during a period specified in a notification request from the user with the vehicle state information and vehicle surrounding environment information at the time of proposal. This allows the user to confirm after the fact what functions were proposed and under what circumstances.

[0058] For example, if the function proposal history information includes location information of the vehicle 10 as vehicle state information, the proposal history notification unit 303 draws, superimposed on the map image of the display device, the location at which the function of the vehicle 10 corresponding to the function proposal history information was proposed. Alternatively, for example, the proposal history notification unit 303 may display, superimposed on the map image of the display device, the travel path of the vehicle 10, and then draw, superimposed on the travel path, the location at which the function of the vehicle 10 was proposed and the content of the function. Information about the travel path of the vehicle 10 is transmitted from the server 20 to the terminal device 30 together with the function proposal history information. This allows the user to confirm after the fact what function was proposed at what location.

[0059] The travel trajectory of the vehicle 10 is generated based on a history of location information of the vehicle 10 while traveling, which is uploaded from the vehicle 10 to the server 20. The function proposal history information may be transmitted directly to the terminal device 30 without going through the server 20. The function proposal history information may be notified to the user by the vehicle 10 instead of or in addition to the terminal device 30. For example, the function proposal device 13 may display the function proposal history information on a display device in response to a request from a user (a passenger of the vehicle 10) received through an input device of the function proposal device 13.

[0060] [Effect] Next, the functions of the function proposal system 1 (vehicle 10 and server 20) of this embodiment will be described.

[0061] In this embodiment, the vehicle 10 (function proposal device 13) includes a proposal history storage unit 135. Similarly, the server 20 includes a proposal history storage unit 202. Specifically, in the vehicle 10 having the function proposal device 13 that proposes to the occupant the use of a function of the vehicle 10 in accordance with at least one of the state of the vehicle 10 and the environment around the vehicle 10, the proposal history storage unit 135 and the proposal history storage unit 202 store the content of the target function when a proposal regarding the use of the function is made, together with at least one of vehicle state information and vehicle surrounding environment information at that time.

[0062] As a result, the function proposal system 1 can notify the user of the combination of the content of the proposed function stored in the vehicle 10 and the server 20 with the vehicle state information and vehicle surrounding environment information at that time. Therefore, for example, if the user misses or fails to hear a proposal to use a function in the vehicle 10, the function proposal system 1 can allow the user to confirm after the fact what function was proposed and under what circumstances. Therefore, the function proposal system 1 can reduce the doubts and discomfort that the user may feel due to, for example, missing or failing to hear a proposal to use a function, thereby improving user convenience.

[0063] Although the embodiments have been described in detail above, the present disclosure is not limited to such specific embodiments, and various modifications and improvements are possible within the scope of the gist described in the claims. [Explanation of symbols]

[0064] 1. Feature suggestion system 10 vehicles 11 Information acquisition device 12. Communications equipment 13 Function proposal device (information processing device) 20 Server (information processing device) 30 Terminal Equipment 111 Information Acquisition Department 112 Information Transmission Unit 131 Information Receiving Unit 132 Judgment section 133 Function Proposal Department 134 Recording Section 135 Proposal history memory unit (memory unit) 136 Proposal history transmission unit 201 Proposal History Receiving Unit 202 Proposal history memory unit (memory unit) 203 Request Receiver 204 Proposal History Transmission Unit 301 Request Sender 302 Proposal History Receiving Unit 303 Proposal History Notification Department

Claims

[Claim 1] a storage unit configured to store information on a combination of the content of a function of a vehicle that is proposed to a passenger in accordance with at least one of a vehicle state and a surrounding environment of the vehicle, and information on the state of the vehicle at that time and information on the surrounding environment of the vehicle; a notification unit that notifies a user of the vehicle of information about the combination, the function can be used without being suggested for use by the suggestion device, the notification unit, in response to a request from the user, notifies the user of a history of information on the combinations stored in the storage unit that correspond to proposals regarding the use of the functions made before the request; Information processing system.

Images