Information processing device

Abstract

Output an appropriate message to the user. [Solution] The information processing device comprises: information acquisition means for acquiring user information about the user and vehicle information about the vehicle the user uses; question output means for outputting questions to the user; reception means for receiving answers from the user to the questions; estimation means for estimating the user's psychological state based on the answers; generation means for generating a message to the user based on the user information, vehicle information, and the user's psychological state; and message output means for outputting the message to the user.

Description

Technical Field

[0006] , , ,

[0001] This disclosure relates to the technical field of information processing apparatuses.

Background Art

[0002] As this type of apparatus, an apparatus that generates and outputs a message to a user is known. For example, Patent Document 1 discloses a technique of projecting a predetermined question item on a monitor and outputting a fortune-telling result based on the answer content to the predetermined question item by the user.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0007] [Figure 1] This is a block diagram showing the hardware configuration of an information processing device according to an embodiment. [Figure 2] This is a block diagram showing the functional configuration of an information processing apparatus according to an embodiment. [Figure 3] This is a flowchart showing the operation flow of the information processing device according to the embodiment. [Modes for carrying out the invention]

[0008] The following describes an embodiment of the information processing device with reference to the drawings. In the following description, the information processing device is assumed to be configured as a device mounted on a vehicle.

[0009] (Hardware configuration) First, the hardware configuration of the information processing device according to the embodiment will be described with reference to Figure 1. Figure 1 is a block diagram showing the hardware configuration of the information processing device according to the embodiment.

[0010] In Figure 1, the information processing device 10 according to the embodiment comprises an arithmetic unit 110, a storage device 120, a communication device 130, an input device 140, and an output device 150. The arithmetic unit 110, the storage device 120, the communication device 130, the input device 140, and the output device 150 are connected to each other via a data bus. All of the devices included in the information processing device 10 described above may be mounted on a vehicle. Alternatively, some of the devices included in the information processing device 10 may be mounted on a vehicle, and the remaining devices may be installed outside the vehicle.

[0011] The arithmetic unit 110 is configured to perform various arithmetic operations in the information processing device 10. The arithmetic unit 110 may have a processor. The arithmetic unit 110 may have a single processor or may have multiple processors. In other words, the arithmetic unit 110 may have one or more processors. The processor may be a multi-core processor. If the arithmetic unit 110 has a single processor that is a multi-core processor, then logically, the arithmetic unit 110 can be said to have multiple processors.

[0012] The processor in the arithmetic unit 110 may be at least one of the following: CPU (Central Processing Unit), GPU (Graphics Processing Unit), FPGA (Field Programmable Gate Array), and TPU (Tensor Processing Unit).

[0013] The storage device 120 may be at least one of the following: RAM (Random Access Memory), ROM (Read Only Memory), hard disk drive, magneto-optical disk drive, SSD (Solid State Drive), and optical disk array. In other words, the storage device 120 may be implemented by a single device or by multiple devices.

[0014] The storage device 120 is capable of storing desired data. The storage device 120 may store the computer program CP that the arithmetic unit 11 executes. The storage device 120 may temporarily store data that the arithmetic unit 110 temporarily uses when the arithmetic unit 110 is executing the computer program CP.

[0015] The computer program CP may be recorded on a non-temporary recording medium that is readable by a computer. In this case, the computer program CP may be stored in the storage device 120 by reading the recording medium using a recording medium reading device (not shown) provided by the information processing device 10. At least one of the following may be used as the recording medium: an optical disc, a magnetic medium, a magneto-optical disc, a semiconductor memory, and any other medium capable of storing a program. The computer program CP may also be obtained from an external device (not shown) of the information processing device 10 via a communication device 130. In other words, the computer program CP may be downloaded from an external device to the storage device 120 of the information processing device 10.

[0016] The arithmetic unit 110 (for example, a processor) may execute the processing that the information processing device 10 should perform together with the memory device 120 in which the computer program CP is stored (in other words, together with the memory device 120 and the computer program CP stored in the memory device 120). For example, by the arithmetic unit 110 executing the computer program CP, a logical functional block for executing the processing that the information processing device 10 should perform may be realized within the arithmetic unit 110 (for example, within the processor).

[0017] The communication device 130 is configured to communicate with devices outside the information processing device 10. The communication device 130 may use wired communication or wireless communication.

[0018] The input device 140 is a device that can receive input of information to the information processing device 10 from the outside. The input device 140 may include an operating device (for example, a keyboard, a mouse, a touch panel, etc.) that can be operated by the user of the information processing device 10. The input device 140 may include a recording medium reader that can read information recorded on a recording medium detachable from the information processing device 10, such as a USB (Universal Serial Bus) memory. When information is input to the information processing device 10 via the communication device 130 (in other words, when the information processing device 10 acquires information via the communication device 130), the communication device 130 may function as an input device.

[0019] The output device 150 is a device that can output information to the outside of the information processing device 10. The output device 150 may have a display device that can output visual information such as characters and images as the above information. The output device 150 may also have a speaker that can output auditory information such as sound as the above information. The output device 150 may be configured to output the above information (for example, control information of other devices, etc.) to other devices. The output device 150 may be able to output information to a recording medium detachable from the information processing device 10, such as a USB memory. When the information processing device 10 outputs information via the communication device 130, the communication device 130 may function as an output device.

[0020] <Functional Configuration> Next, referring to FIG. 2, the functional configuration of the information processing device 10 according to the embodiment will be described. FIG. 2 is a block diagram showing the functional configuration of the information processing device according to the embodiment.

[0021] In Figure 2, the information processing device 10 is configured as a device that outputs messages to users of the vehicle. The information processing device 10 includes, as components for realizing its function, an information acquisition unit 210, a question output unit 220, an answer reception unit 230, a psychological state estimation unit 240, a fortune-telling information acquisition unit 250, a problem information acquisition unit 260, a message generation unit 270, a message output unit 280, a route generation unit 290, a route suggestion unit 300, a timing change unit 310, and a warning information presentation unit 320. Furthermore, each of the information acquisition unit 210, question output unit 220, answer reception unit 230, psychological state estimation unit 240, fortune-telling information acquisition unit 250, trouble information acquisition unit 260, message generation unit 270, message output unit 280, route generation unit 290, route suggestion unit 300, timing change unit 310, and warning information presentation unit 320 may be a processing block implemented by the above-described arithmetic unit 110.

[0022] The information acquisition unit 210 is configured to acquire user information and vehicle information. User information is information about the user, and may include, for example, the user's personal information (e.g., name, date of birth, etc.) or attribute information (e.g., age, gender, family structure, etc.). The information acquisition unit 210 may acquire user information, for example, through user input operations. Alternatively, the information acquisition unit 210 may acquire user information from a terminal or the like owned by the user. Vehicle information is information about the vehicle used by the user, and may include, for example, information indicating the vehicle's status (e.g., speed, etc.) or information indicating the vehicle's driving history (e.g., frequently visited places or frequently used routes). The information acquisition unit 210 may acquire vehicle information, for example, from various sensors or storage devices mounted on the vehicle.

[0023] The question output unit 220 is configured to be able to output questions to the user. The question output unit 220 may output a question (specifically, a question message) to the user by using, for example, a monitor or a speaker mounted on the vehicle. The content of the question output by the question output unit 220 may be anything that can elicit information available for estimating the user's psychological state. The question output unit 220 may output a greeting to the user (for example, a message such as "Good morning. Are you feeling well today?"). Alternatively, the question output unit 220 may output a question asking about the current mood (for example, a message such as "What color would represent your mood today?"). Note that the question output by the question output unit 220 may be a pre-prepared fixed message or a message appropriately generated by a machine learning model or the like.

[0024] The answer reception unit 230 is configured to be able to receive an answer from the user to the question output by the question output unit 220. The answer reception unit 230 may receive an answer based on the user's input operation. Alternatively, the answer reception unit 230 may receive an answer by recognizing the voice uttered by the user.

[0025] The psychological state estimation unit 240 is configured to be able to estimate the user's current psychological state based on the answer received by the answer reception unit 230. The method for estimating the psychological state is not particularly limited, but the psychological state estimation unit 240 may estimate the user's psychological state by, for example, sentiment analysis using BERT (Bidirectional Encoder Representations from Transformers). In addition, the psychological state estimation unit 240 may estimate the user's psychological state using other information in addition to the answer to the question. For example, the psychological state estimation unit 240 may acquire information regarding the user's expression and body temperature and estimate the user's psychological state based on the answer to the question, the user's expression, and the body temperature.

[0026] The fortune-telling information acquisition unit 250 is configured to acquire fortune-telling information from an external source. The fortune-telling information acquisition unit 250 may acquire fortune-telling information using the Internet. For example, fortune-telling information may be acquired by transmitting user information acquired by the information acquisition unit 210, and fortune-telling results based on the transmitted user information (for example, information about today's fortune or lucky items) may be acquired as fortune-telling information.

[0027] The problem information acquisition unit 260 is configured to acquire problem information from the user. The problem information acquisition unit 260 may acquire problem information by outputting a predetermined message to the user. For example, the problem information acquisition unit 260 may output a message such as "Is there anything you've been worried about lately?" to the user and acquire the user's response to that message as problem information.

[0028] The message generation unit 270 is configured to generate messages based on fortune-telling information acquired by the fortune-telling information acquisition unit 250, or messages based on problem information acquired by the problem information acquisition unit 260. The message generation unit 270 may generate a message based on fortune-telling information or a message based on problem information after allowing the user to choose whether to have their fortune told or seek advice on a problem. In addition, the message generation unit 270 according to this embodiment generates messages based on user information and vehicle information acquired by the information acquisition unit 210, and the user's psychological state estimated by the psychological state estimation unit 240. For example, when generating a message based on fortune-telling information, the message generation unit 270 may customize some of the information included in the fortune-telling information based on user information, vehicle information, and the user's psychological state. Specifically, the message generation unit 270 may change the lucky items included in the fortune-telling information to items that the user might be interested in or items that match the user's psychological state, and then generate a message. Alternatively, when the message generation unit 270 generates a message based on the user's concerns, it may customize the response to the concerns based on user information, vehicle information, and the user's psychological state. Specifically, the message generation unit 270 may change the content of the response to the concerns to be more tailored to the user, or change it to be output in a tone that matches the user's psychological state. The message generation unit 270 may generate messages using, for example, a large language model (LLM).

[0029] The message output unit 280 is configured to output messages generated by the message generation unit 270 to the user. The message output unit 280 may output messages via the output device 150. For example, the message output unit 280 may output messages using a display, speaker, or the like.

[0030] The route generation unit 290 is configured to generate a driving route to propose to the user. Based on the user information and vehicle information acquired by the information acquisition unit 210, and the user's psychological state estimated by the psychological state estimation unit 240, the route generation unit 290 generates a driving route to propose to the user. For example, if the route generation unit 290 determines that the user is feeling depressed, it may propose a driving route to the sea that the user has visited in the past.

[0031] The route suggestion unit 300 is configured to output the driving route generated by the route generation unit 290 to the user. If the user agrees to the proposed driving route, the route suggestion unit 300 may automatically change the destination of the navigation system installed in the vehicle to match the proposed driving route.

[0032] The timing change unit 310 is configured to change the timing at which it outputs warning information to the user. This warning information is information intended to alert the user driving the vehicle to danger, such as information indicating the presence of pedestrians around the vehicle. The timing change unit 310 changes the timing at which it outputs the warning information based on the user information and vehicle information acquired by the information acquisition unit 210, as well as the user's psychological state estimated by the psychological state estimation unit 240. For example, if the timing change unit 310 determines that the user is psychologically anxious, it may change the timing at which it outputs the warning information to be earlier than usual.

[0033] The warning information display unit 320 is configured to output warning information to the user. The timing change unit 310 outputs the warning information at the timing changed by the timing change unit 310.

[0034] (Flow of operations) Next, the operation flow of the information processing device 10 according to the embodiment will be described with reference to Figure 3. Figure 3 is a flowchart showing the operation flow of the information processing device according to the embodiment.

[0035] As shown in Figure 3, when the operation of the information processing device 10 according to the embodiment begins, the information acquisition unit 210 first acquires user information and vehicle information (step S101). Note that the information acquisition unit 210 does not need to acquire user information and vehicle information simultaneously. That is, the information acquisition unit 210 only needs to acquire user information and vehicle information sequentially at appropriate timings.

[0036] Next, the question output unit 220 outputs a question to the user (step S102). Then, the answer receiving unit 230 receives the answer from the user (step S103). After that, the psychological state estimation unit 240 estimates the user's current psychological state based on the answer received by the answer receiving unit 230 (step S104).

[0037] Next, the message generation unit 270 determines whether the user wants to have their fortune told (step S105). More specifically, the message generation unit 270 determines whether the user chooses fortune telling or advice on problems. For example, the message generation unit 270 may present the user with the options "fortune telling" and "advice on problems" and allow the user to make a selection.

[0038] If the user chooses to have their fortune told (step S105: YES), the fortune-telling information acquisition unit 250 acquires fortune-telling information from an external source (step S106). Then, the message generation unit 270 generates a message including the fortune-telling information based on the user information and vehicle information acquired by the information acquisition unit 110, and the user's psychological state estimated by the psychological state estimation unit 240 (step S107). After that, the message output unit 280 outputs the message generated by the message generation unit 270 to the user (step S110).

[0039] On the other hand, if the user chooses not to have their fortune told (in other words, to seek advice on their problems) (step S105: NO), the problem information acquisition unit 260 acquires problem information from the user (step S108). Then, the message generation unit 270 generates a message including a response to the problem information based on the user information and vehicle information acquired by the information acquisition unit 110, and the user's psychological state estimated by the psychological state estimation unit 240 (step S109). After that, the message output unit 280 outputs the message generated by the message generation unit 270 to the user (step S110).

[0040] Next, the route suggestion unit 300 determines whether or not to suggest a driving route to the user (step S111). The route suggestion unit 300 may determine whether or not to suggest a driving route based, for example, on the user's psychological state estimated by the psychological state estimation unit 240. If the route suggestion unit 300 determines to suggest a driving route (step S111: YES), the route generation unit 290 generates a driving route to suggest to the user based on the user information and vehicle information acquired by the information acquisition unit 110, as well as the user's psychological state estimated by the psychological state estimation unit 240 (step S112). Then, the route presentation unit 300 outputs the driving route generated by the route generation unit 290 to the user (step S113). If the route suggestion unit 300 determines not to suggest a driving route (step S111: NO), the processes in steps S112 and S113 described above are omitted.

[0041] Next, the warning information presentation unit 320 determines whether or not to output warning information to the user (step S114). The warning information presentation unit 320 may determine whether or not to output warning information based on vehicle information acquired by, for example, the information acquisition unit 210. If the warning information presentation unit 320 determines to output warning information (step S114: YES), the timing change unit 310 changes the timing at which the warning information is output to the user based on the user information and vehicle information acquired by the information acquisition unit 110, and the user's psychological state estimated by the psychological state estimation unit 240 (step S115). Then, the warning information presentation unit 320 outputs the warning information to the user at the timing changed by the timing change unit 310 (step S116). If the warning information presentation unit 320 determines not to output warning information (step S114: NO), the processes in steps S115 and S116 described above are omitted.

[0042] (Technical effects) Next, the technical effects obtained by the information processing device 10 according to this embodiment will be described.

[0043] As explained in Figures 1 to 3, the information processing device 10 according to this embodiment generates a message to be output to the user based on user information, vehicle information, and the user's psychological state. In this way, it becomes possible to generate and output an appropriate message tailored to the user.

[0044] When generating messages using a machine learning model, it is possible to train the model to match the user, but this alone may not be sufficient to generate appropriate messages for the user. In particular, since a user's psychological state changes moment by moment, it is not easy to output a message that matches the user's psychological state at that moment. However, in this embodiment, the message is generated after estimating the user's psychological state. Therefore, it is possible to generate and output a message that is more appropriate for the current user.

[0045] For example, television and magazine horoscopes only provide general predictions that apply to everyone, but the information processing device 10 according to this embodiment can present predictions that are relevant to the user. Furthermore, if overly negative information is given to a user who is in an unfavorable psychological state, it may negatively affect the user's subsequent behavior. However, the information processing device 10 according to this embodiment can customize the prediction results to match the user's psychological state (for example, by changing overly negative information), thereby mitigating negative impacts on the user.

[0046] The technical effects described above are also clearly demonstrated when the information processing device 10 is applied to an AI partner. For example, it is crucial for an AI partner to gain the user's trust and encourage self-disclosure. However, many users hesitate to talk to an AI partner about their personal interests and concerns. In such situations, if the AI ​​partner outputs appropriate messages that take into account the user's psychological state, it is conceivable that the user will open up and communicate more freely with the AI ​​partner. As a result, for example, it becomes possible to provide more empathetic answers to questions and concerns from users.

[0047] Furthermore, in the information processing device 10 according to this embodiment, a driving route is suggested based on user information, vehicle information, and the user's psychological state. In this way, a driving route can be suggested appropriately based on the user's psychological state. Moreover, in the information processing device 10 according to this embodiment, the timing of presenting information is changed based on user information, vehicle information, and the user's psychological state. In this way, information can be presented at an appropriate time based on the user's psychological state.

[0048] This disclosure is not limited to the embodiments described above and can be modified as appropriate without contradicting the gist or idea of ​​the invention as can be inferred from the claims and the specification as a whole. Information processing devices with such modifications are also included within the technical scope of the present invention. [Explanation of Symbols]

[0049] 10...Information processing unit, 110...Calculation unit, 120...Storage device, 130...Communication device, 140...Input device, 150...Output device, 210...Information acquisition unit, 220...Question output unit, 230...Answer reception unit, 240...Psychological state estimation unit, 250...Fortune-telling information acquisition unit, 260...Trouble information acquisition unit, 270...Message generation unit, 280...Message output unit, 290...Route generation unit, 300...Route suggestion unit, 310...Timing change unit, 320...Warning information presentation unit

Claims

1. Information acquisition means for acquiring user information about a user and vehicle information about a vehicle used by the user, A question output means that outputs a question to the user, A means for receiving responses from the user to the aforementioned questions, An estimation means for estimating the user's psychological state based on the aforementioned response, A generation means that generates a message to the user based on the user information, the vehicle information, and the user's psychological state, A message output means for outputting the aforementioned message to the user, An information processing device equipped with the following features.

2. The system further comprises means for obtaining fortune-telling information relating to the user, The generation means modifies a portion of the fortune-telling information based on the user information, the vehicle information, and the user's psychological state, and generates the message including the modified fortune-telling information. The information processing apparatus according to claim 1.

3. The system further includes a means for acquiring problem information that the user inputs, The generation means generates the message, which includes a response to the problem information, based on the user information, the vehicle information, and the user's psychological state. The information processing apparatus according to claim 1.

4. A route generation means that generates a driving route for the vehicle used by the user based on the user information, the vehicle information, and the user's psychological state, Route suggestion means for proposing the aforementioned driving route to the user, An information processing apparatus according to any one of claims 1 to 3, further comprising:

5. A presentation means for presenting cautionary information regarding the operation of the vehicle to the user, A timing change means for changing the timing of presenting the warning information based on the user information, the vehicle information, and the user's psychological state, An information processing apparatus according to any one of claims 1 to 3, further comprising:

Images