Information processing apparatus

Abstract

The present application provides an information processing device, which includes: an information acquisition unit that acquires user information related to a user and vehicle information related to a vehicle used by the user; a question output unit that outputs a question to the user; a reception unit that receives an answer to the question from the user; an estimation unit that estimates a psychological state of the user based on the answer; a generation unit that generates a message for the user based on the user information, the vehicle information, and the psychological state of the user; and a message output unit that outputs the message to the user.

Description

Technical Field

[0001] This invention relates to the technical field of an information processing device. Background Technology

[0002] As such a device, there is a known apparatus for generating and outputting user-oriented messages. For example, Patent Document 1 discloses a technique that displays prescribed question items on a monitor and outputs predicted results based on the user's answers to the prescribed question items.

[0003] Patent Document 1: Japanese Patent Application Publication No. 2003-047763 Summary of the Invention

[0004] Artificial intelligence (AI) chatbots learn from users' past statements and behaviors to achieve personalization. However, even after learning, AI chatbots struggle to produce responses that match the user's current state (e.g., mental state).

[0005] The present invention was made in view of the above-mentioned problems, and its objective is to provide an information processing apparatus capable of outputting appropriate messages according to the user's state.

[0006] An information processing apparatus according to one aspect of the present invention comprises: an information acquisition unit that acquires user information related to a user and vehicle information related to a vehicle used by the user; a question output unit that outputs a question to the user; a receiving unit that receives an answer from the user to the question; an estimation unit that estimates the user's psychological state based on the answer; a generation unit that generates a message for the user based on the user information, the vehicle information, and the user's psychological state; and a message output unit that outputs the message to the user. Attached Figure Description

[0007] Figure 1 This is a block diagram illustrating the hardware structure of the information processing device involved in the implementation method.

[0008] Figure 2 This is a block diagram illustrating the functional structure of the information processing apparatus involved in the implementation method.

[0009] Figure 3 It is a flowchart illustrating the operation of the information processing apparatus involved in the implementation method. Detailed Implementation

[0010] Hereinafter, embodiments of the information processing device will be described with reference to the accompanying drawings. The device will be described as an information processing apparatus mounted on a vehicle.

[0011] (Hardware structure)

[0012] First, refer to Figure 1 The hardware structure of the information processing device involved in the implementation method will be described. Figure 1 This is a block diagram illustrating the hardware structure of the information processing device involved in the implementation method.

[0013] exist Figure 1 In this embodiment, the information processing apparatus 10 is configured to include a computing unit 110, a storage unit 120, a communication unit 130, an input unit 140, and an output unit 150. The computing unit 110, storage unit 120, communication unit 130, input unit 140, and output unit 150 are interconnected via a data bus. All the devices included in the information processing apparatus 10 can be mounted in a vehicle. Alternatively, some of the devices included in the information processing apparatus 10 can be mounted in a vehicle, while the remaining devices can be located outside the vehicle.

[0014] The arithmetic processing unit 110 is configured to perform various arithmetic operations in the information processing unit 10. The arithmetic processing unit 110 may have a processor. The arithmetic processing unit 110 may have a single processor or multiple processors. That is, the arithmetic processing unit 110 may have more than one processor. Furthermore, the processor may be a multi-core processor. In the case where the arithmetic processing unit 110 has a single processor that functions as a multi-core processor, it can be said that the arithmetic processing unit 110 logically has multiple processors.

[0015] The processor included in the computing device 110 may be at least one of a central processing unit (CPU), a graphics processing unit (GPU), a field-programmable gate array (FPGA), and a tensor processing unit (TPU).

[0016] Storage device 120 may be at least one of random access memory (RAM), read-only memory (ROM), hard disk drive, magneto-optical disk drive, solid-state drive (SSD), and optical disk array. That is, storage device 120 may be implemented by a single device or by multiple devices.

[0017] Storage device 120 is capable of storing desired data. The computer program CP executed by arithmetic unit 110 can be stored in storage device 120. When arithmetic unit 110 executes computer program CP, storage device 120 can temporarily store data temporarily used by arithmetic unit 110.

[0018] Furthermore, the computer program CP can be recorded on a computer-readable and non-transitory recording medium. In this case, the computer program CP can be stored in the storage device 120 by reading the recording medium using a recording medium reading device (not shown) included in the information processing device 10. Additionally, at least one of optical discs, magnetic media, magneto-optical discs, semiconductor memory, and any medium capable of storing other programs can be used as the recording medium. The computer program CP can also be obtained from an external (not shown) device outside the information processing device 10 via the communication device 130. In other words, the computer program CP can be downloaded from an external device to the storage device 120 of the information processing device 10.

[0019] The arithmetic unit 110 (e.g., a processor) can perform the processing to be performed by the information processing unit 10 together with the storage device 120 storing the computer program CP (in other words, together with the storage device 120 and the computer program CP stored in the storage device 120). For example, the arithmetic unit 110 can implement logical function blocks for performing the processing to be performed by the information processing unit 10 within the arithmetic unit 110 (e.g., within the processor) by executing the computer program CP.

[0020] The communication device 130 is configured to communicate with external devices of the information processing device 10. Furthermore, the communication device 130 can perform both wired and wireless communication.

[0021] Input device 140 is a device capable of accepting information input from an external source to information processing device 10. Input device 140 may include user-operable devices (e.g., keyboard, mouse, touch panel, etc.) of information processing device 10. Input device 140 may include, for example, a recording medium reading device capable of reading information recorded on a recording medium removable from information processing device 10, such as a Universal Serial Bus (USB) memory. Furthermore, when information is input to information processing device 10 via communication device 130 (in other words, when information processing device 10 obtains information via communication device 130), communication device 130 may function as an input device.

[0022] Output device 150 is a device capable of outputting information to an external device of information processing device 10. Output device 150 may include a display device capable of outputting visual information such as characters and images as the aforementioned information. Additionally, output device 150 may include a speaker capable of outputting auditory information such as sound as the aforementioned information. Output device 150 may be configured to output the aforementioned information to other devices (e.g., control information of other devices). Output device 150 may, for example, output information to a recording medium removable from information processing device 10, such as a USB flash drive. Furthermore, when information processing device 10 outputs information via communication device 130, communication device 130 may function as an output device.

[0023] <Functional Structure>

[0024] Next, refer to Figure 2 The functional structure of the information processing device 10 involved in the implementation method will be explained. Figure 2 This is a block diagram illustrating the functional structure of the information processing apparatus involved in the implementation method.

[0025] exist Figure 2 In this embodiment, the information processing device 10 is configured to output messages to users utilizing the vehicle. The information processing device 10 includes an information acquisition unit 210, a question output unit 220, a response receiving unit 230, a psychological state estimation unit 240, a prediction information acquisition unit 250, a troublesome event information acquisition unit 260, a message generation unit 270, a message output unit 280, a route generation unit 290, a route recommendation unit 300, a time change unit 310, and a attention information prompting unit 320 as constituent elements for realizing its functions. Furthermore, the information acquisition unit 210, question output unit 220, response receiving unit 230, psychological state estimation unit 240, prediction information acquisition unit 250, troublesome event information acquisition unit 260, message generation unit 270, message output unit 280, route generation unit 290, route recommendation unit 300, time change unit 310, and attention information prompting unit 320 can each be a processing block implemented by the aforementioned computing device 110.

[0026] The information acquisition unit 210 is configured to acquire user information and vehicle information. User information is information related to the user, such as personal information (e.g., name, date of birth) or attribute information (e.g., age, gender, family structure). The information acquisition unit 210 can acquire user information, for example, through user input. Alternatively, the information acquisition unit 210 can acquire user information from a terminal held by the user. Vehicle information is information related to the vehicle used by the user, such as information indicating the vehicle's status (e.g., speed) or information indicating the vehicle's driving history (e.g., frequently visited locations or frequently traveled routes). The information acquisition unit 210 can acquire vehicle information, for example, from various sensors or storage devices mounted on the vehicle.

[0027] The question output unit 220 is configured to output a question to the user. The question output unit 220 can output a question (specifically, a question message) to the user, for example, using a monitor or speaker mounted in a vehicle. The content of the question output by the question output unit 220 only needs to extract information that can be used to infer the user's psychological state. The question output unit 220 can output a greeting to the user (e.g., "Good morning. How are you feeling today?"). Alternatively, the question output unit 220 can output a question inquiring about the current mood (e.g., "If you were to represent your mood today with a color, what color would it be?"). Furthermore, the question output by the question output unit 220 can be a pre-prepared fixed message or a message appropriately generated through a machine learning model, etc.

[0028] The response receiving unit 230 is configured to receive answers from the user to questions output by the question output unit 220. The response receiving unit 230 can receive answers based on user input. Alternatively, the response receiving unit 230 can receive answers by recognizing the user's voice.

[0029] The psychological state estimation unit 240 is configured to estimate the user's current psychological state based on the response received by the response receiving unit 230. The method for estimating the psychological state is not particularly limited, but the psychological state estimation unit 240 can, for example, estimate the user's psychological state through sentiment analysis based on Bidirectional Encoder Representations from Transformers (BERT). Furthermore, the psychological state estimation unit 240 can also use information other than the answer to the question to estimate the user's psychological state. For example, the psychological state estimation unit 240 can acquire information related to the user's facial expression or body temperature, and estimate the user's psychological state based on the answer to the question, the user's facial expression, and body temperature.

[0030] The prediction information acquisition unit 250 is configured to acquire prediction information from external sources. The prediction information acquisition unit 250 can use the Internet to acquire prediction information. For example, prediction information can be acquired by sending user information obtained by the information acquisition unit 210, and obtaining prediction results based on the sent user information (e.g., information related to today's lucky items) as prediction information.

[0031] The trouble information acquisition unit 260 is configured to acquire trouble information from a user. The trouble information acquisition unit 260 can acquire trouble information by outputting a predetermined message to the user. For example, the trouble information acquisition unit 260 can output a message such as "Don't you have any troubles lately?" to the user and acquire the user's response to that message as trouble information.

[0032] The message generation unit 270 is configured to generate messages based on prediction information acquired by the prediction information acquisition unit 250 or on trouble information acquired by the trouble information acquisition unit 260. The message generation unit 270 can generate messages based on prediction information or trouble information after the user selects to make a prediction or seek trouble information consultation. Furthermore, the message generation unit 270 in this embodiment generates messages specifically based on user information and vehicle information acquired by the information acquisition unit 210 and the user's psychological state estimated by the psychological state estimation unit 240. For example, when generating a message based on prediction information, the message generation unit 270 can customize a portion of the information included in the prediction information based on the user information, vehicle information, and the user's psychological state. Specifically, the message generation unit 270 can generate a message after changing the lucky item included in the prediction information to an item that the user might be interested in or that matches the user's psychological state. Alternatively, when generating a message based on trouble information, the message generation unit 270 can customize a response to the trouble based on the user information, vehicle information, and the user's psychological state. Specifically, the message generation unit 270 can modify the response content related to the troublesome matter to be more suitable for the user, or change it to output in a tone that matches the user's psychological state. For example, the message generation unit 270 can use large-scale language models (LLM) to generate messages.

[0033] The message output unit 280 is configured to output messages generated by the message generation unit 270 to the user. The message output unit 280 can output messages via the output device 150. For example, the message output unit 280 can output messages using a display or a speaker.

[0034] The route generation unit 290 is configured to generate driving routes recommended to the user. The route generation unit 290 generates the recommended driving routes based on user and vehicle information acquired by the information acquisition unit 210 and the user's psychological state estimated by the psychological state estimation unit 240. For example, if it can be determined that the user is in a low mood, the route generation unit 290 can recommend a drive to the beach that the user has previously visited.

[0035] The route recommendation unit 300 is configured to output a driving route generated by the route generation unit 290 to the user. The route recommendation unit 300 can automatically change the destination of the navigation system installed in the vehicle to a route that matches the recommended driving route, provided the user agrees.

[0036] The timing adjustment unit 310 is configured to change the timing of outputting attention information to the user. This attention information is used to notify the driver of potential hazards; for example, it could be information notifying the presence of pedestrians near the vehicle. The timing adjustment unit 310 adjusts the timing of outputting the attention information based on user and vehicle information acquired by the information acquisition unit 210 and the user's psychological state estimated by the psychological state estimation unit 240. For example, if it can be determined that the user is anxious, the timing adjustment unit 310 can change the timing of outputting the attention information earlier than usual.

[0037] The attention information prompting unit 320 is configured to output attention information to the user. The time change unit 310 outputs attention information at the time changed by the time change unit 310.

[0038] (The flow of the action)

[0039] Next, refer to Figure 3 The operation flow of the information processing device 10 involved in the implementation method will be explained. Figure 3 It is a flowchart illustrating the operation of the information processing apparatus involved in the implementation method.

[0040] like Figure 3 As shown, if the information processing device 10 according to the initial embodiment is operated, the information acquisition unit 210 first acquires user information and vehicle information (step S101). Alternatively, the information acquisition unit 210 may not acquire user information and vehicle information simultaneously. That is, the information acquisition unit 210 can acquire user information and vehicle information sequentially at appropriate times.

[0041] Next, the question output unit 220 outputs a question to the user (step S102). Then, the answer receiving unit 230 receives the answer from the user (step S103). Subsequently, the mental state estimation unit 240 estimates the user's current mental state based on the answer received by the answer receiving unit 230 (step S104).

[0042] Next, the message generation unit 270 determines whether the user wishes to make a prediction (step S105). More specifically, the message generation unit 270 determines whether the user chooses prediction or consultation on troublesome matters. For example, the message generation unit 270 may prompt the user with the options of "prediction" and "consultation on troublesome matters" for the user to choose from.

[0043] If the user selects to make a prediction (step S105: Yes), the prediction information acquisition unit 250 acquires prediction information from an external source (step S106). Furthermore, the message generation unit 270 generates a message containing the prediction information based on the user and vehicle information acquired by the information acquisition unit 210 and the user's psychological state estimated by the psychological state estimation unit 240 (step S107). Then, the message output unit 280 outputs the message generated by the message generation unit 270 to the user (step S110).

[0044] On the other hand, if the user chooses not to make a prediction (in other words, to consult about their troubles) (step S105: No), the trouble information acquisition unit 260 acquires trouble information from the user (step S108). Furthermore, the message generation unit 270 generates a message containing a response to the trouble information based on the user and vehicle information acquired by the information acquisition unit 210 and the user's psychological state estimated by the psychological state estimation unit 240 (step S109). Then, the message output unit 280 outputs the message generated by the message generation unit 270 to the user (step S110).

[0045] Next, the route recommendation unit 300 determines whether to recommend a driving route to the user (step S111). The route recommendation unit 300 may, for example, determine whether to recommend a driving route based on the user's psychological state estimated by the psychological state estimation unit 240. If the route recommendation unit 300 determines that a driving route is recommended (step S111: Yes), the route generation unit 290 generates a driving route to be recommended to the user based on the user information and vehicle information obtained by the information acquisition unit 210 and the user's psychological state estimated by the psychological state estimation unit 240 (step S112). Then, the route prompting unit 300 outputs the driving route generated by the route generation unit 290 to the user (step S113). Conversely, if the route recommendation unit 300 determines that a driving route is not recommended (step S111: No), the above steps S112 and S113 are omitted.

[0046] Next, the attention information prompting unit 320 determines whether to output attention information to the user (step S114). The attention information prompting unit 320 may determine whether to prompt attention information based, for example, on vehicle information acquired by the information acquisition unit 210. If the attention information prompting unit 320 determines that attention information should be prompted (step S114: Yes), the time change unit 310 changes the time for prompting attention information to the user based on the user information and vehicle information acquired by the information acquisition unit 210 and the user's psychological state estimated by the psychological state estimation unit 240 (step S115). Then, the attention information prompting unit 320 outputs attention information to the user at the time changed by the time change unit 310 (step S116). Alternatively, if the attention information prompting unit 320 determines that attention information should not be prompted (step S114: No), the above steps S115 and S116 are omitted.

[0047] (Technical effect)

[0048] Next, the technical effects obtained by the information processing apparatus 10 according to the implementation method will be explained.

[0049] As by Figures 1 to 3 As explained, in the information processing apparatus 10 according to the embodiment, messages to be output to the user are generated based on user information, vehicle information, and the user's psychological state. In this way, appropriate messages can be generated and output according to the user.

[0050] Furthermore, when using machine learning models to generate messages, it's possible to learn by matching the model to the user. However, relying solely on this might not be sufficient to generate messages appropriately for the user. In particular, a user's mental state is constantly changing, making it difficult to output a message that matches the user's current mental state. As described above, in this embodiment, messages are generated based on an estimate of the user's mental state. Therefore, it is possible to generate and output messages that are more closely matched to the current user.

[0051] For example, predictions from television or magazines can only provide predictions applicable to any individual, but the information processing device 10 of this embodiment can provide predictions applicable to the user. Furthermore, if overly negative information is given to a user with an undesirable psychological state, it may adversely affect their subsequent behavior. However, the information processing device 10 of this embodiment can customize the prediction results based on the user's psychological state (e.g., modify overly negative information) to provide the prompt, thus suppressing any adverse effects on the user.

[0052] The aforementioned technical effects are still significant even when the information processing device 10 is applied to the AI ​​companion. For example, it is important for the AI ​​companion to gain the user's trust and to reveal itself. However, many users hesitate to engage in in-depth conversations with the AI ​​companion regarding personal concerns or interests. In such cases, it is believed that if the AI ​​companion outputs appropriate messages that take into account the user's psychological state, the user will be more likely to open up and communicate with the AI ​​companion. As a result, for example, inquiries about the user's worries can be answered in a more user-friendly way.

[0053] Furthermore, in the information processing apparatus 10 according to this embodiment, a driving route is recommended based on user information, vehicle information, and the user's psychological state. In this way, a driving route can be appropriately recommended based on the user's psychological state. Additionally, in the information processing apparatus 10 according to this embodiment, the timing of the attention prompt is changed based on user information, vehicle information, and the user's psychological state. In this way, attention prompts can be given at appropriate times based on the user's psychological state.

[0054] The present invention is not limited to the embodiments described above, and appropriate modifications can be made without departing from the spirit or idea of ​​the invention as read in its entirety from the claims and description. Information processing apparatuses that accompany such modifications are also included within the technical scope of the present invention.

[0055] Symbol Explanation 10-Information processing device, 110-Arithmetic device, 120-Storage device, 130-Communication device, 140-Input device, 150-Output device, 210-Information acquisition unit, 220-Problem output unit, 230-Answer receiving unit, 240-Psychological state estimation unit, 250-Prediction information acquisition unit, 260-Troublesome event information acquisition unit, 270-Message generation unit, 280-Message output unit, 290-Route generation unit, 300-Route recommendation unit, 310-Time change unit, 320-Attention information prompt unit.

Claims

1. An information processing device, characterized in that, have: The information acquisition unit acquires user information related to the user and vehicle information related to the vehicle used by the user. A question output unit, which outputs a question to the user; A receiving unit that receives the user's answer to the question; An inference unit that infers the user's psychological state based on the response; The generation unit generates a message for the user based on the user information, the vehicle information, and the user's psychological state. and The message output unit outputs the message to the user.

2. The information processing device according to claim 1, characterized in that, It also has: The prediction information acquisition unit acquires prediction information related to the user. The generation unit modifies a portion of the prediction information based on the user information, the vehicle information, and the user's psychological state, and generates the message containing the modified prediction information.

3. The information processing device according to claim 1, characterized in that, It also has: The trouble information acquisition unit acquires the trouble information input by the user. The generation unit generates a message containing a response to the troublesome matter based on the user information, the vehicle information, and the user's psychological state.

4. The information processing apparatus according to any one of claims 1 to 3, characterized in that, It also has: A route generation unit generates a driving route for the vehicle used by the user based on the user information, the vehicle information, and the user's psychological state; and The route recommendation unit recommends the driving route to the user.

5. The information processing apparatus according to any one of claims 1 to 3, characterized in that, It also has: The prompting unit provides the user with notices related to the driving of the vehicle; and The time-changing unit changes the time of the attention prompt based on the user information, the vehicle information, and the user's psychological state.

Images