Information processing apparatus, information processing method, and information processing system

The information processing device enhances user engagement by modifying character images and messages based on user input, addressing the challenge of low motivation in message sending and promoting cognitive benefits.

JP2025176785APending Publication Date: 2025-12-05JOLLY GOOD INC
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024083098
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-05-22
Publication Date
2025-12-05

AI Technical Summary

Technical Problem

Users of communication devices find it troublesome to operate the device to send messages, leading to a lack of motivation for message sending.

Method used

An information processing device that generates and modifies character images and messages on a communication terminal based on user input, incorporating facial and wording characteristics to enhance user engagement.

Benefits of technology

Motivates users to send messages by increasing enjoyment and affinity with the virtual character, potentially preventing or improving cognitive decline.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025176785000001_ABST
    Figure 2025176785000001_ABST
Patent Text Reader

Abstract

To motivate a user of a communication terminal to send a message.SOLUTION: An information processing apparatus 1 includes: an image generation unit 132 which generates a first character image; a message transmission unit 133 which transmits a character message together with the first character image; and a message receiving unit 134 which receives a user message after the character message is transmitted. The image generation unit 132 generates a second character image, in response to the message receiving unit 134 receiving the user message, by modifying a part of the first character image. The message transmission unit 133 transmits the second character image.SELECTED DRAWING: Figure 6
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing method, and an information processing system. [Background technology]

[0002] Systems are known that allow users to send and receive messages with others using communication terminals such as smartphones or tablets (see, for example, Patent Document 1). Communication terminals that allow users to send and receive messages are becoming popular among the elderly, and the number of elderly people using such systems to send and receive messages is increasing. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 7043665 Summary of the Invention [Problem to be solved by the invention]

[0004] It is believed that users of communication devices can maintain and improve their cognitive functions by sending and receiving messages using the device. However, many users of communication devices find it troublesome to operate the device to send messages. Therefore, there is a need to increase users' motivation to send messages.

[0005] The present invention has been made in view of these points, and has as its object to motivate users of communication terminals to send messages. [Means for solving the problem]

[0006] An information processing device of a first aspect of the present invention is an information processing device that sends messages displayed on a chat screen of a communication terminal, wherein the chat screen includes a user message input by a user of the communication terminal, a character message for the user, and a character image showing the face of a virtual character issuing the character message, and the information processing device has an image generation unit that generates a first character image, a message sending unit that sends the character message together with the first character image, and a message receiving unit that receives the user message after the character message is sent, and the image generation unit generates a second character image by changing a part of the first character image in response to the message receiving unit receiving the user message, and the message sending unit sends the second character image.

[0007] The information processing device may further have a memory unit that stores feature data indicating the facial features of the user, and the image generation unit may generate the second character image that has more of the facial features of the user than the first character image based on the feature data.

[0008] The information processing device may further have a feature identification unit that identifies facial features indicated by facial image data by analyzing facial image data included in the image data received by the message receiving unit, and the image generation unit may generate the second character image having more of the features than the first character image based on the features identified by the feature identification unit.

[0009] The image generation unit may generate a second character image by changing a part of the first character image every time the message receiving unit receives a predetermined number of the user messages.

[0010] The image generation unit may generate a second character image by changing a part of the first character image when a predetermined period has elapsed, on the condition that the message receiving unit has received a predetermined number of the user messages within the predetermined period.

[0011] An information processing device of a second aspect of the present invention is an information processing device that sends messages displayed on a chat screen of a communication terminal, wherein the chat screen includes a user message input by a user of the communication terminal and a character message for the user, and the information processing device has a message generation unit that generates a first character message, a message sending unit that sends the first character message, and a message receiving unit that receives the user message after the first character message is sent, and in response to the message receiving unit receiving the user message, the message generation unit generates a second character message having characteristics closer to the characteristics of the user message than the characteristics of the first character message, and the message sending unit sends the second character message.

[0012] The information processing device may further have a message analysis unit that extracts wording characteristics of the user message, and the message generation unit may generate the second character message having characteristics closer to the wording characteristics of the user extracted by the message analysis unit than the wording characteristics of the first character message.

[0013] The message analysis unit may input the user message into a large-scale language model, and extract, as features of the wording, parts of the user message that have the same meaning as the user message but are standard messages using standard wording, where the user message differs from the standard message.

[0014] The message generation unit may generate a temporary character message corresponding to the user message received by the message receiving unit, and generate the second character message by inputting the temporary character message and text indicating characteristics of the user message into a large-scale language model.

[0015] The user message includes the user's voice, and the information processing device further has a message analysis unit that extracts characteristics of the user's voice by analyzing the user's voice, and the message generation unit may generate a second character message having characteristics closer to the user's voice characteristics extracted by the message analysis unit than the voice characteristics of the first character message.

[0016] An information processing method of a third aspect of the present invention is an information processing method for a computer to send a message to be displayed on a chat screen of a communication terminal, wherein the chat screen includes a user message input by a user of the communication terminal, a character message to the user, and a character image showing the face of a virtual character issuing the character message, and the computer executes the steps of generating a first character image, transmitting the character message together with the first character image, receiving the user message after the character message has been transmitted, generating a second character image by changing a portion of the first character image in response to receiving the user message, and transmitting the second character image.

[0017] An information processing method of a fourth aspect of the present invention is an information processing method for a computer to send a message to be displayed on a chat screen of a communication terminal, wherein the chat screen includes a user message input by a user of the communication terminal and a character message for the user, and the computer executes the steps of generating a first character message, sending the first character message, receiving the user message after the first character message is sent, and, in response to receiving the user message, generating a second character message having characteristics closer to the characteristics of the user message than the characteristics of the first character message, and sending the second character message.

[0018] An information processing system of a fifth aspect of the present invention includes a communication terminal and an information processing device that sends a message to the communication terminal, wherein the information processing device has an image generation unit that generates a first character image, a message sending unit that sends a character message together with the first character image, and a message receiving unit that receives a user message after the character message is sent, wherein the image generation unit generates a second character image by changing a part of the first character image in response to the message receiving unit receiving the user message, and the message sending unit sends the second character image, and the communication terminal has a display unit that displays the first character image and the second character image.

[0019] An information processing system of a sixth aspect of the present invention comprises a communication terminal and an information processing device that sends a message to the communication terminal, wherein the information processing device has a message generation unit that generates a first character message, a message sending unit that sends the first character message, and a message receiving unit that receives a user message after the first character message is sent, wherein the message generation unit generates a second character message having characteristics closer to the characteristics of the user message than the characteristics of the first character message in response to the message receiving unit receiving the user message, the message sending unit sends the second character message, and the communication terminal has a display unit that displays the first character message and the second character message. [Effects of the Invention]

[0020] The present invention has the effect of motivating users of communication terminals to send messages. [Brief explanation of the drawings]

[0021] [Figure 1] FIG. 1 is a diagram for explaining an overview of an information processing system S. [Figure 2] 10A and 10B are diagrams showing examples of character messages and user messages displayed on the communication terminal 2. FIG. [Figure 3] 10A and 10B are diagrams showing examples of character messages and user messages displayed on the communication terminal 2. FIG. [Figure 4] 10A and 10B are diagrams showing other examples of character messages and user messages displayed on the communication terminal 2. FIG. [Figure 5] 10A and 10B are diagrams showing other examples of character messages and user messages displayed on the communication terminal 2. FIG. [Figure 6] 1 is a diagram illustrating a configuration of an information processing device 1. FIG. [Figure 7] FIG. 2 is a diagram showing an example of scenario data stored in a storage unit 12. [Figure 8]3 is a flowchart showing the flow of processing in the information processing device 1. [Figure 9] FIG. 10 is a diagram showing the configuration of an information processing device 1A according to a second embodiment. [Figure 10] 10 is a flowchart showing the flow of processing in information processing device 1A. DETAILED DESCRIPTION OF THE INVENTION

[0022] [Outline of Information Processing System S] 1 is a diagram illustrating an overview of an information processing system S. The information processing system S includes an information processing device 1 and a communication terminal 2. The information processing device 1 and the communication terminal 2 can send and receive chat messages to and from each other via a network N. The communication terminal 2 accesses the network N via, for example, a wireless communication line.

[0023] The communication terminal 2 is, for example, a smartphone or a tablet, and has a display that is a display unit that can display messages received from the information processing device 1. The communication terminal 2 also has a touch panel that is an operation unit that allows a user U who uses the communication terminal 2 to input messages. In this specification, a message of a virtual character transmitted by the information processing device 1 is referred to as a character message, and a message input by the user U and transmitted by the communication terminal 2 is referred to as a user message.

[0024] The communication terminal 2 displays the character messages and the user messages in chronological order. The communication terminal 2 displays the character messages received from the information processing device 1 in association with at least one of the name of the character or the image of the character generated by the information processing device 1, and displays the user messages in association with at least one of the user name or the image of the user.

[0025] The information processing device 1 is a computer capable of communicating with multiple communication terminals 2 used by multiple different users U, and causes the communication terminals 2 to display a chat screen including character messages and user messages. The information processing device 1 is, for example, a server managed by a business operator that provides a chat service. The information processing device 1 causes the communication terminals 2 to display the character messages by transmitting the character messages to the communication terminals 2. Details will be described later, but the information processing device 1 sequentially creates character messages according to a predetermined scenario, for example.

[0026] The information processing device 1 generates a character message issued by a virtual character. The information processing device 1 generates a character message whose content corresponds to the content of a user message transmitted by the user U. The information processing device 1 transmits the generated character message to the communication terminal 2. The information processing device 1 may transmit the character message to the communication terminal 2 together with a character image showing the character's face. For example, the information processing device 1 transmits the character message together with a face image of a character selected by the user U from images of a plurality of characters generated in advance.

[0027] The information processing device 1 has a function of changing at least one of the character image or the wording of the character message when it receives a predetermined number or more of user messages from user U, or when it receives user messages from user U for a predetermined period or more.

[0028] For example, the information processing device 1 changes the character image so as to increase the cuteness of the character image. The information processing device 1 may change the character image so as to resemble a favorite face of the user U (for example, a favorite actor or character) registered in advance by the user U. The information processing device 1 may change the character image so as to have a face with the same features as the features of the user U or the user U's family included in the image transmitted by the user U.

[0029] Furthermore, the information processing device 1 may change the wording of the character message so that the wording is similar to the wording of the user message input by the user U. As an example, the information processing device 1 identifies the hometown of the user U based on the dialect included in the user message input by the user U, and after identifying the hometown, transmits a character message including the dialect of the identified hometown.

[0030] 2 and 3 are diagrams showing examples of character messages and user messages displayed on the communication terminal 2. In Fig. 2 and Fig. 3, messages with facial images displayed on the left side are character messages, and messages with facial images displayed on the right side are user messages. Fig. 2 shows messages exchanged on a first day, and Fig. 3 shows messages exchanged on a second day after the first day.

[0031] Comparing the character image G1 shown in Fig. 2 with the character image G2 shown in Fig. 3, the character image G2 has longer hair and larger eyes than the character image G1. In this way, the information processing device 1 changes the character image in response to the user U sending a user message. The user U's enjoyment increases when the character image changes in response to the user U sending a user message, and the user U is motivated to send a user message.

[0032] 4 and 5 are diagrams showing other examples of character messages and user messages displayed on the communication terminal 2. Fig. 4 shows messages exchanged on a first day, and Fig. 5 shows messages exchanged on a second day after the first day.

[0033] In Fig. 4, the character message is written in standard Japanese, while the user message is written in Kansai dialect. In such a case, the information processing device 1 changes the wording of the character message to be closer to the wording of the user message, so that the character message is also written in Kansai dialect, as shown in Fig. 5, for example. By changing the wording of the character message in this way, the user U feels closer to the character, and is therefore motivated to send a user message.

[0034] First Embodiment [Configuration of information processing device 1] Fig. 6 is a diagram showing the configuration of the information processing device 1. The information processing device 1 has a communication unit 11, a storage unit 12, and a control unit 13. The control unit 13 has a message generation unit 131, an image generation unit 132, a message transmission unit 133, a message reception unit 134, and a feature identification unit 135. The information processing device 1 shown in Fig. 6 has a function of changing a character image in response to a user U sending a user message.

[0035] The communication unit 11 includes a communication interface for transmitting and receiving messages to and from the communication terminal 2 via the network N. The communication unit 11 transmits a character message input from the message sending unit 133, and inputs a user message received from the communication terminal 2 to the message receiving unit 134.

[0036] The storage unit 12 has storage media such as a ROM (Read Only Memory), a RAM (Random Access Memory), and an SSD (Solid State Drive). The storage unit 12 stores programs executed by the control unit 13. The storage unit 12 also stores data used by the message sending unit 133 to create character messages. The storage unit 12 stores, for example, a character image associated with a user U and used when sending and receiving messages to and from the user U.

[0037] The storage unit 12 also stores feature data indicating the facial features of the user U. The facial features are represented by the contours of the face, the size of the eyes relative to the facial area, the distance between the eyes, the positional relationship between the eyes, nose, and mouth, the shape of the hair, etc. The storage unit 12 may store feature data indicating the facial features of the user U's family members in association with the user U. The storage unit 12 may store face image data as feature data. The storage unit 12 may store the user U's preferred facial features in association with the user U.

[0038] The storage unit 12 also stores scenario data used to determine the topic of a character message. Fig. 7 is a diagram showing an example of scenario data stored in the storage unit 12. In the scenario data, a progress stage ID and a situation name are associated with each other. The scenario data is referenced when the message sending unit 133 generates a character message.

[0039] The scenario data may be associated with a character image used in each situation. For example, a casually dressed character image may be associated with a zoo situation, and a formally dressed character image may be associated with a department store or restaurant situation.

[0040] The following describes the operation of each unit of the control unit 13. The control unit 13 is, for example, a CPU (Central Processing Unit). The control unit 13 executes a program stored in the storage unit 12, thereby functioning as a message generation unit 131, an image generation unit 132, a message transmission unit 133, a message reception unit 134, and a feature identification unit 135.

[0041] Message generation unit 131 generates character messages. Message generation unit 131 refers to scenario data, changes situations in the order of the progress stage IDs indicated by the scenario data, and generates character messages corresponding to each situation. Message generation unit 131 transitions through the progress stages indicated by the scenario data stored in storage unit 12 over time, and generates character messages corresponding to the situations in the scenario data associated with the progress stage at that time.

[0042] For example, the message generation unit 131 first generates a character message about a topic related to the zoo, which is a situation with a progress stage ID of S001. The message generation unit 131 first generates a character message saying, for example, "Grandpa, we came to the zoo today," and causes the message transmission unit 133 to transmit the generated character message.

[0043] The message generation unit 131 shifts the progress stage in the scenario data every time a predetermined period (for example, one day or one week) has passed. For example, after a predetermined period has passed since the message generation unit 131 generated a character message about a topic related to a zoo, the message generation unit 131 generates a character message about a topic related to an amusement park, which is a situation with a progress stage ID of S002.

[0044] The image generation unit 132 generates a character image. The image generation unit 132 generates a character image to be transmitted by the message sending unit 133 to the communication terminal 2, for example, by reading out an initial character image stored in the storage unit 12 in association with the user U. The image generation unit 132 generates a second character image after the message sending unit 133 generates a first character image to be transmitted to the communication terminal 2 at a first time point. The second character image is a character image obtained by changing a part of the first character image, and is to be transmitted by the message sending unit 133 to the communication terminal 2 at a second time point that is later than the first time point.

[0045] The image generation unit 132 generates a second character image by changing a part of the first character image in response to the message receiving unit 134 receiving a user message. As an example, the image generation unit 132 does not generate a second character image if the message receiving unit 134 does not receive a user message after the message sending unit 133 sends a character message including the first character image. The image generation unit 132 generates the second character image on the condition that the message receiving unit 134 receives a user message after sending the character message together with the first character image.

[0046] The image generation unit 132 generates a second character image that has more facial features of the user U or the family of the user U than the first character image, based on the feature data stored in the storage unit 12 in association with the user U. The image generation unit 132 generates a second character image that has more facial features of the user U or the family of the user U than the first character image, based on, for example, the facial features of the user U or the family of the user U identified by the feature identification unit 135.

[0047] As an example, the image generation unit 132 generates a second character image that has the facial features of the user U and also has the facial features of a person younger than the user U. If the user U is an elderly man, the image generation unit 132 generates, for example, a second character image that is a female child and has the facial features of the user U. By transmitting such a second character image to the user U, the user U is more likely to feel an affinity to the virtual character.

[0048] The image generation unit 132 may generate a second character image by changing a part of the first character image every time the message receiving unit 134 receives a predetermined number of user messages, and cause the second character image to be transmitted by the message transmitting unit 133. The predetermined number is a number that is considered to be effective for maintaining and improving the cognitive function of the user U, and is, for example, 50. In this way, the image generation unit 132 uses the number of user messages transmitted by the user U as one of the conditions for changing a part of the first character image, thereby motivating the user U to transmit user messages.

[0049] However, if the user U sends only short user messages (e.g., "Yes," "Okay") in order to change part of the first character image, it is considered that this will not lead to maintaining or improving the cognitive function of the user U. Therefore, the image generation unit 132 may generate a second character image and cause the message sending unit 133 to send it on the condition that the message receiving unit 134 has received a predetermined number or more of user messages each having a predetermined length or more. The predetermined length is, for example, 20 characters.

[0050] Even if the user U repeatedly types the same characters to change part of the first character image and sends a long user message, it is considered that this will not lead to maintaining or improving the cognitive function of the user U. Therefore, the image generation unit 132 may generate a second character image and cause the message sending unit 133 to send the second character image on the condition that the message receiving unit 134 has received a predetermined number or more of user messages including a plurality of different nouns or a plurality of different verbs. By operating the image generation unit 132 in this manner, the user U is motivated to frequently send user messages that may lead to maintaining or improving the cognitive function.

[0051] Even if the user U sends a predetermined number of user messages, if the interval between sending the user messages is too long, it is difficult to maintain or improve the cognitive function of the user U. Therefore, the image generation unit 132 may initialize the number of received user messages to zero when a preset period (e.g., one week) has passed since the message receiving unit 134 last received a user message.

[0052] The image generation unit 132 may generate a second character image by changing a part of the first character image when a predetermined period has elapsed, on the condition that the message receiving unit 134 has received a predetermined number of user messages within the predetermined period, and cause the message sending unit 133 to send the second character image. The predetermined period is arbitrary, and may be, for example, one month. The predetermined period may be set by the user U. By operating the image generation unit 132 in this manner, the user U is motivated to send user messages frequently. Furthermore, by switching the character image when the predetermined period has elapsed, it is possible to prevent the character image from changing too frequently.

[0053] The image generation unit 132 may determine how to change the first character image to generate the second character image according to the content of the user message. For example, the image generation unit 132 generates a second character image that matches the preferences of the user U, the greater the degree to which the content of the user message is appropriate as a response to the character message sent by the message sending unit 133. The degree of appropriateness as a response increases, for example, as the degree of similarity to a message stored in the storage unit 12 as a desirable example response to the character message increases.

[0054] If the user U likes cute characters, the image generation unit 132 generates a second character image that includes more features that make the first character image seem cuter than the first character image, so that the more appropriate the second character image is as a response to the character message. By the image generation unit 132 operating in this manner, the user U is motivated to send user messages with good content.

[0055] The message sending unit 133 sends the character message generated by the message generating unit 131 together with the character image generated by the image generating unit 132 to the communication terminal 2 via the communication unit 11. The message sending unit 133 selects a character message to be sent from a large number of character message templates stored in the storage unit 12.

[0056] The message sending unit 133 transitions through the stages of progress indicated by the scenario data stored in the storage unit 12 over time, and sends character messages corresponding to the situations associated with the current stage of progress in the scenario data. When the message sending unit 133 refers to the scenario data shown in FIG. 7, the message sending unit 133 first sends a character message on a topic related to the zoo, which is the situation with a stage ID of S001. For example, the message sending unit 133 first sends a character message saying, "Grandpa, we came to the zoo today," and starts exchanging messages with the user U.

[0057] The message sending unit 133 shifts the progress stage in the scenario data every time a predetermined period (for example, one day or one week) has passed. For example, after a predetermined period has passed since sending a character message about a topic related to a zoo, the message sending unit 133 sends a character message about a topic related to an amusement park, which is a situation with a progress stage ID of S002.

[0058] The message receiving unit 134 receives a user message input by the user U and transmitted by the communication terminal 2 via the communication unit 11. The message receiving unit 134 associates the received user message with the date and time of reception and stores the message in the storage unit 12. The message receiving unit 134 may notify the message generating unit 131 of the received user message.

[0059] When the received user message includes image data, the message receiving unit 134 notifies the feature identifying unit 135 of the received image data. The message receiving unit 134 may notify the feature identifying unit 135 of the image data by storing the received image data in the storage unit 12 in association with the user U.

[0060] The feature identification unit 135 analyzes facial image data included in the image data received by the message receiving unit 134 to identify facial features indicated by the facial image data. The feature identification unit 135 may identify the facial features of the user U by analyzing the facial image data of the user U stored in the storage unit 12. As described above, the facial features include the facial contour, the size of the eyes relative to the facial area, the distance between the eyes, the positional relationship between the eyes, nose, and mouth, and the shape of the hair. The feature identification unit 135 associates feature data indicating the identified features with the user U and stores it in the storage unit 12, thereby notifying the image generation unit 132 of the facial features corresponding to the user U.

[0061] The image data received by the message receiving unit 134 may contain facial image data of multiple people. In this case, the feature identifying unit 135 may select, from the multiple facial image data, facial image data that matches a predetermined number (e.g., two or more) of the multiple features of user U stored in the storage unit 12, and identify the facial features indicated by the selected facial image data. By operating the feature identifying unit 135 in this manner, when the image data includes facial images of user U's family members, the feature identifying unit 135 can more easily identify the features of the facial image data of user U's family members.

[0062] [Processing flow in information processing device 1] Fig. 8 is a flowchart showing the flow of processing in the information processing device 1. The flowchart shown in Fig. 8 starts from the point when the user U starts to use the service of sending and receiving messages to and from a virtual character.

[0063] First, the image generation unit 132 generates an initial character image, which is the first character image used when sending a character message to the user U (S11). The image generation unit 132 associates the generated initial character image with the user U and stores it in the storage unit 12.

[0064] Next, the message generation unit 131 creates a character message by, for example, referring to scenario data, and the message transmission unit 133 transmits the character message together with an initial character image (S12). After that, when the message reception unit 134 receives a user message (S13), the image generation unit 132 determines whether or not the user U satisfies a predetermined condition (S14). Specifically, the image generation unit 132 determines, for example, whether or not the message reception unit 134 has received a predetermined number or more of user messages in response to the character message transmitted by the message transmission unit 133.

[0065] If the image generation unit 132 determines that the user U does not satisfy the predetermined condition (NO in S14), the image generation unit 132 does not generate a new character image, and the control unit 13 returns the process to S12. If the image generation unit 132 determines that the user U satisfies the predetermined condition (YES in S14), the image generation unit 132 generates a next character image by changing some of the features of the initial character image (S15).

[0066] The message sending unit 133 determines whether the user U has finished using the transmission / reception service (S16), and if it is determined that the user U has not finished using the transmission / reception service (NO in S16), the message sending unit 133 sends a character message together with the next character image generated in S15 (S12). The control unit 13 repeats the processes from S12 to S16 while the user U has not finished using the transmission / reception service.

[0067] [Effects of information processing device 1] As described above, the image generation unit 132 generates a second character image by changing a part of the first character image in response to the message receiving unit 134 receiving a user message, and the message sending unit 133 sends the second character image. With the information processing device 1 configured in this way, the user U can enjoy the change in the character image, and thus the user U who expects the character image to change is motivated to send a user message. As a result, it is possible to prevent the user U from suffering from dementia or the like, or to improve the condition of dementia or the like.

[0068] Second Embodiment [Configuration of information processing device 1A] In the second embodiment, as described with reference to Figs. 4 and 5, the wording of the character message transmitted by the information processing device 1A changes. Fig. 9 is a diagram showing the configuration of the information processing device 1A according to the second embodiment. The information processing device 1A shown in Fig. 9 differs from the information processing device 1 shown in Fig. 6 in that it has a message analysis unit 136 instead of the feature identification unit 135. The information processing device 1A may have the feature identification unit 135.

[0069] In response to the message receiving unit 134 receiving the user message, the message generating unit 131 generates a second character message having characteristics closer to the characteristics of the user message than the characteristics of the first character message. For example, based on the characteristics of the user message notified by the message analyzing unit 136, the message generating unit 131 generates the second character message by converting a character message with standard wording based on the notified characteristics. As an example, the message generating unit 131 generates a second character message having characteristics closer to the characteristics of the wording of user U extracted by the message analyzing unit 136 than the characteristics of the wording of the first character message. The message generating unit 131 may set the hometown of user U or the type of dialect used by user U, which is set in advance by user U, as the characteristics of the user message.

[0070] The message generation unit 131 may generate a temporary character message corresponding to the user message received by the message reception unit 134, and may generate a second character message by inputting the temporary character message and text indicating characteristics of the user message into a large-scale language model. The large-scale language model is a natural language processing model held by an external server, and can output text corresponding to the input text.

[0071] As an example, as shown in the exchange in FIG. 5, when a user message is characterized by a Kansai dialect and the message generator 131 receives a user message saying "Has your hair grown a little?", the message generator 131 generates a provisional character message saying "Yes. Isn't she cute?". Next, the message generator 131 inputs a message saying "Please translate 'Yes. Isn't she cute' into Kansai dialect" into the large-scale language model. The message generator 131 generates "That's right. Isn't she cute!" received from the large-scale language model as a second character message.

[0072] The message analysis unit 136 extracts features of wording from the user message. For example, the message analysis unit 136 extracts features of wording from the user message by inputting the user message into a large-scale language model. More specifically, by inputting the user message into the large-scale language model, the message analysis unit 136 extracts, as features of wording, parts of the user message that have the same meaning as the user message but that differ from a standard message using standard wording.

[0073] As an example, the message analysis unit 136 inputs the sentence "Please tell me which dialect is used in this message" into the large-scale language model along with the user message. When the message analysis unit 136 obtains the answer "It's Kansai dialect" from the large-scale language model, it identifies that the characteristic of user U's phrasing is Kansai dialect. The message analysis unit 136 notifies the message generation unit 131 that the characteristic of user U's user message is Kansai dialect, which enables the message generation unit 131 to create a character message in Kansai dialect.

[0074] Note that the message generation unit 131 may generate a character message in response to the user message, including features of the wording of the user U, by inputting the user message and text indicating the features of the user message into a large-scale language model, without generating a provisional character message. The message generation unit 131 may generate a character message including features of the wording of the user U, by inputting the user message and instructions for generating a response message with wording similar to the wording of the user message into a large-scale language model.

[0075] In this way, by the message generation unit 131 generating a character message with wording similar to the wording characteristics of the user message, the user U who sees the character message feels a sense of affinity with the virtual character, and is therefore motivated to send a user message.

[0076] [Processing when user message contains audio] In the above explanation, the user message and character message were text displayed on the communication terminal 2, but the user message may include the voice of the user U, and the character message may include the synthesized voice of the virtual character.

[0077] In this case, the message analysis unit 136 extracts the voice characteristics of the user U by analyzing the voice of the user U. The voice characteristics of the user U are, for example, intonation or voice quality. In this case, the message generation unit 131 generates a second character message having characteristics closer to the voice characteristics of the user U extracted by the message analysis unit 136 than the voice characteristics of the first character message. The message generation unit 131 may generate a second character message having characteristics closer to the voice characteristics of a person (e.g., an actor or singer) that the user U likes and that is set in the storage unit 12.

[0078] As an example, the message generation unit 131 creates a file in which the temporary character message and text indicating the voice characteristics of the user U are written in Speech Synthesis Markup Language (SSML). By inputting the created file to a text-to-speech conversion device, the message generation unit 131 generates a second character message in which the content indicated by the temporary character message is spoken in a voice having the voice characteristics of the user U or the voice characteristics of a person that the user U likes.

[0079] For example, the message generation unit 131 generates text for a temporary character message, inputs the generated text for the second character message and text indicating that the intonation is in Kansai dialect to a speech conversion device, and acquires audio data in which the temporary character message is read aloud in Kansai dialect. At this time, it is desirable that the message generation unit 131 inputs the text for the temporary character message in Kansai dialect to the speech conversion device. The message transmission unit 133 transmits the audio data acquired by the message generation unit 131 to the communication terminal 2.

[0080] The message generation unit 131 may input the provisional character message and text indicating voice characteristics into a large-scale language model having a function of converting text into voice, and thereby acquire, from the large-scale language model, voice data in which the Kansai dialect message is read aloud in a voice having the input characteristics. In this way, the message generation unit 131 generates a character message including a voice having the voice characteristics of the user U or the voice characteristics of a person the user U likes, so that the user U who hears the character message can converse with the virtual character with a sense of affinity, thereby motivating the user U to send a user message by voice.

[0081] [Processing flow in information processing device 1A] Fig. 10 is a flowchart showing the flow of processing in the information processing device 1 A. The flowchart shown in Fig. 10 starts from the point when the user U starts to use the service of sending and receiving messages to and from a virtual character.

[0082] First, the message generation unit 131 generates a character message to be transmitted to the user U (S21). The message transmission unit 133 transmits the generated character message to the communication terminal 2 (S22).

[0083] Next, the message receiving unit 134 receives the user message from the communication terminal 2 (S23). The message analyzing unit 136 analyzes the user message received by the message receiving unit 134 and identifies the characteristics of the wording in the user message (S24).

[0084] The message analysis unit 136 compares the features of the wording in the character message generated by the message generation unit 131 in S21 with the features of the wording in the user message, and determines whether there is a difference in the features (S25). If the message analysis unit 136 determines that there is a difference in the features (YES in S25), it notifies the message generation unit 131 of the features of the wording to be used when generating the character message so as to reduce the difference in the features of the wording. If the message analysis unit 136 determines that there is no difference in the features (NO in S25), the control unit 13 returns the process to S21.

[0085] If the message analysis unit 136 determines that there is a difference in the characteristics and notifies the message generation unit 131 of the characteristics of the wording to be used when generating the character message, the message generation unit 131 changes the characteristics of the wording to be used when generating the character message (S26). For example, the message generation unit 131 generated a character message in standard Japanese in S21, but will generate a character message in Kansai dialect from the next time. The message generation unit 131 determines whether the user U has finished using the transmission and reception service (S27), and if it determines that the use has not finished (NO in S27), generates a character message having the characteristics of the changed wording (S21).

[0086] [Effects of information processing device 1A] As described above, in response to the message receiving unit 134 receiving a user message, the message generating unit 131 generates a second character message having characteristics closer to the characteristics of the user message than the characteristics of the first character message previously transmitted by the message transmitting unit 133 to the communication terminal 2. By configuring the information processing device 1 in this way, the user U feels an affinity to the virtual character, and the desire to send and receive messages with the virtual character is strengthened, motivating the user U to send a user message. As a result, it is possible to prevent the user U from suffering from dementia or the like, or to improve the condition of dementia or the like.

[0087] Note that information processing device 1A may transmit only a character message without transmitting a character image. That is, information processing device 1A may be configured to transmit and receive only a message without transmitting and receiving an image to and from communication terminal 2.

[0088] The present invention has been described above using embodiments, but the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. For example, all or part of the device can be configured by functionally or physically distributing or integrating any unit. Furthermore, new embodiments resulting from any combination of multiple embodiments are also included in the embodiments of the present invention. The effects of the new embodiments resulting from the combination also have the effects of the original embodiments. [Explanation of symbols]

[0089] 1. Information processing equipment 2. Communication terminals 11 Communications Department 12 Storage section 13 Control Unit 131 Message Generation Unit 132 Image Generation Unit 133 Message sending unit 134 Message receiving unit 135 Feature Identification Unit 136 Message Analysis Unit

Claims

1. An information processing device that transmits a message to be displayed on a chat screen of a communication terminal, the chat screen includes a user message input by a user of the communication terminal, a character message to the user, and a character image showing a face of a virtual character issuing the character message; The information processing device includes: an image generation unit that generates a first character image; a message sending unit that sends the character message together with the first character image; a message receiving unit that receives the user message after the character message is transmitted; and the image generation unit generates a second character image by changing a part of the first character image in response to the message receiving unit receiving the user message; the message sending unit sends the second character image. Information processing device.

2. a storage unit that stores feature data indicating facial features of the user; the image generation unit generates the second character image having more facial features of the user than the first character image based on the feature data; The information processing device according to claim 1 .

3. The image data receiving unit further includes a feature specifying unit that specifies facial features indicated by the facial image data by analyzing the facial image data included in the image data received by the message receiving unit, the image generation unit generates the second character image having more of the features identified by the feature identification unit than the first character image, based on the features identified by the feature identification unit. The information processing device according to claim 1 .

4. the image generation unit generates a second character image by changing a part of the first character image every time the message receiving unit receives a predetermined number of the user messages. The information processing device according to claim 1 .

5. the image generation unit generates a second character image by changing a part of the first character image when the predetermined period has elapsed, on condition that the message receiving unit has received a predetermined number of the user messages within the predetermined period. The information processing device according to claim 1 .

6. An information processing device that transmits a message to be displayed on a chat screen of a communication terminal, the chat screen includes a user message input by a user of the communication terminal and a character message to the user, The information processing device includes: a message generator for generating a first character message; a message sending unit that sends the first character message; a message receiving unit that receives the user message after the first character message is transmitted; and the message generating unit generates a second character message having characteristics closer to characteristics of the user message than characteristics of the first character message in response to the message receiving unit receiving the user message; the message sending unit sends the second character message. Information processing device.

7. a message analysis unit that extracts features of the wording of the user message; the message generation unit generates the second character message having characteristics closer to the user's expression characteristics extracted by the message analysis unit than to the expression characteristics of the first character message. The information processing device according to claim 6 .

8. the message analysis unit inputs the user message into a large-scale language model, and extracts, as features of the phrases, portions of the user message that have the same meaning as the user message and are standard messages using standard phrases, and that are different from the user message; The information processing device according to claim 7 .

9. the message generation unit generates a temporary character message corresponding to the user message received by the message reception unit, and generates the second character message by inputting the temporary character message and text indicating characteristics of the user message into a large-scale language model. The information processing device according to claim 6 .

10. the user message includes the user's voice; the information processing device further includes a message analysis unit that analyzes the user's voice to extract features of the user's voice; the message generation unit generates a second character message having characteristics closer to the characteristics of the user's voice extracted by the message analysis unit than the characteristics of the voice of the first character message. The information processing device according to claim 6 .

11. An information processing method for a computer to send a message to be displayed on a chat screen of a communication terminal, comprising: the chat screen includes a user message input by a user of the communication terminal, a character message to the user, and a character image showing a face of a virtual character issuing the character message; The computer generating a first character image; transmitting the character message together with the first character image; receiving the user message after the character message is sent; generating a second character image by changing a part of the first character image in response to receiving the user message; transmitting the second character image; An information processing method that performs the above.

12. An information processing method for a computer to send a message to be displayed on a chat screen of a communication terminal, comprising: the chat screen includes a user message input by a user of the communication terminal and a character message to the user, The computer generating a first character message; transmitting the first character message; receiving the user message after the first character message is sent; In response to receiving the user message, generating a second character message having characteristics closer to the characteristics of the user message than the characteristics of the first character message; transmitting the second character message; An information processing method that performs the above.

13. a communication terminal; and an information processing device that transmits a message to the communication terminal; The information processing device includes: an image generation unit that generates a first character image; a message sending unit that sends a character message together with the first character image; a message receiving unit that receives a user message after the character message is transmitted; and the image generation unit generates a second character image by changing a part of the first character image in response to the message receiving unit receiving the user message; the message sending unit sends the second character image; the communication terminal has a display unit that displays the first character image and the second character image; Information processing system.

14. a communication terminal; and an information processing device that transmits a message to the communication terminal; The information processing device includes: a message generator for generating a first character message; a message sending unit that sends the first character message; a message receiving unit that receives a user message after the first character message is transmitted; and the message generating unit generates a second character message having characteristics closer to characteristics of the user message than characteristics of the first character message in response to the message receiving unit receiving the user message; the message sending unit sends the second character message; the communication terminal has a display unit that displays the first character message and the second character message. Information processing system.

Citation Information

Patent Citations

  • Program, computer and information processing method

    JP7043665B1