Information processing system and program

The system addresses the limitation of human-centric emotion recognition by associating object states with emotion values, enabling emotion interpretation and expression in non-human entities, thereby enhancing user attachment and empathy.

JP2024158649APending Publication Date: 2024-11-08SOFTBANK GROUP CORP
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
JP2023074011
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-04-28
Publication Date
2024-11-08

AI Technical Summary

Technical Problem

Existing emotion recognition systems primarily focus on humans and lack the capability to interpret emotions in non-human objects, limiting empathy and attachment to pets, plants, and other inanimate items.

Method used

An information processing system that associates states of non-human objects with emotion values, using base emotion information storage and updating units to recognize and determine emotions in pets, flowers, and other objects, and communicates these emotions through robots or devices.

Benefits of technology

Enhances empathy and attachment to non-human objects by interpreting and expressing their emotions, contributing to a deeper connection and valuing of pets and possessions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024158649000001_ABST
    Figure 2024158649000001_ABST
Patent Text Reader

Abstract

To provide an information processing system and a program for identifying emotions of a non-human target object.SOLUTION: In an information processing system 10 comprising a server 100 and a robot 200, the server comprises: a base emotion information storage unit for storing a plurality of pieces of base emotion information in which states of elements of a non-human target object (pet or object) are associated with target object emotion values indicating emotions of the target object; and an information updating unit for, when any of states of a plurality of elements for the target object recognized by observing the non-human target object matches any of the states of elements among the plurality of pieces of base emotion information stored in the base emotion information storage unit, updating the base emotion information whose state of element is matched using at least any of the states of elements not matched among the plurality of states of elements.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information processing system and a program. [Background technology]

[0002] Patent Document 1 describes an emotion identification system that identifies the emotion of a robot. [Prior art document] [Patent documents] [Patent Document 1] JP 2017-199319 A Summary of the Invention [Means for solving the problem]

[0003] According to one embodiment of the present invention, there is provided an information processing system. The information processing system may include a base emotion information storage unit that stores base emotion information that associates states of elements of a non-human object with emotion values ​​that indicate the emotion of the object. The information processing system may include an information updating unit that, when any of the states of a plurality of elements of the object recognized by observing the non-human object matches the state of any of the elements in the plurality of pieces of base emotion information stored in the base emotion information storage unit, updates the base emotion information with the matching state of the element with at least any of the states of the elements that do not match among the states of the plurality of elements.

[0004] In the information processing system, when the object is a pet, the elements of the object may include at least one of a bark, eye movement, body movement, and posture. When the object is a dog, the base emotion information storage unit may store the base emotion information associating a state in which a tail is wagged with an emotion value indicating a happy emotion, and when an observation result of observing a dog includes a wagging tail, the information updating unit may update the base emotion information associating the wagging tail with an emotion value indicating a happy emotion with at least one of a bark, eye movement, and posture included in the observation result.

[0005] In any of the information processing systems, when the object is a flower, the base emotion information storage section may store the base emotion information associating the blooming of the flower with an emotion value indicating an emotion of happiness, and when an observation result of observing a flower includes the blooming of a flower, the information updating section may update the base emotion information associating the blooming of a flower with an emotion value indicating an emotion of happiness with at least any element included in the observation result, other than the blooming of a flower.

[0006] Any of the information processing systems may further include an emotion determination unit that, when any of the states of a plurality of elements of the object recognized by observing the object coincides with the state of any of the elements of the plurality of base emotion information stored in the base emotion information storage unit, determines the object emotion value associated with the state of the element as an object emotion value indicating the emotion of the object. The information processing system may further include a human emotion transition pattern storage unit that stores a human emotion transition pattern indicating the transition of emotions when a person communicates with another person, and the emotion determination unit may determine an emotion value indicating the emotion of the object using the human emotion transition pattern when the person takes an action on the object. The human emotion transition pattern storage unit may store the human emotion transition pattern corresponding to each of a plurality of people, and the emotion determination unit may determine an emotion value indicating the emotion of the object using the human emotion transition pattern of a person related to the object from among the plurality of human emotion transition patterns stored in the human emotion transition pattern storage unit.

[0007] Any of the information processing systems may further include an electronic device that communicates with an owner of the object using the emotion determined by the emotion determination unit.

[0008] According to one embodiment of the present invention, there is provided a program for causing a computer to function as the information processing system.

[0009] The above summary of the invention does not list all of the necessary features of the present invention. Also, subcombinations of these features may also be inventions. [Brief description of the drawings]

[0010] [Figure 1] 1 shows an example of the overall configuration of a system 10 according to the present embodiment. [Diagram 2] 1 shows a schematic functional block configuration of a robot 200 and a server 100. [Diagram 3]An example of the hardware configuration of a computer 1200 that functions as a part of the server 100 or the robot 200 is shown in schematic form. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] The present invention will be described below through embodiments of the invention, but the following embodiments do not limit the scope of the invention according to the claims. Furthermore, not all of the combinations of features described in the embodiments are necessarily essential to the solution of the invention.

[0012] FIG. 1 illustrates an example of an overall configuration of a system 10 according to the present embodiment. The system 10 includes a server 100 and a robot 200. The system 10 may include a plurality of robots 200. The robot 200 may be a humanoid robot. The robot 200 may be a non-humanoid robot. The robot 200 may be an example of an electronic device. The server 100 may function as an information processing system. The robot 200 may be an example of a target object of the information processing system. The system 10 may be an example of an information processing system.

[0013] The robot 200 is placed in an arbitrary location. The user 20 is a person who uses the robot 200.

[0014] The robot 200 is placed, for example, in a home. The user 20 may be a family member of the home in which the robot 200 is placed, or a stranger who visits the home. The robot 200 is placed, for example, at the reception desk of a store or office. The user 20 may be a customer who visits the store or office. The manner in which the robot 200 is used is not limited to these manners.

[0015] The server 100 is provided remotely from the robot 200. The server 100 can control the robot 200 through a communication network 50. For example, the server 100 acquires sensor information detected by the robot 200 through the communication network 50, determines an action to be performed by the robot 200 based on the acquired sensor information, and transmits control information through the communication network 50 to instruct the robot 200.

[0016] For example, the robot 200 acquires various types of information detected by sensors, such as the voice and image of the user 20 and information on an external force received by the robot 200, and transmits the information to the server 100. The server 100 generates control information for controlling the robot 200 based on the information acquired from the robot 200. The server 100 generates control information for controlling the robot 200 based on the information acquired from the robot 200, for example, by using a neural network (NN).

[0017] In the system 10, the server 100 may execute processes for processing various information to determine the behavior of the robot 200, and processes for determining the behavior of the robot 200 based on the results of processing the various information. Note that part or all of these processes may be executed by the robot 200. In this case, part of the robot 200 functions as an information processing system.

[0018] The system 10 according to the present embodiment enables emotion recognition, which currently mainly targets people, to anthropomorphize non-human objects (pets and objects) to interpret emotions. In the present embodiment, the object may include anything other than a human. The object may include an animal. The object may include a pet. The object may include a plant. The object may include an inorganic object. The object may include a machine. The object may include a personal computer, a smartphone, a vending machine, a car, and the like. The object may include a book, a publication, a comic, and the like. The object may include a record, a CD (Compact Disc), a DVD (Digital Versatile Disc), a BD (Blu-ray (registered trademark) Disc), and the like. The object may include things worn by a person, such as clothes, a wallet, gloves, a scarf, and a hat. These are just a few examples, and the object may include anything other than a human.

[0019] The system 10 identifies emotion values ​​that indicate the emotions of non-human objects, enabling users 20 to empathize with their owners. It is expected that this will also contribute to sustainability by helping people to feel more attached to their pets and possessions and cherishing things.

[0020] In the system 10, elements that characterize an object are defined in advance. For example, in the system 10, elements that characterize a pet or object are defined in advance. For a dog or cat, the base emotion is defined based on the meow, eyes, tail, ear movement, and posture. For example, if a dog wags its tail, it is defined as "happy," and the meow and eye movement in that state are accumulated to accumulate an emotion transition / combination pattern. For an object, the base emotion is defined based on the color, shape, sound (if there is sound), or information that defines the object (creator, materials, etc.) and history (date of creation, date of ownership, etc.). For example, if a flower blooms, it is defined as "extremely happy," and the color, shape, number of days since it was a seedling, and information and emotions of the person who raised it are accumulated to create an emotion transition / combination pattern.

[0021] In addition, the system 10 accumulates transition patterns of human life and generates anthropomorphized emotions by matching similar patterns with the transition patterns of pets and objects. In this case, not only patterns of the whole human being but also patterns of human relationships similar to the target pet or object such as family members can be used.

[0022] The generated emotions can be interpreted (translated / interpreted) and expressed through the robot, or they can be expressed through other devices (such as those with speakers or displays, or smartphone apps).

[0023] It is also capable of interactive interaction with humans, which is achieved by matching the transition / combination patterns of personified emotions with patterns that occur in human communication. For example, if you tell a flower "it's beautiful," the flower will become even happier (humans also become happier when they are told "beautiful," and this human pattern is referenced and applied).

[0024] 2 shows an example of a functional block configuration of the robot 200 and the server 100. First, the functional block configuration of the robot 200 will be described. The robot 200 has a sensor unit 210, an information processing unit 220, a control target 230, and a communication unit 240. The information processing unit 220 may be a processor such as an MPU. The communication unit 240 is responsible for communication with the server 100. The communication unit 240 may be a communication device such as a network IF.

[0025] The control target 230 includes a speaker. The control target 230 includes a display unit. The display unit may be disposed at any position of the robot 200, such as the chest of the robot 200. The control target 230 includes LEDs installed in the eyes or the like. The control target 230 includes motors and the like that drive movable parts of the robot 200, such as the limbs and head.

[0026] The sensor unit 210 has various sensors such as a microphone 211, a gyro sensor 212, a motor sensor 213, a camera 214, an infrared sensor 215, and a battery remaining amount sensor 216. It is not essential that the sensor unit 210 has all of these sensors, and the sensor unit 210 may have sensors other than these.

[0027] The microphone 211 acquires surrounding sounds. For example, the microphone 211 acquires the voice of the user 20. For example, the microphone 211 acquires the sound of an object. The gyro sensor 212 detects the angular velocity of the entire robot 200 and each part of the robot 200. The motor sensor 213 detects the rotation angle of the drive shaft of the motor that drives the movable part of the robot 200. The camera 214 captures images using visible light and generates image information of videos and still images. The infrared sensor 215 detects surrounding objects and the like using infrared rays. The battery remaining capacity sensor 216 detects the remaining capacity of the battery provided in the robot 200.

[0028] The sensor unit 210 outputs various sensor data, such as voice data acquired by the microphone 211, an image captured by the camera 214, an angular velocity detected by the gyro sensor 212, a rotation angle detected by the motor sensor 213, a remaining capacity detected by the battery remaining amount sensor 216, and object information detected by the infrared sensor 215, to the information processing unit 220. The information processing unit 220 supplies the acquired sensor signals to the communication unit 240, and transmits them to the server 100. Furthermore, based on the control information acquired from the server 100, the information processing unit 220 causes the speaker of the robot 200 to speak, causes an LED of the robot 200 to emit light, and causes limbs and the like of the robot 200 to operate.

[0029] Next, a functional block configuration of the server 100 will be described. The server 100 has a processing unit 110, a communication unit 120, and a storage unit 130. The processing unit 110 includes a control unit 111, a state recognition unit 112, an emotion determination unit 113, and an information update unit 114. The communication unit 120 has an information acquisition unit 122.

[0030] The communication unit 120 is responsible for communication with the robot 200. The communication unit 120 may be a communication device such as a network IF. The information acquisition unit 122 acquires various information. For example, the information acquisition unit 122 acquires information detected by the sensor unit 210 of the robot 200 via the communication network 50.

[0031] The storage unit 130 has a storage medium such as a hard disk device, a flash memory, etc. The storage unit 130 also has a volatile storage device such as a RAM. The storage unit 130 stores program codes and various temporary data that the processing unit 110 reads out at execution time, as well as information required for the processing of the processing unit 110. The storage unit 130 may store so-called Large Language Models (LLM). The storage unit 130 stores information acquired by the communication unit 120 from the robot 200.

[0032] Storage section 130 stores base emotion information that associates, for example, the state of an element of an object with an emotion value that indicates the emotion of the object. Storage section 130 may be an example of a base emotion information storage section.

[0033] In the base emotion information, for example, known emotions of the object corresponding to the state of the element of the object are registered. For example, if the object is a dog, base emotion information in which an object emotion value indicating the emotion of "happy" is associated with a state in which the object is wagging its tail is stored in storage unit 130. For example, if the object is a dog, base emotion information in which an object emotion value indicating the emotion of "anger" is associated with a state in which the object is baring its fangs is stored in storage unit 130.

[0034] In cases where it is unclear whether an object actually has an emotion, any person, such as an administrator of system 10, may associate an appropriate emotion of the object with the state of an element of the object and register it in the base emotion information. For example, if the object is a flower, base emotion information in which an object emotion value indicating a "happy" emotion is associated with a blooming flower is stored in storage unit 130. For example, if the object is a flower, base emotion information in which an object emotion value indicating a "sad" emotion is associated with a withered flower is stored in storage unit 130.

[0035] If an object does not actually have an emotion, an arbitrary person such as an administrator of the system 10 may associate an appropriate emotion of the object with the state of the element of the object and register it in the base emotion information. For example, if the object is a wallet, the base emotion information in which an object emotion value indicating a "happy" emotion is associated with a state in which the amount of money in the wallet is large is stored in the storage unit 130. For example, if the object is a machine that operates by a battery, the base emotion information in which an object emotion value indicating a "hungry" emotion is associated with a state in which the remaining battery is low is stored in the storage unit 130. For example, if the object is a book, a comic book, a record, a CD, a DVD, a BD, or the like, the object emotion value indicating an emotion that is the same as the owner's emotion but stronger than the owner's emotion is stored in the storage unit 130 in the state in which the owner has touched the object many times.

[0036] The storage unit 130 may store a human emotion transition pattern indicating a transition of emotions when a person communicates with another person. An example of a human emotion transition pattern is a pattern in which a person's emotion of happiness increases when another person calls the person "beautiful." The storage unit 130 may store all kinds of human emotion transition patterns. The storage unit 130 may store a human emotion transition pattern corresponding to each of a plurality of people.

[0037] The control unit 111 determines an action of the robot 200 using the information stored in the storage unit 130 and the information acquired by the information acquisition unit 122, and transmits control information for executing the determined action to the robot 200 via the communication unit 120. The control unit 111 causes the robot 200 to communicate with the user 20, for example.

[0038] The state recognition unit 112 recognizes the state of the user 20 and the state of the object corresponding to the user 20 based on the information acquired by the information acquisition unit 122. The object corresponding to the user 20 may be an object captured by the camera 214 together with the user 20. The object corresponding to the user 20 may be an object owned by the user 20.

[0039] The state recognition unit 112 may analyze a captured image captured by the camera 214 to recognize the face of the user 20. For example, the storage unit 130 stores face images of a plurality of people, and the state recognition unit 112 recognizes the face of the user 20 by matching the captured image with the stored face images. The state recognition unit 112 may analyze a captured image captured by the camera 214 to recognize the facial expression of the user 20. The state recognition unit 112 may analyze the voice of the user 20 detected by the microphone 211 to recognize the contents of the utterance of the user 20. The state recognition unit 112 may perform voice emotion recognition by analyzing the voice of the user 20 detected by the microphone 211. For example, the state recognition unit 112 extracts feature amounts such as frequency components of the voice, and recognizes the emotion of the user 20 based on the extracted feature amounts.

[0040] The state recognition unit 112 may recognize the behavior of the user 20 based on the information acquired by the information acquisition unit 122. For example, the state recognition unit 112 stores in advance a neural network that outputs the behavior of the user 20 from the information acquired by the information acquisition unit 122, which is learned using the information acquired by the information acquisition unit 122 and the actual behavior of the user 20 at the time when the information acquisition unit 122 acquired the information as training data, and specifies the user's behavior by inputting the information acquired by the information acquisition unit 122 to the neural network. The neural network may be configured to receive the facial expression of the user 20 and the contents of the user's utterance recognized by the state recognition unit 112. The method of recognizing the user's behavior is not limited to this, and other known methods may be used.

[0041] The state recognition unit 112 may recognize an object by analyzing a captured image captured by the camera 214. The user state recognition unit 112 recognizes what the object is. For example, the storage unit 130 stores images of a plurality of objects, and the state recognition unit 112 recognizes the object by matching the captured image with the stored images.

[0042] In the case where the object emits a sound, the state recognition unit 112 may analyze the sound of the object detected by the microphone 211 and recognize what kind of sound the object emits. In the case where the object takes an action, the state recognition unit 112 may recognize the action of the object based on the information acquired by the information acquisition unit 122. For example, the state recognition unit 112 stores in advance a neural network that outputs the action of the object from the information acquired by the information acquisition unit 122, which is learned using the information acquired by the information acquisition unit 122 and the actual action of the object when the information acquisition unit 122 acquires the information as training data, and acquires the action of the object by inputting the information acquired by the information acquisition unit 122 into the neural network. The method of recognizing the action of the object is not limited to this, and other methods may be used.

[0043] The state recognition unit 112 recognizes the states of multiple elements of an object. For example, if the object is a pet such as a dog or a cat, the state recognition unit 112 recognizes the object's cry, eye movement, body movement, posture, etc. For example, if the object is a flower, the state recognition unit 112 recognizes the object's color, shape, blooming state, etc.

[0044] When the control unit 111 finds out information about the object through a conversation between the robot 200 and the user 20, the state recognition unit 112 may recognize the state of the elements of the object based on the information found out. For example, when the object is a pet, the state recognition unit 112 recognizes the age of the object, how long the object has been kept, etc. For example, when the object is a flower, the state recognition unit 112 recognizes the cultivation history of the object (the period since it was acquired, the number of days since it was a seedling), etc.

[0045] The emotion determination unit 113 determines a user emotion value indicating the emotion of the user 20 conversing with the robot 200. The emotion determination unit 113 may determine the user emotion value of the user 20 using information acquired by the information acquisition unit 122. The emotion determination unit 113 may determine the user emotion value of the user 20 using the user state recognized by the user state recognition unit 112.

[0046] The user emotion value may include a type of emotion of the user 20, and a value indicating the positive or negative emotion and the degree of the emotion of the user 20. Examples of the types of emotion of the user 20 include "joy", "pleasure", "comfort", "relief", "excitement", "relief", "fulfillment", "anger", "sorrow", "discomfort", "anxiety", "sadness", "concern", and "emptiness". Note that these are merely examples and are not limited to these. The value indicating the positive or negative emotion of the user 20 indicates a positive value if the emotion of the user 20 is a cheerful emotion accompanied by a pleasant feeling or comfort, such as "joy", "pleasure", "comfort", "relief", "excitement", "relief", and "fulfillment", and the brighter the emotion, the larger the value. If the emotion of the user is an unpleasant emotion, such as "anger", "sorrow", "discomfort", "anxiety", "sadness", "concern", and "emptiness", the value indicates a negative value, and the more unpleasant the emotion, the larger the absolute value of the negative value. If the emotion of the user is not any of the above ("normal"), the value of 0 is indicated.

[0047] For example, the emotion determination unit 113 pre-stores a neural network that outputs a user emotion value of the user 20 from the information acquired by the information acquisition unit 122, the neural network having been trained using the information acquired by the information acquisition unit 122 and a user emotion value indicating the actual emotion of the user 20 at the time the information acquisition unit 122 acquired the information as training data, and acquires the user emotion value by inputting the information acquired by the information acquisition unit 122 into the neural network. The neural network may be configured to accept the facial expression of the user 20 and the vocal content of the user 20 recognized by the user state recognition unit 112. The method of determining the user emotion value is not limited to this, and other known methods may be used.

[0048] The emotion determination unit 113 determines an object emotion value indicating the emotion of an object corresponding to the user 20 who is talking to the robot 200. When any of the states of a plurality of elements of an object recognized by the state recognition unit 112 by observing the object with the robot 200 matches the state of any of the elements in the base emotion information stored in the storage unit 130, the emotion determination unit 113 determines the emotion value associated with the state of the element as the object emotion value indicating the emotion of the object. For example, when the object is a dog and the state recognition unit 112 recognizes that the tail is wagging, the emotion determination unit 113 identifies the base emotion information stored in the storage unit 130 in which the state of the tail wagging is associated with the emotion "happy," and determines the object emotion value to be the emotion "happy."

[0049] When any of the states of the multiple elements of an object recognized by the state recognition unit 112 by observing the object matches the state of any of the elements in the base emotion information stored in the storage unit 130, the information update unit 114 updates the base emotion information with at least any of the states of the elements that do not match among the multiple elements. When any of the states of the multiple elements of an object recognized by the state recognition unit 112 by observing the object matches the state of any of the elements in the base emotion information stored in the storage unit 130, for example, the information update unit 114 updates the base emotion information with at least any of the states of the elements that do not match among the multiple elements. For example, the information update unit 114 adds at least any of the states of the elements that do not match among the multiple elements to the base emotion information. This makes it possible to generate emotion transitions and emotion combination patterns.

[0050] For example, when the target object is a dog, if the state recognition unit 112 recognizes the tail movement, eye movement, bark, and posture, and the tail movement indicates that the tail is wagging, the information update unit 114 identifies base emotion information stored in the storage unit 130 that associates the state of the tail wagging with the emotion of "happy". Then, the information update unit 114 updates the base emotion information with at least one of the eye movement, bark, and posture recognized by the state recognition unit 112. For example, the information update unit 114 adds at least one of the eye movement, bark, and posture recognized by the state recognition unit 112 to the base emotion information. This makes it possible to record the eye movement, bark, and posture, etc., when the dog is feeling happy, in association with the emotion of "happy", and to register a combination pattern of the states of multiple elements when the dog is feeling happy, or to register a transition pattern of the states of multiple elements. This information can be used for various purposes, such as improving the accuracy of recognizing a dog's emotions and improving the accuracy of predicting transitions in a dog's emotions.

[0051] For example, when the object is a flower, and the state recognition unit 112 recognizes the state of blooming of the flower, the color, the shape, the number of days since the seedling, and the information and emotions of the person who raised the flower, and the state of blooming of the flower indicates that the flower has bloomed, the information update unit 114 identifies base emotion information stored in the storage unit 130 that associates the state of the flower with the emotion of "extremely happy." The information update unit 114 then updates the base emotion information with at least one of the color, the shape, the number of days since the seedling, and the information and emotions of the person who raised the flower recognized by the state recognition unit 112. The information update unit 114 adds, for example, at least one of the color, the shape, the number of days since the seedling, and the information and emotions of the person who raised the flower recognized by the state recognition unit 112 to the base emotion information.

[0052] The emotion determination unit 113 may determine the object emotion value of the object by using the human emotion transition pattern stored in the storage unit 130. For example, when a person takes an action on the object, the emotion determination unit 113 determines the object emotion value of the object by using the human emotion transition pattern. For example, when the object is a flower and the person says to the flower, "It's beautiful," the emotion determination unit 113 increases the degree of happiness of the flower by using a pattern in which the emotion of happiness increases when a person is told "beautiful" by another person. In this way, by using the human emotion transition pattern, the emotion of the object can be determined in a form that is less strange to the person.

[0053] The emotion determination unit 113 may determine the object emotion value of the object by using the human emotion transition pattern of a person related to the object from among the multiple human emotion transition patterns stored in the storage unit 130. The person related to the object may be a person who has some kind of relationship with the object, such as the owner of the object, the family of the owner of the object, the person in the house where the object is located, and the person related to the place where the object is located. For example, the pattern of all humans and the pattern of the person related to the object may be different. As a specific example, when humans as a whole tend to feel "happy" when they are told "it's beautiful", whereas people related to the object tend to feel "embarrassed" more than "happy", if a person says "it's beautiful" to a flower, the emotion determination unit 113 increases the degree of embarrassment of the flower, not the degree of happiness of the flower.

[0054] As it is said that pets resemble their owners, pets and their owners have a special relationship, and the pet's emotions are considered to be strongly influenced by the emotions of the owner. When determining the emotion of a possession, it is considered that it is less strange to determine an emotion closer to that of the owner than that of a complete stranger. Therefore, the emotion determination unit 113 can determine an object emotion value of the object using the human emotion transition pattern of a person related to the object, thereby determining an emotion that is less strange.

[0055] The functions of the server 100 described above may be implemented by one or more computers. At least some of the functions of the server 100 may be implemented by a virtual machine. At least some of the functions of the server 100 may be implemented in the cloud. The robot 200 is an example of a target object. In the above embodiment, the robot 200 has been mainly described as an example of an electronic device, but this is not limited to this. Examples of electronic devices include smartphones, tablet terminals, PCs (Personal Computers), smart speakers, stuffed toys, vehicles such as automobiles and motorcycles, home appliances, etc. Note that these are merely examples, and electronic devices are not limited to these.

[0056] 3 is a schematic diagram showing an example of a hardware configuration of a computer 1200 functioning as a part of the server 100 or the robot 200. The computer 1200 may function as the server 100, for example. A program installed on the computer 1200 may cause the computer 1200 to function as one or more "parts" of the apparatus according to the present embodiment, or cause the computer 1200 to execute operations or one or more "parts" associated with the apparatus according to the present embodiment, and / or cause the computer 1200 to execute a process or steps of the process according to the present embodiment. Such a program may be executed by the CPU 1212 to cause the computer 1200 to execute specific operations associated with some or all of the blocks of the flowcharts and block diagrams described herein.

[0057] The computer 1200 according to this embodiment includes a CPU 1212, a RAM 1214, and a graphics controller 1216, which are connected to each other by a host controller 1210. The computer 1200 also includes input / output units such as a communication interface 1222, a storage device 1224, a DVD drive 1226, and an IC card drive, which are connected to the host controller 1210 via an input / output controller 1220. The DVD drive 1226 may be a DVD-ROM drive, a DVD-RAM drive, or the like. The storage device 1224 may be a hard disk drive, a solid state drive, or the like. The computer 1200 also includes a legacy input / output unit such as a ROM 1230 and a keyboard, which are connected to the input / output controller 1220 via an input / output chip 1240.

[0058] The CPU 1212 operates according to a program stored in the ROM 1230 and the RAM 1214, thereby controlling each unit. The graphic controller 1216 acquires image data generated by the CPU 1212 into a frame buffer or the like provided in the RAM 1214 or into itself, and causes the image data to be displayed on the display device 1218.

[0059] The communication interface 1222 communicates with other electronic devices via a network. The storage device 1224 stores programs and data used by the CPU 1212 in the computer 1200. The DVD drive 1226 reads programs or data from a DVD-ROM 1227 or the like and provides the programs or data to the storage device 1224. The IC card drive reads programs and data from an IC card and / or writes programs and data to an IC card.

[0060] The ROM 1230 stores therein a boot program or the like that is executed by the computer 1200 upon activation, and / or a program that depends on the hardware of the computer 1200. The input / output chip 1240 may also connect various input / output units to the input / output controller 1220 via a USB port, a parallel port, a serial port, a keyboard port, a mouse port, and the like.

[0061] The programs are provided by a computer-readable storage medium such as a DVD-ROM 1227 or an IC card. The programs are read from the computer-readable storage medium, installed in the storage device 1224, the RAM 1214, or the ROM 1230, which are also examples of computer-readable storage media, and executed by the CPU 1212. Information processing described in these programs is read by the computer 1200, and brings about cooperation between the programs and the various types of hardware resources described above. An apparatus or method may be constructed by implementing operations or processing of information according to the use of the computer 1200.

[0062] For example, when communication is performed between the computer 1200 and an external device, the CPU 1212 may execute a communication program loaded in the RAM 1214 and instruct the communication interface 1222 to perform communication processing based on the processing described in the communication program. Under the control of the CPU 1212, the communication interface 1222 reads transmission data stored in a transmission buffer area provided in the RAM 1214, the storage device 1224, the DVD-ROM 1227, or a recording medium such as an IC card, and transmits the read transmission data to a network, or writes reception data received from the network to a reception buffer area or the like provided on the recording medium.

[0063] Furthermore, the CPU 1212 may cause all or a necessary portion of a file or database stored in an external recording medium such as the storage device 1224, the DVD drive 1226 (DVD-ROM 1227), an IC card, etc. to be read into the RAM 1214, and perform various types of processing on the data on the RAM 1214. The CPU 1212 may then write back the processed data to the external recording medium.

[0064] Various types of information, such as various types of programs, data, tables, and databases, may be stored in the recording medium and undergo information processing. The CPU 1212 may perform various types of processing on the data read from the RAM 1214, including various types of operations, information processing, conditional judgment, conditional branching, unconditional branching, information search / replacement, etc., as described throughout this disclosure and specified by the instruction sequence of the program, and write back the results to the RAM 1214. The CPU 1212 may also search for information in a file, database, etc. in the recording medium. For example, when a plurality of entries each having an attribute value of a first attribute associated with an attribute value of a second attribute are stored in the recording medium, the CPU 1212 may search for an entry whose attribute value of the first attribute matches a specified condition from among the plurality of entries, read the attribute value of the second attribute stored in the entry, and thereby obtain the attribute value of the second attribute associated with the first attribute that satisfies a predetermined condition.

[0065] The above-described programs or software modules may be stored in a computer-readable storage medium on the computer 1200 or in the vicinity of the computer 1200. In addition, a recording medium such as a hard disk or a RAM provided in a server system connected to a dedicated communication network or the Internet can be used as a computer-readable storage medium, thereby providing the programs to the computer 1200 via the network.

[0066] The blocks in the flowcharts and block diagrams in the present embodiment may represent stages of a process in which an operation is performed or "parts" of an apparatus responsible for performing the operation. Particular stages and "parts" may be implemented by dedicated circuitry, programmable circuitry provided with computer-readable instructions stored on a computer-readable storage medium, and / or a processor provided with computer-readable instructions stored on a computer-readable storage medium. The dedicated circuitry may include digital and / or analog hardware circuits, and may include integrated circuits (ICs) and / or discrete circuits. The programmable circuitry may include reconfigurable hardware circuits, such as, for example, field programmable gate arrays (FPGAs), programmable logic arrays (PLAs), and the like, including AND, OR, XOR, NAND, NOR, and other logical operations, flip-flops, registers, and memory elements.

[0067] A computer-readable storage medium may include any tangible device capable of storing instructions that are executed by a suitable device, such that a computer-readable storage medium having instructions stored thereon comprises an article of manufacture that includes instructions that can be executed to create means for performing the operations specified in the flowcharts or block diagrams. Examples of computer-readable storage media may include electronic storage media, magnetic storage media, optical storage media, electromagnetic storage media, semiconductor storage media, and the like. More specific examples of computer-readable storage media may include floppy disks, diskettes, hard disks, random access memories (RAMs), read-only memories (ROMs), erasable programmable read-only memories (EPROMs or flash memories), electrically erasable programmable read-only memories (EEPROMs), static random access memories (SRAMs), compact disk read-only memories (CD-ROMs), digital versatile disks (DVDs), Blu-ray disks, memory sticks, integrated circuit cards, and the like.

[0068] The computer readable instructions may include either assembler instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk®, JAVA®, C++, etc., and conventional procedural programming languages ​​such as the “C” programming language or similar programming languages.

[0069] Computer readable instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, or to a programmable circuit, either locally or over a local area network (LAN), a wide area network (WAN), such as the Internet, etc., to cause the processor of the general purpose computer, special purpose computer, or other programmable data processing apparatus, or to a programmable circuit, to execute the computer readable instructions to generate means for performing the operations specified in the flowcharts or block diagrams. Examples of processors include computer processors, processing units, microprocessors, digital signal processors, controllers, microcontrollers, etc.

[0070] Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It is clear to those skilled in the art that various modifications and improvements can be made to the above embodiments. It is clear from the description of the claims that such modifications and improvements can also be included in the technical scope of the present invention.

[0071] It should be noted that the order of execution of each process, such as operations, procedures, steps, and stages, in the devices, systems, programs, and methods shown in the claims, specifications, and drawings is not specifically stated as "before" or "prior to," and that the process may be performed in any order unless the output of a previous process is used in a later process. Even if the operational flow in the claims, specifications, and drawings is described using "first," "next," and the like for convenience, this does not mean that the process must be performed in this order. [Explanation of symbols]

[0072] 10 system, 20 user, 50 communication network, 100 server, 110 processing unit, 111 control unit, 112 state recognition unit, 113 emotion determination unit, 114 information update unit, 120 communication unit, 122 information acquisition unit, 130 memory unit, 200 robot, 210 sensor unit, 211 microphone, 212 gyro sensor, 213 motor sensor, 214 camera, 215 infrared sensor, 216 battery remaining sensor, 220 information processing unit, 230 control target, 240 communication unit, 1200 computer, 1210 host controller, 1212 CPU, 1214 RAM, 1216 graphic controller, 1218 display device, 1220 input / output controller, 1222 communication interface, 1224 storage device, 1226 DVD drive, 1227 DVD-ROM, 1230 ROM, 1240 I / O chip

Claims

1. a base emotion information storage unit that stores a plurality of pieces of base emotion information that associates a state of an element of a non-human object with an object emotion value that indicates the emotion of the object; an information updating section which, when any of a plurality of element states of a non-human object recognized by observing said object matches any of the element states of the plurality of pieces of base emotion information stored in said base emotion information storage section, updates said base emotion information with the matching element state with at least any of the element states that do not match among said plurality of element states; An information processing system comprising:

2. The information processing system according to claim 1 , wherein when the object is a pet, the elements of the object include at least one of a cry, an eye movement, a body movement, and a posture.

3. When the object is a dog, the base emotion information storage unit stores the base emotion information in which a state of a wagging tail is associated with an emotion value indicating a happy emotion, 3. The information processing system according to claim 2, wherein, when an observation result of observing a dog includes a wagging tail, the information updating section updates the base emotion information associating the wagging tail with an emotion value indicating a happy emotion with at least any one of a bark, eye movement, and body posture included in the observation result.

4. when the object is a flower, the base emotion information storage section stores the base emotion information in which the blooming of the flower is associated with an emotion value indicating an emotion of happiness; 2. The information processing system according to claim 1, wherein, when an observation result of observing a flower includes a flower blooming, the information updating section updates the base emotion information associating a flower blooming with an emotion value indicating an emotion of happiness with at least any element included in the observation result other than a flower blooming.

5. an emotion determination section which, when any of a plurality of element states of an object recognized by observing the object coincides with a state of any of the plurality of pieces of base emotion information stored in the base emotion information storage section, determines the object emotion value associated with the state of that element as an object emotion value indicating the emotion of the object. The information processing system according to claim 1 , further comprising:

6. A human emotion transition pattern storage unit that stores human emotion transition patterns that indicate transitions of emotions when a person communicates with others. Further comprising: The information processing system according to claim 5 , wherein the emotion determination unit determines an object emotion value of the object by using the human emotion transition pattern when a person takes an action on the object.

7. the human emotion transition pattern storage unit stores the human emotion transition patterns corresponding to each of a plurality of people; 7. The information processing system according to claim 6, wherein the emotion determination unit determines an emotion value indicating an emotion of the object by using the human emotion transition pattern of a person related to the object from among the plurality of human emotion transition patterns stored in the human emotion transition pattern storage unit.

8. A program for causing a computer to function as the information processing system according to any one of claims 1 to 3.