System

Abstract

An object of a system according to an embodiment is to intuitively and naturally operate an IoT device in a home.SOLUTION: A system according to an embodiment includes a cat-shaped robot, a voice recognition unit, a natural language processing unit, and an IoT cooperation unit. The cat robot communicates with the user. The voice recognition unit recognizes a voice of a user. The natural language processing unit analyzes the voice recognized by the voice recognition unit. The IoT cooperation unit operates the IoT device in the home based on the content analyzed by the natural language processing unit.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Conventional technology has made it difficult to operate IoT devices in the home intuitively and naturally.

[0005] The system according to the embodiment aims to operate IoT devices in the home intuitively and naturally. [Means for solving the problem]

[0006] The system according to the embodiment includes a cat-type robot, a voice recognition unit, a natural language processing unit, and an IoT linking unit. The cat-type robot communicates with a user. The voice recognition unit recognizes the user's voice. The natural language processing unit analyzes the voice recognized by the voice recognition unit. The IoT linking unit operates IoT devices in the home based on the content analyzed by the natural language processing unit. [Effects of the Invention]

[0007] The system according to the embodiment allows users to intuitively and naturally operate IoT devices in the home. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. DETAILED DESCRIPTION OF THE INVENTION

[0009] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0010] First, the terms used in the following description will be explained.

[0011] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, the processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), or a TPU (Tensor Processing Unit).

[0012] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0013] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0014] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), and Bluetooth (registered trademark).

[0015] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0016] [First embodiment] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0017] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0018] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0019] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0020] The reception device 38 includes a touch panel 38A and a microphone 38B, and receives user input. The touch panel 38A detects contact with a pointer (for example, a pen or a finger) to receive user input by the touch of the pointer. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 (see FIG. 2) acquires the data indicating the user input.

[0021] Output device 40 includes a display 40A and a speaker 40B, and presents data to a user by outputting the data in a form of expression that the user can perceive (e.g., audio and / or text). Display 40A displays visible information such as text and images in accordance with instructions from processor 46. Speaker 40B outputs audio in accordance with instructions from processor 46. Camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0022] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0023] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0024] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0025] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290. The identification processing unit 290 can estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0026] In the smart device 14, the specific processing is performed by the processor 46. The storage 50 stores a specific processing program 60. The specific processing program 60 is used together with the specific processing program 56 by the data processing system 10. The processor 46 reads the specific processing program 60 from the storage 50 and executes the read specific processing program 60 on the RAM 48. The specific processing is realized by the processor 46 operating as the control unit 46A in accordance with the specific processing program 60 executed on the RAM 48. Note that the smart device 14 may have a data generation model and an emotion identification model similar to the data generation model 58 and the emotion identification model 59.

[0027] Note that a device other than the data processing device 12 may have the data generation model 58. For example, a server device (e.g., a generation server) may have the data generation model 58. In this case, the data processing device 12 obtains a processing result (prediction result, etc.) using the data generation model 58 by communicating with the server device having the data generation model 58. Furthermore, the data processing device 12 may be a server device, or may be a terminal device owned by a user (e.g., a mobile phone, a robot, a home appliance, etc.). Next, an example of processing by the data processing system 10 according to the first embodiment will be described.

[0028] (Example 1) The cat-type robot system according to an embodiment of the present invention is a system in which a cat-type robot is improved to add communication and IoT-compatible functions. This system is equipped with communication functions using voice recognition and natural language processing, and also has the ability to link with IoT devices. This allows the cat-type robot system to be more convenient in the home.

[0029] A cat-type robot system according to an embodiment includes a cat-type robot, a voice recognition unit, a natural language processing unit, and an IoT linkage unit. The cat-type robot recognizes a user's voice. For example, the cat-type robot collects the user's voice using a microphone and transmits the collected voice to the voice recognition unit. The voice recognition unit converts the user's voice into text data using, for example, voice recognition technology. The voice recognition unit can also improve the accuracy of voice recognition by removing ambient noise using, for example, noise canceling technology. The natural language processing unit analyzes the voice recognized by the voice recognition unit. For example, the natural language processing unit understands the content of the user's voice using a generation AI (e.g., text generation AI or multimodal generation AI) and generates an appropriate response. The natural language processing unit can also analyze the user's emotions and intentions and reflect them in the response. The IoT linkage unit operates IoT devices in the home based on the content analyzed by the natural language processing unit. For example, the IoT linkage unit links with devices such as smart lights, smart thermostats, and smart locks and operates them using voice commands. The IoT linking unit can also remotely control the behavior and settings of the cat-type robot, for example, via a smartphone app. This allows the cat-type robot system according to the embodiment to operate IoT devices in the home based on the user's voice commands. For example, if the user commands "Turn on the light," the cat-type robot controls the smart light to turn it on. Also, if the user commands "Turn down the temperature," the cat-type robot controls the smart thermostat to adjust the room temperature.

[0030] The cat robot can change the movement of its ears and tail in real time according to the tone and volume of the user's voice. For example, the cat robot's ears will stand up when the user's voice tone is high, and droop down when the user's voice tone is low. For example, the ears will stand up when the user speaks excitedly, and will become relaxed when the user speaks calmly. The cat robot also changes the movement of its tail according to the volume of the user's voice. For example, the tail will wag vigorously when the user speaks loudly, and will wag slowly when the user speaks softly. This allows the cat robot's movements to change according to the tone and volume of the user's voice, enabling more natural interaction.

[0031] The cat-type robot can recognize and respond to user gestures. For example, when the user waves their hand, the cat-type robot walks in that direction. For example, when the user waves their right hand, the cat-type robot walks to the right, and when the user waves their left hand, the cat-type robot walks to the left. Furthermore, when the user points their finger, the cat-type robot moves in that direction. For example, when the user points their finger and says "go," the cat-type robot can walk in that direction. Furthermore, when the user claps their hands, the cat-type robot performs a specific action. For example, when the user claps, the cat-type robot jumps. This allows the cat-type robot to react according to the user's gestures, making for more intuitive operation.

[0032] The cat-type robot can change into the shape of an animal and reproduce the animal's movements. For example, the cat-type robot can change into a dog-type robot and reproduce the movement of barking with its ears perked up. For example, when a user commands "bark," the dog-type robot barks. The cat-type robot can also change into a bird-type robot and reproduce the movement of flapping its wings. For example, when a user commands "fly," the bird-type robot performs the movement of flapping its wings. The cat-type robot can also change into a fish-type robot and reproduce the movement of swimming. For example, when a user commands "swimming," the fish-type robot performs the movement of swimming. This allows the shape of the cat-type robot to change into other animals and reproduce the movements of different animals, thereby meeting the diverse needs of users.

[0033] The cat robot can cooperate with other robots and devices in the home and perform cooperative actions. For example, the cat robot can cooperate with a cleaning robot and follow the cleaning robot as it moves. For example, the cat robot follows the cleaning robot while it is cleaning a room. The cat robot can also cooperate with a smart speaker and, when music is played, move its ears and tail to dance to the rhythm. For example, when music is played from the smart speaker, the cat robot starts dancing. The cat robot can also cooperate with a smart display and change its behavior depending on the information displayed on the display. For example, when weather information is displayed on the display, the cat robot will hold an umbrella. In this way, the cat robot can cooperate with other robots and devices in the home and perform cooperative actions, improving convenience within the home.

[0034] Generative AI can learn a user's past conversation history and generate personalized responses. For example, generative AI can learn what a user has said in the past and provide relevant information when the same topic comes up. For example, if a user talks about a hobby they previously mentioned, it can provide new information related to that hobby. Generative AI can also generate responses that reflect the user's preferences and interests based on the user's past conversation history. For example, if a user talks about a favorite movie, it can provide information related to that movie. Generative AI can also analyze a user's past conversation history, understand the user's emotions and intentions, and generate responses. For example, it can infer the user's emotions from what the user has said in the past and respond according to those emotions. In this way, generative AI can learn from a user's past conversation history and generate more personalized responses.

[0035] The communication function can support different languages, enabling communication with international users. For example, the communication function allows the cat robot to support multiple languages, such as English, Japanese, and French, and respond in the language selected by the user. For example, if the user speaks to the cat robot in English, the cat robot will respond in English. The communication function also supports cases where the user speaks to the cat robot in different languages. For example, if the user speaks to the cat robot in Japanese and then in English, the cat robot will respond in the respective language. The communication function also automatically switches languages ​​based on the user's language settings. For example, if the user changes the language settings on a smartphone app, the cat robot will respond in that language. This allows communication with international users by supporting different languages.

[0036] Generative AI can provide information and make suggestions based on a user's hobbies and interests. For example, if a user talks about their favorite movies or music, the generative AI will suggest new movies and music related to that genre. For example, if a user says they like action movies, the generative AI will introduce the latest action movies. Generative AI can also suggest events and activities based on the user's hobbies and interests. For example, if a user says they like the outdoors, the generative AI will suggest outdoor events taking place nearby. Generative AI can also provide information that the user may be interested in based on the user's past behavioral history. For example, it can provide tourist information related to places the user has visited in the past. This improves user satisfaction by providing information and suggestions based on the user's hobbies and interests.

[0037] A cat-shaped robot can constantly monitor the status of IoT devices in the home and notify the user if an abnormality occurs. For example, the cat-shaped robot can monitor the status of a smart thermostat and notify the user if an abnormal temperature change occurs. For example, it can issue a warning if the temperature rises suddenly. The cat-shaped robot can also monitor the status of a smart lock and notify the user if abnormal behavior occurs. For example, it can issue a warning if a door is opened unauthorizedly. The cat-shaped robot can also monitor the status of a smart camera and notify the user if it detects suspicious movement. For example, it can issue a warning if a suspicious person breaks in at night. This allows the status of IoT devices in the home to be constantly monitored and notify the user if an abnormality occurs, thereby improving safety within the home.

[0038] A cat robot can learn the operation history of an IoT device and automatically operate the device based on the user's behavioral patterns. For example, a cat robot can learn the operation history of a smart light and remember that the user turns off the light at the same time every night, and automatically turn it off. For example, it can turn off the light when the user goes to bed. A cat robot can also learn the operation history of a smart thermostat and remember that the user adjusts the temperature at a specific time, and automatically adjust the temperature. For example, it can adjust the room temperature when the user returns home. A cat robot can also learn the operation history of a smart lock and remember that the user locks the door at a specific time, and automatically locks the door. For example, it can lock the door when the user leaves the house. This improves user convenience by learning the operation history of IoT devices and automatically operating devices based on the user's behavioral patterns.

[0039] The cat-shaped robot can also be linked to IoT devices outside the home, allowing it to be operated while away from home. For example, the cat-shaped robot can be linked to a car's smart lock, allowing the user to unlock the car while away from home. For example, the cat-shaped robot unlocks the car when the user issues a command via smartphone. The cat-shaped robot can also be linked to an office's smart light, allowing the user to operate the office light while away from home. For example, the cat-shaped robot turns on the office light when the user issues a command via smartphone. The cat-shaped robot can also be linked to a remote camera, allowing the user to check camera footage while away from home. For example, the cat-shaped robot displays camera footage when the user issues a command via smartphone. This allows the robot to be linked to IoT devices outside the home and operate the robot while away from home, improving user convenience.

[0040] It is possible to operate IoT devices not only with voice but also with gestures and touch panels. For example, a cat-shaped robot can turn on a smart light when a user waves their hand. For example, a user can operate a light just by waving their hand. A cat-shaped robot can also adjust the temperature of a smart thermostat when a user operates a touch panel. For example, the cat-shaped robot adjusts the room temperature when the user gives instructions on the touch panel. A cat-shaped robot can also operate a smart lock when a user makes a gesture. For example, the cat-shaped robot locks the door when the user makes a specific gesture. This allows IoT devices to be operated not only with voice but also with gestures and touch panels, improving user operability.

[0041] The cat-shaped robot can link with home security cameras and automatically start recording when it detects an abnormality. For example, the cat-shaped robot can link with a security camera and automatically start recording when it detects suspicious movement. For example, it can start recording if a suspicious person breaks in at night. The cat-shaped robot can also link with a security camera and automatically start recording when it detects an abnormal sound. For example, it can start recording when a loud noise is heard. The cat-shaped robot can also link with a security camera and automatically start recording when it detects an abnormal temperature change. For example, it can start recording if the temperature rises suddenly. In this way, the cat-shaped robot can link with home security cameras and automatically start recording when it detects an abnormality, thereby improving home security.

[0042] The security function can add facial recognition technology to identify and notify family and friends. For example, the security function uses facial recognition technology to identify family and friends and notify the user. For example, a notification is sent when a family member returns home. The security function can also use facial recognition technology to identify suspicious individuals and issue a warning to the user. For example, a warning is sent when a suspicious individual approaches the house. The security function can also use facial recognition technology to identify delivery personnel and notify the user. For example, a notification is sent when a delivery personnel comes to deliver a package. Thus, adding facial recognition technology to the security function can identify and notify family and friends, improving security within the home.

[0043] The cat-shaped robot can also be linked to security systems outside the home, allowing it to monitor even when away from home. For example, the cat-shaped robot can be linked to a car's security system to monitor the car's status while away from home. For example, the user can check the car's security status on a smartphone. The cat-shaped robot can also be linked to an office security system to monitor the office's status while away from home. For example, the user can check the office's security status on a smartphone. The cat-shaped robot can also be linked to a parking lot surveillance camera to monitor the parking lot's status while away from home. For example, the user can check the parking lot's security status on a smartphone. This allows the cat-shaped robot to be linked to security systems outside the home and perform monitoring even when away from home, improving security outside the home.

[0044] The security function can be linked with a smartphone app to enable remote operation. For example, the security function can be linked with a smartphone app to enable a user to remotely operate a security camera. For example, the user can change the camera's viewpoint using their smartphone. The security function can also be linked with a smartphone app to enable a user to remotely operate a smart lock. For example, the user can unlock a door using their smartphone. The security function can also be linked with a smartphone app to enable a user to remotely set a security alarm. For example, the user can set an alarm using their smartphone. By linking the security function with a smartphone app, it becomes possible to operate the security camera from a remote location, improving user convenience.

[0045] The system according to the embodiment is not limited to the above-described example, and various modifications are possible, for example, as follows.

[0046] The cat-type robot can recognize and respond to user gestures. For example, when the user waves their hand, it walks in that direction. When the user waves their right hand, it walks to the right, and when the user waves their left hand, it walks to the left. When the user points their finger, it moves in that direction. When the user points their finger and says "go," it can walk in that direction. When the user claps their hands, it performs a specific action. When the user claps, the cat-type robot jumps. This allows the cat-type robot to react according to the user's gestures, making for more intuitive operation.

[0047] The cat-type robot can change into the shape of an animal and reproduce the animal's movements. For example, it can change into a dog-type robot and reproduce the movement of barking with its ears perked up. When the user commands "bark," the dog-type robot barks. It can also change into a bird-type robot and reproduce the movement of flapping its wings. When the user commands "fly," the bird-type robot performs the movement of flapping its wings. It can also change into a fish-type robot and reproduce the movement of swimming. When the user commands "swimming," the fish-type robot performs the movement of swimming. This allows the shape of the cat-type robot to be changed into other animals and reproduce the movements of different animals, thereby meeting the diverse needs of users.

[0048] The cat robot can work in conjunction with other robots and devices in the home to perform cooperative actions. For example, it can work in conjunction with a cleaning robot, following the cleaning robot as it moves. While the cleaning robot is cleaning the room, the cat robot follows behind it. It can also work in conjunction with a smart speaker, and when music is played, it moves its ears and tail and dances to the rhythm. When music plays from the smart speaker, the cat robot starts dancing. It can also work in conjunction with a smart display, changing its behavior depending on the information displayed on the display. When weather information is displayed on the display, the cat robot will act as if it is holding an umbrella. This allows the cat robot to work in conjunction with other robots and devices in the home to perform cooperative actions, improving convenience within the home.

[0049] The cat robot can constantly monitor the status of IoT devices in the home and notify the user if an abnormality occurs. For example, it can monitor the status of a smart thermostat and notify the user if an abnormal temperature change occurs. It can issue a warning if the temperature rises suddenly. It can also monitor the status of a smart lock and notify the user if abnormal behavior occurs. It can issue a warning if a door is opened unauthorizedly. It can also monitor the status of a smart camera and notify the user if suspicious movement is detected. It can issue a warning if a suspicious person breaks in at night. This improves safety within the home by constantly monitoring the status of IoT devices in the home and notifying the user if an abnormality occurs.

[0050] It is possible to learn the operation history of IoT devices and automatically operate the devices based on the user's behavioral patterns. For example, it can learn the operation history of a smart light, remember that the user turns off the light at the same time every night, and automatically turn it off. It can turn off the light when the user goes to bed. It can also learn the operation history of a smart thermostat, remember that the user adjusts the temperature at a specific time, and automatically adjust the temperature. It can adjust the room temperature when the user returns home. It can also learn the operation history of a smart lock, remember that the user locks the door at a specific time, and automatically lock it. It can lock the door when the user leaves the house. In this way, user convenience is improved by learning the operation history of IoT devices and automatically operating devices based on the user's behavioral patterns.

[0051] The processing flow of the first embodiment will be briefly explained below.

[0052] Step 1: The cat-like robot recognizes the user's voice. For example, the cat-like robot uses a microphone to collect the user's voice and transmit it to the voice recognition unit. The voice recognition unit converts the user's voice into text data using voice recognition technology. The voice recognition unit can also use noise canceling technology to remove ambient noise and improve the accuracy of voice recognition. Step 2: The natural language processing unit analyzes the speech recognized by the speech recognition unit. For example, the natural language processing unit uses a generation AI (e.g., text generation AI or multimodal generation AI) to understand the content of the user's speech and generate an appropriate response. The natural language processing unit can also analyze the user's emotions and intentions and reflect them in the response. Step 3: The IoT integration unit operates IoT devices in the home based on the content analyzed by the natural language processing unit. For example, the IoT integration unit can connect to devices such as smart lights, smart thermostats, and smart locks and operate them using voice commands. The IoT integration unit can also remotely control the behavior and settings of the cat robot via a smartphone app.

[0053] (Example 2) The cat-type robot system according to an embodiment of the present invention is a system in which a cat-type robot is improved to add communication and IoT-compatible functions. This system is equipped with communication functions using voice recognition and natural language processing, and also has the ability to link with IoT devices. This allows the cat-type robot system to be more convenient in the home.

[0054] A cat-type robot system according to an embodiment includes a cat-type robot, a voice recognition unit, a natural language processing unit, and an IoT linkage unit. The cat-type robot recognizes a user's voice. For example, the cat-type robot collects the user's voice using a microphone and transmits the collected voice to the voice recognition unit. The voice recognition unit converts the user's voice into text data using, for example, voice recognition technology. The voice recognition unit can also improve the accuracy of voice recognition by removing ambient noise using, for example, noise canceling technology. The natural language processing unit analyzes the voice recognized by the voice recognition unit. For example, the natural language processing unit understands the content of the user's voice using a generation AI (e.g., text generation AI or multimodal generation AI) and generates an appropriate response. The natural language processing unit can also analyze the user's emotions and intentions and reflect them in the response. The IoT linkage unit operates IoT devices in the home based on the content analyzed by the natural language processing unit. For example, the IoT linkage unit links with devices such as smart lights, smart thermostats, and smart locks and operates them using voice commands. The IoT linking unit can also remotely control the behavior and settings of the cat-type robot, for example, via a smartphone app. This allows the cat-type robot system according to the embodiment to operate IoT devices in the home based on the user's voice commands. For example, if the user commands "Turn on the light," the cat-type robot controls the smart light to turn it on. Also, if the user commands "Turn down the temperature," the cat-type robot controls the smart thermostat to adjust the room temperature.

[0055] The cat robot can change the movement of its ears and tail in real time according to the tone and volume of the user's voice. For example, the cat robot's ears will stand up when the user's voice tone is high, and droop down when the user's voice tone is low. For example, the ears will stand up when the user speaks excitedly, and will become relaxed when the user speaks calmly. The cat robot also changes the movement of its tail according to the volume of the user's voice. For example, the tail will wag vigorously when the user speaks loudly, and will wag slowly when the user speaks softly. This allows the cat robot's movements to change according to the tone and volume of the user's voice, enabling more natural interaction.

[0056] The cat-type robot can recognize and respond to user gestures. For example, when the user waves their hand, the cat-type robot walks in that direction. For example, when the user waves their right hand, the cat-type robot walks to the right, and when the user waves their left hand, the cat-type robot walks to the left. Furthermore, when the user points their finger, the cat-type robot moves in that direction. For example, when the user points their finger and says "go," the cat-type robot can walk in that direction. Furthermore, when the user claps their hands, the cat-type robot performs a specific action. For example, when the user claps, the cat-type robot jumps. This allows the cat-type robot to react according to the user's gestures, making for more intuitive operation.

[0057] The cat robot can use its emotion estimation function to change its behavior depending on the user's emotions. For example, when the user is sad, the cat robot will slowly approach and sit at the user's feet. For example, when the user is crying, the cat robot will snuggle up to the user. When the user is happy, the cat robot will express joy by moving its ears and tail. For example, when the user speaks to it with a smile, the cat robot will perk up its ears and wag its tail. When the user is angry, the cat robot will keep its distance. For example, when the user speaks in an angry voice, the cat robot will move a little further away. This allows the cat robot's behavior to change depending on the user's emotions, enabling more natural interactions.

[0058] The cat-type robot can change into the shape of an animal and reproduce the animal's movements. For example, the cat-type robot can change into a dog-type robot and reproduce the movement of barking with its ears perked up. For example, when a user commands "bark," the dog-type robot barks. The cat-type robot can also change into a bird-type robot and reproduce the movement of flapping its wings. For example, when a user commands "fly," the bird-type robot performs the movement of flapping its wings. The cat-type robot can also change into a fish-type robot and reproduce the movement of swimming. For example, when a user commands "swimming," the fish-type robot performs the movement of swimming. This allows the shape of the cat-type robot to change into other animals and reproduce the movements of different animals, thereby meeting the diverse needs of users.

[0059] The cat robot can cooperate with other robots and devices in the home and perform cooperative actions. For example, the cat robot can cooperate with a cleaning robot and follow the cleaning robot as it moves. For example, the cat robot follows the cleaning robot while it is cleaning a room. The cat robot can also cooperate with a smart speaker and, when music is played, move its ears and tail to dance to the rhythm. For example, when music is played from the smart speaker, the cat robot starts dancing. The cat robot can also cooperate with a smart display and change its behavior depending on the information displayed on the display. For example, when weather information is displayed on the display, the cat robot will hold an umbrella. In this way, the cat robot can cooperate with other robots and devices in the home and perform cooperative actions, improving convenience within the home.

[0060] The cat robot can use the emotion estimation function to adjust its behavior when interacting with other pets. For example, when a real cat approaches, the cat robot will prick up its ears and act alert. For example, when a real cat approaches the cat robot, the cat robot will assume an alert posture. Also, when a real dog approaches, the cat robot will wag its tail and act friendly. For example, when a real dog approaches the cat robot, the cat robot will wag its tail to welcome it. Also, the cat robot will act quietly when a real bird is nearby. For example, when a real bird is near the cat robot, the cat robot will move quietly. This allows the cat robot to use the emotion estimation function to adjust its behavior when interacting with other pets, enabling more natural interactions.

[0061] Generative AI can learn a user's past conversation history and generate personalized responses. For example, generative AI can learn what a user has said in the past and provide relevant information when the same topic comes up. For example, if a user talks about a hobby they previously mentioned, it can provide new information related to that hobby. Generative AI can also generate responses that reflect the user's preferences and interests based on the user's past conversation history. For example, if a user talks about a favorite movie, it can provide information related to that movie. Generative AI can also analyze a user's past conversation history, understand the user's emotions and intentions, and generate responses. For example, it can infer the user's emotions from what the user has said in the past and respond according to those emotions. In this way, generative AI can learn from a user's past conversation history and generate more personalized responses.

[0062] The communication function adds recognition of the user's facial expressions and can generate responses according to the expressions. For example, when the user smiles, the communication function responds with "You look like you're having fun." For example, when the user speaks with a smile, the cat-like robot responds positively according to the smile. Furthermore, when the user looks sad, the communication function responds with "Are you okay?" For example, when the user looks sad, the cat-like robot provides support according to the expression. Furthermore, when the user looks surprised, the communication function responds with "Is something surprising happening?" For example, when the user looks surprised, the cat-like robot asks a question according to the expression. This allows for more natural communication by generating responses according to the user's facial expressions.

[0063] The emotion estimation function generates a response according to the user's emotions and can engage in a conversation to improve the user's mood. For example, when the user is sad, the emotion estimation function responds by saying, "Are you okay? Is there anything I can help you with?" For example, when the user speaks in a sad voice, the cat-like robot provides support according to that emotion. When the user is happy, the emotion estimation function responds by saying, "That's wonderful! Did something good happen?" For example, when the user speaks in a happy voice, the cat-like robot engages in a conversation according to that emotion. When the user is angry, the emotion estimation function responds by saying, "Please calm down. Is there anything you'd like to talk to me about?" For example, when the user speaks in an angry voice, the cat-like robot responds calmly according to that emotion. In this way, by generating a response according to the user's emotions and engaging in a conversation to improve the user's mood, user satisfaction is improved.

[0064] The communication function can support different languages, enabling communication with international users. For example, the communication function allows the cat robot to support multiple languages, such as English, Japanese, and French, and respond in the language selected by the user. For example, if the user speaks to the cat robot in English, the cat robot will respond in English. The communication function also supports cases where the user speaks to the cat robot in different languages. For example, if the user speaks to the cat robot in Japanese and then in English, the cat robot will respond in the respective language. The communication function also automatically switches languages ​​based on the user's language settings. For example, if the user changes the language settings on a smartphone app, the cat robot will respond in that language. This allows communication with international users by supporting different languages.

[0065] Generative AI can provide information and make suggestions based on a user's hobbies and interests. For example, if a user talks about their favorite movies or music, the generative AI will suggest new movies and music related to that genre. For example, if a user says they like action movies, the generative AI will introduce the latest action movies. Generative AI can also suggest events and activities based on the user's hobbies and interests. For example, if a user says they like the outdoors, the generative AI will suggest outdoor events taking place nearby. Generative AI can also provide information that the user may be interested in based on the user's past behavioral history. For example, it can provide tourist information related to places the user has visited in the past. This improves user satisfaction by providing information and suggestions based on the user's hobbies and interests.

[0066] The emotion estimation function can suggest music or activities to relax the user when they are feeling stressed. For example, the emotion estimation function plays relaxing music when the user is feeling stressed. For example, if the user speaks in a tired voice, a cat-shaped robot suggests relaxing music. The emotion estimation function also suggests activities to relax the user when they are feeling stressed. For example, it suggests yoga or meditation when the user is feeling stressed. The emotion estimation function also creates an environment in which the user can relax when they are feeling stressed. For example, it dims the lights to create a relaxing atmosphere when the user is feeling stressed. In this way, the user's stress is reduced by suggesting music or activities to relax them when they are feeling stressed.

[0067] A cat-shaped robot can constantly monitor the status of IoT devices in the home and notify the user if an abnormality occurs. For example, the cat-shaped robot can monitor the status of a smart thermostat and notify the user if an abnormal temperature change occurs. For example, it can issue a warning if the temperature rises suddenly. The cat-shaped robot can also monitor the status of a smart lock and notify the user if abnormal behavior occurs. For example, it can issue a warning if a door is opened unauthorizedly. The cat-shaped robot can also monitor the status of a smart camera and notify the user if it detects suspicious movement. For example, it can issue a warning if a suspicious person breaks in at night. This allows the status of IoT devices in the home to be constantly monitored and notify the user if an abnormality occurs, thereby improving safety within the home.

[0068] A cat robot can learn the operation history of an IoT device and automatically operate the device based on the user's behavioral patterns. For example, a cat robot can learn the operation history of a smart light and remember that the user turns off the light at the same time every night, and automatically turn it off. For example, it can turn off the light when the user goes to bed. A cat robot can also learn the operation history of a smart thermostat and remember that the user adjusts the temperature at a specific time, and automatically adjust the temperature. For example, it can adjust the room temperature when the user returns home. A cat robot can also learn the operation history of a smart lock and remember that the user locks the door at a specific time, and automatically locks the door. For example, it can lock the door when the user leaves the house. This improves user convenience by learning the operation history of IoT devices and automatically operating devices based on the user's behavioral patterns.

[0069] The emotion estimation function can adjust the settings of IoT devices according to the user's emotions. For example, when the user wants to relax, the emotion estimation function can adjust the brightness of a smart light to create a relaxing environment. For example, if the user speaks in a tired voice, the emotion estimation function can dim the light. The emotion estimation function can also adjust the volume of a smart speaker to create an environment where the user can concentrate. For example, it can lower the volume of music when the user wants to concentrate. The emotion estimation function can also adjust the temperature of a smart thermostat to create a relaxing environment when the user wants to relax. For example, it can lower the room temperature when the user wants to relax. In this way, the user's comfort can be improved by adjusting the settings of IoT devices according to the user's emotions.

[0070] The cat-shaped robot can also be linked to IoT devices outside the home, allowing it to be operated while away from home. For example, the cat-shaped robot can be linked to a car's smart lock, allowing the user to unlock the car while away from home. For example, the cat-shaped robot unlocks the car when the user issues a command via smartphone. The cat-shaped robot can also be linked to an office's smart light, allowing the user to operate the office light while away from home. For example, the cat-shaped robot turns on the office light when the user issues a command via smartphone. The cat-shaped robot can also be linked to a remote camera, allowing the user to check camera footage while away from home. For example, the cat-shaped robot displays camera footage when the user issues a command via smartphone. This allows the robot to be linked to IoT devices outside the home and operate the robot while away from home, improving user convenience.

[0071] It is possible to operate IoT devices not only with voice but also with gestures and touch panels. For example, a cat-shaped robot can turn on a smart light when a user waves their hand. For example, a user can operate a light just by waving their hand. A cat-shaped robot can also adjust the temperature of a smart thermostat when a user operates a touch panel. For example, the cat-shaped robot adjusts the room temperature when the user gives instructions on the touch panel. A cat-shaped robot can also operate a smart lock when a user makes a gesture. For example, the cat-shaped robot locks the door when the user makes a specific gesture. This allows IoT devices to be operated not only with voice but also with gestures and touch panels, improving user operability.

[0072] The emotion estimation function can operate IoT devices in advance to create a comfortable environment before the user returns home. For example, the emotion estimation function operates a smart thermostat to make the room temperature comfortable before the user arrives home. For example, the emotion estimation function adjusts the room temperature to match the time the user will arrive home. The emotion estimation function also operates smart lights to adjust the lighting before the user arrives home. For example, the emotion estimation function turns on the lights to match the time the user will arrive home. The emotion estimation function also operates a smart speaker to play music before the user arrives home. For example, the emotion estimation function plays relaxing music to match the time the user will arrive home. In this way, by operating IoT devices in advance to create a comfortable environment before the user arrives home, the user's comfort is improved.

[0073] The cat robot's emotional expressions can be made to respond to the user's emotions in real time. For example, when the user smiles, the cat robot will use the LED lights in its eyes to show a happy expression. For example, when the user speaks to it with a smile, the cat robot's eyes will light up. When the user is sad, the cat robot will droop its ears and tail to show a sad expression. For example, when the user is crying, the cat robot will droop its ears and tail. When the user is angry, the cat robot will prick up its ears to show an alert expression. For example, when the user speaks in an angry voice, the cat robot will prick up its ears. This allows the cat robot's emotional expressions to respond to the user's emotions in real time, enabling more natural interaction.

[0074] By combining voice and music with emotional expression, it is possible to realize richer emotional expression. For example, the cat-type robot plays cheerful music when expressing a happy emotion. For example, when the user praises the cat-type robot, the cat-type robot plays happy music. Also, the cat-type robot plays quiet music when expressing a sad emotion. For example, when the user is sad, the cat-type robot plays quiet music. Also, the cat-type robot plays a warning sound when expressing an angry emotion. For example, when the user is angry, the cat-type robot plays a warning sound. In this way, by combining voice and music with emotional expression, it is possible to express richer emotions.

[0075] The emotion estimation function can improve the user's mood by interacting with the user according to their emotions. For example, when the user is sad, the cat robot will approach and comfort them. For example, when the user is crying, the cat robot will approach and snuggle up to them. When the user is happy, the emotion estimation function can express joy by moving its ears and tail. For example, when the user speaks with a smile, the cat robot will perk up its ears and wag its tail. When the user is angry, the cat robot will maintain its distance. For example, when the user speaks in an angry voice, the cat robot will move a little further away. In this way, the emotion estimation function can improve the user's mood by interacting with the user according to their emotions.

[0076] The cat robot can coordinate its emotional expressions with other devices and provide visual feedback. For example, the cat robot displays a smiley face icon on the smart display when expressing a happy emotion. For example, when a user praises the cat robot, a smiley face icon is displayed on the smart display. Furthermore, the cat robot displays a teary face icon on the smart display when expressing a sad emotion. For example, when a user is sad, a teary face icon is displayed on the smart display. Furthermore, the cat robot displays an angry face icon on the smart display when expressing an angry emotion. For example, when a user is angry, an angry face icon is displayed on the smart display. This makes it possible to provide visual feedback and enable richer interactions by coordinating the emotional expressions of the cat robot with other devices.

[0077] Emotional expressions can be shared with other robots and devices in the home, allowing them to express emotions in a cooperative manner. For example, when a cat robot expresses happiness, a smart light in the home will light up brightly. For example, when a user praises the cat robot, the smart light will brighten. Furthermore, when a cat robot expresses sadness, a smart speaker in the home will play quiet music. For example, when a user is sad, the smart speaker will play quiet music. Furthermore, when a cat robot expresses anger, a smart display in the home will display a warning message. For example, when a user is angry, the smart display will display a warning message. This allows emotional expressions to be shared with other robots and devices in the home, allowing them to express emotions in a cooperative manner, thereby enriching interactions in the home.

[0078] The emotion estimation function can suggest entertainment content based on the user's emotions. For example, the emotion estimation function suggests a relaxing movie when the user wants to relax. For example, if the user speaks in a tired voice, the cat robot will recommend a relaxing movie. The emotion estimation function also suggests a fun game when the user wants to have fun. For example, the cat robot will suggest a fun game when the user wants to have fun. The emotion estimation function also suggests music that will help the user concentrate when the user wants to concentrate. For example, the cat robot will recommend music that will help the user concentrate when the user wants to concentrate. In this way, by using the emotion estimation function to suggest entertainment content based on the user's emotions, user satisfaction is improved.

[0079] The cat-shaped robot can link with home security cameras and automatically start recording when it detects an abnormality. For example, the cat-shaped robot can link with a security camera and automatically start recording when it detects suspicious movement. For example, it can start recording if a suspicious person breaks in at night. The cat-shaped robot can also link with a security camera and automatically start recording when it detects an abnormal sound. For example, it can start recording when a loud noise is heard. The cat-shaped robot can also link with a security camera and automatically start recording when it detects an abnormal temperature change. For example, it can start recording if the temperature rises suddenly. In this way, the cat-shaped robot can link with home security cameras and automatically start recording when it detects an abnormality, thereby improving home security.

[0080] The security function can add facial recognition technology to identify and notify family and friends. For example, the security function uses facial recognition technology to identify family and friends and notify the user. For example, a notification is sent when a family member returns home. The security function can also use facial recognition technology to identify suspicious individuals and issue a warning to the user. For example, a warning is sent when a suspicious individual approaches the house. The security function can also use facial recognition technology to identify delivery personnel and notify the user. For example, a notification is sent when a delivery personnel comes to deliver a package. Thus, adding facial recognition technology to the security function can identify and notify family and friends, improving security within the home.

[0081] The emotion estimation function can enhance security functions when a user feels anxious. For example, the emotion estimation function expands the monitoring range of a security camera when the user feels anxious. For example, the camera's monitoring range is expanded when the user speaks in an anxious voice. The emotion estimation function also strengthens the locking of a smart lock when the user feels anxious. For example, the door is locked more tightly when the user speaks in an anxious voice. The emotion estimation function also sets a security alarm when the user feels anxious. For example, the alarm is set when the user speaks in an anxious voice. In this way, the emotion estimation function is used to strengthen security functions when the user feels anxious, thereby improving the user's sense of security.

[0082] The cat-shaped robot can also be linked to security systems outside the home, allowing it to monitor even when away from home. For example, the cat-shaped robot can be linked to a car's security system to monitor the car's status while away from home. For example, the user can check the car's security status on a smartphone. The cat-shaped robot can also be linked to an office security system to monitor the office's status while away from home. For example, the user can check the office's security status on a smartphone. The cat-shaped robot can also be linked to a parking lot surveillance camera to monitor the parking lot's status while away from home. For example, the user can check the parking lot's security status on a smartphone. This allows the cat-shaped robot to be linked to security systems outside the home and perform monitoring even when away from home, improving security outside the home.

[0083] The security function can be linked with a smartphone app to enable remote operation. For example, the security function can be linked with a smartphone app to enable a user to remotely operate a security camera. For example, the user can change the camera's viewpoint using their smartphone. The security function can also be linked with a smartphone app to enable a user to remotely operate a smart lock. For example, the user can unlock a door using their smartphone. The security function can also be linked with a smartphone app to enable a user to remotely set a security alarm. For example, the user can set an alarm using their smartphone. By linking the security function with a smartphone app, it becomes possible to operate the security camera from a remote location, improving user convenience.

[0084] The emotion estimation function can provide security notifications that give the user a sense of security. For example, the emotion estimation function notifies the user of a message that gives the user a sense of security when the user is feeling anxious. For example, if the user speaks in an anxious voice, the emotion estimation function notifies the user of the security status in detail when the user is feeling anxious. For example, if the user speaks in an anxious voice, the emotion estimation function notifies the user of the current security status in detail. The emotion estimation function also notifies the user of a prompt response when the user is feeling anxious. For example, if the user speaks in an anxious voice, the emotion estimation function notifies the user that a prompt response has been taken. In this way, by using the emotion estimation function to provide security notifications that give the user a sense of security, the user's sense of security is improved.

[0085] The system according to the embodiment is not limited to the above-described example, and various modifications are possible, for example, as follows.

[0086] The cat robot can change the movement of its ears and tail in real time according to the tone and volume of the user's voice. For example, if the user's voice tone is high, the ears will stand up, and if it is low, they will droop. If the user speaks excitedly, the ears will stand up, and if they speak calmly, the ears will become relaxed. The tail movement also changes according to the volume of the user's voice. If the user speaks loudly, the tail will wag vigorously, and if they speak softly, the tail will wag slowly. This allows the cat robot's movements to change according to the tone and volume of the user's voice, enabling more natural interaction.

[0087] The cat-type robot can recognize and respond to user gestures. For example, when the user waves their hand, it walks in that direction. When the user waves their right hand, it walks to the right, and when the user waves their left hand, it walks to the left. When the user points their finger, it moves in that direction. When the user points their finger and says "go," it can walk in that direction. When the user claps their hands, it performs a specific action. When the user claps, the cat-type robot jumps. This allows the cat-type robot to react according to the user's gestures, making for more intuitive operation.

[0088] The cat robot can use its emotion estimation function to change its behavior depending on the user's emotions. For example, if the user is sad, the cat robot will slowly approach and sit at the user's feet. If the user is crying, the cat robot will snuggle up to the user. If the user is happy, the cat robot will express joy by moving its ears and tail. If the user speaks to it with a smile, the cat robot will perk up its ears and wag its tail. If the user is angry, the cat robot will keep its distance. If the user speaks in an angry voice, the cat robot will move a little further away. This allows the cat robot's behavior to change depending on the user's emotions, enabling more natural interactions.

[0089] The cat-type robot can change into the shape of an animal and reproduce the animal's movements. For example, it can change into a dog-type robot and reproduce the movement of barking with its ears perked up. When the user commands "bark," the dog-type robot barks. It can also change into a bird-type robot and reproduce the movement of flapping its wings. When the user commands "fly," the bird-type robot performs the movement of flapping its wings. It can also change into a fish-type robot and reproduce the movement of swimming. When the user commands "swimming," the fish-type robot performs the movement of swimming. This allows the shape of the cat-type robot to be changed into other animals and reproduce the movements of different animals, thereby meeting the diverse needs of users.

[0090] The cat robot can work in conjunction with other robots and devices in the home to perform cooperative actions. For example, it can work in conjunction with a cleaning robot, following the cleaning robot as it moves. While the cleaning robot is cleaning the room, the cat robot follows behind it. It can also work in conjunction with a smart speaker, and when music is played, it moves its ears and tail and dances to the rhythm. When music plays from the smart speaker, the cat robot starts dancing. It can also work in conjunction with a smart display, changing its behavior depending on the information displayed on the display. When weather information is displayed on the display, the cat robot will act as if it is holding an umbrella. This allows the cat robot to work in conjunction with other robots and devices in the home to perform cooperative actions, improving convenience within the home.

[0091] The cat robot can use the emotion estimation function to adjust its behavior when interacting with other pets. For example, when a real cat approaches, the cat robot will prick up its ears and act alert. When a real cat approaches the cat robot, the cat robot will assume an alert posture. When a real dog approaches, the cat robot will wag its tail and act friendly. When a real dog approaches the cat robot, the cat robot will wag its tail to welcome it. Furthermore, the cat robot will act quietly when a real bird is nearby. When a real bird is near the cat robot, the cat robot will move quietly. This allows the cat robot to use the emotion estimation function to adjust its behavior when interacting with other pets, enabling more natural interactions.

[0092] Generative AI can learn a user's past conversation history and generate personalized responses. For example, it can learn what a user has said in the past and provide relevant information when the same topic comes up. If a user talks about a hobby they previously mentioned, it can provide new information related to that hobby. It can also generate responses that reflect the user's preferences and interests based on the user's past conversation history. If a user talks about a movie they like, it can provide information related to that movie. It can also analyze a user's past conversation history, understand the user's emotions and intentions, and generate responses. It can infer the user's emotions from what the user has said in the past and respond according to those emotions. In this way, generative AI can learn from a user's past conversation history and generate more personalized responses.

[0093] The communication function adds recognition of the user's facial expressions and can generate responses according to their expressions. For example, if the user smiles, the cat robot will respond with "You look like you're having fun." If the user speaks to the cat robot with a smile, it will respond positively according to the smile. If the user looks sad, the cat robot will respond with "Are you okay?" If the user looks sad, the cat robot will provide support according to the expression. If the user looks surprised, the cat robot will respond with "Is something surprising happening?" If the user looks surprised, the cat robot will ask a question according to the expression. This allows for more natural communication by generating responses according to the user's facial expressions.

[0094] The cat robot can constantly monitor the status of IoT devices in the home and notify the user if an abnormality occurs. For example, it can monitor the status of a smart thermostat and notify the user if an abnormal temperature change occurs. It can issue a warning if the temperature rises suddenly. It can also monitor the status of a smart lock and notify the user if abnormal behavior occurs. It can issue a warning if a door is opened unauthorizedly. It can also monitor the status of a smart camera and notify the user if suspicious movement is detected. It can issue a warning if a suspicious person breaks in at night. This improves safety within the home by constantly monitoring the status of IoT devices in the home and notifying the user if an abnormality occurs.

[0095] It is possible to learn the operation history of IoT devices and automatically operate the devices based on the user's behavioral patterns. For example, it can learn the operation history of a smart light, remember that the user turns off the light at the same time every night, and automatically turn it off. It can turn off the light when the user goes to bed. It can also learn the operation history of a smart thermostat, remember that the user adjusts the temperature at a specific time, and automatically adjust the temperature. It can adjust the room temperature when the user returns home. It can also learn the operation history of a smart lock, remember that the user locks the door at a specific time, and automatically lock it. It can lock the door when the user leaves the house. In this way, user convenience is improved by learning the operation history of IoT devices and automatically operating devices based on the user's behavioral patterns.

[0096] The processing flow of the second embodiment will be briefly explained below.

[0097] Step 1: The cat-like robot recognizes the user's voice. For example, the cat-like robot uses a microphone to collect the user's voice and transmit it to the voice recognition unit. The voice recognition unit converts the user's voice into text data using voice recognition technology. The voice recognition unit can also use noise canceling technology to remove ambient noise and improve the accuracy of voice recognition. Step 2: The natural language processing unit analyzes the speech recognized by the speech recognition unit. For example, the natural language processing unit uses a generation AI (e.g., text generation AI or multimodal generation AI) to understand the content of the user's speech and generate an appropriate response. The natural language processing unit can also analyze the user's emotions and intentions and reflect them in the response. Step 3: The IoT integration unit operates IoT devices in the home based on the content analyzed by the natural language processing unit. For example, the IoT integration unit can connect to devices such as smart lights, smart thermostats, and smart locks and operate them using voice commands. The IoT integration unit can also remotely control the behavior and settings of the cat robot via a smartphone app.

[0098] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0099] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> Examples of generative AIs include the data generation model 58, such as a neural network model (e.g., a neural network model), and a neural network model (e.g., a neural network model). The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating speech, text data indicating text, and image data indicating an image is also input to the data generation model 58. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization. The specification processing unit 290 performs the above-mentioned specification processing using the data generation model 58. The data generation model 58 may be a fine-tuned model so as to output an inference result from a prompt that does not include an instruction. In this case, the data generation model 58 can output an inference result from a prompt that does not include an instruction. The data processing device 12 and the like include multiple types of data generation models 58, and the data generation model 58 includes AIs other than the generative AI. The AI ​​other than the generative AI may be, for example, linear regression, logistic regression, decision tree, random forest, support vector machine (SVM), k-means clustering, convolutional neural network (CNN), recurrent neural network (RNN), generative adversarial network (GAN), or naive Bayes, and can perform various processes, but is not limited to these examples. The AI ​​may also be an AI agent. When the processes of each of the above-mentioned parts are performed by AI, the processes may be performed in part or entirely by AI, but are not limited to these examples. The processes performed by AI, including the generative AI, may be replaced with rule-based processes.

[0100] Furthermore, the processing by the data processing system 10 described above is executed by the specific processing unit 290 of the data processing device 12 or the control unit 46A of the smart device 14, but may also be executed by the specific processing unit 290 of the data processing device 12 and the control unit 46A of the smart device 14. Furthermore, the specific processing unit 290 of the data processing device 12 acquires or collects information necessary for processing from the smart device 14 or an external device, and the smart device 14 acquires or collects information necessary for processing from the data processing device 12 or an external device.

[0101] [Second embodiment] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0102] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0103] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN and / or a LAN.

[0104] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0105] The microphone 238 receives instructions and the like from the user by receiving voice uttered by the user. The microphone 238 captures the voice uttered by the user, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to instructions from the processor 46.

[0106] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the user's surroundings (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0107] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0108] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0109] The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0110] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290. The identification processing unit 290 can estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0111] In the smart glasses 214, the specific processing is performed by the processor 46. A specific processing program 60 is stored in the storage 50. The processor 46 reads the specific processing program 60 from the storage 50 and executes the read specific processing program 60 on the RAM 48. The specific processing is realized by the processor 46 operating as the control unit 46A in accordance with the specific processing program 60 executed on the RAM 48. Note that the smart glasses 214 may have a data generation model and an emotion identification model similar to the data generation model 58 and the emotion identification model 59.

[0112] Note that a device other than the data processing device 12 may have the data generation model 58. For example, a server device may have the data generation model 58. In this case, the data processing device 12 communicates with the server device having the data generation model 58 to obtain a processing result (such as a prediction result) using the data generation model 58. Furthermore, the data processing device 12 may be a server device, or may be a terminal device (for example, a mobile phone, a robot, a home appliance, etc.) owned by a user.

[0113] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0114] The data generation model 58 is a so-called generative AI. An example of the data generation model 58 is a generative AI such as ChatGPT. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 receives a prompt containing an instruction, as well as inference data such as voice data representing speech, text data representing text, and image data representing an image. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization. The identification processing unit 290 performs the above-mentioned identification processing using the data generation model 58. The data generation model 58 may be a fine-tuned model so as to output an inference result from a prompt that does not include an instruction. In this case, the data generation model 58 can output an inference result from a prompt that does not include an instruction. The data processing device 12 and the like include multiple types of data generation models 58, and the data generation model 58 includes AIs other than the generative AI. The AI ​​other than the generative AI may be, for example, linear regression, logistic regression, decision tree, random forest, support vector machine (SVM), k-means clustering, convolutional neural network (CNN), recurrent neural network (RNN), generative adversarial network (GAN), or naive Bayes, and can perform various processes, but is not limited to these examples. The AI ​​may also be an AI agent. When the processes of each of the above-mentioned parts are performed by AI, the processes may be performed in part or entirely by AI, but are not limited to these examples. The processes performed by AI, including the generative AI, may be replaced with rule-based processes.

[0115] The data processing system 210 according to the second embodiment performs the same processing as the data processing system 10 according to the first embodiment. The processing by the data processing system 210 is executed by the specific processing unit 290 of the data processing device 12 or the control unit 46A of the smart glasses 214, but may also be executed by the specific processing unit 290 of the data processing device 12 and the control unit 46A of the smart glasses 214. Furthermore, the specific processing unit 290 of the data processing device 12 acquires or collects information required for processing from the smart glasses 214 or an external device, etc., and the smart glasses 214 acquires or collects information required for processing from the data processing device 12 or an external device, etc.

[0116] [Third embodiment] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0117] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0118] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN and / or a LAN.

[0119] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0120] The microphone 238 receives instructions and the like from the user by receiving voice uttered by the user. The microphone 238 captures the voice uttered by the user, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to instructions from the processor 46.

[0121] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the user's surroundings (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0122] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0123] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0124] The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0125] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290. The identification processing unit 290 can estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0126] In the headset type terminal 314, the identification process is performed by the processor 46. A identification program 60 is stored in the storage 50. The processor 46 reads the identification program 60 from the storage 50 and executes the read identification program 60 on the RAM 48. The identification process is realized by the processor 46 operating as a control unit 46A in accordance with the identification program 60 executed on the RAM 48. Note that the headset type terminal 314 may also have a data generation model and an emotion identification model similar to the data generation model 58 and the emotion identification model 59.

[0127] Note that a device other than the data processing device 12 may have the data generation model 58. For example, a server device may have the data generation model 58. In this case, the data processing device 12 communicates with the server device having the data generation model 58 to obtain a processing result (such as a prediction result) using the data generation model 58. Furthermore, the data processing device 12 may be a server device, or may be a terminal device (for example, a mobile phone, a robot, a home appliance, etc.) owned by a user.

[0128] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0129] The data generation model 58 is a so-called generative AI. An example of the data generation model 58 is a generative AI such as ChatGPT. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 receives a prompt containing an instruction, as well as inference data such as voice data representing speech, text data representing text, and image data representing an image. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization. The identification processing unit 290 performs the above-mentioned identification processing using the data generation model 58. The data generation model 58 may be a fine-tuned model so as to output an inference result from a prompt that does not include an instruction. In this case, the data generation model 58 can output an inference result from a prompt that does not include an instruction. The data processing device 12 and the like include multiple types of data generation models 58, and the data generation model 58 includes AIs other than the generative AI. The AI ​​other than the generative AI may be, for example, linear regression, logistic regression, decision tree, random forest, support vector machine (SVM), k-means clustering, convolutional neural network (CNN), recurrent neural network (RNN), generative adversarial network (GAN), or naive Bayes, and can perform various processes, but is not limited to these examples. The AI ​​may also be an AI agent. When the processes of each of the above-mentioned parts are performed by AI, the processes may be performed in part or entirely by AI, but are not limited to these examples. The processes performed by AI, including the generative AI, may be replaced with rule-based processes.

[0130] The data processing system 310 according to the third embodiment performs the same processing as the data processing system 10 according to the first embodiment. The processing by the data processing system 310 is executed by the specific processing unit 290 of the data processing device 12 or the control unit 46A of the headset type terminal 314, but may also be executed by the specific processing unit 290 of the data processing device 12 and the control unit 46A of the headset type terminal 314. Furthermore, the specific processing unit 290 of the data processing device 12 acquires or collects information required for processing from the headset type terminal 314 or an external device, etc., and the headset type terminal 314 acquires or collects information required for processing from the data processing device 12 or an external device, etc.

[0131] [Fourth embodiment] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[0132] 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0133] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN and / or a LAN.

[0134] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[0135] The microphone 238 receives instructions and the like from the user by receiving voice uttered by the user. The microphone 238 captures the voice uttered by the user, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to instructions from the processor 46.

[0136] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS image sensor or a CCD image sensor, and captures images of the user's surroundings (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0137] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0138] The control object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[0139] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0140] The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0141] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290. The identification processing unit 290 can estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0142] In the robot 414, the processor 46 performs the identification process. A identification program 60 is stored in the storage 50. The processor 46 reads the identification program 60 from the storage 50 and executes the read identification program 60 on the RAM 48. The identification process is realized by the processor 46 operating as a control unit 46A in accordance with the identification program 60 executed on the RAM 48. The robot 414 may have a data generation model and an emotion identification model similar to the data generation model 58 and the emotion identification model 59.

[0143] Note that a device other than the data processing device 12 may have the data generation model 58. For example, a server device may have the data generation model 58. In this case, the data processing device 12 communicates with the server device having the data generation model 58 to obtain a processing result (such as a prediction result) using the data generation model 58. Furthermore, the data processing device 12 may be a server device, or may be a terminal device (for example, a mobile phone, a robot, a home appliance, etc.) owned by a user.

[0144] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[0145] The data generation model 58 is a so-called generative AI. An example of the data generation model 58 is a generative AI such as ChatGPT. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 receives a prompt containing an instruction, as well as inference data such as voice data representing speech, text data representing text, and image data representing an image. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization. The identification processing unit 290 performs the above-mentioned identification processing using the data generation model 58. The data generation model 58 may be a fine-tuned model so as to output an inference result from a prompt that does not include an instruction. In this case, the data generation model 58 can output an inference result from a prompt that does not include an instruction. The data processing device 12 and the like include multiple types of data generation models 58, and the data generation model 58 includes AIs other than the generative AI. The AI ​​other than the generative AI may be, for example, linear regression, logistic regression, decision tree, random forest, support vector machine (SVM), k-means clustering, convolutional neural network (CNN), recurrent neural network (RNN), generative adversarial network (GAN), or naive Bayes, and can perform various processes, but is not limited to these examples. The AI ​​may also be an AI agent. When the processes of each of the above-mentioned parts are performed by AI, the processes may be performed in part or entirely by AI, but are not limited to these examples. The processes performed by AI, including the generative AI, may be replaced with rule-based processes.

[0146] The data processing system 410 according to the fourth embodiment performs the same processing as the data processing system 10 according to the first embodiment. The processing by the data processing system 410 is executed by the specific processing unit 290 of the data processing device 12 or the control unit 46A of the robot 414, but may also be executed by the specific processing unit 290 of the data processing device 12 and the control unit 46A of the robot 414. Furthermore, the specific processing unit 290 of the data processing device 12 acquires or collects information required for processing from the robot 414 or an external device, etc., and the robot 414 acquires or collects information required for processing from the data processing device 12 or an external device, etc.

[0147] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0148] FIG. 9 illustrates an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and behaviors arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion encompasses both emotions and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[0149] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[0150] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[0151] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is expressed, and when they approach the ideal, a state of pleasure is expressed. Emotions can also be created for robots, cars, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is expressed, and when they approach the ideal, a state of pleasure is expressed. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on speech emotion recognition and brain physiological signal analysis systems for emotions, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the area called "reaction," where sensation is dominant. The right half of the emotion map lists emotions belonging to the area called "situation," where situational awareness is dominant.

[0152] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[0153] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[0154] In the above embodiment, an example was given in which a specific process is performed by one computer 22, but the technology disclosed herein is not limited to this, and distributed processing of the specific process may be performed by multiple computers including computer 22.

[0155] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[0156] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0157] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[0158] The hardware resource for executing a specific process can be any of the following types of processors: A processor, for example, is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. A processor also includes a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[0159] The hardware resource that executes the specific process may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific process may be a single processor.

[0160] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[0161] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[0162] In the above example, the first to fourth embodiments have been described separately, but some or all of these embodiments may be combined. The smart device 14, smart glasses 214, headset terminal 314, and robot 414 are merely examples, and they may be combined, or other devices may be used. In the above example, the first and second embodiments have been described separately, but they may be combined.

[0163] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[0164] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference. [Explanation of symbols]

[0165] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot

Claims

1. A cat-shaped robot, a speech recognition unit that recognizes a user's speech; a natural language processing unit that analyzes the speech recognized by the speech recognition unit; an IoT cooperation unit that operates IoT devices in the home based on the content analyzed by the natural language processing unit. A system characterized by:

2. The cat-type robot is Using an emotion estimation function, the behavior is changed according to the emotion of the user.

2. The system of claim 1.

3. The cat-type robot is Change into the shape of an animal and reproduce the movements of said animal 2. The system of claim 1.

4. The generating AI is Learns the user's past conversation history and generates personalized responses 2. The system of claim 1.

5. The cat-type robot is The status of the IoT devices in the home is constantly monitored, and if an abnormality occurs, the user is notified.

2. The system of claim 1.

6. The cat-type robot is Making the emotional expressions responsive to the user's emotions in real time 2. The system of claim 1.

7. The cat-type robot is It works in conjunction with the home security camera and automatically starts recording when an abnormality is detected.

2. The system of claim 1.

8. The emotion estimation function Generate a response according to the user's emotions and have a conversation to improve the user's mood.

2. The system of claim 1.

Images