system
A spherical device with sensors and generative AI analyzes cat preferences and behavioral patterns to provide tailored stimulation, addressing the limitations of conventional toys by adapting to individual cat needs and changes.
Patent Information
- Application Number
- JP2024164553
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2023-09-21
- Filing Date
- 2024-09-20
- Publication Date
- 2026-02-25
- Estimated Expiration
- 2044-09-20
AI Technical Summary
Conventional cat toys struggle to respond to individual cat preferences and behavioral patterns, failing to provide appropriate stimulation based on the cat's play style and adapting to changes in these patterns.
A spherical, freely mobile device equipped with sensors to detect cat movements and behavioral patterns, coupled with generative AI to analyze preferences and play styles, providing appropriate reactions and stimuli based on these insights.
The system effectively responds to individual cat preferences and behavioral patterns, adapting to changes over time, ensuring continuous engagement and enjoyment.
Smart Images

Figure 0007820465000001 
Figure 0007820465000002 
Figure 0007820465000003
Abstract
Description
[Technical Field]
[0001] The technology of the present disclosure relates to a system. [Background technology]
[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]
[0004] Conventional cat toys have difficulty responding to individual cat preferences and behavioral patterns, and it is also difficult to respond to changes in cat behavioral patterns. Furthermore, there have been no toys that can understand how cats play and provide appropriate stimulation based on that. [Means for solving the problem]
[0005] The present invention provides a spherical, freely mobile device, a means for controlling the device from a smartphone, a sensor installed in the device that detects the cat's movements and behavioral patterns, a generative AI that analyzes data from the sensor and understands the cat's preferences and play styles, and a means for providing appropriate reactions and stimuli to the cat based on the AI. This makes it possible to respond to individual cat preferences and behavioral patterns and to respond to changes in those preferences and patterns. It is also possible to understand the cat's play style and provide appropriate stimuli based on that. [Brief explanation of the drawings]
[0006] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 2 is a sequence diagram showing a flow of processing in the data processing system according to the first embodiment of the first form example. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Embodiment 1. [Figure 13] FIG. 10 is a sequence diagram showing a processing flow of a data processing system in a second embodiment of the second form example. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Embodiment Example 2. [Figure 15] FIG. 10 is a sequence diagram showing the flow of processing in a data processing system according to a third embodiment of the third embodiment. [Figure 16] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Embodiment 3. [Figure 17] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the first embodiment of the first form example when an emotion engine is combined. [Figure 18] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Form Example 1 when an emotion engine is combined. [Figure 19] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the second embodiment of the second form example when an emotion engine is combined. [Figure 20] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Form Example 2 when an emotion engine is combined. [Figure 21] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the third embodiment of the third form example when an emotion engine is combined. [Figure 22] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Form Example 3 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION
[0007] An example of an embodiment of a system according to the disclosed technique will be described below with reference to the accompanying drawings.
[0008] do.
[0009] First, the terms used in the following description will be explained.
[0010] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, the processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), or a TPU (TENSOR PROCESSING UNIT (registered trademark)).
[0011] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.
[0012] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.
[0013] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.
[0014] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."
[0015] [First embodiment]
[0016] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.
[0017] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0018] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0019] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.
[0020] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0021] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0022] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.
[0023] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0024] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0025] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0026] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0027] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.
[0028] "Example 1"
[0029] In one embodiment of the present invention, a spherical device is provided. This device has an internal driving source such as a motor or battery, allowing it to move freely around. A sensor for detecting the cat's movements and behavioral patterns is located on the outside of the device. This sensor detects the cat's movements and behavioral patterns and transmits the data to a generative AI. The generative AI analyzes the received data and understands the cat's preferences and play styles. Based on this understanding, it then transmits instructions to the device to provide the cat with appropriate reactions and stimuli. The device operates in accordance with the instructions and provides the cat with appropriate reactions and stimuli.
[0030] "Example 2"
[0031] As a specific example, if a cat exhibits aggressive behavior toward the device, a sensor detects the behavior and sends that information to the generative AI. The generative AI analyzes the information and understands that cats prefer aggressive play. Based on that understanding, it instructs the device to perform actions that stimulate the cat. The device then acts according to the instructions and provides the cat with appropriate stimulation.
[0032] "Example 3"
[0033] The generative AI also accumulates data on the cat's behavior over time and learns changes in the cat's behavioral patterns based on that data. For example, if a cat initially prefers aggressive play but develops a preference for gentler play over time, the generative AI will learn this change and issue appropriate instructions to the device based on that learning. This makes it possible to provide appropriate reactions and stimuli in response to changes in the cat's behavioral patterns.
[0034] The processing flow of each embodiment will be described below.
[0035] "Example 1"
[0036] Step 1: The spherical device starts working, and sensors begin to detect the cat's movements and behavior patterns.
[0037] Step 2: The sensors detect the cat's movements and behavioral patterns and send that data to the generative AI.
[0038] Step 3: The generative AI analyzes the received data to understand the cat's preferences and play habits.
[0039] Step 4: Based on that understanding, the generative AI sends instructions to the device to provide the appropriate reaction or stimulation to the cat.
[0040] Step 5: The device will then act on the instructions and provide the appropriate reaction or stimulus to your cat.
[0041] "Example 2"
[0042] Step 1: Your cat exhibits aggressive behavior towards the device.
[0043] Step 2: The sensor detects the behavior and sends that information to the generative AI.
[0044] Step 3: The generative AI analyzes the information and understands that cats prefer aggressive play.
[0045] Step 4: Based on that understanding, the generative AI instructs the device to perform actions that stimulate the cat.
[0046] Step 5: The device will follow the instructions and provide the appropriate stimulation to your cat.
[0047] "Example 3"
[0048] Step 1: The generative AI accumulates cat behavior data over time.
[0049] Step 2: The generative AI learns changes in the cat's behavioral patterns based on the accumulated data.
[0050] Step 3: The generative AI uses its learning to issue appropriate instructions to the device.
[0051] Step 4: The device follows the instructions and provides appropriate reactions and stimuli in response to changes in the cat's behavioral patterns.
[0052] Example 1
[0053] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0054] Conventional animal play equipment has the problem that it is difficult to provide appropriate reactions and stimulation to keep animals interested, and animals quickly become bored. In addition, there is a lack of a system that can analyze animals' behavior patterns in real time and control their movements based on that, making it difficult to provide play styles that suit individual animals' preferences.
[0055] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0056] In this invention, the server includes a spherical device that can move around freely, a means for operating the device from an information terminal, a sensor installed in the device that detects the animal's movements and behavior patterns, a generative artificial intelligence that analyzes data from the sensor and understands the animal's preferences and ways of playing, a means for providing the animal with appropriate reactions and stimuli based on the artificial intelligence, a means for generating instructions for controlling the operation of the device and sending the instructions to the device, and a means for the device to operate in accordance with the instructions and provide the animal with appropriate reactions and stimuli. This makes it possible to analyze the behavior patterns of animals in real time and provide appropriate reactions and stimuli according to the preferences of each individual animal.
[0057] The "device" is a spherical, freely movable device equipped with sensors that detect the movements and behavioral patterns of animals.
[0058] An "information terminal" is an electronic device that provides a means for operating a device, and includes smartphones, tablets, and the like.
[0059] A "sensor" is a device that detects animal movements and behavior patterns and is installed in a device.
[0060] "Generative AI" is an AI system that analyzes data from sensors to understand animals' preferences and play styles.
[0061] "Means for providing reactions or stimuli" refers to mechanisms or methods for providing appropriate reactions or stimuli to animals based on generative artificial intelligence.
[0062] "Means for generating instructions" refers to a mechanism or method for generating instructions to control the operation of a device based on data analyzed by the generative artificial intelligence.
[0063] The "means for sending instructions" refers to a communication means for sending the generated instructions to the device.
[0064] "Means for controlling behavior" refers to the mechanism or method by which the device operates according to the instructions it receives and provides the animal with an appropriate reaction or stimulus.
[0065] This invention is a system that analyzes the behavioral patterns of animals in real time and provides appropriate reactions and stimuli according to the preferences of each individual animal. Specific embodiments of this system will be described below.
[0066] System configuration
[0067] The system consists of the following main components:
[0068] 1. Device: A spherical, freely movable device equipped with sensors that detect animal movements and behavior patterns.
[0069] 2. Information terminal: An electronic device that provides a means to operate a device, including smartphones and tablets.
[0070] 3. Sensor: A device that detects animal movements and behavior patterns and is installed in the device.
[0071] 4. Generative AI: An artificial intelligence system that analyzes data from sensors to understand the animal's preferences and play styles.
[0072] 5. Means of providing reactions and stimuli: Mechanisms and methods for providing appropriate reactions and stimuli to animals based on generative artificial intelligence.
[0073] 6. Means for generating instructions: A mechanism or method for generating instructions to control the operation of a device based on data analyzed by generative artificial intelligence.
[0074] 7. Means for sending instructions: A communication means for sending the generated instructions to the device.
[0075] 8. Means of controlling behavior: The mechanism or method by which the device operates according to the instructions it receives and provides the appropriate reaction or stimulus to the animal.
[0076] System Operation
[0077] 1. Initialize the device
[0078] The user turns on the device.
[0079] The device checks the internal motor and battery to ensure they are in working order.
[0080] The device calibrates the sensors to ensure accurate data collection.
[0081] 2. Data collection
[0082] The device uses sensors on the device to detect animal movements and behavior patterns in real time.
[0083] The device temporarily stores the detected data.
[0084] 3. Data transmission
[0085] The terminal transmits the collected data to the server.
[0086] The server receives the data and prepares it for analysis.
[0087] 4. Data Analysis
[0088] The server passes the received data to the generative artificial intelligence.
[0089] Generative AI analyzes the data to understand the animal's preferences and behavioral patterns.
[0090] 5. Instruction Generation
[0091] Based on the analysis results, generative artificial intelligence generates instructions to provide the animal with appropriate reactions and stimuli.
[0092] The server receives the generated instructions.
[0093] 6. Sending instructions
[0094] The server sends the generated instructions to the terminal.
[0095] The terminal receives the instruction and transmits it to the device.
[0096] 7. Device Operation
[0097] The terminal operates the device according to the instructions received.
[0098] The device provides the animal with the appropriate reaction or stimulus.
[0099] Specific examples
[0100] For example, if a cat approaches the device, the device's sensor detects its movement. The server determines that the cat is interested in the device and sends the data to the generative AI. The generative AI generates an instruction to "move the device slightly to attract the cat." The server sends the instruction to the device, which then moves the device.
[0101] Prompt Sentence Examples
[0102] "Generate an appropriate reaction when a cat approaches the device."
[0103] "If your cat likes to chase the device, tell them what movements to direct it to."
[0104] In this way, the system can analyze the animal's behavior in real time and provide appropriate reactions to keep the animal engaged.
[0105] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0106] Step 1: Initialize your device
[0107] Input: A user turns on the device.
[0108] Processing: The device checks the internal motors and batteries to ensure they are working properly, and calibrates the sensors to ensure accurate data collection.
[0109] Output: The device is ready to operate normally.
[0110] Specific operation: The user presses the power button on the device, and the terminal checks the device's LED indicator to confirm normal operation.
[0111] Step 2: Collect data
[0112] Input: The device detects animal movements and behavior patterns.
[0113] Processing: The device uses the device's sensors to detect animal movements and behavior patterns in real time and temporarily store the data.
[0114] Output: Data is collected on animal movements and behavior patterns.
[0115] Specific operation: The device uses sensors to detect the cat's movement as it approaches the device and stores the data in memory.
[0116] Step 3: Sending data
[0117] Input: Collected animal movement and behavior pattern data.
[0118] Processing: The device sends the collected data to the server, which receives the data and prepares it for analysis.
[0119] Output: Data is sent to the server and ready for analysis.
[0120] Specific operation: The device sends data to the server via Wi-Fi, and the server receives the data and stores it in a database.
[0121] Step 4: Analyze the data
[0122] Input: Data on animal movements and behavior patterns received by the server.
[0123] Processing: The server passes the received data to the generative AI, which analyzes the data to understand the animal's preferences and behavioral patterns.
[0124] Output: Analysis results on the animal's preferences and behavior patterns.
[0125] Specific operation: The server inputs data into the generative AI, which then concludes that "cats like to chase balls."
[0126] Step 5: Generate instructions
[0127] Input: Analysis results by generative artificial intelligence.
[0128] Processing: Based on the analysis results, the generative AI generates instructions to provide appropriate reactions and stimuli to the animals. The server receives the generated instructions.
[0129] Output: Instructions for providing the appropriate reaction or stimulus to the animal.
[0130] Specific operation: The generative artificial intelligence generates the instruction "rotate the device to the right," and the server receives that instruction.
[0131] Step 6: Sending instructions
[0132] Input: Generated instructions.
[0133] Processing: The server sends the generated instruction to the terminal, and the terminal receives the instruction and transmits it to the device.
[0134] Output: The instructions sent to the device.
[0135] Specific operation: The server sends instructions to the terminal via Wi-Fi, and the terminal receives the instructions and passes them on to the device.
[0136] Step 7: Device Operation
[0137] Input: Instructions received by the terminal.
[0138] Processing: The terminal operates the device according to the instructions received and provides the animal with the appropriate reaction or stimulus.
[0139] Output: The appropriate reaction or stimulus provided to the animal.
[0140] Specific behavior: The terminal controls the motor of the device and rotates it to the right. The device rotates in front of the cat, and the cat chases it.
[0141] (Application example 1)
[0142] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0143] Conventional pet devices have difficulty fully understanding the movements and behavior patterns of animals and providing appropriate reactions and stimuli. Furthermore, there are insufficient means to provide a fun environment for animals in physical stores. This has resulted in insufficient reduction of stress for animals and improvement of customer satisfaction.
[0144] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0145] In this invention, the server includes a spherical device that can move around freely, a means for operating the device from a smartphone, a sensor installed in the device that detects the animal's movements and behavior patterns, a generative AI that analyzes data from the sensor and understands the animal's preferences and ways of playing, a means for providing the animal with appropriate reactions and stimuli based on the AI, and a means for the device to detect the animal's movements within the physical store and provide appropriate reactions and play using the generative AI, allowing the animal to have fun within the physical store and improving customer satisfaction.
[0146] A "spherical device that can move freely" is a spherical device that has a power source such as a motor or battery inside and can move in any direction.
[0147] "Means for operating from a smartphone" refers to an interface or application for remotely controlling the operation of a device using a smartphone.
[0148] A "sensor that detects animal movements and behavioral patterns" is a device that detects the position, speed, direction, and other movements of animals and collects that data.
[0149] "Generative AI" is an artificial intelligence model that analyzes collected animal movement and behavior data to understand animals' preferences and play styles.
[0150] "Means for providing appropriate reactions and stimuli to animals" refers to a mechanism that allows animals to take appropriate actions and react based on instructions generated by the generative AI.
[0151] "Means of detecting animal movements within a physical store and using generative AI to provide appropriate reactions and play" refers to a system that detects animal movements within a physical store in real time, sends that data to generative AI, and provides appropriate reactions and play for the animals.
[0152] This invention is a system for providing an environment in a physical store where animals, especially cats, can have fun. The system includes a spherical, freely moving device, a means for controlling it from a smartphone, sensors that detect the animal's movements and behavior patterns, generative AI, and a means for providing appropriate reactions and stimuli to the animal.
[0153] System configuration
[0154] 1. Spherical device:
[0155] It is equipped with a motor and battery inside, allowing it to move in any direction.
[0156] There are sensors on the outside to detect animal movement.
[0157] 2. Methods for operating from a smartphone:
[0158] An application is provided for remotely controlling the operation of a device using a smartphone.
[0159] 3. Sensors that detect animal movements and behavior patterns:
[0160] It senses and collects data on the animal's location, speed, direction, and other movements.
[0161] 4. Generative AI:
[0162] The collected data on animal movements and behavior is analyzed to understand the animals' preferences and play styles.
[0163] Using a generative AI model, appropriate reactions and stimuli are generated for animals.
[0164] 5. Means of providing appropriate reactions and stimuli to animals:
[0165] Based on the instructions generated by the generative AI, the robot will perform appropriate actions and reactions towards the animal.
[0166] Program processing explanation
[0167] The server sends animal movement data collected from sensors to the generative AI. The generative AI analyzes this data to understand the animal's preferences and play styles. Based on this understanding, it generates instructions to provide the animal with appropriate reactions and stimuli. These instructions are then sent to the device, which then performs the appropriate action on the animal.
[0168] The hardware used includes sensors to detect animal movement, motors to power the device, and a battery to power the device, while the software used includes a generative AI model, a sensor control module, and a motor control module.
[0169] Specific examples
[0170] For example, when a cat approaches a device in a pet shop, a sensor detects its movement and sends the data to a generative AI. The generative AI then generates a movement that will interest the cat and sends that instruction to the device. The device then begins to move as if the cat is chasing it, attracting the cat's attention.
[0171] When a cat touches the device in a cafe, the sensor detects the movement and sends the data to the generative AI. The generative AI generates a rotating motion that the cat will enjoy and sends that instruction to the device. The device rotates in a way that the cat enjoys, attracting the cat's interest.
[0172] Prompt Sentence Examples
[0173] "Enter your cat's movement data, including its position, speed, and direction. Use this data to generate reactions that will interest your cat."
[0174] The above is an embodiment of the present invention. This system allows animals to have fun in a physical store, improving customer satisfaction.
[0175] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0176] Step 1:
[0177] The sensor detects the animal's movement. The sensor collects data such as the animal's position, speed, and direction, and sends the data to the server. The input is the animal's movement data, and the output is the movement data sent to the server.
[0178] Step 2:
[0179] The server receives animal movement data from the sensors and sends it to the generative AI. The generative AI analyzes this data to understand the animal's preferences and play styles. The input is movement data from the sensors, and the output is the analysis results by the generative AI.
[0180] Step 3:
[0181] The generative AI generates appropriate reactions and stimuli for the animal based on the analysis results. The generative AI generates actions and responses that will interest the animal and sends these instructions to the server. The input is the analysis result of the animal's movement data, and the output is the generated reaction or stimulus instructions.
[0182] Step 4:
[0183] The server sends instructions received from the generative AI to the device. The device begins to operate based on the received instructions. The input is the instruction from the generative AI, and the output is the device's operation.
[0184] Step 5:
[0185] The device provides appropriate reactions and stimuli to the animal. The device operates according to the animal's movements and performs actions that the animal enjoys. The input is instructions from the server, and the output is reactions and stimuli to the animal.
[0186] Step 6:
[0187] The device detects physical stimuli from the animal and feeds that data back to the server. The server then sends this data to the generative AI and stores it as animal behavior data. The input is the physical stimulus data from the animal, and the output is feedback data to the generative AI.
[0188] The above are the specific processing steps of this system. The specific actions performed at each step allow animals to have fun in the physical store.
[0189] Example 2
[0190] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0191] Previous cat devices simply detected cat behavior and were unable to provide appropriate stimuli based on the cat's individual behavioral patterns and preferences. Furthermore, they lacked the ability to accumulate cat behavior data and learn over time, making it difficult to respond to changes in cat behavior patterns. Furthermore, they lacked the ability to automatically respond to physical stimuli from the cat and provide feedback on that response. This made it difficult to maintain a cat's interest, preventing effective play and training.
[0192] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0193] In this invention, the server includes a sensor means for detecting cat behavior, a terminal means for transmitting data from the sensor means to the server, a means for analyzing the data using a generative AI model in the server means, a device means for providing stimuli to the cat based on instructions from the server means, and a terminal means for controlling the device means. This enables real-time analysis of cat behavior data and provision of appropriate stimuli based on the individual cat's behavioral patterns and preferences. Furthermore, by accumulating cat behavior data over time and learning changes in behavioral patterns based on that data, the server can sustain the cat's interest. Furthermore, the server's ability to automatically respond to physical stimuli from the cat and provide feedback on that response allows for effective play and training.
[0194] "Sensor means" refers to a device for detecting the cat's behavior, and includes a motion sensor, a camera, etc.
[0195] The "terminal means" is a device for transmitting data from the sensor means to the server, and includes a data transmission module and a communication device.
[0196] The "server means" is a device that analyzes the received data using a generative AI model and generates instructions to provide appropriate stimulation to the cat.
[0197] A "generative AI model" is an artificial intelligence model that analyzes cat behavior data and generates instructions to provide appropriate stimuli based on the cat's behavioral patterns and preferences.
[0198] The "device means" refers to a device for providing stimulation to the cat based on instructions from the server means, and includes a robot arm, a laser pointer, etc.
[0199] "Real-time" means that data is processed immediately the moment it is generated, meaning immediate response without delay.
[0200] A "behavioral pattern" refers to a series of behavioral tendencies or habits that a cat exhibits in response to specific situations or stimuli.
[0201] "Feedback" refers to the device means' responses to physical stimuli from the cat being fed back to the generative AI model, allowing the generative AI model to learn and generate more appropriate instructions.
[0202] This invention is a system that detects cat behavior, analyzes the data, and provides appropriate stimuli to the cat. The system includes a sensor means, a terminal means, a server means, a generative AI model, and a device means.
[0203] First, the device detects the cat's behavior using sensors such as motion sensors and cameras. For example, if the cat scratches the device, the device will detect that behavior in real time.
[0204] The device then transmits the detected behavioral data to the server via a data transmission module, including the cat's movement patterns and location information, such as the time and location when the cat scratched the device.
[0205] The server inputs the received data into a generative AI model to analyze the cat's behavior. Examples of generative AI models used include OpenAI's GPT-4. The generative AI model determines whether the cat prefers aggressive play. For example, if the cat frequently exhibits aggressive behavior toward the device, the model learns that behavioral pattern.
[0206] The server then uses the analysis to instruct the device on the appropriate actions to stimulate the cat, such as moving a robotic arm to attract the cat's attention.
[0207] Finally, the terminal receives instructions from the server and controls the device to provide appropriate stimuli to the cat, such as moving a laser pointer to stimulate the cat.
[0208] As a concrete example, consider the following scenario: When a cat scratches the device with its claws, the motion sensor detects this movement. The sensor sends this information to the server via the data transmission module. The generative AI model analyzes the data and understands that cats prefer aggressive play. The generative AI model then instructs the robotic arm to perform actions that will attract the cat's attention. The robotic arm then follows these instructions and provides the cat with appropriate stimuli.
[0209] Examples of prompts to input to a generative AI model include:
[0210] "Your cat claws at the device. Analyze this behavior and determine if your cat likes aggressive play. Then instruct the device on the appropriate behavior to stimulate your cat."
[0211] The above is an embodiment of the present invention.
[0212] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0213] Step 1:
[0214] The device uses sensors to detect the cat's behavior. Specifically, motion sensors and cameras monitor the cat's movements in real time and detect aggressive behavior. For example, if the cat digs its claws into the device, this behavior will be detected.
[0215] Input: Cat movement
[0216] Output: Detected cat behavior data (e.g., time and location of cat claw movements)
[0217] Step 2:
[0218] The device transmits the detected behavioral data to the server via the data transmission module. Specifically, the data acquired from the sensor is packetized and sent to the server via the network.
[0219] Input: Detected cat behavior data
[0220] Output: Behavioral data sent to the server
[0221] Step 3:
[0222] The server inputs the received data into a generative AI model (e.g., GPT-4) to analyze the cat's behavior. Specifically, it inputs the behavioral data into a generative AI model (e.g., GPT-4) to determine whether the cat prefers aggressive play.
[0223] Input: Behavioral data sent to the server
[0224] Output: Analysis of cat behavior patterns (e.g., cats prefer aggressive play)
[0225] Step 4:
[0226] Based on the analysis results, the server instructs the device to perform appropriate actions to stimulate the cat. Specifically, it generates movement instructions for the robot arm and laser pointer based on the analysis results of the generative AI model.
[0227] Input: Analysis of cat behavior patterns
[0228] Output: Instructions for the device (e.g., moving the robot arm to attract the cat's attention)
[0229] Step 5:
[0230] The terminal receives instructions from the server and controls the device to provide appropriate stimuli to the cat, such as moving a robotic arm or laser pointer to entertain the cat.
[0231] Input: Operation instructions from the server
[0232] Output: The appropriate stimulus provided to the cat (e.g., robotic arm movement, laser pointer movement)
[0233] The above is the specific flow of the program processing of this system.
[0234] (Application example 2)
[0235] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0236] Conventional safety monitoring systems in factories have the problem of being unable to detect abnormal behavior of workers or machines in real time and take appropriate action quickly. In addition, there are only a limited number of systems that can understand animal behavior and provide appropriate stimuli, and they also have the problem of being unable to learn changes in animal behavior patterns. To solve these problems, a system is needed that can monitor the behavior of animals and workers in real time, detect abnormal behavior, and take appropriate action.
[0237] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[0238] In this invention, the server includes a spherical device that can move around freely, a means for operating the device from an information terminal, a sensor installed in the device that detects the movements and behavior patterns of the animal, a generative AI that analyzes data from the sensor and understands the animal's preferences and ways of playing, a means for providing the animal with appropriate reactions and stimuli based on the AI, a sensor that detects abnormal behavior of workers and machines in the factory, a means for transmitting data from the sensor to the generative AI and analyzing the abnormal behavior, and a means for instructing the animal on appropriate responses based on the analysis results. This makes it possible to learn changes in the animal's behavior patterns and provide appropriate stimuli, as well as to detect abnormal behavior of workers and machines in the factory in real time and respond quickly.
[0239] A "spherical device that can move freely" is a device that has a spherical shape and has the ability to physically move freely.
[0240] An "information terminal" is an electronic device used to remotely control devices such as smartphones and tablets.
[0241] A "sensor that detects animal movements and behavior patterns" is a device that detects animal movements and behavior in real time and acquires that data.
[0242] "Generative AI" is an artificial intelligence system that analyzes acquired data, understands the behavioral patterns of animals and workers, and generates appropriate responses.
[0243] "Means for providing appropriate reactions and stimuli to animals" refers to devices and methods for providing appropriate reactions and stimuli to animals based on the analysis results of generative AI.
[0244] A "sensor that detects abnormal behavior of workers and machines in a factory" is a device that monitors the behavior of workers and machines in a factory and detects abnormal behavior in real time.
[0245] "Means for analyzing abnormal behavior" refers to a method or device for transmitting data on detected abnormal behavior to the generative AI and analyzing that data.
[0246] "Means for instructing appropriate responses" refers to methods or devices for instructing appropriate responses to abnormal behavior based on the analysis results of generative AI.
[0247] As an embodiment of the present invention, the following system is constructed.
[0248] First, a spherical, freely movable device is prepared. This device is equipped with sensors that detect animal movements and behavioral patterns. The device can be controlled from an information terminal (e.g., a smartphone or tablet).
[0249] Next, we prepare a generative AI. This generative AI analyzes the data from the sensors to understand the animal's preferences and play styles. The generative AI generates instructions to provide the animal with appropriate reactions and stimuli.
[0250] Additionally, sensors will be installed in the factory to detect abnormal behavior by workers or machines. These sensors will also send data to the generative AI, which will analyze the abnormal behavior and provide instructions on how to respond appropriately to the abnormal behavior.
[0251] As a specific example, the following system can be considered.
[0252] 1. Animal behavior monitoring system
[0253] If an animal exhibits aggressive behavior toward the device, the sensor detects the behavior and sends the information to the generative AI. The generative AI analyzes the information and understands that the animal prefers aggressive play. Based on this understanding, it instructs the device to perform actions that stimulate the animal. The device then acts according to the instructions and provides the appropriate stimulation to the animal.
[0254] 2. Factory safety monitoring system
[0255] When a worker or machine behaves abnormally in a factory, sensors detect the behavior and send the data to the generative AI. The generative AI analyzes the data and detects abnormal behavior. If an abnormality is detected, the generative AI instructs the appropriate response, such as sounding an alarm or halting work.
[0256] The hardware used includes sensors to detect animal movement, sensors to detect abnormal behavior in factories, information terminals, and spherical devices, while the software uses generative AI models.
[0257] As a concrete example, the following prompt sentence could be input into a generative AI model:
[0258] Example prompt sentence:
[0259] "Analyze the data when a worker falls, and if it is determined to be abnormal, issue an instruction to sound an alarm."
[0260] In this way, it is possible to learn changes in animal behavior patterns and provide appropriate stimuli, as well as detect abnormal behavior of workers or machinery in the factory in real time and respond quickly.
[0261] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0262] Step 1:
[0263] Sensors detect the movement of animals and workers.
[0264] Input: Animal and worker movement data
[0265] Data processing: Sensors acquire operational data in real time and convert it into digital signals.
[0266] Output: Digitized motion data
[0267] Step 2:
[0268] The data obtained from the sensors is sent to the generative AI.
[0269] Input: Digitized motion data
[0270] Data processing: The data acquired by the sensors is packetized for transmission to the generative AI.
[0271] Output: Packetized motion data
[0272] Step 3:
[0273] Generative AI analyzes motion data.
[0274] Input: Packetized motion data
[0275] Data computation: Generative AI analyzes movement data to identify abnormal movements and animal behavior patterns.
[0276] Output: Analysis results (detection of abnormal behavior and animal behavior patterns)
[0277] Step 4:
[0278] Generative AI will then suggest appropriate responses based on the analysis results.
[0279] Input: Analysis results
[0280] Data calculation: Generative AI determines the appropriate response (e.g., sound an alarm, activate a device, etc.) based on the analysis results.
[0281] Output: Action instructions
[0282] Step 5:
[0283] Devices and information terminals operate according to the instructions of generative AI.
[0284] Input: Action instructions
[0285] Specific action: The device provides an appropriate stimulus to the animal, the information terminal sounds an alarm, etc.
[0286] Output: Action taken (stimulate animal, sound alarm, etc.)
[0287] Step 6:
[0288] The generative AI receives feedback from the results of the actions it performs.
[0289] Input: The result of the action taken
[0290] Data processing: Generative AI evaluates the results of the execution and accumulates the data to reflect in the next response.
[0291] Output: Updated behavior database
[0292] Through these steps, it will be possible to learn changes in animal behavior patterns and provide appropriate stimuli, as well as to detect abnormal behavior of workers or machinery in the factory in real time and respond quickly.
[0293] Example 3
[0294] Next, a description will be given of a third embodiment of the third embodiment. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0295] Conventional animal devices have difficulty learning an animal's behavioral patterns in real time and providing appropriate reactions and stimuli based on that. Furthermore, there were no systems that could accumulate animal behavioral data over a long period of time and learn from those changes. This made it difficult to provide appropriate reactions and stimuli in response to changes in an animal's behavioral patterns.
[0296] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.
[0297] In this invention, the server includes means for storing data from sensors that detect animal movements and behavioral patterns in a database, means for cleansing the stored data and extracting behavioral patterns, means for the generative artificial intelligence to learn changes in behavioral patterns, and means for generating appropriate instructions based on the learning results, which makes it possible to provide appropriate reactions and stimuli in response to changes in the animal's behavioral patterns.
[0298] The "device" is a spherical device that can move freely and detects the movements and behavioral patterns of animals.
[0299] A "personal digital assistant" is a portable electronic device, such as a smartphone or tablet, that is used to operate the device.
[0300] A "sensor" is a sensing device installed on a device to detect animal movements and behavior patterns.
[0301] "Generative AI" is an AI that analyzes data from sensors, understands animals' preferences and play styles, and provides appropriate reactions and stimulation.
[0302] The "database" is an information management system for storing animal behavior data collected from sensors.
[0303] "Cleansing" is a process of removing noise from raw data stored in a database and filling in missing data.
[0304] A "behavioral pattern" is a series of behaviors that an animal tends to exhibit at a particular time or in a particular situation.
[0305] "Learning" is the process by which generative artificial intelligence understands changes in animal behavior patterns based on accumulated data.
[0306] "Instructions" are specific operational commands that generative AI issues to a device based on its learning results.
[0307] A "reaction" is a specific action or stimulus that the device performs on the animal in accordance with instructions from the generative artificial intelligence.
[0308] This invention is a system that learns the behavioral patterns of animals in real time and provides appropriate reactions and stimuli based on the learned patterns. Specific embodiments of this system are described below.
[0309] Hardware and software used
[0310] Hardware: Sensors (cameras, microphones, etc.) that detect animal movements and behavior patterns, a spherical device that can move freely, and mobile information terminals (smartphones and tablets).
[0311] Software: Generative AI (e.g., OpenAI's GPT-4), database (MySQL or MongoDB)
[0312] System configuration
[0313] 1. Device:
[0314] It is equipped with sensors to detect animal movements and behavior patterns.
[0315] Data from sensors is collected in real time and sent to a server.
[0316] 2. Mobile Information Devices:
[0317] Used as a means to operate the device.
[0318] The user can control the operation of the device through the personal digital assistant.
[0319] 3. Server:
[0320] Receives data sent from sensors and stores it in a database.
[0321] The accumulated data is cleansed and behavioral patterns are extracted.
[0322] Use generative artificial intelligence to learn changing behavioral patterns.
[0323] Based on the learning results, appropriate instructions are generated for the device.
[0324] Specific examples
[0325] For example, suppose a cat initially prefers aggressive play, but over time develops a preference for gentle play.
[0326] 1. Data Collection:
[0327] The device (camera) captures the cat poking at the moving toy.
[0328] The server receives the video data and stores it in a database.
[0329] 2. Data preprocessing:
[0330] The server removes unnecessary parts from the video data and extracts only the cat's movements.
[0331] The server organizes the extracted data by time and analyzes the cat's behavioral patterns.
[0332] 3. Learning behavioral patterns:
[0333] The server uses generative artificial intelligence to learn when the cat has changed from aggressive to calm play.
[0334] The server saves the learning results and proceeds to the next step.
[0335] 4. Generating appropriate instructions:
[0336] The server inputs a prompt to the generative artificial intelligence: "Since the cat has started to prefer gentle play, please generate instructions to move a toy with gentle movements."
[0337] The server sends the generated instructions to the device.
[0338] 5. Provide a reaction:
[0339] The device (toy) makes gentle movements according to instructions received from the server.
[0340] The device provides gentle play for cats and responds to their behavioral patterns.
[0341] Prompt Sentence Examples
[0342] By inputting the following prompt sentence into the generative AI, instructions based on changes in the cat's behavioral patterns can be generated.
[0343] Below is the cat's behavioral data. Initially, the cat preferred aggressive play, but over time, it began to prefer gentle play. Based on this change, generate instructions to provide the cat with appropriate reactions and stimuli.
[0344] In this way, the system can provide appropriate reactions and stimuli in response to changes in the animal's behavioral patterns. The flow of the identification process in the third embodiment will be described with reference to FIG.
[0345] Step 1: Data collection
[0346] The devices (sensors) monitor the movements of animals in real time and collect behavioral data. For example, a camera captures the movements of a cat and a microphone records the cat's meows.
[0347] Input: Real-time animal movements and sounds
[0348] Output: Animal behavior data (video data, audio data)
[0349] How it works: The camera captures the cat's movements and the microphone records the cat's meows. The device collects this data and sends it to a server.
[0350] Step 2: Preprocessing the data
[0351] The server cleanses the raw data stored in the database, specifically removing noise and filling in missing data.
[0352] Input: Raw data (video data, audio data)
[0353] Output: Cleansed data
[0354] Specific operation: The server removes unnecessary parts from the video data, filters noise from the audio data, and fills in any missing data.
[0355] Step 3: Extracting behavioral patterns
[0356] The server organizes the cleansed data by time and extracts behavioral patterns.
[0357] Input: Cleansed data
[0358] Output: Behavioral pattern data
[0359] Specific behavior: The server analyzes the cleansed data and extracts the behavior of animals at specific times of the day.
[0360] Step 4: Learning behavioral patterns
[0361] The server uses a generative AI model to learn animal behavior patterns based on the accumulated data.
[0362] Input: Behavioral pattern data
[0363] Output: Learning results (changes in behavioral patterns)
[0364] How it works: The server inputs behavioral pattern data into the generative AI model, which then learns changes in the animal's behavior, for example, when a cat changes from aggressive play to calm play.
[0365] Step 5: Generate appropriate instructions
[0366] The server generates appropriate instructions for the device based on the learning results.
[0367] Input: Training results
[0368] Output: Instruction data
[0369] Specific behavior: The server inputs a prompt to the generative AI model, saying, "Since the cat has started to prefer gentle play, please generate instructions to move a toy with gentle movements," and sends the generated instructions to the device.
[0370] Step 6: Provide a reaction
[0371] The terminal (device) operates according to the instructions received from the server.
[0372] Input: Instruction data
[0373] Output: Reaction to animals
[0374] Specific behavior: The device activates a toy with gentle movements, providing gentle play for the cat.
[0375] (Application example 3)
[0376] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0377] Conventional animal devices and generative AI are limited to learning animal behavior patterns and providing appropriate reactions. However, there were no systems that could learn the behavior patterns of workers in factories and provide appropriate support. This meant that improvements in work efficiency and reductions in worker burden were not fully achieved. Therefore, there is a need for a system that can learn the behavior patterns of workers in factories and provide appropriate support.
[0378] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.
[0379] In this invention, the server includes a spherical device that can move around freely, a means for operating the device from a smartphone, a sensor installed in the device that detects the movements and behavioral patterns of the animal, a generative AI that analyzes data from the sensor and understands the preferences and behavioral patterns of the animal, a means for providing appropriate reactions and stimuli to the animal based on the AI, and a means for accumulating behavioral data of workers over time, learning changes in behavioral patterns based on the accumulated data, and providing appropriate support. This makes it possible to learn the behavioral patterns of workers in the factory and provide appropriate support.
[0380] A "spherical device that can move freely" is a device that has a spherical shape and has the ability to physically move freely.
[0381] "Means for operating from a smartphone" refers to the interface or software for remotely operating the device using a smartphone.
[0382] A "sensor that detects animal movements and behavior patterns" is a device that detects animal movements and behavior in real time and collects that data.
[0383] "Generative AI" is an artificial intelligence technology that learns the behavioral patterns of animals and workers based on collected data and provides appropriate reactions and support.
[0384] "Means for providing appropriate reactions and stimuli" refers to devices and functions that provide appropriate reactions and stimuli to animals and workers based on the results of learning by the generative AI.
[0385] The "means for accumulating worker behavior data over time" is a system for continuously recording worker behavior and storing that data for a long period of time.
[0386] "Means of learning changes in behavioral patterns and providing appropriate support" refers to a function that analyzes accumulated behavioral data, recognizes changes in behavioral patterns, and provides optimal support to workers.
[0387] To implement this invention, the following hardware and software are required. The hardware includes a spherical, freely movable device, a smartphone, a factory robot, and sensors. The software includes Python, scikit-learn, and a generative AI model.
[0388] The spherical, mobile device is equipped with sensors that detect the movements and behavioral patterns of animals and workers in real time. The sensors detect and collect data on the movements and behavioral patterns of animals and workers. The collected data is then sent to a generative AI model for analysis.
[0389] The generative AI model learns the behavioral patterns of animals and workers based on collected data. This learning process uses Python and scikit-learn. Specifically, it uses the KMeans clustering algorithm to classify behavioral patterns and learns how behavioral patterns change over time.
[0390] Once trained, the generative AI model will provide instructions for appropriate reactions and stimuli to animals and workers. For example, if an animal prefers aggressive play, the device will provide appropriate stimuli. Also, if a worker transitions from manual to automated tasks, the robot will provide appropriate support.
[0391] For example, if a worker is manually assembling parts in a factory, a robot can assist with carrying the parts, or if a worker is operating automated machinery, a robot can assist with machine maintenance.
[0392] An example of a prompt is as follows:
[0393] "Develop AI that collects data on worker behavior in factories and learns changes in behavioral patterns based on that data. For example, if a worker transitions from manual to automated tasks, create a robot that learns the change and provides appropriate support."
[0394] In this way, the present invention can improve work efficiency in a factory and reduce the burden on workers.
[0395] The flow of the specific processing in Application Example 3 will be described with reference to FIG.
[0396] Step 1:
[0397] The server uses sensors to collect behavioral data of animals and workers. The input is real-time behavioral data obtained from the sensors, and the output is a list of collected behavioral data. Specifically, the sensors detect the movements of animals and workers and send the data to the server.
[0398] Step 2:
[0399] The server accumulates the collected behavioral data. The input is the behavioral data collected in step 1, and the output is a database of accumulated behavioral data. Specifically, the server saves the data it receives in the database.
[0400] Step 3:
[0401] The server trains a generative AI model using the accumulated behavioral data. The input is the accumulated behavioral data, and the output is the trained generative AI model. Specifically, the server uses Python and scikit-learn to run the KMeans clustering algorithm and classify behavioral patterns.
[0402] Step 4:
[0403] When new behavioral data is input, the server predicts behavioral patterns using a generative AI model. The input is the new behavioral data, and the output is the predicted behavioral pattern. Specifically, the server inputs the new data into the generative AI model and obtains the prediction result.
[0404] Step 5:
[0405] The server issues instructions to provide appropriate reactions and support based on the prediction results. The input is the predicted behavior pattern, and the output is instructions for reactions and support. In terms of specific operations, the server instructs the device or robot to perform appropriate actions.
[0406] Step 6:
[0407] The terminal (smartphone) receives instructions from the server and operates the device or robot. The input is the instruction from the server, and the output is the operation of the device or robot. Specifically, the smartphone sends operation commands to the device or robot.
[0408] Step 7:
[0409] The user monitors the operation of the device or robot and operates it manually as necessary. The input is the operating status of the device or robot, and the output is the user's operation command. Specifically, the user manually operates the device or robot using a smartphone.
[0410] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.
[0411] "Example 1"
[0412] As one embodiment of the present invention, a system incorporating an emotion engine is provided. This system recognizes the user's emotions and adjusts the reactions and stimuli given to the cat according to those emotions. Specifically, when the user is happy, the system encourages the cat to play actively. Conversely, when the user is depressed, the system encourages the cat to play quietly. This allows for optimal interaction with the cat according to the user's emotional state.
[0413] "Example 2"
[0414] The emotion engine also recognizes emotions from the user's tone of voice, facial expressions, or physical reactions. For example, if the user is smiling, the system recognizes the user as happy and encourages the cat to play actively. Conversely, if the user is crying, the system recognizes the user as sad and encourages the cat to play quietly. This allows the system to more accurately understand the user's emotional state and optimally interact with the cat accordingly.
[0415] "Example 3"
[0416] Furthermore, the emotion engine adjusts the device's movements and reactions according to the user's emotions, improving the interaction between the user and the cat. For example, when the user is angry, the system suppresses the device's movements to prevent the cat from bothering the user. Conversely, when the user is happy, the system activates the device's movements to allow the cat to play with the user in a fun way. This enables optimal interaction with the cat according to the user's emotional state.
[0417] The processing flow of each embodiment will be described below.
[0418] "Example 1"
[0419] Step 1: The user emotion engine recognizes the user's emotion.
[0420] Step 2: Based on the recognized emotion, the system adjusts its reactions and stimuli to the cat.
[0421] Step 3: When the user is happy, the system encourages active play with the cat.
[0422] Step 4: When the user is depressed, the system prompts the cat for quiet play.
[0423] "Example 2"
[0424] Step 1: The emotion engine recognizes emotions from the user's tone of voice, facial expressions, or physical reactions.
[0425] Step 2: If the user is smiling, the system recognizes that the user is happy and encourages active play with the cat.
[0426] Step 3: If the user is crying, the system will recognize that the user is sad and prompt the cat to play quietly.
[0427] "Example 3"
[0428] Step 1: The emotion engine recognizes the user's emotion.
[0429] Step 2: Adjust the device's behavior and response based on the user's emotions.
[0430] Step 3: When the user is angry, the system inhibits the device's movement to prevent the cat from bothering the user.
[0431] Step 4: When the user is happy, the system activates the device's movements, allowing the cat to play happily with the user.
[0432] Example 1
[0433] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0434] Previous animal devices simply detected animal movements and behavioral patterns, but were unable to understand the animal's preferences and play styles and provide appropriate reactions or stimulation. Furthermore, they lacked the ability to adjust interactions with the animal according to the user's emotional state, making it difficult to deepen the relationship between the user and the animal.
[0435] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0436] In this invention, the server includes a spherical device that can move around freely, a means for operating the device from an information terminal, a sensor installed in the device that detects the animal's movements and behavior patterns, a generative AI that analyzes data from the sensor and understands the animal's preferences and ways of playing, a means for providing appropriate reactions and stimuli to the animal based on the AI, and an emotion engine that recognizes the user's emotions and adjusts the reactions and stimuli to the animal according to those emotions. This makes it possible to understand the animal's behavior patterns and provide optimal reactions and stimuli according to the user's emotional state.
[0437] A "device" is a spherical apparatus that can move freely.
[0438] An "information terminal" is an electronic device that provides a means for operating a device.
[0439] A "sensor" is a device used to detect animal movements and behavior patterns.
[0440] "Generative AI" is artificial intelligence that analyzes data from sensors to understand animals' preferences and play styles.
[0441] "Means for providing reactions and stimuli" refers to a mechanism for providing appropriate reactions and stimuli to animals based on the analysis results of the generative AI.
[0442] The "emotion engine" is a system that recognizes the user's emotions and adjusts the reactions and stimuli given to animals according to those emotions.
[0443] "Animal behavior data" is information about animal movements and behavior patterns.
[0444] "Feedback" is the process of feeding the device's response to physical stimuli from the animal back to the generative AI.
[0445] The present invention is a system that understands the behavioral patterns of animals and provides optimal reactions and stimuli according to the emotional state of the user. Specific embodiments of this system will be described below.
[0446] Hardware and software used
[0447] Device: A spherical, freely movable device equipped with motors, batteries, and sensors.
[0448] Information terminal: An electronic device that provides a means to operate a device. Examples include smartphones and tablets.
[0449] Sensor: A device used to detect animal movements and behavior patterns. Accelerometers and infrared sensors are used.
[0450] Generative AI: This is artificial intelligence that analyzes data from sensors to understand the animals' preferences and play styles. It uses AI models that run on the cloud.
[0451] Emotion engine: A system that recognizes the user's emotions and adjusts the animal's reactions and stimuli accordingly. Emotion recognition software is used.
[0452] Program processing
[0453] The server receives the animal's behavioral data sent from the device and inputs it into the generative AI. The generative AI analyzes the received data to understand the animal's preferences and play styles. Based on the analysis, the generative AI then generates instructions to provide the animal with appropriate reactions and stimuli, and sends them to the device.
[0454] The device collects data to recognize the user's emotions. For example, it uses the smartphone's camera and microphone to analyze the user's facial expressions and tone of voice. The emotion engine receives the user's emotional data and adjusts the animal's reactions and stimuli according to the user's emotions.
[0455] Specific examples
[0456] Example 1: When a cat approaches the device, the sensor detects its movement and sends the data to the server. The server uses a generative AI model to determine that the cat is interested and sends an instruction to the device to "rotate to attract the cat's attention." The device then starts rotating in place.
[0457] Example 2: When a user is using a smartphone, the device captures the user's facial expression with the camera, and the emotion engine recognizes that the user is happy. The server then sends instructions to the generative AI model to encourage active play, and the device behaves as if it is running around with a cat.
[0458] Prompt Sentence Examples
[0459] "Describe what happens when a cat approaches the device."
[0460] "Please explain how the user reacts to the cat when they are happy."
[0461] The above is a specific embodiment for carrying out the present invention. This system makes it possible to understand the behavioral patterns of animals and provide optimal reactions and stimuli according to the emotional state of the user.
[0462] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0463] Step 1:
[0464] Initializing the device
[0465] Server: Initializes the device, checks the motor and battery status, and checks that the sensors are working properly.
[0466] Input: The signal that powers the device.
[0467] Output: Signals that initialization is complete.
[0468] Specific operation: When the device is turned on, the server checks the status of each component of the device and, if everything is normal, sends a signal indicating that initialization is complete.
[0469] Step 2:
[0470] Cat movement detection
[0471] Device: Uses internal sensors to detect cat movements and behavior patterns in real time.
[0472] Input: Cat movements and behavior.
[0473] Output: Detection data.
[0474] What it does: When your cat approaches or touches the device, the sensor captures the movement and collects data.
[0475] Step 3:
[0476] Sending data
[0477] Device: Sends detected data to the server.
[0478] Input: Sensor data.
[0479] Output: Sending data to the server.
[0480] Specific operation: The data collected by the sensor is sent to the server via wireless communication.
[0481] Step 4:
[0482] Analyzing the data
[0483] Server: Inputs the received data into a generative AI model to analyze the cat's behavioral patterns and preferences.
[0484] Input: Sensor data.
[0485] Output: Behavioral pattern analysis results.
[0486] Specific operation: The server inputs the data "a cat touched the device" into the generated AI model, and the AI determines that "the cat is showing interest."
[0487] Step 5:
[0488] Generate instructions
[0489] Server: Based on the analysis results, generates instructions to provide the cat with appropriate reactions and stimuli.
[0490] Input: Behavioral pattern analysis results.
[0491] Output: Instructions to the device.
[0492] Specific behavior: The server generates an instruction to "rotate the device to attract the cat's attention" and sends it to the device.
[0493] Step 6:
[0494] Device Operation
[0495] Device: Operates according to instructions from the server and provides appropriate reactions and stimuli to the cat.
[0496] Input: Instructions from the server.
[0497] Output: Device behavior.
[0498] Specific action: The device will start to rotate and behave in a way that will attract the cat's interest.
[0499] Step 7:
[0500] User Emotion Recognition
[0501] Device: Collecting data to recognize user emotions, for example using a smartphone's camera or microphone.
[0502] Input: The user's facial expression and tone of voice.
[0503] Output: Emotion data.
[0504] Specific operation: The device analyzes the user's facial expressions and tone of voice to recognize their emotional state.
[0505] Step 8:
[0506] Adjusting instructions based on emotion
[0507] Server: Receives the user's emotional data and adjusts the cat's reactions and stimuli.
[0508] Input: Emotion data.
[0509] Output: Adjusted instructions.
[0510] Specific behavior: If the server recognizes that the user is happy, it sends instructions to the generative AI model to encourage active play. The device then moves as if it is running around with the cat.
[0511] (Application example 1)
[0512] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0513] Conventional pet devices simply detect animal behavior patterns and are unable to deeply understand the animal's preferences or play styles. Furthermore, they lack the ability to adjust interactions with the animal according to the user's emotional state, making it difficult to provide interactions with the pet that are optimal for the user's emotional state. Furthermore, there was a lack of means to display device operation and animal behavior data in real time, making it difficult for users to understand the device's operating status and the animal's behavior.
[0514] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means. In this invention, the server includes a spherical device that can move freely around, means for operating the device from an information terminal, a sensor installed in the device that detects the animal's movements and behavior patterns, a generative AI that analyzes data from the sensor and understands the animal's preferences and play styles, means for providing appropriate reactions and stimuli to the animal based on the AI, means for recognizing the user's emotional state using an emotion engine and adjusting the reactions and stimuli to the animal according to the emotional state, and means for displaying operation of the device and animal behavior data on the information terminal. This makes it possible to deeply understand the animal's behavior patterns and provide optimal interactions with the pet according to the user's emotional state.
[0515] A "spherical device that can move freely" is a spherical device that has a motor and battery inside and can move autonomously based on external instructions.
[0516] An "information terminal" is an electronic device, such as a smartphone or tablet, that is operated by a user to control the device.
[0517] A "sensor that detects animal movements and behavior patterns" is a device that detects the location, speed, and movements of animals in real time and collects that data.
[0518] "Generative AI" is an artificial intelligence system that analyzes collected data to understand animals' preferences and play styles.
[0519] The "emotion engine" is a system that recognizes the user's emotional state and adjusts interactions with animals based on that information.
[0520] "Means for providing appropriate reactions and stimuli to animals" refers to a mechanism for making animals behave and react appropriately based on the analysis results of the generative AI.
[0521] The "means for displaying the operation of the device and the behavioral data of the animal on the information terminal" is a function for displaying the operating status of the device and the behavioral data of the animal on the information terminal in real time.
[0522] A system for implementing this invention includes a spherical, freely movable device, an information terminal, a sensor that detects animal movements and behavior patterns, a generative AI, an emotion engine, and a means for displaying on the information terminal.
[0523] System configuration
[0524] 1. Spherical device:
[0525] It is equipped with a motor and battery inside and moves autonomously based on external instructions.
[0526] It is equipped with sensors to detect animal movements and behavior patterns.
[0527] 2. Information terminal:
[0528] Electronic devices that are operated by users, such as smartphones and tablets.
[0529] Displays device operation and animal behavior data in real time.
[0530] 3. Sensor:
[0531] It senses the animal's location, speed, movement, etc. in real time and collects that data.
[0532] 4. Generative AI:
[0533] The collected data is analyzed to understand the animals' preferences and play styles.
[0534] A generative AI model is used to generate instructions to provide appropriate reactions and stimuli to the animal.
[0535] 5. Emotion Engine:
[0536] It recognizes the user's emotional state and adjusts interactions with the animal based on that information.
[0537] 6. Display means:
[0538] The device's operating status and animal behavior data are displayed on the information terminal.
[0539] Program processing explanation
[0540] The server first collects animal behavior data from sensors. This data is sent to the generative AI, which analyzes the animal's preferences and play patterns. Based on the analysis results, the generative AI generates instructions to provide the animal with appropriate reactions and stimuli. Furthermore, an emotion engine recognizes the user's emotional state and adjusts interactions with the animal based on that information. Finally, device operations and animal behavior data are displayed in real time on the information terminal.
[0541] Specific examples
[0542] For example, if this system is used in a pet shop, when a customer is playing with a cat, the smartphone app will analyze the cat's behavior in real time and adjust how the customer plays with the cat depending on the customer's emotional state. An example of a prompt sentence to be input to the generative AI model is as follows:
[0543] Example prompt sentence:
[0544] Cat behavior data: Movement: Active, Play: Chasing a ball
[0545] User's emotional state: State: Happy
[0546] Based on this data, generate instructions to provide the appropriate reactions and stimuli for your cat.
[0547] By inputting this prompt into a generative AI model, appropriate reactions and stimulation instructions can be obtained for the cat.
[0548] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0549] Step 1:
[0550] The server acquires animal behavior data from sensors. The sensors detect the animal's position, speed, movement, etc. in real time and send the data to the server. The input is raw data from the sensors, and the output is the animal behavior data sent to the server.
[0551] Step 2:
[0552] The server sends the acquired animal behavior data to the generative AI. The generative AI analyzes the received data and understands the animal's preferences and play styles. The input is the animal's behavior data, and the output is the analysis results on the animal's preferences and play styles.
[0553] Step 3:
[0554] The server generates instructions to provide appropriate reactions and stimuli to the animal based on the analysis results from the generative AI. Using the generative AI model, it creates prompts and generates specific instructions for the animal. The input is the analysis results of the generative AI, and the output is instructions for the animal.
[0555] Step 4:
[0556] The server recognizes the user's emotional state using an emotion engine. The emotion engine analyzes data such as the user's facial expressions and voice to identify the user's emotional state. The input is the user's emotional data, and the output is the user's emotional state.
[0557] Step 5:
[0558] The server adjusts the reactions and stimuli of the animals based on the user's emotional state. Based on the output of the emotion engine, it modifies the instructions of the generative AI to provide optimal interactions. The inputs are the user's emotional state and the instructions of the generative AI, and the output is the adjusted instructions for the animals.
[0559] Step 6:
[0560] The server sends the adjusted instructions to the spherical device, which then acts based on the received instructions and provides the appropriate reaction or stimulus to the animal. The input is the adjusted instructions, and the output is the device's behavior.
[0561] Step 7:
[0562] The terminal displays device operation and animal behavior data in real time. Users can check the device's operating status and the animal's behavior through the information terminal. The input is device operation data and animal behavior data, and the output is the information displayed on the information terminal.
[0563] Example 2
[0564] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0565] Previous animal devices struggled to provide appropriate responses to animal behavior and were unable to realize interactions that took into account the user's emotional state. This made it difficult to provide an optimal experience for both the animal and the user. Furthermore, they lacked systems that could learn changes in the animal's behavior patterns and adapt over the long term.
[0566] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0567] In this invention, the server includes a means for operating a spherical, freely movable device, a means for using sensors to detect the animal's movements and behavioral patterns, a means for using generative AI to analyze data from the sensors and understand the animal's preferences and play styles, a means for using an emotion engine to recognize the user's emotional state, and a means for optimizing interactions with the animal based on the generative AI and the emotion engine. This allows for appropriate responses to the animal's behavior and enables interactions that take the user's emotional state into account. It also allows for learning and long-term adaptation to changes in the animal's behavioral patterns.
[0568] A "device" is a spherical apparatus that can move freely.
[0569] An "information terminal" is an electronic device that provides a means for operating a device.
[0570] A "sensor" is a device that detects animal movements and behavior patterns.
[0571] "Generative AI" is artificial intelligence that analyzes data from sensors to understand animals' preferences and play styles.
[0572] An "emotion engine" is software or hardware for recognizing a user's emotional state.
[0573] "Reactions" are appropriate responses or stimuli provided to animals based on generative AI.
[0574] "Interaction optimization" refers to optimizing the interaction between animals and users based on generative AI and emotion engines.
[0575] "Behavioral data" is information about animal movements and behavior patterns.
[0576] "Feedback" means that the device automatically responds to physical stimuli from the animal and transmits that response to the generative AI.
[0577] The present invention provides a system for providing optimal interaction based on the behavior of animals and the emotional state of a user. Specific embodiments of this system are described below.
[0578] Hardware and software used
[0579] Device: A spherical, freely movable device that provides physical responses to the animal's behavior.
[0580] Information terminal: An electronic device that provides a means to operate a device, such as a smartphone or tablet.
[0581] Sensors: These are devices that detect animal movements and behavioral patterns. They are installed in devices and collect data in real time.
[0582] Generative AI: This is artificial intelligence that analyzes data from sensors to understand what animals like and how they play. For example, OpenAI's GPT-4 is one example.
[0583] Emotion engine: Software or hardware that recognizes the user's emotional state by analyzing the user's tone of voice, facial expressions, or physical reactions.
[0584] System Operation
[0585] The server receives animal behavior data sent from the sensors and analyzes it using generative AI, which understands the animal's behavioral patterns and sends instructions to the device to provide appropriate reactions and stimuli.
[0586] Additionally, the server uses an emotion engine to recognize the user's emotional state. The emotion engine analyzes the user's tone of voice and facial expressions to determine whether the user is happy or sad. The server then optimizes interactions with the animals based on this emotional state.
[0587] Specific examples
[0588] For example, if a cat scratches the device, the sensor detects the action. The sensor sends the data to a server, which analyzes the data using generative AI. The generative AI understands that the cat prefers aggressive play and instructs the device to move a cat toy. The device then follows this instruction to move the cat toy and provide the appropriate stimulation to the cat.
[0589] At the same time, the server uses its emotion engine to recognize the user's smile and determine that the user is happy, prompting the cat to play actively according to the user's emotional state.
[0590] Prompt Sentence Examples
[0591] "What should I do if my cat exhibits aggressive behavior toward the device?"
[0592] "What kind of play should the user be prompted to do with the cat when they smile?"
[0593] This system allows optimal interaction depending on the emotional state of the animal and the user.
[0594] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0595] Step 1:
[0596] Data collection by sensors
[0597] The server monitors the animal's behavior in real time using sensors installed on the device. The sensors detect aggressive behavior from the animal toward the device. For example, if a cat digs its claws into the device, the sensor detects the behavior. The input is the animal's behavior data, and the output is the detected behavior data.
[0598] Step 2:
[0599] Sending data
[0600] The sensor sends the detected behavioral data to the server. The server receives this data and passes it to the generative AI. The input is the behavioral data sent from the sensor, and the output is the behavioral data sent to the server.
[0601] Step 3:
[0602] Generative AI analysis
[0603] The server analyzes the received behavioral data using a generative AI. The generative AI uses, for example, OpenAI's GPT-4, to understand that animals prefer aggressive play. Specifically, it analyzes the behavioral data and determines that the behavior constitutes aggressive play. The input is the behavioral data sent to the server, and the output is the analysis result.
[0604] Step 4:
[0605] Device Instructions
[0606] The server issues instructions to the device based on the analysis results of the generative AI. For example, it instructs the device to move a cat toy. The device follows this instruction to move the cat toy and provide the cat with an appropriate stimulus. The input is the analysis results of the generative AI, and the output is the instruction to the device.
[0607] Step 5:
[0608] Recognizing user emotions with an emotion engine
[0609] The server uses an emotion engine to recognize the user's emotions. The emotion engine analyzes the user's tone of voice, facial expressions, or physical reactions. For example, if the user is smiling, the emotion engine recognizes that the user is happy. The input is the user's emotion data, and the output is the emotion recognition result.
[0610] Step 6:
[0611] Optimizing cat interaction
[0612] The server optimizes interactions with animals according to the user's emotional state. For example, if the user is smiling, it encourages the animal to play actively. Conversely, if the user is crying, it encourages the animal to play quietly. This allows optimal interactions with animals according to the user's emotional state. The input is the emotion recognition result, and the output is the optimized interaction instructions.
[0613] (Application example 2)
[0614] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0615] Conventional pet devices have difficulty providing interactions that fully consider the animal's behavior and the user's emotional state. In addition, they lack a means to provide appropriate stimuli based on the animal's behavior patterns and the user's emotions, which prevents the satisfaction of both the pet and the user.
[0616] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[0617] In this invention, the server includes a spherical device that can move freely, a means for operating the device from an information terminal, a sensor installed in the device that detects the animal's movements and behavior patterns, a generative AI that analyzes data from the sensor and understands the animal's preferences and play styles, a means for providing the animal with appropriate reactions and stimuli based on the AI, an emotion engine that recognizes the user's emotional state, and a means for adjusting interaction with the animal based on the emotion engine. This enables appropriate interaction that takes into account the animal's behavior and the user's emotional state in real time.
[0618] A "spherical device that can move freely" is a device that has a spherical shape and can physically move freely.
[0619] An "information terminal" is an electronic device that is operated by a user, such as a smartphone or tablet.
[0620] A "sensor that detects animal movements and behavior patterns" is a device that detects animal movements and behavior in real time.
[0621] "Generative AI" is an artificial intelligence system that analyzes collected data to understand animals' preferences and behavioral patterns.
[0622] "Means for providing appropriate reactions and stimuli" refers to devices and methods for providing appropriate reactions and stimuli to animals based on the analysis results of generative AI.
[0623] The "emotion engine" is a system that recognizes emotions from the user's tone of voice, facial expressions, and physical reactions.
[0624] The "means for adjusting interaction with animals" refers to a device or method for optimizing interaction with animals based on the recognition results of the emotion engine.
[0625] The present invention provides a system that takes into account the behavior of animals and the emotional state of a user in real time to provide appropriate interactions. Specific embodiments for realizing this system are described below.
[0626] System Configuration
[0627] The system consists of the following main components:
[0628] 1. A spherical, freely movable device:
[0629] The device is a spherical device that can move freely to induce animal behavior. It is equipped with motors and batteries and operates according to instructions from an information terminal.
[0630] 2. Information terminal:
[0631] An electronic device such as a smartphone or tablet that provides an interface for users to operate the device and has a dedicated application installed to control the device's operation.
[0632] 3. Sensors that detect animal movements and behavior patterns:
[0633] The device is equipped with a camera and an accelerometer to detect animal movements and behavior in real time.
[0634] 4. Generative AI:
[0635] It is an artificial intelligence system that analyzes collected data to understand the preferences and behavioral patterns of animals. Generative AI accumulates animal behavior data over time and learns changes in behavioral patterns based on that data.
[0636] 5. Means of providing appropriate reactions and stimuli:
[0637] This is a device or method that provides appropriate responses or stimuli to animals based on the analysis results of generative AI. For example, the device can stimulate the animal by performing a specific movement.
[0638] 6. Emotion Engine:
[0639] This system recognizes emotions from the user's tone of voice, facial expressions, and physical reactions. The emotion engine detects the user's emotional state in real time through a camera and microphone.
[0640] 7. Ways to regulate interactions with animals:
[0641] The present invention provides an apparatus and method for optimizing interactions with animals based on the recognition results of an emotion engine. For example, if the user is recognized as sad, the device will behave calmly.
[0642] Program processing explanation
[0643] The server detects the user's emotional state through a camera and microphone and sends it to the generative AI. The generative AI analyzes the animal's behavioral data and the user's emotional data to determine an appropriate reaction. The information terminal receives instructions from the generative AI and instructs the device on how to operate.
[0644] The hardware used includes a camera (to detect animal behavior and user facial expressions), a microphone (to detect the tone of the user's voice), and a motor (to control the device's movements), while the software includes OpenCV (image processing), Keras (emotion recognition model), and requests (to communicate with AI services).
[0645] Specific examples
[0646] For example, if a user comes into the store with a smiling pet, the emotion engine recognizes that the user is happy. The generative AI analyzes the animal's behavioral data and the user's emotional data and instructs the device to behave in a way that encourages active play. Conversely, if the user has a sad expression, the device is instructed to behave calmly.
[0647] Prompt Sentence Examples
[0648] "If the user's emotion is 'happy' and the animal's behavior is 'aggressive,' provide the animal with a toy that encourages positive play."
[0649] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0650] Step 1:
[0651] The server captures the user's facial expressions and tone of voice in real time through a camera and microphone. It receives camera footage and audio data as input. It preprocesses these data using OpenCV and audio processing libraries to extract the user's facial features and tone of voice. It generates data indicating the user's emotional state as output.
[0652] Step 2:
[0653] The server uses an emotion engine to analyze the user's emotional state data obtained in step 1. As input, it uses facial feature points and voice tone data. The emotion engine inputs this data into an emotion recognition model (using Keras) and classifies the user's emotions into categories such as "happy" or "sad." As output, it generates a label indicating the user's emotional state.
[0654] Step 3:
[0655] The terminal acquires animal behavior data in real time through sensors installed on the device. As input, it receives data from the sensors (acceleration, location information, etc.). It preprocesses this data to extract the animal's movements and behavioral patterns. As output, it generates data indicating the animal's behavioral state.
[0656] Step 4:
[0657] The server uses generative AI to integrate and analyze the user's emotional state data acquired in step 2 and the animal's behavior data acquired in step 3. The server uses the user's emotional state data and the animal's behavior data as input. The generative AI determines appropriate reactions and stimuli for the animal based on this data. The output is to generate operational instructions for the device.
[0658] Step 5:
[0659] The terminal sends the motion instructions generated in step 4 to the device. As input, it receives motion instruction data from the generative AI. The terminal transmits these instructions to the device's motor control system and controls the device to perform the appropriate motion. As output, the physical motion of the device is executed.
[0660] Step 6:
[0661] The device automatically responds to physical stimuli from the animal and feeds that response back to the generative AI as animal behavior data. It receives physical stimulus data from the animal as input. The device detects this data with sensors and sends it to the generative AI. The output is updated animal behavior data.
[0662] Step 7:
[0663] The server re-analyzes the animal's behavior data updated in step 6 and learns changes in the animal's behavior patterns. As input, it uses the updated animal's behavior data. The generative AI accumulates this data and learns changes in the animal's behavior patterns. As output, it generates new movement instructions based on the animal's behavior patterns.
[0664] Example 3
[0665] Next, a description will be given of a third embodiment of the third embodiment. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0666] Conventional animal devices have had difficulty providing appropriate reactions and stimuli based on the animal's behavioral patterns and the user's emotional state. Furthermore, they lacked the functionality to accumulate animal behavioral data over time and learn from these changes, making it impossible to respond appropriately to the animal's interests and preferences. Furthermore, the device's movements and responses were not adjusted to take the user's emotional state into account, resulting in a suboptimal interaction between the user and the animal.
[0667] The identification process by the identification processing unit 290 of the data processing device 12 in Example 3 is realized by the following means. In this invention, the server includes a spherical device that can move freely around, means for operating the device from an information terminal, a sensor mounted on the device that detects the animal's movements and behavior patterns, a generative AI that analyzes data from the sensor and understands the animal's preferences and play styles, means for providing appropriate reactions and stimuli to the animal based on the AI, an emotion engine for analyzing the user's emotional state, and means for adjusting the device's movements and reactions based on the analysis results of the emotion engine. This allows the server to provide appropriate reactions and stimuli in response to changes in the animal's behavior patterns, enabling optimal interaction according to the user's emotional state.
[0668] A "device" is a spherical apparatus that can move freely.
[0669] An "information terminal" is an electronic device that provides a means for operating a device.
[0670] A "sensor" is a device used to detect animal movements and behavior patterns.
[0671] "Generative AI" is artificial intelligence that analyzes data from sensors to understand animals' preferences and play styles.
[0672] An "emotion engine" is software or hardware for analyzing a user's emotional state.
[0673] A "reaction" is an appropriate response or stimulus provided to an animal.
[0674] "Animal behavior data" is information about animal movements and behavior patterns.
[0675] "User's emotional state" refers to the emotional state that the user is feeling.
[0676] The present invention provides a system for analyzing animal behavior data and a user's emotional state to provide optimal interaction. Specific embodiments of this system are described below.
[0677] System configuration
[0678] The system consists of the following main components:
[0679] 1. Device: A spherical, freely movable device equipped with sensors to detect animal movements and behavior patterns.
[0680] 2. Information terminal: An electronic device that provides a means to operate a device. Examples include smartphones and tablets.
[0681] 3. Server: This is the central component that receives and analyzes data from devices and information terminals.
[0682] 4. Generative AI: This is artificial intelligence that analyzes data from sensors and understands the animal's preferences and play styles.
[0683] 5. Emotion engine: Software or hardware for analyzing the user's emotional state.
[0684] Data collection and analysis
[0685] The server collects animal behavior data from sensors installed on the device. For example, a camera tracks a cat's movements and a sensor detects which objects the cat touches. The collected data is stored in a database.
[0686] Generative AI analyzes accumulated behavioral data and learns animal behavior patterns. For example, it learns that cats become active at 8 a.m. every morning and that they prefer certain toys. Based on this learning, it issues appropriate commands to the device.
[0687] User sentiment analysis and device adjustment
[0688] The device uses a camera and microphone to analyze the user's emotional state, for example, by analyzing the user's facial expression and tone of voice to determine whether the user is angry or happy.
[0689] The server adjusts the device's behavior and reactions based on the analysis results of the emotion engine. For example, if the user is angry, the device's behavior will be suppressed to allow the animal to remain quiet. Conversely, if the user is happy, the device's behavior will be more active, allowing the user to play with the animal.
[0690] Specific examples
[0691] For example, if a cat initially likes chasing laser pointers, but after a few weeks starts preferring to roll a ball, the generative AI will learn this change and instruct the cat to move the ball-rolling device more frequently.
[0692] When the user comes home from work and is tired, the emotion engine detects the user's fatigue and reduces the device's activity so that the cat can stay quiet. Conversely, when the user is relaxing on a day off, the emotion engine activates the device's activity so that the user can play with the cat.
[0693] Prompt Sentence Examples
[0694] "Please explain the generative AI program that accumulates data on cat behavior and learns changes in behavior patterns."
[0695] "Please explain how the emotion engine works to adjust the device's behavior and response based on the user's emotions."
[0696] In this way, the system utilizes the animal's behavior data and the user's emotion data to provide optimal interaction. The flow of the identification process in the third embodiment will be described with reference to FIG.
[0697] Step 1:
[0698] The server collects animal behavior data from sensors installed on the device. As input, it receives real-time data from the sensors and generates data on the animal's movements and behavior patterns as output. Specifically, the camera tracks the cat's movements and the sensor detects which objects the cat touches.
[0699] Step 2:
[0700] The server stores the collected behavioral data in a database. As input, it receives the animal behavioral data generated in step 1, and as output, it stores the time-stamped behavioral data in the database. Specifically, it records the data "October 1, 2023, 08:00:00 - Cat chases laser pointer."
[0701] Step 3:
[0702] The generative AI analyzes the accumulated behavioral data and learns the behavioral patterns of animals. It receives the behavioral data stored in the database as input and generates the learning results about the animal's behavioral patterns as output. Specifically, it learns the pattern of "chasing a laser pointer every morning at 8 o'clock."
[0703] Step 4:
[0704] The server issues instructions to the device based on the learning results of the generative AI. It receives the learning results of the generative AI as input and generates specific instructions for the device as output. Specifically, it issues the instruction "move the laser pointer at 8 o'clock every morning."
[0705] Step 5:
[0706] The device analyzes the user's emotional state using a camera and microphone. It receives data on the user's facial expressions and tone of voice as input and generates an analysis result on the user's emotional state as output. Specifically, if the user is smiling while speaking, it is determined that the user is happy.
[0707] Step 6:
[0708] The server adjusts the device's movements and reactions based on the analysis results of the emotion engine. It receives the user's emotion analysis results as input and generates specific instructions for the device's movements and reactions as output. Specifically, when the user is angry, the device's movements are suppressed so that the animal can stay quiet. Conversely, when the user is happy, the device's movements are made more active so that the user can play with the animal.
[0709] (Application example 3)
[0710] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0711] Conventional pet interaction systems have difficulty providing appropriate reactions and stimuli according to changes in animal behavior patterns and the user's emotional state. Furthermore, they lacked the functionality to provide real-time advice on how users should interact with animals, making it difficult to achieve optimal interactions with animals.
[0712] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means. In this invention, the server includes a spherical device that can move freely around, means for operating the device from an information terminal, a sensor installed in the device that detects the animal's movements and behavior patterns, a generative AI that analyzes data from the sensor and understands the animal's preferences and play styles, means for providing appropriate reactions and stimuli to the animal based on the AI, an emotion engine that senses the user's emotional state and adjusts the device's movements and reactions, and means for advising the user on optimal interactions with the animal. This makes it possible to provide appropriate reactions and stimuli in response to changes in the animal's behavior patterns and achieve optimal interactions according to the user's emotional state.
[0713] A "spherical device that can move freely" is a device that has a spherical shape and has the ability to physically move freely.
[0714] An "information terminal" is an electronic device that is operated by a user, such as a smartphone or tablet.
[0715] A "sensor that detects animal movements and behavior patterns" is a device that detects animal movements and behavior in real time and collects that data.
[0716] "Generative AI" is an artificial intelligence that learns animal behavior patterns based on collected data and generates appropriate reactions and stimuli.
[0717] "Means of providing appropriate reactions and stimuli" is a function that provides appropriate reactions and stimuli to animals based on the results of learning by the generative AI.
[0718] An "emotion engine" is a system that senses the user's emotional state and adjusts the device's behavior and responses accordingly.
[0719] The "means for advising optimal interactions" is a function that provides real-time instructions to users on how best to interact with and play with animals.
[0720] A system for implementing the present invention has the following configuration.
[0721] First, a spherical, mobile device is required. This device is equipped with sensors that detect the animal's movements and behavior patterns. The sensors detect the animal's movements and behavior in real time and collect that data.
[0722] Next, you need an information terminal. An information terminal is an electronic device that users can operate, such as a smartphone or tablet. You can operate the device through this information terminal.
[0723] The collected data is analyzed by generative AI, which accumulates data on the animal's behavior over time and learns changes in the animal's behavior patterns based on that data. This allows the AI to understand the animal's preferences and play styles, and provide appropriate reactions and stimulation.
[0724] Furthermore, the emotion engine senses the user's emotional state and adjusts the device's behavior and response according to the user's emotional state. For example, the emotion engine increases the device's behavior when the user is happy, and decreases the device's behavior when the user is angry.
[0725] Finally, it includes a means to advise users on optimal interactions with animals, allowing users to know in real time how to interact with animals.
[0726] For example, if the user types "happy," the system will advise, "Play with your cat more!". If the user types "angry," the system will advise, "Let's give your cat a break."
[0727] An example of a prompt is as follows:
[0728] Enter the user's emotion (happy, angry, neutral): happy
[0729] In this way, it is possible to provide appropriate reactions and stimuli in response to changes in the animal's behavioral patterns, realizing optimal interaction according to the user's emotional state.
[0730] The flow of the specific processing in Application Example 3 will be described with reference to FIG.
[0731] Step 1:
[0732] The user operates the information terminal and starts the device. As input, the user starts the information terminal application and turns on the device. As output, the device starts operating and the sensor begins to detect animal movement.
[0733] Step 2:
[0734] The sensors detect and collect data on animal movements and behavior patterns in real time. As input, the animal's movements and behavior are detected by the sensors. As output, the collected data is sent to the generative AI.
[0735] Step 3:
[0736] The generative AI analyzes the collected data and learns the animal's behavior patterns. The input is the animal's behavior data transmitted from sensors. The output is the generation of appropriate reactions and stimulus instructions based on changes in the animal's behavior patterns.
[0737] Step 4:
[0738] The emotion engine senses the user's emotional state. As input, the user enters their emotional state into the information terminal. As output, the emotion engine analyzes the user's emotional state and sends the results to the generative AI.
[0739] Step 5:
[0740] The generative AI adjusts the device's behavior and response based on the user's emotional state. The input is the user's emotional state data sent from the emotion engine. The output is the device's behavior and response adjusted according to the user's emotional state.
[0741] Step 6:
[0742] The system provides users with advice on optimal interactions with animals. The inputs are instructions from the generative AI and data on the user's emotional state. The output is advice on optimal interactions with animals displayed on the information terminal screen.
[0743] Step 7:
[0744] The user interacts with the animal according to the advice. The input is the advice displayed on the information terminal. The output is that the user's appropriate interaction with the animal changes the animal's behavioral patterns, and the sensor again collects that data.
[0745] This series of processing steps makes it possible to provide appropriate reactions and stimuli in response to changes in the animal's behavioral patterns, thereby achieving optimal interaction according to the user's emotional state.
[0746] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0747] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0748] Another example of generative AI is Gemini (registered trademark) (Internet search engine). <url: https: gemini.google.com ?hl="ja">) are mentioned.
[0749] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.
[0750] [Second embodiment]
[0751] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.
[0752] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0753] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0754] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.
[0755] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0756] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0757] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0758] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0759] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0760] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0761] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0762] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.
[0763] "Example 1"
[0764] In one embodiment of the present invention, a spherical device is provided. This device has an internal driving source such as a motor or battery, allowing it to move freely around. A sensor for detecting the cat's movements and behavioral patterns is located on the outside of the device. This sensor detects the cat's movements and behavioral patterns and transmits the data to a generative AI. The generative AI analyzes the received data and understands the cat's preferences and play styles. Based on this understanding, it then transmits instructions to the device to provide the cat with appropriate reactions and stimuli. The device operates in accordance with the instructions and provides the cat with appropriate reactions and stimuli.
[0765] "Example 2"
[0766] As a specific example, if a cat exhibits aggressive behavior toward the device, a sensor detects the behavior and sends that information to the generative AI. The generative AI analyzes the information and understands that cats prefer aggressive play. Based on that understanding, it instructs the device to perform actions that stimulate the cat. The device then acts according to the instructions and provides the cat with appropriate stimulation.
[0767] "Example 3"
[0768] The generative AI also accumulates data on the cat's behavior over time and learns changes in the cat's behavioral patterns based on that data. For example, if a cat initially prefers aggressive play but develops a preference for gentler play over time, the generative AI will learn this change and issue appropriate instructions to the device based on that learning. This makes it possible to provide appropriate reactions and stimuli in response to changes in the cat's behavioral patterns.
[0769] The processing flow of each embodiment will be described below.
[0770] "Example 1"
[0771] Step 1: The spherical device starts working, and sensors begin to detect the cat's movements and behavior patterns.
[0772] Step 2: The sensors detect the cat's movements and behavioral patterns and send that data to the generative AI.
[0773] Step 3: The generative AI analyzes the received data to understand the cat's preferences and play habits.
[0774] Step 4: Based on that understanding, the generative AI sends instructions to the device to provide the appropriate reaction or stimulation to the cat.
[0775] Step 5: The device will then act on the instructions and provide the appropriate reaction or stimulus to your cat.
[0776] "Example 2"
[0777] Step 1: Your cat exhibits aggressive behavior towards the device.
[0778] Step 2: The sensor detects the behavior and sends that information to the generative AI.
[0779] Step 3: The generative AI analyzes the information and understands that cats prefer aggressive play.
[0780] Step 4: Based on that understanding, the generative AI instructs the device to perform actions that stimulate the cat.
[0781] Step 5: The device will follow the instructions and provide the appropriate stimulation to your cat.
[0782] "Example 3"
[0783] Step 1: The generative AI accumulates cat behavior data over time.
[0784] Step 2: The generative AI learns changes in the cat's behavioral patterns based on the accumulated data.
[0785] Step 3: The generative AI uses its learning to issue appropriate instructions to the device.
[0786] Step 4: The device follows the instructions and provides appropriate reactions and stimuli in response to changes in the cat's behavioral patterns.
[0787] Example 1
[0788] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0789] Conventional animal play equipment has the problem that it is difficult to provide appropriate reactions and stimulation to keep animals interested, and animals quickly become bored. In addition, there is a lack of a system that can analyze animals' behavior patterns in real time and control their movements based on that, making it difficult to provide play styles that suit individual animals' preferences.
[0790] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0791] In this invention, the server includes a spherical device that can move around freely, a means for operating the device from an information terminal, a sensor installed in the device that detects the animal's movements and behavior patterns, a generative artificial intelligence that analyzes data from the sensor and understands the animal's preferences and ways of playing, a means for providing the animal with appropriate reactions and stimuli based on the artificial intelligence, a means for generating instructions for controlling the operation of the device and sending the instructions to the device, and a means for the device to operate in accordance with the instructions and provide the animal with appropriate reactions and stimuli. This makes it possible to analyze the behavior patterns of animals in real time and provide appropriate reactions and stimuli according to the preferences of each individual animal.
[0792] The "device" is a spherical, freely movable device equipped with sensors that detect the movements and behavioral patterns of animals.
[0793] An "information terminal" is an electronic device that provides a means for operating a device, and includes smartphones, tablets, and the like.
[0794] A "sensor" is a device that detects animal movements and behavior patterns and is installed in a device.
[0795] "Generative AI" is an AI system that analyzes data from sensors to understand animals' preferences and play styles.
[0796] "Means for providing reactions or stimuli" refers to mechanisms or methods for providing appropriate reactions or stimuli to animals based on generative artificial intelligence.
[0797] "Means for generating instructions" refers to a mechanism or method for generating instructions to control the operation of a device based on data analyzed by the generative artificial intelligence.
[0798] The "means for sending instructions" refers to a communication means for sending the generated instructions to the device.
[0799] "Means for controlling behavior" refers to the mechanism or method by which the device operates according to the instructions it receives and provides the animal with an appropriate reaction or stimulus.
[0800] This invention is a system that analyzes the behavioral patterns of animals in real time and provides appropriate reactions and stimuli according to the preferences of each individual animal. Specific embodiments of this system will be described below.
[0801] System configuration
[0802] The system consists of the following main components:
[0803] 1. Device: A spherical, freely movable device equipped with sensors that detect animal movements and behavior patterns.
[0804] 2. Information terminal: An electronic device that provides a means to operate a device, including smartphones and tablets.
[0805] 3. Sensor: A device that detects animal movements and behavior patterns and is installed in the device.
[0806] 4. Generative AI: An artificial intelligence system that analyzes data from sensors to understand the animal's preferences and play styles.
[0807] 5. Means of providing reactions and stimuli: Mechanisms and methods for providing appropriate reactions and stimuli to animals based on generative artificial intelligence.
[0808] 6. Means for generating instructions: A mechanism or method for generating instructions to control the operation of a device based on data analyzed by generative artificial intelligence.
[0809] 7. Means for sending instructions: A communication means for sending the generated instructions to the device.
[0810] 8. Means of controlling behavior: The mechanism or method by which the device operates according to the instructions it receives and provides the appropriate reaction or stimulus to the animal.
[0811] System Operation
[0812] 1. Initialize the device
[0813] The user turns on the device.
[0814] The device checks the internal motor and battery to ensure they are in working order.
[0815] The device calibrates the sensors to ensure accurate data collection.
[0816] 2. Data collection
[0817] The device uses sensors on the device to detect animal movements and behavior patterns in real time.
[0818] The device temporarily stores the detected data.
[0819] 3. Data transmission
[0820] The terminal transmits the collected data to the server.
[0821] The server receives the data and prepares it for analysis.
[0822] 4. Data Analysis
[0823] The server passes the received data to the generative artificial intelligence.
[0824] Generative AI analyzes the data to understand the animal's preferences and behavioral patterns.
[0825] 5. Instruction Generation
[0826] Based on the analysis results, generative artificial intelligence generates instructions to provide the animal with appropriate reactions and stimuli.
[0827] The server receives the generated instructions.
[0828] 6. Sending instructions
[0829] The server sends the generated instructions to the terminal.
[0830] The terminal receives the instruction and transmits it to the device.
[0831] 7. Device Operation
[0832] The terminal operates the device according to the instructions received.
[0833] The device provides the animal with the appropriate reaction or stimulus.
[0834] Specific examples
[0835] For example, if a cat approaches the device, the device's sensor detects its movement. The server determines that the cat is interested in the device and sends the data to the generative AI. The generative AI generates an instruction to "move the device slightly to attract the cat." The server sends the instruction to the device, which then moves the device.
[0836] Prompt Sentence Examples
[0837] "Generate an appropriate reaction when a cat approaches the device."
[0838] "If your cat likes to chase the device, tell them what movements to direct it to."
[0839] In this way, the system can analyze the animal's behavior in real time and provide appropriate reactions to keep the animal engaged.
[0840] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0841] Step 1: Initialize your device
[0842] Input: A user turns on the device.
[0843] Processing: The device checks the internal motors and batteries to ensure they are working properly, and calibrates the sensors to ensure accurate data collection.
[0844] Output: The device is ready to operate normally.
[0845] Specific operation: The user presses the power button on the device, and the terminal checks the device's LED indicator to confirm normal operation.
[0846] Step 2: Collect data
[0847] Input: The device detects animal movements and behavior patterns.
[0848] Processing: The device uses the device's sensors to detect animal movements and behavior patterns in real time and temporarily store the data.
[0849] Output: Data is collected on animal movements and behavior patterns.
[0850] Specific operation: The device uses sensors to detect the cat's movement as it approaches the device and stores the data in memory.
[0851] Step 3: Sending data
[0852] Input: Collected animal movement and behavior pattern data.
[0853] Processing: The device sends the collected data to the server, which receives the data and prepares it for analysis.
[0854] Output: Data is sent to the server and ready for analysis.
[0855] Specific operation: The device sends data to the server via Wi-Fi, and the server receives the data and stores it in a database.
[0856] Step 4: Analyze the data
[0857] Input: Data on animal movements and behavior patterns received by the server.
[0858] Processing: The server passes the received data to the generative AI, which analyzes the data to understand the animal's preferences and behavioral patterns.
[0859] Output: Analysis results on the animal's preferences and behavior patterns.
[0860] Specific operation: The server inputs data into the generative AI, which then concludes that "cats like to chase balls."
[0861] Step 5: Generate instructions
[0862] Input: Analysis results by generative artificial intelligence.
[0863] Processing: Based on the analysis results, the generative AI generates instructions to provide appropriate reactions and stimuli to the animals. The server receives the generated instructions.
[0864] Output: Instructions for providing the appropriate reaction or stimulus to the animal.
[0865] Specific operation: The generative artificial intelligence generates the instruction "rotate the device to the right," and the server receives that instruction.
[0866] Step 6: Sending instructions
[0867] Input: Generated instructions.
[0868] Processing: The server sends the generated instruction to the terminal, and the terminal receives the instruction and transmits it to the device.
[0869] Output: The instructions sent to the device.
[0870] Specific operation: The server sends instructions to the terminal via Wi-Fi, and the terminal receives the instructions and passes them on to the device.
[0871] Step 7: Device Operation
[0872] Input: Instructions received by the terminal.
[0873] Processing: The terminal operates the device according to the instructions received and provides the animal with the appropriate reaction or stimulus.
[0874] Output: The appropriate reaction or stimulus provided to the animal.
[0875] Specific behavior: The terminal controls the motor of the device and rotates it to the right. The device rotates in front of the cat, and the cat chases it.
[0876] (Application example 1)
[0877] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0878] Conventional pet devices have difficulty fully understanding the movements and behavior patterns of animals and providing appropriate reactions and stimuli. Furthermore, there are insufficient means to provide a fun environment for animals in physical stores. This has resulted in insufficient reduction of stress for animals and improvement of customer satisfaction.
[0879] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0880] In this invention, the server includes a spherical device that can move around freely, a means for operating the device from a smartphone, a sensor installed in the device that detects the animal's movements and behavior patterns, a generative AI that analyzes data from the sensor and understands the animal's preferences and ways of playing, a means for providing the animal with appropriate reactions and stimuli based on the AI, and a means for the device to detect the animal's movements within the physical store and provide appropriate reactions and play using the generative AI, allowing the animal to have fun within the physical store and improving customer satisfaction.
[0881] A "spherical device that can move freely" is a spherical device that has a power source such as a motor or battery inside and can move in any direction.
[0882] "Means for operating from a smartphone" refers to an interface or application for remotely controlling the operation of a device using a smartphone.
[0883] A "sensor that detects animal movements and behavioral patterns" is a device that detects the position, speed, direction, and other movements of animals and collects that data.
[0884] "Generative AI" is an artificial intelligence model that analyzes collected animal movement and behavior data to understand animals' preferences and play styles.
[0885] "Means for providing appropriate reactions and stimuli to animals" refers to a mechanism that allows animals to take appropriate actions and react based on instructions generated by the generative AI.
[0886] "Means of detecting animal movements within a physical store and using generative AI to provide appropriate reactions and play" refers to a system that detects animal movements within a physical store in real time, sends that data to generative AI, and provides appropriate reactions and play for the animals.
[0887] This invention is a system for providing an environment in a physical store where animals, especially cats, can have fun. The system includes a spherical, freely moving device, a means for controlling it from a smartphone, sensors that detect the animal's movements and behavior patterns, generative AI, and a means for providing appropriate reactions and stimuli to the animal.
[0888] System configuration
[0889] 1. Spherical device:
[0890] It is equipped with a motor and battery inside, allowing it to move in any direction.
[0891] There are sensors on the outside to detect animal movement.
[0892] 2. Methods for operating from a smartphone:
[0893] An application is provided for remotely controlling the operation of a device using a smartphone.
[0894] 3. Sensors that detect animal movements and behavior patterns:
[0895] It senses and collects data on the animal's location, speed, direction, and other movements.
[0896] 4. Generative AI:
[0897] The collected data on animal movements and behavior is analyzed to understand the animals' preferences and play styles.
[0898] Using a generative AI model, appropriate reactions and stimuli are generated for animals.
[0899] 5. Means of providing appropriate reactions and stimuli to animals:
[0900] Based on the instructions generated by the generative AI, the robot will perform appropriate actions and reactions towards the animal.
[0901] Program processing explanation
[0902] The server sends animal movement data collected from sensors to the generative AI. The generative AI analyzes this data to understand the animal's preferences and play styles. Based on this understanding, it generates instructions to provide the animal with appropriate reactions and stimuli. These instructions are then sent to the device, which then performs the appropriate action on the animal.
[0903] The hardware used includes sensors to detect animal movement, motors to power the device, and a battery to power the device, while the software used includes a generative AI model, a sensor control module, and a motor control module.
[0904] Specific examples
[0905] For example, when a cat approaches a device in a pet shop, a sensor detects its movement and sends the data to a generative AI. The generative AI then generates a movement that will interest the cat and sends that instruction to the device. The device then begins to move as if the cat is chasing it, attracting the cat's attention.
[0906] When a cat touches the device in a cafe, the sensor detects the movement and sends the data to the generative AI. The generative AI generates a rotating motion that the cat will enjoy and sends that instruction to the device. The device rotates in a way that the cat enjoys, attracting the cat's interest.
[0907] Prompt Sentence Examples
[0908] "Enter your cat's movement data, including its position, speed, and direction. Use this data to generate reactions that will interest your cat."
[0909] The above is an embodiment of the present invention. This system allows animals to have fun in a physical store, improving customer satisfaction.
[0910] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0911] Step 1:
[0912] The sensor detects the animal's movement. The sensor collects data such as the animal's position, speed, and direction, and sends the data to the server. The input is the animal's movement data, and the output is the movement data sent to the server.
[0913] Step 2:
[0914] The server receives animal movement data from the sensors and sends it to the generative AI. The generative AI analyzes this data to understand the animal's preferences and play styles. The input is movement data from the sensors, and the output is the analysis results by the generative AI.
[0915] Step 3:
[0916] The generative AI generates appropriate reactions and stimuli for the animal based on the analysis results. The generative AI generates actions and responses that will interest the animal and sends these instructions to the server. The input is the analysis result of the animal's movement data, and the output is the generated reaction or stimulus instructions.
[0917] Step 4:
[0918] The server sends instructions received from the generative AI to the device. The device begins to operate based on the received instructions. The input is the instruction from the generative AI, and the output is the device's operation.
[0919] Step 5:
[0920] The device provides appropriate reactions and stimuli to the animal. The device operates according to the animal's movements and performs actions that the animal enjoys. The input is instructions from the server, and the output is reactions and stimuli to the animal.
[0921] Step 6:
[0922] The device detects physical stimuli from the animal and feeds that data back to the server. The server then sends this data to the generative AI and stores it as animal behavior data. The input is the physical stimulus data from the animal, and the output is feedback data to the generative AI.
[0923] The above are the specific processing steps of this system. The specific actions performed at each step allow animals to have fun in the physical store.
[0924] Example 2
[0925] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0926] Previous cat devices simply detected cat behavior and were unable to provide appropriate stimuli based on the cat's individual behavioral patterns and preferences. Furthermore, they lacked the ability to accumulate cat behavior data and learn over time, making it difficult to respond to changes in cat behavior patterns. Furthermore, they lacked the ability to automatically respond to physical stimuli from the cat and provide feedback on that response. This made it difficult to maintain a cat's interest, preventing effective play and training.
[0927] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0928] In this invention, the server includes a sensor means for detecting cat behavior, a terminal means for transmitting data from the sensor means to the server, a means for analyzing the data using a generative AI model in the server means, a device means for providing stimuli to the cat based on instructions from the server means, and a terminal means for controlling the device means. This enables real-time analysis of cat behavior data and provision of appropriate stimuli based on the individual cat's behavioral patterns and preferences. Furthermore, by accumulating cat behavior data over time and learning changes in behavioral patterns based on that data, the server can sustain the cat's interest. Furthermore, the server's ability to automatically respond to physical stimuli from the cat and provide feedback on that response allows for effective play and training.
[0929] "Sensor means" refers to a device for detecting the cat's behavior, and includes a motion sensor, a camera, etc.
[0930] The "terminal means" is a device for transmitting data from the sensor means to the server, and includes a data transmission module and a communication device.
[0931] The "server means" is a device that analyzes the received data using a generative AI model and generates instructions to provide appropriate stimulation to the cat.
[0932] A "generative AI model" is an artificial intelligence model that analyzes cat behavior data and generates instructions to provide appropriate stimuli based on the cat's behavioral patterns and preferences.
[0933] The "device means" refers to a device for providing stimulation to the cat based on instructions from the server means, and includes a robot arm, a laser pointer, etc.
[0934] "Real-time" means that data is processed immediately the moment it is generated, meaning immediate response without delay.
[0935] A "behavioral pattern" refers to a series of behavioral tendencies or habits that a cat exhibits in response to specific situations or stimuli.
[0936] "Feedback" refers to the device means' responses to physical stimuli from the cat being fed back to the generative AI model, allowing the generative AI model to learn and generate more appropriate instructions.
[0937] This invention is a system that detects cat behavior, analyzes the data, and provides appropriate stimuli to the cat. The system includes a sensor means, a terminal means, a server means, a generative AI model, and a device means.
[0938] First, the device detects the cat's behavior using sensors such as motion sensors and cameras. For example, if the cat scratches the device, the device will detect that behavior in real time.
[0939] The device then transmits the detected behavioral data to the server via a data transmission module, including the cat's movement patterns and location information, such as the time and location when the cat scratched the device.
[0940] The server inputs the received data into a generative AI model to analyze the cat's behavior. Examples of generative AI models used include OpenAI's GPT-4. The generative AI model determines whether the cat prefers aggressive play. For example, if the cat frequently exhibits aggressive behavior toward the device, the model learns that behavioral pattern.
[0941] The server then uses the analysis to instruct the device on the appropriate actions to stimulate the cat, such as moving a robotic arm to attract the cat's attention.
[0942] Finally, the terminal receives instructions from the server and controls the device to provide appropriate stimuli to the cat, such as moving a laser pointer to stimulate the cat.
[0943] As a concrete example, consider the following scenario: When a cat scratches the device with its claws, the motion sensor detects this movement. The sensor sends this information to the server via the data transmission module. The generative AI model analyzes the data and understands that cats prefer aggressive play. The generative AI model then instructs the robotic arm to perform actions that will attract the cat's attention. The robotic arm then follows these instructions and provides the cat with appropriate stimuli.
[0944] Examples of prompts to input to a generative AI model include:
[0945] "Your cat claws at the device. Analyze this behavior and determine if your cat likes aggressive play. Then instruct the device on the appropriate behavior to stimulate your cat."
[0946] The above is an embodiment of the present invention.
[0947] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0948] Step 1:
[0949] The device uses sensors to detect the cat's behavior. Specifically, motion sensors and cameras monitor the cat's movements in real time and detect aggressive behavior. For example, if the cat digs its claws into the device, this behavior will be detected.
[0950] Input: Cat movement
[0951] Output: Detected cat behavior data (e.g., time and location of cat claw movements)
[0952] Step 2:
[0953] The device transmits the detected behavioral data to the server via the data transmission module. Specifically, the data acquired from the sensor is packetized and sent to the server via the network.
[0954] Input: Detected cat behavior data
[0955] Output: Behavioral data sent to the server
[0956] Step 3:
[0957] The server inputs the received data into a generative AI model (e.g., GPT-4) to analyze the cat's behavior. Specifically, it inputs the behavioral data into a generative AI model (e.g., GPT-4) to determine whether the cat prefers aggressive play.
[0958] Input: Behavioral data sent to the server
[0959] Output: Analysis of cat behavior patterns (e.g., cats prefer aggressive play)
[0960] Step 4:
[0961] Based on the analysis results, the server instructs the device to perform appropriate actions to stimulate the cat. Specifically, it generates movement instructions for the robot arm and laser pointer based on the analysis results of the generative AI model.
[0962] Input: Analysis of cat behavior patterns
[0963] Output: Instructions for the device (e.g., moving the robot arm to attract the cat's attention)
[0964] Step 5:
[0965] The terminal receives instructions from the server and controls the device to provide appropriate stimuli to the cat, such as moving a robotic arm or laser pointer to entertain the cat.
[0966] Input: Operation instructions from the server
[0967] Output: The appropriate stimulus provided to the cat (e.g., robotic arm movement, laser pointer movement)
[0968] The above is the specific flow of the program processing of this system.
[0969] (Application example 2)
[0970] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0971] Conventional safety monitoring systems in factories have the problem of being unable to detect abnormal behavior of workers or machines in real time and take appropriate action quickly. In addition, there are only a limited number of systems that can understand animal behavior and provide appropriate stimuli, and they also have the problem of being unable to learn changes in animal behavior patterns. To solve these problems, a system is needed that can monitor the behavior of animals and workers in real time, detect abnormal behavior, and take appropriate action.
[0972] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[0973] In this invention, the server includes a spherical device that can move around freely, a means for operating the device from an information terminal, a sensor installed in the device that detects the movements and behavior patterns of the animal, a generative AI that analyzes data from the sensor and understands the animal's preferences and ways of playing, a means for providing the animal with appropriate reactions and stimuli based on the AI, a sensor that detects abnormal behavior of workers and machines in the factory, a means for transmitting data from the sensor to the generative AI and analyzing the abnormal behavior, and a means for instructing the animal on appropriate responses based on the analysis results. This makes it possible to learn changes in the animal's behavior patterns and provide appropriate stimuli, as well as to detect abnormal behavior of workers and machines in the factory in real time and respond quickly.
[0974] A "spherical device that can move freely" is a device that has a spherical shape and has the ability to physically move freely.
[0975] An "information terminal" is an electronic device used to remotely control devices such as smartphones and tablets.
[0976] A "sensor that detects animal movements and behavior patterns" is a device that detects animal movements and behavior in real time and acquires that data.
[0977] "Generative AI" is an artificial intelligence system that analyzes acquired data, understands the behavioral patterns of animals and workers, and generates appropriate responses.
[0978] "Means for providing appropriate reactions and stimuli to animals" refers to devices and methods for providing appropriate reactions and stimuli to animals based on the analysis results of generative AI.
[0979] A "sensor that detects abnormal behavior of workers and machines in a factory" is a device that monitors the behavior of workers and machines in a factory and detects abnormal behavior in real time.
[0980] "Means for analyzing abnormal behavior" refers to a method or device for transmitting data on detected abnormal behavior to the generative AI and analyzing that data.
[0981] "Means for instructing appropriate responses" refers to methods or devices for instructing appropriate responses to abnormal behavior based on the analysis results of generative AI.
[0982] As an embodiment of the present invention, the following system is constructed.
[0983] First, a spherical, freely movable device is prepared. This device is equipped with sensors that detect animal movements and behavioral patterns. The device can be controlled from an information terminal (e.g., a smartphone or tablet).
[0984] Next, we prepare a generative AI. This generative AI analyzes the data from the sensors to understand the animal's preferences and play styles. The generative AI generates instructions to provide the animal with appropriate reactions and stimuli.
[0985] Additionally, sensors will be installed in the factory to detect abnormal behavior by workers or machines. These sensors will also send data to the generative AI, which will analyze the abnormal behavior and provide instructions on how to respond appropriately to the abnormal behavior.
[0986] As a specific example, the following system can be considered.
[0987] 1. Animal behavior monitoring system
[0988] If an animal exhibits aggressive behavior toward the device, the sensor detects the behavior and sends the information to the generative AI. The generative AI analyzes the information and understands that the animal prefers aggressive play. Based on this understanding, it instructs the device to perform actions that stimulate the animal. The device then acts according to the instructions and provides the appropriate stimulation to the animal.
[0989] 2. Factory safety monitoring system
[0990] When a worker or machine behaves abnormally in a factory, sensors detect the behavior and send the data to the generative AI. The generative AI analyzes the data and detects abnormal behavior. If an abnormality is detected, the generative AI instructs the appropriate response, such as sounding an alarm or halting work.
[0991] The hardware used includes sensors to detect animal movement, sensors to detect abnormal behavior in factories, information terminals, and spherical devices, while the software uses generative AI models.
[0992] As a concrete example, the following prompt sentence could be input into a generative AI model:
[0993] Example prompt sentence:
[0994] "Analyze the data when a worker falls, and if it is determined to be abnormal, issue an instruction to sound an alarm."
[0995] In this way, it is possible to learn changes in animal behavior patterns and provide appropriate stimuli, as well as detect abnormal behavior of workers or machinery in the factory in real time and respond quickly.
[0996] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0997] Step 1:
[0998] Sensors detect the movement of animals and workers.
[0999] Input: Animal and worker movement data
[1000] Data processing: Sensors acquire operational data in real time and convert it into digital signals.
[1001] Output: Digitized motion data
[1002] Step 2:
[1003] The data obtained from the sensors is sent to the generative AI.
[1004] Input: Digitized motion data
[1005] Data processing: The data acquired by the sensors is packetized for transmission to the generative AI.
[1006] Output: Packetized motion data
[1007] Step 3:
[1008] Generative AI analyzes motion data.
[1009] Input: Packetized motion data
[1010] Data computation: Generative AI analyzes movement data to identify abnormal movements and animal behavior patterns.
[1011] Output: Analysis results (detection of abnormal behavior and animal behavior patterns)
[1012] Step 4:
[1013] Generative AI will then suggest appropriate responses based on the analysis results.
[1014] Input: Analysis results
[1015] Data calculation: Generative AI determines the appropriate response (e.g., sound an alarm, activate a device, etc.) based on the analysis results.
[1016] Output: Action instructions
[1017] Step 5:
[1018] Devices and information terminals operate according to the instructions of generative AI.
[1019] Input: Action instructions
[1020] Specific action: The device provides an appropriate stimulus to the animal, the information terminal sounds an alarm, etc.
[1021] Output: Action taken (stimulate animal, sound alarm, etc.)
[1022] Step 6:
[1023] The generative AI receives feedback from the results of the actions it performs.
[1024] Input: The result of the action taken
[1025] Data processing: Generative AI evaluates the results of the execution and accumulates the data to reflect in the next response.
[1026] Output: Updated behavior database
[1027] Through these steps, it will be possible to learn changes in animal behavior patterns and provide appropriate stimuli, as well as to detect abnormal behavior of workers or machinery in the factory in real time and respond quickly.
[1028] Example 3
[1029] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1030] Conventional animal devices have difficulty learning an animal's behavioral patterns in real time and providing appropriate reactions and stimuli based on that. Furthermore, there were no systems that could accumulate animal behavioral data over a long period of time and learn from those changes. This made it difficult to provide appropriate reactions and stimuli in response to changes in an animal's behavioral patterns.
[1031] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.
[1032] In this invention, the server includes means for storing data from sensors that detect animal movements and behavioral patterns in a database, means for cleansing the stored data and extracting behavioral patterns, means for the generative artificial intelligence to learn changes in behavioral patterns, and means for generating appropriate instructions based on the learning results, which makes it possible to provide appropriate reactions and stimuli in response to changes in the animal's behavioral patterns.
[1033] The "device" is a spherical device that can move freely and detects the movements and behavioral patterns of animals.
[1034] A "personal digital assistant" is a portable electronic device, such as a smartphone or tablet, that is used to operate the device.
[1035] A "sensor" is a sensing device installed on a device to detect animal movements and behavior patterns.
[1036] "Generative AI" is an AI that analyzes data from sensors, understands animals' preferences and play styles, and provides appropriate reactions and stimulation.
[1037] The "database" is an information management system for storing animal behavior data collected from sensors.
[1038] "Cleansing" is a process of removing noise from raw data stored in a database and filling in missing data.
[1039] A "behavioral pattern" is a series of behaviors that an animal tends to exhibit at a particular time or in a particular situation.
[1040] "Learning" is the process by which generative artificial intelligence understands changes in animal behavior patterns based on accumulated data.
[1041] "Instructions" are specific operational commands that generative AI issues to a device based on its learning results.
[1042] A "reaction" is a specific action or stimulus that the device performs on the animal in accordance with instructions from the generative artificial intelligence.
[1043] This invention is a system that learns the behavioral patterns of animals in real time and provides appropriate reactions and stimuli based on the learned patterns. Specific embodiments of this system are described below.
[1044] Hardware and software used
[1045] Hardware: Sensors (cameras, microphones, etc.) that detect animal movements and behavior patterns, a spherical device that can move freely, and mobile information terminals (smartphones and tablets).
[1046] Software: Generative AI (e.g., OpenAI's GPT-4), databases (MySQL or MongoDB)
[1047] System configuration
[1048] 1. Device:
[1049] It is equipped with sensors to detect animal movements and behavior patterns.
[1050] Data from sensors is collected in real time and sent to a server.
[1051] 2. Mobile Information Devices:
[1052] Used as a means to operate the device.
[1053] The user can control the operation of the device through the personal digital assistant.
[1054] 3. Server:
[1055] Receives data sent from sensors and stores it in a database.
[1056] The accumulated data is cleansed and behavioral patterns are extracted.
[1057] Use generative artificial intelligence to learn changing behavioral patterns.
[1058] Based on the learning results, appropriate instructions are generated for the device.
[1059] Specific examples
[1060] For example, suppose a cat initially prefers aggressive play, but over time develops a preference for gentle play.
[1061] 1. Data Collection:
[1062] The device (camera) captures the cat poking at the moving toy.
[1063] The server receives the video data and stores it in a database.
[1064] 2. Data preprocessing:
[1065] The server removes unnecessary parts from the video data and extracts only the cat's movements.
[1066] The server organizes the extracted data by time and analyzes the cat's behavioral patterns.
[1067] 3. Learning behavioral patterns:
[1068] The server uses generative artificial intelligence to learn when the cat has changed from aggressive to calm play.
[1069] The server saves the learning results and proceeds to the next step.
[1070] 4. Generating appropriate instructions:
[1071] The server inputs a prompt to the generative artificial intelligence: "Since the cat has started to prefer gentle play, please generate instructions to move a toy with gentle movements."
[1072] The server sends the generated instructions to the device.
[1073] 5. Provide a reaction:
[1074] The device (toy) makes gentle movements according to instructions received from the server.
[1075] The device provides gentle play for cats and responds to their behavioral patterns.
[1076] Prompt Sentence Examples
[1077] By inputting the following prompt sentence into the generative AI, instructions based on changes in the cat's behavioral patterns can be generated.
[1078] Below is the cat's behavioral data. Initially, the cat preferred aggressive play, but over time, it began to prefer gentle play. Based on this change, generate instructions to provide the cat with appropriate reactions and stimuli.
[1079] In this way, the system can provide appropriate reactions and stimuli in response to changes in the animal's behavioral patterns. The flow of the identification process in the third embodiment will be described with reference to FIG.
[1080] Step 1: Data collection
[1081] The devices (sensors) monitor the movements of animals in real time and collect behavioral data. For example, a camera captures the movements of a cat and a microphone records the cat's meows.
[1082] Input: Real-time animal movements and sounds
[1083] Output: Animal behavior data (video data, audio data)
[1084] How it works: The camera captures the cat's movements and the microphone records the cat's meows. The device collects this data and sends it to a server.
[1085] Step 2: Preprocessing the data
[1086] The server cleanses the raw data stored in the database, specifically removing noise and filling in missing data.
[1087] Input: Raw data (video data, audio data)
[1088] Output: Cleansed data
[1089] Specific operation: The server removes unnecessary parts from the video data, filters noise from the audio data, and fills in any missing data.
[1090] Step 3: Extracting behavioral patterns
[1091] The server organizes the cleansed data by time and extracts behavioral patterns.
[1092] Input: Cleansed data
[1093] Output: Behavioral pattern data
[1094] Specific behavior: The server analyzes the cleansed data and extracts the behavior of animals at specific times of the day.
[1095] Step 4: Learning behavioral patterns
[1096] The server uses a generative AI model to learn animal behavior patterns based on the accumulated data.
[1097] Input: Behavioral pattern data
[1098] Output: Learning results (changes in behavioral patterns)
[1099] How it works: The server inputs behavioral pattern data into the generative AI model, which then learns changes in the animal's behavior, for example, when a cat changes from aggressive play to calm play.
[1100] Step 5: Generate appropriate instructions
[1101] The server generates appropriate instructions for the device based on the learning results.
[1102] Input: Training results
[1103] Output: Instruction data
[1104] Specific behavior: The server inputs a prompt to the generative AI model, saying, "Since the cat has started to prefer gentle play, please generate instructions to move a toy with gentle movements," and sends the generated instructions to the device.
[1105] Step 6: Provide a reaction
[1106] The terminal (device) operates according to the instructions received from the server.
[1107] Input: Instruction data
[1108] Output: Reaction to animals
[1109] Specific behavior: The device activates a toy with gentle movements, providing gentle play for the cat.
[1110] (Application example 3)
[1111] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1112] Conventional animal devices and generative AI are limited to learning animal behavior patterns and providing appropriate reactions. However, there were no systems that could learn the behavior patterns of workers in factories and provide appropriate support. This meant that improvements in work efficiency and reductions in worker burden were not fully achieved. Therefore, there is a need for a system that can learn the behavior patterns of workers in factories and provide appropriate support.
[1113] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.
[1114] In this invention, the server includes a spherical device that can move around freely, a means for operating the device from a smartphone, a sensor installed in the device that detects the movements and behavioral patterns of the animal, a generative AI that analyzes data from the sensor and understands the preferences and behavioral patterns of the animal, a means for providing appropriate reactions and stimuli to the animal based on the AI, and a means for accumulating behavioral data of workers over time, learning changes in behavioral patterns based on the accumulated data, and providing appropriate support. This makes it possible to learn the behavioral patterns of workers in the factory and provide appropriate support.
[1115] A "spherical device that can move freely" is a device that has a spherical shape and has the ability to physically move freely.
[1116] "Means for operating from a smartphone" refers to the interface or software for remotely operating the device using a smartphone.
[1117] A "sensor that detects animal movements and behavior patterns" is a device that detects animal movements and behavior in real time and collects that data.
[1118] "Generative AI" is an artificial intelligence technology that learns the behavioral patterns of animals and workers based on collected data and provides appropriate reactions and support.
[1119] "Means for providing appropriate reactions and stimuli" refers to devices and functions that provide appropriate reactions and stimuli to animals and workers based on the results of learning by the generative AI.
[1120] The "means for accumulating worker behavior data over time" is a system for continuously recording worker behavior and storing that data for a long period of time.
[1121] "Means of learning changes in behavioral patterns and providing appropriate support" refers to a function that analyzes accumulated behavioral data, recognizes changes in behavioral patterns, and provides optimal support to workers.
[1122] To implement this invention, the following hardware and software are required. The hardware includes a spherical, freely movable device, a smartphone, a factory robot, and sensors. The software includes Python, scikit-learn, and a generative AI model.
[1123] The spherical, mobile device is equipped with sensors that detect the movements and behavioral patterns of animals and workers in real time. The sensors detect and collect data on the movements and behavioral patterns of animals and workers. The collected data is then sent to a generative AI model for analysis.
[1124] The generative AI model learns the behavioral patterns of animals and workers based on collected data. This learning process uses Python and scikit-learn. Specifically, it uses the KMeans clustering algorithm to classify behavioral patterns and learns how behavioral patterns change over time.
[1125] Once trained, the generative AI model will provide instructions for appropriate reactions and stimuli to animals and workers. For example, if an animal prefers aggressive play, the device will provide appropriate stimuli. Also, if a worker transitions from manual to automated tasks, the robot will provide appropriate support.
[1126] For example, if a worker is manually assembling parts in a factory, a robot can assist with carrying the parts, or if a worker is operating automated machinery, a robot can assist with machine maintenance.
[1127] An example of a prompt is as follows:
[1128] "Develop AI that collects data on worker behavior in factories and learns changes in behavioral patterns based on that data. For example, if a worker transitions from manual to automated tasks, create a robot that learns the change and provides appropriate support."
[1129] In this way, the present invention can improve work efficiency in a factory and reduce the burden on workers.
[1130] The flow of the specific processing in Application Example 3 will be described with reference to FIG.
[1131] Step 1:
[1132] The server uses sensors to collect behavioral data of animals and workers. The input is real-time behavioral data obtained from the sensors, and the output is a list of collected behavioral data. Specifically, the sensors detect the movements of animals and workers and send the data to the server.
[1133] Step 2:
[1134] The server accumulates the collected behavioral data. The input is the behavioral data collected in step 1, and the output is a database of accumulated behavioral data. Specifically, the server saves the data it receives in the database.
[1135] Step 3:
[1136] The server trains a generative AI model using the accumulated behavioral data. The input is the accumulated behavioral data, and the output is the trained generative AI model. Specifically, the server uses Python and scikit-learn to run the KMeans clustering algorithm and classify behavioral patterns.
[1137] Step 4:
[1138] When new behavioral data is input, the server predicts behavioral patterns using a generative AI model. The input is the new behavioral data, and the output is the predicted behavioral pattern. Specifically, the server inputs the new data into the generative AI model and obtains the prediction result.
[1139] Step 5:
[1140] The server issues instructions to provide appropriate reactions and support based on the prediction results. The input is the predicted behavior pattern, and the output is instructions for reactions and support. In terms of specific operations, the server instructs the device or robot to perform appropriate actions.
[1141] Step 6:
[1142] The terminal (smartphone) receives instructions from the server and operates the device or robot. The input is the instruction from the server, and the output is the operation of the device or robot. Specifically, the smartphone sends operation commands to the device or robot.
[1143] Step 7:
[1144] The user monitors the operation of the device or robot and operates it manually as necessary. The input is the operating status of the device or robot, and the output is the user's operation command. Specifically, the user manually operates the device or robot using a smartphone.
[1145] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1146] "Example 1"
[1147] As one embodiment of the present invention, a system incorporating an emotion engine is provided. This system recognizes the user's emotions and adjusts the reactions and stimuli given to the cat according to those emotions. Specifically, when the user is happy, the system encourages the cat to play actively. Conversely, when the user is depressed, the system encourages the cat to play quietly. This allows for optimal interaction with the cat according to the user's emotional state.
[1148] "Example 2"
[1149] The emotion engine also recognizes emotions from the user's tone of voice, facial expressions, or physical reactions. For example, if the user is smiling, the system recognizes the user as happy and encourages the cat to play actively. Conversely, if the user is crying, the system recognizes the user as sad and encourages the cat to play quietly. This allows the system to more accurately understand the user's emotional state and optimally interact with the cat accordingly.
[1150] "Example 3"
[1151] Furthermore, the emotion engine adjusts the device's movements and reactions according to the user's emotions, improving the interaction between the user and the cat. For example, when the user is angry, the system suppresses the device's movements to prevent the cat from bothering the user. Conversely, when the user is happy, the system activates the device's movements to allow the cat to play with the user in a fun way. This enables optimal interaction with the cat according to the user's emotional state.
[1152] The processing flow of each embodiment will be described below.
[1153] "Example 1"
[1154] Step 1: The user emotion engine recognizes the user's emotion.
[1155] Step 2: Based on the recognized emotion, the system adjusts its reactions and stimuli to the cat.
[1156] Step 3: When the user is happy, the system encourages active play with the cat.
[1157] Step 4: When the user is depressed, the system prompts the cat for quiet play.
[1158] "Example 2"
[1159] Step 1: The emotion engine recognizes emotions from the user's tone of voice, facial expressions, or physical reactions.
[1160] Step 2: If the user is smiling, the system recognizes that the user is happy and encourages active play with the cat.
[1161] Step 3: If the user is crying, the system will recognize that the user is sad and prompt the cat to play quietly.
[1162] "Example 3"
[1163] Step 1: The emotion engine recognizes the user's emotion.
[1164] Step 2: Adjust the device's behavior and response based on the user's emotions.
[1165] Step 3: When the user is angry, the system inhibits the device's movement to prevent the cat from bothering the user.
[1166] Step 4: When the user is happy, the system activates the device's movements, allowing the cat to play happily with the user.
[1167] Example 1
[1168] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1169] Previous animal devices simply detected animal movements and behavioral patterns, but were unable to understand the animal's preferences and play styles and provide appropriate reactions or stimulation. Furthermore, they lacked the ability to adjust interactions with the animal according to the user's emotional state, making it difficult to deepen the relationship between the user and the animal.
[1170] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1171] In this invention, the server includes a spherical device that can move around freely, a means for operating the device from an information terminal, a sensor installed in the device that detects the animal's movements and behavior patterns, a generative AI that analyzes data from the sensor and understands the animal's preferences and ways of playing, a means for providing appropriate reactions and stimuli to the animal based on the AI, and an emotion engine that recognizes the user's emotions and adjusts the reactions and stimuli to the animal according to those emotions. This makes it possible to understand the animal's behavior patterns and provide optimal reactions and stimuli according to the user's emotional state.
[1172] A "device" is a spherical apparatus that can move freely.
[1173] An "information terminal" is an electronic device that provides a means for operating a device.
[1174] A "sensor" is a device used to detect animal movements and behavior patterns.
[1175] "Generative AI" is artificial intelligence that analyzes data from sensors to understand animals' preferences and play styles.
[1176] "Means for providing reactions and stimuli" refers to a mechanism for providing appropriate reactions and stimuli to animals based on the analysis results of the generative AI.
[1177] The "emotion engine" is a system that recognizes the user's emotions and adjusts the reactions and stimuli given to animals according to those emotions.
[1178] "Animal behavior data" is information about animal movements and behavior patterns.
[1179] "Feedback" is the process of feeding the device's response to physical stimuli from the animal back to the generative AI.
[1180] The present invention is a system that understands the behavioral patterns of animals and provides optimal reactions and stimuli according to the emotional state of the user. Specific embodiments of this system will be described below.
[1181] Hardware and software used
[1182] Device: A spherical, freely movable device equipped with motors, batteries, and sensors.
[1183] Information terminal: An electronic device that provides a means to operate a device. Examples include smartphones and tablets.
[1184] Sensor: A device used to detect animal movements and behavior patterns. Accelerometers and infrared sensors are used.
[1185] Generative AI: This is artificial intelligence that analyzes data from sensors to understand the animals' preferences and play styles. It uses AI models that run on the cloud.
[1186] Emotion engine: A system that recognizes the user's emotions and adjusts the animal's reactions and stimuli accordingly. Emotion recognition software is used.
[1187] Program processing
[1188] The server receives the animal's behavioral data sent from the device and inputs it into the generative AI. The generative AI analyzes the received data to understand the animal's preferences and play styles. Based on the analysis, the generative AI then generates instructions to provide the animal with appropriate reactions and stimuli, and sends them to the device.
[1189] The device collects data to recognize the user's emotions. For example, it uses the smartphone's camera and microphone to analyze the user's facial expressions and tone of voice. The emotion engine receives the user's emotional data and adjusts the animal's reactions and stimuli according to the user's emotions.
[1190] Specific examples
[1191] Example 1: When a cat approaches the device, the sensor detects its movement and sends the data to the server. The server uses a generative AI model to determine that the cat is interested and sends an instruction to the device to "rotate to attract the cat's attention." The device then starts rotating in place.
[1192] Example 2: When a user is using a smartphone, the device captures the user's facial expression with the camera, and the emotion engine recognizes that the user is happy. The server then sends instructions to the generative AI model to encourage active play, and the device behaves as if it is running around with a cat.
[1193] Prompt Sentence Examples
[1194] "Describe what happens when a cat approaches the device."
[1195] "Please explain how the user reacts to the cat when they are happy."
[1196] The above is a specific embodiment for carrying out the present invention. This system makes it possible to understand the behavioral patterns of animals and provide optimal reactions and stimuli according to the emotional state of the user.
[1197] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1198] Step 1:
[1199] Initializing the device
[1200] Server: Initializes the device, checks the motor and battery status, and checks that the sensors are working properly.
[1201] Input: The signal that powers the device.
[1202] Output: Signals that initialization is complete.
[1203] Specific operation: When the device is turned on, the server checks the status of each component of the device and, if everything is normal, sends a signal indicating that initialization is complete.
[1204] Step 2:
[1205] Cat movement detection
[1206] Device: Uses internal sensors to detect cat movements and behavior patterns in real time.
[1207] Input: Cat movements and behavior.
[1208] Output: Detection data.
[1209] What it does: When your cat approaches or touches the device, the sensor captures the movement and collects data.
[1210] Step 3:
[1211] Sending data
[1212] Device: Sends detected data to the server.
[1213] Input: Sensor data.
[1214] Output: Sending data to the server.
[1215] Specific operation: The data collected by the sensor is sent to the server via wireless communication.
[1216] Step 4:
[1217] Analyzing the data
[1218] Server: Inputs the received data into a generative AI model to analyze the cat's behavioral patterns and preferences.
[1219] Input: Sensor data.
[1220] Output: Behavioral pattern analysis results.
[1221] Specific operation: The server inputs the data "a cat touched the device" into the generated AI model, and the AI determines that "the cat is showing interest."
[1222] Step 5:
[1223] Generate instructions
[1224] Server: Based on the analysis results, generates instructions to provide the cat with appropriate reactions and stimuli.
[1225] Input: Behavioral pattern analysis results.
[1226] Output: Instructions to the device.
[1227] Specific behavior: The server generates an instruction to "rotate the device to attract the cat's attention" and sends it to the device.
[1228] Step 6:
[1229] Device Operation
[1230] Device: Operates according to instructions from the server and provides appropriate reactions and stimuli to the cat.
[1231] Input: Instructions from the server.
[1232] Output: Device behavior.
[1233] Specific action: The device will start to rotate and behave in a way that will attract the cat's interest.
[1234] Step 7:
[1235] User Emotion Recognition
[1236] Device: Collecting data to recognize user emotions, for example using a smartphone's camera or microphone.
[1237] Input: The user's facial expression and tone of voice.
[1238] Output: Emotion data.
[1239] Specific operation: The device analyzes the user's facial expressions and tone of voice to recognize their emotional state.
[1240] Step 8:
[1241] Adjusting instructions based on emotion
[1242] Server: Receives the user's emotional data and adjusts the cat's reactions and stimuli.
[1243] Input: Emotion data.
[1244] Output: Adjusted instructions.
[1245] Specific behavior: If the server recognizes that the user is happy, it sends instructions to the generative AI model to encourage active play. The device then moves as if it is running around with the cat.
[1246] (Application example 1)
[1247] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1248] Conventional pet devices simply detect animal behavior patterns and are unable to deeply understand the animal's preferences or play styles. Furthermore, they lack the ability to adjust interactions with the animal according to the user's emotional state, making it difficult to provide interactions with the pet that are optimal for the user's emotional state. Furthermore, there was a lack of means to display device operation and animal behavior data in real time, making it difficult for users to understand the device's operating status and the animal's behavior.
[1249] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means. In this invention, the server includes a spherical device that can move freely around, means for operating the device from an information terminal, a sensor installed in the device that detects the animal's movements and behavior patterns, a generative AI that analyzes data from the sensor and understands the animal's preferences and play styles, means for providing appropriate reactions and stimuli to the animal based on the AI, means for recognizing the user's emotional state using an emotion engine and adjusting the reactions and stimuli to the animal according to the emotional state, and means for displaying operation of the device and animal behavior data on the information terminal. This makes it possible to deeply understand the animal's behavior patterns and provide optimal interactions with the pet according to the user's emotional state.
[1250] A "spherical device that can move freely" is a spherical device that has a motor and battery inside and can move autonomously based on external instructions.
[1251] An "information terminal" is an electronic device, such as a smartphone or tablet, that is operated by a user to control the device.
[1252] A "sensor that detects animal movements and behavior patterns" is a device that detects the location, speed, and movements of animals in real time and collects that data.
[1253] "Generative AI" is an artificial intelligence system that analyzes collected data to understand animals' preferences and play styles.
[1254] The "emotion engine" is a system that recognizes the user's emotional state and adjusts interactions with animals based on that information.
[1255] "Means for providing appropriate reactions and stimuli to animals" refers to a mechanism for making animals behave and react appropriately based on the analysis results of the generative AI.
[1256] The "means for displaying the operation of the device and the behavioral data of the animal on the information terminal" is a function for displaying the operating status of the device and the behavioral data of the animal on the information terminal in real time.
[1257] A system for implementing this invention includes a spherical, freely movable device, an information terminal, a sensor that detects animal movements and behavior patterns, a generative AI, an emotion engine, and a means for displaying on the information terminal.
[1258] System configuration
[1259] 1. Spherical device:
[1260] It is equipped with a motor and battery inside and moves autonomously based on external instructions.
[1261] It is equipped with sensors to detect animal movements and behavior patterns.
[1262] 2. Information terminal:
[1263] Electronic devices that are operated by users, such as smartphones and tablets.
[1264] Displays device operation and animal behavior data in real time.
[1265] 3. Sensor:
[1266] It senses the animal's location, speed, movement, etc. in real time and collects that data.
[1267] 4. Generative AI:
[1268] The collected data is analyzed to understand the animals' preferences and play styles.
[1269] A generative AI model is used to generate instructions to provide appropriate reactions and stimuli to the animal.
[1270] 5. Emotion Engine:
[1271] It recognizes the user's emotional state and adjusts interactions with the animal based on that information.
[1272] 6. Display means:
[1273] The device's operating status and animal behavior data are displayed on the information terminal.
[1274] Program processing explanation
[1275] The server first collects animal behavior data from sensors. This data is sent to the generative AI, which analyzes the animal's preferences and play patterns. Based on the analysis results, the generative AI generates instructions to provide the animal with appropriate reactions and stimuli. Furthermore, an emotion engine recognizes the user's emotional state and adjusts interactions with the animal based on that information. Finally, device operations and animal behavior data are displayed in real time on the information terminal.
[1276] Specific examples
[1277] For example, if this system is used in a pet shop, when a customer is playing with a cat, the smartphone app will analyze the cat's behavior in real time and adjust how the customer plays with the cat depending on the customer's emotional state. An example of a prompt sentence to be input to the generative AI model is as follows:
[1278] Example prompt sentence:
[1279] Cat behavior data: Movement: Active, Play: Chasing a ball
[1280] User's emotional state: State: Happy
[1281] Based on this data, generate instructions to provide the appropriate reactions and stimuli for your cat.
[1282] By inputting this prompt into a generative AI model, appropriate reactions and stimulation instructions can be obtained for the cat.
[1283] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1284] Step 1:
[1285] The server acquires animal behavior data from sensors. The sensors detect the animal's position, speed, movement, etc. in real time and send the data to the server. The input is raw data from the sensors, and the output is the animal behavior data sent to the server.
[1286] Step 2:
[1287] The server sends the acquired animal behavior data to the generative AI. The generative AI analyzes the received data and understands the animal's preferences and play styles. The input is the animal's behavior data, and the output is the analysis results on the animal's preferences and play styles.
[1288] Step 3:
[1289] The server generates instructions to provide appropriate reactions and stimuli to the animal based on the analysis results from the generative AI. Using the generative AI model, it creates prompts and generates specific instructions for the animal. The input is the analysis results of the generative AI, and the output is instructions for the animal.
[1290] Step 4:
[1291] The server recognizes the user's emotional state using an emotion engine. The emotion engine analyzes data such as the user's facial expressions and voice to identify the user's emotional state. The input is the user's emotional data, and the output is the user's emotional state.
[1292] Step 5:
[1293] The server adjusts the reactions and stimuli of the animals based on the user's emotional state. Based on the output of the emotion engine, it modifies the instructions of the generative AI to provide optimal interactions. The inputs are the user's emotional state and the instructions of the generative AI, and the output is the adjusted instructions for the animals.
[1294] Step 6:
[1295] The server sends the adjusted instructions to the spherical device, which then acts based on the received instructions and provides the appropriate reaction or stimulus to the animal. The input is the adjusted instructions, and the output is the device's behavior.
[1296] Step 7:
[1297] The terminal displays device operation and animal behavior data in real time. Users can check the device's operating status and the animal's behavior through the information terminal. The input is device operation data and animal behavior data, and the output is the information displayed on the information terminal.
[1298] Example 2
[1299] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1300] Previous animal devices struggled to provide appropriate responses to animal behavior and were unable to realize interactions that took into account the user's emotional state. This made it difficult to provide an optimal experience for both the animal and the user. Furthermore, they lacked systems that could learn changes in the animal's behavior patterns and adapt over the long term.
[1301] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[1302] In this invention, the server includes a means for operating a spherical, freely movable device, a means for using sensors to detect the animal's movements and behavioral patterns, a means for using generative AI to analyze data from the sensors and understand the animal's preferences and play styles, a means for using an emotion engine to recognize the user's emotional state, and a means for optimizing interactions with the animal based on the generative AI and the emotion engine. This allows for appropriate responses to the animal's behavior and enables interactions that take the user's emotional state into account. It also allows for learning and long-term adaptation to changes in the animal's behavioral patterns.
[1303] A "device" is a spherical apparatus that can move freely.
[1304] An "information terminal" is an electronic device that provides a means for operating a device.
[1305] A "sensor" is a device that detects animal movements and behavior patterns.
[1306] "Generative AI" is artificial intelligence that analyzes data from sensors to understand animals' preferences and play styles.
[1307] An "emotion engine" is software or hardware for recognizing a user's emotional state.
[1308] "Reactions" are appropriate responses or stimuli provided to animals based on generative AI.
[1309] "Interaction optimization" refers to optimizing the interaction between animals and users based on generative AI and emotion engines.
[1310] "Behavioral data" is information about animal movements and behavior patterns.
[1311] "Feedback" means that the device automatically responds to physical stimuli from the animal and transmits that response to the generative AI.
[1312] The present invention provides a system for providing optimal interaction based on the behavior of animals and the emotional state of a user. Specific embodiments of this system are described below.
[1313] Hardware and software used
[1314] Device: A spherical, freely movable device that provides physical responses to the animal's behavior.
[1315] Information terminal: An electronic device that provides a means to operate a device, such as a smartphone or tablet.
[1316] Sensors: These are devices that detect animal movements and behavioral patterns. They are installed in devices and collect data in real time.
[1317] Generative AI: This is artificial intelligence that analyzes data from sensors to understand what animals like and how they play. For example, OpenAI's GPT-4 is one example.
[1318] Emotion engine: Software or hardware that recognizes the user's emotional state by analyzing the user's tone of voice, facial expressions, or physical reactions.
[1319] System Operation
[1320] The server receives animal behavior data sent from the sensors and analyzes it using generative AI, which understands the animal's behavioral patterns and sends instructions to the device to provide appropriate reactions and stimuli.
[1321] Additionally, the server uses an emotion engine to recognize the user's emotional state. The emotion engine analyzes the user's tone of voice and facial expressions to determine whether the user is happy or sad. The server then optimizes interactions with the animals based on this emotional state.
[1322] Specific examples
[1323] For example, if a cat scratches the device, the sensor detects the action. The sensor sends the data to a server, which analyzes the data using generative AI. The generative AI understands that the cat prefers aggressive play and instructs the device to move a cat toy. The device then follows this instruction to move the cat toy and provide the appropriate stimulation to the cat.
[1324] At the same time, the server uses its emotion engine to recognize the user's smile and determine that the user is happy, prompting the cat to play actively according to the user's emotional state.
[1325] Prompt Sentence Examples
[1326] "What should I do if my cat exhibits aggressive behavior toward the device?"
[1327] "What kind of play should the user be prompted to do with the cat when they smile?"
[1328] This system allows optimal interaction depending on the emotional state of the animal and the user.
[1329] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1330] Step 1:
[1331] Data collection by sensors
[1332] The server monitors the animal's behavior in real time using sensors installed on the device. The sensors detect aggressive behavior from the animal toward the device. For example, if a cat digs its claws into the device, the sensor detects the behavior. The input is the animal's behavior data, and the output is the detected behavior data.
[1333] Step 2:
[1334] Sending data
[1335] The sensor sends the detected behavioral data to the server. The server receives this data and passes it to the generative AI. The input is the behavioral data sent from the sensor, and the output is the behavioral data sent to the server.
[1336] Step 3:
[1337] Generative AI analysis
[1338] The server analyzes the received behavioral data using a generative AI. The generative AI uses, for example, OpenAI's GPT-4, to understand that animals prefer aggressive play. Specifically, it analyzes the behavioral data and determines that the behavior constitutes aggressive play. The input is the behavioral data sent to the server, and the output is the analysis result.
[1339] Step 4:
[1340] Device Instructions
[1341] The server issues instructions to the device based on the analysis results of the generative AI. For example, it instructs the device to move a cat toy. The device follows this instruction to move the cat toy and provide the cat with an appropriate stimulus. The input is the analysis results of the generative AI, and the output is the instruction to the device.
[1342] Step 5:
[1343] Recognizing user emotions with an emotion engine
[1344] The server uses an emotion engine to recognize the user's emotions. The emotion engine analyzes the user's tone of voice, facial expressions, or physical reactions. For example, if the user is smiling, the emotion engine recognizes that the user is happy. The input is the user's emotion data, and the output is the emotion recognition result.
[1345] Step 6:
[1346] Optimizing cat interaction
[1347] The server optimizes interactions with animals according to the user's emotional state. For example, if the user is smiling, it encourages the animal to play actively. Conversely, if the user is crying, it encourages the animal to play quietly. This allows optimal interactions with animals according to the user's emotional state. The input is the emotion recognition result, and the output is the optimized interaction instructions.
[1348] (Application example 2)
[1349] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1350] Conventional pet devices have difficulty providing interactions that fully consider the animal's behavior and the user's emotional state. In addition, they lack a means to provide appropriate stimuli based on the animal's behavior patterns and the user's emotions, which prevents the satisfaction of both the pet and the user.
[1351] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[1352] In this invention, the server includes a spherical device that can move freely, a means for operating the device from an information terminal, a sensor installed in the device that detects the animal's movements and behavior patterns, a generative AI that analyzes data from the sensor and understands the animal's preferences and play styles, a means for providing the animal with appropriate reactions and stimuli based on the AI, an emotion engine that recognizes the user's emotional state, and a means for adjusting interaction with the animal based on the emotion engine. This enables appropriate interaction that takes into account the animal's behavior and the user's emotional state in real time.
[1353] A "spherical device that can move freely" is a device that has a spherical shape and can physically move freely.
[1354] An "information terminal" is an electronic device that is operated by a user, such as a smartphone or tablet.
[1355] A "sensor that detects animal movements and behavior patterns" is a device that detects animal movements and behavior in real time.
[1356] "Generative AI" is an artificial intelligence system that analyzes collected data to understand animals' preferences and behavioral patterns.
[1357] "Means for providing appropriate reactions and stimuli" refers to devices and methods for providing appropriate reactions and stimuli to animals based on the analysis results of generative AI.
[1358] The "emotion engine" is a system that recognizes emotions from the user's tone of voice, facial expressions, and physical reactions.
[1359] The "means for adjusting interaction with animals" refers to a device or method for optimizing interaction with animals based on the recognition results of the emotion engine.
[1360] The present invention provides a system that takes into account the behavior of animals and the emotional state of a user in real time to provide appropriate interactions. Specific embodiments for realizing this system are described below.
[1361] System Configuration
[1362] The system consists of the following main components:
[1363] 1. A spherical, freely movable device:
[1364] The device is a spherical device that can move freely to induce animal behavior. It is equipped with motors and batteries and operates according to instructions from an information terminal.
[1365] 2. Information terminal:
[1366] An electronic device such as a smartphone or tablet that provides an interface for users to operate the device and has a dedicated application installed to control the device's operation.
[1367] 3. Sensors that detect animal movements and behavior patterns:
[1368] The device is equipped with a camera and an accelerometer to detect animal movements and behavior in real time.
[1369] 4. Generative AI:
[1370] It is an artificial intelligence system that analyzes collected data to understand the preferences and behavioral patterns of animals. Generative AI accumulates animal behavior data over time and learns changes in behavioral patterns based on that data.
[1371] 5. Means of providing appropriate reactions and stimuli:
[1372] This is a device or method that provides appropriate responses or stimuli to animals based on the analysis results of generative AI. For example, the device can stimulate the animal by performing a specific movement.
[1373] 6. Emotion Engine:
[1374] This system recognizes emotions from the user's tone of voice, facial expressions, and physical reactions. The emotion engine detects the user's emotional state in real time through a camera and microphone.
[1375] 7. Ways to regulate interactions with animals:
[1376] The present invention provides an apparatus and method for optimizing interactions with animals based on the recognition results of an emotion engine. For example, if the user is recognized as sad, the device will behave calmly.
[1377] Program processing explanation
[1378] The server detects the user's emotional state through a camera and microphone and sends it to the generative AI. The generative AI analyzes the animal's behavioral data and the user's emotional data to determine an appropriate reaction. The information terminal receives instructions from the generative AI and instructs the device on how to operate.
[1379] The hardware used includes a camera (to detect animal behavior and user facial expressions), a microphone (to detect the tone of the user's voice), and a motor (to control the device's movements), while the software includes OpenCV (image processing), Keras (emotion recognition model), and requests (to communicate with AI services).
[1380] Specific examples
[1381] For example, if a user comes into the store with a smiling pet, the emotion engine recognizes that the user is happy. The generative AI analyzes the animal's behavioral data and the user's emotional data and instructs the device to behave in a way that encourages active play. Conversely, if the user has a sad expression, the device is instructed to behave calmly.
[1382] Prompt Sentence Examples
[1383] "If the user's emotion is 'happy' and the animal's behavior is 'aggressive,' provide the animal with a toy that encourages positive play."
[1384] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1385] Step 1:
[1386] The server captures the user's facial expressions and tone of voice in real time through a camera and microphone. It receives camera footage and audio data as input. It preprocesses these data using OpenCV and audio processing libraries to extract the user's facial features and tone of voice. It generates data indicating the user's emotional state as output.
[1387] Step 2:
[1388] The server uses an emotion engine to analyze the user's emotional state data obtained in step 1. As input, it uses facial feature points and voice tone data. The emotion engine inputs this data into an emotion recognition model (using Keras) and classifies the user's emotions into categories such as "happy" or "sad." As output, it generates a label indicating the user's emotional state.
[1389] Step 3:
[1390] The terminal acquires animal behavior data in real time through sensors installed on the device. As input, it receives data from the sensors (acceleration, location information, etc.). It preprocesses this data to extract the animal's movements and behavioral patterns. As output, it generates data indicating the animal's behavioral state.
[1391] Step 4:
[1392] The server uses generative AI to integrate and analyze the user's emotional state data acquired in step 2 and the animal's behavior data acquired in step 3. The server uses the user's emotional state data and the animal's behavior data as input. The generative AI determines appropriate reactions and stimuli for the animal based on this data. The output is to generate operational instructions for the device.
[1393] Step 5:
[1394] The terminal sends the motion instructions generated in step 4 to the device. As input, it receives motion instruction data from the generative AI. The terminal transmits these instructions to the device's motor control system and controls the device to perform the appropriate motion. As output, the physical motion of the device is executed.
[1395] Step 6:
[1396] The device automatically responds to physical stimuli from the animal and feeds that response back to the generative AI as animal behavior data. It receives physical stimulus data from the animal as input. The device detects this data with sensors and sends it to the generative AI. The output is updated animal behavior data.
[1397] Step 7:
[1398] The server re-analyzes the animal's behavior data updated in step 6 and learns changes in the animal's behavior patterns. As input, it uses the updated animal's behavior data. The generative AI accumulates this data and learns changes in the animal's behavior patterns. As output, it generates new movement instructions based on the animal's behavior patterns.
[1399] Example 3
[1400] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1401] Conventional animal devices have had difficulty providing appropriate reactions and stimuli based on the animal's behavioral patterns and the user's emotional state. Furthermore, they lacked the functionality to accumulate animal behavioral data over time and learn from these changes, making it impossible to respond appropriately to the animal's interests and preferences. Furthermore, the device's movements and responses were not adjusted to take the user's emotional state into account, resulting in a suboptimal interaction between the user and the animal.
[1402] The identification process by the identification processing unit 290 of the data processing device 12 in Example 3 is realized by the following means. In this invention, the server includes a spherical device that can move freely around, means for operating the device from an information terminal, a sensor mounted on the device that detects the animal's movements and behavior patterns, a generative AI that analyzes data from the sensor and understands the animal's preferences and play styles, means for providing appropriate reactions and stimuli to the animal based on the AI, an emotion engine for analyzing the user's emotional state, and means for adjusting the device's movements and reactions based on the analysis results of the emotion engine. This allows the server to provide appropriate reactions and stimuli in response to changes in the animal's behavior patterns, enabling optimal interaction according to the user's emotional state.
[1403] A "device" is a spherical apparatus that can move freely.
[1404] An "information terminal" is an electronic device that provides a means for operating a device.
[1405] A "sensor" is a device used to detect animal movements and behavior patterns.
[1406] "Generative AI" is artificial intelligence that analyzes data from sensors to understand animals' preferences and play styles.
[1407] An "emotion engine" is software or hardware for analyzing a user's emotional state.
[1408] A "reaction" is an appropriate response or stimulus provided to an animal.
[1409] "Animal behavior data" is information about animal movements and behavior patterns.
[1410] "User's emotional state" refers to the emotional state that the user is feeling.
[1411] The present invention provides a system for analyzing animal behavior data and a user's emotional state to provide optimal interaction. Specific embodiments of this system are described below.
[1412] System configuration
[1413] The system consists of the following main components:
[1414] 1. Device: A spherical, freely movable device equipped with sensors to detect animal movements and behavior patterns.
[1415] 2. Information terminal: An electronic device that provides a means to operate a device. Examples include smartphones and tablets.
[1416] 3. Server: This is the central component that receives and analyzes data from devices and information terminals.
[1417] 4. Generative AI: This is artificial intelligence that analyzes data from sensors and understands the animal's preferences and play styles.
[1418] 5. Emotion engine: Software or hardware for analyzing the user's emotional state.
[1419] Data collection and analysis
[1420] The server collects animal behavior data from sensors installed on the device. For example, a camera tracks a cat's movements and a sensor detects which objects the cat touches. The collected data is stored in a database.
[1421] Generative AI analyzes accumulated behavioral data and learns animal behavior patterns. For example, it learns that cats become active at 8 a.m. every morning and that they prefer certain toys. Based on this learning, it issues appropriate commands to the device.
[1422] User sentiment analysis and device adjustment
[1423] The device uses a camera and microphone to analyze the user's emotional state, for example, by analyzing the user's facial expression and tone of voice to determine whether the user is angry or happy.
[1424] The server adjusts the device's behavior and reactions based on the analysis results of the emotion engine. For example, if the user is angry, the device's behavior will be suppressed to allow the animal to remain quiet. Conversely, if the user is happy, the device's behavior will be more active, allowing the user to play with the animal.
[1425] Specific examples
[1426] For example, if a cat initially likes chasing laser pointers, but after a few weeks starts preferring to roll a ball, the generative AI will learn this change and instruct the cat to move the ball-rolling device more frequently.
[1427] When the user comes home from work and is tired, the emotion engine detects the user's fatigue and reduces the device's activity so that the cat can stay quiet. Conversely, when the user is relaxing on a day off, the emotion engine activates the device's activity so that the user can play with the cat.
[1428] Prompt Sentence Examples
[1429] "Please explain the generative AI program that accumulates data on cat behavior and learns changes in behavior patterns."
[1430] "Please explain how the emotion engine works to adjust the device's behavior and response based on the user's emotions."
[1431] In this way, the system utilizes the animal's behavior data and the user's emotion data to provide optimal interaction. The flow of the identification process in the third embodiment will be described with reference to FIG.
[1432] Step 1:
[1433] The server collects animal behavior data from sensors installed on the device. As input, it receives real-time data from the sensors and generates data on the animal's movements and behavior patterns as output. Specifically, the camera tracks the cat's movements and the sensor detects which objects the cat touches.
[1434] Step 2:
[1435] The server stores the collected behavioral data in a database. As input, it receives the animal behavioral data generated in step 1, and as output, it stores the time-stamped behavioral data in the database. Specifically, it records the data "October 1, 2023, 08:00:00 - Cat chases laser pointer."
[1436] Step 3:
[1437] The generative AI analyzes the accumulated behavioral data and learns the behavioral patterns of animals. It receives the behavioral data stored in the database as input and generates the learning results about the animal's behavioral patterns as output. Specifically, it learns the pattern of "chasing a laser pointer every morning at 8 o'clock."
[1438] Step 4:
[1439] The server issues instructions to the device based on the learning results of the generative AI. It receives the learning results of the generative AI as input and generates specific instructions for the device as output. Specifically, it issues the instruction "move the laser pointer at 8 o'clock every morning."
[1440] Step 5:
[1441] The device analyzes the user's emotional state using a camera and microphone. It receives data on the user's facial expressions and tone of voice as input and generates an analysis result on the user's emotional state as output. Specifically, if the user is smiling while speaking, it is determined that the user is happy.
[1442] Step 6:
[1443] The server adjusts the device's movements and reactions based on the analysis results of the emotion engine. It receives the user's emotion analysis results as input and generates specific instructions for the device's movements and reactions as output. Specifically, when the user is angry, the device's movements are suppressed so that the animal can stay quiet. Conversely, when the user is happy, the device's movements are made more active so that the user can play with the animal.
[1444] (Application example 3)
[1445] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1446] Conventional pet interaction systems have difficulty providing appropriate reactions and stimuli according to changes in animal behavior patterns and the user's emotional state. Furthermore, they lacked the functionality to provide real-time advice on how users should interact with animals, making it difficult to achieve optimal interactions with animals.
[1447] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means. In this invention, the server includes a spherical device that can move freely around, means for operating the device from an information terminal, a sensor installed in the device that detects the animal's movements and behavior patterns, a generative AI that analyzes data from the sensor and understands the animal's preferences and play styles, means for providing appropriate reactions and stimuli to the animal based on the AI, an emotion engine that senses the user's emotional state and adjusts the device's movements and reactions, and means for advising the user on optimal interactions with the animal. This makes it possible to provide appropriate reactions and stimuli in response to changes in the animal's behavior patterns and achieve optimal interactions according to the user's emotional state.
[1448] A "spherical device that can move freely" is a device that has a spherical shape and has the ability to physically move freely.
[1449] An "information terminal" is an electronic device that is operated by a user, such as a smartphone or tablet.
[1450] A "sensor that detects animal movements and behavior patterns" is a device that detects animal movements and behavior in real time and collects that data.
[1451] "Generative AI" is an artificial intelligence that learns animal behavior patterns based on collected data and generates appropriate reactions and stimuli.
[1452] "Means of providing appropriate reactions and stimuli" is a function that provides appropriate reactions and stimuli to animals based on the results of learning by the generative AI.
[1453] An "emotion engine" is a system that senses the user's emotional state and adjusts the device's behavior and responses accordingly.
[1454] The "means for advising optimal interactions" is a function that provides real-time instructions to users on how best to interact with and play with animals.
[1455] A system for implementing the present invention has the following configuration.
[1456] First, a spherical, mobile device is required. This device is equipped with sensors that detect the animal's movements and behavior patterns. The sensors detect the animal's movements and behavior in real time and collect that data.
[1457] Next, you need an information terminal. An information terminal is an electronic device that users can operate, such as a smartphone or tablet. You can operate the device through this information terminal.
[1458] The collected data is analyzed by generative AI, which accumulates data on the animal's behavior over time and learns changes in the animal's behavior patterns based on that data. This allows the AI to understand the animal's preferences and play styles, and provide appropriate reactions and stimulation.
[1459] Furthermore, the emotion engine senses the user's emotional state and adjusts the device's behavior and response according to the user's emotional state. For example, the emotion engine increases the device's behavior when the user is happy, and decreases the device's behavior when the user is angry.
[1460] Finally, it includes a means to advise users on optimal interactions with animals, allowing users to know in real time how to interact with animals.
[1461] For example, if the user types "happy," the system will advise, "Play with your cat more!". If the user types "angry," the system will advise, "Let's give your cat a break."
[1462] An example of a prompt is as follows:
[1463] Enter the user's emotion (happy, angry, neutral): happy
[1464] In this way, it is possible to provide appropriate reactions and stimuli in response to changes in the animal's behavioral patterns, realizing optimal interaction according to the user's emotional state.
[1465] The flow of the specific processing in Application Example 3 will be described with reference to FIG.
[1466] Step 1:
[1467] The user operates the information terminal and starts the device. As input, the user starts the information terminal application and turns on the device. As output, the device starts operating and the sensor begins to detect animal movement.
[1468] Step 2:
[1469] The sensors detect and collect data on animal movements and behavior patterns in real time. As input, the animal's movements and behavior are detected by the sensors. As output, the collected data is sent to the generative AI.
[1470] Step 3:
[1471] The generative AI analyzes the collected data and learns the animal's behavior patterns. The input is the animal's behavior data transmitted from sensors. The output is the generation of appropriate reactions and stimulus instructions based on changes in the animal's behavior patterns.
[1472] Step 4:
[1473] The emotion engine senses the user's emotional state. As input, the user enters their emotional state into the information terminal. As output, the emotion engine analyzes the user's emotional state and sends the results to the generative AI.
[1474] Step 5:
[1475] The generative AI adjusts the device's behavior and response based on the user's emotional state. The input is the user's emotional state data sent from the emotion engine. The output is the device's behavior and response adjusted according to the user's emotional state.
[1476] Step 6:
[1477] The system provides users with advice on optimal interactions with animals. The inputs are instructions from the generative AI and data on the user's emotional state. The output is advice on optimal interactions with animals displayed on the information terminal screen.
[1478] Step 7:
[1479] The user interacts with the animal according to the advice. The input is the advice displayed on the information terminal. The output is that the user's appropriate interaction with the animal changes the animal's behavioral patterns, and the sensor again collects that data.
[1480] This series of processing steps makes it possible to provide appropriate reactions and stimuli in response to changes in the animal's behavioral patterns, thereby achieving optimal interaction according to the user's emotional state.
[1481] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1482] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1483] Another example of generative AI is Gemini (internet search engine). <url: https: gemini.google.com ?hl="ja">) are mentioned.
[1484] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.
[1485] [Third embodiment]
[1486] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.
[1487] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.
[1488] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1489] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.
[1490] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1491] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1492] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1493] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1494] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1495] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1496] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1497] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.
[1498] "Example 1"
[1499] In one embodiment of the present invention, a spherical device is provided. This device has an internal driving source such as a motor or battery, allowing it to move freely around. A sensor for detecting the cat's movements and behavioral patterns is located on the outside of the device. This sensor detects the cat's movements and behavioral patterns and transmits the data to a generative AI. The generative AI analyzes the received data and understands the cat's preferences and play styles. Based on this understanding, it then transmits instructions to the device to provide the cat with appropriate reactions and stimuli. The device operates in accordance with the instructions and provides the cat with appropriate reactions and stimuli.
[1500] "Example 2"
[1501] As a specific example, if a cat exhibits aggressive behavior toward the device, a sensor detects the behavior and sends that information to the generative AI. The generative AI analyzes the information and understands that cats prefer aggressive play. Based on that understanding, it instructs the device to perform actions that stimulate the cat. The device then acts according to the instructions and provides the cat with appropriate stimulation.
[1502] "Example 3"
[1503] The generative AI also accumulates data on the cat's behavior over time and learns changes in the cat's behavioral patterns based on that data. For example, if a cat initially prefers aggressive play but develops a preference for gentler play over time, the generative AI will learn this change and issue appropriate instructions to the device based on that learning. This makes it possible to provide appropriate reactions and stimuli in response to changes in the cat's behavioral patterns.
[1504] The processing flow of each embodiment will be described below.
[1505] "Example 1"
[1506] Step 1: The spherical device starts working, and sensors begin to detect the cat's movements and behavior patterns.
[1507] Step 2: The sensors detect the cat's movements and behavioral patterns and send that data to the generative AI.
[1508] Step 3: The generative AI analyzes the received data to understand the cat's preferences and play habits.
[1509] Step 4: Based on that understanding, the generative AI sends instructions to the device to provide the appropriate reaction or stimulation to the cat.
[1510] Step 5: The device will then act on the instructions and provide the appropriate reaction or stimulus to your cat.
[1511] "Example 2"
[1512] Step 1: Your cat exhibits aggressive behavior towards the device.
[1513] Step 2: The sensor detects the behavior and sends that information to the generative AI.
[1514] Step 3: The generative AI analyzes the information and understands that cats prefer aggressive play.
[1515] Step 4: Based on that understanding, the generative AI instructs the device to perform actions that stimulate the cat.
[1516] Step 5: The device will follow the instructions and provide the appropriate stimulation to your cat.
[1517] "Example 3"
[1518] Step 1: The generative AI accumulates cat behavior data over time.
[1519] Step 2: The generative AI learns changes in the cat's behavioral patterns based on the accumulated data.
[1520] Step 3: The generative AI uses its learning to issue appropriate instructions to the device.
[1521] Step 4: The device follows the instructions and provides appropriate reactions and stimuli in response to changes in the cat's behavioral patterns.
[1522] Example 1
[1523] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1524] Conventional animal play equipment has the problem that it is difficult to provide appropriate reactions and stimulation to keep animals interested, and animals quickly become bored. In addition, there is a lack of a system that can analyze animals' behavior patterns in real time and control their movements based on that, making it difficult to provide play styles that suit individual animals' preferences.
[1525] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1526] In this invention, the server includes a spherical device that can move around freely, a means for operating the device from an information terminal, a sensor installed in the device that detects the animal's movements and behavior patterns, a generative artificial intelligence that analyzes data from the sensor and understands the animal's preferences and ways of playing, a means for providing the animal with appropriate reactions and stimuli based on the artificial intelligence, a means for generating instructions for controlling the operation of the device and sending the instructions to the device, and a means for the device to operate in accordance with the instructions and provide the animal with appropriate reactions and stimuli. This makes it possible to analyze the behavior patterns of animals in real time and provide appropriate reactions and stimuli according to the preferences of each individual animal.
[1527] The "device" is a spherical, freely movable device equipped with sensors that detect the movements and behavioral patterns of animals.
[1528] An "information terminal" is an electronic device that provides a means for operating a device, and includes smartphones, tablets, and the like.
[1529] A "sensor" is a device that detects animal movements and behavior patterns and is installed in a device.
[1530] "Generative AI" is an AI system that analyzes data from sensors to understand animals' preferences and play styles.
[1531] "Means for providing reactions or stimuli" refers to mechanisms or methods for providing appropriate reactions or stimuli to animals based on generative artificial intelligence.
[1532] "Means for generating instructions" refers to a mechanism or method for generating instructions to control the operation of a device based on data analyzed by the generative artificial intelligence.
[1533] The "means for sending instructions" refers to a communication means for sending the generated instructions to the device.
[1534] "Means for controlling behavior" refers to the mechanism or method by which the device operates according to the instructions it receives and provides the animal with an appropriate reaction or stimulus.
[1535] This invention is a system that analyzes the behavioral patterns of animals in real time and provides appropriate reactions and stimuli according to the preferences of each individual animal. Specific embodiments of this system will be described below.
[1536] System configuration
[1537] The system consists of the following main components:
[1538] 1. Device: A spherical, freely movable device equipped with sensors that detect animal movements and behavior patterns.
[1539] 2. Information terminal: An electronic device that provides a means to operate a device, including smartphones and tablets.
[1540] 3. Sensor: A device that detects animal movements and behavior patterns and is installed in the device.
[1541] 4. Generative AI: An artificial intelligence system that analyzes data from sensors to understand the animal's preferences and play styles.
[1542] 5. Means of providing reactions and stimuli: Mechanisms and methods for providing appropriate reactions and stimuli to animals based on generative artificial intelligence.
[1543] 6. Means for generating instructions: A mechanism or method for generating instructions to control the operation of a device based on data analyzed by generative artificial intelligence.
[1544] 7. Means for sending instructions: A communication means for sending the generated instructions to the device.
[1545] 8. Means of controlling behavior: The mechanism or method by which the device operates according to the instructions it receives and provides the appropriate reaction or stimulus to the animal.
[1546] System Operation
[1547] 1. Initialize the device
[1548] The user turns on the device.
[1549] The device checks the internal motor and battery to ensure they are in working order.
[1550] The device calibrates the sensors to ensure accurate data collection.
[1551] 2. Data collection
[1552] The device uses sensors on the device to detect animal movements and behavior patterns in real time.
[1553] The device temporarily stores the detected data.
[1554] 3. Data transmission
[1555] The terminal transmits the collected data to the server.
[1556] The server receives the data and prepares it for analysis.
[1557] 4. Data Analysis
[1558] The server passes the received data to the generative artificial intelligence.
[1559] Generative AI analyzes the data to understand the animal's preferences and behavioral patterns.
[1560] 5. Instruction Generation
[1561] Based on the analysis results, generative artificial intelligence generates instructions to provide the animal with appropriate reactions and stimuli.
[1562] The server receives the generated instructions.
[1563] 6. Sending instructions
[1564] The server sends the generated instructions to the terminal.
[1565] The terminal receives the instruction and transmits it to the device.
[1566] 7. Device Operation
[1567] The terminal operates the device according to the instructions received.
[1568] The device provides the animal with the appropriate reaction or stimulus.
[1569] Specific examples
[1570] For example, if a cat approaches the device, the device's sensor detects its movement. The server determines that the cat is interested in the device and sends the data to the generative AI. The generative AI generates an instruction to "move the device slightly to attract the cat." The server sends the instruction to the device, which then moves the device.
[1571] Prompt Sentence Examples
[1572] "Generate an appropriate reaction when a cat approaches the device."
[1573] "If your cat likes to chase the device, tell them what movements to direct it to."
[1574] In this way, the system can analyze the animal's behavior in real time and provide appropriate reactions to keep the animal engaged.
[1575] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1576] Step 1: Initialize your device
[1577] Input: A user turns on the device.
[1578] Processing: The device checks the internal motors and batteries to ensure they are working properly, and calibrates the sensors to ensure accurate data collection.
[1579] Output: The device is ready to operate normally.
[1580] Specific operation: The user presses the power button on the device, and the terminal checks the device's LED indicator to confirm normal operation.
[1581] Step 2: Collect data
[1582] Input: The device detects animal movements and behavior patterns.
[1583] Processing: The device uses the device's sensors to detect animal movements and behavior patterns in real time and temporarily store the data.
[1584] Output: Data is collected on animal movements and behavior patterns.
[1585] Specific operation: The device uses sensors to detect the cat's movement as it approaches the device and stores the data in memory.
[1586] Step 3: Sending data
[1587] Input: Collected animal movement and behavior pattern data.
[1588] Processing: The device sends the collected data to the server, which receives the data and prepares it for analysis.
[1589] Output: Data is sent to the server and ready for analysis.
[1590] Specific operation: The device sends data to the server via Wi-Fi, and the server receives the data and stores it in a database.
[1591] Step 4: Analyze the data
[1592] Input: Data on animal movements and behavior patterns received by the server.
[1593] Processing: The server passes the received data to the generative AI, which analyzes the data to understand the animal's preferences and behavioral patterns.
[1594] Output: Analysis results on the animal's preferences and behavior patterns.
[1595] Specific operation: The server inputs data into the generative AI, which then concludes that "cats like to chase balls."
[1596] Step 5: Generate instructions
[1597] Input: Analysis results by generative artificial intelligence.
[1598] Processing: Based on the analysis results, the generative AI generates instructions to provide appropriate reactions and stimuli to the animals. The server receives the generated instructions.
[1599] Output: Instructions for providing the appropriate reaction or stimulus to the animal.
[1600] Specific operation: The generative artificial intelligence generates the instruction "rotate the device to the right," and the server receives that instruction.
[1601] Step 6: Sending instructions
[1602] Input: Generated instructions.
[1603] Processing: The server sends the generated instruction to the terminal, and the terminal receives the instruction and transmits it to the device.
[1604] Output: The instructions sent to the device.
[1605] Specific operation: The server sends instructions to the terminal via Wi-Fi, and the terminal receives the instructions and passes them on to the device.
[1606] Step 7: Device Operation
[1607] Input: Instructions received by the terminal.
[1608] Processing: The terminal operates the device according to the instructions received and provides the animal with the appropriate reaction or stimulus.
[1609] Output: The appropriate reaction or stimulus provided to the animal.
[1610] Specific behavior: The terminal controls the motor of the device and rotates it to the right. The device rotates in front of the cat, and the cat chases it.
[1611] (Application example 1)
[1612] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1613] Conventional pet devices have difficulty fully understanding the movements and behavior patterns of animals and providing appropriate reactions and stimuli. Furthermore, there are insufficient means to provide a fun environment for animals in physical stores. This has resulted in insufficient reduction of stress for animals and improvement of customer satisfaction.
[1614] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1615] In this invention, the server includes a spherical device that can move around freely, a means for operating the device from a smartphone, a sensor installed in the device that detects the animal's movements and behavior patterns, a generative AI that analyzes data from the sensor and understands the animal's preferences and ways of playing, a means for providing the animal with appropriate reactions and stimuli based on the AI, and a means for the device to detect the animal's movements within the physical store and provide appropriate reactions and play using the generative AI, allowing the animal to have fun within the physical store and improving customer satisfaction.
[1616] A "spherical device that can move freely" is a spherical device that has a power source such as a motor or battery inside and can move in any direction.
[1617] "Means for operating from a smartphone" refers to an interface or application for remotely controlling the operation of a device using a smartphone.
[1618] A "sensor that detects animal movements and behavioral patterns" is a device that detects the position, speed, direction, and other movements of animals and collects that data.
[1619] "Generative AI" is an artificial intelligence model that analyzes collected animal movement and behavior data to understand animals' preferences and play styles.
[1620] "Means for providing appropriate reactions and stimuli to animals" refers to a mechanism that allows animals to take appropriate actions and react based on instructions generated by the generative AI.
[1621] "Means of detecting animal movements within a physical store and using generative AI to provide appropriate reactions and play" refers to a system that detects animal movements within a physical store in real time, sends that data to generative AI, and provides appropriate reactions and play for the animals.
[1622] This invention is a system for providing an environment in a physical store where animals, especially cats, can have fun. The system includes a spherical, freely moving device, a means for controlling it from a smartphone, sensors that detect the animal's movements and behavior patterns, generative AI, and a means for providing appropriate reactions and stimuli to the animal.
[1623] System configuration
[1624] 1. Spherical device:
[1625] It is equipped with a motor and battery inside, allowing it to move in any direction.
[1626] There are sensors on the outside to detect animal movement.
[1627] 2. Methods for operating from a smartphone:
[1628] An application is provided for remotely controlling the operation of a device using a smartphone.
[1629] 3. Sensors that detect animal movements and behavior patterns:
[1630] It senses and collects data on the animal's location, speed, direction, and other movements.
[1631] 4. Generative AI:
[1632] The collected data on animal movements and behavior is analyzed to understand the animals' preferences and play styles.
[1633] Using a generative AI model, appropriate reactions and stimuli are generated for animals.
[1634] 5. Means of providing appropriate reactions and stimuli to animals:
[1635] Based on the instructions generated by the generative AI, the robot will perform appropriate actions and reactions towards the animal.
[1636] Program processing explanation
[1637] The server sends animal movement data collected from sensors to the generative AI. The generative AI analyzes this data to understand the animal's preferences and play styles. Based on this understanding, it generates instructions to provide the animal with appropriate reactions and stimuli. These instructions are then sent to the device, which then performs the appropriate action on the animal.
[1638] The hardware used includes sensors to detect animal movement, motors to power the device, and a battery to power the device, while the software used includes a generative AI model, a sensor control module, and a motor control module.
[1639] Specific examples
[1640] For example, when a cat approaches a device in a pet shop, a sensor detects its movement and sends the data to a generative AI. The generative AI then generates a movement that will interest the cat and sends that instruction to the device. The device then begins to move as if the cat is chasing it, attracting the cat's attention.
[1641] When a cat touches the device in a cafe, the sensor detects the movement and sends the data to the generative AI. The generative AI generates a rotating motion that the cat will enjoy and sends that instruction to the device. The device rotates in a way that the cat enjoys, attracting the cat's interest.
[1642] Prompt Sentence Examples
[1643] "Enter your cat's movement data, including its position, speed, and direction. Use this data to generate reactions that will interest your cat."
[1644] The above is an embodiment of the present invention. This system allows animals to have fun in a physical store, improving customer satisfaction.
[1645] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1646] Step 1:
[1647] The sensor detects the animal's movement. The sensor collects data such as the animal's position, speed, and direction, and sends the data to the server. The input is the animal's movement data, and the output is the movement data sent to the server.
[1648] Step 2:
[1649] The server receives animal movement data from the sensors and sends it to the generative AI. The generative AI analyzes this data to understand the animal's preferences and play styles. The input is movement data from the sensors, and the output is the analysis results by the generative AI.
[1650] Step 3:
[1651] The generative AI generates appropriate reactions and stimuli for the animal based on the analysis results. The generative AI generates actions and responses that will interest the animal and sends these instructions to the server. The input is the analysis result of the animal's movement data, and the output is the generated reaction or stimulus instructions.
[1652] Step 4:
[1653] The server sends instructions received from the generative AI to the device. The device begins to operate based on the received instructions. The input is the instruction from the generative AI, and the output is the device's operation.
[1654] Step 5:
[1655] The device provides appropriate reactions and stimuli to the animal. The device operates according to the animal's movements and performs actions that the animal enjoys. The input is instructions from the server, and the output is reactions and stimuli to the animal.
[1656] Step 6:
[1657] The device detects physical stimuli from the animal and feeds that data back to the server. The server then sends this data to the generative AI and stores it as animal behavior data. The input is the physical stimulus data from the animal, and the output is feedback data to the generative AI.
[1658] The above are the specific processing steps of this system. The specific actions performed at each step allow animals to have fun in the physical store.
[1659] Example 2
[1660] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1661] Previous cat devices simply detected cat behavior and were unable to provide appropriate stimuli based on the cat's individual behavioral patterns and preferences. Furthermore, they lacked the ability to accumulate cat behavior data and learn over time, making it difficult to respond to changes in cat behavior patterns. Furthermore, they lacked the ability to automatically respond to physical stimuli from the cat and provide feedback on that response. This made it difficult to maintain a cat's interest, preventing effective play and training.
[1662] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[1663] In this invention, the server includes a sensor means for detecting cat behavior, a terminal means for transmitting data from the sensor means to the server, a means for analyzing the data using a generative AI model in the server means, a device means for providing stimuli to the cat based on instructions from the server means, and a terminal means for controlling the device means. This enables real-time analysis of cat behavior data and provision of appropriate stimuli based on the individual cat's behavioral patterns and preferences. Furthermore, by accumulating cat behavior data over time and learning changes in behavioral patterns based on that data, the server can sustain the cat's interest. Furthermore, the server's ability to automatically respond to physical stimuli from the cat and provide feedback on that response allows for effective play and training.
[1664] "Sensor means" refers to a device for detecting the cat's behavior, and includes a motion sensor, a camera, etc.
[1665] The "terminal means" is a device for transmitting data from the sensor means to the server, and includes a data transmission module and a communication device.
[1666] The "server means" is a device that analyzes the received data using a generative AI model and generates instructions to provide appropriate stimulation to the cat.
[1667] A "generative AI model" is an artificial intelligence model that analyzes cat behavior data and generates instructions to provide appropriate stimuli based on the cat's behavioral patterns and preferences.
[1668] The "device means" refers to a device for providing stimulation to the cat based on instructions from the server means, and includes a robot arm, a laser pointer, etc.
[1669] "Real-time" means that data is processed immediately the moment it is generated, meaning immediate response without delay.
[1670] A "behavioral pattern" refers to a series of behavioral tendencies or habits that a cat exhibits in response to specific situations or stimuli.
[1671] "Feedback" refers to the device means' responses to physical stimuli from the cat being fed back to the generative AI model, allowing the generative AI model to learn and generate more appropriate instructions.
[1672] This invention is a system that detects cat behavior, analyzes the data, and provides appropriate stimuli to the cat. The system includes a sensor means, a terminal means, a server means, a generative AI model, and a device means.
[1673] First, the device detects the cat's behavior using sensors such as motion sensors and cameras. For example, if the cat scratches the device, the device will detect that behavior in real time.
[1674] The device then transmits the detected behavioral data to the server via a data transmission module, including the cat's movement patterns and location information, such as the time and location when the cat scratched the device.
[1675] The server inputs the received data into a generative AI model to analyze the cat's behavior. Examples of generative AI models used include OpenAI's GPT-4. The generative AI model determines whether the cat prefers aggressive play. For example, if the cat frequently exhibits aggressive behavior toward the device, the model learns that behavioral pattern.
[1676] The server then uses the analysis to instruct the device on the appropriate actions to stimulate the cat, such as moving a robotic arm to attract the cat's attention.
[1677] Finally, the terminal receives instructions from the server and controls the device to provide appropriate stimuli to the cat, such as moving a laser pointer to stimulate the cat.
[1678] As a concrete example, consider the following scenario: When a cat scratches the device with its claws, the motion sensor detects this movement. The sensor sends this information to the server via the data transmission module. The generative AI model analyzes the data and understands that cats prefer aggressive play. The generative AI model then instructs the robotic arm to perform actions that will attract the cat's attention. The robotic arm then follows these instructions and provides the cat with appropriate stimuli.
[1679] Examples of prompts to input to a generative AI model include:
[1680] "Your cat claws at the device. Analyze this behavior and determine if your cat likes aggressive play. Then instruct the device on the appropriate behavior to stimulate your cat."
[1681] The above is an embodiment of the present invention.
[1682] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1683] Step 1:
[1684] The device uses sensors to detect the cat's behavior. Specifically, motion sensors and cameras monitor the cat's movements in real time and detect aggressive behavior. For example, if the cat digs its claws into the device, this behavior will be detected.
[1685] Input: Cat movement
[1686] Output: Detected cat behavior data (e.g., time and location of cat claw movements)
[1687] Step 2:
[1688] The device transmits the detected behavioral data to the server via the data transmission module. Specifically, the data acquired from the sensor is packetized and sent to the server via the network.
[1689] Input: Detected cat behavior data
[1690] Output: Behavioral data sent to the server
[1691] Step 3:
[1692] The server inputs the received data into a generative AI model (e.g., GPT-4) to analyze the cat's behavior. Specifically, it inputs the behavioral data into a generative AI model (e.g., GPT-4) to determine whether the cat prefers aggressive play.
[1693] Input: Behavioral data sent to the server
[1694] Output: Analysis of cat behavior patterns (e.g., cats prefer aggressive play)
[1695] Step 4:
[1696] Based on the analysis results, the server instructs the device to perform appropriate actions to stimulate the cat. Specifically, it generates movement instructions for the robot arm and laser pointer based on the analysis results of the generative AI model.
[1697] Input: Analysis of cat behavior patterns
[1698] Output: Instructions for the device (e.g., moving the robot arm to attract the cat's attention)
[1699] Step 5:
[1700] The terminal receives instructions from the server and controls the device to provide appropriate stimuli to the cat, such as moving a robotic arm or laser pointer to entertain the cat.
[1701] Input: Operation instructions from the server
[1702] Output: The appropriate stimulus provided to the cat (e.g., robotic arm movement, laser pointer movement)
[1703] The above is the specific flow of the program processing of this system.
[1704] (Application example 2)
[1705] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1706] Conventional safety monitoring systems in factories have the problem of being unable to detect abnormal behavior of workers or machines in real time and take appropriate action quickly. In addition, there are only a limited number of systems that can understand animal behavior and provide appropriate stimuli, and they also have the problem of being unable to learn changes in animal behavior patterns. To solve these problems, a system is needed that can monitor the behavior of animals and workers in real time, detect abnormal behavior, and take appropriate action.
[1707] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[1708] In this invention, the server includes a spherical device that can move around freely, a means for operating the device from an information terminal, a sensor installed in the device that detects the movements and behavior patterns of the animal, a generative AI that analyzes data from the sensor and understands the animal's preferences and ways of playing, a means for providing the animal with appropriate reactions and stimuli based on the AI, a sensor that detects abnormal behavior of workers and machines in the factory, a means for transmitting data from the sensor to the generative AI and analyzing the abnormal behavior, and a means for instructing the animal on appropriate responses based on the analysis results. This makes it possible to learn changes in the animal's behavior patterns and provide appropriate stimuli, as well as to detect abnormal behavior of workers and machines in the factory in real time and respond quickly.
[1709] A "spherical device that can move freely" is a device that has a spherical shape and has the ability to physically move freely.
[1710] An "information terminal" is an electronic device used to remotely control devices such as smartphones and tablets.
[1711] A "sensor that detects animal movements and behavior patterns" is a device that detects animal movements and behavior in real time and acquires that data.
[1712] "Generative AI" is an artificial intelligence system that analyzes acquired data, understands the behavioral patterns of animals and workers, and generates appropriate responses.
[1713] "Means for providing appropriate reactions and stimuli to animals" refers to devices and methods for providing appropriate reactions and stimuli to animals based on the analysis results of generative AI.
[1714] A "sensor that detects abnormal behavior of workers and machines in a factory" is a device that monitors the behavior of workers and machines in a factory and detects abnormal behavior in real time.
[1715] "Means for analyzing abnormal behavior" refers to a method or device for transmitting data on detected abnormal behavior to the generative AI and analyzing that data.
[1716] "Means for instructing appropriate responses" refers to methods or devices for instructing appropriate responses to abnormal behavior based on the analysis results of generative AI.
[1717] As an embodiment of the present invention, the following system is constructed.
[1718] First, a spherical, freely movable device is prepared. This device is equipped with sensors that detect animal movements and behavioral patterns. The device can be controlled from an information terminal (e.g., a smartphone or tablet).
[1719] Next, we prepare a generative AI. This generative AI analyzes the data from the sensors to understand the animal's preferences and play styles. The generative AI generates instructions to provide the animal with appropriate reactions and stimuli.
[1720] Additionally, sensors will be installed in the factory to detect abnormal behavior by workers or machines. These sensors will also send data to the generative AI, which will analyze the abnormal behavior and provide instructions on how to respond appropriately to the abnormal behavior.
[1721] As a specific example, the following system can be considered.
[1722] 1. Animal behavior monitoring system
[1723] If an animal exhibits aggressive behavior toward the device, the sensor detects the behavior and sends the information to the generative AI. The generative AI analyzes the information and understands that the animal prefers aggressive play. Based on this understanding, it instructs the device to perform actions that stimulate the animal. The device then acts according to the instructions and provides the appropriate stimulation to the animal.
[1724] 2. Factory safety monitoring system
[1725] When a worker or machine behaves abnormally in a factory, sensors detect the behavior and send the data to the generative AI. The generative AI analyzes the data and detects abnormal behavior. If an abnormality is detected, the generative AI instructs the appropriate response, such as sounding an alarm or halting work.
[1726] The hardware used includes sensors to detect animal movement, sensors to detect abnormal behavior in factories, information terminals, and spherical devices, while the software uses generative AI models.
[1727] As a concrete example, the following prompt sentence could be input into a generative AI model:
[1728] Example prompt sentence:
[1729] "Analyze the data when a worker falls, and if it is determined to be abnormal, issue an instruction to sound an alarm."
[1730] In this way, it is possible to learn changes in animal behavior patterns and provide appropriate stimuli, as well as detect abnormal behavior of workers or machinery in the factory in real time and respond quickly.
[1731] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1732] Step 1:
[1733] Sensors detect the movement of animals and workers.
[1734] Input: Animal and worker movement data
[1735] Data processing: Sensors acquire operational data in real time and convert it into digital signals.
[1736] Output: Digitized motion data
[1737] Step 2:
[1738] The data obtained from the sensors is sent to the generative AI.
[1739] Input: Digitized motion data
[1740] Data processing: The data acquired by the sensors is packetized for transmission to the generative AI.
[1741] Output: Packetized motion data
[1742] Step 3:
[1743] Generative AI analyzes motion data.
[1744] Input: Packetized motion data
[1745] Data computation: Generative AI analyzes movement data to identify abnormal movements and animal behavior patterns.
[1746] Output: Analysis results (detection of abnormal behavior and animal behavior patterns)
[1747] Step 4:
[1748] Generative AI will then suggest appropriate responses based on the analysis results.
[1749] Input: Analysis results
[1750] Data calculation: Generative AI determines the appropriate response (e.g., sound an alarm, activate a device, etc.) based on the analysis results.
[1751] Output: Action instructions
[1752] Step 5:
[1753] Devices and information terminals operate according to the instructions of generative AI.
[1754] Input: Action instructions
[1755] Specific action: The device provides an appropriate stimulus to the animal, the information terminal sounds an alarm, etc.
[1756] Output: Action taken (stimulate animal, sound alarm, etc.)
[1757] Step 6:
[1758] The generative AI receives feedback from the results of the actions it performs.
[1759] Input: The result of the action taken
[1760] Data processing: Generative AI evaluates the results of the execution and accumulates the data to reflect in the next response.
[1761] Output: Updated behavior database
[1762] Through these steps, it will be possible to learn changes in animal behavior patterns and provide appropriate stimuli, as well as to detect abnormal behavior of workers or machinery in the factory in real time and respond quickly.
[1763] Example 3
[1764] Next, a third embodiment of the third embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1765] Conventional animal devices have difficulty learning an animal's behavioral patterns in real time and providing appropriate reactions and stimuli based on that. Furthermore, there were no systems that could accumulate animal behavioral data over a long period of time and learn from those changes. This made it difficult to provide appropriate reactions and stimuli in response to changes in an animal's behavioral patterns.
[1766] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.
[1767] In this invention, the server includes means for storing data from sensors that detect animal movements and behavioral patterns in a database, means for cleansing the stored data and extracting behavioral patterns, means for the generative artificial intelligence to learn changes in behavioral patterns, and means for generating appropriate instructions based on the learning results, which makes it possible to provide appropriate reactions and stimuli in response to changes in the animal's behavioral patterns.
[1768] The "device" is a spherical device that can move freely and detects the movements and behavioral patterns of animals.
[1769] A "personal digital assistant" is a portable electronic device, such as a smartphone or tablet, that is used to operate the device.
[1770] A "sensor" is a sensing device installed on a device to detect animal movements and behavior patterns.
[1771] "Generative AI" is an AI that analyzes data from sensors, understands animals' preferences and play styles, and provides appropriate reactions and stimulation.
[1772] The "database" is an information management system for storing animal behavior data collected from sensors.
[1773] "Cleansing" is a process of removing noise from raw data stored in a database and filling in missing data.
[1774] A "behavioral pattern" is a series of behaviors that an animal tends to exhibit at a particular time or in a particular situation.
[1775] "Learning" is the process by which generative artificial intelligence understands changes in animal behavior patterns based on accumulated data.
[1776] "Instructions" are specific operational commands that generative AI issues to a device based on its learning results.
[1777] A "reaction" is a specific action or stimulus that the device performs on the animal in accordance with instructions from the generative artificial intelligence.
[1778] This invention is a system that learns the behavioral patterns of animals in real time and provides appropriate reactions and stimuli based on the learned patterns. Specific embodiments of this system are described below.
[1779] Hardware and software used
[1780] Hardware: Sensors (cameras, microphones, etc.) that detect animal movements and behavior patterns, a spherical device that can move freely, and mobile information terminals (smartphones and tablets).
[1781] Software: Generative AI (e.g., OpenAI's GPT-4), databases (MySQL or MongoDB)
[1782] System configuration
[1783] 1. Device:
[1784] It is equipped with sensors to detect animal movements and behavior patterns.
[1785] Data from sensors is collected in real time and sent to a server.
[1786] 2. Mobile Information Devices:
[1787] Used as a means to operate the device.
[1788] The user can control the operation of the device through the personal digital assistant.
[1789] 3. Server:
[1790] Receives data sent from sensors and stores it in a database.
[1791] The accumulated data is cleansed and behavioral patterns are extracted.
[1792] Use generative artificial intelligence to learn changing behavioral patterns.
[1793] Based on the learning results, appropriate instructions are generated for the device.
[1794] Specific examples
[1795] For example, suppose a cat initially prefers aggressive play, but over time develops a preference for gentle play.
[1796] 1. Data Collection:
[1797] The device (camera) captures the cat poking at the moving toy.
[1798] The server receives the video data and stores it in a database.
[1799] 2. Data preprocessing:
[1800] The server removes unnecessary parts from the video data and extracts only the cat's movements.
[1801] The server organizes the extracted data by time and analyzes the cat's behavioral patterns.
[1802] 3. Learning behavioral patterns:
[1803] The server uses generative artificial intelligence to learn when the cat has changed from aggressive to calm play.
[1804] The server saves the learning results and proceeds to the next step.
[1805] 4. Generating appropriate instructions:
[1806] The server inputs a prompt to the generative artificial intelligence: "Since the cat has started to prefer gentle play, please generate instructions to move a toy with gentle movements."
[1807] The server sends the generated instructions to the device.
[1808] 5. Provide a reaction:
[1809] The device (toy) makes gentle movements according to instructions received from the server.
[1810] The device provides gentle play for cats and responds to their behavioral patterns.
[1811] Prompt Sentence Examples
[1812] By inputting the following prompt sentence into the generative AI, instructions based on changes in the cat's behavioral patterns can be generated.
[1813] Below is the cat's behavioral data. Initially, the cat preferred aggressive play, but over time, it began to prefer gentle play. Based on this change, generate instructions to provide the cat with appropriate reactions and stimuli.
[1814] In this way, the system can provide appropriate reactions and stimuli in response to changes in the animal's behavioral patterns. The flow of the identification process in the third embodiment will be described with reference to FIG.
[1815] Step 1: Data collection
[1816] The devices (sensors) monitor the movements of animals in real time and collect behavioral data. For example, a camera captures the movements of a cat and a microphone records the cat's meows.
[1817] Input: Real-time animal movements and sounds
[1818] Output: Animal behavior data (video data, audio data)
[1819] How it works: The camera captures the cat's movements and the microphone records the cat's meows. The device collects this data and sends it to a server.
[1820] Step 2: Preprocessing the data
[1821] The server cleanses the raw data stored in the database, specifically removing noise and filling in missing data.
[1822] Input: Raw data (video data, audio data)
[1823] Output: Cleansed data
[1824] Specific operation: The server removes unnecessary parts from the video data, filters noise from the audio data, and fills in any missing data.
[1825] Step 3: Extracting behavioral patterns
[1826] The server organizes the cleansed data by time and extracts behavioral patterns.
[1827] Input: Cleansed data
[1828] Output: Behavioral pattern data
[1829] Specific behavior: The server analyzes the cleansed data and extracts the behavior of animals at specific times of the day.
[1830] Step 4: Learning behavioral patterns
[1831] The server uses a generative AI model to learn animal behavior patterns based on the accumulated data.
[1832] Input: Behavioral pattern data
[1833] Output: Learning results (changes in behavioral patterns)
[1834] How it works: The server inputs behavioral pattern data into the generative AI model, which then learns changes in the animal's behavior, for example, when a cat changes from aggressive play to calm play.
[1835] Step 5: Generate appropriate instructions
[1836] The server generates appropriate instructions for the device based on the learning results.
[1837] Input: Training results
[1838] Output: Instruction data
[1839] Specific behavior: The server inputs a prompt to the generative AI model, saying, "Since the cat has started to prefer gentle play, please generate instructions to move a toy with gentle movements," and sends the generated instructions to the device.
[1840] Step 6: Provide a reaction
[1841] The terminal (device) operates according to the instructions received from the server.
[1842] Input: Instruction data
[1843] Output: Reaction to animals
[1844] Specific behavior: The device activates a toy with gentle movements, providing gentle play for the cat.
[1845] (Application example 3)
[1846] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1847] Conventional animal devices and generative AI are limited to learning animal behavior patterns and providing appropriate reactions. However, there were no systems that could learn the behavior patterns of workers in factories and provide appropriate support. This meant that improvements in work efficiency and reductions in worker burden were not fully achieved. Therefore, there is a need for a system that can learn the behavior patterns of workers in factories and provide appropriate support.
[1848] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.
[1849] In this invention, the server includes a spherical device that can move around freely, a means for operating the device from a smartphone, a sensor installed in the device that detects the movements and behavioral patterns of the animal, a generative AI that analyzes data from the sensor and understands the preferences and behavioral patterns of the animal, a means for providing appropriate reactions and stimuli to the animal based on the AI, and a means for accumulating behavioral data of workers over time, learning changes in behavioral patterns based on the accumulated data, and providing appropriate support. This makes it possible to learn the behavioral patterns of workers in the factory and provide appropriate support.
[1850] A "spherical device that can move freely" is a device that has a spherical shape and has the ability to physically move freely.
[1851] "Means for operating from a smartphone" refers to the interface or software for remotely operating the device using a smartphone.
[1852] A "sensor that detects animal movements and behavior patterns" is a device that detects animal movements and behavior in real time and collects that data.
[1853] "Generative AI" is an artificial intelligence technology that learns the behavioral patterns of animals and workers based on collected data and provides appropriate reactions and support.
[1854] "Means for providing appropriate reactions and stimuli" refers to devices and functions that provide appropriate reactions and stimuli to animals and workers based on the results of learning by the generative AI.
[1855] The "means for accumulating worker behavior data over time" is a system for continuously recording worker behavior and storing that data for a long period of time.
[1856] "Means of learning changes in behavioral patterns and providing appropriate support" refers to a function that analyzes accumulated behavioral data, recognizes changes in behavioral patterns, and provides optimal support to workers.
[1857] To implement this invention, the following hardware and software are required. The hardware includes a spherical, freely movable device, a smartphone, a factory robot, and sensors. The software includes Python, scikit-learn, and a generative AI model.
[1858] The spherical, mobile device is equipped with sensors that detect the movements and behavioral patterns of animals and workers in real time. The sensors detect and collect data on the movements and behavioral patterns of animals and workers. The collected data is then sent to a generative AI model for analysis.
[1859] The generative AI model learns the behavioral patterns of animals and workers based on collected data. This learning process uses Python and scikit-learn. Specifically, it uses the KMeans clustering algorithm to classify behavioral patterns and learns how behavioral patterns change over time.
[1860] Once trained, the generative AI model will provide instructions for appropriate reactions and stimuli to animals and workers. For example, if an animal prefers aggressive play, the device will provide appropriate stimuli. Also, if a worker transitions from manual to automated tasks, the robot will provide appropriate support.
[1861] For example, if a worker is manually assembling parts in a factory, a robot can assist with carrying the parts, or if a worker is operating automated machinery, a robot can assist with machine maintenance.
[1862] An example of a prompt is as follows:
[1863] "Develop AI that collects data on worker behavior in factories and learns changes in behavioral patterns based on that data. For example, if a worker transitions from manual to automated tasks, create a robot that learns the change and provides appropriate support."
[1864] In this way, the present invention can improve work efficiency in a factory and reduce the burden on workers.
[1865] The flow of the specific processing in Application Example 3 will be described with reference to FIG.
[1866] Step 1:
[1867] The server uses sensors to collect behavioral data of animals and workers. The input is real-time behavioral data obtained from the sensors, and the output is a list of collected behavioral data. Specifically, the sensors detect the movements of animals and workers and send the data to the server.
[1868] Step 2:
[1869] The server accumulates the collected behavioral data. The input is the behavioral data collected in step 1, and the output is a database of accumulated behavioral data. Specifically, the server saves the data it receives in the database.
[1870] Step 3:
[1871] The server trains a generative AI model using the accumulated behavioral data. The input is the accumulated behavioral data, and the output is the trained generative AI model. Specifically, the server uses Python and scikit-learn to run the KMeans clustering algorithm and classify behavioral patterns.
[1872] Step 4:
[1873] When new behavioral data is input, the server predicts behavioral patterns using a generative AI model. The input is the new behavioral data, and the output is the predicted behavioral pattern. Specifically, the server inputs the new data into the generative AI model and obtains the prediction result.
[1874] Step 5:
[1875] The server issues instructions to provide appropriate reactions and support based on the prediction results. The input is the predicted behavior pattern, and the output is instructions for reactions and support. In terms of specific operations, the server instructs the device or robot to perform appropriate actions.
[1876] Step 6:
[1877] The terminal (smartphone) receives instructions from the server and operates the device or robot. The input is the instruction from the server, and the output is the operation of the device or robot. Specifically, the smartphone sends operation commands to the device or robot.
[1878] Step 7:
[1879] The user monitors the operation of the device or robot and operates it manually as necessary. The input is the operating status of the device or robot, and the output is the user's operation command. Specifically, the user manually operates the device or robot using a smartphone.
[1880] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1881] "Example 1"
[1882] As one embodiment of the present invention, a system incorporating an emotion engine is provided. This system recognizes the user's emotions and adjusts the reactions and stimuli given to the cat according to those emotions. Specifically, when the user is happy, the system encourages the cat to play actively. Conversely, when the user is depressed, the system encourages the cat to play quietly. This allows for optimal interaction with the cat according to the user's emotional state.
[1883] "Example 2"
[1884] The emotion engine also recognizes emotions from the user's tone of voice, facial expressions, or physical reactions. For example, if the user is smiling, the system recognizes the user as happy and encourages the cat to play actively. Conversely, if the user is crying, the system recognizes the user as sad and encourages the cat to play quietly. This allows the system to more accurately understand the user's emotional state and optimally interact with the cat accordingly.
[1885] "Example 3"
[1886] Furthermore, the emotion engine adjusts the device's movements and reactions according to the user's emotions, improving the interaction between the user and the cat. For example, when the user is angry, the system suppresses the device's movements to prevent the cat from bothering the user. Conversely, when the user is happy, the system activates the device's movements to allow the cat to play with the user in a fun way. This enables optimal interaction with the cat according to the user's emotional state.
[1887] The processing flow of each embodiment will be described below.
[1888] "Example 1"
[1889] Step 1: The user emotion engine recognizes the user's emotion.
[1890] Step 2: Based on the recognized emotion, the system adjusts its reactions and stimuli to the cat.
[1891] Step 3: When the user is happy, the system encourages active play with the cat.
[1892] Step 4: When the user is depressed, the system prompts the cat for quiet play.
[1893] "Example 2"
[1894] Step 1: The emotion engine recognizes emotions from the user's tone of voice, facial expressions, or physical reactions.
[1895] Step 2: If the user is smiling, the system recognizes that the user is happy and encourages active play with the cat.
[1896] Step 3: If the user is crying, the system will recognize that the user is sad and prompt the cat to play quietly.
[1897] "Example 3"
[1898] Step 1: The emotion engine recognizes the user's emotion.
[1899] Step 2: Adjust the device's behavior and response based on the user's emotions.
[1900] Step 3: When the user is angry, the system inhibits the device's movement to prevent the cat from bothering the user.
[1901] Step 4: When the user is happy, the system activates the device's movements, allowing the cat to play happily with the user.
[1902] Example 1
[1903] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1904] Previous animal devices simply detected animal movements and behavioral patterns, but were unable to understand the animal's preferences and play styles and provide appropriate reactions or stimulation. Furthermore, they lacked the ability to adjust interactions with the animal according to the user's emotional state, making it difficult to deepen the relationship between the user and the animal.
[1905] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1906] In this invention, the server includes a spherical device that ca...
Claims
[Claim 1] A spherical device that can move in any direction; a sensor mounted on the device for detecting the location, speed, and direction of the animal; A generative AI that analyzes data from the sensors and understands the animal's preferences and play styles; a server that issues instructions to the device based on the generative AI to provide the animal with appropriate reactions, stimulation, and play; an information terminal that receives instructions from the server and operates the device; an emotion engine that analyzes an emotional state of a user playing with the animal; The system wherein the server adjusts the device's reactions, stimuli, and play based on the results of the emotion engine's analysis.
Citation Information
Patent Citations
Robot system for nursing pet
CN101278654A
Pet accompanying robot
CN113331071A
Long distance communication system for communication with companion animal and method for long distance communication with companion animal using the same
JP2014103969A
Autonomous maintenance device of manufacturing facility, autonomous maintenance method of manufacturing facility and autonomous maintenance program of manufacturing facility
JP2020126436A
Persona chatbot control method and system
JP2022180282A