system

Abstract

Provide a system. [Solution] An automatic pet play equipment system, A sensor that detects the position and movement of a pet; a control means for moving the play equipment based on the detected position and movement of the pet; artificial intelligence means for generating movement patterns of the play equipment; an obstacle avoidance means for detecting an obstacle and performing an obstacle avoidance operation; An exercise management tool that grasps exercise status and activates it periodically; A system including:

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Lack of exercise for indoor pets is a serious health problem. Conventional cat toys and other manual playthings often struggle to attract pets' attention and fail to encourage sustained exercise. Furthermore, when owners are away or busy, pets have even fewer opportunities to exercise, which can have a negative impact on their physical and mental health. Therefore, there is a need for an automated plaything system that can sustainably attract pets' interest and encourage appropriate exercise. [Means for solving the problem]

[0005] The present invention is an automatic pet play equipment system having the following configuration. The system includes a sensor that detects the position and movement of a pet, a control means that moves the play equipment based on the detected position and movement of the pet, an artificial intelligence means that generates a movement pattern for the play equipment, an obstacle avoidance means that detects obstacles and takes action to avoid them, and an exercise management means that grasps the pet's exercise status and activates the play equipment periodically. The artificial intelligence means generates movements and sounds that attract the pet's interest, and the exercise management means, based on the detected exercise status, automatically activates the play equipment if the pet is not getting enough exercise. This system allows pets to exercise appropriately and maintain their health and happiness.

[0006] An "automatic pet play system" is a system designed to allow a pet to exercise automatically.

[0007] A "sensor for detecting the position and movement of a pet" is a sensor device for obtaining information on the current position and movement of a pet in real time.

[0008] The "control means" refers to a device that controls the movement of the play equipment based on information from the sensor and promotes exercise for the pet.

[0009] "Artificial intelligence means" refers to a mechanism that uses artificial intelligence technology to generate movements and sounds to attract pets' interest and to optimize the operation of the play equipment.

[0010] An "obstacle avoidance means" is a mechanism that detects and avoids obstacles such as furniture and other objects as the play equipment moves.

[0011] The "exercise management means" is a mechanism for monitoring the pet's exercise status and activating the play equipment at the appropriate time to eliminate the pet's lack of exercise. [Brief explanation of the drawings]

[0012] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0013] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0014] First, the terms used in the following description will be explained.

[0015] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0016] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0017] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0018] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0019] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0020] [First embodiment]

[0021] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0022] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0023] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0024] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0025] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0026] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0027] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0028] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0029] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0030] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0031] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0032] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0033] The present invention relates to an automatic pet play equipment system for relieving lack of exercise for pets, and is specifically embodied as follows.

[0034] System Overview

[0035] The server manages the overall operation of the automatic pet play equipment system (hereinafter referred to as "Smart Mouse"). Smart Mouse is a pet device that utilizes AI technology to encourage pets to exercise while playing independently. It uses sensors to detect the pet's position and movements in real time, and the control means adjusts the movement of the play equipment appropriately. In addition, the artificial intelligence means generates movements and sounds that attract the pet's interest, and the exercise management means manages a schedule to ensure the pet gets enough exercise.

[0036] A natural language description of what the program does

[0037] Server Processing

[0038] 1. The server first instantiates the smart mouse and performs the initial configuration, which includes setting the initial position of the smart mouse and a list of obstacles.

[0039] 2. The server calls the activate method of the smart mouse to issue a start instruction, and monitors that the smart mouse has started operating.

[0040] 3. The server calls the run method of the smart mouse and controls the operation of the smart mouse while detecting the pet's position and movements. Specifically, it collects sensor data, adjusts its movements according to the pet's position, and monitors the pet's exercise status.

[0041] 4. The server calls the smart mouse's deactivate method to stop it from operating.

[0042] Terminal handling

[0043] 1. The terminal provides an interface that displays the initial position of the smart mouse and information on obstacles, allowing the user to check the current system status.

[0044] 2. The device detects the location of obstacles and inputs them so that the smart mouse can avoid them. It also updates and displays the location of the smart mouse in real time as it moves.

[0045] 3. When the smart mouse detects a pet, the device will display and notify the pet by displaying a corresponding reaction (for example, playing a sound or escaping).

[0046] User operations

[0047] 1. The user installs the smart mouse, turns it on through the terminal, and starts the smart mouse program.

[0048] 2. The user can check on the display screen of the device whether the smart mouse is working properly, so that if a problem occurs, they can take action immediately.

[0049] 3. The user observes how the Smart Mouse responds to their pet and adjusts settings as needed, which may include changing the location of obstacles or adjusting the Smart Mouse's movement patterns.

[0050] 4. Users can set a schedule for the smart mouse so that their pet gets enough exercise and maintain their pet's health.

[0051] Specific examples

[0052] Example 1: Server operation

[0053] After creating an instance of the smart mouse, the server calls the activate method to start the smart mouse and moves it appropriately while collecting the pet's location information. Through cloud-based sensor data analysis, the server generates movements that interest the pet in real time.

[0054] Example 2: Displaying a terminal

[0055] The terminal displays the movement of the smart mouse, notifying the user of the current system status in real time. It also has the function of detecting obstacles and displaying the action to avoid them.

[0056] Example 3: User operation

[0057] The user can start the smart mouse from the terminal and watch the pet start playing. If the pet is not getting enough exercise, the user can start the smart mouse again through the terminal to ensure that the pet gets enough play time.

[0058] The above is a specific embodiment of the automatic pet play equipment system according to the present invention. This system can effectively alleviate the lack of exercise for pets and contribute to maintaining their health.

[0059] The processing flow will be explained below.

[0060] Server Processing

[0061] Step 1:

[0062] The server creates an instance of the smart mouse, and during this initialization process it sets the initial position of the smart mouse and empties the obstacle list.

[0063] Step 2:

[0064] The server invokes the activate method of the smart mouse to activate it, which causes the smart mouse to transition from a standby state to an active state.

[0065] Step 3:

[0066] The server calls the run method to control the operation of the smart mouse, which includes the process of collecting sensor data and pet location and movement information.

[0067] Step 4:

[0068] The server determines the smart mouse's next move based on data from the sensors, performs calculations to avoid obstacles, and generates optimal movement patterns to attract pets.

[0069] Step 5:

[0070] The server generates sounds and movements for the smart mouse to react to the pet. For example, when the pet approaches within a certain range, the smart mouse plays a sound and performs a predictive action.

[0071] Step 6:

[0072] The server periodically monitors the smart mouse's exercise status, and if the pet is not getting enough exercise, it issues an instruction to restart the operation.

[0073] Step 7:

[0074] The server calls the deactivate method of the smart mouse to stop the operation of the smart mouse, thereby controlling the smart mouse to stop in a safe place.

[0075] Terminal handling

[0076] Step 1:

[0077] The terminal displays the initial position of the smart mouse and various setting information on the initial screen of the system, where the user can check the current status of the system.

[0078] Step 2:

[0079] The terminal provides an interface for the user to set the location of the obstacle, which is then sent to the server and added to the obstacle list of the smart mouse.

[0080] Step 3:

[0081] The terminal updates and displays the current location of the smart mouse in real time based on the sensor data, allowing the user to check the operating status of the smart mouse.

[0082] Step 4:

[0083] When the smart mouse detects the pet's location, the terminal notifies the user of the sound and movement that is being made, allowing the user to check whether the system is operating normally.

[0084] Step 5:

[0085] The device adjusts the smart mouse's movement patterns and schedule based on user input, for example, scheduling additional play time if the mouse is not getting enough exercise.

[0086] User operations

[0087] Step 1:

[0088] The user places the smart mouse in the cat's play area and turns it on using the terminal. As an initial setting, the user turns on the smart mouse and checks the settings on the terminal.

[0089] Step 2:

[0090] Users can monitor the operation of the smart mouse on the device screen, check for abnormalities and obstacle detection, and be prepared to deal with any problems that may arise.

[0091] Step 3:

[0092] The user observes how their pet reacts to the smart mouse, and if the pet shows no interest, they can change the behavior pattern from the terminal.

[0093] Step 4:

[0094] Users can adjust the smart mouse's operating schedule as needed to ensure efficient exercise for their pets, for example, by setting a schedule to activate the smart mouse at a specific time of day.

[0095] Step 5:

[0096] After use, the user turns off the power of the smart mouse, shuts down the system from the terminal, and finally stores the smart mouse in a safe place.

[0097] Example 1

[0098] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0099] Conventional automatic pet play equipment systems often fail to adequately alleviate pets' lack of exercise, limiting their effectiveness. Furthermore, they require users to frequently operate the system manually, placing a heavy burden on the user. Furthermore, they lack the ingenuity to continuously attract pets' interest, and pets often become bored quickly.

[0100] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0101] In this invention, the server includes a sensor means for detecting the position and movement of the pet, a control means for moving the play equipment based on the detected position and movement of the pet, an artificial intelligence means for generating a movement pattern of the play equipment, an obstacle avoidance means for detecting obstacles and performing avoidance actions, an exercise management means for grasping the exercise status and periodically activating the system, a data analysis means for performing cloud-based data analysis, an interface means for operating and monitoring the system from a user terminal, and a schedule management means for setting and managing the pet's exercise schedule. This makes it possible to effectively manage the pet's exercise, reduce the burden on the user, and continuously attract the pet's interest.

[0102] An "automated pet play equipment system" is an automated play equipment system designed to help pets get enough exercise and have fun playing.

[0103] A "sensor" is a device that detects the position and movements of a pet, and provides information to control the movement of play equipment based on that data.

[0104] The "control means" is a mechanism that appropriately adjusts the movement of the play equipment based on data obtained from the sensor, encouraging the pet to exercise.

[0105] "Artificial intelligence means" refers to algorithms and technologies for analyzing pet behavior data and generating optimal movements and sounds for play equipment.

[0106] The "obstacle avoidance means" is a function that allows the play equipment to detect obstacles while moving and take appropriate action to avoid them.

[0107] The "exercise management means" is a system for grasping the pet's exercise status and periodically activating the play equipment as necessary.

[0108] The "data analysis means" is a cloud-based technology that analyzes pet behavior data and optimizes the movement of play equipment.

[0109] The "interface means" is a device that provides an operation screen for the user to operate and monitor the system.

[0110] The "schedule management means" is a function for efficiently managing the pet's exercise time and activating the play equipment at the appropriate time.

[0111] The present invention relates to an automatic pet play equipment system for relieving pets' lack of exercise. This system detects the pet's position and movements and automatically controls the play equipment to encourage appropriate exercise. Specifically, the system includes a sensor that detects the pet's position and movements, a control means that moves the play equipment based on the detected data, an artificial intelligence means that generates the movement and sound of the play equipment, an obstacle avoidance means that detects and avoids obstacles, and an exercise management means that monitors the exercise status and is activated periodically.

[0112] Server Roles

[0113] The server first creates an instance of a pet toy called a smart mouse and performs initial setup. This setup includes setting the smart mouse's initial position and a list of obstacles. The server calls the smart mouse's activate method to start the smart mouse. Next, it uses the run method to collect sensor data and control the smart mouse's operation based on the pet's position and movement. It then calls the deactivate method to stop the smart mouse. Specifically, it uses cloud-based data analysis means to analyze the pet's movements in real time and generate optimal movement for the toy.

[0114] Device Role

[0115] The terminal provides an interface that displays the initial position of the smart mouse and obstacle information, allowing users to check the current status of the system in real time. The terminal also updates and displays the position of the smart mouse in real time based on sensor data. Furthermore, if a pet comes into contact with the smart mouse, the terminal notifies the user of the reaction. For example, when a pet approaches the smart mouse, a notification will be displayed saying, "Your pet has started playing."

[0116] User operations

[0117] First, the user installs the smart mouse, turns it on through the terminal, and starts the smart mouse program. Next, the user checks whether the smart mouse is working properly on the terminal display screen. If a problem occurs, the user can reconfigure the obstacle location and the smart mouse's movement through the terminal. In addition, the user can set an exercise schedule for the smart mouse to efficiently manage their pet's exercise time.

[0118] Specific examples

[0119] Example 1: Server installation

[0120] The server creates an instance of the smart mouse and activates it using the activate method. It then collects the pet's location information and performs cloud-based data analysis to generate appropriate play equipment movements.

[0121] Example 2: Using a terminal

[0122] The terminal displays the movement of the smart mouse, notifying the user of the current system status in real time. It also has the function of detecting obstacles and displaying the action to avoid them.

[0123] Example 3: User operation

[0124] The user activates the smart mouse from the device and observes how the pet begins to play. If the pet is not getting enough exercise, the user activates the smart mouse again to ensure that the pet gets adequate playtime.

[0125] Example prompts for generative AI models

[0126] "Please explain what the following system does. Explain in detail how an automated pet toy operates according to instructions from a server, a device, and a user. Include examples of specific hardware and software components."

[0127] In this way, the system of the present invention can effectively alleviate the lack of exercise required by pets, reduce the burden on users, and continuously attract the interest of pets.

[0128] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0129] The flow of this system's program processing

[0130] Step 1:

[0131] Initialization and Instantiation

[0132] The server creates an instance of the smart mouse and sets its initial position and obstacle list. Specifically, it calls the initialize_smart_mouse() method, and inputs the initial X and Y coordinates of the smart mouse and the position data of the obstacles. Based on this data, it sets the smart mouse in a state where it can start operating. As an output, the smart mouse is placed in its initial position and the obstacle list is loaded into the system.

[0133] Step 2:

[0134] Starting the Smart Mouse

[0135] The server invokes the activate method of the smart mouse to activate it. The activate command is given as input, and the system transitions the smart mouse's sensor to an active state. As an output, the smart mouse starts operating and begins collecting sensor data.

[0136] Step 3:

[0137] Sensor data collection and analysis

[0138] The server collects real-time location and movement data from the smart mouse's sensor. The sensor data is periodically sent as input, and a cloud-based data analysis tool operates based on this data to analyze the pet's location and movement. The output is an analysis result of the pet's current location and movement.

[0139] Step 4:

[0140] Controlling movement according to pet behavior

[0141] The server controls the operation of the smart mouse based on the analysis results. The analyzed pet's position data and predicted movement are given as input, and the artificial intelligence means operates to generate the movement pattern of the play equipment. As output, the next movement pattern of the smart mouse is calculated and the instruction is sent to the smart mouse.

[0142] Step 5:

[0143] Obstacle Avoidance

[0144] The server performs processing to avoid obstacles when the smart mouse moves. Data from the obstacle sensor is used as input to operate the obstacle avoidance means. As output, a new movement pattern to avoid the obstacle is generated and sent to the smart mouse.

[0145] Step 6:

[0146] Sending data to the user interface

[0147] The server sends sensor data and analysis results to the user's device, allowing the user to monitor the system status. The latest data on the server is used as input, and data displayed in real time on the user's device is sent as output.

[0148] Step 7:

[0149] Resetting by user operation

[0150] The user reconfigures the smart mouse's operation and obstacle positions through the terminal. The user's operation instructions are given as input, and the system accepts them and performs new settings. As output, the smart mouse's operation parameters and obstacle list are updated.

[0151] Step 8:

[0152] Managing your exercise schedule

[0153] The user sets an exercise schedule for the smart mouse to maintain the health of their pet. The exercise time and frequency specified by the user are used as input, and the schedule management means reflects this in the system. As output, the smart mouse will automatically start and stop based on the set schedule.

[0154] Step 9:

[0155] Stopping Smart Mouse

[0156] When the exercise session ends, the server calls the deactivate method of the smart mouse to stop the smart mouse operation. The command to end the exercise session is given as input, and the system completely stops the smart mouse operation. As an output, the smart mouse is safely stopped.

[0157] Through the above specific processing steps, the automatic pet play equipment system can effectively alleviate the lack of exercise for pets and reduce the user's hassle.

[0158] (Application example 1)

[0159] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0160] Automatic play equipment systems play an important role in helping pets get enough exercise, but conventional systems have difficulty monitoring a pet's exercise status in real time and providing appropriate exercise patterns based on that data. Furthermore, they lack an interface that allows users to easily check the system status and the pet's response, making it difficult to effectively manage a pet's exercise plan.

[0161] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0162] In this invention, the server includes a sensor that detects the position and movement of the pet, a control means that moves the play equipment based on the detected position and movement of the pet, an artificial intelligence means that generates a movement pattern for the play equipment, an obstacle avoidance means that detects obstacles and takes action to avoid them, an exercise management means that grasps the exercise status and activates periodically, a data analysis means that monitors the pet's movements in real time and generates recommended play equipment and exercise patterns, a recording means that saves the pet's exercise status and uses it for future exercise plans, and a display means that allows the user to check the system status and the pet's reaction through an interface. This makes it possible to eliminate a lack of exercise for pets and maintain their health.

[0163] A "sensor for detecting the position and movement of a pet" is a device used to detect the current position and movement of a pet in real time.

[0164] The "control means for moving the play equipment based on the detected position and movement of the pet" is a control system for appropriately moving the play equipment based on information from the sensor.

[0165] "Artificial intelligence means for generating movement patterns for play equipment" means means using AI technology to generate movement or movement patterns that attract pets.

[0166] The "obstacle avoidance means for detecting an obstacle and taking action to avoid it" is a system for detecting an obstacle so that the play equipment does not collide with it and taking action to avoid it.

[0167] The "exercise management means for grasping the exercise status and activating it periodically" is a management system for monitoring the exercise status of a pet and activating the automatic play equipment periodically.

[0168] "Data analysis means for monitoring pet movements in real time and generating recommended play equipment and exercise patterns" refers to a means for analyzing pet movements in real time and generating optimal play equipment and exercise patterns based on that data.

[0169] "Means for recording the exercise status of a pet and using it for future exercise planning" refers to a means for storing the exercise data of a pet and creating future exercise plans based on that information.

[0170] "Display means that allows the user to check the system status and the pet's reaction through an interface" refers to a display device and an interface that allows the user to check the current status of the system and the behavior of the pet.

[0171] This invention is an automatic pet play equipment system that effectively eliminates the lack of exercise for pets and contributes to maintaining their health. This system is composed of three entities: a server, a terminal, and a user, each of which plays a specific role.

[0172] Server Processing

[0173] The server creates an instance of the smart mouse and performs initial settings within the pet shop. It sets the initial position of the smart mouse and a list of obstacles, and after creating the instance, calls the smart mouse's activate method to issue an activation command. The server collects data on the pet's position and movement detected using sensors, and appropriately controls the smart mouse's movement based on that data. Furthermore, the server uses AI technology to analyze the pet's movement patterns and generate movements and sounds that interest the pet. Specifically, it analyzes the data using AI modules such as TENSORFLOW (registered trademark) and Keras.

[0174] Terminal handling

[0175] The terminal monitors the status of the smart mouse and the pet's reaction in real time through a user interface. It displays the initial position and obstacle information, allowing the user to check the current status of the system. The terminal communicates with the server via Bluetooth or Wi-Fi to receive sensor data and analysis results. The terminal also stores the pet's exercise status, providing a means of recording it for use in future exercise planning.

[0176] User operations

[0177] Users simply activate the smart mouse through their device and watch their pet begin to play. If their pet is not getting enough exercise, they can simply reactivate the smart mouse through their device to ensure their pet gets the appropriate playtime. They can also monitor their pet's behavior through the device's display function and adjust play equipment and settings as needed.

[0178] Specific application examples and prompt sentence examples

[0179] A specific application example is a situation where a pet owner tries out toys for their pet in a pet shop. The user launches the smartphone app and moves the smart mouse together with their pet. The app analyzes the pet's movements in real time and generates recommended toys and exercise patterns based on that data. This allows the user to more effectively alleviate their pet's lack of exercise.

[0180] Example prompt sentence:

[0181] (Setting) Check the initial position and set the list of obstacles.

[0182] (Start) Start the smart mouse and check your pet's movements.

[0183] (Analysis) Analyze your pet's position in real time and generate interesting movements.

[0184] (Stop) Stop the Smart Mouse if necessary.

[0185] This system will help pets get enough exercise and effectively maintain their health.

[0186] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0187] Step 1:

[0188] The server creates an instance of the smart mouse and initializes the location information of the pet. The input includes the pet's initial location data and a list of obstacles. Based on this data, it calculates a route to avoid obstacles and creates the initial location data and a movement route as output.

[0189] Step 2:

[0190] The server invokes the activate method of the smart mouse to start the smart mouse. The server then monitors whether the smart mouse starts operating normally. The input includes the initial setting information of the smart mouse. The output generates a log that confirms that the smart mouse has started operating.

[0191] Step 3:

[0192] The server calls the smart mouse's run method and uses sensors to collect pet position and movement data in real time. The input data is position and movement data from the sensors, as well as obstacle information. The server analyzes the data and generates movements of the play equipment and interesting movements based on the pet's movements. The output is the movement pattern of the play equipment and movement instructions.

[0193] Step 4:

[0194] The terminal receives the sensor data and analysis results from the server and displays them in real time through the user interface. The input data is the sensor data from the server and the operation information of the play equipment. The terminal displays this visually, allowing the user to check the current status of the system. The output is a visual status display on the user interface.

[0195] Step 5:

[0196] The user monitors the pet's exercise status through the device and adjusts the settings as needed. Input includes the information displayed on the device and the user's operation instructions. Based on this, the settings and movement patterns of the play equipment are adjusted. The updated settings and the applied movement patterns are generated as output.

[0197] Step 6:

[0198] The server periodically records the pet's exercise status data and stores it for use in future exercise planning. The input data is exercise status data collected in real time. Based on this, the data is stored in a recording device and can be retrieved when needed. A recorded data file is generated as an output.

[0199] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0200] The present invention relates to an automatic pet play equipment system that combines an emotion engine that recognizes the user's emotions, and is specifically implemented as follows.

[0201] System Overview

[0202] The automatic pet play equipment system of the present invention (hereinafter referred to as "smart mouse") is designed to alleviate the lack of exercise for pets and integrates multiple functions. Specifically, it includes a sensor to detect the position and movement of the pet, a control means to move the play equipment, an artificial intelligence means to generate the movement pattern of the play equipment, an obstacle avoidance means to detect and avoid obstacles, an exercise management means to manage the exercise status and periodically activate the play equipment, and an emotion engine to recognize the user's emotions.

[0203] A natural language description of what the program does

[0204] Server Processing

[0205] 1. The server creates an instance of the smart mouse and performs the initial configuration, which includes setting the initial position of the smart mouse and a list of obstacles.

[0206] 2. The server invokes the activate method of the smart mouse to activate the smart mouse.

[0207] 3. The server calls the run method, detects the pet's position and movement based on sensor data, and moves the smart mouse appropriately.

[0208] 4. The server uses artificial intelligence means to generate movements and sounds that will attract the pet's attention.

[0209] 5. The server analyzes the user's emotional state through the emotion engine, collecting the user's voice and facial expression data and evaluating the status.

[0210] 6. The server adjusts the pet's play patterns and the behavior of the play equipment based on the results of the emotion engine. For example, if the user is feeling stressed, it selects a behavior pattern that will relax both the pet and the user.

[0211] 7. The server monitors the pet's exercise status using the exercise management means and restarts the smart mouse if necessary.

[0212] 8. Finally, the server calls the smart mouse's deactivate method to safely stop the smart mouse's operation.

[0213] Terminal handling

[0214] 1. The terminal provides an interface that displays the initial position and obstacle information on the initial screen of the smart mouse.

[0215] 2. The device accepts input from the user to set the location of the obstacle and sends it to the server.

[0216] 3. The terminal updates the position and operating status of the smart mouse in real time and displays it to the user.

[0217] 4. If the user's emotional state changes, the device notifies the server of the change.

[0218] 5. The terminal can adjust the operation patterns and schedules of the play equipment based on instructions from the user.

[0219] User operations

[0220] 1. The user places the smart mouse in the pet's play area and turns it on through the terminal.

[0221] 2. After confirming the initial settings, the user can monitor the system status through the terminal, set the obstacle location as needed, and adjust the operation of the smart mouse.

[0222] 3. After the smart mouse starts working, the user can observe the pet's reaction and change the operation settings via the terminal.

[0223] 4. If the user's emotional state changes, the user notifies the server via the device, which then uses the emotion engine to adjust the server's behavior.

[0224] 5. After finishing playing, the user should turn off the smart mouse and shut down the system from the terminal. Then store the smart mouse in a safe place.

[0225] Specific examples

[0226] Example 1: Server operation

[0227] After creating an instance of the smart mouse, the server calls the activate method to start the smart mouse and moves it appropriately while collecting information on the pet's location.The emotion engine is used to analyze the user's emotional state, and if the user's stress level is high, the smart mouse's movement pattern is changed to make the mouse move in a way that helps the user relax.

[0228] Example 2: Displaying a terminal

[0229] The terminal displays the operation status of the smart mouse in real time, allowing the user to check the current system status, and also displays the user's emotional state fluctuations and transmits data to the server accordingly.

[0230] Example 3: User operation

[0231] The user installs the smart mouse, turns it on using a terminal, and checks its operation. If the user's emotional state changes, the terminal transmits that information, and the smart mouse adjusts its behavior based on that information. The user also observes their pet, adjusts further settings as needed, and finally shuts down the system.

[0232] The above is a specific embodiment of an automatic pet play equipment system incorporating an emotion engine according to the present invention. This system not only helps pets get more exercise but also provides play that responds to the user's emotional state, ensuring the happiness of both the pet and the user.

[0233] The processing flow will be explained below.

[0234] Server Processing

[0235] Step 1:

[0236] The server creates an instance of the smart mouse, which initializes the initial position of the smart mouse and the list of obstacles.

[0237] Step 2:

[0238] The server invokes the activate method of the smart mouse to activate the smart mouse, which causes the smart mouse to start operating.

[0239] Step 3:

[0240] The server calls the run method, receives data from the sensor, and detects the pet's position and movement in real time. It controls the movement of the smart mouse based on the acquired data.

[0241] Step 4:

[0242] The server analyzes the sensor data and moves the smart mouse according to the pet's current position and movement. It also detects the location of obstacles and takes action to avoid them.

[0243] Step 5:

[0244] The server uses artificial intelligence to generate movements and sounds that interest the pet, and designs and executes optimal reactions to the pet's movements.

[0245] Step 6:

[0246] The server analyzes the user's emotional state through an emotion engine, extracting emotional data from the user's voice and facial expressions, and uses that data to determine the user's stress level and happiness.

[0247] Step 7:

[0248] The server adjusts the behavior of the smart mouse based on the user's emotional state, for example, if the user is in a relaxed state, the server will slow down the behavior of the smart mouse to maintain a relaxed mood.

[0249] Step 8:

[0250] The server monitors the pet's exercise status using the exercise management means, periodically activates the smart mouse, and if the pet is not getting enough exercise, activates the smart mouse again to encourage more exercise.

[0251] Step 9:

[0252] The server calls the deactivate method of the smart mouse to stop the smart mouse from operating, and in the process safely places the smart mouse in a stopped position.

[0253] Terminal handling

[0254] Step 1:

[0255] The terminal displays the initial position and setting information on the initial screen of the smart mouse, allowing the user to check the current status of the system.

[0256] Step 2:

[0257] The terminal provides an interface for the user to input the location of the obstacle, which is then sent to the server and added to the obstacle list of the smart mouse.

[0258] Step 3:

[0259] The terminal updates and displays the current location of the smart mouse based on real-time data from the sensor, allowing the user to monitor the movement of the smart mouse in real time.

[0260] Step 4:

[0261] When a user inputs emotional information or provides voice or facial expression data, the device sends it to the server, which then analyzes the data using an emotion engine.

[0262] Step 5:

[0263] The device will detect the pet's location and display a notification when the smart mouse performs a specific action, allowing the user to check whether the system is working properly.

[0264] Step 6:

[0265] The device can adjust the smart mouse's motion patterns and schedules based on user instructions, such as setting up additional play time or selecting special motion patterns.

[0266] User operations

[0267] Step 1:

[0268] The user places the smart mouse in the cat's play area and turns it on using the terminal. As an initial setting, the user turns on the smart mouse and checks the settings on the terminal.

[0269] Step 2:

[0270] The user checks the location of obstacles and the status of the system through the terminal, changes the settings as necessary, and verifies that the system is operating normally.

[0271] Step 3:

[0272] After the smart mouse starts working, users can observe their pet's behavior and make additional settings and adjustments through the device, for example, increasing the speed if the movement is slow.

[0273] Step 4:

[0274] When a user provides emotion information, the data is input through the terminal, and the server uses the emotion engine to select an appropriate behavior pattern.

[0275] Step 5:

[0276] After finishing playing, the user turns off the smart mouse and shuts down the system from the terminal, and finally puts the smart mouse in a safe place.

[0277] Example 2

[0278] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0279] In today's living environment, lack of exercise for pets and fluctuations in users' emotions are becoming problems. It is particularly difficult for busy users to manage their pets' exercise and provide them with play. Furthermore, existing automatic pet play equipment systems are unable to provide play that responds to the user's emotional state, making it difficult to provide an environment that satisfies both the user and the pet.

[0280] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a sensor means for detecting the position and movement of the pet, a control means for moving the play equipment based on the detected position and movement of the pet, an artificial intelligence means for generating a movement pattern of the play equipment, an obstacle avoidance means for detecting obstacles and performing an avoidance operation, an exercise management means for grasping the exercise status and periodically activating the same, an emotion recognition means for analyzing the emotional state of the user, and an emotion response means for adjusting the operation of the play equipment based on the analyzed emotional state. This makes it possible to alleviate the lack of exercise for the pet and provide play that takes into account the emotional state of the user.

[0281] An "automatic pet play system" is a system that includes a device for playing with a pet that operates automatically to encourage exercise for the pet.

[0282] "Sensor means" refers to devices or technologies for collecting information from the surrounding environment or objects, and specifically refers to devices that detect the position and movements of a pet.

[0283] "Control Means" refers to the devices or technology used to manage and control the operation of a system or device, specifically a device that moves play equipment based on the detected position and movement of a pet.

[0284] "Artificial intelligence means" refers to technology that uses data analysis and machine learning to make autonomous decisions and take action, and specifically refers to devices and software for generating movement patterns for playground equipment.

[0285] "Obstacle avoidance means" refers to devices or technologies that detect surrounding obstacles and take action to avoid them.

[0286] "Exercise management means" refers to devices and technologies for grasping the level and status of exercise and for managing and adjusting it, and is a device that grasps the pet's exercise status and activates play equipment periodically.

[0287] "Emotion recognition means" refers to devices and technologies for analyzing the user's emotional state, specifically devices that analyze voice and facial expressions.

[0288] "Emotion response means" refers to a device or technology that responds or behaves appropriately based on the analyzed emotional state, and specifically refers to a device that adjusts the operation of play equipment.

[0289] The present invention relates to an automatic pet play equipment system that combines an emotion engine that recognizes the user's emotions, and is specifically implemented as follows.

[0290] System Overview

[0291] The automatic pet play equipment system of the present invention (hereinafter referred to as "smart mouse") is designed to alleviate the lack of exercise for pets and integrates multiple functions. Specifically, it includes a sensor means for detecting the position and movement of the pet, a control means for moving the play equipment, an artificial intelligence means for generating the movement pattern of the play equipment, an obstacle avoidance means for detecting and avoiding obstacles, an exercise management means for grasping the exercise status and periodically activating the play equipment, and an emotion recognition means and an emotion response means for analyzing the user's emotional state and adjusting the operation of the play equipment.

[0292] Server Processing

[0293] The server creates an instance of the smart mouse and performs initial settings. These initial settings include the smart mouse's initial position and a list of obstacles. The server calls the smart mouse's activate method to start the smart mouse. The server detects the pet's position and movement based on sensor data and moves the smart mouse appropriately. The sensors used are cameras and motion sensors, and data is acquired in real time.

[0294] Furthermore, the server uses artificial intelligence means to generate movements and sounds that will attract the pet's attention. For example, TensorFlow and PyTorch are used as AI platforms. The server analyzes the user's emotional state through emotion recognition means (e.g., natural language processing software for voice recognition and image analysis software for facial expression recognition) and selects an appropriate movement pattern based on the emotion response means. Based on this information, if the user feels stressed, the server changes the movement pattern of the smart mouse to provide relaxing movements. MongoDB and other database technologies are used to store and analyze movement data, and the server restarts the smart mouse if the pet is not getting enough exercise.

[0295] Terminal handling

[0296] The device provides an interface that displays the initial position and obstacle information on the smart mouse's initial screen. For example, the interface can be built using frameworks such as React or Vue.js. The location information of obstacles set by the user is sent to the server, which displays the smart mouse's position and operating status in real time. The device manages the operation of the smart mouse using real-time communication technologies such as WebSocket. The device also has a notification system (such as Firebase Cloud Messaging) that notifies the server when the user's emotional state changes.

[0297] User operations

[0298] The user places the smart mouse in the pet's play area and turns on the device. The user uses the device to check the initial settings and monitor the system status. The device can be used to set the location of obstacles and adjust the smart mouse's behavior. If the user's emotional state changes during play, it is communicated through the device, and the server analyzes it and takes appropriate action. Finally, after finishing play, the smart mouse is shut down and stored in a safe place.

[0299] Specific examples

[0300] Example 1: Server operation

[0301] After creating an instance of the smart mouse, the server calls the activate method to start the smart mouse and makes it operate appropriately while collecting the pet's location information.The emotion engine is used to analyze the user's emotional state, and if the stress level is high, the smart mouse's movement pattern is changed to make it operate in a relaxing manner.

[0302] Example 2: Displaying a terminal

[0303] The terminal displays the operation status of the smart mouse in real time, allowing the user to check the current system status, and also displays the user's emotional state fluctuations and transmits data to the server accordingly.

[0304] Example 3: User operation

[0305] The user installs the smart mouse, turns it on using a terminal, and checks its operation. If the user's emotional state changes, the terminal transmits that information, and the smart mouse adjusts its behavior based on that information. The user observes their pet, changes settings as needed, and finally shuts down the system.

[0306] Prompt Sentence Examples

[0307] "Please explain what behavior pattern should be selected in an automatic pet play system when the user's emotional state changes."

[0308] This system not only helps pets overcome lack of exercise but also provides play that responds to the user's emotional state, ensuring the happiness of both the pet and the user.

[0309] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0310] Step 1:

[0311] The server creates an instance of the smart mouse and performs the initial settings.

[0312] Input: Smart Mouse initial setting information (initial position, obstacle list, etc.)

[0313] Output: Smart Mouse initial settings completed

[0314] Specific operation: The server creates a new smart mouse instance and sets the initial position and obstacle list specified in the program code. This initial information is often obtained from a database.

[0315] Step 2:

[0316] The server starts the smart mouse.

[0317] Input: Start command

[0318] Output: Smart Mouse activated

[0319] Specific operation: The server calls the activate method of the smart mouse to activate the smart mouse's sensors and motors. This operation turns on the smart mouse's LED and starts operation.

[0320] Step 3:

[0321] The server detects the pet's position and movements based on sensor data and moves the smart mouse appropriately.

[0322] Input: Sensor data (location information, motion information)

[0323] Output: Smart Mouse movement command

[0324] Specific operation: The server analyzes data obtained from the infrared sensor and camera installed in the smart mouse to identify the pet's current location and movement. Based on the analysis results, it calculates the direction and distance the smart mouse should move and sends a movement command to the smart mouse.

[0325] Step 4:

[0326] The server generates the movements and sounds using artificial intelligence means.

[0327] Input: Pet behavioral patterns and environmental data

[0328] Output: Generated movements and sounds

[0329] How it works: The server uses AI frameworks such as TensorFlow and PyTorch to analyze data on your pet's past behavior and current environment, and based on this, generates new movements and sounds that will attract your pet's attention and sends them to the smart mouse.

[0330] Step 5:

[0331] The server analyzes the user's emotional state through emotion recognition means.

[0332] Input: User's voice data, facial expression data

[0333] Output: Parsed emotional state

[0334] Specific operation: The server analyzes the user's voice data using voice recognition software (using natural language processing) and facial expression data using image recognition software. For example, if the user says "I'm happy" or "I'm tired," or if they smile or frown, the server analyzes the data to evaluate their emotional state.

[0335] Step 6:

[0336] The server adjusts the behavior of the play equipment based on the emotion response means.

[0337] Input: Parsed emotional state

[0338] Output: Coordinated movement pattern

[0339] Specific behavior: The server analyzes the user's emotional state and changes the behavior pattern of the smart mouse. For example, if the user is feeling stressed, the smart mouse will be configured to move slowly and provide relaxing sounds.

[0340] Step 7:

[0341] The server uses the exercise management means to monitor the pet's exercise status and restarts the smart mouse if necessary.

[0342] Input: Exercise data

[0343] Output: Restart command

[0344] How it works: The server continuously monitors your pet's past exercise data stored in a database such as MongoDB, assesses whether it is getting enough exercise, and if it is, issues a command to restart the smart mouse to encourage your pet to exercise.

[0345] Step 8:

[0346] The server stops the smart mouse from working.

[0347] Input: Stop command

[0348] Output: Smart Mouse stopped

[0349] Specific operation: The server calls the smart mouse's deactivate method to safely stop the sensors and motors. This turns off the smart mouse's LED and completely stops its operation.

[0350] Step 9:

[0351] The device will display the initial position and obstacle information on the initial screen.

[0352] Input: Initialization information (initial position, obstacle list, etc.)

[0353] Output: Initial screen display

[0354] Specific operation: The device uses JavaScript frameworks such as React and Vue.js to display the initial setting information on the user interface, allowing the user to easily check the initial position of the smart mouse and obstacle information.

[0355] Step 10:

[0356] The terminal accepts input from the user and sends it to the server.

[0357] Input: User setting input (obstacle position, operation instructions, etc.)

[0358] Output: Data sent to the server

[0359] Specific operation: The terminal receives the user's input of the obstacle position and the smart mouse's operation instructions in real time and sends them to the server, which then adjusts the smart mouse's operation based on the user's instructions.

[0360] Step 11:

[0361] The terminal updates the position and operating status of the smart mouse and displays it to the user.

[0362] Input: Smart mouse status data (location information, operation information, etc.)

[0363] Output: Real-time display

[0364] Specific operation: The device uses real-time communication technology such as WebSocket to display the current location and operating status of the smart mouse on the user's screen. For example, a smart mouse icon is displayed on a map, updated in real time.

[0365] Step 12:

[0366] The terminal notifies the server of changes in the user's emotional state.

[0367] Input: Emotional state data (feedback from the user)

[0368] Output: Notification data to the server

[0369] Specific operation: The device uses a system (e.g., Firebase Cloud Messaging) to detect changes in the user's emotional state and notify the server, allowing the server to adjust the behavior of the smart mouse according to the user's emotional state.

[0370] Step 13:

[0371] The terminal adjusts the movement pattern of the play equipment based on the user's instructions.

[0372] Input: User instructions (operation patterns, schedule settings, etc.)

[0373] Output: Instruction data to the server

[0374] Specific operation: Based on the user's instructions, the terminal adjusts the operation pattern of the smart mouse and sends the setting information to the server, so that the operation of the smart mouse can be changed according to the user's wishes.

[0375] Step 14:

[0376] The user installs the smart mouse and turns it on through the terminal.

[0377] Input: Power on command, installation location information

[0378] Output: Smart mouse startup status

[0379] Specific operation: The user places the smart mouse in the pet play area and clicks the power button on the device to start the system, which then starts the smart mouse.

[0380] Step 15:

[0381] The user confirms the initial configuration and monitors the system status.

[0382] Input: Initialization information (initial position, obstacle list, etc.)

[0383] Output: System status monitoring information

[0384] Specific operation: The user checks the initial setting information on the terminal, and then monitors the system's operating status. Based on the initial setting information displayed on the terminal, the user checks whether the system is operating normally.

[0385] Step 16:

[0386] The user observes the pet's reactions and changes the settings.

[0387] Input: Pet reaction information, setting change instructions

[0388] Output: New configuration information

[0389] Specific operation: After the smart mouse starts operating, the user can observe the pet's reaction and change the operation settings through the terminal if necessary. For example, if the pet is not interested, the operation pattern can be changed.

[0390] Step 17:

[0391] The user communicates changes in their emotional state through the terminal.

[0392] Input: Emotional state data (user feedback)

[0393] Output: Emotional state notification data

[0394] Specific operation: The user's emotional state (relaxed, stressed, etc.) is communicated to the server through button presses or voice input on the device. The server then adjusts the operation of the smart mouse in real time based on this information.

[0395] Step 18:

[0396] When the user has finished playing, he or she shuts down the smart mouse and stores it in a safe place.

[0397] Input: Stop command

[0398] Output:Smart Mouse stopped state

[0399] Specific operation: When the user finishes playing, he / she presses the stop button on the device to stop the smart mouse safely, and then stores the smart mouse in a safe place.

[0400] (Application example 2)

[0401] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0402] For customers who visit physical stores with their pets, there is a need for systems that allow pets to stay comfortable and safe in the store, improving the customer experience. In particular, there is a need for systems that can recognize customers' emotions in real time and adjust the pet's play environment accordingly. There is also a need for a method that allows customers to easily operate and monitor play equipment via smartphone while ensuring their pet's exercise and safety.

[0403] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0404] In this invention, the server includes a sensor that detects the pet's position and movement, a control means that moves the play equipment based on the detected pet's position and movement, an artificial intelligence means that generates a movement pattern for the play equipment, an obstacle avoidance means that detects obstacles and takes action to avoid them, an exercise management means that grasps the exercise status and periodically activates the control, an emotion recognition means that analyzes the user's facial expression or voice to recognize emotions, a means for adjusting the operation of the play equipment based on the recognized emotional state of the user, and an interface for monitoring and controlling the operation status of the play equipment using a smartphone. This allows pets to spend a comfortable time in the store and provides a play environment that matches the customer's emotional state. Furthermore, customers can easily manage and monitor their pet's play environment via their smartphone.

[0405] An "automatic pet play equipment system" is an integrated system that detects the pet's position and movements and operates play equipment appropriately.

[0406] A "sensor" is a device for detecting the location and movement of a pet.

[0407] "Control means" refers to means for moving the play equipment based on the detected position and movement of the pet.

[0408] "Artificial intelligence means" refers to means that utilizes artificial intelligence to generate movement patterns for play equipment.

[0409] The "obstacle avoidance means" is a means for detecting an obstacle and performing an avoidance operation.

[0410] The "exercise management means" is a means for understanding the pet's exercise status and for periodically activating the play equipment.

[0411] The "emotion recognition means" is a means for analyzing the user's facial expression or voice and recognizing the user's emotion.

[0412] The "interface" is a user interface for monitoring and controlling the operating status of the play equipment using a smartphone.

[0413] A "plaything" is a device for pets to play with, and in the case of the present invention, it has an automatic function.

[0414] A "server" is a central control unit that controls the entire system and processes data.

[0415] The present invention is an automatic pet play equipment system that combines an emotion engine that recognizes the user's emotions, and is specifically implemented as follows.

[0416] The system is composed of sensors that detect the pet's position and movements, a control means that moves the play equipment, an artificial intelligence means that generates the play equipment's movement patterns, an obstacle avoidance means that detects and avoids obstacles, an exercise management means that manages the exercise status and periodically activates the play equipment, an emotion engine that recognizes the user's emotions, and an interface that uses a smartphone to monitor and control the system.

[0417] Server Processing

[0418] The server receives data from sensors that detect the pet's position and movement, and controls the play equipment based on that data. It also uses artificial intelligence to generate movement patterns for the play equipment that will interest the pet. It also analyzes the user's emotional state through an emotion engine, recognizing the user's emotional state by analyzing the user's facial expressions or voice. Based on the results, the server adjusts the operation of the play equipment, providing a relaxing environment for the user.

[0419] Terminal handling

[0420] The device (smartphone) provides an interface that allows users to monitor and control the operation status of pet toys in real time. Through this interface, users can set the operation patterns and schedules of the toys and notify their emotional state.

[0421] User operations

[0422] The user configures the system via a smartphone and controls the start and stop of the play equipment. When the user's emotional state changes, the smartphone transmits this information to the server, which then uses an emotion engine to adjust the operation of the play equipment as needed.

[0423] Explanation of program processing

[0424] The server uses hardware such as sensors that detect the pet's position and movements, and a central control unit (server device) that collects and processes this data. Its software includes the OpenCV image processing library, the Requests Python library for making HTTP requests, the Flask web framework, and libraries for recognizing emotions (such as EmotionEngine). Using this software, the server collects data on the pet's position and performs data calculations to appropriately control the play equipment. It also uses the emotion engine to analyze the user's facial expressions and voice data, adjusting the behavior of the play equipment based on the results to provide a play environment that responds to the user's emotional state.

[0425] Specific examples

[0426] While the pet is playing, the user can hold a smartphone and monitor the play equipment's operation in real time.

[0427] If the user is feeling stressed, their emotions are recognized through the smartphone's camera or microphone, and the server changes the play equipment's movement patterns to make them more relaxing.

[0428] When a user is spending time in a store with their pet, the atmosphere of the store is improved by showing other customers that the pet is enjoying a comfortable stay.

[0429] Prompt Sentence Examples

[0430] "Generate code for a smartphone app that works with an automated pet play system in a brick-and-mortar store and analyzes the user's emotions to adjust the pet's play patterns. The app should have different behavior patterns (play, idle, calm) depending on the user's emotional state."

[0431] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0432] Step 1:

[0433] The server initializes the automatic pet playground system. Specifically, it sets the initial position information and obstacle list for the pet in the play area. This initialization allows the system to accurately determine the pet's position and prepare for obstacle avoidance. The input is the initial position information and obstacle list, and the output is the status of the initialization completion.

[0434] Step 2:

[0435] The server receives sensor data and detects the pet's location and behavior in real time. The input is data sent from the sensor, and the output is information about the pet's location and behavior. The server analyzes the sensor data to determine the pet's current location. It also analyzes the behavior information to identify the pet's interests and behavior patterns.

[0436] Step 3:

[0437] The device (smartphone) captures the user's facial expressions and voice through the smartphone's camera and microphone to recognize the user's emotions. The input is the camera image or microphone audio, and the output is the emotion recognition results. The device analyzes the user's emotions using an image processing library (OpenCV) or an emotion recognition library (EmotionEngine), and sends the results to the server.

[0438] Step 4:

[0439] The server analyzes the user's emotional state received through the emotion engine and adjusts the movement pattern of the pet toy. The input is the user's emotional data, and the output is the adjusted movement pattern of the toy. For example, if the user is feeling stressed, the movement pattern will be changed to a slower one that helps the user relax.

[0440] Step 5:

[0441] The server uses artificial intelligence to generate patterns of movement and sounds for the play equipment that will interest the pet. The input is the pet's position information and detected movement data, and the output is the movement pattern of the play equipment. Based on the pet's movement pattern, the server determines movements that will likely interest the pet and the direction in which the play equipment will move.

[0442] Step 6:

[0443] The terminal displays the operating status of the play equipment in real time, allowing the user to check the current system status. The input is the operating status data of the play equipment sent from the server, and the output is the display screen of the smartphone. The user can view this information and judge whether the operation of the play equipment is appropriate.

[0444] Step 7:

[0445] Users can adjust the operation patterns and schedules of play equipment through a terminal. The input is the user's instruction, and the output is the adjusted operation patterns and schedule information of the play equipment. For example, if a user wants their pet to perform a specific movement, they operate the terminal to instruct the server to perform that movement, and the server then executes it.

[0446] Step 8:

[0447] The server uses the exercise management means to monitor the pet's exercise status and restarts the play equipment as necessary. The input is the pet's exercise data and the output is a command to start the play equipment. If it is determined that the pet is not getting enough exercise, the play equipment can be operated again to increase the pet's exercise.

[0448] Step 9:

[0449] Finally, the server safely stops the operation of the play equipment. The input is a stop command, and the output is a stop confirmation status. When the user wants to end play, they send a stop command from their terminal to the server, and the server safely stops the play equipment. The server also periodically monitors the status of the play equipment, and safely stops it if an abnormality occurs.

[0450] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0451] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0452] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0453] [Second embodiment]

[0454] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0455] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0456] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0457] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0458] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0459] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0460] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0461] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0462] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0463] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0464] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0465] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0466] The present invention relates to an automatic pet play equipment system for relieving lack of exercise for pets, and is specifically embodied as follows.

[0467] System Overview

[0468] The server manages the overall operation of the automatic pet play equipment system (hereinafter referred to as "Smart Mouse"). Smart Mouse is a pet device that utilizes AI technology to encourage pets to exercise while playing independently. It uses sensors to detect the pet's position and movements in real time, and the control means adjusts the movement of the play equipment appropriately. In addition, the artificial intelligence means generates movements and sounds that attract the pet's interest, and the exercise management means manages a schedule to ensure the pet gets enough exercise.

[0469] A natural language description of what the program does

[0470] Server Processing

[0471] 1. The server first instantiates the smart mouse and performs the initial configuration, which includes setting the initial position of the smart mouse and a list of obstacles.

[0472] 2. The server calls the activate method of the smart mouse to issue a start instruction, and monitors that the smart mouse has started operating.

[0473] 3. The server calls the run method of the smart mouse and controls the operation of the smart mouse while detecting the pet's position and movements. Specifically, it collects sensor data, adjusts its movements according to the pet's position, and monitors the pet's exercise status.

[0474] 4. The server calls the smart mouse's deactivate method to stop it from operating.

[0475] Terminal handling

[0476] 1. The terminal provides an interface that displays the initial position of the smart mouse and information on obstacles, allowing the user to check the current system status.

[0477] 2. The device detects the location of obstacles and inputs them so that the smart mouse can avoid them. It also updates and displays the location of the smart mouse in real time as it moves.

[0478] 3. When the smart mouse detects a pet, the device will display and notify the pet by displaying a corresponding reaction (for example, playing a sound or escaping).

[0479] User operations

[0480] 1. The user installs the smart mouse, turns it on through the terminal, and starts the smart mouse program.

[0481] 2. The user can check on the display screen of the device whether the smart mouse is working properly, so that if a problem occurs, they can take action immediately.

[0482] 3. The user observes how the Smart Mouse responds to their pet and adjusts settings as needed, which may include changing the location of obstacles or adjusting the Smart Mouse's movement patterns.

[0483] 4. Users can set a schedule for the smart mouse so that their pet gets enough exercise and maintain their pet's health.

[0484] Specific examples

[0485] Example 1: Server operation

[0486] After creating an instance of the smart mouse, the server calls the activate method to start the smart mouse and moves it appropriately while collecting the pet's location information. Through cloud-based sensor data analysis, the server generates movements that interest the pet in real time.

[0487] Example 2: Displaying a terminal

[0488] The terminal displays the movement of the smart mouse, notifying the user of the current system status in real time. It also has the function of detecting obstacles and displaying the action to avoid them.

[0489] Example 3: User operation

[0490] The user can start the smart mouse from the terminal and watch the pet start playing. If the pet is not getting enough exercise, the user can start the smart mouse again through the terminal to ensure that the pet gets enough play time.

[0491] The above is a specific embodiment of the automatic pet play equipment system according to the present invention. This system can effectively alleviate the lack of exercise for pets and contribute to maintaining their health.

[0492] The processing flow will be explained below.

[0493] Server Processing

[0494] Step 1:

[0495] The server creates an instance of the smart mouse, and during this initialization process it sets the initial position of the smart mouse and empties the obstacle list.

[0496] Step 2:

[0497] The server invokes the activate method of the smart mouse to activate it, which causes the smart mouse to transition from a standby state to an active state.

[0498] Step 3:

[0499] The server calls the run method to control the operation of the smart mouse, which includes the process of collecting sensor data and pet location and movement information.

[0500] Step 4:

[0501] The server determines the smart mouse's next move based on data from the sensors, performs calculations to avoid obstacles, and generates optimal movement patterns to attract pets.

[0502] Step 5:

[0503] The server generates sounds and movements for the smart mouse to react to the pet. For example, when the pet approaches within a certain range, the smart mouse plays a sound and performs a predictive action.

[0504] Step 6:

[0505] The server periodically monitors the smart mouse's exercise status, and if the pet is not getting enough exercise, it issues an instruction to restart the operation.

[0506] Step 7:

[0507] The server calls the deactivate method of the smart mouse to stop the operation of the smart mouse, thereby controlling the smart mouse to stop in a safe place.

[0508] Terminal handling

[0509] Step 1:

[0510] The terminal displays the initial position of the smart mouse and various setting information on the initial screen of the system, where the user can check the current status of the system.

[0511] Step 2:

[0512] The terminal provides an interface for the user to set the location of the obstacle, which is then sent to the server and added to the obstacle list of the smart mouse.

[0513] Step 3:

[0514] The terminal updates and displays the current location of the smart mouse in real time based on the sensor data, allowing the user to check the operating status of the smart mouse.

[0515] Step 4:

[0516] When the smart mouse detects the pet's location, the terminal notifies the user of the sound and movement that is being made, allowing the user to check whether the system is operating normally.

[0517] Step 5:

[0518] The device adjusts the smart mouse's movement patterns and schedule based on user input, for example, scheduling additional play time if the mouse is not getting enough exercise.

[0519] User operations

[0520] Step 1:

[0521] The user places the smart mouse in the cat's play area and turns it on using the terminal. As an initial setting, the user turns on the smart mouse and checks the settings on the terminal.

[0522] Step 2:

[0523] Users can monitor the operation of the smart mouse on the device screen, check for abnormalities and obstacle detection, and be prepared to deal with any problems that may arise.

[0524] Step 3:

[0525] The user observes how their pet reacts to the smart mouse, and if the pet shows no interest, they can change the behavior pattern from the terminal.

[0526] Step 4:

[0527] Users can adjust the smart mouse's operating schedule as needed to ensure efficient exercise for their pets, for example, by setting a schedule to activate the smart mouse at a specific time of day.

[0528] Step 5:

[0529] After use, the user turns off the power of the smart mouse, shuts down the system from the terminal, and finally stores the smart mouse in a safe place.

[0530] Example 1

[0531] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0532] Conventional automatic pet play equipment systems often fail to adequately alleviate pets' lack of exercise, limiting their effectiveness. Furthermore, they require users to frequently operate the system manually, placing a heavy burden on the user. Furthermore, they lack the ingenuity to continuously attract pets' interest, and pets often become bored quickly.

[0533] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0534] In this invention, the server includes a sensor means for detecting the position and movement of the pet, a control means for moving the play equipment based on the detected position and movement of the pet, an artificial intelligence means for generating a movement pattern of the play equipment, an obstacle avoidance means for detecting obstacles and performing avoidance actions, an exercise management means for grasping the exercise status and periodically activating the system, a data analysis means for performing cloud-based data analysis, an interface means for operating and monitoring the system from a user terminal, and a schedule management means for setting and managing the pet's exercise schedule. This makes it possible to effectively manage the pet's exercise, reduce the burden on the user, and continuously attract the pet's interest.

[0535] An "automated pet play equipment system" is an automated play equipment system designed to help pets get enough exercise and have fun playing.

[0536] A "sensor" is a device that detects the position and movements of a pet, and provides information to control the movement of play equipment based on that data.

[0537] The "control means" is a mechanism that appropriately adjusts the movement of the play equipment based on data obtained from the sensor, encouraging the pet to exercise.

[0538] "Artificial intelligence means" refers to algorithms and technologies for analyzing pet behavior data and generating optimal movements and sounds for play equipment.

[0539] The "obstacle avoidance means" is a function that allows the play equipment to detect obstacles while moving and take appropriate action to avoid them.

[0540] The "exercise management means" is a system for grasping the pet's exercise status and periodically activating the play equipment as necessary.

[0541] The "data analysis means" is a cloud-based technology that analyzes pet behavior data and optimizes the movement of play equipment.

[0542] The "interface means" is a device that provides an operation screen for the user to operate and monitor the system.

[0543] The "schedule management means" is a function for efficiently managing the pet's exercise time and activating the play equipment at the appropriate time.

[0544] The present invention relates to an automatic pet play equipment system for relieving pets' lack of exercise. This system detects the pet's position and movements and automatically controls the play equipment to encourage appropriate exercise. Specifically, the system includes a sensor that detects the pet's position and movements, a control means that moves the play equipment based on the detected data, an artificial intelligence means that generates the movement and sound of the play equipment, an obstacle avoidance means that detects and avoids obstacles, and an exercise management means that monitors the exercise status and is activated periodically.

[0545] Server Roles

[0546] The server first creates an instance of a pet toy called a smart mouse and performs initial setup. This setup includes setting the smart mouse's initial position and a list of obstacles. The server calls the smart mouse's activate method to start the smart mouse. Next, it uses the run method to collect sensor data and control the smart mouse's operation based on the pet's position and movement. It then calls the deactivate method to stop the smart mouse. Specifically, it uses cloud-based data analysis means to analyze the pet's movements in real time and generate optimal movement for the toy.

[0547] Device Role

[0548] The terminal provides an interface that displays the initial position of the smart mouse and obstacle information, allowing users to check the current status of the system in real time. The terminal also updates and displays the position of the smart mouse in real time based on sensor data. Furthermore, if a pet comes into contact with the smart mouse, the terminal notifies the user of the reaction. For example, when a pet approaches the smart mouse, a notification will be displayed saying, "Your pet has started playing."

[0549] User operations

[0550] First, the user installs the smart mouse, turns it on through the terminal, and starts the smart mouse program. Next, the user checks whether the smart mouse is working properly on the terminal display screen. If a problem occurs, the user can reconfigure the obstacle location and the smart mouse's movement through the terminal. In addition, the user can set an exercise schedule for the smart mouse to efficiently manage their pet's exercise time.

[0551] Specific examples

[0552] Example 1: Server installation

[0553] The server creates an instance of the smart mouse and activates it using the activate method. It then collects the pet's location information and performs cloud-based data analysis to generate appropriate play equipment movements.

[0554] Example 2: Using a terminal

[0555] The terminal displays the movement of the smart mouse, notifying the user of the current system status in real time. It also has the function of detecting obstacles and displaying the action to avoid them.

[0556] Example 3: User operation

[0557] The user activates the smart mouse from the device and observes how the pet begins to play. If the pet is not getting enough exercise, the user activates the smart mouse again to ensure that the pet gets adequate playtime.

[0558] Example prompts for generative AI models

[0559] "Please explain what the following system does. Explain in detail how an automated pet toy operates according to instructions from a server, a device, and a user. Include examples of specific hardware and software components."

[0560] In this way, the system of the present invention can effectively alleviate the lack of exercise required by pets, reduce the burden on users, and continuously attract the interest of pets.

[0561] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0562] The flow of this system's program processing

[0563] Step 1:

[0564] Initialization and Instantiation

[0565] The server creates an instance of the smart mouse and sets its initial position and obstacle list. Specifically, it calls the initialize_smart_mouse() method, and inputs the initial X and Y coordinates of the smart mouse and the position data of the obstacles. Based on this data, it sets the smart mouse in a state where it can start operating. As an output, the smart mouse is placed in its initial position and the obstacle list is loaded into the system.

[0566] Step 2:

[0567] Starting the Smart Mouse

[0568] The server invokes the activate method of the smart mouse to activate it. The activate command is given as input, and the system transitions the smart mouse's sensor to an active state. As an output, the smart mouse starts operating and begins collecting sensor data.

[0569] Step 3:

[0570] Sensor data collection and analysis

[0571] The server collects real-time location and movement data from the smart mouse's sensor. The sensor data is periodically sent as input, and a cloud-based data analysis tool operates based on this data to analyze the pet's location and movement. The output is an analysis result of the pet's current location and movement.

[0572] Step 4:

[0573] Controlling movement according to pet behavior

[0574] The server controls the operation of the smart mouse based on the analysis results. The analyzed pet's position data and predicted movement are given as input, and the artificial intelligence means operates to generate the movement pattern of the play equipment. As output, the next movement pattern of the smart mouse is calculated and the instruction is sent to the smart mouse.

[0575] Step 5:

[0576] Obstacle Avoidance

[0577] The server performs processing to avoid obstacles when the smart mouse moves. Data from the obstacle sensor is used as input to operate the obstacle avoidance means. As output, a new movement pattern to avoid the obstacle is generated and sent to the smart mouse.

[0578] Step 6:

[0579] Sending data to the user interface

[0580] The server sends sensor data and analysis results to the user's device, allowing the user to monitor the system status. The latest data on the server is used as input, and data displayed in real time on the user's device is sent as output.

[0581] Step 7:

[0582] Resetting by user operation

[0583] The user reconfigures the smart mouse's operation and obstacle positions through the terminal. The user's operation instructions are given as input, and the system accepts them and performs new settings. As output, the smart mouse's operation parameters and obstacle list are updated.

[0584] Step 8:

[0585] Managing your exercise schedule

[0586] The user sets an exercise schedule for the smart mouse to maintain the health of their pet. The exercise time and frequency specified by the user are used as input, and the schedule management means reflects this in the system. As output, the smart mouse will automatically start and stop based on the set schedule.

[0587] Step 9:

[0588] Stopping Smart Mouse

[0589] When the exercise session ends, the server calls the deactivate method of the smart mouse to stop the smart mouse operation. The command to end the exercise session is given as input, and the system completely stops the smart mouse operation. As an output, the smart mouse is safely stopped.

[0590] Through the above specific processing steps, the automatic pet play equipment system can effectively alleviate the lack of exercise for pets and reduce the user's hassle.

[0591] (Application example 1)

[0592] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0593] Automatic play equipment systems play an important role in helping pets get enough exercise, but conventional systems have difficulty monitoring a pet's exercise status in real time and providing appropriate exercise patterns based on that data. Furthermore, they lack an interface that allows users to easily check the system status and the pet's response, making it difficult to effectively manage a pet's exercise plan.

[0594] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0595] In this invention, the server includes a sensor that detects the position and movement of the pet, a control means that moves the play equipment based on the detected position and movement of the pet, an artificial intelligence means that generates a movement pattern for the play equipment, an obstacle avoidance means that detects obstacles and takes action to avoid them, an exercise management means that grasps the exercise status and activates periodically, a data analysis means that monitors the pet's movements in real time and generates recommended play equipment and exercise patterns, a recording means that saves the pet's exercise status and uses it for future exercise plans, and a display means that allows the user to check the system status and the pet's reaction through an interface. This makes it possible to eliminate a lack of exercise for pets and maintain their health.

[0596] A "sensor for detecting the position and movement of a pet" is a device used to detect the current position and movement of a pet in real time.

[0597] The "control means for moving the play equipment based on the detected position and movement of the pet" is a control system for appropriately moving the play equipment based on information from the sensor.

[0598] "Artificial intelligence means for generating movement patterns for play equipment" means means using AI technology to generate movement or movement patterns that attract pets.

[0599] The "obstacle avoidance means for detecting an obstacle and taking action to avoid it" is a system for detecting an obstacle so that the play equipment does not collide with it and taking action to avoid it.

[0600] The "exercise management means for grasping the exercise status and activating it periodically" is a management system for monitoring the exercise status of a pet and activating the automatic play equipment periodically.

[0601] "Data analysis means for monitoring pet movements in real time and generating recommended play equipment and exercise patterns" refers to a means for analyzing pet movements in real time and generating optimal play equipment and exercise patterns based on that data.

[0602] "Means for recording the exercise status of a pet and using it for future exercise planning" refers to a means for storing the exercise data of a pet and creating future exercise plans based on that information.

[0603] "Display means that allows the user to check the system status and the pet's reaction through an interface" refers to a display device and an interface that allows the user to check the current status of the system and the behavior of the pet.

[0604] This invention is an automatic pet play equipment system that effectively eliminates the lack of exercise for pets and contributes to maintaining their health. This system is composed of three entities: a server, a terminal, and a user, each of which plays a specific role.

[0605] Server Processing

[0606] The server creates an instance of the smart mouse and performs initial settings within the pet shop. It sets the initial position of the smart mouse and a list of obstacles, and after creating the instance, calls the smart mouse's activate method to issue an activation command. The server uses sensors to collect data on the pet's position and movement, and appropriately controls the smart mouse's movement based on that data. Furthermore, the server uses AI technology to analyze the pet's movement patterns and generate movements and sounds that interest the pet. Specifically, it analyzes the data using AI modules such as TensorFlow and Keras.

[0607] Terminal handling

[0608] The terminal monitors the status of the smart mouse and the pet's reaction in real time through a user interface. It displays the initial position and obstacle information, allowing the user to check the current status of the system. The terminal communicates with the server via Bluetooth or Wi-Fi to receive sensor data and analysis results. The terminal also stores the pet's exercise status, providing a means of recording it for use in future exercise planning.

[0609] User operations

[0610] Users simply activate the smart mouse through their device and watch their pet begin to play. If their pet is not getting enough exercise, they can simply reactivate the smart mouse through their device to ensure their pet gets the appropriate playtime. They can also monitor their pet's behavior through the device's display function and adjust play equipment and settings as needed.

[0611] Specific application examples and prompt sentence examples

[0612] A specific application example is a situation where a pet owner tries out toys for their pet in a pet shop. The user launches the smartphone app and moves the smart mouse together with their pet. The app analyzes the pet's movements in real time and generates recommended toys and exercise patterns based on that data. This allows the user to more effectively alleviate their pet's lack of exercise.

[0613] Example prompt sentence:

[0614] (Setting) Check the initial position and set the list of obstacles.

[0615] (Start) Start the smart mouse and check your pet's movements.

[0616] (Analysis) Analyze your pet's position in real time and generate interesting movements.

[0617] (Stop) Stop the Smart Mouse if necessary.

[0618] This system will help pets get enough exercise and effectively maintain their health.

[0619] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0620] Step 1:

[0621] The server creates an instance of the smart mouse and initializes the location information of the pet. The input includes the pet's initial location data and a list of obstacles. Based on this data, it calculates a route to avoid obstacles and creates the initial location data and a movement route as output.

[0622] Step 2:

[0623] The server invokes the activate method of the smart mouse to start the smart mouse. The server then monitors whether the smart mouse starts operating normally. The input includes the initial setting information of the smart mouse. The output generates a log that confirms that the smart mouse has started operating.

[0624] Step 3:

[0625] The server calls the smart mouse's run method and uses sensors to collect pet position and movement data in real time. The input data is position and movement data from the sensors, as well as obstacle information. The server analyzes the data and generates movements of the play equipment and interesting movements based on the pet's movements. The output is the movement pattern of the play equipment and movement instructions.

[0626] Step 4:

[0627] The terminal receives the sensor data and analysis results from the server and displays them in real time through the user interface. The input data is the sensor data from the server and the operation information of the play equipment. The terminal displays this visually, allowing the user to check the current status of the system. The output is a visual status display on the user interface.

[0628] Step 5:

[0629] The user monitors the pet's exercise status through the device and adjusts the settings as needed. Input includes the information displayed on the device and the user's operation instructions. Based on this, the settings and movement patterns of the play equipment are adjusted. The updated settings and the applied movement patterns are generated as output.

[0630] Step 6:

[0631] The server periodically records the pet's exercise status data and stores it for use in future exercise planning. The input data is exercise status data collected in real time. Based on this, the data is stored in a recording device and can be retrieved when needed. A recorded data file is generated as an output.

[0632] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0633] The present invention relates to an automatic pet play equipment system that combines an emotion engine that recognizes the user's emotions, and is specifically implemented as follows.

[0634] System Overview

[0635] The automatic pet play equipment system of the present invention (hereinafter referred to as "smart mouse") is designed to alleviate the lack of exercise for pets and integrates multiple functions. Specifically, it includes a sensor to detect the position and movement of the pet, a control means to move the play equipment, an artificial intelligence means to generate the movement pattern of the play equipment, an obstacle avoidance means to detect and avoid obstacles, an exercise management means to manage the exercise status and periodically activate the play equipment, and an emotion engine to recognize the user's emotions.

[0636] A natural language description of what the program does

[0637] Server Processing

[0638] 1. The server creates an instance of the smart mouse and performs the initial configuration, which includes setting the initial position of the smart mouse and a list of obstacles.

[0639] 2. The server invokes the activate method of the smart mouse to activate the smart mouse.

[0640] 3. The server calls the run method, detects the pet's position and movement based on sensor data, and moves the smart mouse appropriately.

[0641] 4. The server uses artificial intelligence means to generate movements and sounds that will attract the pet's attention.

[0642] 5. The server analyzes the user's emotional state through the emotion engine, collecting the user's voice and facial expression data and evaluating the status.

[0643] 6. The server adjusts the pet's play patterns and the behavior of the play equipment based on the results of the emotion engine. For example, if the user is feeling stressed, it selects a behavior pattern that will relax both the pet and the user.

[0644] 7. The server monitors the pet's exercise status using the exercise management means and restarts the smart mouse if necessary.

[0645] 8. Finally, the server calls the smart mouse's deactivate method to safely stop the smart mouse's operation.

[0646] Terminal handling

[0647] 1. The terminal provides an interface that displays the initial position and obstacle information on the initial screen of the smart mouse.

[0648] 2. The device accepts input from the user to set the location of the obstacle and sends it to the server.

[0649] 3. The terminal updates the position and operating status of the smart mouse in real time and displays it to the user.

[0650] 4. If the user's emotional state changes, the device notifies the server of the change.

[0651] 5. The terminal can adjust the operation patterns and schedules of the play equipment based on instructions from the user.

[0652] User operations

[0653] 1. The user places the smart mouse in the pet's play area and turns it on through the terminal.

[0654] 2. After confirming the initial settings, the user can monitor the system status through the terminal, set the obstacle location as needed, and adjust the operation of the smart mouse.

[0655] 3. After the smart mouse starts working, the user can observe the pet's reaction and change the operation settings via the terminal.

[0656] 4. If the user's emotional state changes, the user notifies the server via the device, which then uses the emotion engine to adjust the server's behavior.

[0657] 5. After finishing playing, the user should turn off the smart mouse and shut down the system from the terminal. Then store the smart mouse in a safe place.

[0658] Specific examples

[0659] Example 1: Server operation

[0660] After creating an instance of the smart mouse, the server calls the activate method to start the smart mouse and moves it appropriately while collecting information on the pet's location.The emotion engine is used to analyze the user's emotional state, and if the user's stress level is high, the smart mouse's movement pattern is changed to make the mouse move in a way that helps the user relax.

[0661] Example 2: Displaying a terminal

[0662] The terminal displays the operation status of the smart mouse in real time, allowing the user to check the current system status, and also displays the user's emotional state fluctuations and transmits data to the server accordingly.

[0663] Example 3: User operation

[0664] The user installs the smart mouse, turns it on using a terminal, and checks its operation. If the user's emotional state changes, the terminal transmits that information, and the smart mouse adjusts its behavior based on that information. The user also observes their pet, adjusts further settings as needed, and finally shuts down the system.

[0665] The above is a specific embodiment of an automatic pet play equipment system incorporating an emotion engine according to the present invention. This system not only helps pets get more exercise but also provides play that responds to the user's emotional state, ensuring the happiness of both the pet and the user.

[0666] The processing flow will be explained below.

[0667] Server Processing

[0668] Step 1:

[0669] The server creates an instance of the smart mouse, which initializes the initial position of the smart mouse and the list of obstacles.

[0670] Step 2:

[0671] The server invokes the activate method of the smart mouse to activate the smart mouse, which causes the smart mouse to start operating.

[0672] Step 3:

[0673] The server calls the run method, receives data from the sensor, and detects the pet's position and movement in real time. It controls the movement of the smart mouse based on the acquired data.

[0674] Step 4:

[0675] The server analyzes the sensor data and moves the smart mouse according to the pet's current position and movement. It also detects the location of obstacles and takes action to avoid them.

[0676] Step 5:

[0677] The server uses artificial intelligence to generate movements and sounds that interest the pet, and designs and executes optimal reactions to the pet's movements.

[0678] Step 6:

[0679] The server analyzes the user's emotional state through an emotion engine, extracting emotional data from the user's voice and facial expressions, and uses that data to determine the user's stress level and happiness.

[0680] Step 7:

[0681] The server adjusts the behavior of the smart mouse based on the user's emotional state, for example, if the user is in a relaxed state, the server will slow down the behavior of the smart mouse to maintain a relaxed mood.

[0682] Step 8:

[0683] The server monitors the pet's exercise status using the exercise management means, periodically activates the smart mouse, and if the pet is not getting enough exercise, activates the smart mouse again to encourage more exercise.

[0684] Step 9:

[0685] The server calls the deactivate method of the smart mouse to stop the smart mouse from operating, and in the process safely places the smart mouse in a stopped position.

[0686] Terminal handling

[0687] Step 1:

[0688] The terminal displays the initial position and setting information on the initial screen of the smart mouse, allowing the user to check the current status of the system.

[0689] Step 2:

[0690] The terminal provides an interface for the user to input the location of the obstacle, which is then sent to the server and added to the obstacle list of the smart mouse.

[0691] Step 3:

[0692] The terminal updates and displays the current location of the smart mouse based on real-time data from the sensor, allowing the user to monitor the movement of the smart mouse in real time.

[0693] Step 4:

[0694] When a user inputs emotional information or provides voice or facial expression data, the device sends it to the server, which then analyzes the data using an emotion engine.

[0695] Step 5:

[0696] The device will detect the pet's location and display a notification when the smart mouse performs a specific action, allowing the user to check whether the system is working properly.

[0697] Step 6:

[0698] The device can adjust the smart mouse's motion patterns and schedules based on user instructions, such as setting up additional play time or selecting special motion patterns.

[0699] User operations

[0700] Step 1:

[0701] The user places the smart mouse in the cat's play area and turns it on using the terminal. As an initial setting, the user turns on the smart mouse and checks the settings on the terminal.

[0702] Step 2:

[0703] The user checks the location of obstacles and the status of the system through the terminal, changes the settings as necessary, and verifies that the system is operating normally.

[0704] Step 3:

[0705] After the smart mouse starts working, users can observe their pet's behavior and make additional settings and adjustments through the device, for example, increasing the speed if the movement is slow.

[0706] Step 4:

[0707] When a user provides emotion information, the data is input through the terminal, and the server uses the emotion engine to select an appropriate behavior pattern.

[0708] Step 5:

[0709] After finishing playing, the user turns off the smart mouse and shuts down the system from the terminal, and finally puts the smart mouse in a safe place.

[0710] Example 2

[0711] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0712] In today's living environment, lack of exercise for pets and fluctuations in users' emotions are becoming problems. It is particularly difficult for busy users to manage their pets' exercise and provide them with play. Furthermore, existing automatic pet play equipment systems are unable to provide play that responds to the user's emotional state, making it difficult to provide an environment that satisfies both the user and the pet.

[0713] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a sensor means for detecting the position and movement of the pet, a control means for moving the play equipment based on the detected position and movement of the pet, an artificial intelligence means for generating a movement pattern of the play equipment, an obstacle avoidance means for detecting obstacles and performing an avoidance operation, an exercise management means for grasping the exercise status and periodically activating the same, an emotion recognition means for analyzing the emotional state of the user, and an emotion response means for adjusting the operation of the play equipment based on the analyzed emotional state. This makes it possible to alleviate the lack of exercise for the pet and provide play that takes into account the emotional state of the user.

[0714] An "automatic pet play system" is a system that includes a device for playing with a pet that operates automatically to encourage exercise for the pet.

[0715] "Sensor means" refers to devices or technologies for collecting information from the surrounding environment or objects, and specifically refers to devices that detect the position and movements of a pet.

[0716] "Control Means" refers to the devices or technology used to manage and control the operation of a system or device, specifically a device that moves play equipment based on the detected position and movement of a pet.

[0717] "Artificial intelligence means" refers to technology that uses data analysis and machine learning to make autonomous decisions and take action, and specifically refers to devices and software for generating movement patterns for playground equipment.

[0718] "Obstacle avoidance means" refers to devices or technologies that detect surrounding obstacles and take action to avoid them.

[0719] "Exercise management means" refers to devices and technologies for grasping the level and status of exercise and for managing and adjusting it, and is a device that grasps the pet's exercise status and activates play equipment periodically.

[0720] "Emotion recognition means" refers to devices and technologies for analyzing the user's emotional state, specifically devices that analyze voice and facial expressions.

[0721] "Emotion response means" refers to a device or technology that responds or behaves appropriately based on the analyzed emotional state, and specifically refers to a device that adjusts the operation of play equipment.

[0722] The present invention relates to an automatic pet play equipment system that combines an emotion engine that recognizes the user's emotions, and is specifically implemented as follows.

[0723] System Overview

[0724] The automatic pet play equipment system of the present invention (hereinafter referred to as "smart mouse") is designed to alleviate the lack of exercise for pets and integrates multiple functions. Specifically, it includes a sensor means for detecting the position and movement of the pet, a control means for moving the play equipment, an artificial intelligence means for generating the movement pattern of the play equipment, an obstacle avoidance means for detecting and avoiding obstacles, an exercise management means for grasping the exercise status and periodically activating the play equipment, and an emotion recognition means and an emotion response means for analyzing the user's emotional state and adjusting the operation of the play equipment.

[0725] Server Processing

[0726] The server creates an instance of the smart mouse and performs initial settings. These initial settings include the smart mouse's initial position and a list of obstacles. The server calls the smart mouse's activate method to start the smart mouse. The server detects the pet's position and movement based on sensor data and moves the smart mouse appropriately. The sensors used are cameras and motion sensors, and data is acquired in real time.

[0727] Furthermore, the server uses artificial intelligence means to generate movements and sounds that will attract the pet's attention. For example, TensorFlow and PyTorch are used as AI platforms. The server analyzes the user's emotional state through emotion recognition means (e.g., natural language processing software for voice recognition and image analysis software for facial expression recognition) and selects an appropriate movement pattern based on the emotion response means. Based on this information, if the user feels stressed, the server changes the movement pattern of the smart mouse to provide relaxing movements. MongoDB and other database technologies are used to store and analyze movement data, and the server restarts the smart mouse if the pet is not getting enough exercise.

[0728] Terminal handling

[0729] The device provides an interface that displays the initial position and obstacle information on the smart mouse's initial screen. For example, the interface can be built using frameworks such as React or Vue.js. The location information of obstacles set by the user is sent to the server, which displays the smart mouse's position and operating status in real time. The device manages the operation of the smart mouse using real-time communication technologies such as WebSocket. The device also has a notification system (such as Firebase Cloud Messaging) that notifies the server when the user's emotional state changes.

[0730] User operations

[0731] The user places the smart mouse in the pet's play area and turns on the device. The user uses the device to check the initial settings and monitor the system status. The device can be used to set the location of obstacles and adjust the smart mouse's behavior. If the user's emotional state changes during play, it is communicated through the device, and the server analyzes it and takes appropriate action. Finally, after finishing play, the smart mouse is shut down and stored in a safe place.

[0732] Specific examples

[0733] Example 1: Server operation

[0734] After creating an instance of the smart mouse, the server calls the activate method to start the smart mouse and makes it operate appropriately while collecting the pet's location information.The emotion engine is used to analyze the user's emotional state, and if the stress level is high, the smart mouse's movement pattern is changed to make it operate in a relaxing manner.

[0735] Example 2: Displaying a terminal

[0736] The terminal displays the operation status of the smart mouse in real time, allowing the user to check the current system status, and also displays the user's emotional state fluctuations and transmits data to the server accordingly.

[0737] Example 3: User operation

[0738] The user installs the smart mouse, turns it on using a terminal, and checks its operation. If the user's emotional state changes, the terminal transmits that information, and the smart mouse adjusts its behavior based on that information. The user observes their pet, changes settings as needed, and finally shuts down the system.

[0739] Prompt Sentence Examples

[0740] "Please explain what behavior pattern should be selected in an automatic pet play system when the user's emotional state changes."

[0741] This system not only helps pets overcome lack of exercise but also provides play that responds to the user's emotional state, ensuring the happiness of both the pet and the user.

[0742] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0743] Step 1:

[0744] The server creates an instance of the smart mouse and performs the initial settings.

[0745] Input: Smart Mouse initial setting information (initial position, obstacle list, etc.)

[0746] Output: Smart Mouse initial settings completed

[0747] Specific operation: The server creates a new smart mouse instance and sets the initial position and obstacle list specified in the program code. This initial information is often obtained from a database.

[0748] Step 2:

[0749] The server starts the smart mouse.

[0750] Input: Start command

[0751] Output: Smart Mouse activated

[0752] Specific operation: The server calls the activate method of the smart mouse to activate the smart mouse's sensors and motors. This operation turns on the smart mouse's LED and starts operation.

[0753] Step 3:

[0754] The server detects the pet's position and movements based on sensor data and moves the smart mouse appropriately.

[0755] Input: Sensor data (location information, motion information)

[0756] Output: Smart Mouse movement command

[0757] Specific operation: The server analyzes data obtained from the infrared sensor and camera installed in the smart mouse to identify the pet's current location and movement. Based on the analysis results, it calculates the direction and distance the smart mouse should move and sends a movement command to the smart mouse.

[0758] Step 4:

[0759] The server generates the movements and sounds using artificial intelligence means.

[0760] Input: Pet behavioral patterns and environmental data

[0761] Output: Generated movements and sounds

[0762] How it works: The server uses AI frameworks such as TensorFlow and PyTorch to analyze data on your pet's past behavior and current environment, and based on this, generates new movements and sounds that will attract your pet's attention and sends them to the smart mouse.

[0763] Step 5:

[0764] The server analyzes the user's emotional state through emotion recognition means.

[0765] Input: User's voice data, facial expression data

[0766] Output: Parsed emotional state

[0767] Specific operation: The server analyzes the user's voice data using voice recognition software (using natural language processing) and facial expression data using image recognition software. For example, if the user says "I'm happy" or "I'm tired," or if they smile or frown, the server analyzes the data to evaluate their emotional state.

[0768] Step 6:

[0769] The server adjusts the behavior of the play equipment based on the emotion response means.

[0770] Input: Parsed emotional state

[0771] Output: Coordinated movement pattern

[0772] Specific behavior: The server analyzes the user's emotional state and changes the behavior pattern of the smart mouse. For example, if the user is feeling stressed, the smart mouse will be configured to move slowly and provide relaxing sounds.

[0773] Step 7:

[0774] The server uses the exercise management means to monitor the pet's exercise status and restarts the smart mouse if necessary.

[0775] Input: Exercise data

[0776] Output: Restart command

[0777] How it works: The server continuously monitors your pet's past exercise data stored in a database such as MongoDB, assesses whether it is getting enough exercise, and if it is, issues a command to restart the smart mouse to encourage your pet to exercise.

[0778] Step 8:

[0779] The server stops the smart mouse from working.

[0780] Input: Stop command

[0781] Output: Smart Mouse stopped

[0782] Specific operation: The server calls the smart mouse's deactivate method to safely stop the sensors and motors. This turns off the smart mouse's LED and completely stops its operation.

[0783] Step 9:

[0784] The device will display the initial position and obstacle information on the initial screen.

[0785] Input: Initialization information (initial position, obstacle list, etc.)

[0786] Output: Initial screen display

[0787] Specific operation: The device uses JavaScript frameworks such as React and Vue.js to display the initial setting information on the user interface, allowing users to easily check the initial position of the smart mouse and obstacle information.

[0788] Step 10:

[0789] The terminal accepts input from the user and sends it to the server.

[0790] Input: User setting input (obstacle position, operation instructions, etc.)

[0791] Output: Data sent to the server

[0792] Specific operation: The terminal receives the user's input of the obstacle position and the smart mouse's operation instructions in real time and sends them to the server, which then adjusts the smart mouse's operation based on the user's instructions.

[0793] Step 11:

[0794] The terminal updates the position and operating status of the smart mouse and displays it to the user.

[0795] Input: Smart mouse status data (location information, operation information, etc.)

[0796] Output: Real-time display

[0797] Specific operation: The device uses real-time communication technology such as WebSocket to display the current location and operating status of the smart mouse on the user's screen. For example, a smart mouse icon is displayed on a map, updated in real time.

[0798] Step 12:

[0799] The terminal notifies the server of changes in the user's emotional state.

[0800] Input: Emotional state data (feedback from the user)

[0801] Output: Notification data to the server

[0802] Specific operation: The device uses a system (e.g., Firebase Cloud Messaging) to detect changes in the user's emotional state and notify the server, allowing the server to adjust the behavior of the smart mouse according to the user's emotional state.

[0803] Step 13:

[0804] The terminal adjusts the movement pattern of the play equipment based on the user's instructions.

[0805] Input: User instructions (operation patterns, schedule settings, etc.)

[0806] Output: Instruction data to the server

[0807] Specific operation: Based on the user's instructions, the terminal adjusts the operation pattern of the smart mouse and sends the setting information to the server, so that the operation of the smart mouse can be changed according to the user's wishes.

[0808] Step 14:

[0809] The user installs the smart mouse and turns it on through the terminal.

[0810] Input: Power on command, installation location information

[0811] Output: Smart mouse startup status

[0812] Specific operation: The user places the smart mouse in the pet play area and clicks the power button on the device to start the system, which then starts the smart mouse.

[0813] Step 15:

[0814] The user confirms the initial configuration and monitors the system status.

[0815] Input: Initialization information (initial position, obstacle list, etc.)

[0816] Output: System status monitoring information

[0817] Specific operation: The user checks the initial setting information on the terminal, and then monitors the system's operating status. Based on the initial setting information displayed on the terminal, the user checks whether the system is operating normally.

[0818] Step 16:

[0819] The user observes the pet's reactions and changes the settings.

[0820] Input: Pet reaction information, setting change instructions

[0821] Output: New configuration information

[0822] Specific operation: After the smart mouse starts operating, the user can observe the pet's reaction and change the operation settings through the terminal if necessary. For example, if the pet is not interested, the operation pattern can be changed.

[0823] Step 17:

[0824] The user communicates changes in their emotional state through the terminal.

[0825] Input: Emotional state data (user feedback)

[0826] Output: Emotional state notification data

[0827] Specific operation: The user's emotional state (relaxed, stressed, etc.) is communicated to the server through button presses or voice input on the device. The server then adjusts the operation of the smart mouse in real time based on this information.

[0828] Step 18:

[0829] When the user has finished playing, he or she shuts down the smart mouse and stores it in a safe place.

[0830] Input: Stop command

[0831] Output:Smart Mouse stopped state

[0832] Specific operation: When the user finishes playing, he / she presses the stop button on the device to stop the smart mouse safely, and then stores the smart mouse in a safe place.

[0833] (Application example 2)

[0834] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0835] For customers who visit physical stores with their pets, there is a need for systems that allow pets to stay comfortable and safe in the store, improving the customer experience. In particular, there is a need for systems that can recognize customers' emotions in real time and adjust the pet's play environment accordingly. There is also a need for a method that allows customers to easily operate and monitor play equipment via smartphone while ensuring their pet's exercise and safety.

[0836] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0837] In this invention, the server includes a sensor that detects the pet's position and movement, a control means that moves the play equipment based on the detected pet's position and movement, an artificial intelligence means that generates a movement pattern for the play equipment, an obstacle avoidance means that detects obstacles and takes action to avoid them, an exercise management means that grasps the exercise status and periodically activates the control, an emotion recognition means that analyzes the user's facial expression or voice to recognize emotions, a means for adjusting the operation of the play equipment based on the recognized emotional state of the user, and an interface for monitoring and controlling the operation status of the play equipment using a smartphone. This allows pets to spend a comfortable time in the store and provides a play environment that matches the customer's emotional state. Furthermore, customers can easily manage and monitor their pet's play environment via their smartphone.

[0838] An "automatic pet play equipment system" is an integrated system that detects the pet's position and movements and operates play equipment appropriately.

[0839] A "sensor" is a device for detecting the location and movement of a pet.

[0840] "Control means" refers to means for moving the play equipment based on the detected position and movement of the pet.

[0841] "Artificial intelligence means" refers to means that utilizes artificial intelligence to generate movement patterns for play equipment.

[0842] The "obstacle avoidance means" is a means for detecting an obstacle and performing an avoidance operation.

[0843] The "exercise management means" is a means for understanding the pet's exercise status and for periodically activating the play equipment.

[0844] The "emotion recognition means" is a means for analyzing the user's facial expression or voice and recognizing the user's emotion.

[0845] The "interface" is a user interface for monitoring and controlling the operating status of the play equipment using a smartphone.

[0846] A "plaything" is a device for pets to play with, and in the case of the present invention, it has an automatic function.

[0847] A "server" is a central control unit that controls the entire system and processes data.

[0848] The present invention is an automatic pet play equipment system that combines an emotion engine that recognizes the user's emotions, and is specifically implemented as follows.

[0849] The system is composed of sensors that detect the pet's position and movements, a control means that moves the play equipment, an artificial intelligence means that generates the play equipment's movement patterns, an obstacle avoidance means that detects and avoids obstacles, an exercise management means that manages the exercise status and periodically activates the play equipment, an emotion engine that recognizes the user's emotions, and an interface that uses a smartphone to monitor and control the system.

[0850] Server Processing

[0851] The server receives data from sensors that detect the pet's position and movement, and controls the play equipment based on that data. It also uses artificial intelligence to generate movement patterns for the play equipment that will interest the pet. It also analyzes the user's emotional state through an emotion engine, recognizing the user's emotional state by analyzing the user's facial expressions or voice. Based on the results, the server adjusts the operation of the play equipment, providing a relaxing environment for the user.

[0852] Terminal handling

[0853] The device (smartphone) provides an interface that allows users to monitor and control the operation status of pet toys in real time. Through this interface, users can set the operation patterns and schedules of the toys and notify their emotional state.

[0854] User operations

[0855] The user configures the system via a smartphone and controls the start and stop of the play equipment. When the user's emotional state changes, the smartphone transmits this information to the server, which then uses an emotion engine to adjust the operation of the play equipment as needed.

[0856] Explanation of program processing

[0857] The server uses hardware such as sensors that detect the pet's position and movements, and a central control unit (server device) that collects and processes this data. Its software includes the OpenCV image processing library, the Requests Python library for making HTTP requests, the Flask web framework, and libraries for recognizing emotions (such as EmotionEngine). Using this software, the server collects data on the pet's position and performs data calculations to appropriately control the play equipment. It also uses the emotion engine to analyze the user's facial expressions and voice data, adjusting the behavior of the play equipment based on the results to provide a play environment that responds to the user's emotional state.

[0858] Specific examples

[0859] While the pet is playing, the user can hold a smartphone and monitor the play equipment's operation in real time.

[0860] If the user is feeling stressed, their emotions are recognized through the smartphone's camera or microphone, and the server changes the play equipment's movement patterns to make them more relaxing.

[0861] When a user is spending time in a store with their pet, the atmosphere of the store is improved by showing other customers that the pet is enjoying a comfortable stay.

[0862] Prompt Sentence Examples

[0863] "Generate code for a smartphone app that works with an automated pet play system in a brick-and-mortar store and analyzes the user's emotions to adjust the pet's play patterns. The app should have different behavior patterns (play, idle, calm) depending on the user's emotional state."

[0864] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0865] Step 1:

[0866] The server initializes the automatic pet playground system. Specifically, it sets the initial position information and obstacle list for the pet in the play area. This initialization allows the system to accurately determine the pet's position and prepare for obstacle avoidance. The input is the initial position information and obstacle list, and the output is the status of the initialization completion.

[0867] Step 2:

[0868] The server receives sensor data and detects the pet's location and behavior in real time. The input is data sent from the sensor, and the output is information about the pet's location and behavior. The server analyzes the sensor data to determine the pet's current location. It also analyzes the behavior information to identify the pet's interests and behavior patterns.

[0869] Step 3:

[0870] The device (smartphone) captures the user's facial expressions and voice through the smartphone's camera and microphone to recognize the user's emotions. The input is the camera image or microphone audio, and the output is the emotion recognition results. The device analyzes the user's emotions using an image processing library (OpenCV) or an emotion recognition library (EmotionEngine), and sends the results to the server.

[0871] Step 4:

[0872] The server analyzes the user's emotional state received through the emotion engine and adjusts the movement pattern of the pet toy. The input is the user's emotional data, and the output is the adjusted movement pattern of the toy. For example, if the user is feeling stressed, the movement pattern will be changed to a slower one that helps the user relax.

[0873] Step 5:

[0874] The server uses artificial intelligence to generate patterns of movement and sounds for the play equipment that will interest the pet. The input is the pet's position information and detected movement data, and the output is the movement pattern of the play equipment. Based on the pet's movement pattern, the server determines movements that will likely interest the pet and the direction in which the play equipment will move.

[0875] Step 6:

[0876] The terminal displays the operating status of the play equipment in real time, allowing the user to check the current system status. The input is the operating status data of the play equipment sent from the server, and the output is the display screen of the smartphone. The user can view this information and judge whether the operation of the play equipment is appropriate.

[0877] Step 7:

[0878] Users can adjust the operation patterns and schedules of play equipment through a terminal. The input is the user's instruction, and the output is the adjusted operation patterns and schedule information of the play equipment. For example, if a user wants their pet to perform a specific movement, they operate the terminal to instruct the server to perform that movement, and the server then executes it.

[0879] Step 8:

[0880] The server uses the exercise management means to monitor the pet's exercise status and restarts the play equipment as necessary. The input is the pet's exercise data and the output is a command to start the play equipment. If it is determined that the pet is not getting enough exercise, the play equipment can be operated again to increase the pet's exercise.

[0881] Step 9:

[0882] Finally, the server safely stops the operation of the play equipment. The input is a stop command, and the output is a stop confirmation status. When the user wants to end play, they send a stop command from their terminal to the server, and the server safely stops the play equipment. The server also periodically monitors the status of the play equipment, and safely stops it if an abnormality occurs.

[0883] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0884] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0885] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0886] [Third embodiment]

[0887] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0888] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0889] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0890] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0891] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0892] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0893] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0894] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0895] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0896] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0897] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0898] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0899] The present invention relates to an automatic pet play equipment system for relieving lack of exercise for pets, and is specifically embodied as follows.

[0900] System Overview

[0901] The server manages the overall operation of the automatic pet play equipment system (hereinafter referred to as "Smart Mouse"). Smart Mouse is a pet device that utilizes AI technology to encourage pets to exercise while playing independently. It uses sensors to detect the pet's position and movements in real time, and the control means adjusts the movement of the play equipment appropriately. In addition, the artificial intelligence means generates movements and sounds that attract the pet's interest, and the exercise management means manages a schedule to ensure the pet gets enough exercise.

[0902] A natural language description of what the program does

[0903] Server Processing

[0904] 1. The server first instantiates the smart mouse and performs the initial configuration, which includes setting the initial position of the smart mouse and a list of obstacles.

[0905] 2. The server calls the activate method of the smart mouse to issue a start instruction, and monitors that the smart mouse has started operating.

[0906] 3. The server calls the run method of the smart mouse and controls the operation of the smart mouse while detecting the pet's position and movements. Specifically, it collects sensor data, adjusts its movements according to the pet's position, and monitors the pet's exercise status.

[0907] 4. The server calls the smart mouse's deactivate method to stop it from operating.

[0908] Terminal handling

[0909] 1. The terminal provides an interface that displays the initial position of the smart mouse and information on obstacles, allowing the user to check the current system status.

[0910] 2. The device detects the location of obstacles and inputs them so that the smart mouse can avoid them. It also updates and displays the location of the smart mouse in real time as it moves.

[0911] 3. When the smart mouse detects a pet, the device will display and notify the pet by displaying a corresponding reaction (for example, playing a sound or escaping).

[0912] User operations

[0913] 1. The user installs the smart mouse, turns it on through the terminal, and starts the smart mouse program.

[0914] 2. The user can check on the display screen of the device whether the smart mouse is working properly, so that if a problem occurs, they can take action immediately.

[0915] 3. The user observes how the Smart Mouse responds to their pet and adjusts settings as needed, which may include changing the location of obstacles or adjusting the Smart Mouse's movement patterns.

[0916] 4. Users can set a schedule for the smart mouse so that their pet gets enough exercise and maintain their pet's health.

[0917] Specific examples

[0918] Example 1: Server operation

[0919] After creating an instance of the smart mouse, the server calls the activate method to start the smart mouse and moves it appropriately while collecting the pet's location information. Through cloud-based sensor data analysis, the server generates movements that interest the pet in real time.

[0920] Example 2: Displaying a terminal

[0921] The terminal displays the movement of the smart mouse, notifying the user of the current system status in real time. It also has the function of detecting obstacles and displaying the action to avoid them.

[0922] Example 3: User operation

[0923] The user can start the smart mouse from the terminal and watch the pet start playing. If the pet is not getting enough exercise, the user can start the smart mouse again through the terminal to ensure that the pet gets enough play time.

[0924] The above is a specific embodiment of the automatic pet play equipment system according to the present invention. This system can effectively alleviate the lack of exercise for pets and contribute to maintaining their health.

[0925] The processing flow will be explained below.

[0926] Server Processing

[0927] Step 1:

[0928] The server creates an instance of the smart mouse, and during this initialization process it sets the initial position of the smart mouse and empties the obstacle list.

[0929] Step 2:

[0930] The server invokes the activate method of the smart mouse to activate it, which causes the smart mouse to transition from a standby state to an active state.

[0931] Step 3:

[0932] The server calls the run method to control the operation of the smart mouse, which includes the process of collecting sensor data and pet location and movement information.

[0933] Step 4:

[0934] The server determines the smart mouse's next move based on data from the sensors, performs calculations to avoid obstacles, and generates optimal movement patterns to attract pets.

[0935] Step 5:

[0936] The server generates sounds and movements for the smart mouse to react to the pet. For example, when the pet approaches within a certain range, the smart mouse plays a sound and performs a predictive action.

[0937] Step 6:

[0938] The server periodically monitors the smart mouse's exercise status, and if the pet is not getting enough exercise, it issues an instruction to restart the operation.

[0939] Step 7:

[0940] The server calls the deactivate method of the smart mouse to stop the operation of the smart mouse, thereby controlling the smart mouse to stop in a safe place.

[0941] Terminal handling

[0942] Step 1:

[0943] The terminal displays the initial position of the smart mouse and various setting information on the initial screen of the system, where the user can check the current status of the system.

[0944] Step 2:

[0945] The terminal provides an interface for the user to set the location of the obstacle, which is then sent to the server and added to the obstacle list of the smart mouse.

[0946] Step 3:

[0947] The terminal updates and displays the current location of the smart mouse in real time based on the sensor data, allowing the user to check the operating status of the smart mouse.

[0948] Step 4:

[0949] When the smart mouse detects the pet's location, the terminal notifies the user of the sound and movement that is being made, allowing the user to check whether the system is operating normally.

[0950] Step 5:

[0951] The device adjusts the smart mouse's movement patterns and schedule based on user input, for example, scheduling additional play time if the mouse is not getting enough exercise.

[0952] User operations

[0953] Step 1:

[0954] The user places the smart mouse in the cat's play area and turns it on using the terminal. As an initial setting, the user turns on the smart mouse and checks the settings on the terminal.

[0955] Step 2:

[0956] Users can monitor the operation of the smart mouse on the device screen, check for abnormalities and obstacle detection, and be prepared to deal with any problems that may arise.

[0957] Step 3:

[0958] The user observes how their pet reacts to the smart mouse, and if the pet shows no interest, they can change the behavior pattern from the terminal.

[0959] Step 4:

[0960] Users can adjust the smart mouse's operating schedule as needed to ensure efficient exercise for their pets, for example, by setting a schedule to activate the smart mouse at a specific time of day.

[0961] Step 5:

[0962] After use, the user turns off the power of the smart mouse, shuts down the system from the terminal, and finally stores the smart mouse in a safe place.

[0963] Example 1

[0964] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0965] Conventional automatic pet play equipment systems often fail to adequately alleviate pets' lack of exercise, limiting their effectiveness. Furthermore, they require users to frequently operate the system manually, placing a heavy burden on the user. Furthermore, they lack the ingenuity to continuously attract pets' interest, and pets often become bored quickly.

[0966] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0967] In this invention, the server includes a sensor means for detecting the position and movement of the pet, a control means for moving the play equipment based on the detected position and movement of the pet, an artificial intelligence means for generating a movement pattern of the play equipment, an obstacle avoidance means for detecting obstacles and performing avoidance actions, an exercise management means for grasping the exercise status and periodically activating the system, a data analysis means for performing cloud-based data analysis, an interface means for operating and monitoring the system from a user terminal, and a schedule management means for setting and managing the pet's exercise schedule. This makes it possible to effectively manage the pet's exercise, reduce the burden on the user, and continuously attract the pet's interest.

[0968] An "automated pet play equipment system" is an automated play equipment system designed to help pets get enough exercise and have fun playing.

[0969] A "sensor" is a device that detects the position and movements of a pet, and provides information to control the movement of play equipment based on that data.

[0970] The "control means" is a mechanism that appropriately adjusts the movement of the play equipment based on data obtained from the sensor, encouraging the pet to exercise.

[0971] "Artificial intelligence means" refers to algorithms and technologies for analyzing pet behavior data and generating optimal movements and sounds for play equipment.

[0972] The "obstacle avoidance means" is a function that allows the play equipment to detect obstacles while moving and take appropriate action to avoid them.

[0973] The "exercise management means" is a system for grasping the pet's exercise status and periodically activating the play equipment as necessary.

[0974] The "data analysis means" is a cloud-based technology that analyzes pet behavior data and optimizes the movement of play equipment.

[0975] The "interface means" is a device that provides an operation screen for the user to operate and monitor the system.

[0976] The "schedule management means" is a function for efficiently managing the pet's exercise time and activating the play equipment at the appropriate time.

[0977] The present invention relates to an automatic pet play equipment system for relieving pets' lack of exercise. This system detects the pet's position and movements and automatically controls the play equipment to encourage appropriate exercise. Specifically, the system includes a sensor that detects the pet's position and movements, a control means that moves the play equipment based on the detected data, an artificial intelligence means that generates the movement and sound of the play equipment, an obstacle avoidance means that detects and avoids obstacles, and an exercise management means that monitors the exercise status and is activated periodically.

[0978] Server Roles

[0979] The server first creates an instance of a pet toy called a smart mouse and performs initial setup. This setup includes setting the smart mouse's initial position and a list of obstacles. The server calls the smart mouse's activate method to start the smart mouse. Next, it uses the run method to collect sensor data and control the smart mouse's operation based on the pet's position and movement. It then calls the deactivate method to stop the smart mouse. Specifically, it uses cloud-based data analysis means to analyze the pet's movements in real time and generate optimal movement for the toy.

[0980] Device Role

[0981] The terminal provides an interface that displays the initial position of the smart mouse and obstacle information, allowing users to check the current status of the system in real time. The terminal also updates and displays the position of the smart mouse in real time based on sensor data. Furthermore, if a pet comes into contact with the smart mouse, the terminal notifies the user of the reaction. For example, when a pet approaches the smart mouse, a notification will be displayed saying, "Your pet has started playing."

[0982] User operations

[0983] First, the user installs the smart mouse, turns it on through the terminal, and starts the smart mouse program. Next, the user checks whether the smart mouse is working properly on the terminal display screen. If a problem occurs, the user can reconfigure the obstacle location and the smart mouse's movement through the terminal. In addition, the user can set an exercise schedule for the smart mouse to efficiently manage their pet's exercise time.

[0984] Specific examples

[0985] Example 1: Server installation

[0986] The server creates an instance of the smart mouse and activates it using the activate method. It then collects the pet's location information and performs cloud-based data analysis to generate appropriate play equipment movements.

[0987] Example 2: Using a terminal

[0988] The terminal displays the movement of the smart mouse, notifying the user of the current system status in real time. It also has the function of detecting obstacles and displaying the action to avoid them.

[0989] Example 3: User operation

[0990] The user activates the smart mouse from the device and observes how the pet begins to play. If the pet is not getting enough exercise, the user activates the smart mouse again to ensure that the pet gets adequate playtime.

[0991] Example prompts for generative AI models

[0992] "Please explain what the following system does. Explain in detail how an automated pet toy operates according to instructions from a server, a device, and a user. Include examples of specific hardware and software components."

[0993] In this way, the system of the present invention can effectively alleviate the lack of exercise required by pets, reduce the burden on users, and continuously attract the interest of pets.

[0994] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0995] The flow of this system's program processing

[0996] Step 1:

[0997] Initialization and Instantiation

[0998] The server creates an instance of the smart mouse and sets its initial position and obstacle list. Specifically, it calls the initialize_smart_mouse() method, and inputs the initial X and Y coordinates of the smart mouse and the position data of the obstacles. Based on this data, it sets the smart mouse in a state where it can start operating. As an output, the smart mouse is placed in its initial position and the obstacle list is loaded into the system.

[0999] Step 2:

[1000] Starting the Smart Mouse

[1001] The server invokes the activate method of the smart mouse to activate it. The activate command is given as input, and the system transitions the smart mouse's sensor to an active state. As an output, the smart mouse starts operating and begins collecting sensor data.

[1002] Step 3:

[1003] Sensor data collection and analysis

[1004] The server collects real-time location and movement data from the smart mouse's sensor. The sensor data is periodically sent as input, and a cloud-based data analysis tool operates based on this data to analyze the pet's location and movement. The output is an analysis result of the pet's current location and movement.

[1005] Step 4:

[1006] Controlling movement according to pet behavior

[1007] The server controls the operation of the smart mouse based on the analysis results. The analyzed pet's position data and predicted movement are given as input, and the artificial intelligence means operates to generate the movement pattern of the play equipment. As output, the next movement pattern of the smart mouse is calculated and the instruction is sent to the smart mouse.

[1008] Step 5:

[1009] Obstacle Avoidance

[1010] The server performs processing to avoid obstacles when the smart mouse moves. Data from the obstacle sensor is used as input to operate the obstacle avoidance means. As output, a new movement pattern to avoid the obstacle is generated and sent to the smart mouse.

[1011] Step 6:

[1012] Sending data to the user interface

[1013] The server sends sensor data and analysis results to the user's device, allowing the user to monitor the system status. The latest data on the server is used as input, and data displayed in real time on the user's device is sent as output.

[1014] Step 7:

[1015] Resetting by user operation

[1016] The user reconfigures the smart mouse's operation and obstacle positions through the terminal. The user's operation instructions are given as input, and the system accepts them and performs new settings. As output, the smart mouse's operation parameters and obstacle list are updated.

[1017] Step 8:

[1018] Managing your exercise schedule

[1019] The user sets an exercise schedule for the smart mouse to maintain the health of their pet. The exercise time and frequency specified by the user are used as input, and the schedule management means reflects this in the system. As output, the smart mouse will automatically start and stop based on the set schedule.

[1020] Step 9:

[1021] Stopping Smart Mouse

[1022] When the exercise session ends, the server calls the deactivate method of the smart mouse to stop the smart mouse operation. The command to end the exercise session is given as input, and the system completely stops the smart mouse operation. As an output, the smart mouse is safely stopped.

[1023] Through the above specific processing steps, the automatic pet play equipment system can effectively alleviate the lack of exercise for pets and reduce the user's hassle.

[1024] (Application example 1)

[1025] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1026] Automatic play equipment systems play an important role in helping pets get enough exercise, but conventional systems have difficulty monitoring a pet's exercise status in real time and providing appropriate exercise patterns based on that data. Furthermore, they lack an interface that allows users to easily check the system status and the pet's response, making it difficult to effectively manage a pet's exercise plan.

[1027] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1028] In this invention, the server includes a sensor that detects the position and movement of the pet, a control means that moves the play equipment based on the detected position and movement of the pet, an artificial intelligence means that generates a movement pattern for the play equipment, an obstacle avoidance means that detects obstacles and takes action to avoid them, an exercise management means that grasps the exercise status and activates periodically, a data analysis means that monitors the pet's movements in real time and generates recommended play equipment and exercise patterns, a recording means that saves the pet's exercise status and uses it for future exercise plans, and a display means that allows the user to check the system status and the pet's reaction through an interface. This makes it possible to eliminate a lack of exercise for pets and maintain their health.

[1029] A "sensor for detecting the position and movement of a pet" is a device used to detect the current position and movement of a pet in real time.

[1030] The "control means for moving the play equipment based on the detected position and movement of the pet" is a control system for appropriately moving the play equipment based on information from the sensor.

[1031] "Artificial intelligence means for generating movement patterns for play equipment" means means using AI technology to generate movement or movement patterns that attract pets.

[1032] The "obstacle avoidance means for detecting an obstacle and taking action to avoid it" is a system for detecting an obstacle so that the play equipment does not collide with it and taking action to avoid it.

[1033] The "exercise management means for grasping the exercise status and activating it periodically" is a management system for monitoring the exercise status of a pet and activating the automatic play equipment periodically.

[1034] "Data analysis means for monitoring pet movements in real time and generating recommended play equipment and exercise patterns" refers to a means for analyzing pet movements in real time and generating optimal play equipment and exercise patterns based on that data.

[1035] "Means for recording the exercise status of a pet and using it for future exercise planning" refers to a means for storing the exercise data of a pet and creating future exercise plans based on that information.

[1036] "Display means that allows the user to check the system status and the pet's reaction through an interface" refers to a display device and an interface that allows the user to check the current status of the system and the behavior of the pet.

[1037] This invention is an automatic pet play equipment system that effectively eliminates the lack of exercise for pets and contributes to maintaining their health. This system is composed of three entities: a server, a terminal, and a user, each of which plays a specific role.

[1038] Server Processing

[1039] The server creates an instance of the smart mouse and performs initial settings within the pet shop. It sets the initial position of the smart mouse and a list of obstacles, and after creating the instance, calls the smart mouse's activate method to issue an activation command. The server uses sensors to collect data on the pet's position and movement, and appropriately controls the smart mouse's movement based on that data. Furthermore, the server uses AI technology to analyze the pet's movement patterns and generate movements and sounds that interest the pet. Specifically, it analyzes the data using AI modules such as TensorFlow and Keras.

[1040] Terminal handling

[1041] The terminal monitors the status of the smart mouse and the pet's reaction in real time through a user interface. It displays the initial position and obstacle information, allowing the user to check the current status of the system. The terminal communicates with the server via Bluetooth or Wi-Fi to receive sensor data and analysis results. The terminal also stores the pet's exercise status, providing a means of recording it for use in future exercise planning.

[1042] User operations

[1043] Users simply activate the smart mouse through their device and watch their pet begin to play. If their pet is not getting enough exercise, they can simply reactivate the smart mouse through their device to ensure their pet gets the appropriate playtime. They can also monitor their pet's behavior through the device's display function and adjust play equipment and settings as needed.

[1044] Specific application examples and prompt sentence examples

[1045] A specific application example is a situation where a pet owner tries out toys for their pet in a pet shop. The user launches the smartphone app and moves the smart mouse together with their pet. The app analyzes the pet's movements in real time and generates recommended toys and exercise patterns based on that data. This allows the user to more effectively alleviate their pet's lack of exercise.

[1046] Example prompt sentence:

[1047] (Setting) Check the initial position and set the list of obstacles.

[1048] (Start) Start the smart mouse and check your pet's movements.

[1049] (Analysis) Analyze your pet's position in real time and generate interesting movements.

[1050] (Stop) Stop the Smart Mouse if necessary.

[1051] This system will help pets get enough exercise and effectively maintain their health.

[1052] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1053] Step 1:

[1054] The server creates an instance of the smart mouse and initializes the location information of the pet. The input includes the pet's initial location data and a list of obstacles. Based on this data, it calculates a route to avoid obstacles and creates the initial location data and a movement route as output.

[1055] Step 2:

[1056] The server invokes the activate method of the smart mouse to start the smart mouse. The server then monitors whether the smart mouse starts operating normally. The input includes the initial setting information of the smart mouse. The output generates a log that confirms that the smart mouse has started operating.

[1057] Step 3:

[1058] The server calls the smart mouse's run method and uses sensors to collect pet position and movement data in real time. The input data is position and movement data from the sensors, as well as obstacle information. The server analyzes the data and generates movements of the play equipment and interesting movements based on the pet's movements. The output is the movement pattern of the play equipment and movement instructions.

[1059] Step 4:

[1060] The terminal receives the sensor data and analysis results from the server and displays them in real time through the user interface. The input data is the sensor data from the server and the operation information of the play equipment. The terminal displays this visually, allowing the user to check the current status of the system. The output is a visual status display on the user interface.

[1061] Step 5:

[1062] The user monitors the pet's exercise status through the device and adjusts the settings as needed. Input includes the information displayed on the device and the user's operation instructions. Based on this, the settings and movement patterns of the play equipment are adjusted. The updated settings and the applied movement patterns are generated as output.

[1063] Step 6:

[1064] The server periodically records the pet's exercise status data and stores it for use in future exercise planning. The input data is exercise status data collected in real time. Based on this, the data is stored in a recording device and can be retrieved when needed. A recorded data file is generated as an output.

[1065] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1066] The present invention relates to an automatic pet play equipment system that combines an emotion engine that recognizes the user's emotions, and is specifically implemented as follows.

[1067] System Overview

[1068] The automatic pet play equipment system of the present invention (hereinafter referred to as "smart mouse") is designed to alleviate the lack of exercise for pets and integrates multiple functions. Specifically, it includes a sensor to detect the position and movement of the pet, a control means to move the play equipment, an artificial intelligence means to generate the movement pattern of the play equipment, an obstacle avoidance means to detect and avoid obstacles, an exercise management means to manage the exercise status and periodically activate the play equipment, and an emotion engine to recognize the user's emotions.

[1069] A natural language description of what the program does

[1070] Server Processing

[1071] 1. The server creates an instance of the smart mouse and performs the initial configuration, which includes setting the initial position of the smart mouse and a list of obstacles.

[1072] 2. The server invokes the activate method of the smart mouse to activate the smart mouse.

[1073] 3. The server calls the run method, detects the pet's position and movement based on sensor data, and moves the smart mouse appropriately.

[1074] 4. The server uses artificial intelligence means to generate movements and sounds that will attract the pet's attention.

[1075] 5. The server analyzes the user's emotional state through the emotion engine, collecting the user's voice and facial expression data and evaluating the status.

[1076] 6. The server adjusts the pet's play patterns and the behavior of the play equipment based on the results of the emotion engine. For example, if the user is feeling stressed, it selects a behavior pattern that will relax both the pet and the user.

[1077] 7. The server monitors the pet's exercise status using the exercise management means and restarts the smart mouse if necessary.

[1078] 8. Finally, the server calls the smart mouse's deactivate method to safely stop the smart mouse's operation.

[1079] Terminal handling

[1080] 1. The terminal provides an interface that displays the initial position and obstacle information on the initial screen of the smart mouse.

[1081] 2. The device accepts input from the user to set the location of the obstacle and sends it to the server.

[1082] 3. The terminal updates the position and operating status of the smart mouse in real time and displays it to the user.

[1083] 4. If the user's emotional state changes, the device notifies the server of the change.

[1084] 5. The terminal can adjust the operation patterns and schedules of the play equipment based on instructions from the user.

[1085] User operations

[1086] 1. The user places the smart mouse in the pet's play area and turns it on through the terminal.

[1087] 2. After confirming the initial settings, the user can monitor the system status through the terminal, set the obstacle location as needed, and adjust the operation of the smart mouse.

[1088] 3. After the smart mouse starts working, the user can observe the pet's reaction and change the operation settings via the terminal.

[1089] 4. If the user's emotional state changes, the user notifies the server via the device, which then uses the emotion engine to adjust the server's behavior.

[1090] 5. After finishing playing, the user should turn off the smart mouse and shut down the system from the terminal. Then store the smart mouse in a safe place.

[1091] Specific examples

[1092] Example 1: Server operation

[1093] After creating an instance of the smart mouse, the server calls the activate method to start the smart mouse and moves it appropriately while collecting information on the pet's location.The emotion engine is used to analyze the user's emotional state, and if the user's stress level is high, the smart mouse's movement pattern is changed to make the mouse move in a way that helps the user relax.

[1094] Example 2: Displaying a terminal

[1095] The terminal displays the operation status of the smart mouse in real time, allowing the user to check the current system status, and also displays the user's emotional state fluctuations and transmits data to the server accordingly.

[1096] Example 3: User operation

[1097] The user installs the smart mouse, turns it on using a terminal, and checks its operation. If the user's emotional state changes, the terminal transmits that information, and the smart mouse adjusts its behavior based on that information. The user also observes their pet, adjusts further settings as needed, and finally shuts down the system.

[1098] The above is a specific embodiment of an automatic pet play equipment system incorporating an emotion engine according to the present invention. This system not only helps pets get more exercise but also provides play that responds to the user's emotional state, ensuring the happiness of both the pet and the user.

[1099] The processing flow will be explained below.

[1100] Server Processing

[1101] Step 1:

[1102] The server creates an instance of the smart mouse, which initializes the initial position of the smart mouse and the list of obstacles.

[1103] Step 2:

[1104] The server invokes the activate method of the smart mouse to activate the smart mouse, which causes the smart mouse to start operating.

[1105] Step 3:

[1106] The server calls the run method, receives data from the sensor, and detects the pet's position and movement in real time. It controls the movement of the smart mouse based on the acquired data.

[1107] Step 4:

[1108] The server analyzes the sensor data and moves the smart mouse according to the pet's current position and movement. It also detects the location of obstacles and takes action to avoid them.

[1109] Step 5:

[1110] The server uses artificial intelligence to generate movements and sounds that interest the pet, and designs and executes optimal reactions to the pet's movements.

[1111] Step 6:

[1112] The server analyzes the user's emotional state through an emotion engine, extracting emotional data from the user's voice and facial expressions, and uses that data to determine the user's stress level and happiness.

[1113] Step 7:

[1114] The server adjusts the behavior of the smart mouse based on the user's emotional state, for example, if the user is in a relaxed state, the server will slow down the behavior of the smart mouse to maintain a relaxed mood.

[1115] Step 8:

[1116] The server monitors the pet's exercise status using the exercise management means, periodically activates the smart mouse, and if the pet is not getting enough exercise, activates the smart mouse again to encourage more exercise.

[1117] Step 9:

[1118] The server calls the deactivate method of the smart mouse to stop the smart mouse from operating, and in the process safely places the smart mouse in a stopped position.

[1119] Terminal handling

[1120] Step 1:

[1121] The terminal displays the initial position and setting information on the initial screen of the smart mouse, allowing the user to check the current status of the system.

[1122] Step 2:

[1123] The terminal provides an interface for the user to input the location of the obstacle, which is then sent to the server and added to the obstacle list of the smart mouse.

[1124] Step 3:

[1125] The terminal updates and displays the current location of the smart mouse based on real-time data from the sensor, allowing the user to monitor the movement of the smart mouse in real time.

[1126] Step 4:

[1127] When a user inputs emotional information or provides voice or facial expression data, the device sends it to the server, which then analyzes the data using an emotion engine.

[1128] Step 5:

[1129] The device will detect the pet's location and display a notification when the smart mouse performs a specific action, allowing the user to check whether the system is working properly.

[1130] Step 6:

[1131] The device can adjust the smart mouse's motion patterns and schedules based on user instructions, such as setting up additional play time or selecting special motion patterns.

[1132] User operations

[1133] Step 1:

[1134] The user places the smart mouse in the cat's play area and turns it on using the terminal. As an initial setting, the user turns on the smart mouse and checks the settings on the terminal.

[1135] Step 2:

[1136] The user checks the location of obstacles and the status of the system through the terminal, changes the settings as necessary, and verifies that the system is operating normally.

[1137] Step 3:

[1138] After the smart mouse starts working, users can observe their pet's behavior and make additional settings and adjustments through the device, for example, increasing the speed if the movement is slow.

[1139] Step 4:

[1140] When a user provides emotion information, the data is input through the terminal, and the server uses the emotion engine to select an appropriate behavior pattern.

[1141] Step 5:

[1142] After finishing playing, the user turns off the smart mouse and shuts down the system from the terminal, and finally puts the smart mouse in a safe place.

[1143] Example 2

[1144] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1145] In today's living environment, lack of exercise for pets and fluctuations in users' emotions are becoming problems. It is particularly difficult for busy users to manage their pets' exercise and provide them with play. Furthermore, existing automatic pet play equipment systems are unable to provide play that responds to the user's emotional state, making it difficult to provide an environment that satisfies both the user and the pet.

[1146] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a sensor means for detecting the position and movement of the pet, a control means for moving the play equipment based on the detected position and movement of the pet, an artificial intelligence means for generating a movement pattern of the play equipment, an obstacle avoidance means for detecting obstacles and performing an avoidance operation, an exercise management means for grasping the exercise status and periodically activating the same, an emotion recognition means for analyzing the emotional state of the user, and an emotion response means for adjusting the operation of the play equipment based on the analyzed emotional state. This makes it possible to alleviate the lack of exercise for the pet and provide play that takes into account the emotional state of the user.

[1147] An "automatic pet play system" is a system that includes a device for playing with a pet that operates automatically to encourage exercise for the pet.

[1148] "Sensor means" refers to devices or technologies for collecting information from the surrounding environment or objects, and specifically refers to devices that detect the position and movements of a pet.

[1149] "Control Means" refers to the devices or technology used to manage and control the operation of a system or device, specifically a device that moves play equipment based on the detected position and movement of a pet.

[1150] "Artificial intelligence means" refers to technology that uses data analysis and machine learning to make autonomous decisions and take action, and specifically refers to devices and software for generating movement patterns for playground equipment.

[1151] "Obstacle avoidance means" refers to devices or technologies that detect surrounding obstacles and take action to avoid them.

[1152] "Exercise management means" refers to devices and technologies for grasping the level and status of exercise and for managing and adjusting it, and is a device that grasps the pet's exercise status and activates play equipment periodically.

[1153] "Emotion recognition means" refers to devices and technologies for analyzing the user's emotional state, specifically devices that analyze voice and facial expressions.

[1154] "Emotion response means" refers to a device or technology that responds or behaves appropriately based on the analyzed emotional state, and specifically refers to a device that adjusts the operation of play equipment.

[1155] The present invention relates to an automatic pet play equipment system that combines an emotion engine that recognizes the user's emotions, and is specifically implemented as follows.

[1156] System Overview

[1157] The automatic pet play equipment system of the present invention (hereinafter referred to as "smart mouse") is designed to alleviate the lack of exercise for pets and integrates multiple functions. Specifically, it includes a sensor means for detecting the position and movement of the pet, a control means for moving the play equipment, an artificial intelligence means for generating the movement pattern of the play equipment, an obstacle avoidance means for detecting and avoiding obstacles, an exercise management means for grasping the exercise status and periodically activating the play equipment, and an emotion recognition means and an emotion response means for analyzing the user's emotional state and adjusting the operation of the play equipment.

[1158] Server Processing

[1159] The server creates an instance of the smart mouse and performs initial settings. These initial settings include the smart mouse's initial position and a list of obstacles. The server calls the smart mouse's activate method to start the smart mouse. The server detects the pet's position and movement based on sensor data and moves the smart mouse appropriately. The sensors used are cameras and motion sensors, and data is acquired in real time.

[1160] Furthermore, the server uses artificial intelligence means to generate movements and sounds that will attract the pet's attention. For example, TensorFlow and PyTorch are used as AI platforms. The server analyzes the user's emotional state through emotion recognition means (e.g., natural language processing software for voice recognition and image analysis software for facial expression recognition) and selects an appropriate movement pattern based on the emotion response means. Based on this information, if the user feels stressed, the server changes the movement pattern of the smart mouse to provide relaxing movements. MongoDB and other database technologies are used to store and analyze movement data, and the server restarts the smart mouse if the pet is not getting enough exercise.

[1161] Terminal handling

[1162] The device provides an interface that displays the initial position and obstacle information on the smart mouse's initial screen. For example, the interface can be built using frameworks such as React or Vue.js. The location information of obstacles set by the user is sent to the server, which displays the smart mouse's position and operating status in real time. The device manages the operation of the smart mouse using real-time communication technologies such as WebSocket. The device also has a notification system (such as Firebase Cloud Messaging) that notifies the server when the user's emotional state changes.

[1163] User operations

[1164] The user places the smart mouse in the pet's play area and turns on the device. The user uses the device to check the initial settings and monitor the system status. The device can be used to set the location of obstacles and adjust the smart mouse's behavior. If the user's emotional state changes during play, it is communicated through the device, and the server analyzes it and takes appropriate action. Finally, after finishing play, the smart mouse is shut down and stored in a safe place.

[1165] Specific examples

[1166] Example 1: Server operation

[1167] After creating an instance of the smart mouse, the server calls the activate method to start the smart mouse and makes it operate appropriately while collecting the pet's location information.The emotion engine is used to analyze the user's emotional state, and if the stress level is high, the smart mouse's movement pattern is changed to make it operate in a relaxing manner.

[1168] Example 2: Displaying a terminal

[1169] The terminal displays the operation status of the smart mouse in real time, allowing the user to check the current system status, and also displays the user's emotional state fluctuations and transmits data to the server accordingly.

[1170] Example 3: User operation

[1171] The user installs the smart mouse, turns it on using a terminal, and checks its operation. If the user's emotional state changes, the terminal transmits that information, and the smart mouse adjusts its behavior based on that information. The user observes their pet, changes settings as needed, and finally shuts down the system.

[1172] Prompt Sentence Examples

[1173] "Please explain what behavior pattern should be selected in an automatic pet play system when the user's emotional state changes."

[1174] This system not only helps pets overcome lack of exercise but also provides play that responds to the user's emotional state, ensuring the happiness of both the pet and the user.

[1175] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1176] Step 1:

[1177] The server creates an instance of the smart mouse and performs the initial settings.

[1178] Input: Smart Mouse initial setting information (initial position, obstacle list, etc.)

[1179] Output: Smart Mouse initial settings completed

[1180] Specific operation: The server creates a new smart mouse instance and sets the initial position and obstacle list specified in the program code. This initial information is often obtained from a database.

[1181] Step 2:

[1182] The server starts the smart mouse.

[1183] Input: Start command

[1184] Output: Smart Mouse activated

[1185] Specific operation: The server calls the activate method of the smart mouse to activate the smart mouse's sensors and motors. This operation turns on the smart mouse's LED and starts operation.

[1186] Step 3:

[1187] The server detects the pet's position and movements based on sensor data and moves the smart mouse appropriately.

[1188] Input: Sensor data (location information, motion information)

[1189] Output: Smart Mouse movement command

[1190] Specific operation: The server analyzes data obtained from the infrared sensor and camera installed in the smart mouse to identify the pet's current location and movement. Based on the analysis results, it calculates the direction and distance the smart mouse should move and sends a movement command to the smart mouse.

[1191] Step 4:

[1192] The server generates the movements and sounds using artificial intelligence means.

[1193] Input: Pet behavioral patterns and environmental data

[1194] Output: Generated movements and sounds

[1195] How it works: The server uses AI frameworks such as TensorFlow and PyTorch to analyze data on your pet's past behavior and current environment, and based on this, generates new movements and sounds that will attract your pet's attention and sends them to the smart mouse.

[1196] Step 5:

[1197] The server analyzes the user's emotional state through emotion recognition means.

[1198] Input: User's voice data, facial expression data

[1199] Output: Parsed emotional state

[1200] Specific operation: The server analyzes the user's voice data using voice recognition software (using natural language processing) and facial expression data using image recognition software. For example, if the user says "I'm happy" or "I'm tired," or if they smile or frown, the server analyzes the data to evaluate their emotional state.

[1201] Step 6:

[1202] The server adjusts the behavior of the play equipment based on the emotion response means.

[1203] Input: Parsed emotional state

[1204] Output: Coordinated movement pattern

[1205] Specific behavior: The server analyzes the user's emotional state and changes the behavior pattern of the smart mouse. For example, if the user is feeling stressed, the smart mouse will be configured to move slowly and provide relaxing sounds.

[1206] Step 7:

[1207] The server uses the exercise management means to monitor the pet's exercise status and restarts the smart mouse if necessary.

[1208] Input: Exercise data

[1209] Output: Restart command

[1210] How it works: The server continuously monitors your pet's past exercise data stored in a database such as MongoDB, assesses whether it is getting enough exercise, and if it is, issues a command to restart the smart mouse to encourage your pet to exercise.

[1211] Step 8:

[1212] The server stops the smart mouse from working.

[1213] Input: Stop command

[1214] Output: Smart Mouse stopped

[1215] Specific operation: The server calls the smart mouse's deactivate method to safely stop the sensors and motors. This turns off the smart mouse's LED and completely stops its operation.

[1216] Step 9:

[1217] The device will display the initial position and obstacle information on the initial screen.

[1218] Input: Initialization information (initial position, obstacle list, etc.)

[1219] Output: Initial screen display

[1220] Specific operation: The device uses JavaScript frameworks such as React and Vue.js to display the initial setting information on the user interface, allowing users to easily check the initial position of the smart mouse and obstacle information.

[1221] Step 10:

[1222] The terminal accepts input from the user and sends it to the server.

[1223] Input: User setting input (obstacle position, operation instructions, etc.)

[1224] Output: Data sent to the server

[1225] Specific operation: The terminal receives the user's input of the obstacle position and the smart mouse's operation instructions in real time and sends them to the server, which then adjusts the smart mouse's operation based on the user's instructions.

[1226] Step 11:

[1227] The terminal updates the position and operating status of the smart mouse and displays it to the user.

[1228] Input: Smart mouse status data (location information, operation information, etc.)

[1229] Output: Real-time display

[1230] Specific operation: The device uses real-time communication technology such as WebSocket to display the current location and operating status of the smart mouse on the user's screen. For example, a smart mouse icon is displayed on a map, updated in real time.

[1231] Step 12:

[1232] The terminal notifies the server of changes in the user's emotional state.

[1233] Input: Emotional state data (feedback from the user)

[1234] Output: Notification data to the server

[1235] Specific operation: The device uses a system (e.g., Firebase Cloud Messaging) to detect changes in the user's emotional state and notify the server, allowing the server to adjust the behavior of the smart mouse according to the user's emotional state.

[1236] Step 13:

[1237] The terminal adjusts the movement pattern of the play equipment based on the user's instructions.

[1238] Input: User instructions (operation patterns, schedule settings, etc.)

[1239] Output: Instruction data to the server

[1240] Specific operation: Based on the user's instructions, the terminal adjusts the operation pattern of the smart mouse and sends the setting information to the server, so that the operation of the smart mouse can be changed according to the user's wishes.

[1241] Step 14:

[1242] The user installs the smart mouse and turns it on through the terminal.

[1243] Input: Power on command, installation location information

[1244] Output: Smart mouse startup status

[1245] Specific operation: The user places the smart mouse in the pet play area and clicks the power button on the device to start the system, which then starts the smart mouse.

[1246] Step 15:

[1247] The user confirms the initial configuration and monitors the system status.

[1248] Input: Initialization information (initial position, obstacle list, etc.)

[1249] Output: System status monitoring information

[1250] Specific operation: The user checks the initial setting information on the terminal, and then monitors the system's operating status. Based on the initial setting information displayed on the terminal, the user checks whether the system is operating normally.

[1251] Step 16:

[1252] The user observes the pet's reactions and changes the settings.

[1253] Input: Pet reaction information, setting change instructions

[1254] Output: New configuration information

[1255] Specific operation: After the smart mouse starts operating, the user can observe the pet's reaction and change the operation settings through the terminal if necessary. For example, if the pet is not interested, the operation pattern can be changed.

[1256] Step 17:

[1257] The user communicates changes in their emotional state through the terminal.

[1258] Input: Emotional state data (user feedback)

[1259] Output: Emotional state notification data

[1260] Specific operation: The user's emotional state (relaxed, stressed, etc.) is communicated to the server through button presses or voice input on the device. The server then adjusts the operation of the smart mouse in real time based on this information.

[1261] Step 18:

[1262] When the user has finished playing, he or she shuts down the smart mouse and stores it in a safe place.

[1263] Input: Stop command

[1264] Output:Smart Mouse stopped state

[1265] Specific operation: When the user finishes playing, he / she presses the stop button on the device to stop the smart mouse safely, and then stores the smart mouse in a safe place.

[1266] (Application example 2)

[1267] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1268] For customers who visit physical stores with their pets, there is a need for systems that allow pets to stay comfortable and safe in the store, improving the customer experience. In particular, there is a need for systems that can recognize customers' emotions in real time and adjust the pet's play environment accordingly. There is also a need for a method that allows customers to easily operate and monitor play equipment via smartphone while ensuring their pet's exercise and safety.

[1269] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1270] In this invention, the server includes a sensor that detects the pet's position and movement, a control means that moves the play equipment based on the detected pet's position and movement, an artificial intelligence means that generates a movement pattern for the play equipment, an obstacle avoidance means that detects obstacles and takes action to avoid them, an exercise management means that grasps the exercise status and periodically activates the control, an emotion recognition means that analyzes the user's facial expression or voice to recognize emotions, a means for adjusting the operation of the play equipment based on the recognized emotional state of the user, and an interface for monitoring and controlling the operation status of the play equipment using a smartphone. This allows pets to spend a comfortable time in the store and provides a play environment that matches the customer's emotional state. Furthermore, customers can easily manage and monitor their pet's play environment via their smartphone.

[1271] An "automatic pet play equipment system" is an integrated system that detects the pet's position and movements and operates play equipment appropriately.

[1272] A "sensor" is a device for detecting the location and movement of a pet.

[1273] "Control means" refers to means for moving the play equipment based on the detected position and movement of the pet.

[1274] "Artificial intelligence means" refers to means that utilizes artificial intelligence to generate movement patterns for play equipment.

[1275] The "obstacle avoidance means" is a means for detecting an obstacle and performing an avoidance operation.

[1276] The "exercise management means" is a means for understanding the pet's exercise status and for periodically activating the play equipment.

[1277] The "emotion recognition means" is a means for analyzing the user's facial expression or voice and recognizing the user's emotion.

[1278] The "interface" is a user interface for monitoring and controlling the operating status of the play equipment using a smartphone.

[1279] A "plaything" is a device for pets to play with, and in the case of the present invention, it has an automatic function.

[1280] A "server" is a central control unit that controls the entire system and processes data.

[1281] The present invention is an automatic pet play equipment system that combines an emotion engine that recognizes the user's emotions, and is specifically implemented as follows.

[1282] The system is composed of sensors that detect the pet's position and movements, a control means that moves the play equipment, an artificial intelligence means that generates the play equipment's movement patterns, an obstacle avoidance means that detects and avoids obstacles, an exercise management means that manages the exercise status and periodically activates the play equipment, an emotion engine that recognizes the user's emotions, and an interface that uses a smartphone to monitor and control the system.

[1283] Server Processing

[1284] The server receives data from sensors that detect the pet's position and movement, and controls the play equipment based on that data. It also uses artificial intelligence to generate movement patterns for the play equipment that will interest the pet. It also analyzes the user's emotional state through an emotion engine, recognizing the user's emotional state by analyzing the user's facial expressions or voice. Based on the results, the server adjusts the operation of the play equipment, providing a relaxing environment for the user.

[1285] Terminal handling

[1286] The device (smartphone) provides an interface that allows users to monitor and control the operation status of pet toys in real time. Through this interface, users can set the operation patterns and schedules of the toys and notify their emotional state.

[1287] User operations

[1288] The user configures the system via a smartphone and controls the start and stop of the play equipment. When the user's emotional state changes, the smartphone transmits this information to the server, which then uses an emotion engine to adjust the operation of the play equipment as needed.

[1289] Explanation of program processing

[1290] The server uses hardware such as sensors that detect the pet's position and movements, and a central control unit (server device) that collects and processes this data. Its software includes the OpenCV image processing library, the Requests Python library for making HTTP requests, the Flask web framework, and libraries for recognizing emotions (such as EmotionEngine). Using this software, the server collects data on the pet's position and performs data calculations to appropriately control the play equipment. It also uses the emotion engine to analyze the user's facial expressions and voice data, adjusting the behavior of the play equipment based on the results to provide a play environment that responds to the user's emotional state.

[1291] Specific examples

[1292] While the pet is playing, the user can hold a smartphone and monitor the play equipment's operation in real time.

[1293] If the user is feeling stressed, their emotions are recognized through the smartphone's camera or microphone, and the server changes the play equipment's movement patterns to make them more relaxing.

[1294] When a user is spending time in a store with their pet, the atmosphere of the store is improved by showing other customers that the pet is enjoying a comfortable stay.

[1295] Prompt Sentence Examples

[1296] "Generate code for a smartphone app that works with an automated pet play system in a brick-and-mortar store and analyzes the user's emotions to adjust the pet's play patterns. The app should have different behavior patterns (play, idle, calm) depending on the user's emotional state."

[1297] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1298] Step 1:

[1299] The server initializes the automatic pet playground system. Specifically, it sets the initial position information and obstacle list for the pet in the play area. This initialization allows the system to accurately determine the pet's position and prepare for obstacle avoidance. The input is the initial position information and obstacle list, and the output is the status of the initialization completion.

[1300] Step 2:

[1301] The server receives sensor data and detects the pet's location and behavior in real time. The input is data sent from the sensor, and the output is information about the pet's location and behavior. The server analyzes the sensor data to determine the pet's current location. It also analyzes the behavior information to identify the pet's interests and behavior patterns.

[1302] Step 3:

[1303] The device (smartphone) captures the user's facial expressions and voice through the smartphone's camera and microphone to recognize the user's emotions. The input is the camera image or microphone audio, and the output is the emotion recognition results. The device analyzes the user's emotions using an image processing library (OpenCV) or an emotion recognition library (EmotionEngine), and sends the results to the server.

[1304] Step 4:

[1305] The server analyzes the user's emotional state received through the emotion engine and adjusts the movement pattern of the pet toy. The input is the user's emotional data, and the output is the adjusted movement pattern of the toy. For example, if the user is feeling stressed, the movement pattern will be changed to a slower one that helps the user relax.

[1306] Step 5:

[1307] The server uses artificial intelligence to generate patterns of movement and sounds for the play equipment that will interest the pet. The input is the pet's position information and detected movement data, and the output is the movement pattern of the play equipment. Based on the pet's movement pattern, the server determines movements that will likely interest the pet and the direction in which the play equipment will move.

[1308] Step 6:

[1309] The terminal displays the operating status of the play equipment in real time, allowing the user to check the current system status. The input is the operating status data of the play equipment sent from the server, and the output is the display screen of the smartphone. The user can view this information and judge whether the operation of the play equipment is appropriate.

[1310] Step 7:

[1311] Users can adjust the operation patterns and schedules of play equipment through a terminal. The input is the user's instruction, and the output is the adjusted operation patterns and schedule information of the play equipment. For example, if a user wants their pet to perform a specific movement, they operate the terminal to instruct the server to perform that movement, and the server then executes it.

[1312] Step 8:

[1313] The server uses the exercise management means to monitor the pet's exercise status and restarts the play equipment as necessary. The input is the pet's exercise data and the output is a command to start the play equipment. If it is determined that the pet is not getting enough exercise, the play equipment can be operated again to increase the pet's exercise.

[1314] Step 9:

[1315] Finally, the server safely stops the operation of the play equipment. The input is a stop command, and the output is a stop confirmation status. When the user wants to end play, they send a stop command from their terminal to the server, and the server safely stops the play equipment. The server also periodically monitors the status of the play equipment, and safely stops it if an abnormality occurs.

[1316] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1317] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1318] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1319] [Fourth embodiment]

[1320] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1321] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1322] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1323] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1324] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1325] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1326] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1327] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1328] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1329] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1330] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1331] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1332] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1333] The present invention relates to an automatic pet play equipment system for relieving lack of exercise for pets, and is specifically embodied as follows.

[1334] System Overview

[1335] The server manages the overall operation of the automatic pet play equipment system (hereinafter referred to as "Smart Mouse"). Smart Mouse is a pet device that utilizes AI technology to encourage pets to exercise while playing independently. It uses sensors to detect the pet's position and movements in real time, and the control means adjusts the movement of the play equipment appropriately. In addition, the artificial intelligence means generates movements and sounds that attract the pet's interest, and the exercise management means manages a schedule to ensure the pet gets enough exercise.

[1336] A natural language description of what the program does

[1337] Server Processing

[1338] 1. The server first instantiates the smart mouse and performs the initial configuration, which includes setting the initial position of the smart mouse and a list of obstacles.

[1339] 2. The server calls the activate method of the smart mouse to issue a start instruction, and monitors that the smart mouse has started operating.

[1340] 3. The server calls the run method of the smart mouse and controls the operation of the smart mouse while detecting the pet's position and movements. Specifically, it collects sensor data, adjusts its movements according to the pet's position, and monitors the pet's exercise status.

[1341] 4. The server calls the smart mouse's deactivate method to stop it from operating.

[1342] Terminal handling

[1343] 1. The terminal provides an interface that displays the initial position of the smart mouse and information on obstacles, allowing the user to check the current system status.

[1344] 2. The device detects the location of obstacles and inputs them so that the smart mouse can avoid them. It also updates and displays the location of the smart mouse in real time as it moves.

[1345] 3. When the smart mouse detects a pet, the device will display and notify the pet by displaying a corresponding reaction (for example, playing a sound or escaping).

[1346] User operations

[1347] 1. The user installs the smart mouse, turns it on through the terminal, and starts the smart mouse program.

[1348] 2. The user can check on the display screen of the device whether the smart mouse is working properly, so that if a problem occurs, they can take action immediately.

[1349] 3. The user observes how the Smart Mouse responds to their pet and adjusts settings as needed, which may include changing the location of obstacles or adjusting the Smart Mouse's movement patterns.

[1350] 4. Users can set a schedule for the smart mouse so that their pet gets enough exercise and maintain their pet's health.

[1351] Specific examples

[1352] Example 1: Server operation

[1353] After creating an instance of the smart mouse, the server calls the activate method to start the smart mouse and moves it appropriately while collecting the pet's location information. Through cloud-based sensor data analysis, the server generates movements that interest the pet in real time.

[1354] Example 2: Displaying a terminal

[1355] The terminal displays the movement of the smart mouse, notifying the user of the current system status in real time. It also has the function of detecting obstacles and displaying the action to avoid them.

[1356] Example 3: User operation

[1357] The user can start the smart mouse from the terminal and watch the pet start playing. If the pet is not getting enough exercise, the user can start the smart mouse again through the terminal to ensure that the pet gets enough play time.

[1358] The above is a specific embodiment of the automatic pet play equipment system according to the present invention. This system can effectively alleviate the lack of exercise for pets and contribute to maintaining their health.

[1359] The processing flow will be explained below.

[1360] Server Processing

[1361] Step 1:

[1362] The server creates an instance of the smart mouse, and during this initialization process it sets the initial position of the smart mouse and empties the obstacle list.

[1363] Step 2:

[1364] The server invokes the activate method of the smart mouse to activate it, which causes the smart mouse to transition from a standby state to an active state.

[1365] Step 3:

[1366] The server calls the run method to control the operation of the smart mouse, which includes the process of collecting sensor data and pet location and movement information.

[1367] Step 4:

[1368] The server determines the smart mouse's next move based on data from the sensors, performs calculations to avoid obstacles, and generates optimal movement patterns to attract pets.

[1369] Step 5:

[1370] The server generates sounds and movements for the smart mouse to react to the pet. For example, when the pet approaches within a certain range, the smart mouse plays a sound and performs a predictive action.

[1371] Step 6:

[1372] The server periodically monitors the smart mouse's exercise status, and if the pet is not getting enough exercise, it issues an instruction to restart the operation.

[1373] Step 7:

[1374] The server calls the deactivate method of the smart mouse to stop the operation of the smart mouse, thereby controlling the smart mouse to stop in a safe place.

[1375] Terminal handling

[1376] Step 1:

[1377] The terminal displays the initial position of the smart mouse and various setting information on the initial screen of the system, where the user can check the current status of the system.

[1378] Step 2:

[1379] The terminal provides an interface for the user to set the location of the obstacle, which is then sent to the server and added to the obstacle list of the smart mouse.

[1380] Step 3:

[1381] The terminal updates and displays the current location of the smart mouse in real time based on the sensor data, allowing the user to check the operating status of the smart mouse.

[1382] Step 4:

[1383] When the smart mouse detects the pet's location, the terminal notifies the user of the sound and movement that is being made, allowing the user to check whether the system is operating normally.

[1384] Step 5:

[1385] The device adjusts the smart mouse's movement patterns and schedule based on user input, for example, scheduling additional play time if the mouse is not getting enough exercise.

[1386] User operations

[1387] Step 1:

[1388] The user places the smart mouse in the cat's play area and turns it on using the terminal. As an initial setting, the user turns on the smart mouse and checks the settings on the terminal.

[1389] Step 2:

[1390] Users can monitor the operation of the smart mouse on the device screen, check for abnormalities and obstacle detection, and be prepared to deal with any problems that may arise.

[1391] Step 3:

[1392] The user observes how their pet reacts to the smart mouse, and if the pet shows no interest, they can change the behavior pattern from the terminal.

[1393] Step 4:

[1394] Users can adjust the smart mouse's operating schedule as needed to ensure efficient exercise for their pets, for example, by setting a schedule to activate the smart mouse at a specific time of day.

[1395] Step 5:

[1396] After use, the user turns off the power of the smart mouse, shuts down the system from the terminal, and finally stores the smart mouse in a safe place.

[1397] Example 1

[1398] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1399] Conventional automatic pet play equipment systems often fail to adequately alleviate pets' lack of exercise, limiting their effectiveness. Furthermore, they require users to frequently operate the system manually, placing a heavy burden on the user. Furthermore, they lack the ingenuity to continuously attract pets' interest, and pets often become bored quickly.

[1400] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1401] In this invention, the server includes a sensor means for detecting the position and movement of the pet, a control means for moving the play equipment based on the detected position and movement of the pet, an artificial intelligence means for generating a movement pattern of the play equipment, an obstacle avoidance means for detecting obstacles and performing avoidance actions, an exercise management means for grasping the exercise status and periodically activating the system, a data analysis means for performing cloud-based data analysis, an interface means for operating and monitoring the system from a user terminal, and a schedule management means for setting and managing the pet's exercise schedule. This makes it possible to effectively manage the pet's exercise, reduce the burden on the user, and continuously attract the pet's interest.

[1402] An "automated pet play equipment system" is an automated play equipment system designed to help pets get enough exercise and have fun playing.

[1403] A "sensor" is a device that detects the position and movements of a pet, and provides information to control the movement of play equipment based on that data.

[1404] The "control means" is a mechanism that appropriately adjusts the movement of the play equipment based on data obtained from the sensor, encouraging the pet to exercise.

[1405] "Artificial intelligence means" refers to algorithms and technologies for analyzing pet behavior data and generating optimal movements and sounds for play equipment.

[1406] The "obstacle avoidance means" is a function that allows the play equipment to detect obstacles while moving and take appropriate action to avoid them.

[1407] The "exercise management means" is a system for grasping the pet's exercise status and periodically activating the play equipment as necessary.

[1408] The "data analysis means" is a cloud-based technology that analyzes pet behavior data and optimizes the movement of play equipment.

[1409] The "interface means" is a device that provides an operation screen for the user to operate and monitor the system.

[1410] The "schedule management means" is a function for efficiently managing the pet's exercise time and activating the play equipment at the appropriate time.

[1411] The present invention relates to an automatic pet play equipment system for relieving pets' lack of exercise. This system detects the pet's position and movements and automatically controls the play equipment to encourage appropriate exercise. Specifically, the system includes a sensor that detects the pet's position and movements, a control means that moves the play equipment based on the detected data, an artificial intelligence means that generates the movement and sound of the play equipment, an obstacle avoidance means that detects and avoids obstacles, and an exercise management means that monitors the exercise status and is activated periodically.

[1412] Server Roles

[1413] The server first creates an instance of a pet toy called a smart mouse and performs initial setup. This setup includes setting the smart mouse's initial position and a list of obstacles. The server calls the smart mouse's activate method to start the smart mouse. Next, it uses the run method to collect sensor data and control the smart mouse's operation based on the pet's position and movement. It then calls the deactivate method to stop the smart mouse. Specifically, it uses cloud-based data analysis means to analyze the pet's movements in real time and generate optimal movement for the toy.

[1414] Device Role

[1415] The terminal provides an interface that displays the initial position of the smart mouse and obstacle information, allowing users to check the current status of the system in real time. The terminal also updates and displays the position of the smart mouse in real time based on sensor data. Furthermore, if a pet comes into contact with the smart mouse, the terminal notifies the user of the reaction. For example, when a pet approaches the smart mouse, a notification will be displayed saying, "Your pet has started playing."

[1416] User operations

[1417] First, the user installs the smart mouse, turns it on through the terminal, and starts the smart mouse program. Next, the user checks whether the smart mouse is working properly on the terminal display screen. If a problem occurs, the user can reconfigure the obstacle location and the smart mouse's movement through the terminal. In addition, the user can set an exercise schedule for the smart mouse to efficiently manage their pet's exercise time.

[1418] Specific examples

[1419] Example 1: Server installation

[1420] The server creates an instance of the smart mouse and activates it using the activate method. It then collects the pet's location information and performs cloud-based data analysis to generate appropriate play equipment movements.

[1421] Example 2: Using a terminal

[1422] The terminal displays the movement of the smart mouse, notifying the user of the current system status in real time. It also has the function of detecting obstacles and displaying the action to avoid them.

[1423] Example 3: User operation

[1424] The user activates the smart mouse from the device and observes how the pet begins to play. If the pet is not getting enough exercise, the user activates the smart mouse again to ensure that the pet gets adequate playtime.

[1425] Example prompts for generative AI models

[1426] "Please explain what the following system does. Explain in detail how an automated pet toy operates according to instructions from a server, a device, and a user. Include examples of specific hardware and software components."

[1427] In this way, the system of the present invention can effectively alleviate the lack of exercise required by pets, reduce the burden on users, and continuously attract the interest of pets.

[1428] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1429] The flow of this system's program processing

[1430] Step 1:

[1431] Initialization and Instantiation

[1432] The server creates an instance of the smart mouse and sets its initial position and obstacle list. Specifically, it calls the initialize_smart_mouse() method, and inputs the initial X and Y coordinates of the smart mouse and the position data of the obstacles. Based on this data, it sets the smart mouse in a state where it can start operating. As an output, the smart mouse is placed in its initial position and the obstacle list is loaded into the system.

[1433] Step 2:

[1434] Starting the Smart Mouse

[1435] The server invokes the activate method of the smart mouse to activate it. The activate command is given as input, and the system transitions the smart mouse's sensor to an active state. As an output, the smart mouse starts operating and begins collecting sensor data.

[1436] Step 3:

[1437] Sensor data collection and analysis

[1438] The server collects real-time location and movement data from the smart mouse's sensor. The sensor data is periodically sent as input, and a cloud-based data analysis tool operates based on this data to analyze the pet's location and movement. The output is an analysis result of the pet's current location and movement.

[1439] Step 4:

[1440] Controlling movement according to pet behavior

[1441] The server controls the operation of the smart mouse based on the analysis results. The analyzed pet's position data and predicted movement are given as input, and the artificial intelligence means operates to generate the movement pattern of the play equipment. As output, the next movement pattern of the smart mouse is calculated and the instruction is sent to the smart mouse.

[1442] Step 5:

[1443] Obstacle Avoidance

[1444] The server performs processing to avoid obstacles when the smart mouse moves. Data from the obstacle sensor is used as input to operate the obstacle avoidance means. As output, a new movement pattern to avoid the obstacle is generated and sent to the smart mouse.

[1445] Step 6:

[1446] Sending data to the user interface

[1447] The server sends sensor data and analysis results to the user's device, allowing the user to monitor the system status. The latest data on the server is used as input, and data displayed in real time on the user's device is sent as output.

[1448] Step 7:

[1449] Resetting by user operation

[1450] The user reconfigures the smart mouse's operation and obstacle positions through the terminal. The user's operation instructions are given as input, and the system accepts them and performs new settings. As output, the smart mouse's operation parameters and obstacle list are updated.

[1451] Step 8:

[1452] Managing your exercise schedule

[1453] The user sets an exercise schedule for the smart mouse to maintain the health of their pet. The exercise time and frequency specified by the user are used as input, and the schedule management means reflects this in the system. As output, the smart mouse will automatically start and stop based on the set schedule.

[1454] Step 9:

[1455] Stopping Smart Mouse

[1456] When the exercise session ends, the server calls the deactivate method of the smart mouse to stop the smart mouse operation. The command to end the exercise session is given as input, and the system completely stops the smart mouse operation. As an output, the smart mouse is safely stopped.

[1457] Through the above specific processing steps, the automatic pet play equipment system can effectively alleviate the lack of exercise for pets and reduce the user's hassle.

[1458] (Application example 1)

[1459] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1460] Automatic play equipment systems play an important role in helping pets get enough exercise, but conventional systems have difficulty monitoring a pet's exercise status in real time and providing appropriate exercise patterns based on that data. Furthermore, they lack an interface that allows users to easily check the system status and the pet's response, making it difficult to effectively manage a pet's exercise plan.

[1461] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1462] In this invention, the server includes a sensor that detects the position and movement of the pet, a control means that moves the play equipment based on the detected position and movement of the pet, an artificial intelligence means that generates a movement pattern for the play equipment, an obstacle avoidance means that detects obstacles and takes action to avoid them, an exercise management means that grasps the exercise status and activates periodically, a data analysis means that monitors the pet's movements in real time and generates recommended play equipment and exercise patterns, a recording means that saves the pet's exercise status and uses it for future exercise plans, and a display means that allows the user to check the system status and the pet's reaction through an interface. This makes it possible to eliminate a lack of exercise for pets and maintain their health.

[1463] A "sensor for detecting the position and movement of a pet" is a device used to detect the current position and movement of a pet in real time.

[1464] The "control means for moving the play equipment based on the detected position and movement of the pet" is a control system for appropriately moving the play equipment based on information from the sensor.

[1465] "Artificial intelligence means for generating movement patterns for play equipment" means means using AI technology to generate movement or movement patterns that attract pets.

[1466] The "obstacle avoidance means for detecting an obstacle and taking action to avoid it" is a system for detecting an obstacle so that the play equipment does not collide with it and taking action to avoid it.

[1467] The "exercise management means for grasping the exercise status and activating it periodically" is a management system for monitoring the exercise status of a pet and activating the automatic play equipment periodically.

[1468] "Data analysis means for monitoring pet movements in real time and generating recommended play equipment and exercise patterns" refers to a means for analyzing pet movements in real time and generating optimal play equipment and exercise patterns based on that data.

[1469] "Means for recording the exercise status of a pet and using it for future exercise planning" refers to a means for storing the exercise data of a pet and creating future exercise plans based on that information.

[1470] "Display means that allows the user to check the system status and the pet's reaction through an interface" refers to a display device and an interface that allows the user to check the current status of the system and the behavior of the pet.

[1471] This invention is an automatic pet play equipment system that effectively eliminates the lack of exercise for pets and contributes to maintaining their health. This system is composed of three entities: a server, a terminal, and a user, each of which plays a specific role.

[1472] Server Processing

[1473] The server creates an instance of the smart mouse and performs initial settings within the pet shop. It sets the initial position of the smart mouse and a list of obstacles, and after creating the instance, calls the smart mouse's activate method to issue an activation command. The server uses sensors to collect data on the pet's position and movement, and appropriately controls the smart mouse's movement based on that data. Furthermore, the server uses AI technology to analyze the pet's movement patterns and generate movements and sounds that interest the pet. Specifically, it analyzes the data using AI modules such as TensorFlow and Keras.

[1474] Terminal handling

[1475] The terminal monitors the status of the smart mouse and the pet's reaction in real time through a user interface. It displays the initial position and obstacle information, allowing the user to check the current status of the system. The terminal communicates with the server via Bluetooth or Wi-Fi to receive sensor data and analysis results. The terminal also stores the pet's exercise status, providing a means of recording it for use in future exercise planning.

[1476] User operations

[1477] Users simply activate the smart mouse through their device and watch their pet begin to play. If their pet is not getting enough exercise, they can simply reactivate the smart mouse through their device to ensure their pet gets the appropriate playtime. They can also monitor their pet's behavior through the device's display function and adjust play equipment and settings as needed.

[1478] Specific application examples and prompt sentence examples

[1479] A specific application example is a situation where a pet owner tries out toys for their pet in a pet shop. The user launches the smartphone app and moves the smart mouse together with their pet. The app analyzes the pet's movements in real time and generates recommended toys and exercise patterns based on that data. This allows the user to more effectively alleviate their pet's lack of exercise.

[1480] Example prompt sentence:

[1481] (Setting) Check the initial position and set the list of obstacles.

[1482] (Start) Start the smart mouse and check your pet's movements.

[1483] (Analysis) Analyze your pet's position in real time and generate interesting movements.

[1484] (Stop) Stop the Smart Mouse if necessary.

[1485] This system will help pets get enough exercise and effectively maintain their health.

[1486] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1487] Step 1:

[1488] The server creates an instance of the smart mouse and initializes the location information of the pet. The input includes the pet's initial location data and a list of obstacles. Based on this data, it calculates a route to avoid obstacles and creates the initial location data and a movement route as output.

[1489] Step 2:

[1490] The server invokes the activate method of the smart mouse to start the smart mouse. The server then monitors whether the smart mouse starts operating normally. The input includes the initial setting information of the smart mouse. The output generates a log that confirms that the smart mouse has started operating.

[1491] Step 3:

[1492] The server calls the smart mouse's run method and uses sensors to collect pet position and movement data in real time. The input data is position and movement data from the sensors, as well as obstacle information. The server analyzes the data and generates movements of the play equipment and interesting movements based on the pet's movements. The output is the movement pattern of the play equipment and movement instructions.

[1493] Step 4:

[1494] The terminal receives the sensor data and analysis results from the server and displays them in real time through the user interface. The input data is the sensor data from the server and the operation information of the play equipment. The terminal displays this visually, allowing the user to check the current status of the system. The output is a visual status display on the user interface.

[1495] Step 5:

[1496] The user monitors the pet's exercise status through the device and adjusts the settings as needed. Input includes the information displayed on the device and the user's operation instructions. Based on this, the settings and movement patterns of the play equipment are adjusted. The updated settings and the applied movement patterns are generated as output.

[1497] Step 6:

[1498] The server periodically records the pet's exercise status data and stores it for use in future exercise planning. The input data is exercise status data collected in real time. Based on this, the data is stored in a recording device and can be retrieved when needed. A recorded data file is generated as an output.

[1499] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1500] The present invention relates to an automatic pet play equipment system that combines an emotion engine that recognizes the user's emotions, and is specifically implemented as follows.

[1501] System Overview

[1502] The automatic pet play equipment system of the present invention (hereinafter referred to as "smart mouse") is designed to alleviate the lack of exercise for pets and integrates multiple functions. Specifically, it includes a sensor to detect the position and movement of the pet, a control means to move the play equipment, an artificial intelligence means to generate the movement pattern of the play equipment, an obstacle avoidance means to detect and avoid obstacles, an exercise management means to manage the exercise status and periodically activate the play equipment, and an emotion engine to recognize the user's emotions.

[1503] A natural language description of what the program does

[1504] Server Processing

[1505] 1. The server creates an instance of the smart mouse and performs the initial configuration, which includes setting the initial position of the smart mouse and a list of obstacles.

[1506] 2. The server invokes the activate method of the smart mouse to activate the smart mouse.

[1507] 3. The server calls the run method, detects the pet's position and movement based on sensor data, and moves the smart mouse appropriately.

[1508] 4. The server uses artificial intelligence means to generate movements and sounds that will attract the pet's attention.

[1509] 5. The server analyzes the user's emotional state through the emotion engine, collecting the user's voice and facial expression data and evaluating the status.

[1510] 6. The server adjusts the pet's play patterns and the behavior of the play equipment based on the results of the emotion engine. For example, if the user is feeling stressed, it selects a behavior pattern that will relax both the pet and the user.

[1511] 7. The server monitors the pet's exercise status using the exercise management means and restarts the smart mouse if necessary.

[1512] 8. Finally, the server calls the smart mouse's deactivate method to safely stop the smart mouse's operation.

[1513] Terminal handling

[1514] 1. The terminal provides an interface that displays the initial position and obstacle information on the initial screen of the smart mouse.

[1515] 2. The device accepts input from the user to set the location of the obstacle and sends it to the server.

[1516] 3. The terminal updates the position and operating status of the smart mouse in real time and displays it to the user.

[1517] 4. If the user's emotional state changes, the device notifies the server of the change.

[1518] 5. The terminal can adjust the operation patterns and schedules of the play equipment based on instructions from the user.

[1519] User operations

[1520] 1. The user places the smart mouse in the pet's play area and turns it on through the terminal.

[1521] 2. After confirming the initial settings, the user can monitor the system status through the terminal, set the obstacle location as needed, and adjust the operation of the smart mouse.

[1522] 3. After the smart mouse starts working, the user can observe the pet's reaction and change the operation settings via the terminal.

[1523] 4. If the user's emotional state changes, the user notifies the server via the device, which then uses the emotion engine to adjust the server's behavior.

[1524] 5. After finishing playing, the user should turn off the smart mouse and shut down the system from the terminal. Then store the smart mouse in a safe place.

[1525] Specific examples

[1526] Example 1: Server operation

[1527] After creating an instance of the smart mouse, the server calls the activate method to start the smart mouse and moves it appropriately while collecting information on the pet's location.The emotion engine is used to analyze the user's emotional state, and if the user's stress level is high, the smart mouse's movement pattern is changed to make the mouse move in a way that helps the user relax.

[1528] Example 2: Displaying a terminal

[1529] The terminal displays the operation status of the smart mouse in real time, allowing the user to check the current system status, and also displays the user's emotional state fluctuations and transmits data to the server accordingly.

[1530] Example 3: User operation

[1531] The user installs the smart mouse, turns it on using a terminal, and checks its operation. If the user's emotional state changes, the terminal transmits that information, and the smart mouse adjusts its behavior based on that information. The user also observes their pet, adjusts further settings as needed, and finally shuts down the system.

[1532] The above is a specific embodiment of an automatic pet play equipment system incorporating an emotion engine according to the present invention. This system not only helps pets get more exercise but also provides play that responds to the user's emotional state, ensuring the happiness of both the pet and the user.

[1533] The processing flow will be explained below.

[1534] Server Processing

[1535] Step 1:

[1536] The server creates an instance of the smart mouse, which initializes the initial position of the smart mouse and the list of obstacles.

[1537] Step 2:

[1538] The server invokes the activate method of the smart mouse to activate the smart mouse, which causes the smart mouse to start operating.

[1539] Step 3:

[1540] The server calls the run method, receives data from the sensor, and detects the pet's position and movement in real time. It controls the movement of the smart mouse based on the acquired data.

[1541] Step 4:

[1542] The server analyzes the sensor data and moves the smart mouse according to the pet's current position and movement. It also detects the location of obstacles and takes action to avoid them.

[1543] Step 5:

[1544] The server uses artificial intelligence to generate movements and sounds that interest the pet, and designs and executes optimal reactions to the pet's movements.

[1545] Step 6:

[1546] The server analyzes the user's emotional state through an emotion engine, extracting emotional data from the user's voice and facial expressions, and uses that data to determine the user's stress level and happiness.

[1547] Step 7:

[1548] The server adjusts the behavior of the smart mouse based on the user's emotional state, for example, if the user is in a relaxed state, the server will slow down the behavior of the smart mouse to maintain a relaxed mood.

[1549] Step 8:

[1550] The server monitors the pet's exercise status using the exercise management means, periodically activates the smart mouse, and if the pet is not getting enough exercise, activates the smart mouse again to encourage more exercise.

[1551] Step 9:

[1552] The server calls the deactivate method of the smart mouse to stop the smart mouse from operating, and in the process safely places the smart mouse in a stopped position.

[1553] Terminal handling

[1554] Step 1:

[1555] The terminal displays the initial position and setting information on the initial screen of the smart mouse, allowing the user to check the current status of the system.

[1556] Step 2:

[1557] The terminal provides an interface for the user to input the location of the obstacle, which is then sent to the server and added to the obstacle list of the smart mouse.

[1558] Step 3:

[1559] The terminal updates and displays the current location of the smart mouse based on real-time data from the sensor, allowing the user to monitor the movement of the smart mouse in real time.

[1560] Step 4:

[1561] When a user inputs emotional information or provides voice or facial expression data, the device sends it to the server, which then analyzes the data using an emotion engine.

[1562] Step 5:

[1563] The device will detect the pet's location and display a notification when the smart mouse performs a specific action, allowing the user to check whether the system is working properly.

[1564] Step 6:

[1565] The device can adjust the smart mouse's motion patterns and schedules based on user instructions, such as setting up additional play time or selecting special motion patterns.

[1566] User operations

[1567] Step 1:

[1568] The user places the smart mouse in the cat's play area and turns it on using the terminal. As an initial setting, the user turns on the smart mouse and checks the settings on the terminal.

[1569] Step 2:

[1570] The user checks the location of obstacles and the status of the system through the terminal, changes the settings as necessary, and verifies that the system is operating normally.

[1571] Step 3:

[1572] After the smart mouse starts working, users can observe their pet's behavior and make additional settings and adjustments through the device, for example, increasing the speed if the movement is slow.

[1573] Step 4:

[1574] When a user provides emotion information, the data is input through the terminal, and the server uses the emotion engine to select an appropriate behavior pattern.

[1575] Step 5:

[1576] After finishing playing, the user turns off the smart mouse and shuts down the system from the terminal, and finally puts the smart mouse in a safe place.

[1577] Example 2

[1578] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1579] In today's living environment, lack of exercise for pets and fluctuations in users' emotions are becoming problems. It is particularly difficult for busy users to manage their pets' exercise and provide them with play. Furthermore, existing automatic pet play equipment systems are unable to provide play that responds to the user's emotional state, making it difficult to provide an environment that satisfies both the user and the pet.

[1580] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a sensor means for detecting the position and movement of the pet, a control means for moving the play equipment based on the detected position and movement of the pet, an artificial intelligence means for generating a movement pattern of the play equipment, an obstacle avoidance means for detecting obstacles and performing an avoidance operation, an exercise management means for grasping the exercise status and periodically activating the same, an emotion recognition means for analyzing the emotional state of the user, and an emotion response means for adjusting the operation of the play equipment based on the analyzed emotional state. This makes it possible to alleviate the lack of exercise for the pet and provide play that takes into account the emotional state of the user.

[1581] An "automatic pet play system" is a system that includes a device for playing with a pet that operates automatically to encourage exercise for the pet.

[1582] "Sensor means" refers to devices or technologies for collecting information from the surrounding environment or objects, and specifically refers to devices that detect the position and movements of a pet.

[1583] "Control Means" refers to the devices or technology used to manage and control the operation of a system or device, specifically a device that moves play equipment based on the detected position and movement of a pet.

[1584] "Artificial intelligence means" refers to technology that uses data analysis and machine learning to make autonomous decisions and take action, and specifically refers to devices and software for generating movement patterns for playground equipment.

[1585] "Obstacle avoidance means" refers to devices or technologies that detect surrounding obstacles and take action to avoid them.

[1586] "Exercise management means" refers to devices and technologies for grasping the level and status of exercise and for managing and adjusting it, and is a device that grasps the pet's exercise status and activates play equipment periodically.

[1587] "Emotion recognition means" refers to devices and technologies for analyzing the user's emotional state, specifically devices that analyze voice and facial expressions.

[1588] "Emotion response means" refers to a device or technology that responds or behaves appropriately based on the analyzed emotional state, and specifically refers to a device that adjusts the operation of play equipment.

[1589] The present invention relates to an automatic pet play equipment system that combines an emotion engine that recognizes the user's emotions, and is specifically implemented as follows.

[1590] System Overview

[1591] The automatic pet play equipment system of the present invention (hereinafter referred to as "smart mouse") is designed to alleviate the lack of exercise for pets and integrates multiple functions. Specifically, it includes a sensor means for detecting the position and movement of the pet, a control means for moving the play equipment, an artificial intelligence means for generating the movement pattern of the play equipment, an obstacle avoidance means for detecting and avoiding obstacles, an exercise management means for grasping the exercise status and periodically activating the play equipment, and an emotion recognition means and an emotion response means for analyzing the user's emotional state and adjusting the operation of the play equipment.

[1592] Server Processing

[1593] The server creates an instance of the smart mouse and performs initial settings. These initial settings include the smart mouse's initial position and a list of obstacles. The server calls the smart mouse's activate method to start the smart mouse. The server detects the pet's position and movement based on sensor data and moves the smart mouse appropriately. The sensors used are cameras and motion sensors, and data is acquired in real time.

[1594] Furthermore, the server uses artificial intelligence means to generate movements and sounds that will attract the pet's attention. For example, TensorFlow and PyTorch are used as AI platforms. The server analyzes the user's emotional state through emotion recognition means (e.g., natural language processing software for voice recognition and image analysis software for facial expression recognition) and selects an appropriate movement pattern based on the emotion response means. Based on this information, if the user feels stressed, the server changes the movement pattern of the smart mouse to provide relaxing movements. MongoDB and other database technologies are used to store and analyze movement data, and the server restarts the smart mouse if the pet is not getting enough exercise.

[1595] Terminal handling

[1596] The device provides an interface that displays the initial position and obstacle information on the smart mouse's initial screen. For example, the interface can be built using frameworks such as React or Vue.js. The location information of obstacles set by the user is sent to the server, which displays the smart mouse's position and operating status in real time. The device manages the operation of the smart mouse using real-time communication technologies such as WebSocket. The device also has a notification system (such as Firebase Cloud Messaging) that notifies the server when the user's emotional state changes.

[1597] User operations

[1598] The user places the smart mouse in the pet's play area and turns on the device. The user uses the device to check the initial settings and monitor the system status. The device can be used to set the location of obstacles and adjust the smart mouse's behavior. If the user's emotional state changes during play, it is communicated through the device, and the server analyzes it and takes appropriate action. Finally, after finishing play, the smart mouse is shut down and stored in a safe place.

[1599] Specific examples

[1600] Example 1: Server operation

[1601] After creating an instance of the smart mouse, the server calls the activate method to start the smart mouse and makes it operate appropriately while collecting the pet's location information.The emotion engine is used to analyze the user's emotional state, and if the stress level is high, the smart mouse's movement pattern is changed to make it operate in a relaxing manner.

[1602] Example 2: Displaying a terminal

[1603] The terminal displays the operation status of the smart mouse in real time, allowing the user to check the current system status, and also displays the user's emotional state fluctuations and transmits data to the server accordingly.

[1604] Example 3: User operation

[1605] The user installs the smart mouse, turns it on using a terminal, and checks its operation. If the user's emotional state changes, the terminal transmits that information, and the smart mouse adjusts its behavior based on that information. The user observes their pet, changes settings as needed, and finally shuts down the system.

[1606] Prompt Sentence Examples

[1607] "Please explain what behavior pattern should be selected in an automatic pet play system when the user's emotional state changes."

[1608] This system not only helps pets overcome lack of exercise but also provides play that responds to the user's emotional state, ensuring the happiness of both the pet and the user.

[1609] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1610] Step 1:

[1611] The server creates an instance of the smart mouse and performs the initial settings.

[1612] Input: Smart Mouse initial setting information (initial position, obstacle list, etc.)

[1613] Output: Smart Mouse initial settings completed

[1614] Specific operation: The server creates a new smart mouse instance and sets the initial position and obstacle list specified in the program code. This initial information is often obtained from a database.

[1615] Step 2:

[1616] The server starts the smart mouse.

[1617] Input: Start command

[1618] Output: Smart Mouse activated

[1619] Specific operation: The server calls the activate method of the smart mouse to activate the smart mouse's sensors and motors. This operation turns on the smart mouse's LED and starts operation.

[1620] Step 3:

[1621] The server detects the pet's position and movements based on sensor data and moves the smart mouse appropriately.

[1622] Input: Sensor data (location information, motion information)

[1623] Output: Smart Mouse movement command

[1624] Specific operation: The server analyzes data obtained from the infrared sensor and camera installed in the smart mouse to identify the pet's current location and movement. Based on the analysis results, it calculates the direction and distance the smart mouse should move and sends a movement command to the smart mouse.

[1625] Step 4:

[1626] The server generates the movements and sounds using artificial intelligence means.

[1627] Input: Pet behavioral patterns and environmental data

[1628] Output: Generated movements and sounds

[1629] How it works: The server uses AI frameworks such as TensorFlow and PyTorch to analyze data on your pet's past behavior and current environment, and based on this, generates new movements and sounds that will attract your pet's attention and sends them to the smart mouse.

[1630] Step 5:

[1631] The server analyzes the user's emotional state through emotion recognition means.

[1632] Input: User's voice data, facial expression data

[1633] Output: Parsed emotional state

[1634] Specific operation: The server analyzes the user's voice data using voice recognition software (using natural language processing) and facial expression data using image recognition software. For example, if the user says "I'm happy" or "I'm tired," or if they smile or frown, the server analyzes the data to evaluate their emotional state.

[1635] Step 6:

[1636] The server adjusts the behavior of the play equipment based on the emotion response means.

[1637] Input: Parsed emotional state

[1638] Output: Coordinated movement pattern

[1639] Specific behavior: The server analyzes the user's emotional state and changes the behavior pattern of the smart mouse. For example, if the user is feeling stressed, the smart mouse will be configured to move slowly and provide relaxing sounds.

[1640] Step 7:

[1641] The server uses the exercise management means to monitor the pet's exercise status and restarts the smart mouse if necessary.

[1642] Input: Exercise data

[1643] Output: Restart command

[1644] How it works: The server continuously monitors your pet's past exercise data stored in a database such as MongoDB, assesses whether it is getting enough exercise, and if it is, issues a command to restart the smart mouse to encourage your pet to exercise.

[1645] Step 8:

[1646] The server stops the smart mouse from working.

[1647] Input: Stop command

[1648] Output: Smart Mouse stopped

[1649] Specific operation: The server calls the smart mouse's deactivate method to safely stop the sensors and motors. This turns off the smart mouse's LED and completely stops its operation.

[1650] Step 9:

[1651] The device will display the initial position and obstacle information on the initial screen.

[1652] Input: Initialization information (initial position, obstacle list, etc.)

[1653] Output: Initial screen display

[1654] Specific operation: The device uses JavaScript frameworks such as React and Vue.js to display the initial setting information on the user interface, allowing users to easily check the initial position of the smart mouse and obstacle information.

[1655] Step 10:

[1656] The terminal accepts input from the user and sends it to the server.

[1657] Input: User setting input (obstacle position, operation instructions, etc.)

[1658] Output: Data sent to the server

[1659] Specific operation: The terminal receives the user's input of the obstacle position and the smart mouse's operation instructions in real time and sends them to the server, which then adjusts the smart mouse's operation based on the user's instructions.

[1660] Step 11:

[1661] The terminal updates the position and operating status of the smart mouse and displays it to the user.

[1662] Input: Smart mouse status data (location information, operation information, etc.)

[1663] Output: Real-time display

[1664] Specific operation: The device uses real-time communication technology such as WebSocket to display the current location and operating status of the smart mouse on the user's screen. For example, a smart mouse icon is displayed on a map, updated in real time.

[1665] Step 12:

[1666] The terminal notifies the server of changes in the user's emotional state.

[1667] Input: Emotional state data (feedback from the user)

[1668] Output: Notification data to the server

[1669] Specific operation: The device uses a system (e.g., Firebase Cloud Messaging) to detect changes in the user's emotional state and notify the server, allowing the server to adjust the behavior of the smart mouse according to the user's emotional state.

[1670] Step 13:

[1671] The terminal adjusts the movement pattern of the play equipment based on the user's instructions.

[1672] Input: User instructions (operation patterns, schedule settings, etc.)

[1673] Output: Instruction data to the server

[1674] Specific operation: Based on the user's instructions, the terminal adjusts the operation pattern of the smart mouse and sends the setting information to the server, so that the operation of the smart mouse can be changed according to the user's wishes.

[1675] Step 14:

[1676] The user installs the smart mouse and turns it on through the terminal.

[1677] Input: Power on command, installation location information

[1678] Output: Smart mouse startup status

[1679] Specific operation: The user places the smart mouse in the pet play area and clicks the power button on the device to start the system, which then starts the smart mouse.

[1680] Step 15:

[1681] The user confirms the initial configuration and monitors the system status.

[1682] Input: Initialization information (initial position, obstacle list, etc.)

[1683] Output: System status monitoring information

[1684] Specific operation: The user checks the initial setting information on the terminal, and then monitors the system's operating status. Based on the initial setting information displayed on the terminal, the user checks whether the system is operating normally.

[1685] Step 16:

[1686] The user observes the pet's reactions and changes the settings.

[1687] Input: Pet reaction information, setting change instructions

[1688] Output: New configuration information

[1689] Specific operation: After the smart mouse starts operating, the user can observe the pet's reaction and change the operation settings through the terminal if necessary. For example, if the pet is not interested, the operation pattern can be changed.

[1690] Step 17:

[1691] The user communicates changes in their emotional state through the terminal.

[1692] Input: Emotional state data (user feedback)

[1693] Output: Emotional state notification data

[1694] Specific operation: The user's emotional state (relaxed, stressed, etc.) is communicated to the server through button presses or voice input on the device. The server then adjusts the operation of the smart mouse in real time based on this information.

[1695] Step 18:

[1696] When the user has finished playing, he or she shuts down the smart mouse and stores it in a safe place.

[1697] Input: Stop command

[1698] Output:Smart Mouse stopped state

[1699] Specific operation: When the user finishes playing, he / she presses the stop button on the device to stop the smart mouse safely, and then stores the smart mouse in a safe place.

[1700] (Application example 2)

[1701] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1702] For customers who visit physical stores with their pets, there is a need for systems that allow pets to stay comfortable and safe in the store, improving the customer experience. In particular, there is a need for systems that can recognize customers' emotions in real time and adjust the pet's play environment accordingly. There is also a need for a method that allows customers to easily operate and monitor play equipment via smartphone while ensuring their pet's exercise and safety.

[1703] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1704] In this invention, the server includes a sensor that detects the pet's position and movement, a control means that moves the play equipment based on the detected pet's position and movement, an artificial intelligence means that generates a movement pattern for the play equipment, an obstacle avoidance means that detects obstacles and takes action to avoid them, an exercise management means that grasps the exercise status and periodically activates the control, an emotion recognition means that analyzes the user's facial expression or voice to recognize emotions, a means for adjusting the operation of the play equipment based on the recognized emotional state of the user, and an interface for monitoring and controlling the operation status of the play equipment using a smartphone. This allows pets to spend a comfortable time in the store and provides a play environment that matches the customer's emotional state. Furthermore, customers can easily manage and monitor their pet's play environment via their smartphone.

[1705] An "automatic pet play equipment system" is an integrated system that detects the pet's position and movements and operates play equipment appropriately.

[1706] A "sensor" is a device for detecting the location and movement of a pet.

[1707] "Control means" refers to means for moving the play equipment based on the detected position and movement of the pet.

[1708] "Artificial intelligence means" refers to means that utilizes artificial intelligence to generate movement patterns for play equipment.

[1709] The "obstacle avoidance means" is a means for detecting an obstacle and performing an avoidance operation.

[1710] The "exercise management means" is a means for understanding the pet's exercise status and for periodically activating the play equipment.

[1711] The "emotion recognition means" is a means for analyzing the user's facial expression or voice and recognizing the user's emotion.

[1712] The "interface" is a user interface for monitoring and controlling the operating status of the play equipment using a smartphone.

[1713] A "plaything" is a device for pets to play with, and in the case of the present invention, it has an automatic function.

[1714] A "server" is a central control unit that controls the entire system and processes data.

[1715] The present invention is an automatic pet play equipment system that combines an emotion engine that recognizes the user's emotions, and is specifically implemented as follows.

[1716] The system is composed of sensors that detect the pet's position and movements, a control means that moves the play equipment, an artificial intelligence means that generates the play equipment's movement patterns, an obstacle avoidance means that detects and avoids obstacles, an exercise management means that manages the exercise status and periodically activates the play equipment, an emotion engine that recognizes the user's emotions, and an interface that uses a smartphone to monitor and control the system.

[1717] Server Processing

[1718] The server receives data from sensors that detect the pet's position and movement, and controls the play equipment based on that data. It also uses artificial intelligence to generate movement patterns for the play equipment that will interest the pet. It also analyzes the user's emotional state through an emotion engine, recognizing the user's emotional state by analyzing the user's facial expressions or voice. Based on the results, the server adjusts the operation of the play equipment, providing a relaxing environment for the user.

[1719] Terminal handling

[1720] The device (smartphone) provides an interface that allows users to monitor and control the operation status of pet toys in real time. Through this interface, users can set the operation patterns and schedules of the toys and notify their emotional state.

[1721] User operations

[1722] The user configures the system via a smartphone and controls the start and stop of the play equipment. When the user's emotional state changes, the smartphone transmits this information to the server, which then uses an emotion engine to adjust the operation of the play equipment as needed.

[1723] Explanation of program processing

[1724] The server uses hardware such as sensors that detect the pet's position and movements, and a central control unit (server device) that collects and processes this data. Its software includes the OpenCV image processing library, the Requests Python library for making HTTP requests, the Flask web framework, and libraries for recognizing emotions (such as EmotionEngine). Using this software, the server collects data on the pet's position and performs data calculations to appropriately control the play equipment. It also uses the emotion engine to analyze the user's facial expressions and voice data, adjusting the behavior of the play equipment based on the results to provide a play environment that responds to the user's emotional state.

[1725] Specific examples

[1726] While the pet is playing, the user can hold a smartphone and monitor the play equipment's operation in real time.

[1727] If the user is feeling stressed, their emotions are recognized through the smartphone's camera or microphone, and the server changes the play equipment's movement patterns to make them more relaxing.

[1728] When a user is spending time in a store with their pet, the atmosphere of the store is improved by showing other customers that the pet is enjoying a comfortable stay.

[1729] Prompt Sentence Examples

[1730] "Generate code for a smartphone app that works with an automated pet play system in a brick-and-mortar store and analyzes the user's emotions to adjust the pet's play patterns. The app should have different behavior patterns (play, idle, calm) depending on the user's emotional state."

[1731] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1732] Step 1:

[1733] The server initializes the automatic pet playground system. Specifically, it sets the initial position information and obstacle list for the pet in the play area. This initialization allows the system to accurately determine the pet's position and prepare for obstacle avoidance. The input is the initial position information and obstacle list, and the output is the status of the initialization completion.

[1734] Step 2:

[1735] The server receives sensor data and detects the pet's location and behavior in real time. The input is data sent from the sensor, and the output is information about the pet's location and behavior. The server analyzes the sensor data to determine the pet's current location. It also analyzes the behavior information to identify the pet's interests and behavior patterns.

[1736] Step 3:

[1737] The device (smartphone) captures the user's facial expressions and voice through the smartphone's camera and microphone to recognize the user's emotions. The input is the camera image or microphone audio, and the output is the emotion recognition results. The device analyzes the user's emotions using an image processing library (OpenCV) or an emotion recognition library (EmotionEngine), and sends the results to the server.

[1738] Step 4:

[1739] The server analyzes the user's emotional state received through the emotion engine and adjusts the movement pattern of the pet toy. The input is the user's emotional data, and the output is the adjusted movement pattern of the toy. For example, if the user is feeling stressed, the movement pattern will be changed to a slower one that helps the user relax.

[1740] Step 5:

[1741] The server uses artificial intelligence to generate patterns of movement and sounds for the play equipment that will interest the pet. The input is the pet's position information and detected movement data, and the output is the movement pattern of the play equipment. Based on the pet's movement pattern, the server determines movements that will likely interest the pet and the direction in which the play equipment will move.

[1742] Step 6:

[1743] The terminal displays the operating status of the play equipment in real time, allowing the user to check the current system status. The input is the operating status data of the play equipment sent from the server, and the output is the display screen of the smartphone. The user can view this information and judge whether the operation of the play equipment is appropriate.

[1744] Step 7:

[1745] Users can adjust the operation patterns and schedules of play equipment through a terminal. The input is the user's instruction, and the output is the adjusted operation patterns and schedule information of the play equipment. For example, if a user wants their pet to perform a specific movement, they operate the terminal to instruct the server to perform that movement, and the server then executes it.

[1746] Step 8:

[1747] The server uses the exercise management means to monitor the pet's exercise status and restarts the play equipment as necessary. The input is the pet's exercise data and the output is a command to start the play equipment. If it is determined that the pet is not getting enough exercise, the play equipment can be operated again to increase the pet's exercise.

[1748] Step 9:

[1749] Finally, the server safely stops the operation of the play equipment. The input is a stop command, and the output is a stop confirmation status. When the user wants to end play, they send a stop command from their terminal to the server, and the server safely stops the play equipment. The server also periodically monitors the status of the play equipment, and safely stops it if an abnormality occurs.

[1750] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1751] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1752] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1753] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1754] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1755] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1756] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1757] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.a...

Claims

1. An automatic pet play equipment system, A sensor that detects the position and movement of a pet; a control means for moving the play equipment based on the detected position and movement of the pet; artificial intelligence means for generating movement patterns of the play equipment; an obstacle avoidance means for detecting an obstacle and performing an obstacle avoidance operation; An exercise management tool that grasps exercise status and activates it periodically; A system including:

2. 2. The system of claim 1, wherein said artificial intelligence means generates movements and sounds that are appealing to pets.

3. 2. The system according to claim 1, wherein the exercise management means automatically activates a plaything when the pet is not getting enough exercise based on the detected exercise status.

Images