Information processing system, information processing device, information processing method, and program

Abstract

To provide an information processing system capable of improving the convenience of robot control.SOLUTION: An information processing system 1 includes an information conversion unit 101, an operation setting unit 33, and a robot control unit 42. The information conversion unit 101 converts user's input information to an input device into text information. The operation setting unit 33 sets operation command information showing an operation of a robot on the basis of the text information. The robot control unit instructs an operation corresponding to the operation command information to the robot.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to an information processing system, an information processing device, an information processing method, and a program. [Background technology]

[0002] Patent Document 1 below describes a conventional information processing system. This information processing system includes a smart speaker installed in a guest room of a hotel or the like. When a guest staying in a specific guest room speaks to the smart speaker saying, "Please clean," an indicator corresponding to that guest room lights up. A cleaning staff member at the hotel or the like can recognize that the specific guest room is to be cleaned by visually checking that the indicator is lit. After cleaning the specific guest room, the cleaning staff member speaks to the smart speaker saying, "Finished," and the information processing system causes a robot to enter the room. After entering the specific guest room, the robot acquires image data of the interior of the room using a camera mounted on the robot. This information processing system checks the cleaning status of the guest room based on the image data acquired by the robot. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6843418 Summary of the Invention [Problem to be solved by the invention]

[0004] The inventor is considering a system for controlling robots using a smart speaker or the like, which can control multiple types of robots for various purposes, instead of a system that controls only one type of robot as described in Patent Document 1. When multiple types of robots are used, different control methods are required depending on the type of robot, so individual user interfaces must be provided for each type of robot. For example, a cleaning robot must be provided with a button to instruct the robot to clean, and a luggage-transporting robot must be provided with a switch to instruct the robot to transport luggage. This reduces the convenience of a system that controls multiple types of robots.

[0005] The present invention has been made in consideration of the above-mentioned circumstances, and its purpose is to provide an information processing system, an information processing device, an information processing method, and a program that can improve the convenience of robot control. [Means for solving the problem]

[0006] An information processing system according to one aspect of the present invention is an information processing system for controlling a robot, and includes an information conversion unit that converts user input information to a specified input unit into text information, an operation setting unit that sets operation command information indicating the operation of the robot based on the text information, and a robot control unit that instructs the robot to perform an operation according to the operation command information.

[0007] An information processing device according to one aspect of the present invention is an information processing device that controls a robot, and includes an information conversion unit that converts user input information to a specified input unit into text information, an operation setting unit that sets operation command information that indicates the operation of the robot based on the text information, and a robot control unit that instructs the robot to perform an operation according to the operation command information.

[0008] An information processing method according to one aspect of the present invention is an information processing method for controlling a robot, which causes a computer to perform the steps of converting user input information to a specified input unit into text information, setting operation command information indicating the robot's operation based on the text information, and instructing the robot to perform an operation according to the operation command information.

[0009] A program according to one aspect of the present invention is a program for controlling a robot, and causes a computer to execute the steps of converting user input information to a specified input unit into text information, setting operation command information indicating the robot's operation based on the text information, and instructing the robot to perform an operation in accordance with the operation command information. [Effects of the Invention]

[0010] According to the information processing system, information processing device, information processing method, and program of the present invention, it is possible to improve the convenience of robot control. [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 1 is a block diagram showing a schematic configuration of an information processing system according to an embodiment. [Figure 2] FIG. 1 is a block diagram showing the hardware configuration of an input device, a text processing device, and a robot control device according to an embodiment. [Figure 3] FIG. 1 is a block diagram showing the functional configuration of an input device, a text processing device, and a robot control device according to an embodiment. [Figure 4] 10 is a flowchart showing a procedure of a process executed by a robot control unit according to the embodiment. [Figure 5] FIG. 10 is a block diagram showing a schematic configuration of an information processing system according to another embodiment. [Figure 6] FIG. 10 is a block diagram showing the functional configuration of an input device, a text processing device, and a robot control device according to another embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0012] <Embodiment> An embodiment of an information processing system will be described below with reference to the drawings. To facilitate understanding of the description, the same components in the drawings will be denoted by the same reference numerals as much as possible, and duplicate descriptions will be omitted.

[0013] (Outline of information processing system configuration) First, a schematic configuration of an information processing system 1 according to this embodiment will be described with reference to Fig. 1. The information processing system 1 shown in Fig. 1 is a system that provides various services to users by controlling a plurality of robots 50 arranged within a predetermined building. The robots 50 include a plurality of types of robots, such as a cleaning robot 51 that cleans the building, a security robot 52 that patrols the building to provide security, and a transport robot 53 that transports luggage within the building. One or more of each of the robots 51 to 53 is arranged within the building. As shown in Fig. 1, the information processing system 1 includes an input device 10, an imaging device 20, a text processing device 30, and a robot control device 40 in addition to the plurality of types of robots 50.

[0014] The input device 10 is a device that allows a user to input various commands to the robot 50. The input device 10 includes a mobile terminal 11, a smart speaker 12, an operation device 13, and the like. In the mobile terminal 11, various commands to the robot 50 can be input by, for example, touching a touch panel. In the smart speaker 12, various commands to the robot 50 can be input by emitting voice. In the operation device 13, various commands to the robot 50 can be input by pressing any of a plurality of buttons. Information input to the mobile terminal 11, the smart speaker 12, the operation device 13, and the like is converted into text information and then transmitted to the text processing device 30.

[0015] The imaging devices 20 are installed in different locations within the building. The imaging devices 20 acquire image data of the locations where they are installed, and transmit the acquired image data to the robot control device 40. When the text processing device 30 receives the text information transmitted from the input device 10, it estimates the user's command content from the text information and sets operation command information indicating the operation of the robot 50 based on the estimated user's command content. For example, if the text processing device 30 estimates that the user's command content is a command content to clean a specific room in a building, it sets operation command information instructing the cleaning robot 51 to clean the specific room. The text processing device 30 transmits the set operation command information to the robot control device 40.

[0016] The robot control device 40 comprehensively controls the multiple robots 50. For example, the robot control device 40 periodically operates the multiple robots 50 based on a schedule set in advance by the user. The robot control device 40 also monitors the status inside the building based on image data captured by the imaging device 20, and operates the multiple robots 50 separately from the regular operations based on operation command information transmitted from the text processing device 30.

[0017] In this way, in the information processing system 1 of this embodiment, a plurality of robots 50 operate periodically. In addition, a user can make the robots 50 perform actions according to his or her intentions by operating the input device 10. (Hardware configuration of input devices) As shown in FIG. 2, the input device 10, which is a mobile terminal 11, a smart speaker 12, and an operating device 13, has a processor 60, a memory 61, a storage device 62, a communication IF (Interface) 63, an input device 64, and an output device 65, etc.

[0018] The processor 60 is a control unit that controls various processes by executing programs stored in the memory 61 . The memory 61 is a storage medium such as a RAM (Random Access Memory), etc. The memory 61 temporarily stores the code of the program executed by the processor 60 and data required when the program is executed.

[0019] The storage device 62 is a non-volatile storage medium such as a hard disk drive (HDD), flash memory, etc. The storage device 62 stores an operating system and various programs. The communication IF 63 is a device for performing wired or wireless data communication with an external device.

[0020] The input device 64 is a device for receiving input from a user, and is a keyboard, a mouse, a touch panel, various sensors, a wearable device, etc. In the mobile terminal 11, for example, a touch panel is used as the input device 64. In the smart speaker 12, for example, a microphone is used as the input device 64. In the operation device 13, for example, a plurality of buttons are used as the input device 64. In this embodiment, the input device 64 corresponds to an input unit.

[0021] The output device 65 is a device that outputs information, and is a display, a touch panel, a speaker, etc. Specific examples of displays include a liquid crystal display, an organic EL (Electro-Luminescence) display, a wearable device, etc.

[0022] (Functional configuration of input device) As shown in FIG. 3, the input device 10, which is a mobile terminal 11, a smart speaker 12, and an operating device 13, includes an input information acquisition unit 100, an information conversion unit 101, and a communication unit 102 as functional configurations realized by a processor 60 executing a program stored in a memory 61.

[0023] The input information acquisition unit 100 acquires information input by a user to the input device 64. For example, the input information acquisition unit 100 of the mobile terminal 11 acquires operation information of the user on the touch panel of the mobile terminal 11. The input information acquisition unit 100 of the smart speaker 12 acquires voice information of the user collected by the microphone of the smart speaker 12. The input information acquisition unit 100 of the operation device 13 acquires operation information of each of a plurality of buttons provided on the operation device 13.

[0024] The information conversion unit 101 converts the information acquired by the input information acquisition unit 100 into text information. For example, the information conversion unit 101 of the mobile terminal 11 converts the operation information of the touch panel acquired by the input information acquisition unit 100 into text information. Specifically, when the user taps the touch panel to specify a cleaning location for the cleaning robot 51, the information conversion unit 101 creates text information including information about the specified location and information that cleaning is required.

[0025] The information conversion unit 101 of the smart speaker 12 converts the user's voice information acquired by the input information acquisition unit 100 into text information. The information conversion unit 101 of the operation device 13 converts into text information the operation information of the plurality of buttons acquired by the input information acquisition unit 100. For example, if a plurality of buttons that can cause the cleaning robot 51 to perform cleaning are installed in each room of a building, when a user presses a button installed in a specific room, the information conversion unit 101 creates text information including information about the specific room and information that cleaning is required.

[0026] The communication unit 102 uses the communication IF 63 to transmit the text information converted by the information conversion unit 101 to the text processing device 30. The communication unit 102 also uses the communication IF 63 to receive various information transmitted from the robot control device 40. The various information transmitted from the robot control device 40 is displayed on the touch panel of the mobile terminal 11 or output as voice from the smart speaker 12, allowing the user to understand the status of each robot 50, etc.

[0027] (Hardware configuration of text processing device) 2, the text processing device 30, like the input device 10, also has a processor 60, a memory 61, a storage device 62, a communication IF 63, an input device 64, and an output device 65. The configuration of each of these elements is the same as or similar to the configuration of each element described in the section "Hardware configuration of input device 10," so a detailed description will be omitted. In this embodiment, the text processing device 30 corresponds to a computer.

[0028] (Functional configuration of text processing device) As shown in FIG. 3, the text processing device 30 includes a communication unit 31, a data processing unit 32, and an operation setting unit 33 as functional components realized by the processor 60 executing a program stored in the memory 61.

[0029] The communication unit 31 receives text information transmitted from the input device 10 using the communication IF 63, and transmits the received text information to the data processing unit 32. The communication unit 31 also transmits operation command information set by the operation setting unit 33 to the robot control device 40 using the communication IF 63.

[0030] The data processing unit 32 performs various processes on the text information transmitted from the communication unit 31 in order to infer the command content intended by the user. The processes performed on the text information include natural language processing and full-text search processing. The data processing unit 32 extracts information necessary for operating each robot 50 from the text information by performing natural language processing and full-text search processing on the text information. For example, if the text information includes information related to cleaning, the data processing unit 32 extracts information such as the cleaning location and cleaning content from the text information. The data processing unit 32 transmits the extracted command information to the operation setting unit 33.

[0031] The operation setting unit 33 sets operation command information indicating the operation of each robot 50 based on the command information extracted by the data processing unit 32. For example, to operate the cleaning robot 51, it is necessary to transmit information such as the cleaning location and cleaning time to the cleaning robot 51. Furthermore, if the cleaning robot 51 has multiple functions, such as a function to wipe the floor in addition to a function to suck up dirt, etc., it is necessary to transmit information on the cleaning method to the cleaning robot 51. When operating such a cleaning robot 51, the operation setting unit 33 sets information such as the cleaning location, cleaning time, and cleaning method as operation command information based on the command information extracted by the data processing unit 32.

[0032] Specifically, the operation setting unit 33 uses the information included in the command information as it is for the cleaning location. In this embodiment, the information about the cleaning location included in the operation command information corresponds to information about the robot's operation location. Furthermore, the operation setting unit 33 sets the cleaning time and cleaning method based on information about the cleaning content, etc., included in the command information. For example, if the cleaning content included in the text information is simply collecting trash, the operation setting unit 33 sets the cleaning time to a predetermined short time and sets the cleaning method to only collect trash. On the other hand, if the cleaning content included in the text information is a high-importance cleaning such as collecting glass shards, the operation setting unit 33 sets the cleaning time to a predetermined long time and sets the cleaning method to not only collect trash but also wipe the floor.

[0033] The operation setting unit 33 transmits the set operation command information to the robot control device 40 via the communication unit 31. (Hardware configuration of the robot control device) 2, the text processing device 30, like the input device 10, also has a processor 60, a memory 61, a storage device 62, a communication IF 63, an input device 64, and an output device 65. The configuration of each of these elements is the same as or similar to the configuration of each element described in the section "Hardware configuration of input device 10," so a detailed description will be omitted. In this embodiment, the robot control device 40 corresponds to a computer.

[0034] (Functional configuration of the robot control device) As shown in FIG. 3, the robot control device 40 includes a communication unit 41 and a robot control unit 42 as functional components realized by a processor 60 executing a program stored in a memory 61.

[0035] The communication unit 41 receives the operation command information transmitted from the text processing device 30 by using the communication IF 63, and transmits the received operation command information to the robot control unit . The robot control unit 42 performs overall control of the multiple robots 50. For example, the robot control unit 42 automatically operates the multiple robots 50 within a building based on a schedule set in advance by an administrator of the information processing system 1. The robot control unit 42 also operates the robots 50 based on operation command information transmitted from the communication unit 41, thereby causing the robots 50 to perform operations in accordance with a user's request.

[0036] (Example of robot control unit operation) Next, a specific procedure for operating the robot 50 based on the operation command information will be described with reference to Fig. 4. In the following, to make it easier to understand the process, an example will be described in which the cleaning robot 51 is operated based on the operation command information. The process shown in Fig. 4 is repeatedly executed by the robot control unit 42 at a predetermined cycle.

[0037] 4, the robot control unit 42 first determines whether or not a cleaning instruction has been received from the user (step S10). Specifically, if no operation command information has been transmitted from the text processing device 30, the robot control unit 42 determines that no cleaning instruction has been received from the user (step S10: NO). In this case, the robot control unit 42 temporarily ends the series of processes shown in FIG. 4.

[0038] When the robot control unit 42 receives the operation command information transmitted from the text processing device 30, it determines that a cleaning instruction has been given by the user (step S10: YES). The robot control unit 42 may monitor whether there is a place in the building that needs cleaning based on image data of the inside of the building captured by the imaging device 20. In this case, if the robot control unit 42 determines that there is a place in the building that needs cleaning, it transmits a notification to that effect to the mobile terminal 11 and also transmits image data of the place that needs cleaning to the mobile terminal 11. At this time, if the user taps the image data of the place to be cleaned that is displayed on the touch panel of the mobile terminal 11, operation command information including information about the place to be cleaned is transmitted from the text processing device 30 to the robot control device 40. In this case, the robot control unit 42 determines that a cleaning instruction has been issued from the user based on receiving the operation command information (step S10: YES).

[0039] When the robot control unit 42 determines that a cleaning instruction has been received from the user (step S10: YES), it determines whether the cleaning robot 51 is in a regular operating state (step S11). The regular operating state refers to an operating state in which the cleaning robot 51 is performing regular cleaning. In this embodiment, the cleaning robot 51 corresponds to a predetermined robot, and regular cleaning corresponds to regular operation. When the robot control unit 42 determines that the cleaning robot 51 is not in a regular operating state (step S11: NO), that is, when the cleaning robot 51 is in a standby state or the like, it switches the cleaning robot 51 that is located closest to the cleaning location among the multiple cleaning robots 51 from the standby state or the like to an irregular operating state (step S12). The irregular operating state is a state in which the cleaning robot 51 operates based on operation command information transmitted from the text processing device 30.

[0040] Following the process of step S12, the robot control unit 42 instructs the cleaning robot 51 located closest to the cleaning location to perform an operation according to the operation command information (step S13). As a result, the cleaning robot 51 located closest to the cleaning location performs a cleaning operation according to the user's cleaning instruction.

[0041] On the other hand, if the robot control unit 42 determines in the process of step S11 that the cleaning robot 51 is in a regular operation state (step S11: YES), it determines whether the problem can be handled by regular operation of the cleaning robot 51 (step S14). For example, if the condition shown in the following (a1) is met, or if the AND condition of the following (a1) and (a2) is met, the robot control unit 42 determines that the problem can be handled by regular operation of the cleaning robot 51 (step S14: YES).

[0042] (a1) The cleaning location specified by the operation command information exists on the travel route of the cleaning robot 51 during the regular operation. (a2) The dirt present in the cleaning location specified by the operation command information is below a normal level. Note that the robot control unit 42 can determine whether the dirt present in the cleaning location specified by the operation command information is below a normal level by using, for example, image data of the inside of the building captured by the imaging device 20. For example, the robot control unit 42 analyzes the image data and determines that the dirt is below a normal level if there are no hazardous objects such as broken glass in the cleaning location, and determines that the dirt is above a normal level if there are hazardous objects present.

[0043] In addition, when the cleaning area is dirty beyond the normal level, such as when hazardous materials are scattered in the cleaning area, it may not be possible to remove all of the hazardous materials by simply cleaning the area through the regular operation of the cleaning robot 51. In other words, it may not be possible to deal with the situation solely through the regular operation of the cleaning robot 51. For this reason, it is effective to use the condition shown in (a2) above as one of the judgment conditions in step S14.

[0044] If the robot control unit 42 determines that the problem can be solved by the regular operation of the cleaning robot 51 (step S14: YES), the robot control unit 42 continues the regular operation of the cleaning robot 51 (step S15). On the other hand, if the robot control unit 42 determines that the cleaning robot 51 cannot handle the situation through its regular operation (step S14: NO), it determines whether or not it is necessary to interrupt the regular operation and perform cleaning (step S16).

[0045] For example, if the robot control unit 42 determines, by using image data of the inside of the building captured by the imaging device 20, that hazardous materials such as glass have been scattered in the cleaning location specified by the operation command information, it determines that the situation is highly urgent and that it is necessary to interrupt regular operation and perform cleaning (step S16: YES).

[0046] Alternatively, the robot control unit 42 may display options on the mobile terminal 11 that allow the user to determine whether or not it is necessary to interrupt the regular operation and perform cleaning. For example, the robot control unit 42 displays options asking whether or not a virus infection cluster has occurred on the mobile terminal 11, and if the user selects the option indicating that a virus infection cluster has occurred, the robot control unit 42 determines that the situation is highly urgent and that it is necessary to interrupt the regular operation and perform cleaning (step S16: YES).

[0047] Furthermore, the robot control unit 42 may determine whether or not it is necessary to interrupt the regular operation to perform cleaning based on the operation command information transmitted from the text processing device 30. For example, when a specific word such as "cluster" is included in the text information extracted by the data processing unit 32, the operation setting unit 33 of the text processing device 30 includes an indication of high urgency in the operation command information and transmits the same to the robot control device 40. In this case, the robot control unit 42 determines that it is necessary to interrupt the regular operation to perform cleaning based on the fact that the operation command information includes information indicating a high urgency situation (step S16: YES).

[0048] If the robot control unit 42 determines that it is necessary to interrupt regular operation and perform cleaning (step S16: YES), it switches the cleaning robot 51 located closest to the cleaning location from a regular operation state to a non-regular operation state (step S17), and then instructs the cleaning robot 51 to operate in accordance with the operation command information (step S18).

[0049] On the other hand, if the robot control unit 42 determines that it is not necessary to interrupt the regular operation to perform cleaning (step S16: NO), it determines whether the regular cleaning of the cleaning robot 51 has been completed (step S19). Thereafter, when the regular cleaning of the cleaning robot 51 has been completed, the robot control unit 42 makes a positive determination in the processing of step S19 (step S19: YES), switches the cleaning robot 51 located closest to the cleaning location to a non-regular operating state (step S20), and then instructs the cleaning robot 51 to operate in accordance with the operation command information (step S21).

[0050] (effect) As described above, the information processing system 1 of this embodiment includes an information conversion unit 101, an operation setting unit 33, and a robot control unit 42. The information conversion unit 101 converts information input by a user to the input device 64 into text information. The operation setting unit 33 sets operation command information indicating an operation of the robot 50 based on the text information. The robot control unit 42 instructs the robot 50 to perform an operation according to the operation command information. According to this configuration, since the information input by a user to the input device 64 is once converted into text information, it is possible to control various robots 50 based on the text information. This allows the use of any input device 64, such as the mobile terminal 11, smart speaker 12, or operating device 13, thereby improving convenience.

[0051] The robot control unit 42 determines whether the cleaning robot 51 is performing regular cleaning, and if it determines that regular cleaning is not being performed, it instructs the cleaning robot 51 to perform an operation according to the operation command information. This configuration makes it possible to prevent the cleaning robot 51 from interrupting regular cleaning.

[0052] When the robot control unit 42 determines that the cleaning robot 51 is performing regular cleaning, it determines whether the operation corresponding to the operation command information can be achieved by regular cleaning. When the robot control unit 42 determines that the operation corresponding to the operation command information can be achieved by regular cleaning, it continues the regular cleaning of the cleaning robot 51. According to this configuration, when the user issues a cleaning command, if the cleaning content instructed by the user can be achieved by regular cleaning of the cleaning robot 51, the regular cleaning of the cleaning robot 51 continues, thereby making it possible to operate the cleaning robot 51 more efficiently.

[0053] When the robot control unit 42 determines that the cleaning robot 51 is performing regular cleaning, it determines whether or not it is necessary to interrupt the regular cleaning and have the cleaning robot 51 perform the operation according to the operation command information. When the robot control unit 42 determines that it is necessary to interrupt the regular cleaning and have the cleaning robot 51 perform the operation according to the operation command information, it instructs the cleaning robot 51 performing the regular cleaning to perform the operation according to the operation command information. According to this configuration, in the case of a high urgency, such as when hazardous objects such as glass are scattered indoors or when a virus infection cluster occurs, the cleaning robot 51 interrupts the regular cleaning and immediately performs the operation according to the operation command information. This enables the cleaning robot 51 to operate in a manner more in line with the user's intentions.

[0054] If the robot control unit 42 determines that there is no need to interrupt the regular cleaning and have the cleaning robot 51 perform the operation corresponding to the operation command information, the robot control unit 42 instructs the cleaning robot 51 to perform the operation corresponding to the operation command information after the regular cleaning of the cleaning robot 51 is completed. According to this configuration, if there is no need to interrupt the regular cleaning to operate the cleaning robot 51, such as when a user requests cleaning to remove dirt adhering to the floor surface, the cleaning robot 51 will perform cleaning to remove dirt from the floor surface after the regular cleaning is completed. This makes it possible to operate the cleaning robot 51 in a manner that is more suited to the actual situation.

[0055] When there are multiple cleaning robots 51 that can perform the operation corresponding to the operation command information, the robot control unit 42 instructs the cleaning robot 51 that is located closest to the cleaning location included in the operation command information to perform the operation corresponding to the operation command information among the multiple cleaning robots 51. With this configuration, the cleaning robot 51 can be directed to the cleaning location in the shortest time.

[0056] The robot control unit 42 is provided in common to multiple types of robots 50, such as the cleaning robot 51, the security robot 52, and the transport robot 53. This configuration simplifies the structure compared to when a robot control unit is provided individually for each of the cleaning robot 51, the security robot 52, the transport robot 53, etc.

[0057] (Variation) Next, a modification of the information processing system 1 of the above embodiment will be described. When the control methods of the cleaning robot 51, security robot 52, and transport robot 53 are significantly different, it may be difficult to build a common robot control device 40 for the cleaning robot 51, security robot 52, and transport robot 53 as shown in Fig. 1. In this case, for example, as shown in Fig. 5, robot control devices 40a to 40c may be provided individually for the cleaning robot 51, security robot 52, and transport robot 53, respectively. In the configuration of this modified example, as shown in Fig. 6, the robot control devices 40a to 40c each have communication units 41a to 41c and robot control units 42a to 42c.

[0058] <Other embodiments> It should be noted that the embodiment is not limited to the above specific example. For example, an imaging device that uses imaging information as input information can be used as the input device 10. The imaging device acquires, for example, the user's appearance, facial expression, etc. as metadata for image recognition, and then transmits corresponding text information to the text processing device 30. The information on the user's appearance, facial expression, etc. acquired by image recognition includes information such as gender, age, whether the user is angry, or whether the user is smiling.

[0059] The configuration of the information processing system 1 of the above embodiment can be realized in various forms such as an information processing device, an information processing method, and a program. Design modifications made by a person skilled in the art to the above specific examples are also included within the scope of the present invention as long as they retain the features of the present invention. The elements of the above specific examples, as well as their arrangement, conditions, shape, etc., are not limited to those exemplified and can be modified as appropriate. The elements of the above specific examples can be combined in various ways as long as no technical contradictions arise. [Explanation of symbols]

[0060] 1...information processing system, 10...input device (input section), 11...mobile terminal (input section), 12...smart speaker (input section), 13...operation device (input section), 33...operation setting section, 42, 42a to 42c...robot control section, 50...robot, 51...cleaning robot, 52...security robot, 53...transport robot, 101...information conversion section.

Claims

1. An information processing system for controlling a robot, an information conversion unit that acquires user voice information collected by an input device from the input device and converts the information into text information; a data processing unit that performs natural language processing or full-text search processing on the text information regarding the location and content of the robot's action, and extracts, from the text information, command content that is a command given to the robot by the user and includes the location and content of the robot's action; an action setting unit that sets action command information including the action location and the action content of the robot, the action command information being information indicating an action of the robot based on the action location and the action content of the robot included in the command content, and transmits the action command information to the robot via a communication device; a robot control unit that causes the robot to perform an action in accordance with the action command information, The robot control unit determining whether the robot is performing a regular operation based on a preset schedule; When the robot is not performing the periodic operation, the operation command information is transmitted to the robot by the communication device, causing the robot to perform an operation according to the operation command information; When the robot is performing the periodic operation, determining whether or not the operation location included in the operation command information is located on a travel route of the periodic operation; If the operation location included in the operation command information is located on the travel route of the periodic operation, the robot is caused to continue the periodic operation. Information processing system.

2. When the operation location included in the operation command information is not located on the travel route of the periodic operation, the robot control unit transmits the operation command information to the robot performing the periodic operation via the communication device, thereby interrupting the periodic operation and causing the robot to perform the operation according to the operation command information, or transmits the operation command information to the robot via the communication device after the robot has completed the periodic operation, thereby causing the robot to perform the operation according to the operation command information. The information processing system according to claim 1 .

3. When there are multiple robots in a standby state that are not performing the periodic operation, the robot control unit causes one of the multiple robots that is located closest to the operation location included in the operation command information to perform the operation according to the operation command information.

3. The information processing system according to claim 1 or 2.

4. A plurality of the robot control units are provided for each type of the robot. The information processing system according to any one of claims 1 to 3.

5. The robot control unit is provided in common to a plurality of types of the robots. The information processing system according to any one of claims 1 to 3.

6. The information conversion unit When an operation capable of identifying an operation location for causing the robot to execute a specific operation is performed on the input device, operation information related to the operation is acquired from the input device; creating text information including information on the location of the action and information indicating that the specific action is required based on the operation information, and transmitting the created text information to the data processing unit; The specific operation is one of transportation, cleaning, and security. The information processing system according to any one of claims 1 to 5.

7. An information processing device for controlling a robot, an information conversion unit that acquires user voice information collected by an input device from the input device and converts the information into text information; a data processing unit that performs natural language processing or full-text search processing on the text information regarding the location and content of the robot's action, and extracts, from the text information, command content that is a command given to the robot by the user and includes the location and content of the robot's action; an action setting unit that sets action command information including the action location and the action content of the robot, the action command information being information indicating an action of the robot based on the action location and the action content of the robot included in the command content, and transmits the action command information to the robot via a communication device; a robot control unit that causes the robot to perform an action in accordance with the action command information, The robot control unit determining whether the robot is performing a regular operation based on a preset schedule; When the robot is not performing the periodic operation, the operation command information is transmitted to the robot by the communication device, causing the robot to perform an operation according to the operation command information; When the robot is performing the periodic operation, determining whether or not the operation location included in the operation command information is located on a travel route of the periodic operation; If the operation location included in the operation command information is located on the travel route of the periodic operation, the robot is caused to continue the periodic operation. Information processing device.

8. An information processing method for controlling a robot, comprising: On the computer, a first step of acquiring user voice information collected by an input device from the input device and converting the information into text information; a second step of extracting, from the text information, command content that includes the location and content of the robot's operation, the command content being a command given to the robot by the user, by performing natural language processing or full-text search processing on the text information regarding the location and content of the robot's operation; a third step of setting operation command information including the operation location and operation content of the robot, the operation command information being information indicating an operation of the robot based on the operation location and operation content of the robot included in the command content, and transmitting the operation command information to the robot via a communication device; a fourth step of causing the robot to perform an action in accordance with the action command information; In the fourth step, determining whether the robot is performing a regular operation based on a preset schedule; When the robot is not performing the periodic operation, the operation command information is transmitted to the robot by the communication device, causing the robot to perform an operation according to the operation command information; When the robot is performing the periodic operation, determining whether or not the operation location included in the operation command information is located on a travel route of the periodic operation; If the operation location included in the operation command information is located on the travel route of the periodic operation, the robot is caused to continue the periodic operation. Information processing methods.

9. A program for controlling a robot, On the computer, a first step of acquiring user voice information collected by an input device from the input device and converting the information into text information; a second step of extracting, from the text information, command content that includes the location and content of the robot's operation, the command content being a command given to the robot by the user, by performing natural language processing or full-text search processing on the text information regarding the location and content of the robot's operation; a third step of setting operation command information including the operation location and operation content of the robot, the operation command information being information indicating an operation of the robot based on the operation location and operation content of the robot included in the command content, and transmitting the operation command information to the robot via a communication device; a fourth step of causing the robot to perform an action in accordance with the action command information; In the fourth step, determining whether the robot is performing a regular operation based on a preset schedule; When the robot is not performing the periodic operation, the operation command information is transmitted to the robot by the communication device, causing the robot to perform an operation according to the operation command information; When the robot is performing the periodic operation, determining whether or not the operation location included in the operation command information is located on a travel route of the periodic operation; If the operation location included in the operation command information is located on the travel route of the periodic operation, the robot is caused to continue the periodic operation. program.

Images