Robot interaction system and method
By sending function editing instructions to the server through mobile devices, the problem that existing robots cannot meet diversified needs is solved, and the robot's diversified function display and user emotional communication is improved.
Patent Information
- Application Number
- CN201810094832.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2018-01-31
- Publication Date
- 2024-12-20
- Estimated Expiration
- 2038-01-31
AI Technical Summary
Existing robots can only accept control of fixed instructions and cannot interact with other robots or users, and cannot meet the diverse needs of users, such as playing songs and posting blessings.
The mobile device sends function editing instructions to the server, and the server stores and forwards them to the target robot, so that the robot can display diverse functions according to user needs, including playing songs, posting blessings, etc.
It realizes that robots display various functions according to users' diverse needs, improves user experience, and strengthens emotional communication between users and robots.
Smart Images

Figure CN108115691B_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present invention relate to the field of robotics technology, and in particular to a robot interaction system and method. Background Art
[0002] In recent years, with the development of information technology, communication technology, artificial intelligence technology, etc., the application fields of robots have been continuously expanded and deepened. Modern robots can already perform reciprocating mechanical movements according to pre-designed programs. For example, service robots can provide some simple services. When guests come, they say some welcome words such as "welcome" and "hello" to meet the basic needs of customers.
[0003] However, this kind of artificial remote-controlled robot can only accept fixed commands, cannot interact with other robots or other mobile phone users, and mechanically completes some simple actions. There is still a certain distance between emotional communication with people. At present, the social communication network with friendship as the core has become very popular. Traditional robots can no longer meet the problem of diverse user needs, such as playing songs, posting greetings, etc. Therefore, the automation of the above services has become an urgent need. Summary of the invention
[0004] The embodiments of the present invention provide a robot interaction system and method, which can enable the robot to display various functions according to the diverse needs of users, improve the user experience, and further strengthen the emotional communication between the user and the robot.
[0005] In a first aspect, an embodiment of the present invention provides a robot interaction system, the system comprising: a mobile device, a server, and at least one robot, wherein the mobile device and the at least one robot are both connected to the server;
[0006] The mobile device is used to send the function editing instruction to the server;
[0007] The server is used to store the received function editing instructions, obtain the target function editing instructions from the stored function editing instructions, and send them to the target robot;
[0008] The target robot is used to receive the target function editing instruction sent by the server and display the function corresponding to the received target function editing instruction.
[0009] In a second aspect, an embodiment of the present invention further provides a robot interaction method, the method comprising:
[0010] The mobile device sends the function editing instruction to the server;
[0011] The server stores the received function editing instructions, obtains the target function editing instructions from the stored function editing instructions, and sends the target function editing instructions to the target robot;
[0012] The target robot receives the target function editing instruction sent by the server, and displays a function corresponding to the received target function editing instruction.
[0013] The embodiment of the present invention provides a robot interaction system and method, in which a user sends a function editing instruction that requires the robot to display a corresponding function to the robot indirectly through a server through a mobile device, so that the robot displays a function corresponding to the received target function editing instruction. The robot can display a variety of functions according to the diverse needs of the user, improve the user experience, and further strengthen the emotional communication between the user and the robot. BRIEF DESCRIPTION OF THE DRAWINGS
[0014] Other features, objects and advantages of the present invention will become more apparent from the detailed description of non-limiting embodiments made with reference to the following drawings:
[0015] Figure 1 is a structural block diagram of a robot interaction system provided in Embodiment 1 of the present invention;
[0016] Figure 2 is a structural block diagram of a robot interaction system provided in Embodiment 2 of the present invention;
[0017] Figure 3 is a schematic diagram of a robot structure provided in Embodiment 2 of the present invention;
[0018] Figure 4 This is a schematic diagram of the side structure of a robot provided in the second embodiment of the present invention;
[0019] Figure 5 is a flow chart of a robot interaction method provided in Embodiment 3 of the present invention;
[0020] Figure 6 This is a flow chart of a robot interaction method provided in Embodiment 4 of the present invention. DETAILED DESCRIPTION
[0021] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the present invention, rather than to limit the present invention. It should also be noted that, for ease of description, only the parts related to the present invention are shown in the accompanying drawings, rather than the entire contents.
[0022] Embodiment 1
[0023] Figure 1This is a block diagram of a robot interaction system provided in Example 1 of the present application. The system can be used for users to interact with robots through mobile devices such as mobile phones, smart watches, etc., to achieve their own diverse needs such as posting greetings, uploading picture greeting cards to the Internet, discussing topics of interest or playing songs, etc., thereby strengthening the close emotional communication between people and robots. The robot is a service device for users to use. It can be used for hotel reception, conference services, traffic directions, chatting with people, and participating in birthday party activities such as making birthday greeting cards, singing, etc. The entire robot interaction system is usually executed by a mobile device held by the user, a server, and at least one robot. Specifically, the system 100 includes: a mobile device 10, a server 20, and a robot 30. The robot 30 can be one or more, and the mobile device 10 and at least one robot 30 are connected to the server 20.
[0024] The mobile device 10 is used to send the function editing instruction to the server 20;
[0025] The server 20 is used to store the received function editing instructions, obtain the target function editing instructions from the stored function editing instructions, and send them to the target robot;
[0026] The target robot is used to receive the target function editing instruction sent by the server 20 and display the function corresponding to the received target function editing instruction.
[0027] In order to strengthen the emotional communication between the user and the robot and better manage the robot 30, the server 20 is introduced in this embodiment. The server 20 can be a service processing server, for example, it can provide decisions for the management of the robot 30, the information processing of the robot 30, etc., provide decisions for event triggering such as alarms, provide strategies for the deployment of the robot 30, and manage the geographical location information of the robot 30. It can also be a server that handles comprehensive services.
[0028] Function editing instructions refer to instructions that contain information that the user wants to express. Users can edit different function editing instructions according to the application scenario, such as at least one of sending blessings on the spot, making corresponding greeting cards, playing songs, voice questions and answers, and telling stories. Specifically, when a user attends a birthday party, the edited blessings such as happy birthday can be processed accordingly, such as compression, packaging, encoding, etc. to generate corresponding function editing instructions. In order to distinguish the function editing instructions of different users, the function editing instructions may include the user's name, identity information, MAC (Media Access Control, physical address) or IMEI (International Mobile Equipment Identity) of the mobile device. The target function editing instruction refers to one of the function editing instructions, which is selected by the server from many function editing instructions using corresponding rules, such as the server selecting according to the order in which the user's function editing instructions are received or the number of the function editing instructions.
[0029] In a certain period of time, since each robot 30 can process a limited number of functions, that is, the number of mobile devices that interact with it is limited, such as 10, the server 20 needs to monitor the working status of each robot 30 in real time. If it does not reach 10, a new task, that is, a target function editing instruction, is assigned to it. The target robot is one of the at least one robot 30.
[0030] When the user is in a scene of a friend's birthday party, the mobile device 10 is a mobile phone. The specific operation process is: when the user sends the edited function editing instructions containing birthday wishes, greeting cards or songs to the server 20 through the mobile communication unit in the mobile phone such as 3G / 4G, GPRS or WIFI (Wireless Fidelity), after receiving the function editing instruction, the server 20 first stores the function editing instruction in the storage unit in the server 20, and the storage unit can be a memory bar, a flash memory flash or the cloud, and then calls the selector in the server 20 to select the target function editing instruction according to certain rules, and the target function editing instruction can be processed by software or hardware circuits, such as converting the target function editing instruction into a language that the target robot can recognize through level conversion, which can be a level signal or a pulse signal, or converting the target function editing instruction into a binary string that the target robot can recognize through an encoder. At the same time, the server 20 determines the target robot according to the working state of the robot, and sends the target function editing instruction to the target robot through the communication unit in the server 20; the target robot has a communication unit that can be used to receive the target function editing instruction, such as a GSM communication module, a SIM card, etc. When the target robot receives the target function editing instruction, it executes the corresponding function. For example, if the user sends a song, the main control unit in the robot will control the sound device on it, such as a speaker, to play the song. Among them, the main control unit can be a hardware circuit such as a single-chip microcomputer integrated with multiple chips, which is used to control the operation of each unit or component in the robot 30.
[0031] Exemplarily, the robot 30 may further include: a second display screen for displaying content corresponding to the target function editing instruction. Preferably, the second display screen is a promotional display screen. For example, if the function editing instruction sent by the user is a greeting card and a blessing message, after being parsed and processed by the server 20 and converted into an instruction recognizable by the robot 30, it is sent to the robot 30, and the main control unit in the robot 30 will control the second display screen to play the greeting card and the blessing message.
[0032] The embodiment of the present invention provides a robot interaction system, in which a user sends a function editing instruction that requires the robot to display a corresponding function to the robot indirectly through a server through a mobile device, so that the robot displays a function corresponding to the received target function editing instruction. The robot can display a variety of functions according to the diverse needs of the user, improve the user experience, and further strengthen the emotional communication between the user and the robot.
[0033] Embodiment 2
[0034] Figure 2A structural block diagram of a robot interaction system provided in Example 2 of the present application, which further optimizes the server 30 based on the above-mentioned embodiment. Specifically, the system 100 includes: a mobile device 10, a server 20 and a robot 30, and the robot 30 can be one or more, wherein the server 20 includes a cloud end 210 and an operation management end 220, and the mobile device 10, at least one robot 30 and the operation management end 220 are all connected to the cloud end 210.
[0035] The mobile device 10 is used to send the function editing instruction to the server 20, and the server 20 includes a cloud 210 and an operation management terminal 220;
[0036] The cloud 210 is used to store the received function editing instructions;
[0037] The operation management terminal 220 is used to obtain the target function editing instruction from the function editing instructions stored in the cloud 210 and send it to the target robot;
[0038] The target robot is used to receive the target function editing instruction sent by the operation management terminal 220, and display the function corresponding to the received target function editing instruction.
[0039] Among them, the function editing instructions may include: at least one of: on-site blessing activities, making corresponding blessing greeting cards, playing songs, voice questions and answers, and storytelling.
[0040] The operation management end 220 may include a processing unit 221, a monitoring unit 222 and a first communication unit 223; wherein the processing unit 221 is used to parse and filter the acquired target function editing instructions to obtain target instruction data recognizable by the robot; the monitoring unit 222 is used to determine the target robot based on the working status of at least one robot 30; the first communication unit 223 is used to send the target instruction data to the target robot.
[0041] The processing unit 221 can be a module composed of hardware circuits such as a decoder, an encoder, and a selection switch, which can realize functions such as decoding, encoding, and screening. The target function editing instruction obtained from the cloud 210 can be converted into a language that can be recognized by the target robot by level conversion, which can be a level signal or a pulse signal, etc., or the target function editing instruction can be converted into a binary string that can be recognized by the target robot by an encoder, wherein the level signal, pulse signal or binary string obtained after processing by the processing unit 221 is the target instruction data. The monitoring unit 222 can be composed of hardware circuits such as counters. When the number of counters in the monitoring unit 222 reaches a preset number such as 10, it indicates that the number of functions processed in the robot is full; when it does not reach the preset number, it indicates that the robot can also accept other function instructions. The first communication unit 223 can be a remote communication unit, which is used to send the target function editing instruction to the target robot or obtain the target function editing instruction from the cloud 210 based on a long-distance communication protocol such as Ethernet, GPRS (General Packet Radio Service, packet wireless service), etc.
[0042] Exemplarily, the robot 30 in the system 100 may include an image acquisition unit 31 and a second communication unit 32; wherein the image acquisition unit 31 is used to collect the user's identity information and match the identity information with the information pre-stored in the local database; the second communication unit 32 is used to send information for generating function editing instructions to the mobile device 10 based on the user's registration information if the match is successful.
[0043] The image acquisition unit 31 may be a camera for collecting user facial information; or a fingerprint acquisition module for collecting user fingerprint information. The identity information is information that can uniquely identify the user's identity, such as facial information or fingerprint information. The second communication unit 32 may include a long-distance communication module and a short-distance communication module, and the long-distance communication module may be similar to the first communication unit in the operation management terminal 220. For example, it may contain GSM communication, GPRS (General Packet Radio Service, packet radio service), etc., which may be used to receive target instruction data sent by the operation management terminal 220; the short-distance communication module may be Bluetooth, WIFI, etc., which may be used to directly send relevant information to the mobile device 10, such as information for generating function editing instructions, which may be a QR code or a picture making frame. The information pre-stored in the robot database corresponds to the user's identity information, which may be facial information or fingerprint information. The information may be saved in the form of a pulse signal, and since the facial information of different users is different, the corresponding pulse signals are different.
[0044] The user's registration information may include, but is not limited to, name, phone number, company name, position, facial features, identity level, and other information. The identity level is divided into at least four categories according to the importance of the user, for example, four levels of VIP, special, ordinary, and unfamiliar can be set. The user's registration information can be stored in the form of electrical signals of different frequencies. The user's registration information can be stored in the robot 30 or in the cloud. Preferably, the user's registration information is stored in the cloud 210 to reduce the memory occupied by the robot 30.
[0045] For example, if the user comes to attend a scientific research conference, the robot 30 may further include a comparator. When the camera in the robot 30 collects the user's facial information, it may be converted into a corresponding pulse signal, and the pulse signal corresponding to the facial information pre-stored in the database of the robot 30 is simultaneously input into the comparator for comparison. If a match is found, the second communication unit 32 in the robot 30 will obtain the registration information of the relevant user from the cloud 210, and then, based on the user's registration information such as telephone number parsed from electrical signals of different frequencies, the information used to generate function editing instructions such as the location information of the user's venue and the QR code for the venue to interact with the robot 30 are sent to the user's mobile device 10; if the match is unsuccessful, it means that the user is a stranger. Optionally, the robot 30 may further include a sound-emitting device such as a speaker and a first display screen such as a touch display screen, which is used to send a registration prompt message if the match is unsuccessful, and / or display a registration prompt message or a registration interface on the first display screen.
[0046] Specifically, the speaker will broadcast a voice message such as "Please register before entering the venue", and the touch screen will display an interface for prompting the user to register identity information or register using the WeChat QR code and fill in relevant information. For example, the user can click the speaker button on the interface to complete the registration by having a voice conversation with the robot 30; or directly scan the QR code that appears on the first display screen of the robot 30 to complete the registration through a mobile device. At this time, the robot 30 may be a target robot or not.
[0047] In addition, since all authorized users can interact with the robot 30 through the mobile device 10, in order to prevent conflicts between the mobile devices 10, a different service thread is established for each user through the operation management terminal 220. Exemplarily, the monitoring unit 222 can also be used to create a specific thread for the mobile device 10 and establish a communication connection with the cloud 210 if it monitors that the mobile device 10 sends a function editing instruction to the cloud 210.
[0048] Specifically, the monitoring unit 222 can monitor the connection status of the mobile device 10 at a fixed port. Once the user sends a corresponding function editing instruction through the mobile device 10, a specific thread is created for the user, and a connection is established through the cloud 210. The thread object is used to continuously read data from the mobile device 10, parse the protocol, and process or transfer the target function editing instruction. For example, when a customer sends a greeting message, a greeting card picture, etc. through a mobile phone, the operation management terminal 220 reads the data, parses and filters it, and sends the filtered data to the target robot, which then broadcasts it accordingly.
[0049] For example, this embodiment provides a specific structural diagram of a robot 30, such as Figure 3 , 4 As shown, the robot may include: a base 1, a robot body 2 arranged on the base, a first display screen 3, a sound device 6 and a second display screen 5. Specifically, a universal wheel 4 is arranged at the bottom of the base 1, the first display screen 3 may be a touch screen, on which the user can manually select a way to interact with the robot, such as language or text input, etc.; the second display screen 5 may be a promotional display screen, used to broadcast the content of the function instructions edited by the user, the company's promotional slogans, such as blessings, blessing QR codes, etc.; the sound device may be a speaker, used to respond to the blessings or songs edited by the user through a mobile device, etc.
[0050] Optionally, the robot body 2 includes a body 21, a head 22 arranged on the body 21, and an arm 26 arranged on the body 21. The robot body 2 is arranged on the base 1 through a first bracket 8. The bottom end of the first bracket 8 is fixed to the top surface of the base 1. A transverse rotating shaft 11 is arranged at the top of the first bracket 8. The shaft body of the rotating shaft is detachably connected to the body 21 of the robot body 2. The rotation of the rotating shaft 11 can drive the rotation of the robot body 2, and the effect is similar to bending down and bowing, which is very vivid.
[0051] The head 22 of the robot body 2 is also provided with an LED light array 23 and an image collector 24. The LED light array 23 mainly acts as eyes and can be combined into a variety of expressions such as happiness, sadness, crying, confusion, etc., which greatly enhances the robot's expressiveness. The body 21 of the robot body 2 can also be provided with a recording microphone device 25 and a pyroelectric sensor 14. The arm 26 of the robot body 2 is a one-degree-of-freedom arm. Corresponding actions can be made. Among them, the image collector 24 is the image acquisition unit 31 in the robot 30 proposed in the above embodiment. The promotional display screen 5 is set on the base 1 through the second bracket 7, and the promotional display screen 5 is located above the robot body 2. The second communication unit 32 can be a SIM card.
[0052] When the mobile device is a mobile phone, the robot and the user are in a birthday party scene, the entire operation process is specifically as follows: when the user stands in front of the robot 30, the pyroelectric sensor 14 in the robot 30 detects that there is someone within a certain distance, such as within 1m, and it will send out a level signal, so that the main control unit in the robot 30 generates a high-level signal to drive the image collector 24 in the robot, such as a camera, to collect the facial image information of the user, and compare it with the information pre-stored in the robot 30. If the match is successful, the main control unit in the robot will control the corresponding module, such as the module composed of the encoder and decoder, to parse the phone number in the user's registration information. Based on the phone number, the QR code for editing the blessing activity is sent to the user's mobile phone through the second communication unit 32. At this time, the user's seat information and the route to the seat will also be displayed on the first display screen 3 of the robot, or photos of the user related to the host of the banquet will be played. After the user's mobile phone receives the blessing activity QR code sent by the robot 30, the user scans the QR code through the mobile phone to obtain the blessing link page, edit the blessing words or order songs through the QR code. Specifically, the song can be selected from the song order list, or the blessing content can be manually or voice input in the blessing column, and the blessing recipient information, the phone number of the person sending the blessing, etc. When the editing is completed, the user clicks the submit and send button, and the edited content will be automatically compressed, encoded, and other operations will be performed to generate function editing instructions such as function editing instructions including singing, and the function editing instructions will be sent to the cloud 210 for storage through the communication unit in the mobile phone. At the same time, the monitoring unit 222 in the operation management end 220 monitors the connection status of the user's mobile phone in real time at the fixed port. Once the user sends the corresponding function editing instruction through the mobile phone, a specific thread will be created for the user and a connection will be established through the cloud 210; the first communication unit 223 in the operation management end 220 will obtain the function editing instruction from the cloud 210, and parse and filter it through the processing unit 221 to obtain the target instruction data that the robot 30 can recognize, and finally send it to the robot whose number of mobile phones interacting with the robot 30 does not reach the preset number, that is, the target robot, through the first communication unit 223. After the second communication unit 32 in the target robot receives the target instruction data, the main control unit in the robot will control the relevant functional modules of the robot to perform the corresponding functions. Specifically, the sound device 6 in the robot, such as a speaker, plays songs and corresponding blessings, and displays the blessings on the second display screen 5; at the same time, the sound device 6 will also generate corresponding audio electronic signals, so that the main control unit controls the rotation of the robot's shaft 11, and the LED light array 23 changes with the rhythm of the electronic music, so that the robot finally makes mechanical dance movements with different postures and different expressions.
[0053] In addition, in order to enhance the emotional exchange between the robot 30 and the user, the facial image information of the user collected by the image collector 24 in the robot 30, such as the camera, is compared with the information pre-stored in the robot 30. Users who are not successfully matched can also directly scan the QR code appearing on the second display screen 5 of the robot 30 to edit QR code blessings, greeting cards, etc. During the editing process, you can enter your own name and the friends you want to bless, and all of these can be displayed on the second display screen 5. In this way, unregistered users do not need to register first, and can directly scan the QR code to edit the blessing, thereby improving the user experience.
[0054] The embodiment of the present invention provides a robot interaction system, in which a user sends a function editing instruction that requires the robot to display a corresponding function to the robot indirectly through a server through a mobile device, so that the robot displays a function corresponding to the received target function editing instruction. The robot can display a variety of functions according to the diverse needs of the user, improve the user experience, and further strengthen the emotional communication between the user and the robot.
[0055] Embodiment 3
[0056] Figure 5 This is a flowchart of a robot interaction method provided in the third embodiment of the present invention. This method can be applied to users interacting with robots through mobile devices such as mobile phones, smart watches, etc. to meet their own diverse needs such as posting greetings, uploading picture greeting cards to the Internet, discussing topics of interest or playing songs. The entire robot interaction method is usually performed by the mobile device held by the user, the server, and at least one robot. The method provided in this embodiment can be performed by a robot interaction system. Figure 5 As shown, the method specifically includes:
[0057] S310, the mobile device sends a function editing instruction to the server.
[0058] Function editing instructions refer to instructions containing information that the user wants to express, and the user can edit different function instructions according to the application scenario. Exemplarily, the function editing instructions include: at least one of sending blessings on site, making corresponding greeting cards, playing songs, voice questions and answers, and telling stories.
[0059] S320, the server stores the received function editing instructions, obtains the target function editing instructions from the stored function editing instructions, and sends them to the target robot.
[0060] Among them, the target function editing instruction is one of many function editing instructions; the server can be a business processing server, which can include the cloud and operation management end, or it can be a robot with comprehensive business management capabilities.
[0061] When the server includes a cloud side and an operation management side, exemplarily, the server stores the received function editing instructions, obtains the target function editing instructions from the stored function editing instructions, and sends them to the target robot. Specifically, it can be: the cloud side stores the received function editing instructions; the operation management side obtains the target function editing instructions from the function editing instructions stored in the cloud side, and sends them to the target robot.
[0062] When the server is a robot with comprehensive business management capabilities, the technical solution provided in this embodiment can also realize interaction between robots.
[0063] Because each robot can handle a limited number of functions within a certain period of time, that is, the number of mobile devices that can interact with it is limited, such as 10. Therefore, the server needs to monitor the working status of each robot in real time. If it does not reach the limit, it will assign a new task, that is, the target function editing instruction. The target robot is one of the at least one robot.
[0064] Exemplarily, the specific operation process of the operation management end obtaining the target function editing instructions from the function editing instructions stored in the cloud and sending them to the target robot can be: the operation management end obtains the target function editing instructions from the function editing instructions stored in the cloud, and parses and filters the obtained target function editing instructions to obtain target instruction data recognizable by the robot; the operation management end determines the target robot based on the working status of at least one robot; the operation management end sends the target instruction data to the target robot.
[0065] The target instruction data refers to data information such as level signals, pulse signals or binary strings that can be recognized by the robot.
[0066] Since all authorized users can interact with the robot through mobile devices, in order to avoid conflicts between mobile devices, a different service thread is established for each user through the operation management end. Exemplarily, before the operation management end obtains the target function editing instruction from the function editing instruction stored in the cloud, it can also include: if the operation management end monitors that the mobile device sends a function editing instruction to the cloud, a specific thread is created for the mobile device and a communication connection is established with the cloud.
[0067] S330, the target robot receives the target function editing instruction sent by the server, and displays the function corresponding to the received target function editing instruction.
[0068] Specifically, when users attend various meetings such as company regular meetings, the robot can serve as a conference service robot. The user uses the image acquisition unit in the robot, such as the camera, to perform face recognition sign-in. If the face information collected by the camera matches the face information pre-stored in the robot database, the on-site sign-in is successful, and the second communication unit in the robot will send the relevant QR code required for the meeting to the user. The user scans the QR code with the mobile phone to obtain the meeting link page, selects the relevant meeting theme option and edits the content, and fills in the user's personal information such as phone number, position, name, etc. After filling in, click the submit button, and the communication unit in the mobile phone will encode and package the content edited by the user to generate function editing instructions and send them to the cloud for the operation management end to obtain. After the operation management end obtains the function editing instructions, it decompresses and encodes the content into target instruction data that the robot can recognize, and sends it to the robot that can currently receive the function instruction, i.e., the target robot, through the first communication unit. After the second communication unit in the target robot receives the target instruction data, the main control unit in the target robot will control the demonstration screen / touch screen to play the meeting information page (meeting theme map, location guide map, meeting introduction, meeting agenda carousel) on the same screen, and the conference service robot will micro-move in real time and play intermittent solicitation words.
[0069] The technical solution provided by the embodiment of the present invention allows the user to indirectly send the function editing instruction that requires the robot to display the corresponding function to the robot through the server through the mobile device, so that the robot displays the function corresponding to the received target function editing instruction. The robot can display a variety of functions according to the diverse needs of users, improve the user experience, and further strengthen the emotional communication between the user and the robot.
[0070] Embodiment 4
[0071] Figure 6 Flowchart of a robot interaction method provided in Embodiment 4 of the present invention. This method is a preferred example provided on the basis of the above embodiments. Figure 6 , the method comprising:
[0072] S401, the robot collects the user's identity information and matches the identity information with the information pre-stored in the local database. If the match is successful, step S402 is executed; if the match is not successful, step S403 is executed.
[0073] S402, the robot sends information for generating function editing instructions to the mobile device based on the user's registration information.
[0074] S403, sending a registration prompt message. After the user completes the registration, execute step S404.
[0075] Exemplarily, if the match is not successful, the sound device and the first display screen in the robot send out a registration prompt message, and / or display a registration prompt message or a registration interface on the first display screen for the user to register the identity information.
[0076] S404, the mobile device sends the function editing instruction to the cloud.
[0077] S405, cloud storage receives the function editing instruction.
[0078] S406, the operation management end obtains the target function editing from the function editing instructions stored in the cloud, and parses and filters the obtained target function editing instructions to obtain target instruction data that can be recognized by the robot.
[0079] S407, the operation management end determines the target robot according to the working status of at least one robot.
[0080] S408, the operation management end sends the target instruction data to the target robot.
[0081] S409, the target robot receives the target function editing instruction sent by the operation management end, and displays the function corresponding to the received target function editing instruction.
[0082] The technical method provided by the embodiment of the present invention allows the user to indirectly send the function editing instruction that requires the robot to display the corresponding function to the robot through the server through the mobile device, so that the robot displays the function corresponding to the received target function editing instruction. The robot can display a variety of functions according to the diverse needs of users, improve the user experience, and further strengthen the emotional communication between the user and the robot.
[0083] The serial numbers of the above embodiments are only for description and do not represent the advantages or disadvantages of the embodiments.
[0084] It should be understood by those skilled in the art that the modules or steps of the present invention described above can be implemented by a general-purpose computing device, they can be concentrated on a single computing device, or distributed on a network composed of multiple computing devices, optionally, they can be implemented by a program code executable by a computer device, so that they can be stored in a storage device and executed by the computing device, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. Thus, the present invention is not limited to any specific combination of hardware and software.
[0085] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.
[0086] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.
Claims
1. A robot interaction system, characterized in that: It includes a mobile device, a server and at least one robot, wherein the mobile device and the at least one robot are both connected to the server; The mobile device is used to send a function editing instruction to the server; wherein the function editing instruction is a function instruction edited by the user according to the application scenario, and the function editing instruction includes at least one of: on-site blessing activities, making corresponding blessing greeting cards, playing songs, voice questions and answers, meetings, and storytelling; the function editing instruction includes the user's name and identity information, and the function editing instruction also includes the physical address or international mobile equipment identity code of the mobile device; The server is used to store the received function editing instructions, obtain the target function editing instructions from the stored function editing instructions, and send them to the target robot; The target robot is used to receive the target function editing instruction sent by the server and display the function corresponding to the received target function editing instruction; the target robot also includes: a second display screen, used to display the content corresponding to the target function editing instruction; The robot comprises an image acquisition unit and a second communication unit; wherein, The image acquisition unit is used to acquire the user's identity information and match the identity information with the information pre-stored in the local database; The second communication unit is used to send information for generating the function editing instruction to the mobile device according to the user's registration information if the match is successful; The second communication unit includes a long-distance communication module and a short-distance communication module. The long-distance communication module includes GSM communication and GPRS, which is used to receive the target instruction data sent by the operation management end; the short-distance communication module includes Bluetooth and WIFI, which is used to directly send relevant information to the mobile device, specifically for generating information of the function editing instruction; The robot also includes a comparator. When the camera in the robot collects the user's facial information, it is converted into a corresponding pulse signal, and the pulse signal corresponding to the facial information pre-stored in the robot database is simultaneously input into the comparator for comparison. If a match is found, the second communication unit in the robot will obtain the registration information of the relevant user from the cloud, and then parse the user's registration information based on electrical signals of different frequencies to generate information for function editing instructions: the location information of the user's venue and the QR code for the venue to interact with the robot are sent to the user's mobile device; if the match is unsuccessful, the sound device in the robot will issue a registration prompt message, and / or display the registration prompt message or registration interface on the first display screen.
2. The system according to claim 1, characterized in that The service end includes a cloud end and an operation management end, wherein the mobile device, the at least one robot and the operation management end are all connected to the cloud end; The cloud is used to store the received function editing instructions; The operation management end is used to obtain the target function editing instruction from the function editing instructions stored in the cloud, and send it to the target robot.
3. The system according to claim 2, characterized in that The operation management end includes a processing unit, a monitoring unit and a first communication unit; wherein, The processing unit is used to parse and filter the acquired target function editing instructions to obtain target instruction data recognizable by the robot; The monitoring unit is used to determine the target robot according to the working state of the at least one robot; The first communication unit is used to send the target instruction data to the target robot.
4. The system according to claim 3, characterized in that The monitoring unit is also used for: If it is monitored that the mobile device sends the function editing instruction to the cloud, a specific thread is created for the mobile device, and a communication connection is established with the cloud.
5. A robot interaction method, characterized in that: include: The mobile device sends the function editing instruction to the server; wherein the function editing instruction is a function instruction edited by the user according to the application scenario, and the function editing instruction includes at least one of: on-site blessing activities, making corresponding blessing greeting cards, playing songs, voice questions and answers, meetings, and storytelling; the function editing instruction includes the user's name and identity information, and the function editing instruction also includes the physical address or international mobile equipment identity code of the mobile device; The server stores the received function editing instructions, obtains the target function editing instructions from the stored function editing instructions, and sends the target function editing instructions to the target robot; The target robot receives the target function editing instruction sent by the server, and displays the function corresponding to the received target function editing instruction; the target robot also includes: a second display screen, which displays the content corresponding to the target function editing instruction; Before the mobile device sends the function editing instruction to the server, it also includes: The robot collects the user's identity information and matches the identity information with the information pre-stored in the local database; If the match is successful, the robot sends information for generating the function editing instruction to the mobile device based on the user's registration information; The robot receives the target instruction data sent by the operation management end and directly sends the relevant information to the mobile device through the second communication unit, the second communication unit includes a long-distance communication module and a short-distance communication module, the long-distance communication module includes GSM communication and GPRS, and is used to receive the target instruction data sent by the operation management end; the short-distance communication module includes Bluetooth and WIFI, and is used to directly send the relevant information to the mobile device, specifically for generating information of the function editing instruction; The robot also includes a comparator. When the camera in the robot collects the user's facial information, it is converted into a corresponding pulse signal, and the pulse signal corresponding to the facial information pre-stored in the robot database is simultaneously input into the comparator for comparison. If a match is found, the second communication unit in the robot will obtain the registration information of the relevant user from the cloud, and then parse the user's registration information based on electrical signals of different frequencies to generate information for function editing instructions: the location information of the user's venue and the QR code for the venue to interact with the robot are sent to the user's mobile device; if the match is unsuccessful, the sound device in the robot will issue a registration prompt message, and / or display the registration prompt message or registration interface on the first display screen.
6. The method according to claim 5, characterized in that The server end includes a cloud end and an operation management end. The server end stores the received function editing instructions, obtains the target function editing instructions from the stored function editing instructions, and sends them to the target robot, including: The cloud storage receives the function editing instruction; The operation management end obtains the target function editing instruction from the function editing instructions stored in the cloud, and sends it to the target robot.
7. The method according to claim 6, characterized in that The operation management end obtains the target function editing instruction from the function editing instruction stored in the cloud, and sends it to the target robot, specifically including: The operation management end obtains the target function editing from the function editing instructions stored in the cloud, and parses and filters the obtained target function editing instructions to obtain target instruction data recognizable by the robot; The operation management end determines the target robot according to the working status of at least one robot; The operation management end sends the target instruction data to the target robot.
8. The method according to claim 6, characterized in that Before the operation management end obtains the target function editing instruction from the function editing instruction stored in the cloud, the operation management end further includes: If the operation management end monitors that the mobile device sends the function editing instruction to the cloud, a specific thread is created for the mobile device and a communication connection is established with the cloud.
Citation Information
Patent Citations
Programming and control system of mobile phone to robot
CN103101054A
Interactive system and method based on robot
CN104656653A
Family affection sharing system of photos, videos and congratulation cards based on cloud platform
CN104683453A
Guide interpretation robot based on human face recognition technology, and method
CN107065863A
Visual editing cloud recipe cooking control system
CN107357665A
