Method and apparatus for acquiring robot interaction prompt information

Abstract

A method and device for obtaining robot interaction prompt information, the method comprising: obtaining information of a current interaction action of the robot; determining interaction prompt information corresponding to the interaction action; and sending the interaction prompt information to a mobile device to present the interaction prompt information to a user through the mobile device. In this way, the user can more accurately understand the interaction purpose of the robot, while the life and reality of the robot can be improved, and the user experience can be enhanced.

Description

Technical Field

[0001] This application relates to the field of robotics, and more specifically, to a method and apparatus for acquiring interactive prompts from a robot. Background Technology

[0002] With the continuous development of artificial intelligence technology, there are more and more types of robots. Among them, home robots are a relatively common type of robot, which can increase users' happiness and reduce their stress through interaction with them.

[0003] Currently, to help users understand the purpose of their interaction, home robots typically emit human voices or a special combination of electronic sounds. However, this interaction method diminishes the lifelike quality of the home robot. For example, if a home robot is primarily intended to simulate a real pet, such as a cat or dog, emitting human voices or electronic sounds would affect the realism of the pet and thus impact the user experience. Summary of the Invention

[0004] This application provides a method and apparatus for obtaining robot interaction prompts, which enables users to more accurately understand the purpose of the robot's interaction, while also enhancing the robot's sense of life and realism, and improving the user experience.

[0005] In a first aspect, a method for obtaining robot interaction prompts is provided, the method comprising: obtaining information about the robot's current interactive action; determining the interactive prompts corresponding to the interactive action; and sending the interactive prompts to a mobile device to present the interactive prompts to the user through the mobile device.

[0006] In this embodiment of the application, presenting interactive prompts of the robot to the user via a mobile device can enable the robot, such as a home robot, to accurately understand the robot's interactive purpose without uttering human voice, thereby improving the interaction effect between the robot and the user. At the same time, it can also make the robot, such as a home robot, more lifelike and realistic, thus enhancing the user experience.

[0007] In conjunction with the first aspect, in some implementations of the first aspect, the information of the interactive action includes the number information corresponding to the interactive action.

[0008] In this embodiment of the application, the interactive prompt information corresponding to the interactive action is determined by the number information corresponding to the interactive action. This is beneficial for obtaining the interactive prompt information, can reduce the data overhead of obtaining the interactive prompt information, and improve the efficiency of obtaining the interactive prompt information.

[0009] In conjunction with the first aspect, in some implementations of the first aspect, before obtaining information about the robot's current interactive actions, the method further includes: receiving request information sent by a mobile device, the request information being used to request interactive prompt information.

[0010] In this embodiment, interactive prompts from the robot can be obtained based on requests from mobile devices. This allows for requests to be made based on user needs, improving the user experience.

[0011] In conjunction with the first aspect, in some implementations of the first aspect, the information for the interactive actions is determined by the robot or a cloud server.

[0012] In this embodiment, the information of the interactive action is determined by the robot, which helps the robot determine the interactive prompt information based on the interactive action information. This can reduce the interaction between the robot and other devices, such as cloud servers, and improve the efficiency of obtaining robot interactive prompt information.

[0013] The information for interactive actions is determined by the cloud server, which allows the robot to provide interactive prompts to users without needing to have the ability to determine the interactive action information itself. This makes robot maintenance simpler and reduces robot maintenance costs.

[0014] In conjunction with the first aspect, in some implementations of the first aspect, interactive prompts are displayed within a first range of the robot's location in a real-time image, which is an image captured by the mobile device's camera and displayed on the mobile device's screen, and includes an image of the robot.

[0015] In this embodiment of the application, by displaying interactive prompts within a first range of the robot's location in a real-time image, users can quickly extract the robot's interactive prompts, thereby enabling them to quickly interact with the robot, improving the interaction effect between the user and the robot, and enhancing the user experience.

[0016] In conjunction with the first aspect, in some implementations of the first aspect, the robot's past interactive prompts are moved from a first range to a second range where the robot is located and then popped up on the real-time image.

[0017] In this embodiment, the robot's past interaction prompts are removed from the first range and then popped up from the real-time image, which makes it easier for users to clearly understand the robot's current and past interaction prompts, enabling users to better understand the robot's interaction purpose, thereby improving the interaction effect between users and robots.

[0018] Secondly, a method for obtaining robot interaction prompts is provided, the method comprising: receiving interaction prompts from the robot, the interaction prompts being interaction prompts corresponding to the robot's current interactive action; and presenting the interaction prompts to the user.

[0019] In conjunction with the second aspect, in some implementations of the second aspect, the information of the interactive action includes the number information corresponding to the interactive action.

[0020] In conjunction with the second aspect, in some implementations of the second aspect, before receiving the interactive prompts from the robot, the method further includes: sending a request message, the request message being used to request the acquisition of the interactive prompts.

[0021] In conjunction with the second aspect, in some implementations of the second aspect, the information for the interactive actions is determined by the robot or a cloud server.

[0022] In conjunction with the second aspect, in some implementations of the second aspect, the method further includes: acquiring real-time images using a mobile device's camera and displaying them on the mobile device's screen, the real-time images including an image of the robot; identifying the robot's position in the real-time images; and displaying interactive prompts within a first range of the robot's position in the real-time images.

[0023] In conjunction with the second aspect, in some implementations of the second aspect, the method further includes: after moving the robot's past interactive prompts from a first range to a second range where the robot is located, popping them out from the real-time image.

[0024] Thirdly, an apparatus for acquiring robot interaction prompts is provided. The apparatus includes: an acquisition unit for acquiring information about the robot's current interactive action; a processing unit for determining the interactive prompts corresponding to the interactive action; and a sending unit for sending the interactive prompts to a mobile device to present the interactive prompts to a user via the mobile device.

[0025] In conjunction with the third aspect, in some implementations of the third aspect, the information of the interactive action includes the number information corresponding to the interactive action.

[0026] In conjunction with the third aspect, in some implementations of the third aspect, the device further includes: a receiving unit for receiving request information sent by a mobile device, the request information being used to request interactive prompt information.

[0027] In conjunction with the third aspect, in some implementations of the third aspect, the information for the interactive actions is determined by the robot or a cloud server.

[0028] In conjunction with the third aspect, in some implementations of the third aspect, interactive prompts are displayed within a first range of the robot's location in a real-time image, which is an image captured by the mobile device's camera and displayed on the mobile device's screen, and includes an image of the robot.

[0029] In conjunction with the third aspect, in some implementations of the third aspect, the robot's past interactive prompts are moved from the first range to the second range where the robot is located and then popped up on the real-time image.

[0030] Fourthly, an apparatus for acquiring robot interaction prompts is provided. The apparatus includes: a receiving unit for receiving robot interaction prompts, wherein the interaction prompts correspond to the robot's current interactive action; and a processing unit for presenting the interaction prompts to a user.

[0031] In conjunction with the fourth aspect, in some implementations of the fourth aspect, the information of the interactive action includes the number information corresponding to the interactive action.

[0032] In conjunction with the fourth aspect, in some implementations of the fourth aspect, the device further includes: a sending unit for sending request information, the request information being used to request the acquisition of interactive prompt information.

[0033] In conjunction with the fourth aspect, in some implementations of the fourth aspect, the information for the interactive actions is determined by the robot or a cloud server.

[0034] In conjunction with the fourth aspect, in some implementations of the fourth aspect, the processing unit is used to: acquire real-time images using the camera of a mobile device and display them on the screen of the mobile device, the real-time images including an image of the robot; identify the position of the robot in the real-time images; and display interactive prompts within a first range of the robot's position in the real-time images.

[0035] In conjunction with the fourth aspect, in some implementations of the fourth aspect, the processing unit is also used to: pop up from the real-time image after moving the robot's past interactive prompts from the first range to the second range where the robot is located.

[0036] Fifthly, a computing device is provided, comprising: one or more processors; one or more memories; and one or more computer programs, wherein the one or more computer programs are stored in the one or more memories, and the one or more computer programs include instructions that, when executed by the one or more processors, cause the computing device to perform the methods described in the first aspect and any possible implementation thereof.

[0037] A sixth aspect provides a mobile device comprising: one or more processors; one or more memories; and one or more computer programs, wherein the one or more computer programs are stored in the one or more memories, and the one or more computer programs include instructions that, when executed by the one or more processors, cause the mobile device to perform the methods described in the second aspect and any possible implementation thereof.

[0038] In a seventh aspect, a computer-readable storage medium is provided, including computer instructions that, when executed on a device for acquiring robot interaction prompts, cause the device for acquiring robot interaction prompts to perform the method described in the implementation of the first or second aspect.

[0039] Eighthly, a chip is provided, including at least one processor and an interface circuit, the interface circuit being used to provide program instructions or data to the at least one processor, the at least one processor being used to execute the program instructions to implement the method described in the implementation of the first or second aspect above. Attached Figure Description

[0040] Figure 1 This is a schematic diagram of the hardware structure of the robot provided in the embodiments of this application.

[0041] Figure 2 This is a schematic diagram of the process for obtaining robot interaction prompts provided in an embodiment of this application.

[0042] Figure 3 This is a schematic diagram of the process for obtaining robot interaction prompts provided in an embodiment of this application.

[0043] Figure 4 This is a schematic diagram illustrating the display method of robot interactive prompts provided in the embodiments of this application.

[0044] Figure 5 This is a schematic diagram illustrating the display method of robot interactive prompts provided in the embodiments of this application.

[0045] Figure 6 This is a schematic diagram of the process for obtaining robot interaction prompts provided in an embodiment of this application.

[0046] Figure 7 This is a schematic block diagram of a computing device provided in an embodiment of this application.

[0047] Figure 8 This is a schematic block diagram of a mobile device provided in an embodiment of this application.

[0048] Figure 9This is a schematic diagram of the hardware structure of the computing device provided in the embodiments of this application.

[0049] Figure 10 This is a schematic diagram of the hardware structure of the mobile device provided in the embodiments of this application. Detailed Implementation

[0050] The technical solutions in the embodiments of this application will now be described with reference to the accompanying drawings.

[0051] In the description of the embodiments of this application, unless otherwise stated, " / " means "or". For example, A / B can mean A or B. "And / or" in this document is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone. Furthermore, in the description of the embodiments of this application, "plural" or "multiple" refers to two or more than two.

[0052] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of this embodiment, unless otherwise stated, "a plurality of" means two or more.

[0053] Figure 1 A schematic diagram of the structure of the robot 100 provided in an embodiment of this application is shown.

[0054] For example, such as Figure 1 As shown, the robot 100 may include a processor 110, an actuator 111, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna, a wireless communication module 150, a sensor module 160, an audio module 170, a speaker 170A, a microphone 170B, a camera 180, a display screen 190, etc.

[0055] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on robot 100. In other embodiments of this application, robot 100 may include more or fewer components than illustrated, or combine some components, or separate some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0056] The processor 110 may include one or more processing units, such as a graphics processing unit (GPU), a controller, memory, etc. These different processing units may be independent devices or integrated into one or more processors.

[0057] The controller can serve as the neural center and command center of the robot 100. The controller can generate operational control signals based on instruction opcodes and timing signals to control the fetching and execution of instructions.

[0058] The memory is used to store instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can directly retrieve it from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0059] In some embodiments, processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, and / or a USB interface, etc. The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). The I2S interface can be used for audio communication. In some embodiments, processor 110 may include multiple I2S buses. Processor 110 can be coupled to audio module 170 via the I2S bus to achieve communication between processor 110 and audio module 170. The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 150 can be coupled via a PCM bus interface. The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 150. The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display 190 and the camera 180. The GPIO interface can be configured via software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to the camera 180, display 190, wireless communication module 150, sensor module 160, audio module 170, etc.

[0060] It is understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a structural limitation on the robot 100. In other embodiments of this application, the robot 100 may also adopt different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.

[0061] Actuator 111 is used to control the robot 100 to move, rotate, jump, etc. Optionally, in some embodiments, if the robot 100 includes a head, neck, limbs, and torso, actuator 111 is also used to control the head to rotate relative to the torso, the limbs to rotate relative to the torso, the neck to shake, or the limbs to swing relative to the torso, etc. Optionally, in some embodiments, actuator 111 may include at least one motor.

[0062] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the robot 100.

[0063] Internal memory 121 can be used to store computer-executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of robot 100 by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of robot 100 (such as audio data, etc.). Furthermore, internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0064] USB interface 130 is a USB standard compliant interface, specifically a Mini USB interface, Micro USB interface, USB Type-C interface, etc. USB interface 130 can be used to connect a charger to charge robot 100, and can also be used for data transfer between robot 100 and peripheral devices.

[0065] The charging management module 140 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 receives charging input from the wired charger via a USB interface 130. In some wireless charging embodiments, the charging management module 140 receives wireless charging input via the wireless charging coil of the robot 100. While charging the battery 142, the charging management module 140 can also supply power to the electronic device via the power management module 141. The power management module 141 connects to the battery 142, and the charging management module 140 connects to the processor 110.

[0066] The wireless communication module 150 can provide wireless communication solutions for use on the robot 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks) and Bluetooth (BT).

[0067] In some embodiments, the antenna of robot 100 is coupled to wireless communication module 150, enabling robot 100 to communicate with networks and other devices via wireless communication technology.

[0068] Sensor module 160 may include at least one sensor. For example, sensor module 160 may include a touch sensor, a distance sensor, an attitude sensor, etc. In some embodiments, the touch sensor is a capacitive sensor, which may be located on the robot's head, neck, back, abdomen, etc., to sense interactive actions such as touching or patting by the user. The distance sensor is used to measure the distance between the robot and external environmental objects or the user. The attitude sensor is a gyroscope, used to sense changes in the robot's attitude.

[0069] Audio module 170 is used to convert digital audio information into analog audio signal output, and also to convert analog audio input into digital audio signal. Audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, audio module 170 may be located in processor 110, or some functional modules of audio module 170 may be located in processor 110. Speaker 170A, also called a "loudspeaker," is used to convert audio electrical signals into sound signals. Microphone 170B, also called a "microphone" or "microphone," is used to convert sound signals into electrical signals.

[0070] Robot 100 can implement audio functions through audio module 170, speaker 170A, microphone 170B, and processor 110, such as voice playback and recording.

[0071] The camera 180 is used to capture still images or videos so that the processor 110 can detect events in the images or videos acquired by the camera 180 and provide feedback on the events. For example, the camera 180 can acquire images of the user, and after the processor 110 processes the images, it can obtain user instructions so that the actuator 111 can move according to the user instructions.

[0072] The display screen 190 is used to display images, videos, etc.

[0073] As an example, the robot 100 described above can be a household robot, such as a pet robot.

[0074] Currently, to help users understand the purpose of their interaction, home robots typically emit human voices or a special combination of electronic sounds. However, this interaction method diminishes the lifelike quality of the home robot. For example, if a home robot is primarily intended to simulate a real pet, such as a cat or dog, emitting human voices or electronic sounds would affect the realism of the pet and thus impact the user experience.

[0075] To address the aforementioned issues, this application provides a method and apparatus for obtaining robot interaction prompts. The method includes: obtaining information about the robot's current interactive actions; determining the interactive prompts corresponding to the interactive actions; and sending the interactive prompts to a mobile device to present the interactive prompts to the user via the mobile device.

[0076] The method and apparatus for obtaining robot interaction prompts provided in this application can enable users to understand the purpose of robot interaction more accurately, while also improving the robot's sense of life and realism, and enhancing the user experience.

[0077] Figure 2 This is a schematic diagram of the process for obtaining robot interaction prompts provided in an embodiment of this application. Figure 2 The method for obtaining robot interaction prompts shown can be performed by the robot or by a computing device. Optionally, the computing device can be located in the robot or in the cloud, such as a cloud server.

[0078] 210, Obtain information about the robot's current interactive actions.

[0079] In the embodiments of this application, the robot can perform interactive actions corresponding to the external environment.

[0080] For example, when the distance between the robot's sensor module and the user's face is greater than a first distance threshold, the robot can perform one or more of the following interactive actions, such as dancing, spinning, or raising its leg, because the distance between the robot and the user is relatively far.

[0081] When the robot performs an interactive action of dancing, the interactive action information can be information about dancing. When the robot performs an interactive action of spinning, the interactive action information can be information about spinning.

[0082] For example, when the distance between a person's face in a still image or video captured by the robot's camera and the robot is less than a second distance threshold, the robot can perform more subtle and expressive interactive actions, such as looking up at the user or looking down for a touch.

[0083] When the robot's interactive action is to look up at the user, the interaction information can be the information about looking up at the user. When the robot's interactive action is to look down for a pet, the interaction information can be the information about looking down for a pet.

[0084] Optionally, in this embodiment, the information of the interactive action may include a number corresponding to the interactive action. For example, the number corresponding to the interactive action may include the number of the interactive action itself.

[0085] Optionally, the numbering of interactive actions can include different formats. For example, it can be numbered in text form or in alphabetical form.

[0086] For example, the interactive actions mentioned above, such as dancing, spinning, raising one's leg, looking up at the user, and looking down for a touch, are numbered 0001, 0002, 0003, 0004, and 0005, respectively.

[0087] Optionally, in this embodiment of the application, the numbering information corresponding to the interactive action may include the numbering information of the interactive mode.

[0088] Optionally, in this embodiment of the application, the numbering information corresponding to the interactive action may include the numbering information of the interactive state.

[0089] Optionally, the numbering of interaction modes or interaction states can include different formats. For example, they can be numbered in text form or in alphabetical form.

[0090] In other words, the information about an interactive action can include information about the interactive action itself, information about the interactive mode, or information about the interactive state.

[0091] Optionally, in this embodiment, the robot's interaction can be divided into multiple interaction modes based on the external environment in which the robot is located. Each robot interaction mode can include at least one interactive action.

[0092] For example, multiple interaction modes can include: humanoid mode, face mode, or normal mode, etc. When the robot's sensor module detects a face at a distance greater than a first threshold, the robot's interaction mode can be confirmed as humanoid mode. When the distance to the robot's face in a still image or video captured by the robot's camera is less than a second distance threshold, the robot's interaction mode can be determined as face mode. When the robot does not detect any special events, the robot's interaction mode can be determined as normal mode.

[0093] For example, a robot's interaction mode may include an interaction action. For instance, in face mode, the robot may perform an interaction action of slightly moving closer to the user. Both the interaction action and the face mode are responses from the robot to the same external environment, and it can be assumed that there is a one-to-one correspondence between the interaction action and the interaction mode. The interaction action currently being performed by the robot can be determined through information about the interaction action itself, such as its ID, or information about the interaction mode, such as its ID. This allows for the identification of the corresponding interactive prompt information.

[0094] Optionally, when a robot’s interaction mode includes an interaction action, the number of the interaction action and the number of the interaction mode can be the same or different.

[0095] Optionally, in the embodiments of this application, the robot's interaction mode may include at least one interaction state, and the robot's interaction state may include at least one interaction action.

[0096] For example, a robot's humanoid mode can include a follow state, a search state, or a pick-up state. In humanoid mode, when the robot detects a humanoid figure and the figure moves further away, the robot's interaction state can be follow. In humanoid mode, when the robot detects the humanoid figure disappearing, the robot's interaction state can be search. In humanoid mode, when the robot detects that the humanoid figure has been picked up, the robot's interaction state can be pick-up.

[0097] For example, a robot's interaction state may include an interaction action. For instance, in follow state, the robot's interaction action may follow the user's movement. Both the interaction action and the follow state are different levels of feedback from the robot to the same external environment. It can be assumed that there is a one-to-one correspondence between the interaction state and the interaction action. The robot's current interaction action can be determined through information about the interaction action itself, such as the action's identifier or the state's identifier, thus allowing the identification of the corresponding interaction prompt.

[0098] Optionally, when a robot's interaction state includes an interaction action, the numbering information of the interaction action and the numbering information of the interaction state can be the same or different.

[0099] Optionally, in this embodiment, the information of the current interaction action can be determined by the robot. For example, the robot can use a sensor module to detect the current external environment, and then determine the information of the current interaction action based on the external environment. Optionally, the robot can also send the interaction action information to a cloud server.

[0100] Optionally, in this embodiment, the information of the current interaction action can be determined by a cloud server. For example, the robot can use a sensor module to detect the current external environment and then send the information of the external environment to the cloud server. The cloud server can then determine the information of the current interaction action based on the information of the external environment. Optionally, the cloud server can also send the information of the interaction action to the robot.

[0101] In this embodiment of the application, information about the current interaction action can be obtained from the robot, or it can be obtained from the cloud server.

[0102] 220. Determine the interactive prompt information corresponding to the robot's current interactive action.

[0103] Interactive prompts can be understood as information that helps users understand the purpose of the robot's interaction. Once users receive these prompts, they will know how the robot wants them to interact with it.

[0104] The interactive prompts corresponding to the current interactive action can include at least one. For example, when the robot performs the action of looking down for a pat, the corresponding interactive prompts can include at least one of "Little master, I miss you" or "Quickly pat my head".

[0105] 230. Send interactive prompts to mobile devices and present the interactive prompts to users through those mobile devices.

[0106] Accordingly, the mobile device receives the interactive prompt. The mobile device can then present this interactive prompt to the user.

[0107] Optionally, in this embodiment of the application, the mobile device may present interactive prompts to the user in the form of text and / or images.

[0108] Optionally, in this embodiment of the application, the mobile device may present interactive prompts to the user in the form of symbols.

[0109] In this embodiment of the application, presenting interactive prompts of the robot to the user via a mobile device can enable the robot, such as a home robot, to accurately understand the robot's interactive purpose without uttering human voice, thereby improving the interaction effect between the robot and the user. At the same time, it can also make the robot, such as a home robot, more lifelike and realistic, thus enhancing the user experience.

[0110] Figure 3 This is a flowchart illustrating a method for obtaining robot interaction prompts provided in an embodiment of this application.

[0111] Optionally, Figure 3The process of acquiring information about the robot's current interactive actions, determining the robot's current interactive prompts based on this information, and sending the robot's interactive prompts to mobile devices can be performed by the robot or by a computing device. When the above steps are performed by a computing device, the computing device can be located within the robot or on a cloud server. The following description uses a robot as the executing entity as an example.

[0112] 310. The mobile device sends a request message to the robot.

[0113] This request is used to request the robot's current interactive prompts.

[0114] Optionally, in this embodiment of the application, the sending of the request information can be triggered based on the user's needs.

[0115] For example, when a user needs to interact with a robot using a mobile device, the user can open the mobile device's application (APP) to trigger the mobile device to send a request message to the robot; or the user can click a button in the mobile device's APP, such as the "Get Interaction Prompt" button, to trigger the mobile device to send a request message to the robot.

[0116] 320, The robot obtains information about the robot's current interactive actions.

[0117] The content of step 320 can be found in the relevant description in step 210, and will not be repeated here.

[0118] 330, the robot determines the interactive prompt information corresponding to the current interactive action.

[0119] The description of step 330 can be found in the description of step 220, and will not be repeated here.

[0120] 340. The robot sends interactive prompts to the mobile device.

[0121] 350. Mobile devices present interactive prompts to users.

[0122] Optionally, in this embodiment of the application, the mobile device may present interactive prompts to the user in the form of text and / or images.

[0123] Optionally, in this embodiment of the application, interactive prompts may be displayed in the center of the mobile device screen.

[0124] like Figure 4The diagram illustrates a display method for robot interactive prompts provided in an embodiment of this application. A dynamic background can be used as the background for displaying the robot interactive prompts. For example, a dynamic image, such as a graphics interchange format (GIF) animation, can be used as the background to indicate that the robot currently has interactive prompts. The robot's current interactive prompts can be displayed as text within the dynamic background. For example, the robot's interactive prompts can be displayed in the center of the mobile device screen.

[0125] Optionally, in this embodiment of the application, when there are multiple interactive prompts corresponding to the current interactive action, the interactive prompts can be displayed in chronological order. For example, the interactive prompts for bowing one's head to ask for a pat include "Little master, I miss you" and "Quickly pat my head." "Little master, I miss you" can be displayed within 0-3 seconds, and "Quickly pat my head" can be displayed within 4-12 seconds.

[0126] Optionally, in this embodiment of the application, past interactive prompts from the robot can be displayed from the real-time image.

[0127] Optionally, in this embodiment of the application, a real-time image can be captured using the camera of a mobile device and displayed on the screen of the mobile device. The real-time image includes an image of the robot. Then, the position of the robot in the real-time image is identified, and the current interactive prompt information of the robot is displayed in a first range of the robot's position in the real-time image.

[0128] like Figure 5 As shown, in the real-time image of the robot captured by the camera of the mobile device, the robot's current interactive prompts can be displayed within a first range of the robot's location, such as within 100 pixels around the robot.

[0129] Optionally, in this embodiment, past interactive prompts for the robot can be displayed in the real-time image after the robot moves from a first range to a second range where it is located. For example, the second range can be a range more than 100 pixels around the robot.

[0130] Optionally, in the embodiments of this application, Figure 3 Steps 320 to 340 can be performed by a cloud server. For example, the cloud server can obtain information about the robot's current interactive action. The cloud server determines the interactive prompt information corresponding to the current interactive action. The cloud server can send the interactive prompt information to the mobile device. The mobile device can then present the interactive prompt information to the user.

[0131] Figure 6 This is a schematic diagram of the process for obtaining robot interaction prompts provided in an embodiment of this application.

[0132] 610. The mobile device sends a request message to the robot.

[0133] The request information is used to request interactive prompts from the robot.

[0134] Optionally, in this embodiment of the application, the sending of the request information may be triggered based on the user's needs.

[0135] For example, when a user needs to interact with a robot using a mobile device, they can trigger the mobile device to send a request message to the robot by opening the mobile device's app; or the user can click a button in the mobile device's app, such as clicking the button to get interactive prompts, to trigger the mobile device to send a request message to the robot.

[0136] 620. The robot can obtain information about the robot's current interactive actions.

[0137] The content of step 620 can be found in the relevant description in step 210, and will not be repeated here.

[0138] 630, the robot can send information about the current interactive actions to the cloud server.

[0139] Alternatively, the robot can directly send the information of the interaction to the cloud server, or it can send the information of the current interaction to the server via a mobile device.

[0140] Optionally, in this embodiment, the mobile device can send request information to the cloud server, and then the cloud server can obtain information about the robot's current interactive actions, replacing steps 610 to 630. Optionally, the mobile device can send request information directly to the cloud server, or the mobile device can send request information to the mobile device through the robot.

[0141] 640, The cloud server determines the interactive prompt information corresponding to the interactive action.

[0142] The content of step 640 can be found in the relevant description in step 220, and will not be repeated here.

[0143] 650, the cloud server sends interactive prompts to the mobile device.

[0144] 660, The mobile device turns on its camera.

[0145] Optionally, in this embodiment, the mobile device can turn on its camera based on a user's trigger action. For example, the mobile device can turn on its camera based on a user's action of clicking the camera in the mobile device's app.

[0146] Optionally, in this embodiment, the user's action of turning on the camera in the mobile device's app can trigger the mobile device to send a request to the robot or cloud server. That is, steps 610 and 660 can be executed simultaneously.

[0147] 670, uses a camera to capture real-time images and displays them on the screen of a mobile device.

[0148] The live feed includes images of the robot.

[0149] In this embodiment of the application, the user can point the camera at the robot, thereby enabling the mobile device to capture real-time images of the robot using the camera.

[0150] 680, Mobile devices identify the robot's position in real-time images.

[0151] For example, mobile devices can extract a robot from a real-time image based on one or more pieces of information such as the robot's outline, color, or shape, thereby further identifying the robot's position in the real-time image.

[0152] 690. Mobile devices can display interactive prompts within the first range of the robot's location in a real-time image.

[0153] The content displayed for robot interaction prompts can be found in the following reference. Figure 5 The relevant descriptions in the previous document will not be repeated here.

[0154] 6100, the mobile device will display the robot's past interactive prompts from the live image.

[0155] When the robot's external environment changes, its interactive actions and prompts may also change. When the robot's prompts change, the mobile device can re-display the new (current) prompts within a first area of ​​the live view. Past prompts are then moved from the first area to a second area around the robot's location and popped up from the live view.

[0156] In the embodiments of this application, the sequence numbers of the above processes do not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application. For example, steps 660 to 680 can also be executed before step 610.

[0157] The above text combined Figures 2 to 6 The present application describes a method for obtaining robot interactive prompt information provided in its embodiments. The following is a description of this method in conjunction with... Figures 7 to 10 This section describes the apparatus embodiments of the present application. It should be understood that the descriptions of the method embodiments correspond to the descriptions of the apparatus embodiments; therefore, any parts not described in detail can be referred to in the above description.

[0158] Figure 7 A schematic block diagram of a computing device provided in an embodiment of this application is shown. The computing device 2000 includes an acquisition unit 2010, a processing unit 2020, and a transmission unit 2030. The acquisition unit 2010 can acquire data, and the processing unit 2020 is used to perform data processing. The transmission unit 2030 can also be referred to as a communication interface or a communication unit.

[0159] Optionally, the computing device 2000 may further include a storage unit 2040, which can be used to store instructions and / or data, and the processing unit 2020 can read the instructions and / or data in the storage unit to enable the device to implement the aforementioned method embodiments.

[0160] In some embodiments, the computing device 2000 may include tools for performing... Figures 2 to 6 The corresponding units of each process of the method. Furthermore, each unit in the computing device 2000 and the other operations and / or functions described above are respectively for implementing... Figures 2 to 6 The corresponding process of the method implementation.

[0161] Acquisition unit 2010 is used to acquire information about the robot's current interactive actions;

[0162] Processing unit 2020 is used to determine the interactive prompt information corresponding to the interactive action;

[0163] The sending unit 2030 is used to send interactive prompt information to the mobile device so as to present the interactive prompt information to the user through the mobile device.

[0164] Optionally, in this embodiment of the application, the information of the interactive action includes number information corresponding to the interactive action.

[0165] Optionally, in this embodiment of the application, the computing device 2000 further includes: a receiving unit 2050, configured to receive request information sent by a mobile device, the request information being used to request access to interactive prompt information.

[0166] Optionally, in this embodiment, the information of the interactive action is determined by the robot or a cloud server.

[0167] Optionally, in this embodiment, interactive prompts are displayed within a first range of the robot's location in the real-time image. The real-time image is captured by the mobile device's camera and displayed on the mobile device's screen, and includes an image of the robot.

[0168] Optionally, in this embodiment of the application, the robot's past interactive prompts are displayed on the real-time image after moving from the first range to the second range where the robot is located.

[0169] Figure 8 A schematic block diagram of a mobile device provided in an embodiment of this application is shown. The mobile device 3000 includes a receiving unit 3010 and a processing unit 3020. The receiving unit 3010 can implement corresponding communication functions, and the processing unit 3020 is used for data processing. The receiving unit 3010 can also be referred to as a communication interface or a communication unit.

[0170] Optionally, the mobile device 3000 may further include a storage unit 3030, which can be used to store instructions and / or data, and the processing unit 3020 can read the instructions and / or data in the storage unit to enable the device to implement the aforementioned method embodiments.

[0171] In some implementations, the mobile device 3000 may include tools for performing Figures 2 to 6 The corresponding units of each process of the method. Furthermore, each unit in the mobile device 3000 and the other operations and / or functions described above are respectively for implementing... Figures 2 to 6 The corresponding process of the method implementation.

[0172] The receiving unit 3010 is used to receive interactive prompt information from the robot, which is the interactive prompt information corresponding to the robot's current interactive action;

[0173] The processing unit 3020 is used to present interactive prompts to the user.

[0174] Optionally, in this embodiment of the application, the information of the interactive action includes number information corresponding to the interactive action.

[0175] Optionally, in this embodiment of the application, the mobile device 3000 further includes: a sending unit 3040, used to send request information, the request information being used to request the acquisition of interactive prompt information.

[0176] Optionally, in this embodiment, the information of the interactive action is determined by the robot or a cloud server.

[0177] Optionally, in this embodiment, the processing unit 3020 is configured to: acquire real-time images using the camera of the mobile device and display them on the screen of the mobile device, wherein the real-time images include an image of the robot; identify the position of the robot in the real-time images; and display interactive prompt information within a first range of the robot's position in the real-time images.

[0178] Optionally, in this embodiment of the application, the processing unit 3020 is further configured to: move the robot's past interactive prompts from the first range to the second range where the robot is located, and then pop them out from the real-time image.

[0179] It should be noted that the aforementioned mobile device 3000 is embodied in the form of a functional unit. The term "unit" here can be implemented in software and / or hardware, without specific limitations.

[0180] For example, a "unit" can be a software program, a hardware circuit, or a combination of both that implements the above functions. The hardware circuit may include an application-specific integrated circuit (ASIC), electronic circuitry, a processor (e.g., a shared processor, a proprietary processor, or a group processor) and memory for executing one or more software or firmware programs, integrated logic circuitry, and / or other suitable components that support the described functions.

[0181] Therefore, the units of the various examples described in the embodiments of this application can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0182] Figure 9 A schematic diagram of the hardware structure of the computing device provided in an embodiment of this application is shown. Figure 9 The computing device 4000 shown includes a memory 4001, a processor 4002, a communication interface 4003, and a bus 4004. The memory 4001, processor 4002, and communication interface 4003 are interconnected via the bus 4004.

[0183] The memory 4001 may be a read-only memory (ROM), a static storage device, a dynamic storage device, or a random access memory (RAM). The memory 4001 may store programs, and when the program stored in the memory 4001 is executed by the processor 4002, the processor 4002 is used to perform the various steps of obtaining robot interactive prompt information according to the embodiments of this application.

[0184] The processor 4002 may be a general-purpose central processing unit (CPU), microprocessor, application-specific integrated circuit (ASIC), graphics processing unit (GPU), or one or more integrated circuits, used to execute relevant programs to implement the method of obtaining robot interactive prompt information in the method embodiment of this application.

[0185] The processor 4002 can also be an integrated circuit chip with signal processing capabilities. In implementation, the various steps of obtaining robot interactive prompts in this application can be completed through integrated logic circuits in the processor 4002 or through software instructions.

[0186] The processor 4002 described above can also be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. It can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this application. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of this application can be directly embodied in the execution of a hardware decoding processor, or can be executed by a combination of hardware and software modules in the decoding processor. The software modules can be located in random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, or other mature storage media in the art. This storage medium is located in memory 4001, and the processor 4002 reads the information in memory 4001 and combines it with its hardware to complete the task. Figure 9 The device shown includes units that are required to perform functions, or methods for obtaining robot interactive prompts according to embodiments of the present application.

[0187] The communication interface 4003 uses transceiver devices, such as, but not limited to, transceivers, to enable communication between the computing device 4000 and other devices or communication networks.

[0188] Bus 4004 may include a path for transmitting information between various components of computing device 4000 (e.g., memory 4001, processor 4002, communication interface 4003).

[0189] Figure 10 A schematic diagram of the hardware structure of a mobile device provided in an embodiment of this application is shown. Figure 10 The mobile device 5000 shown includes a memory 5001, a processor 5002, a communication interface 5003, and a bus 5004. The memory 5001, processor 5002, and communication interface 5003 are interconnected via the bus 5004.

[0190] The memory 5001 may be a read-only memory (ROM), a static storage device, a dynamic storage device, or a random access memory (RAM). The memory 5001 may store programs, and when the program stored in the memory 5001 is executed by the processor 5002, the processor 5002 is used to perform the various steps of obtaining robot interactive prompt information according to the embodiments of this application.

[0191] The processor 5002 may be a general-purpose central processing unit (CPU), microprocessor, application-specific integrated circuit (ASIC), graphics processing unit (GPU), or one or more integrated circuits, used to execute relevant programs to implement the method of obtaining robot interactive prompt information in the method embodiment of this application.

[0192] The processor 5002 can also be an integrated circuit chip with signal processing capabilities. In implementation, the various steps of obtaining robot interactive prompts in this application can be completed through integrated logic circuits in the processor 5002 or through software instructions.

[0193] The processor 5002 described above can also be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. It can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this application. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of this application can be directly embodied in the execution of a hardware decoding processor, or can be executed by a combination of hardware and software modules in the decoding processor. The software modules can be located in random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, or other mature storage media in the art. This storage medium is located in memory 5001, and the processor 5002 reads the information in memory 5001 and combines it with its hardware to complete the task. Figure 10 The device shown includes units that are required to perform functions, or methods for obtaining robot interactive prompts according to embodiments of the present application.

[0194] The communication interface 5003 uses transceiver devices, such as, but not limited to, transceivers, to enable communication between the device 5000 and other devices or communication networks.

[0195] Bus 5004 may include a pathway for transmitting information between various components of mobile device 5000 (e.g., memory 5001, processor 5002, communication interface 5003).

[0196] It should be noted that although the computing device 4000 or mobile device 5000 described above only shows a memory, processor, and communication interface, those skilled in the art should understand that in specific implementations, the computing device 4000 or mobile device 5000 may also include other devices necessary for normal operation. Furthermore, depending on specific needs, those skilled in the art should understand that the computing device 4000 or mobile device 5000 may also include hardware devices for implementing other additional functions. In addition, those skilled in the art should understand that the computing device 4000 or mobile device 5000 may only include the devices necessary for implementing the embodiments of this application, and may not necessarily include... Figure 9 or Figure 10 All the devices shown.

[0197] This application also provides a computer-readable medium storing program code for execution by a device, the program code including a method for executing the method for obtaining robot interactive prompt information in the embodiments of this application.

[0198] This application also provides a chip, which includes a processor and a data interface. The processor reads instructions stored in the memory through the data interface and executes the method for obtaining robot interactive prompt information in this application embodiment.

[0199] Optionally, as one implementation, the chip may further include a memory storing instructions, and the processor is used to execute the instructions stored in the memory. When the instructions are executed, the processor is used to perform the method for obtaining robot interactive prompt information in the embodiments of this application.

[0200] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0201] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0202] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0203] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0204] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0205] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0206] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in this application, and these modifications or substitutions should all be covered within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A method for acquiring robot interaction prompts, characterized in that, include: Obtain information about the robot's current interactive actions; Determine the interactive prompt information corresponding to the interactive action; The interactive prompt information is sent to a mobile device to present the interactive prompt information to the user through the mobile device. The interactive prompt information is displayed in a first range of the robot's location in a real-time image. The real-time image is an image captured by the camera of the mobile device and displayed on the screen of the mobile device, and the real-time image includes an image of the robot.

2. The method according to claim 1, characterized in that, The information of the interactive action includes the number information corresponding to the interactive action.

3. The method according to claim 1, characterized in that, Before acquiring information about the robot's current interactive actions, the method further includes: The system receives a request from the mobile device, the request being used to request the interactive prompt information.

4. The method according to claim 1, characterized in that, The information for the interactive action is determined by the robot or the cloud server.

5. The method according to claim 1, characterized in that, The robot's past interactive prompts are displayed on the real-time image after they move from the first range to the second range where the robot is located.

6. A method for acquiring robot interaction prompts, characterized in that, include: Receive interactive prompts from the robot, wherein the interactive prompts are interactive prompts corresponding to the robot's current interactive action; Present the interactive prompt information to the user; Presenting the interactive prompt information to the user includes: The robot's image is captured using the camera of a mobile device and displayed on the screen of the mobile device. Identify the robot's position in the real-time image; The interactive prompt information is displayed within a first range of the robot's location in the real-time image.

7. The method according to claim 6, characterized in that, The information of the interactive action includes the number information corresponding to the interactive action.

8. The method according to claim 6, characterized in that, Before receiving interactive prompts from the robot, the method further includes: Send a request message, which is used to request the interactive prompt information.

9. The method according to claim 6, characterized in that, The information for the interactive action is determined by the robot or the cloud server.

10. The method according to claim 6, characterized in that, The method further includes: After the robot's past interactive prompts are moved from the first range to the second range where the robot is located, they pop up in the real-time image.

11. A computing device, characterized in that, include: One or more processors; One or more memory units; And one or more computer programs, wherein the one or more computer programs are stored in the one or more memories, the one or more computer programs including instructions that, when executed by the one or more processors, cause the computing device to perform the method as described in any one of claims 1 to 5.

12. A mobile device, characterized in that, include: One or more processors; One or more memory units; And one or more computer programs, wherein the one or more computer programs are stored in the one or more memories, the one or more computer programs including instructions that, when executed by the one or more processors, cause the mobile device to perform the method as described in any one of claims 6 to 10.

13. A computer-readable storage medium, characterized in that, The device includes computer instructions that, when executed on a device for acquiring robot interaction prompts, cause the device for acquiring robot interaction prompts to perform the method as claimed in claims 1 to 5 or any one of claims 6 to 10.

Images