Robot-based question-answering service method, device, intelligent device, and storage medium

Abstract

The present invention is applicable to the field of robotics and provides a robot-based question-and-answer service method, apparatus, intelligent device, and storage medium. The question-and-answer service method comprises: a robot obtaining a service reservation request sent by a user terminal, the service reservation request including the identity information of a target user and a reservation location, wherein the target user is the user requesting the robot to provide question-and-answer services; the robot moving to the reservation location and obtaining a first environmental image, which is an environmental image centered on the reservation location and within a first preset range; the robot determining the target user based on the first environmental image and the identity information; the robot obtaining a question-and-answer instruction from the target user and providing a question-and-answer service corresponding to the instruction. The present invention can provide users with convenient and effective question-and-answer services, enhancing the user experience.

Description

Technical Field

[0001] The present invention relates to the field of robotics technology, and in particular to a robot-based question-answering service method, apparatus, intelligent device, and storage medium. Background Art

[0002] Currently, in places like shopping malls, hotels, karaoke bars, exhibition halls, and museums, staff or volunteers are often available to provide consultation and Q&A services, or smart information desks are set up for users to operate independently. However, the service quality of staff and volunteers varies, which can inevitably lead to user misleading. Existing smart information desks generally only offer limited Q&A functions, such as floor guidance. Furthermore, smart information desks are often fixed in one location, making them difficult for users to find, inconvenient to use, and a poor user experience.

[0003] How to provide users with convenient and effective question-and-answer services and enhance user experience is a problem that needs to be solved at present. Summary of the Invention

[0004] The embodiments of the present invention provide a robot-based question-answering service method, apparatus, intelligent device, and storage medium, which can provide intelligent question-answering services, provide users with convenient and effective question-answering services, and enhance user experience.

[0005] In a first aspect, an embodiment of the present invention provides a robot-based question-answering service method, comprising:

[0006] The robot obtains a service reservation request sent by a user terminal, wherein the service reservation request includes the identity information of a target user and a reservation location, wherein the target user is a user who requires the robot to provide a question-and-answer service;

[0007] The robot moves to the reserved position and obtains a first environmental image, where the first environmental image refers to an environmental image within a first preset range centered on the reserved position;

[0008] The robot determines a target user based on the first environment image and the identity information;

[0009] The robot obtains the question-and-answer instruction of the target user and provides a question-and-answer service corresponding to the question-and-answer instruction.

[0010] In a possible implementation of the first aspect, the identity information includes target facial features; and the robot determines the target user based on the first environment image and the identity information, including:

[0011] Performing facial feature detection based on the first environment image;

[0012] If a facial feature is detected in the first environment image, the detected facial feature is compared with the target facial feature;

[0013] If the comparison result is a match, the user corresponding to the facial feature is determined as the target user.

[0014] In a possible implementation of the first aspect, the robot determines a target user based on the first environment image and the identity information, further comprising:

[0015] If no facial features are detected in the first environmental image, or if the facial features detected in the first environmental image do not match the target facial features, the robot acquires a second environmental image, where the second environmental image is an environmental image centered at the reserved location and within a second preset range.

[0016] The robot performs facial feature detection based on the second environment image;

[0017] If a facial feature is detected in the second environment image, the robot compares the detected facial feature with the target facial feature;

[0018] If the comparison result is a match, the robot determines the user corresponding to the facial feature as the target user.

[0019] In a possible implementation of the first aspect, the service reservation request further includes a device identifier of the user terminal, and the robot determines a target user based on the first environment image and the identity identifier information, further comprising:

[0020] If no facial features are detected in the first environment image, or if the facial features detected in the first environment image do not match the target facial features, the robot sends a location request to the user terminal based on the device identifier;

[0021] The robot receives the real-time position fed back by the user terminal based on the position request, and moves to the real-time position;

[0022] The robot authenticates the user at the real-time location based on the identity information;

[0023] If the identity authentication is passed, the robot determines the user at the real-time location as a target user.

[0024] In a possible implementation of the first aspect, the robot obtains a question-and-answer instruction from the target user and provides a question-and-answer service corresponding to the question-and-answer instruction, including:

[0025] The robot obtains a facial image of the target user and displays the facial image on a display screen of the robot;

[0026] If the duration of time the facial image is displayed on the display screen reaches a preset duration, the robot obtains the question-and-answer instruction of the target user and provides a question-and-answer service corresponding to the question-and-answer instruction.

[0027] In a possible implementation of the first aspect, the robot is provided with multiple display screens;

[0028] The robot acquires a facial image of the target user and displays the facial image on a display screen of the robot, including:

[0029] The robot obtains the posture of the target user;

[0030] Based on the posture of the target user, the robot activates a display screen corresponding to the posture of the target user and displays the face image on the display screen.

[0031] In a possible implementation of the first aspect, the robot obtains the service reservation request sent by the user terminal, including:

[0032] The robot is in communication with the user terminal to obtain a service reservation request sent by the user terminal;

[0033] Alternatively, the robot is connected to a dispatch center for communication to obtain a service task instruction issued by the dispatch center, wherein the dispatch center is used to receive a service appointment request sent by the user terminal, and based on the service appointment request, generate a service task instruction and send it to the robot, wherein the service task instruction carries the service appointment request sent by the user terminal.

[0034] In a second aspect, an embodiment of the present invention provides a robot-based question-answering service device, comprising:

[0035] An appointment request obtaining unit, configured for the robot to obtain a service appointment request sent by a user terminal, wherein the service appointment request includes the identity information of a target user and an appointment location, wherein the target user is a user who requires the robot to provide a question-and-answer service;

[0036] An environmental image acquisition unit, configured to move the robot to the predetermined position and acquire a first environmental image, wherein the first environmental image refers to an environmental image within a first preset range centered on the predetermined position;

[0037] a target user determining unit, configured for the robot to determine a target user based on the first environment image and the identity identification information;

[0038] The question-answering service unit is used for the robot to obtain the question-answering instructions of the target user and provide question-answering services corresponding to the question-answering instructions.

[0039] In a third aspect, an embodiment of the present invention provides an intelligent device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the robot-based question-and-answer service method as described in the first aspect above is implemented.

[0040] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the robot-based question-answering service method as described in the first aspect above is implemented.

[0041] In a fifth aspect, an embodiment of the present invention provides a computer program product, which, when executed on a smart device, enables the smart device to execute the robot-based question-answering service method as described in the first aspect above.

[0042] In an embodiment of the present invention, a robot obtains a service reservation request sent by a user terminal, the service reservation request including the identity information of the target user and the reservation location, then moves to the reservation location and obtains a first environmental image, and then determines the target user based on the first environmental image and the identity information. Finally, the robot obtains the question-and-answer instructions of the target user and provides a question-and-answer service corresponding to the question-and-answer instruction. The user only needs to make an appointment for the question-and-answer service, and the robot will find the user to realize intelligent question-and-answer service. The question-and-answer service is convenient, thereby improving the effectiveness of the question-and-answer service and enhancing the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0044] Figure 1 This is a flowchart of an implementation method of a robot-based question-answering service provided by an embodiment of the present invention;

[0045] Figure 2 This is a specific implementation flowchart of step S30 of the robot-based question-answering service method provided in an embodiment of the present invention;

[0046] Figure 3 This is another specific implementation flowchart of step S30 of the robot-based question-answering service method provided in an embodiment of the present invention;

[0047] Figure 4 This is another specific implementation flowchart of step S30 of the robot-based question-answering service method provided in an embodiment of the present invention;

[0048] Figure 5 This is a specific implementation flow chart of the robot-based question-answering service method S40 provided in one embodiment of the present invention;

[0049] Figure 6 This is a structural block diagram of a robot-based question-answering service device provided by an embodiment of the present invention;

[0050] Figure 7 Schematic diagram of a smart device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0051] In the following description, specific details such as particular system structures and techniques are provided for purposes of illustration, not limitation, to facilitate a thorough understanding of the embodiments of the present invention. However, it will be apparent to those skilled in the art that the present invention may be practiced in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present invention with unnecessary detail.

[0052] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and / or components, but does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or groups thereof.

[0053] It will also be understood that the term "and / or" used in the present description and appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

[0054] As used in the present specification and the appended claims, the term "if" may be interpreted as "when" or "upon" or "in response to determining" or "in response to detecting," depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" may be interpreted as meaning "upon determination" or "in response to determining" or "upon detection of [described condition or event]" or "in response to detecting [described condition or event]," depending on the context.

[0055] In addition, in the description of the present specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0056] References to "one embodiment" or "some embodiments" in the present specification mean that a particular feature, structure, or characteristic described in conjunction with that embodiment is included in one or more embodiments of the present invention. Thus, phrases such as "in one embodiment," "in some embodiments," "in other embodiments," and "in yet other embodiments" appearing in various places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "including," "comprising," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0057] The question-answering service method provided by the embodiment of the present invention can be applied to intelligent robots.

[0058] Figure 1 The following illustrates the implementation process of the robot-based question-answering service method provided by an embodiment of the present invention, which includes steps S10 to S40. The specific implementation principles of each step are as follows:

[0059] S10: The robot obtains a service reservation request sent by a user terminal, wherein the service reservation request includes the target user's identity information and the reservation location;

[0060] Among them, the target users are users who require the robot to provide question-and-answer services.

[0061] In an embodiment of the present invention, when a user requires a Q&A service, they can make a reservation in advance through a user terminal. A robot will then travel to the user's location and provide the service. The user terminal can be a mobile terminal such as a mobile phone or tablet, or a smart wearable device such as a smartwatch. The service reservation request sent by the user through the user terminal must include identification information and a reservation location. The reservation location is the location where the target user requires the Q&A service. It should be noted that the reservation location must be within the range within which the robot can move.

[0062] In one possible implementation, the robot communicates with the user terminal and receives a service reservation request from the user terminal. In this embodiment of the present invention, the user terminal pre-acquires the robot's identity. Based on this identity, the user terminal can directly communicate with the robot and send the service reservation request to the robot, enabling rapid reservation.

[0063] In another possible implementation, the robot is in communication with a dispatch center and obtains a service task instruction issued by the dispatch center. The dispatch center is configured to receive a service appointment request sent by the user terminal, and the service appointment request is configured to instruct the dispatch center to assign the robot to provide question-and-answer services to the target user. Specifically, the dispatch center generates a service task instruction based on the service appointment request and sends it to the robot. The service task instruction carries the service appointment request sent by the user terminal. In this embodiment of the present invention, the robot is dispatched by the dispatch center, and the robot is indirectly connected to the user terminal through the dispatch center. The dispatch center assigns the service task instruction to the currently idle robot so that the question-and-answer service can be provided to the user as soon as possible.

[0064] In one possible implementation, the service appointment request also includes the appointment time. Based on the appointment location and time, the dispatch center can assign the service task to the robot closest to the appointment location and available on a proximity basis, so that Q&A service can be provided to the user as soon as possible. In this embodiment of the present invention, the robot must arrive at the appointment location at or before the appointment time to avoid waiting for the user.

[0065] S20: The robot moves to the reserved position and obtains a first environment image, where the first environment image refers to an environment image within a first preset range centered at the reserved position.

[0066] In an embodiment of the present invention, the robot automatically locates and navigates according to the reserved location and moves to the reserved location. The robot is equipped with a camera. When the robot moves to the reserved location, the camera captures an image of the environment within a first preset range centered on the reserved location, for example, an image of the environment within a radius of 3 meters centered on the reserved location.

[0067] In one possible implementation, the robot locates its current position, determines a moving speed based on the current position, the reserved position, and the reserved time, and moves based on the moving speed so that the robot arrives at the reserved position at the reserved time, avoiding user waiting and enhancing user experience.

[0068] S30: The robot determines a target user based on the first environment image and the identity identification information.

[0069] In an embodiment of the present invention, the robot processes and analyzes the first environment image and combines the identity information of the target user in the service reservation request to lock the user who requires the robot to provide question-and-answer service.

[0070] As a possible implementation manner of the present invention, the identity identification information includes target facial features. Figure 2The specific implementation process of step S30 of the intelligent service method provided by an embodiment of the present invention is shown, in which the robot determines the target user based on the first environment image and the identity identification information, as detailed below:

[0071] S301: Perform facial feature detection based on the first environment image.

[0072] In the embodiment of the present application, facial features include, but are not limited to, the nose, left eye, right eye, left eyebrow, right eyebrow, left ear, right ear, and mouth. Facial feature detection is performed on the first environment image using a facial feature detection algorithm to determine the specific location of the face in the first environment image. The facial feature detection algorithm can refer to existing technologies and is not described in detail here.

[0073] S302: If facial features are detected in the first environment image, the detected facial features are compared with the target facial features.

[0074] In an embodiment of the present invention, comparing and matching the detected facial features with the target facial features refers to performing a similarity comparison. If the similarity between the detected facial features and the target facial features is greater than or equal to a preset similarity threshold, the comparison result between the detected facial features and the target facial features is determined to be a match; if the similarity between the detected facial features and the target facial features is less than the preset similarity threshold, the comparison result between the detected facial features and the target facial features is determined to be a mismatch.

[0075] S303: If the comparison result is a match, the user corresponding to the facial feature is determined as the target user.

[0076] In an embodiment of the present invention, facial features are detected on the first environment image and compared with target facial features to determine the target user, thereby quickly and automatically locking the target user and improving the efficiency of the question-answering service.

[0077] As a possible embodiment of the present invention, Figure 3 Another specific implementation process of step S30 of the intelligent service method provided by an embodiment of the present invention is shown, in which the robot determines the target user based on the first environment image and the identity identification information, as detailed below:

[0078] S311: If no facial features are detected in the first environmental image, or the facial features detected in the first environmental image are compared with the target facial features and the result is no match, the robot obtains a second environmental image, where the second environmental image refers to an environmental image centered on the reservation location and within a second preset range, for example, an environmental image centered on the reservation location and within a radius of 5 meters.

[0079] The second preset range is larger than the first preset range.

[0080] S312: The robot performs facial feature detection based on the second environment image.

[0081] S313: If facial features are detected in the second environment image, the robot compares the detected facial features with the target facial features.

[0082] S314: If the comparison result is a match, the robot determines the user corresponding to the facial feature as the target user.

[0083] Steps S312 to S314 refer to steps S301 to S303 and are not described in detail here.

[0084] In an embodiment of the present invention, when the robot cannot determine the target user at the reserved location, the robot enlarges the determined range, reacquires a second environmental image centered on the reserved location and within a second preset range, and determines the target user based on the second environmental image, thereby avoiding the situation where the target user cannot be found due to the target user possibly walking away from the reserved location.

[0085] As a possible implementation manner of the present invention, the service reservation request further includes the device identification of the user terminal. Figure 4 Another specific implementation process of step S30 of the intelligent service method provided by an embodiment of the present invention is shown, in which the robot determines the target user based on the first environment image and the identity identification information, as detailed below:

[0086] S321: If no facial features are detected in the first environment image, or if the facial features detected in the first environment image are compared with the target facial features and the result is no match, the robot sends a location request to the user terminal based on the device identifier.

[0087] S322: The robot receives the real-time position fed back by the user terminal based on the position request, and moves to the real-time position.

[0088] In the embodiment of the present invention, the robot establishes a communication connection with the user terminal based on the device identification of the user terminal, receives the real-time position fed back by the user terminal based on the position request, and navigates to the real-time position.

[0089] S323: The robot authenticates the user at the real-time location based on the identity information.

[0090] Identity verification includes verification of identity information. The user at the real-time location refers to users within a specified distance range centered on the real-time location. In an embodiment of the present invention, the robot obtains the identity information of the user at the real-time location and compares and matches the identity information of the user at the real-time location with the identity information of the target user. If a match is successful, identity verification is successful, and the user at the real-time location is the target user. If a match is unsuccessful, identity verification fails, and the user at the real-time location is not the target user.

[0091] S324: If the identity authentication is passed, the robot determines the user at the real-time location as the target user.

[0092] S40: The robot obtains the question-and-answer instruction of the target user and provides a question-and-answer service corresponding to the question-and-answer instruction.

[0093] In an embodiment of the present invention, the robot is applied to a hotel scenario, and the question-and-answer services include information inquiry, check-in, check-out, guidance, manual service, etc.

[0094] In some embodiments, the question-and-answer instruction may be a voice instruction. The target user sends a voice instruction containing keywords to the robot, and the robot provides a question-and-answer service corresponding to the question-and-answer instruction based on the keywords in the voice instruction.

[0095] In some embodiments, the robot provides an interactive operation interface, and the question-and-answer instruction can be an input instruction of the interactive operation interface. The target user inputs an input instruction containing keywords to the robot through the interactive operation interface, and the robot provides a question-and-answer service corresponding to the question-and-answer instruction based on the keywords in the input instruction.

[0096] Keywords include primary and secondary keywords. For example, for a hotel service robot, primary keywords include information query, check-in, check-out, navigation, and manual service. Secondary keywords for information query include hotel information query, check-in status query, weather query, and transportation query. The robot controls or responds to the user based on the corresponding keywords.

[0097] In a possible implementation, if the robot does not detect the user's question-and-answer instruction within a first preset time, it moves back to the initial docking position. Optionally, the first preset time is 2 minutes.

[0098] In one possible embodiment, if the robot does not detect the user's question and answer instructions within the first preset time, it waits at the current position for the dispatch center to issue a service task instruction; if the robot does not detect the service task instruction issued by the dispatch center within the second preset time, it moves back to the initial docking position. Optionally, the second preset time is 1 minute.

[0099] As a possible embodiment of the present invention, Figure 5 The specific implementation process of step S40 of the intelligent service method provided by an embodiment of the present invention is shown, in which the robot obtains the question-answering instruction of the target user and provides the question-answering service corresponding to the question-answering instruction, as detailed below:

[0100] S401: The robot obtains a facial image of the target user and displays the facial image on a display screen of the robot.

[0101] In the embodiment of the present invention, the display screen is used to display the face image of the target user and present the question and answer results.

[0102] As a possible implementation of the present application, the robot is provided with multiple display screens, and the robot obtains the facial image of the target user and displays the facial image on the display screen of the robot, including: the robot obtains the posture of the target user; the robot starts the display screen corresponding to the posture of the target user based on the posture of the target user, and displays the facial image on the display screen.

[0103] In one possible embodiment, the robot includes a first display screen and a second display screen, with the first display screen disposed on the top of the robot and the second display screen disposed on the side of the robot, with the first display screen and the second display screen facing two different directions. Alternatively, multiple display screens may be disposed at different heights on the robot body, for example, with the first display screen disposed at a first height and the second display screen disposed at a second height, with the first height being greater than the second height.

[0104] In one application scenario, the target user's posture includes standing and sitting. If the target user's posture is standing, the robot's first display screen is activated; if the target user's posture is sitting, the robot's second display screen is activated to adapt to the user's posture, thereby improving the effectiveness of the question-and-answer service and enhancing the user experience.

[0105] In one possible implementation, the robot obtains the target user's height information, activates a display screen corresponding to the target user's height information based on the height information, and displays the facial image on the display screen. Specifically, the robot may estimate the target user's height information through infrared detection.

[0106] In one application scenario, if the target user's height is higher than a preset height threshold, the robot's first display screen is activated; if the target user's height is less than or equal to the preset height threshold, the robot's second display screen is activated to adapt to users of different heights, thereby improving the effectiveness of the question-and-answer service and enhancing the user experience.

[0107] S402: If the duration of display of the facial image on the display screen reaches a preset duration, the robot obtains a question-and-answer instruction of the target user and provides a question-and-answer service corresponding to the question-and-answer instruction.

[0108] In this embodiment of the present invention, while the robot is providing Q&A services to a target user, the target user must keep their facial image aligned with the robot's camera so that it appears on the robot's display. If the facial image does not remain on the display for a specified period of time, the robot terminates the Q&A service, avoiding ineffective service and conserving power.

[0109] As can be seen from the above, in an embodiment of the present invention, a service reservation request sent by a user terminal is obtained by a robot, and the service reservation request includes the identity identification information and reservation location of the target user. The robot then moves to the reservation location and obtains a first environmental image. The target user is then determined based on the first environmental image and the identity identification information. Finally, the robot obtains the question and answer instructions of the target user and provides a question and answer service corresponding to the question and answer instructions. The user only needs to make an appointment for the question and answer service, and the robot will find the user to realize intelligent question and answer service. The question and answer service is convenient, thereby improving the effectiveness of the question and answer service and enhancing the user experience.

[0110] It should be understood that the order of execution of each step in the embodiment does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present invention.

[0111] Corresponding to the robot-based question-answering service method described in the above embodiment, Figure 6 A structural block diagram of a robot-based question-answering service device provided by an embodiment of the present invention is shown. For ease of explanation, only the parts related to the embodiment of the present invention are shown.

[0112] Reference Figure 6 The robot-based question-answering service device includes: a reservation request acquisition unit 61, an environment image acquisition unit 62, a target user determination unit 63, and a question-answering service unit 64, wherein:

[0113] An appointment request obtaining unit 61 is configured for the robot to obtain a service appointment request sent by a user terminal, wherein the service appointment request includes the identity information of a target user and an appointment location, wherein the target user is a user who requires the robot to provide a question-and-answer service;

[0114] An environmental image acquisition unit 62 is configured to move the robot to the predetermined position and acquire a first environmental image, wherein the first environmental image refers to an environmental image within a first preset range centered on the predetermined position;

[0115] a target user determining unit 63, configured for the robot to determine a target user based on the first environment image and the identity identification information;

[0116] The question-answering service unit 64 is configured for the robot to obtain the question-answering instruction of the target user and provide a question-answering service corresponding to the question-answering instruction.

[0117] In a possible implementation, the reservation request obtaining unit 61 includes:

[0118] A first reservation request acquisition module is used for the robot to communicate with the user terminal and acquire a service reservation request sent by the user terminal;

[0119] The second reservation request acquisition module is used for the robot to communicate with the dispatch center and obtain the service task instruction issued by the dispatch center, wherein the dispatch center is used to receive the service reservation request sent by the user terminal, and generate a service task instruction based on the service reservation request, and send it to the robot, wherein the service task instruction carries the service reservation request sent by the user terminal.

[0120] In a possible implementation, the identity information includes target facial features; the target user determination unit 63 includes:

[0121] A first facial feature detection module, configured to perform facial feature detection based on the first environment image;

[0122] a first face matching module, configured to compare the detected face features with the target face features if face features are detected in the first environment image;

[0123] The first target user determination module is configured to determine the user corresponding to the facial feature as the target user if the comparison result is a match.

[0124] In a possible implementation, the target user determination unit 63 includes:

[0125] an environmental image acquisition module, configured to, if no facial features are detected in the first environmental image, or if the facial features detected in the first environmental image do not match the target facial features, cause the robot to acquire a second environmental image, the second environmental image being an environmental image centered on the reservation location and within a second preset range;

[0126] A second facial feature detection module, configured for the robot to perform facial feature detection based on the second environment image;

[0127] a second face matching module, configured to, if a face feature is detected in the second environment image, cause the robot to compare the detected face feature with the target face feature;

[0128] The second target user determination module is configured to determine, by the robot, the user corresponding to the facial feature as the target user if the comparison result matches.

[0129] In a possible implementation, the service reservation request further includes a device identifier of the user terminal, and the target user determination unit 63 includes:

[0130] a location request module, configured to, if no facial features are detected in the first environment image, or if the facial features detected in the first environment image do not match the target facial features, send a location request to the user terminal based on the device identifier;

[0131] a position movement module, configured for the robot to receive the real-time position fed back by the user terminal based on the position request and move to the real-time position;

[0132] an identity authentication module, configured for the robot to authenticate the user at the real-time location based on the identity identification information;

[0133] The third target user determination module is configured to enable the robot to determine the user at the real-time location as a target user if the identity authentication is passed.

[0134] In a possible implementation, the question-answering service unit 64 includes:

[0135] A facial image acquisition and display module, configured for the robot to acquire a facial image of the target user and display the facial image on a display screen of the robot;

[0136] The question-and-answer service module is used for, if the duration for which the facial image is displayed on the display screen reaches a preset duration, the robot then obtains the question-and-answer instruction of the target user and provides a question-and-answer service corresponding to the question-and-answer instruction.

[0137] In one possible implementation, the facial image acquisition and display module includes:

[0138] A posture acquisition submodule, used for the robot to acquire the posture of the target user;

[0139] The facial image acquisition and display submodule is used for the robot to start a display screen corresponding to the posture of the target user based on the posture of the target user, and display the facial image on the display screen.

[0140] As can be seen from the above, in an embodiment of the present invention, a service reservation request sent by a user terminal is obtained by a robot, and the service reservation request includes the identity identification information and reservation location of the target user. The robot then moves to the reservation location and obtains a first environmental image. The target user is then determined based on the first environmental image and the identity identification information. Finally, the robot obtains the question and answer instructions of the target user and provides a question and answer service corresponding to the question and answer instructions. The user only needs to make an appointment for the question and answer service, and the robot will find the user to realize intelligent question and answer service. The question and answer service is convenient, thereby improving the effectiveness of the question and answer service and enhancing the user experience.

[0141] It should be noted that the information interaction, execution process, etc. between devices / units are based on the same concept as the method embodiment of the present invention. Their specific functions and technical effects can be found in the method embodiment part and will not be repeated here.

[0142] An embodiment of the present invention further provides an intelligent device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, Figures 1 to 5 The steps of any robot-based question-answering service method are represented.

[0143] The embodiment of the present invention further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the computer program implements the following Figures 1 to 5 The steps of any robot-based question-answering service method are represented.

[0144] The embodiment of the present invention also provides a computer program product, which, when running on a server, enables the server to execute the following Figures 1 to 5 The steps of any robot-based question-answering service method are represented.

[0145] Figure 7 FIG is a schematic diagram of a smart device provided by an embodiment of the present invention. Figure 7As shown, the smart device 7 of this embodiment includes: a processor 70, a memory 71, and a computer program 72 stored in the memory 71 and executable on the processor 70. When the processor 70 executes the computer program 72, the steps in each embodiment of the robot-based question-answering service method are implemented, such as Figure 1 Alternatively, when the processor 70 executes the computer program 72, the functions of each module / unit in each device embodiment are realized, for example Figure 6 The functions of the units 61 to 64 are shown.

[0146] Exemplarily, the computer program 72 may be divided into one or more modules / units, which are stored in the memory 71 and executed by the processor 70 to implement the present invention. The one or more modules / units may be a series of computer-readable instruction segments capable of implementing specific functions, and the instruction segments are used to describe the execution process of the computer program 72 in the smart device 7.

[0147] The smart device 7 may be a smart robot. The smart device 7 may include, but is not limited to, a processor 70 and a memory 71. Those skilled in the art will understand that Figure 7 It is only an example of the smart device 7 and does not constitute a limitation of the smart device 7. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, the smart device 7 may also include input and output devices, network access devices, buses, etc.

[0148] The processor 70 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor.

[0149] The memory 71 may be an internal storage unit of the smart device 7, such as a hard disk or memory of the smart device 7. The memory 71 may also be an external storage device of the smart device 7, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the smart device 7. Furthermore, the memory 71 may include both an internal storage unit of the smart device 7 and an external storage device. The memory 71 is used to store the computer program and other programs and data required by the smart device. The memory 71 may also be used to temporarily store data that has been output or is about to be output.

[0150] It should be noted that the information interaction, execution process, etc. between the above-mentioned devices / units are based on the same concept as the embodiment of the method of the present invention. Their specific functions and technical effects can be found in the method embodiment part and will not be repeated here.

[0151] Those skilled in the art can clearly understand that, for the convenience and brevity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In actual applications, the above-mentioned functions can be distributed and completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of the present invention. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0152] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present invention implements all or part of the process in the above-mentioned embodiment method by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium. When the computer program is executed by a processor, it can implement the steps of each of the above-mentioned method embodiments. The computer program includes computer program code, which can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium can at least include: any entity or device that can carry computer program code to a device / terminal device, a recording medium, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electric carrier signal, a telecommunication signal and a software distribution medium. For example, a USB flash drive, a mobile hard drive, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.

[0153] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant description of other embodiments.

[0154] The embodiments described above are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present invention, and should all be included in the scope of protection of the present invention.

Claims

1. A robot-based question-answering service method, characterized in that: include: The robot obtains a service reservation request sent by a user terminal, wherein the service reservation request includes identity information of a target user and a reservation location, wherein the target user is a user who requires the robot to provide a question-and-answer service, and the identity information includes facial features of the target user; The robot moves to the reserved position and obtains a first environmental image, where the first environmental image refers to an environmental image within a first preset range centered on the reserved position; The robot determines a target user based on the first environment image and the identity information, including: performing facial feature detection based on the first environment image; if facial features are detected in the first environment image, comparing the detected facial features with the target facial features; if the comparison result is a match, determining the user corresponding to the facial features as the target user; The robot obtains the question-and-answer instruction of the target user and provides a question-and-answer service corresponding to the question-and-answer instruction.

2. The question-answering service method according to claim 1, wherein: The robot determines a target user according to the first environment image and the identity information, further comprising: If no facial features are detected in the first environmental image, or if the facial features detected in the first environmental image do not match the target facial features, the robot acquires a second environmental image, where the second environmental image is an environmental image centered at the reserved location and within a second preset range. The robot performs facial feature detection based on the second environment image; If a facial feature is detected in the second environment image, the robot compares the detected facial feature with the target facial feature; If the comparison result is a match, the robot determines the user corresponding to the facial feature as the target user.

3. The question-answering service method according to claim 1, wherein: The service reservation request also includes the device identification of the user terminal, and the robot determines the target user based on the first environment image and the identity identification information, further comprising: If no facial features are detected in the first environment image, or if the facial features detected in the first environment image do not match the target facial features, the robot sends a location request to the user terminal based on the device identifier; The robot receives the real-time position fed back by the user terminal based on the position request, and moves to the real-time position; The robot authenticates the user at the real-time location based on the identity information; If the identity authentication is passed, the robot determines the user at the real-time location as a target user.

4. The question-answering service method according to claim 1, wherein: The robot obtains the question-and-answer instruction of the target user and provides a question-and-answer service corresponding to the question-and-answer instruction, including: The robot obtains a facial image of the target user and displays the facial image on a display screen of the robot; If the duration of time the facial image is displayed on the display screen reaches a preset duration, the robot obtains the question-and-answer instruction of the target user and provides a question-and-answer service corresponding to the question-and-answer instruction.

5. The question-answering service method according to claim 4, wherein: The robot is provided with multiple display screens; The robot acquires a facial image of the target user and displays the facial image on a display screen of the robot, including: The robot obtains the posture of the target user; Based on the posture of the target user, the robot activates a display screen corresponding to the posture of the target user and displays the face image on the display screen.

6. The question-answering service method according to any one of claims 1 to 5, characterized in that: The robot obtains a service reservation request sent by a user terminal, including: The robot is in communication with the user terminal to obtain a service reservation request sent by the user terminal; Alternatively, the robot is connected to a dispatch center for communication to obtain a service task instruction issued by the dispatch center, wherein the dispatch center is used to receive a service appointment request sent by the user terminal, and based on the service appointment request, generate a service task instruction and send it to the robot, wherein the service task instruction carries the service appointment request sent by the user terminal.

7. A robot-based question-answering service device, characterized in that: include: An appointment request acquisition unit is configured to enable the robot to acquire a service appointment request sent by a user terminal, wherein the service appointment request includes the identity information of a target user and an appointment location, wherein the target user is a user who requires the robot to provide a question-and-answer service, and the identity information includes facial features of the target user; An environmental image acquisition unit, configured to move the robot to the predetermined position and acquire a first environmental image, wherein the first environmental image refers to an environmental image within a first preset range centered on the predetermined position; a target user determining unit, configured for the robot to determine a target user based on the first environment image and the identity identification information; The target user determination unit includes: a first facial feature detection module, configured to detect facial features based on the first environment image; a first face matching module, configured to compare the detected facial features with the target facial features if facial features are detected in the first environment image; and a first target user determination module, configured to determine the user corresponding to the facial features as the target user if a match is found in the comparison result; The question-answering service unit is used for the robot to obtain the question-answering instructions of the target user and provide question-answering services corresponding to the question-answering instructions.

8. An intelligent device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, the robot-based question-answering service method according to any one of claims 1 to 6 is implemented.

9. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the robot-based question-answering service method according to any one of claims 1 to 6 is implemented.

Images