Robot-based service methods, devices, electronic equipment, and storage media

Abstract

This invention discloses a robot-based service method, apparatus, electronic device, and storage medium. The method includes: upon receiving a welcoming instruction corresponding to a welcoming service, identifying a target welcoming object in an image to be processed, and obtaining a target welcoming mode determined by the target welcoming object; if the target welcoming mode is consistent with a preset welcoming mode, determining at least one candidate welcoming user associated with the target welcoming robot; determining the target welcoming user based on the status attribute information of the at least one candidate welcoming user; and sending the association information of the target welcoming object to the target welcoming user based on the target welcoming robot. The technical solution of this invention, by deploying a human-machine collaboration strategy on the robot, reduces the physical and mental demands on staff while providing repetitive and personalized services.

Description

Technical Field

[0001] The embodiments of the present invention relate to the field of robotics technology, and in particular to a robot-based service method, apparatus, electronic device, and storage medium. Background Technology

[0002] In front desk service scenarios, in addition to a large amount of repetitive work, there are also many temporary and personalized communication services. Therefore, the front desk usually needs to assign specific staff to provide corresponding consultation services to users.

[0003] However, in the solutions provided by existing technologies, the front desk places high demands on staff in the process of providing services to users. For example, when providing guidance services to patients at the hospital front desk, relevant medical staff may need to provide personalized guidance in addition to providing standardized answers to patients. The large amount of work will undoubtedly consume the physical strength and energy of the staff. At the same time, users need to queue and wait when receiving front desk services, resulting in a poor user experience. Summary of the Invention

[0004] This invention provides a robot-based service method, device, electronic device, and storage medium. By deploying a human-machine collaboration strategy on the robot, it reduces the physical and mental demands on staff while providing repetitive and personalized services.

[0005] In a first aspect, embodiments of the present invention provide a robot-based service method, the method comprising:

[0006] Upon receiving a welcoming instruction corresponding to the welcoming service, the system identifies the target welcoming object in the image to be processed and obtains the target welcoming pattern determined by the target welcoming object.

[0007] If the target welcoming mode is consistent with the preset welcoming mode, then at least one potential welcoming user associated with the target welcoming robot is identified.

[0008] Based on the status attribute information of the at least one candidate welcoming user, the target welcoming user is determined;

[0009] The target welcoming robot sends the associated information of the target welcoming object to the target welcoming user.

[0010] Secondly, embodiments of the present invention also provide a robot-based service device, the device comprising:

[0011] The target welcoming object recognition module is used to identify the target welcoming object in the image to be processed when a welcoming instruction corresponding to the welcoming service is received, and to obtain the target welcoming pattern determined by the target welcoming object.

[0012] The module for determining the candidate welcoming user is used to determine at least one candidate welcoming user associated with the target welcoming robot if the target welcoming mode is consistent with the preset welcoming mode.

[0013] The target welcoming user determination module is used to determine the target welcoming user based on the status attribute information of the at least one welcoming user to be selected;

[0014] The information sending module is used to send the associated information of the target welcoming object to the target welcoming user based on the target welcoming robot.

[0015] Thirdly, embodiments of the present invention also provide an electronic device, the electronic device comprising:

[0016] One or more processors;

[0017] Storage device for storing one or more programs.

[0018] When the one or more programs are executed by the one or more processors, the one or more processors implement the robot-based service method as described in any of the embodiments of the present invention.

[0019] Fourthly, embodiments of the present invention also provide a storage medium containing computer-executable instructions, which, when executed by a computer processor, are used to perform a robot-based service method as described in any of the embodiments of the present invention.

[0020] The technical solution of this invention, upon receiving a welcoming instruction corresponding to the welcoming service, identifies the target welcoming object in the image to be processed and obtains the target welcoming mode determined by the target welcoming object; if the target welcoming mode is consistent with the preset welcoming mode, at least one candidate welcoming user associated with the target welcoming robot is determined; based on the status attribute information of at least one candidate welcoming user, the target welcoming user is determined; and based on the target welcoming robot, the association information of the target welcoming object is sent to the target welcoming user. By deploying a human-machine collaboration strategy on the robot, while providing repetitive and personalized services, the physical and mental demands on staff are reduced, and long waiting times for users are avoided, thus improving the user experience. Attached Figure Description

[0021] To more clearly illustrate the technical solutions of exemplary embodiments of the present invention, the accompanying drawings used in describing the embodiments are briefly introduced below. Obviously, the accompanying drawings described are only a portion of the drawings of the embodiments to be described in this invention, and not all of the drawings. For those skilled in the art, other drawings can be obtained from these drawings without any creative effort.

[0022] Figure 1 This is a flowchart illustrating a robot-based service method provided in Embodiment 1 of the present invention.

[0023] Figure 2 This is a flowchart illustrating a robot-based service method provided in Embodiment 2 of the present invention;

[0024] Figure 3 This is a flowchart of a robot-based service method provided in Embodiment 3 of the present invention;

[0025] Figure 4 This is a structural block diagram of a robot-based service device provided in Embodiment 4 of the present invention;

[0026] Figure 5 This is a schematic diagram of the structure of an electronic device provided in Embodiment 5 of the present invention. Detailed Implementation

[0027] The present invention will now be described in further detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and not intended to limit it. Furthermore, it should be noted that, for ease of description, the accompanying drawings show only the parts relevant to the present invention, and not all of the structures.

[0028] Example 1

[0029] Figure 1 This is a flowchart illustrating a robot-based service method provided in Embodiment 1 of the present invention. This embodiment is applicable to situations where robots are used to provide welcoming services to users. The method can be executed by a robot-based service device, which can be implemented in the form of software and / or hardware. The hardware can be an electronic device, such as a mobile terminal, a PC, or a server.

[0030] like Figure 1 As shown, the method specifically includes the following steps:

[0031] S110. Upon receiving a welcoming instruction corresponding to the welcoming service, identify the target welcoming object in the image to be processed and obtain the target welcoming mode determined by the target welcoming object.

[0032] The welcoming instruction can be a command issued by staff or a server to a welcoming robot in a specific scenario. It can be understood that the robot can perform specific actions based on this instruction to provide welcoming services to users. For example, when the welcoming robot at the front desk starts up, it can receive a welcoming instruction sent by a staff member, thus entering welcoming mode. In practical applications, the server can also issue welcoming instructions to the robot based on relevant user actions. For example, when a user is detected entering the scene to which the robot belongs, the server associated with the robot can issue a corresponding welcoming instruction. Those skilled in the art should understand that the specific method of triggering the robot to perform welcoming services can be selected according to the actual situation, and this disclosure does not impose specific limitations here.

[0033] In this embodiment, once the welcoming robot is activated, it can acquire images to be processed. Specifically, the welcoming robot can use a camera device to acquire a view of a specific area, where a single image or multiple frames from a video stream constitute the image to be processed. Furthermore, the robot can detect faces in the acquired image to be processed, for example, by detecting faces in the image based on the features of organs such as eyes, eyebrows, mouth, and nose, as well as their geometrical relationships, thereby identifying the target person to be welcomed in the image. It can be understood that the target person to be welcomed is the user entering the specific area, such as a patient approaching the reception area of ​​a hospital.

[0034] In this embodiment, after identifying the target welcoming object in the image to be processed, the target welcoming mode can be further obtained. For example, by detecting the user's touch operation, the mode selected by the user in the relevant controls can be used as the target welcoming mode, or the welcoming mode preset by the robot can be used as the target welcoming mode. In practical applications, there can be various welcoming modes, such as an autonomous service mode that relies entirely on the robot to provide standardized services, and a human-machine collaboration mode in which the robot and staff of the management backend system jointly provide services.

[0035] S120. If the target welcoming mode is consistent with the preset welcoming mode, then determine at least one candidate welcoming user associated with the target welcoming robot.

[0036] In this embodiment, the preset welcoming mode can be a human-machine collaboration mode. When the target welcoming mode is determined to be consistent with the preset welcoming mode, in order to provide users with temporary and personalized services, it is also necessary to select welcoming users in the management backend system. The welcoming users are staff members who provide services to users through remote communication, using a robot as an intermediary. One robot can be associated with multiple welcoming users, and vice versa. It can be understood that in the process of determining welcoming users, the multiple welcoming users associated with the target welcoming robot are the welcoming users to be selected.

[0037] S130. Determine the target welcoming user based on the status attribute information of at least one potential welcoming user.

[0038] Once at least one potential greeter associated with the target greeter robot is identified, in order for the target greeter to receive the corresponding human service, it is first necessary to determine the status attribute information of each potential greeter. This status attribute information includes at least information reflecting the greeter's current status; for example, for each greeter, the status attribute information could be busy, idle, or away.

[0039] Furthermore, after determining the status attribute information of each potential greeter, an idle user can be selected as the target greeter. It can be understood that when all potential greeters are not idle, the target greeter robot can offer the target greeter the option to continue waiting, or it can automatically provide the target greeter with automated standard services until an idle potential greeter becomes available. It should be noted that during the process of the target greeter robot determining the target greeter, each potential greeter can also actively designate itself as the target greeter through the management backend system.

[0040] S140. Based on the target welcoming robot, send the associated information of the target welcoming object to the target welcoming user.

[0041] In this embodiment, after identifying the target greeter who will provide remote human service, the greeting robot can collect the associated information of the target greeter and then send the associated information to the client corresponding to the target greeter through the management backend system. The associated information can be multi-dimensional, reflecting the identity, status, problems, or needs of the target greeter.

[0042] For example, in a hospital front desk guidance service scenario, once the robot identifies the target greeter to provide services to the patient in the management backend system, the robot can use various sensors installed on its body to collect the patient's information, such as height, weight, and body temperature. Furthermore, this information is sent to the client of the staff member who is the target greeter, so that the staff member can guide the patient and provide relevant services.

[0043] The technical solution of this embodiment, upon receiving a welcoming instruction corresponding to the welcoming service, identifies the target welcoming object in the image to be processed and obtains the target welcoming mode determined by the target welcoming object; if the target welcoming mode is consistent with the preset welcoming mode, at least one candidate welcoming user associated with the target welcoming robot is determined; based on the status attribute information of at least one candidate welcoming user, the target welcoming user is determined; based on the target welcoming robot, the association information of the target welcoming object is sent to the target welcoming user. By deploying a human-machine collaboration strategy on the robot, while providing repetitive and personalized services, the physical and mental requirements of staff are reduced, and long waiting times for users are avoided, thus improving the user experience.

[0044] Example 2

[0045] Figure 2 This is a flowchart illustrating a robot-based service method provided in Embodiment 2 of the present invention. Building upon the aforementioned embodiments, when the target greeter selects a human-machine collaboration mode, the target greeter is determined from the pool of potential greeters based on priority information. When the target greeter provides human service, the robot feeds back the target greeter's voice and text information to the target greeter's client. The robot also plays the voice information fed back by the target greeter through a speaker and displays the text information on the robot's screen. This robot fulfills the complex scenario requirements of a management backend system with multiple personnel on duty. Specific implementation details can be found in the technical solution of this embodiment. Technical terms that are the same as or corresponding to those in the above embodiments will not be repeated here.

[0046] like Figure 2 As shown, the method specifically includes the following steps:

[0047] S210. Upon receiving a welcoming instruction corresponding to the welcoming service, identify the target welcoming object in the image to be processed and obtain the target welcoming mode determined by the target welcoming object.

[0048] In the above process, optionally, a welcoming instruction is generated based on the trigger operation of the target welcoming object on the welcoming robot; an image to be processed, including the target welcoming object, is acquired based on the image acquisition device set on the target welcoming robot; the target welcoming object on the image to be processed is identified through the image recognition module; the trigger operation of the target welcoming object on the welcoming mode selection control is obtained, and the target welcoming mode is determined based on the trigger operation.

[0049] Specifically, the target welcoming robot is equipped with a corresponding display device. This display interface shows pre-developed controls corresponding to various functions. When a touch operation by the target welcoming object on these controls is detected, a welcoming command is generated in the target welcoming robot's processor. Of course, in practical applications, a welcoming command can also be automatically generated based on the detection signals from relevant sensors when a user enters a specific scene, or automatically based on facial feature information when a face image is detected by a camera device.

[0050] Furthermore, during the process of acquiring images to be processed using the image acquisition device on the target welcoming robot, either an image or a video clip can be acquired; this embodiment of the disclosure is not limited in this regard. Once the target welcoming object in the image is identified, a welcoming mode selection control can be displayed on the display device, and touch operations on the target welcoming object can be acquired to determine the corresponding target welcoming mode. For example, based on the selection result of the target welcoming object, it can be determined whether the robot is in autonomous welcoming mode or human-machine collaborative welcoming mode.

[0051] S220. If the target welcoming mode is consistent with the human-machine collaborative welcoming mode, then determine at least one candidate welcoming user who is bound to the target welcoming robot.

[0052] In this embodiment, the preset welcoming mode can be a human-machine collaborative welcoming mode. Specifically, when the target welcoming mode matches the human-machine collaborative welcoming mode, the welcoming user list of the target welcoming robot can be retrieved. It can be understood that the users in this list are the waiting welcoming users bound to the robot, and these users can at least communicate with the robot via data based on the client.

[0053] S230. Determine the target welcoming user based on the status attribute information of at least one potential welcoming user.

[0054] Optionally, the target welcoming robot sends collaboration information to the client corresponding to the highest priority candidate welcoming user; if the client agrees to the collaboration, the candidate welcoming user is selected as the target welcoming user.

[0055] Specifically, when multiple potential greeters are identified in the management backend system, their priority information can also be determined. This priority information reflects at least the order in which each user provides services to the target greeter. In other words, when all potential greeters are idle, the robot will identify the highest priority greeter and send collaboration information to its client.

[0056] In practical applications, when multiple robots simultaneously identify target greeters for multiple potential greeters, the robots can also generate a call event to the management backend and enter a queuing sequence to wait for matching with potential greeters. This can be understood as the robot waiting for a relatively high-priority, idle user to appear based on the priority information of the potential greeters, and then sending collaboration information to that user. In this embodiment, after identifying the target greeter, in order to provide services to the target greeter through human-machine collaboration, it is also necessary to send collaboration information to the client corresponding to the target greeter. If the user's consent to collaboration is received, it indicates that the user can currently provide human service to the target greeter, and this user is the finally identified target greeter.

[0057] It should be noted that if the client does not agree to the collaboration feedback, it means that the user is not currently qualified to provide services to the target greeter. In this case, the robot can repeatedly send collaboration information to the corresponding candidate greeters in descending order of priority. This can be understood as sending collaboration information to each candidate greeter in turn until the target greeter is determined.

[0058] In this embodiment, if the target welcoming mode differs from the preset welcoming mode, i.e., when the target person selects the autonomous welcoming mode, the robot can provide standardized services to the user based on pre-stored relevant knowledge graphs. Specifically, the robot can guide the target person step-by-step according to the built-in guidance specifications; these specifications include basic triage information. For example, in a hospital front desk triage scenario, when a patient selects the autonomous welcoming mode and inquires about relevant departments, the robot can display relevant department information, such as medical staff and registration services, on the display device according to the built-in guidance specifications. Furthermore, it can show the patient the route to the department or directly guide the patient to the department.

[0059] S240: Based on the target welcoming robot, the voice and text information of the target welcoming object are fed back to the client corresponding to the target welcoming user; based on the target welcoming robot, the voice information fed back by the target welcoming user is played through the speaker, and the text information is displayed on the display screen of the welcoming robot.

[0060] In this embodiment, when a target greeter uses a robot as an intermediary to provide human service based on a human-machine collaboration model, the robot can not only use pre-installed cameras and various sensors to send multi-dimensional information about the target greeter to the management backend system, but also feed back the voice and text information input by the target greeter through the robot to the target greeter's client. For example, in a hospital front desk guidance scenario, the robot can transmit the patient's height, weight, facial features, and body temperature to the management backend system, while simultaneously sending the patient's basic personal information and physical condition input through the robot's touchscreen to the corresponding staff's client.

[0061] Correspondingly, during the process of the target greeter providing feedback to the target greeter, voice information can be transmitted to the target greeter through a microphone pre-installed on the robot. Simultaneously, text information is displayed on the robot's screen, thus providing personalized human service to the target greeter. It should be noted that the solution in this embodiment can be applied to greeting services, specifically including guidance services or wayfinding services. Based on this, during the process of the target greeter providing wayfinding services, the robot can also be controlled in real-time to perform various standard behaviors. For example, in the aforementioned hospital front desk guidance scenario, the staff member acting as the target greeter can issue real-time commands to the robot to control its movement, thereby guiding the user to the relevant department.

[0062] In this embodiment, when the target greeter selects the human-machine collaboration mode, the target greeter is determined from the pool of potential greeters based on priority information. When the target greeter provides human service, the robot feeds back the target greeter's voice and text information to the target greeter's client. The robot also plays the voice information fed back by the target greeter through a speaker and displays the text information on the robot's screen. This robot enables a complex scenario where a management backend system can be implemented with multiple people on duty simultaneously.

[0063] Example 3

[0064] As an optional embodiment of the above embodiments, Figure 3 This is a flowchart of a robot-based service method provided in Embodiment 3 of the present invention. To clearly illustrate the technical solution of this embodiment, an example can be given of an application scenario where multiple robots are deployed in a specific space, a management backend system (such as a customer service center), and multiple staff members are on duty. However, this is not limited to the above scenario and can be applied to various scenarios requiring the provision of welcoming services to users.

[0065] See Figure 3After the target robot is adjusted to its initial state, it can monitor the view of a specific area in real time. When facial recognition technology detects a face in the area, it can trigger preset welcoming services such as greetings to the user.

[0066] See also Figure 3 While providing preset greeting services to users, the target robot can also perform different operations depending on its current mode. Specifically, when the robot is in a paused service state, it can guide users to select other robots to provide services through voice or other means; when the robot is in an autonomous service state, it can interact with users through speakers and touch-screen displays based on pre-deployed standardized functions to provide corresponding services.

[0067] See also Figure 3 When the robot is in human-robot collaboration mode, it can call backend human service via wired or wireless means using its communication module. This involves generating a corresponding call event and queuing it for human matching based on the priority of backend staff. Specifically, matching can be done in descending order of priority, with the highest priority staff member serving as the primary contact. If the primary contact person cannot answer, meaning remote human service cannot be provided to the user, other staff members can be selected in sequence. It should be noted that if backend staff cannot answer for an extended period, the robot can automatically switch from human collaboration mode to autonomous service mode and autonomously guide the user to receive standardized services through touch controls.

[0068] See also Figure 3 When the robot is in human-robot collaboration mode and connected to the management backend system, staff can use the robot's cameras and microphones to capture real-time footage of the front desk, the robot's service audio, current service functions, and user voice information. Simultaneously, the robot can convert user voice information into text using a semantic understanding module and display it on the corresponding client, enabling a rapid understanding of the situation and better service to users. Correspondingly, staff can also use the robot's speakers to provide audio feedback to users, or display text information. Furthermore, the robot can generate sound effects based on its built-in audio, or control it to perform various standard behaviors, such as moving to provide guidance services to users.

[0069] The beneficial effects of the above technical solution are as follows: by deploying a human-machine collaboration strategy on the robot, while providing repetitive and personalized services, it reduces the physical and mental demands on staff, avoids long waiting times for users, and improves the user experience.

[0070] Example 4

[0071] Figure 4 This is a structural block diagram of a robot-based service device provided in Embodiment 4 of the present invention. It can execute the robot-based service method provided in any embodiment of the present invention, and possesses the corresponding functional modules and beneficial effects of the method execution. For example... Figure 5 As shown, the device specifically includes: a target welcoming object identification module 310, a candidate welcoming user determination module 320, a target welcoming user determination module 330, and an information sending module 340.

[0072] The target welcoming object recognition module 310 is used to identify the target welcoming object in the image to be processed when receiving a welcoming instruction corresponding to the welcoming service, and to obtain the target welcoming mode determined by the target welcoming object.

[0073] The candidate welcoming user determination module 320 is used to determine at least one candidate welcoming user associated with the target welcoming robot if the target welcoming mode is consistent with the preset welcoming mode.

[0074] The target welcoming user determination module 330 is used to determine the target welcoming user based on the status attribute information of the at least one candidate welcoming user.

[0075] The information sending module 340 is used to send the associated information of the target welcoming object to the target welcoming user based on the target welcoming robot.

[0076] Based on the above technical solutions, the target welcoming object recognition module 310 includes a welcoming instruction generation unit, a to-be-processed image acquisition unit, a target welcoming object recognition unit, and a target welcoming mode determination unit.

[0077] The welcoming instruction generation unit is used to generate the welcoming instruction based on the triggering operation of the target welcoming object on the welcoming robot.

[0078] The image acquisition unit is used to acquire an image of the target welcoming object based on the image acquisition device installed on the welcoming robot.

[0079] The target welcoming object recognition unit is used to identify the target welcoming object on the image to be processed through the image recognition module.

[0080] The target welcoming mode determination unit is used to obtain the trigger operation of the target welcoming object on the welcoming mode selection control, and determine the target welcoming mode based on the trigger operation.

[0081] Based on the above technical solutions, the preset welcoming mode is a human-machine collaborative welcoming mode.

[0082] Optionally, the candidate welcoming user determination module 320 is further configured to determine at least one candidate welcoming user bound to the target welcoming robot if the target welcoming mode is consistent with the human-machine collaborative welcoming mode.

[0083] Based on the above technical solutions, the status attribute information includes priority information, and the target welcoming user determination module 330 includes a collaborative information sending unit and an information processing unit.

[0084] The collaboration information sending unit is used to send collaboration information to the client corresponding to the highest priority candidate welcoming user based on the target welcoming robot.

[0085] The information processing unit is configured to, upon receiving feedback of agreement to cooperation from the client, designate the candidate welcoming user as the target welcoming user; and, upon receiving feedback of disagreement to cooperation from the client, repeatedly send cooperation information to the corresponding candidate welcoming users in descending order of priority, until the target welcoming user is determined.

[0086] Based on the above technical solutions, the robot-based service device also includes a guidance module.

[0087] The guidance module is used to guide the target guest to be greeted step by step according to the guidance specifications built into the target welcoming robot if the target welcoming mode is inconsistent with the preset welcoming mode; wherein, the guidance specifications include basic triage information.

[0088] Optionally, the information sending module 340 is further configured to feed back the voice and text information of the target greeter to the client corresponding to the target greeter based on the target greeter robot; and to play the voice information fed back by the target greeter user through a speaker based on the target greeter robot, and to display the text information on the display screen of the greeter robot.

[0089] Based on the above technical solutions, the method is applied to the welcoming service, which includes a medical guidance service or a wayfinding service.

[0090] The technical solution provided in this embodiment, upon receiving a welcoming instruction corresponding to the welcoming service, identifies the target welcoming object in the image to be processed and obtains the target welcoming mode determined by the target welcoming object; if the target welcoming mode is consistent with the preset welcoming mode, at least one candidate welcoming user associated with the target welcoming robot is determined; based on the status attribute information of at least one candidate welcoming user, the target welcoming user is determined; based on the target welcoming robot, the association information of the target welcoming object is sent to the target welcoming user. By deploying a human-machine collaboration strategy on the robot, while providing repetitive and personalized services, the physical and mental requirements of staff are reduced, and long waiting times for users are avoided, thus improving the user experience.

[0091] The robot-based service device provided in the embodiments of the present invention can execute the robot-based service method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0092] It is worth noting that the various units and modules included in the above-mentioned device are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be realized; in addition, the specific names of each functional unit are only for easy differentiation and are not used to limit the protection scope of the embodiments of the present invention.

[0093] Example 5

[0094] Figure 5 This is a schematic diagram of the structure of an electronic device provided in Embodiment 5 of the present invention. Figure 5 A block diagram is shown of an exemplary electronic device 40 suitable for implementing embodiments of the present invention. Figure 5 The electronic device 40 shown is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments of the present invention.

[0095] like Figure 5 As shown, electronic device 40 is represented in the form of a general-purpose computing device. The components of electronic device 40 may include, but are not limited to: one or more processors or processing units 401, system memory 402, and bus 403 connecting different system components (including system memory 402 and processing unit 401).

[0096] Bus 403 represents one or more of several bus architectures, including a memory bus or memory controller, a peripheral bus, a graphics acceleration port, a processor, or a local bus using any of the various bus architectures. Examples of these architectures include, but are not limited to, the Industry Standard Architecture (ISA) bus, the Micro Channel Architecture (MAC) bus, the Enhanced ISA bus, the Video Electronics Standards Association (VESA) local bus, and the Peripheral Component Interconnect (PCI) bus.

[0097] Electronic device 40 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by electronic device 40, including volatile and non-volatile media, removable and non-removable media.

[0098] System memory 402 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 404 and / or cache memory 405. Electronic device 40 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, storage system 406 may be used to read and write non-removable, non-volatile magnetic media (… Figure 5 Not shown; usually referred to as a "hard drive"). Although Figure 5 Not shown, a disk drive for reading and writing to a removable non-volatile disk (e.g., a "floppy disk") and an optical disk drive for reading and writing to a removable non-volatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to bus 403 via one or more data media interfaces. Memory 402 may include at least one program product having a set (e.g., at least one) of program modules configured to perform the functions of the embodiments of the present invention.

[0099] A program / utility 408 having a set (at least one) of program modules 407 may be stored, for example, in memory 402. Such program modules 407 include, but are not limited to, an operating system, one or more application programs, other program modules, and program data. Each or some combination of these examples may include an implementation of a network environment. Program modules 407 typically perform the functions and / or methods described in the embodiments of the present invention.

[0100] Electronic device 40 can also communicate with one or more external devices 409 (e.g., keyboard, pointing device, display 410, etc.), and with one or more devices that enable a user to interact with the electronic device 40, and / or with any device that enables the electronic device 40 to communicate with one or more other computing devices (e.g., network card, modem, etc.). This communication can be performed via input / output (I / O) interface 411. Furthermore, electronic device 40 can also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN), and / or public networks, such as the Internet) via network adapter 412. As shown, network adapter 412 communicates with other modules of electronic device 40 via bus 403. It should be understood that, although... Figure 5Not shown, other hardware and / or software modules may be used in conjunction with electronic device 40, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0101] The processing unit 401 executes various functional applications and data processing by running programs stored in the system memory 402, such as implementing the robot-based service method provided in the embodiments of the present invention.

[0102] Example 6

[0103] Embodiment 6 of the present invention also provides a storage medium containing computer-executable instructions, which, when executed by a computer processor, are used to perform a robot-based service method.

[0104] The method includes:

[0105] Upon receiving a welcoming instruction corresponding to the welcoming service, the system identifies the target welcoming object in the image to be processed and obtains the target welcoming pattern determined by the target welcoming object.

[0106] If the target welcoming mode is consistent with the preset welcoming mode, then at least one potential welcoming user associated with the target welcoming robot is identified.

[0107] Based on the status attribute information of the at least one candidate welcoming user, the target welcoming user is determined;

[0108] The target welcoming robot sends the associated information of the target welcoming object to the target welcoming user.

[0109] The computer storage medium of this invention can be any combination of one or more computer-readable media. A computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this document, a computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

[0110] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, carrying computer-readable project code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, which can send, propagate, or transmit programs for use by or in connection with an instruction execution system, apparatus, or device.

[0111] The project code contained on a computer-readable medium may be transmitted using any suitable medium, including—but not limited to—wireless, wire, optical fiber, RF, etc., or any suitable combination thereof.

[0112] Computer project code for performing the operations of embodiments of the present invention can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The project code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0113] Note that the above description is merely a preferred embodiment of the present invention and the technical principles employed. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and various obvious changes, readjustments, and substitutions can be made without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in detail through the above embodiments, the present invention is not limited to the above embodiments, and may include many other equivalent embodiments without departing from the concept of the present invention, the scope of which is determined by the scope of the appended claims.

Claims

1. A service method based on a robot, characterized by, Comprise: Upon receiving a welcoming instruction corresponding to a welcoming service, a target welcoming object in a to-be-processed image is identified, and a target welcoming mode determined by the target welcoming object is obtained, the target welcoming object being a patient walking towards a front desk guidance area of a hospital, and the welcoming service including a guidance service or a route guiding service; If the target welcoming mode is consistent with a preset welcoming mode, at least one to-be-selected welcoming user bound to a target welcoming robot is determined, the preset welcoming mode being a human-robot collaborative welcoming mode; A target welcoming user is determined according to state attribute information of the at least one to-be-selected welcoming user; Correlation information of the target welcoming object is sent by the target welcoming robot to a client corresponding to the target welcoming user, the correlation information being information reflecting an identity, a state, a question or a demand of the target welcoming object from multiple dimensions; Wherein, the target welcoming object in the to-be-processed image is identified upon receiving a welcoming instruction corresponding to a welcoming service, and the target welcoming mode determined by the target welcoming object is obtained, comprising: The welcoming instruction is generated based on a triggering operation of the target welcoming object on the target welcoming robot; A to-be-processed image including the target welcoming object is collected by an image collection device arranged on the target welcoming robot; The target welcoming object on the to-be-processed image is identified by an image recognition module; A triggering operation of the target welcoming object on a welcoming mode selection control is obtained, and the target welcoming mode is determined based on the triggering operation; Wherein, the state attribute information includes priority information, and the target welcoming user is determined according to the state attribute information of the at least one to-be-selected welcoming user, comprising: Collaboration information is sent by the target welcoming robot to a client corresponding to a to-be-selected welcoming user with the highest priority level; If an agreement to collaborate feedback of the client is received, the to-be-selected welcoming user is taken as the target welcoming user; If a disagreement to collaborate feedback of the client is received, collaboration information is repeatedly sent to the corresponding to-be-selected welcoming user in order of priority level from high to low until the target welcoming user is determined; Wherein, the correlation information of the target welcoming object is sent by the target welcoming robot to the client corresponding to the target welcoming user, comprising: Voice information and text information of the target welcoming object are fed back by the target welcoming robot to the client corresponding to the target welcoming user; and Voice information fed back by the target welcoming user is played by a loudspeaker of the target welcoming robot, and the text information is displayed on a display screen of the target welcoming robot.

2. The method of claim 1, wherein, Also include: If the target welcoming mode is inconsistent with the preset welcoming mode, the target to-be-welcomed object is guided step by step based on a guidance specification built-in the target welcoming robot; Wherein, the guidance specification includes guidance basic information.

3. A robot-based service device, characterized in that Comprise: The target welcoming object recognition module is configured to, when a welcoming instruction corresponding to a welcoming service is received, identify a target welcoming object in a to-be-processed image, and obtain a target welcoming mode determined by the target welcoming object, including: generating the welcoming instruction based on a trigger operation of the target welcoming object on the target welcoming robot; collecting a to-be-processed image including the target welcoming object based on an image collection device arranged on the target welcoming robot; identifying the target welcoming object on the to-be-processed image through an image recognition module; obtaining a trigger operation of the target welcoming object on a welcoming mode selection control, and determining the target welcoming mode based on the trigger operation, the target welcoming object being a patient walking to a front desk of a hospital, and the welcoming service including a guide service or a route guiding service; The to-be-selected welcoming user determination module is configured to, if the target welcoming mode is consistent with a preset welcoming mode, determine at least one to-be-selected welcoming user bound to the target welcoming robot, the preset welcoming mode being a human-robot collaborative welcoming mode; The target welcoming user determination module is configured to determine a target welcoming user according to state attribute information of the at least one to-be-selected welcoming user, including: sending, by the target welcoming robot, collaborative information to a client corresponding to a to-be-selected welcoming user with the highest priority level; if an agreement to collaborate feedback of the client is received, regarding the to-be-selected welcoming user as the target welcoming user; if a disagreement to collaborate feedback of the client is received, repeatedly sending, by the target welcoming robot, collaborative information to a corresponding to-be-selected welcoming user in order of priority level from high to low until the target welcoming user is determined, the state attribute information including priority information; The information sending module is configured to send, by the target welcoming robot, associated information of the target welcoming object to a client corresponding to the target welcoming user, including: feeding back, by the target welcoming robot, voice information and text information of the target welcoming object to the client corresponding to the target welcoming user; and playing, by the target welcoming robot, voice information fed back by the target welcoming user through a loudspeaker, and displaying the text information on a display screen of the target welcoming robot, the associated information being information reflecting an identity, a state, a problem or a demand of the target welcoming object from multiple dimensions.

4. An electronic device, comprising: The electronic device includes: one or more processors; a storage device for storing one or more programs, when the one or more programs are executed by the one or more processors, the one or more processors implement the robot-based service method of claim 1 or 2.

5. A storage medium containing computer executable instructions for performing the robot-based service method of claim 1 or 2 when executed by a computer processor.

5. A storage medium containing computer executable instructions for performing the robot-based service method of claim 1 or 2 when executed by a computer processor.

Images