Method, device, robot and medium for playing display content by robot

By acquiring various recognition features and using models to determine the attributes of the target object, the robot can play personalized interactive content, solving the problem of monotonous interactive content in existing robots and improving the user experience.

CN114332996BActive Publication Date: 2025-11-28SHENZHEN PUDU TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202111582440.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-12-22
Publication Date
2025-11-28
Estimated Expiration
2041-12-22

AI Technical Summary

Technical Problem

Existing service robots offer limited interactive content and cannot provide personalized content for different target audiences, resulting in a poor user experience.

Method used

By acquiring various recognition features of the target object, such as facial data, height data, and voice data, the trained model is used to determine the attributes of the target object, and the display screen is controlled to play interactive content corresponding to the attributes.

Benefits of technology

It improves the user experience of the robot by combining multiple recognition features to more accurately identify the attributes of the target user, thereby playing content that is more in line with their interests.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114332996B_ABST
    Figure CN114332996B_ABST
Patent Text Reader

Abstract

The application discloses a method and device for a robot to play display content, the robot, and a medium, and applies to the field of robots. The robot comprises a display screen and a detection device. When a target object walks to the vicinity of the robot, the detection device on the robot acquires at least two identification features of the target object, and determines the attributes of the target object, such as the age and gender of the target object, according to the identification features. The display screen plays interactive content corresponding to the attributes of the target object, and plays content that is more likely to interest different target objects, thereby improving the experience of the target object to the robot. Moreover, the robot adopts at least two identification features, and can more accurately identify the attributes of the target object than using only one identification feature. The application also provides a method and device for a robot to play display content, and a medium, which correspond to the above-mentioned robot, and therefore have the same beneficial effects as the above-mentioned robot.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the field of robots, and in particular to a method and device for playing display content by a robot, a robot and a medium. BACKGROUND

[0002] With more and more service robots, people can see the service robots everywhere in daily life. The existing service robots are often applied to business places such as shopping malls or restaurants to provide services and display information of merchants. However, the service content and form of the existing service robots are relatively single, and the service robots can only provide some simple basic information of merchants to target objects, and cannot provide different content to different target objects, so it is difficult to cater to the preferences of the target objects, thereby causing the target objects to have a poor experience of the robots.

[0003] Therefore, the single interactive content of the robot and the poor pertinence of the interactive content are problems to be solved by those skilled in the art. SUMMARY

[0004] The present application aims to provide a method and device for playing display content by a robot, a robot and a medium, so as to improve the experience of target objects to the robot.

[0005] To solve the above technical problems, the present application provides a robot comprising a display screen, a detection device, a memory and a processor, wherein the memory stores computer readable instructions executable on the processor, and the processor is configured to execute the computer readable instructions to implement the following steps:

[0006] obtaining at least two identification features of a target object sent by the detection device;

[0007] determining an attribute of the target object according to the identification features;

[0008] controlling the display screen to play interactive content corresponding to the attribute.

[0009] Optionally, the identification features comprise facial data and height data of the target object, wherein the height data is obtained through body contour data; and the obtaining of the at least two identification features of the target object sent by the detection device comprises:

[0010] obtaining the facial data of the target object;

[0011] determining whether the facial data meets a preset condition;

[0012] if yes, obtaining the height data of the target object;

[0013] if no, ending the identification process of the facial data in this round.

[0014] Optionally, before the step of controlling the display screen to play the interactive content corresponding to the attribute, the processor, when executing the computer readable instructions, further implements the following steps:

[0015] calling a body contour judgment model to determine whether the body contour data meets preset requirements of a human body contour, the body contour judgment model being generated in advance according to body contour sample data;

[0016] If yes, entering the step of controlling the display screen to play the interactive content corresponding to the attribute.

[0017] Optionally, the identification feature further includes voice data of the target object.

[0018] The determining of the attribute of the target object according to the identification feature includes:

[0019] calling a height classification model to process the height data to determine the attribute, the height classification model being generated in advance according to height sample data;

[0020] calling a face classification model to process the face data to determine the attribute, the face classification model being generated in advance according to face sample data;

[0021] calling a voice classification model to process the voice data to determine the attribute, the voice classification model being generated in advance according to voice sample data.

[0022] Optionally, the robot includes a body, the body including a top portion and a side portion extending downward along a periphery of the top portion, and the display screen includes at least two display screens, two of which are arranged on the top portion and the side portion, respectively.

[0023] The controlling of the display screen to play the interactive content corresponding to the attribute includes controlling the display screen on the top portion and the display screen on the side portion to both play the interactive content corresponding to the attribute.

[0024] Optionally, the display screen includes at least two display screens, two of which are arranged on a front surface and a back surface of the robot, respectively; and the processor, when executing the computer readable instructions, further implements the following steps:

[0025] If it is detected that the target object is interested in the interactive content, controlling the display screen on the back surface to play the interactive content;

[0026] Controlling the robot to move from a current position to a target position corresponding to the interactive content.

[0027] Optionally, the identification features include height data and face data of the target object, the detection device includes an RGBD depth camera and an RGB camera; the obtaining of the at least two identification features of the target object sent by the detection device includes:

[0028] the height data sent by the RGBD depth camera, and the face data sent by the RGB camera.

[0029] Optionally, the attributes include gender and age, wherein the gender is obtained by invoking a trained model to process the face data and / or the voice data, and the age is obtained by invoking a trained model to process any one or any combination of the height data, the face data, the body contour data and the voice data.

[0030] Optionally, after the controlling of the display screen to play the interactive content corresponding to the attributes, the processor, when executing the computer readable instructions, further implements the following steps:

[0031] if it is detected that the target object is interested in the interactive content, displaying a pre-stored map;

[0032] determining path information of a current location and a target location through the map;

[0033] controlling the robot to move from the current location to the target location according to the determined path information.

[0034] Optionally, the robot includes a body, the body includes a top portion and a side portion extending downward along a periphery of the top portion, and the display screen includes at least two display screens, two of which are arranged on the top portion and the side portion, respectively.

[0035] The controlling of the display screen to play the interactive content corresponding to the attributes is specifically controlling the display screen of the side portion to play the interactive content corresponding to the attributes.

[0036] After the controlling of the display screen to play the interactive content corresponding to the attributes, the processor, when executing the computer readable instructions, further implements the following steps:

[0037] when the height data represents that the height of the target object is greater than a threshold value, controlling the display screen of the top portion to play the interactive content.

[0038] To solve the above technical problems, the application further provides a method for a robot to play display content, applied to a robot including a display screen and a detection device, and the method includes:

[0039] obtaining at least two identification features of a target object sent by the detection device;

[0040] determine an attribute of the target object according to the identification features;

[0041] control the display screen to play interactive content corresponding to the attribute.

[0042] To solve the above technical problems, the application further provides a device for a robot to play display content, applied to a robot comprising a display screen and a detection device, comprising:

[0043] an acquisition module configured to acquire at least two identification features of a target object sent by the detection device;

[0044] a determination module configured to determine an attribute of the target object according to the identification features;

[0045] a control module configured to control the display screen to play interactive content corresponding to the attribute.

[0046] To solve the above technical problems, the application further provides a computer readable storage medium, wherein the computer readable storage medium stores a computer program, and the computer program is executed by a processor to implement the steps of the method for a robot to play display content.

[0047] The robot provided by the application comprises a display screen and a detection device. When a target object approaches the robot, the detection device on the robot acquires at least two identification features of the target object, and determines an attribute of the target object, such as the age and gender of the target object, according to the identification features. The display screen plays interactive content corresponding to the attribute of the target object, which is more likely to interest different target objects, and can improve the experience of the target object to the robot. Moreover, the robot uses at least two identification features, which can more accurately identify the attribute of the target object than using only one identification feature.

[0048] The application further provides a method, device and medium for a robot to play display content, which correspond to the robot described above, and have the same beneficial effects as the robot described above. BRIEF DESCRIPTION OF DRAWINGS

[0049] To make the application embodiments clearer, the following will briefly introduce the drawings needed in the embodiments. Obviously, the drawings in the following description are only some embodiments of the application, and other drawings can be obtained by those skilled in the art without any creative effort on the basis of these drawings.

[0050] Figure 1 FIG. 1 is a structural schematic diagram of a robot provided by an embodiment of the application;

[0051] Figure 2 A flow chart of a method for a robot to play display content is provided in an embodiment of the present application.

[0052] Figure 3 A module schematic diagram of an apparatus for a robot to play display content is provided in an embodiment of the present application.

[0053] Figure 4 A structural diagram of an apparatus for a robot to play display content is provided in another embodiment of the present application. DETAILED DESCRIPTION

[0054] The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, but not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work fall within the protection scope of the present application.

[0055] The core of the present application is to provide a method, an apparatus, a robot and a medium for a robot to play display content.

[0056] In order to make the person skilled in the art better understand the present application, the present application will be further described in detail below with reference to the drawings and specific embodiments.

[0057] The robot mentioned in the present application includes a memory and a processor, the memory stores computer readable instructions, and the processor implements a method for a robot to play display content when executing the computer readable instructions. The robot provided in the present application is generally applied in a restaurant or a shopping mall, and can be fixed or mobile. Figure 1 A structural schematic diagram of a robot is provided in an embodiment of the present application. It should be noted that, Figure 1 is only one implementation in the embodiments of the present application, and does not limit other embodiments of the present application. For example, Figure 1 As shown in the figure, the robot includes a display screen 10 and a detection apparatus 11. The present application does not limit the structure of the robot, the number, shape and mounting position of the display screen 10 and the detection apparatus 11 in the figure, and does not require the type of the detection apparatus 11, but generally includes multiple different types of detection apparatuses 11 for detecting multiple identification features of the target object. Figure 1The display screen 10 in the figure is installed at the body of the robot, and the target object can watch the interactive content in the display screen 10, and the display screen 10 can also be arranged on the back of the robot or on the top of the body of the robot, so that the target object can watch the interactive content from other directions; the figure also includes two detection devices 11, and the detection device 11 generally installed at the bottom of the body of the robot is a depth camera, which is used to obtain the body contour data of the target object; the detection device 11 installed on the top of the body is an RGB camera, which is used to obtain the face data of the target object, and the detection device can also be a sound recognition device, which is used to obtain the sound data of the target object.

[0058] Figure 2 A flowchart of a method for a robot to play display content is provided in the embodiment of the application; as shown in the figure, the following steps are realized when the processor executes the computer readable instructions:

[0059] S10: obtaining at least two recognition features of the target object sent by the detection device;

[0060] Generally, a plurality of detection devices are installed on the robot to obtain corresponding recognition features, and the detection devices can be laser radar, depth camera, RGB camera, sound recognition device, etc., and these detection devices are generally used to obtain the body contour data, face data, sound data, etc. of the target object, and the height data of the target object can also be obtained through the body contour data; when obtaining different recognition features, the specific detection device to be used is subject to the actual situation, and generally one detection device is used to obtain one recognition feature, which is not specifically required here. The detection device can be installed at any position on the robot, and the corresponding data can be obtained as long as it can be obtained well. For example, the laser radar or the depth camera can be installed at the bottom of the body of the robot, and the body contour data of the target object can be obtained, and the laser radar can also be used to detect whether the target object is close, and the robot can start the detection function of the corresponding detection device after the laser radar detects that the target object is close, and obtain the corresponding recognition features. The RGB camera can be installed on the top of the body of the robot, and the specific installation position is subject to the actual situation, because the RGB camera is generally used to obtain the face data of the target object, and it is best to be close to the height of the face; a plurality of RGB cameras can also be installed at different heights of the robot to obtain the face data of target objects of different heights.

[0061] S11: determining the attribute of the target object according to the recognition features;

[0062] The at least two identification features of the target object are acquired by the plurality of detection devices in step S10, and the acquired identification features include but are not limited to facial data, height data, and voice data. The attributes of the target object can be determined according to the identification features, and the attributes of the target object can be the gender and / or age of the target object. The determined age of the target object can be an accurate age value or an age range, and the length of the age range is not limited, and 5 years can be taken as an age range. The gender of the target object can be determined by the facial data and voice data of the target object, because the differences between the faces and voices of men and women are large, and the gender of the target object can be accurately distinguished by the two kinds of data. However, the height range of men and women is large, and it is difficult to distinguish the gender of the target object by the height data. The age of the target object can be determined by the facial data, height data, voice data, and body contour data of the target object. The differences in the faces and timbres of target objects of different ages are obvious, and can be used as a basis for judgment. The body contour data of target objects of different ages is also quite different. For example, the height data obtained from the body contour data of the target object can be used to distinguish the age of the target object. Children are usually short, and adults are usually tall. If the target object is an old person, the shape of the target object can be obtained from the body contour data to determine the corresponding attributes. The above correspondence between the attributes and the identification features is only one scheme given by the embodiments of the present application. In specific implementation, the attributes can be determined according to the corresponding identification features according to the actual situation. If only one kind of identification feature is used as the basis for determining the attributes, the result obtained may not be accurate. Therefore, the attributes of the target object can be determined according to multiple identification features. If the attributes determined by multiple identification features are different, the attributes determined by multiple identification features can be counted, and an optimal result can be selected. The following gives several cases, and the optimal result can be determined according to the several schemes. In the first case, the gender of the target object is determined by multiple identification features, but multiple results are obtained. The result with the highest frequency can be selected as the optimal result. If the frequency of the results of men and women is the same, the identification features can be reacquired. For example, three identification features determine different genders, two of which determine that the gender is male, and one determines that the gender is female. Finally, the gender of the target object is determined to be male. In the second case, the age range of the target object is determined by multiple identification features, but multiple age ranges are obtained. The age range with the highest frequency can be selected as the optimal result. If the age ranges of the multiple results are different, the average value can be taken or the identification features can be reacquired. For example, three identification features determine three age ranges, which are 1 to 5 years old, 5 to 10 years old, and 10 to 15 years old. The average value of the three age ranges can be taken to determine that the age range of the target object is 5 to 10 years old.

[0063] S12: controlling the display screen to play the interactive content corresponding to the attribute.

[0064] The display screen can be installed at any position of the robot, and is usually installed at a middle position of the robot body, so as to conform to the height of most target objects. The size and shape of the display screen are not required, and generally, a large display screen is used for the target object to watch, and multiple display screens can be used for the target object to watch from different angles. After the attribute of the target object is determined, the display screen is controlled to play the interactive content corresponding to the attribute of the target object. For example, when it is determined that the target object is a child, the display screen is controlled to play some child short film materials to attract the child; when it is determined that the target object is a female, the display screen is controlled to play some makeup teaching videos. The two recognition features are obtained to more accurately determine the attribute of the target object, so that the interactive content played by the display screen can better cater to the preferences of the target object.

[0065] The robot provided in the embodiments of the present application includes a display screen and a detection device. When a target object walks to the vicinity of the robot, the detection device on the robot obtains at least two recognition features of the target object, and determines the attribute of the target object, such as the age and gender of the target object, according to the recognition features. The display screen plays interactive content corresponding to the attribute of the target object, which is more likely to interest the target object, and can improve the experience of the target object to the robot. Moreover, the robot uses at least two recognition features, which can more accurately identify the attribute of the target object than using only one recognition feature.

[0066] In specific implementation, the multiple recognition features can influence each other when determining the attribute, and therefore, the order of obtaining the multiple recognition features can better determine the attribute of the target object. When the recognition features of the target object include face data and height data of the target object, the order of obtaining the two recognition features of the target object by the detection device is as follows: obtaining the face data of the target object; determining whether the face data meets a preset condition; if yes, obtaining the height data of the target object; and if no, ending the face data recognition process.

[0067] The acquired identification features include two kinds, one is face data, and the other is height data. In specific application, the face data of the target object can be acquired by using an RGB camera, and it is judged whether the face data meets the preset requirement. The preset requirement can mean that the acquired face data meets the characteristics of a human face, for example, the acquired face data includes the human facial features. If the face data meets the preset requirement, it can be determined that the object scanned by the detection device at this time is a human being, and the height data of the target object can be further acquired to further determine the attribute of the target object. If the face data does not meet the preset requirement, it is not necessary to continue to acquire the height data, and it is not necessary to continue to determine the attribute of the target object according to the face data, that is, the identification of the face data in this round is ended. The above scheme is the case where the identification features only include face data and height data. When the acquired identification features also include sound data, the acquisition sequence can be to acquire the face data first, then acquire the height data, and finally acquire the sound data. When the acquired identification features do not meet the requirement, the subsequent identification features are not acquired.

[0068] In the embodiment, the acquisition sequence of the face data and the height data is described, the face data of the target object is acquired first, and then the height data of the target object is acquired, so that the attribute of the target object can be determined more accurately. When the acquired face data does not meet the preset condition, the height data is not acquired, so that useless data is avoided to be acquired, thereby avoiding resource waste.

[0069] In actual application scenarios, there can be many other objects near the robot, and the detection device will only acquire identification features for human bodies. However, in actual application, objects similar to human body contours and heights can enter the detection range of the detection device, and some detection devices cannot identify whether the detected object is the target object, thereby possibly obtaining incorrect results. Therefore, before the processor executes the computer readable instructions to control the display screen to play the interactive content corresponding to the attribute, the following step is further implemented: calling a body contour judgment model to judge whether the body contour data meets the preset requirement of the human body contour, the body contour judgment model being generated by being trained in advance according to body contour sample data; if yes, the step of controlling the display screen to play the interactive content corresponding to the attribute is entered.

[0070] The scheme provided in the embodiment excludes similar objects near the robot, so that the identification features of the target object can be acquired more accurately, resource waste caused by acquiring the identification features of similar objects is avoided, and invalid identification features are also avoided to be acquired from similar objects, so that when the target object appears, the display screen of the robot plays the interactive content that is not interesting to the current target object.

[0071] In determining the attribute of the target object, appropriate identification features need to be selected for reference. If the identification features are too few, the determined attribute can not be accurate enough. If the identification features are too many, the accuracy of identification can not be increased, and resource waste can be caused. Therefore, the number of selected identification features is not the more the better, and it is more important to select appropriate identification features for reference. The identification features also include voice data of the target object, and the detection device on the robot also includes a voice recognition device. Determining the attribute of the target object according to the identification features includes: calling a height classification model to process the height data to determine the attribute, the height classification model being generated in advance according to height sample data; calling a face classification model to process the face data to determine the attribute, the face classification model being generated in advance according to face sample data; and calling a voice classification model to process the voice data to determine the attribute, the voice classification model being generated in advance according to voice sample data. The order of obtaining the three kinds of identification features can be: obtaining the face data first, obtaining the height data second, and obtaining the voice data last. Each kind of identification feature can utilize the results of the other two kinds of identification features when determining the attribute of the target object.

[0072] The scheme provided in this embodiment increases the voice data of the target object for reference when determining the attribute of the target object, and the three kinds of identification features jointly confirm the attribute of the target object, so that the determined attribute of the target object is more accurate.

[0073] The robot provided in this embodiment includes a body, the body includes a top portion and a side portion extending downward along a periphery of the top portion, and the display screen includes at least two display screens, of which two display screens are arranged on the top portion and the side portion respectively. For the robot including the two display screens, this embodiment provides two different schemes for controlling the two display screens.

[0074] The first scheme is to control the display screens to play interactive content corresponding to the attribute of the target object, which includes controlling the display screen on the top portion and the display screen on the side portion to play the interactive content corresponding to the attribute of the target object. In actual application, the identification features can not include the height data of the target object. When a target object walks to the vicinity of the robot and the attribute of the target object is determined, the two display screens on the top portion and the side portion of the robot can be controlled to play the same interactive content.

[0075] The second scheme is to control the display screens to play interactive content corresponding to the attribute, which specifically includes: controlling the display screen on the side portion to play the interactive content corresponding to the attribute; and after controlling the display screens to play the interactive content corresponding to the attribute, the processor executing the computer readable instructions further implements the following steps: when the height data represents that the height of the target object is greater than a threshold value, controlling the display screen on the top portion to play the interactive content. When the identification features include the height data of the target object, the height of the target object can be obtained therefrom, and the display screen of the corresponding height can be controlled to play the interactive content according to the height of the target object.

[0076] The above embodiments provide two different solutions, the first solution is to control the two display screens of the top and side to play interactive content regardless of the height of the target object; the second solution is to control the display screen of the corresponding height to play interactive content according to the height of the target object. Both solutions can provide a good viewing angle for the target object and improve the viewing experience of the target object.

[0077] The robot provided in the present application can be applied in a shopping mall, and the interactive content played in the display screen can be product information of a merchant. If the target object is interested in the product in the display screen, the robot needs to lead the target object to the location of the merchant. Therefore, after controlling the display screen to play interactive content corresponding to the attribute, the processor executes computer readable instructions to further implement the following steps: if it is detected that the target object is interested in the interactive content, a pre-stored map is displayed; path information from the current location to the target location is determined through the map; and the robot is controlled to move from the current location to the target location according to the determined path information.

[0078] The solution provided in the present embodiment can lead the target object to the corresponding target location when the target object is interested in the interactive content in the display screen, and display a map of the shopping mall to the target object, so that the target object can obtain the location of the target location according to the map. The solution provides a better experience for the target object and avoids the target object from blindly searching for the target location.

[0079] In the above embodiments, the robot needs to lead the target object to the target location, and in this leading process, the target object is at the back of the robot. The display screen of the robot is at least two, of which two are respectively arranged on the front and back of the robot. When the target object is at the back of the robot, the target object cannot watch the display screen on the front. Therefore, when the processor executes computer readable instructions, the following steps are further implemented: if it is detected that the target object is interested in the interactive content, the display screen on the back is controlled to play the interactive content; and the robot is controlled to move from the current location to the target location corresponding to the interactive content.

[0080] The display screen on the front of the robot plays interactive content. If it is detected that the target object is interested in the interactive content, a prompt information can be played on the display screen on the front to prompt the target object to watch the display screen on the back. At this time, the robot can also turn around to face the display screen on the back to the target object and lead the target object from the current location to the target location corresponding to the interactive content.

[0081] The solution provided in the present embodiment can attract the target object to the back of the robot to watch the display screen on the back. Therefore, in the leading process of the robot, the target object is at the back of the robot and can also watch the interactive content, thereby improving the experience of the target object to the robot.

[0082] In specific implementations, using appropriate detection devices to obtain corresponding identification features can bring a multiplier effect. Therefore, the identification features include height data and face data of the target object, and the detection devices include an RGBD depth camera and an RGB camera; and obtaining at least two identification features of the target object sent by the detection devices includes: obtaining the height data sent by the RGBD depth camera, and obtaining the face data sent by the RGB camera.

[0083] The detection device provided in this embodiment can better obtain the identification features of the target object, has high acquisition efficiency, and the obtained data is accurate.

[0084] The attributes of the target object include gender and age, and the target objects of different ages and different genders are interested in different things. Using appropriate identification features to determine the corresponding attributes can achieve good results; wherein the gender of the target object is obtained by calling a trained model to process face data and / or voice data, because the faces and voices of men and women are quite different, the gender of the target object can be accurately distinguished through the two kinds of data, but the height range of men and women is large, and it is difficult to distinguish the gender of the target object through height data. The age of the target object is obtained by calling a trained model to process any one or any combination of height data, face data, body contour data, and voice data, because the features of the age of the target object can be obtained from height data, face data, body contour data, and voice data, the differences in the faces and timbres of target objects of different ages are quite obvious, and can be used as a basis for judgment. The body contour data of target objects of different ages is also quite different, for example, the height data obtained from the body contour data of the target object can distinguish the age of the target object, children are usually short, and adults are usually tall; if the target object is an old person, the shape of the target object can be obtained from the body contour data to determine the corresponding attribute.

[0085] The scheme provided in this embodiment uses appropriate identification features to determine the age and gender of the target object, and the obtained results have high accuracy and high determination efficiency.

[0086] In the above embodiments, the method for the robot to play display content is described in detail, and the present application also provides corresponding embodiments of the device for the robot to play display content. It should be noted that the embodiments of the device part are described from two angles, one is based on the functional module angle, and the other is based on the hardware angle.

[0087] Based on the functional module angle, the present application provides a device for the robot to play display content, Figure 3 The module schematic diagram of the device for the robot to play display content provided in the embodiments of the present application is shown in Figure 3 The device comprises:

[0088] The acquisition module 20 is configured to acquire at least two identification features of the target object sent by the detection device.

[0089] The determination module 21 is configured to determine the attribute of the target object according to the identification features.

[0090] The control module 22 is configured to control the display screen to play the interactive content corresponding to the attribute.

[0091] Since the embodiments of the device part correspond to the embodiments of the method part, the embodiments of the device part are described in the description of the embodiments of the method part, and will not be described here.

[0092] The device for playing display content by the robot provided in the embodiment corresponds to the method described above, and thus has the same beneficial effects as the method described above.

[0093] From the perspective of hardware, the embodiment provides another device for playing display content by a robot, Figure 4 The structural diagram of the device for playing display content by the robot provided in another embodiment of the present application is shown in Figure 4 The device for playing display content by the robot includes a memory 30 configured to store a computer program.

[0094] A processor 31 is configured to execute the computer program to realize the steps of the method for playing display content by the robot mentioned in the above embodiments.

[0095] The device for playing display content by the robot provided in the embodiment can include but is not limited to a smart phone, a tablet computer, a notebook computer, or a desktop computer, etc.

[0096] The processor 31 can include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 31 can be implemented in at least one of a hardware form of a digital signal processor (DSP), a field-programmable gate array (FPGA), a programmable logic array (PLA), etc. The processor 31 can also include a main processor and a coprocessor. The main processor is a processor for processing data in a wake-up state, also referred to as a central processing unit (CPU). The coprocessor is a low-power processor for processing data in a standby state. In some embodiments, the processor 31 can be integrated with a graphics processor (GPU) for rendering and drawing content to be displayed on the display screen. In some embodiments, the processor 31 can further include an artificial intelligence (AI) processor for processing machine learning-related computing operations.

[0097] The memory 30 can include one or more computer-readable storage media, which can be non-transitory. The memory 30 can further include a high-speed random access memory, and a nonvolatile memory such as one or more disk storage devices, flash storage devices. In this embodiment, the memory 30 is used at least to store the following computer program 301, wherein the computer program is loaded and executed by the processor 31, and can implement the related steps of the robot display content playing method disclosed in any of the preceding embodiments. In addition, the resources stored in the memory 30 can further include an operating system 302 and data 303, etc., and the storage mode can be temporary storage or permanent storage. The operating system 302 can include Windows, Unix, Linux, etc. The data 303 can include, but is not limited to, data related to the robot display content playing method, etc.

[0098] In some embodiments, the robot display content playing apparatus can further include a display screen 32, an input / output interface 33, a communication interface 34, a power supply 35, and a communication bus 36.

[0099] Those skilled in the art can understand that the structure shown in the above embodiments does not constitute a limitation on the robot display content playing apparatus, and can include more or fewer components than those shown in the drawings. Figure 4 The structure shown in the above embodiments does not constitute a limitation on the robot display content playing apparatus, and can include more or fewer components than those shown in the drawings.

[0100] The device for playing display content by a robot provided in the embodiment of the present application comprises a memory and a processor. When the processor executes a program stored in the memory, the method for playing display content by a robot can be implemented.

[0101] The device for playing display content by a robot provided in the embodiment of the present application corresponds to the above method, and thus has the same beneficial effects as the above method.

[0102] Finally, the present application also provides an embodiment corresponding to a computer readable storage medium. The computer readable storage medium stores a computer program. When the computer program is executed by a processor, the steps recorded in the above method embodiments are implemented.

[0103] It can be understood that if the method in the above embodiments is implemented in the form of a software function unit and sold or used as an independent product, it can be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application essentially or say the part that contributes to the prior art or the whole or part of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium, and executes all or part of the steps of the methods described in the embodiments of the present application. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various media that can store program codes.

[0104] The computer readable storage medium provided in the embodiment of the present application corresponds to the above method, and thus has the same beneficial effects as the above method.

[0105] The method, device, robot and medium for playing display content by a robot provided in the present application are described in detail above. The embodiments in the specification are described in a progressive manner. Each embodiment mainly describes the differences from other embodiments. The same or similar parts of each embodiment can be referred to. For the device disclosed in the embodiments, since it corresponds to the method disclosed in the embodiments, the description is relatively simple, and the related parts can be referred to the method part. It should be pointed out that, for those skilled in the art, without departing from the principles of the present application, some improvements and modifications can be made to the present application, and these improvements and modifications also fall within the protection scope of the claims of the present application.

[0106] It also needs to be explained that in the present specification, the relational terms such as first and second and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises", "comprising", or any other variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but can include other elements not expressly listed or inherent to such process, method, article, or apparatus. An element proceeded by "comprises... a" does not, without more constraints, exclude the existence of additional identical elements in the process, method, article, or apparatus that comprises the aforesaid element.

Claims

1. A robot comprising a display screen, a detection device, a memory, and a processor, wherein the memory stores computer-readable instructions executable on the processor, characterized in that, When the processor executes the computer-readable instructions, it performs the following steps: Acquire at least two identification features of the target object sent by the detection device; The attributes of the target object are determined based on the identified features; Control the display screen to play interactive content corresponding to the attribute; The display screens are at least two, with two respectively located on the front and back of the robot; the processor, when executing the computer-readable instructions, also performs the following steps: If the target object is detected to be interested in the interactive content, a prompt message is played on the front display screen, prompting the target object to look at the rear display screen, and the rear display screen is controlled to play the interactive content. Control the robot to move from its current position to the target position corresponding to the interactive content.

2. The robot according to claim 1, characterized in that, The identification features include facial data and height data of the target object, wherein the height data is obtained through body contour data; acquiring at least two identification features of the target object sent by the detection device includes: Obtain the facial data of the target object; Determine whether the facial data meets the preset conditions; If so, then obtain the height data of the target object.

3. The robot according to claim 2, characterized in that, Before controlling the display screen to play interactive content corresponding to the attribute, the processor, when executing the computer-readable instructions, also performs the following steps: The body contour judgment model is invoked to determine whether the body contour data meets the preset requirements of human body contour. The body contour judgment model is generated in advance based on body contour sample data. If so, proceed to the step of controlling the display screen to play interactive content corresponding to the attribute.

4. The robot according to claim 2 or 3, characterized in that, The identification features also include the sound data of the target object; Determining the attributes of the target object based on the identified features includes: The height classification model is invoked to process the height data to determine the attribute, wherein the height classification model is pre-trained and generated based on height sample data. The facial data is processed by a facial classification model to determine the attribute, wherein the facial classification model is pre-trained and generated based on facial sample data. The sound data is processed by a sound classification model to determine the attribute, and the sound classification model is generated in advance based on sound sample data.

5. The robot according to claim 1, characterized in that, The robot includes a body, the body including a top and a side extending downward along the periphery of the top, and the display screen is at least two, with two respectively disposed on the top and the side; Controlling the display screen to play interactive content corresponding to the attribute includes controlling both the top display screen and the side display screen to play the interactive content corresponding to the attribute.

6. The robot according to claim 1, characterized in that, The identification features include the height data and facial data of the target object; the detection device includes an RGBD depth camera and an RGB camera; acquiring at least two identification features of the target object sent by the detection device includes: The height data sent by the RGBD depth camera and the facial data sent by the RGB camera are acquired.

7. The robot according to claim 4, characterized in that, The attributes include gender and age, wherein the gender is obtained by calling a trained model to process the facial data and / or the voice data, and the age is obtained by calling a trained model to process any one or any combination of the height data, the facial data, the body contour data, and the voice data.

8. The robot according to claim 1, characterized in that, After controlling the display screen to play interactive content corresponding to the attribute, the processor, when executing the computer-readable instructions, also performs the following steps: If the target object is detected to be interested in the interactive content, a pre-stored map is displayed; The path information between the current location and the target location is determined using the map; Based on the determined path information, the robot is controlled to move from the current position to the target position.

9. The robot according to claim 2, characterized in that, The robot includes a body, the body including a top and a side extending downward along the periphery of the top, and the display screen is at least two, with two respectively disposed on the top and the side; The specific method of controlling the display screen to play interactive content corresponding to the attribute is to control the side display screen to play interactive content corresponding to the attribute. After controlling the display screen to play interactive content corresponding to the attribute, the processor, when executing the computer-readable instructions, also performs the following steps: When the height data indicates that the height of the target object is greater than a threshold, the top display screen is controlled to play the interactive content.

10. A method for a robot to play and display content, characterized in that, Applied to robots including displays and detection devices, the method includes: Acquire at least two identification features of the target object sent by the detection device; The attributes of the target object are determined based on the identified features; Control the display screen to play interactive content corresponding to the attribute; The robot has at least two displays, with two of them located on the front and back of the robot, respectively. If the target object is detected to be interested in the interactive content, a prompt message is played on the front display to prompt the target object to look at the back display, and the back display is controlled to play the interactive content. Control the robot to move from its current position to the target position corresponding to the interactive content.

11. A device for a robot to play and display content, characterized in that, Applications include robots with displays and inspection devices, including: The acquisition module is used to acquire at least two identification features of the target object sent by the detection device; The determining module is used to determine the attributes of the target object based on the identified features; The control module is used to control the display screen to play interactive content corresponding to the attribute; The robot has at least two displays, with two of them located on the front and back of the robot, respectively. The control module is also configured to, if it detects that the target object is interested in the interactive content, play a prompt message on the front display to prompt the target object to look at the back display, control the back display to play the interactive content, and control the robot to move from its current position to the target position corresponding to the interactive content.

12. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the steps of the method for a robot to play displayed content as described in claim 10.

Citation Information

Patent Citations

  • Robot, robot control method and device, storage medium and controller

    CN109940638A

  • Face attribute recognition method and device, electronic equipment and storage medium

    CN111382642A