Facial action debugging method of bionic robot and related equipment

Abstract

The invention provides a bionic robot facial action debugging method and related equipment, and relates to the technical field of intelligent robots. According to the method, the to-be-debugged biomimetic robot can be automatically adjusted by taking the manually finely adjusted reference biomimetic robot as a reference object, so that the reference biomimetic robot and the adjusted to-be-debugged biomimetic robot can directly show the same or similar facial expression effect when executing the same facial action; therefore, in the robot batch production process, the manual adjustment workload and the robot facial action expression deviation are effectively reduced, the robot adjustment efficiency and the robot facial action expression consistency are improved, and the aging requirement and the facial action expression consistency requirement in the robot batch production process are met.

Description

Technical Field

[0001] The present application relates to the technical field of intelligent robots, and in particular to a method for debugging facial movements of a bionic robot and related equipment. Background Art

[0002] As the trend of population aging intensifies and industrial robot technology becomes increasingly mature and perfect, people's requirements for robots have also improved from simple repetitive mechanical movements to the development of bionic robots with high intelligence and the ability to interact with other intelligent entities. People hope that bionic robots can express real situations by controlling facial expressions and communicate naturally with humans.

[0003] At present, the facial movements of bionic robots rely on the cooperation between the bionic skin on the robot's face and the numerous tiny motors built into the robot's head. Usually, it is necessary to drive a number of specific tiny motors to move together in order to pull the bionic skin on the robot's face to move and perform a certain facial movement. It is worth noting that during the mass production of bionic robots, due to assembly process limitations, different finished products of the same bionic robot have certain differences in the installation of head motors and / or facial skin. As a result, when the same motor drive solution is run on different finished products to perform specific facial movements, the facial movement amplitudes of different finished products for the specific facial movements are significantly different, and the same or similar facial expression effects cannot be presented to users.

[0004] Therefore, in order to ensure that the mass-produced robots can have the same or similar facial movement amplitudes when performing any facial movements, it is usually necessary to manually adjust the movement amplitude parameters of each motor involved in different facial movements for each robot before leaving the factory to ensure that the facial movement amplitudes of each robot product that is manually checked can achieve consistency. However, this manual inspection and adjustment solution has a huge workload and low efficiency, and cannot meet the timeliness requirements of robot mass production. At the same time, it is also difficult to meet the consistency requirements of facial movement performance during robot mass production because manual inspection of robot expressions is too subjective. Summary of the invention

[0005] In view of this, the purpose of the present application is to provide a bionic robot facial movement debugging method, a robot debugging device and a readable storage medium, which can use a manually fine-tuned reference bionic robot as a reference object to automatically adjust the motor movement amplitude of the bionic robot to be debugged, so as to ensure that the reference bionic robot and the adjusted bionic robot to be debugged can directly show the same or similar facial expression effects when performing the same facial movements, thereby effectively reducing the manual adjustment workload and the deviation of the robot's facial movement performance during the mass production of the robot, and improving the robot adjustment efficiency and the consistency of the robot's facial movement performance, so as to meet the timeliness requirements and facial movement performance consistency requirements during the mass production of the robot.

[0006] In order to achieve the above purpose, the technical solution adopted in the embodiment of the present application is as follows:

[0007] In a first aspect, the present application provides a bionic robot facial action debugging method, the method comprising:

[0008] Acquire reference facial expression feature data of a reference bionic robot performing a target facial action according to an expected action instruction, and acquire actual facial expression feature data of a bionic robot to be debugged performing the target facial action according to the expected action instruction;

[0009] Calculating the difference degree of facial expression matching the target facial action between the bionic robot to be debugged and the reference bionic robot according to the reference facial expression feature data and the actual facial expression feature data;

[0010] Detecting whether the facial expression difference satisfies a difference constraint condition;

[0011] If it is detected that the facial expression difference does not satisfy the difference constraint condition, the maximum motor movement amplitude of the target motor involved in the target facial action in the bionic robot to be debugged at the target facial action is adjusted, and the step of obtaining the actual facial expression feature data of the bionic robot to be debugged performing the target facial action according to the expected action instruction is skipped to continue the execution;

[0012] If it is detected that the facial expression difference satisfies the difference constraint condition, the maximum motor movement amplitude actually used by all target motors in the bionic robot to be debugged for the target facial movement is used as the expected limit movement amplitude of the corresponding target motor to achieve the target facial movement.

[0013] In an optional embodiment, the expected action instruction includes a plurality of expected action state weights of the target facial action; the step of calculating the difference degree of facial expression matching the target facial action between the bionic robot to be debugged and the reference bionic robot according to the reference facial expression feature data and the actual facial expression feature data comprises:

[0014] Calculating a plurality of first facial expression quantization values ​​of the reference bionic robot that match the target facial action according to the reference facial expression feature data, wherein each first facial expression quantization value corresponds to a desired action state weight;

[0015] Calculating a plurality of second facial expression quantization values ​​of the bionic robot to be debugged that match the target facial action according to the actual facial expression feature data, wherein each second facial expression quantization value corresponds to a desired action state weight alone;

[0016] For each expected action state weight, calculating an actual quantized difference between a second facial expression quantized value corresponding to the expected action state weight and the first facial expression quantized value;

[0017] A weighted sum operation is performed on the actual quantized differences of the weights of the multiple desired action states to obtain a difference degree of facial expression matching the target facial action.

[0018] In an optional embodiment, for any set of target facial expression feature data in the reference facial expression feature data and the actual facial expression feature data, the step of calculating a plurality of target facial expression quantization values ​​matching the target facial action comprises:

[0019] Extracting target dimension data whose corresponding dimension matches the target facial action from the target facial expression feature data;

[0020] For each expected action state weight, the target dimension data is screened according to a preset data distribution interval corresponding to the expected action state weight to obtain candidate dimension data matching the expected action state weight;

[0021] At least one group of continuous steady-state data is screened out from the candidate dimensional data that matches the expected action state weight, and a mean operation is performed on the screened out at least one group of continuous steady-state data to obtain a target facial expression quantization value corresponding to the expected action state weight; wherein the target facial expression quantization value is a first facial expression quantization value that matches the reference facial expression feature data, or the target facial expression quantization value is a second facial expression quantization value that matches the actual facial expression feature data; the total number of data frames involved in each group of continuous steady-state data is greater than a preset frame number threshold, and the absolute value of the change between two adjacent frames of data in each group of continuous steady-state data is less than the same change threshold.

[0022] In an optional implementation, the step of detecting whether the facial expression difference satisfies a difference constraint condition comprises:

[0023] Comparing the absolute value of the facial expression difference with a preset difference threshold;

[0024] When the absolute value of the facial expression difference is greater than or equal to the preset difference threshold, determining that the facial expression difference does not satisfy the difference constraint condition;

[0025] When the absolute value of the facial expression difference is less than the preset difference threshold, it is determined that the facial expression difference satisfies the difference constraint condition.

[0026] In an optional embodiment, the method further comprises:

[0027] Acquire multiple expected action state weights for the target facial action, and determine the actual action frame numbers of each of the multiple expected action state weights in a corresponding driving time period according to the unit action driving time and action driving frame rate of the bionic robot;

[0028] An expression reset time period of a preset number of action frames is reserved before and after the driving time period of each expected action state weight among the multiple expected action state weights to obtain the expected action instruction; wherein the actual action state weight corresponding to the expression reset time period is 0.

[0029] In an optional embodiment, the step of adjusting the maximum motor movement amplitude of the target motor involved in the target facial movement in the bionic robot to be debugged at the target facial movement comprises:

[0030] Among all target motors of the bionic robot to be debugged that are involved in the target facial action, one target motor is selected as the motor to be adjusted;

[0031] Detecting whether the facial expression difference is positive or negative;

[0032] When it is detected that the facial expression difference is a positive number, the maximum motor movement amplitude actually used when the motor to be adjusted performs the target facial movement is reduced;

[0033] When it is detected that the facial expression difference is a negative number, the maximum motor movement amplitude actually used when the motor to be adjusted performs the target facial movement is increased.

[0034] In an optional embodiment, the step of selecting a target motor as the motor to be adjusted from all target motors of the bionic robot to be adjusted that are involved in the target facial action includes:

[0035] In each polling process of all the target motors, according to the descending order of the expression influence of all the target motors, each target motor is selected in turn for a preset number of times as the motor to be adjusted.

[0036] In an optional embodiment, the method further comprises:

[0037] During the process of adjusting the motor movement amplitude of the bionic robot to be debugged related to the target facial movement, detecting in real time whether the total number of motor adjustments of the bionic robot to be debugged for the target facial movement exceeds a preset number threshold;

[0038] When it is detected that the total number of motor adjustments exceeds a preset number threshold, the maximum motor movement amplitude actually used by all target motors in the bionic robot to be debugged for the target facial movement is directly used as the expected limit movement amplitude of the corresponding target motor to achieve the target facial movement.

[0039] In a second aspect, the present application provides a robot debugging device, comprising a processor and a memory, wherein the memory stores a computer program that can be executed by the processor, and the processor can execute the computer program to implement the bionic robot facial movement debugging method described in any one of the aforementioned embodiments.

[0040] In a third aspect, the present application provides a readable storage medium having a computer program stored thereon. When the computer program is executed by a computer device, the bionic robot facial action debugging method described in any one of the aforementioned embodiments is implemented.

[0041] In this case, the beneficial effects of the embodiments of the present application may include the following:

[0042] The present application obtains reference facial expression feature data of a reference bionic robot executing a target facial action according to an expected action instruction, and obtains actual facial expression feature data of the bionic robot to be debugged executing the target facial action according to the expected action instruction, and then calculates the difference in facial expression that matches the target facial action between the bionic robot to be debugged and the reference bionic robot based on the reference facial expression feature data and the actual facial expression feature data, and then detects whether the facial expression difference satisfies a difference constraint condition, and if the difference constraint condition is not satisfied, adjusts the maximum motor movement amplitude used by the target motor involved in the target facial action in the bionic robot to be debugged when executing the target facial action, and then jumps to the step of obtaining the actual facial expression feature data of the bionic robot to be debugged executing the target facial action according to the expected action instruction and continues to execute until the difference constraint condition is satisfied. When the difference of facial expressions meets the difference constraint condition, the maximum motor movement amplitude actually used by all target motors involved in the target facial action in the bionic robot to be debugged for the target facial action is directly used as the expected limit movement amplitude of the corresponding target motor to achieve the target facial action, so as to use the manually fine-tuned reference bionic robot as a reference to automatically adjust the motor movement amplitude of the bionic robot to be debugged, so as to ensure that the reference bionic robot and the adjusted bionic robot to be debugged can directly show the same or similar facial expression effects when performing the same facial action, so as to effectively reduce the manual adjustment workload and the deviation of the robot's facial action performance during the mass production of the robot, and improve the robot adjustment efficiency and the consistency of the robot's facial action performance, so as to meet the timeliness requirements and facial action performance consistency requirements during the mass production of the robot.

[0043] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, preferred embodiments are specifically cited below and described in detail with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0045] Figure 1 A schematic diagram of the composition of a robot debugging device provided in an embodiment of the present application;

[0046] Figure 2 One of the flow charts of the bionic robot facial action debugging method provided in the embodiment of the present application;

[0047] Figure 3 for Figure 2A schematic flow chart of the sub-steps included in step S230;

[0048] Figure 4 for Figure 2 A schematic flow chart of the sub-steps included in step S250;

[0049] Figure 5 A second flow chart of the bionic robot facial action debugging method provided in an embodiment of the present application;

[0050] Figure 6 The third flowchart of the bionic robot facial movement debugging method provided in the embodiment of the present application.

[0051] Icons: 10 - robot debugging equipment; 11 - memory; 12 - processor; 13 - communication unit. DETAILED DESCRIPTION

[0052] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. The components of the embodiments of the present application described and shown in the drawings here can be arranged and designed in various different configurations.

[0053] Therefore, the following detailed description of the embodiments of the present application provided in the accompanying drawings is not intended to limit the scope of the present application for which protection is sought, but merely represents selected embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application.

[0054] It should be noted that similar reference numerals and letters denote similar items in the following drawings, and therefore, once an item is defined in one drawing, further definition and explanation thereof is not required in subsequent drawings.

[0055] In the description of the present application, it should be understood that the terms "center", "up", "down", "left", "right", "vertical", "horizontal", "inside", "outside", etc. indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, or are the orientations or positional relationships in which the product of the application is conventionally placed when in use, or are the orientations or positional relationships conventionally understood by those skilled in the art. They are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as a limitation on the present application.

[0056] In the description of this application, it should also be noted that, unless otherwise clearly specified and limited, the terms "set", "install", "connect", and "connect" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two elements. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood according to specific circumstances.

[0057] In addition, in the description of the present application, it is understood that the relational terms such as the term "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply that there is any such actual relationship or order between these entities or operations. Moreover, the term "include", "comprise" or any other variant thereof is intended to cover non-exclusive inclusion, so that the process, method, article or equipment including a series of elements includes not only those elements, but also includes other elements that are not clearly listed, or also includes elements inherent to such process, method, article or equipment. In the absence of more restrictions, the elements defined by the sentence "comprise one..." do not exclude the existence of other identical elements in the process, method, article or equipment including the elements. For those of ordinary skill in the art, the specific meanings of the above terms in the present application can be understood by specific circumstances.

[0058] In conjunction with the accompanying drawings, some embodiments of the present application are described in detail below. In the absence of conflict, the following embodiments and features in the embodiments can be combined with each other.

[0059] Please refer to Figure 1 , Figure 1It is a schematic diagram of the composition of the robot debugging device 10 provided in the embodiment of the present application. In the embodiment of the present application, the robot debugging device 10 can be respectively connected to at least one bionic robot to be debugged and a manually fine-tuned reference bionic robot, and is used to drive the at least one bionic robot to be debugged and the reference bionic robot to perform any facial action with the same action state, and take the facial action performance of the reference bionic robot as a reference, according to the facial action performance deviation between the at least one bionic robot to be debugged and the reference bionic robot, the head motor of the bionic robot to be debugged involving the facial action is automatically adjusted to ensure that the reference bionic robot and the bionic robot to be debugged after the final adjustment can show the same or similar facial expression effect for the same facial action, thereby effectively reducing the manual adjustment workload and the deviation of the robot's facial action performance during the robot mass production process, and improving the robot adjustment efficiency and the robot's facial action performance consistency, to meet the timeliness requirements and facial action performance consistency requirements during the robot mass production. Wherein, the robot debugging device 10 can be a computer device independent of the bionic robot, and the computer device can be, but is not limited to, a personal computer, a cloud server, a laptop computer, a tablet computer, etc.

[0060] In an embodiment of the present application, the reference bionic robot and the at least one bionic robot to be debugged belong to the same bionic robot; the executable facial actions of the reference bionic robot and all bionic robots to be debugged can be 52 single-dimensional facial actions involved in the BlendShape (BS for short) expression animation, and each single-dimensional facial action can be characterized by an action state weight with a numerical interval of [0,1] to characterize its degree of exaggeration, wherein when the action state weight of a single-dimensional facial action is "0", the actual facial action amplitude of the single-dimensional facial action is 0, and the corresponding bionic robot returns to a normal state of not executing the single-dimensional facial action, and when the action state weight of a single-dimensional facial action is "1", the actual facial action amplitude of the single-dimensional facial action reaches the extreme action effect. When any bionic robot performs a one-dimensional facial action according to a certain action state weight, all head motors involved in the one-dimensional facial action in the bionic robot need to move according to a theoretical action amplitude that matches the action state weight and the one-dimensional facial action; wherein the theoretical action amplitude of each head motor performing the one-dimensional facial action is obtained by multiplying the action state weight by the limit action amplitude of the corresponding head motor to realize the one-dimensional facial action.

[0061] In this embodiment, for any one-dimensional facial movement, the number of head motors involved in the one-dimensional facial movement is at least one, and the head motor components involved in different one-dimensional facial movements may partially overlap or may not overlap at all; when the same head motor is shared by multiple one-dimensional facial movements, the limit movement amplitudes used by the head motor when realizing the multiple one-dimensional facial movements are usually different from each other, and the limit movement amplitude corresponding to the head motor at any one-dimensional facial movement is less than or equal to the upper limit value of the amplitude of the effective movement amplitude range of the head motor (for example, one-dimensional facial movement A and one-dimensional facial movement B both involve head motor c, and the effective movement amplitude range of head motor c is [0, 110], wherein the limit movement amplitude used by head motor c when realizing one-dimensional facial movement A is 100, and the limit movement amplitude used by head motor c when realizing one-dimensional facial movement B is 20).

[0062] When a head motor involves multiple single-dimensional facial movements to be performed simultaneously, it is necessary to first calculate the theoretical movement amplitude of the head motor to perform each single-dimensional facial movement separately, and then perform motor movement superposition according to the motor movement direction and theoretical movement amplitude corresponding to the head motor at the multiple single-dimensional facial movements, calculate the theoretical superposition movement amplitude of the head motor to realize the multiple single-dimensional facial movements at the same time, and then determine the effective superposition movement amplitude required for the head motor to realize the multiple single-dimensional facial movements at the same time by comparing the theoretical superposition movement amplitude with the effective movement amplitude range of the head motor. Among them, when the corresponding theoretical superposition movement amplitude is within the effective movement amplitude range of the head motor, the effective superposition movement amplitude of the head motor is the corresponding theoretical superposition movement amplitude; when the corresponding theoretical superposition movement amplitude exceeds the effective movement amplitude range of the head motor, the effective superposition movement amplitude of the head motor is the amplitude range boundary value of the corresponding effective movement amplitude range close to the theoretical superposition movement amplitude.

[0063] In the embodiment of the present application, the robot debugging device 10 may include a memory 11, a processor 12, and a communication unit 13. The memory 11, the processor 12, and the communication unit 13 are electrically connected to each other directly or indirectly to achieve data transmission or interaction. For example, the memory 11, the processor 12, and the communication unit 13 may be electrically connected to each other via one or more communication buses or signal lines.

[0064] In the embodiment of the present application, the memory 11 is used to store a computer program, and the processor 12 can execute the computer program accordingly after receiving an execution instruction.

[0065] In the embodiment of the present application, the communication unit 13 is used to establish a communication connection between the robot debugging device 10 and other electronic devices through a network, and to send and receive data through the network, wherein the network includes a wired communication network and a wireless communication network. For example, the robot debugging device 10 can be connected to a facial motion capture device through the communication unit 13 to obtain the facial motion performance status (i.e., facial expression feature data) of any bionic robot performing a certain facial motion through the facial motion capture device, wherein the facial motion performance status can be expressed using BlendShape expression data.

[0066] In an embodiment of the present application, the robot debugging device 10 may pre-store a specific computer program related to the bionic robot facial movement debugging function in the memory 11, and drive the processor 12 to execute the specific computer program stored in the memory 11, so as to automatically adjust the motor movement amplitude of the bionic robot to be debugged with the manually fine-tuned reference bionic robot as a reference object, so as to ensure that the reference bionic robot and the adjusted bionic robot to be debugged can directly show the same or similar facial expression effects when performing the same facial movement, thereby effectively reducing the manual adjustment workload and the deviation of the robot's facial movement performance during the mass production of the robot, and improving the robot adjustment efficiency and the consistency of the robot's facial movement performance, so as to meet the timeliness requirements and facial movement performance consistency requirements during the mass production of the robot.

[0067] Understandably, Figure 1 The block diagram shown is only a schematic diagram of a composition of the robot debugging device 10. The robot debugging device 10 may also include Figure 1 More or fewer components as shown, or with Figure 1 Different configurations shown. Figure 1 Each component shown in the figure can be implemented by hardware, software or a combination thereof.

[0068] In the present application, in order to ensure that the robot debugging device 10 can use the manually fine-tuned reference bionic robot as a reference object to automatically adjust the motor movement amplitude of the bionic robot to be debugged, so as to meet the timeliness requirements and facial movement performance consistency requirements during robot mass production, the embodiment of the present application provides a bionic robot facial movement debugging method to achieve the above purpose. The bionic robot facial movement debugging method provided by the present application is described in detail below.

[0069] Please refer to Figure 2 , Figure 2 This is one of the flow charts of the bionic robot facial action debugging method provided in the embodiment of the present application. In the embodiment of the present application, Figure 2The bionic robot facial action debugging method shown may include steps S210 to S260.

[0070] Step S210, obtaining reference facial expression feature data of a reference bionic robot performing a target facial action according to a desired action instruction.

[0071] In this embodiment, the expected action instruction is used to instruct the corresponding bionic robot to perform a target facial action, wherein the expected action instruction includes a plurality of expected action state weights of the target facial action (for example, 3 expected action state weights of 0.3, 0.6 and 0.9), and the driving time periods corresponding to the plurality of expected action state weights, wherein the plurality of expected action state weights are different from each other and are all greater than 0; the target facial action can be any one of the 52 single-dimensional facial actions involved in the BlendShape expression animation. In one implementation of this embodiment, the driving time periods of the plurality of expected action state weights in the expected action instruction are arranged in ascending order according to the weight values ​​of the plurality of expected action state weights, so as to ensure that when the same bionic robot performs target facial actions with different expected action state weights, there will be no robot hardware damage caused by a short-term drastic change in the action amplitude.

[0072] After the robot debugging device 10 determines the matching expected action instruction for the target facial action, it can send the expected action instruction to the manually fine-tuned reference bionic robot, so that the reference bionic robot calls all head motors involved in the target facial action to execute the expected action instruction using the fine-tuned limit action amplitude that matches the target facial action (i.e., the limit action amplitude used by the corresponding head motor when the target facial action is achieved under manual fine-tuning) to achieve the target facial action execution effect in different expected action states. While the reference bionic robot is executing the expected action instruction, the robot debugging device 10 can capture the facial action performance of the reference bionic robot in real time through a facial action capture device, and obtain reference facial expression feature data of the reference bionic robot executing the expected action instruction.

[0073] It can be understood that in order to avoid any bionic robot being interfered by the robot hardware position of the realized action state when executing the target facial action of different expected action states, an expression reset time period can be reserved before and after the driving time period of each of the multiple expected action state weights in the expected action instruction. The actual action state weight of the target facial action in the expression reset time period is 0, so as to ensure that the corresponding bionic robot is in a normal state before and after executing the target facial action of any expected action state, thereby improving the data reliability of the corresponding facial expression feature data.

[0074] Step S220, obtaining actual facial expression feature data of the bionic robot to be debugged performing the target facial action according to the expected action instruction.

[0075] In this embodiment, after determining the matching expected action instruction for the target facial action, the robot debugging device 10 can send the expected action instruction to any mass-produced bionic robot to be debugged, so that the bionic robot to be debugged drives all head motors (i.e., target motors) involved in the target facial action to execute the expected action instruction using the maximum motor action amplitude configured for the target facial action as the current limit action amplitude, thereby achieving the target facial action execution effect in different expected action states. During the process of the bionic robot to be debugged executing the expected action instruction, the robot debugging device 10 can capture the facial action performance of the bionic robot to be debugged in real time through a facial action capture device, and obtain the actual facial expression feature data of the bionic robot to be debugged executing the expected action instruction. Among them, the facial action capture devices used by different bionic robots are consistent with the relative posture relationship of the corresponding bionic robot face; for all target motors involved in the target facial action in any bionic robot to be debugged, the limit action amplitude (i.e., the maximum motor action amplitude) actually used by each target motor when executing the expected action instruction for the first time is consistent with the fine-tuning limit action amplitude of the target motor to achieve the target facial action at the reference bionic robot.

[0076] Step S230, calculating the difference in facial expression matching the target facial action between the bionic robot to be debugged and the reference bionic robot according to the reference facial expression feature data and the actual facial expression feature data.

[0077] In an embodiment of the present application, the robot debugging device 10 can calculate the difference in facial expression of the bionic robot to be debugged relative to the reference bionic robot at the target facial action execution level based on the actual facial expression feature data of the bionic robot to be debugged, by taking the reference facial expression feature data of the reference bionic robot as a reference, so as to characterize the deviation in facial action performance between the bionic robot to be debugged and the reference bionic robot regarding the target facial action through the facial expression difference.

[0078] Optionally, see Figure 3 , Figure 3 yes Figure 2 In the embodiment of the present application, the step S230 may include sub-steps S231 to S234 to accurately measure the difference in facial expression between the bionic robot to be debugged and the reference bionic robot at the target facial action execution level.

[0079] Sub-step S231, based on the reference facial expression feature data, calculate multiple first facial expression quantization values ​​of the reference bionic robot that match the target facial action, wherein each first facial expression quantization value corresponds to a desired action state weight.

[0080] In this embodiment, when the facial expression feature data collected by the facial motion capture device belongs to 52-dimensional BlendShape expression data, each dimension of expression data corresponds to a single-dimensional facial action, and the sub-step S231 may include:

[0081] Extracting target dimension data whose corresponding dimension matches the target facial action from the reference facial expression feature data;

[0082] For each expected action state weight, the target dimension data is screened according to a preset data distribution interval corresponding to the expected action state weight to obtain candidate dimension data matching the expected action state weight;

[0083] At least one group of continuous steady-state data is selected from the candidate dimension data that matches the expected action state weight, and a mean operation is performed on the selected at least one group of continuous steady-state data to obtain a first facial expression quantization value corresponding to the expected action state weight.

[0084] In this process, different expected action state weights have different preset data distribution intervals corresponding to the target facial action at the facial expression feature data; the total number of frames of data of at least one group of continuous steady-state data corresponding to the same expected action state weight is greater than the preset frame number threshold, and the absolute value of the change between two adjacent frames of data in the at least one group of continuous steady-state data is less than the same change amount threshold; wherein the change amount threshold is greater than 0, and at the same time, because the action driving frame rate of the bionic robot is fixed, the total number of data frames can be used to characterize the steady-state duration of the corresponding continuous steady-state data, and the preset frame number threshold can be used to characterize the preset duration threshold, and the above-mentioned continuous steady-state data screening operation is used to eliminate error data caused by robot hardware action delay; in the continuous steady-state data screening process for any expected action state weight, the change amount threshold can be set according to a smaller value to screen the continuous steady-state data, and then when any group of continuous steady-state data is not screened out, the change amount threshold is appropriately increased to screen the continuous steady-state data again until at least one group of continuous steady-state data is screened out.

[0085] Sub-step S232, based on the actual facial expression feature data, calculate multiple second facial expression quantization values ​​that match the target facial action of the bionic robot to be debugged, wherein each second facial expression quantization value corresponds to a desired action state weight.

[0086] In this embodiment, when the facial expression feature data collected by the facial motion capture device belongs to 52-dimensional BlendShape expression data, each dimension of expression data corresponds to a single-dimensional facial action, and the sub-step S232 may include:

[0087] Extracting target dimension data whose corresponding dimension matches the target facial action from the actual facial expression feature data;

[0088] For each expected action state weight, the target dimension data is screened according to a preset data distribution interval corresponding to the expected action state weight to obtain candidate dimension data matching the expected action state weight;

[0089] At least one group of continuous steady-state data is selected from the candidate dimension data that matches the expected action state weight, and a mean operation is performed on the selected at least one group of continuous steady-state data to obtain a second facial expression quantization value corresponding to the expected action state weight.

[0090] In this process, different expected action state weights have different preset data distribution intervals corresponding to the target facial action at the facial expression feature data; the total number of data frames of at least one group of continuous steady-state data corresponding to the same expected action state weight is greater than the preset frame number threshold, and the absolute value of the change between two adjacent frames of data in the at least one group of continuous steady-state data is less than the same change threshold.

[0091] Sub-step S233, for each expected action state weight, calculate the actual quantized difference between the second facial expression quantized value and the first facial expression quantized value corresponding to the expected action state weight.

[0092] In this embodiment, for each expected action state weight, the actual quantization difference matching the expected action state weight can be obtained by subtracting the corresponding first facial expression quantization value from the second facial expression quantization value corresponding to the expected action state weight.

[0093] Sub-step S234, performing a weighted sum operation on the actual quantized differences of the weights of the multiple desired action states to obtain the difference degree of facial expression matching the target facial action.

[0094] Therefore, the present application can accurately measure the difference in facial expression of the bionic robot to be debugged relative to the reference bionic robot at the target facial action execution level by executing the above sub-steps S231 to S234.

[0095] Step S240, detecting whether the difference of facial expressions satisfies the difference constraint condition.

[0096] In this embodiment, the difference constraint condition is used to characterize the distribution of facial expression differences when the bionic robot to be debugged and the reference bionic robot show the same or similar facial expression effects during the execution of the same facial action. When the robot debugging device 10 determines the difference in facial expression of a bionic robot to be debugged relative to the reference bionic robot according to the expected action instruction, the facial expression difference will be matched with the difference constraint condition to determine whether the corresponding bionic robot to be debugged currently needs to automatically adjust the motor action amplitude.

[0097] Among them, when it is detected that the facial expression difference satisfies the difference constraint condition, it means that the facial expression effects displayed by the bionic robot to be debugged and the reference bionic robot during the execution of the target facial action are already very close, and the bionic robot to be debugged currently does not need to perform automatic adjustment of the motor movement amplitude, and the robot debugging device 10 will execute step S260 accordingly; when it is detected that the facial expression difference does not satisfy the difference constraint condition, it means that there is still an obvious deviation in the facial expression effects displayed by the bionic robot to be debugged and the reference bionic robot during the execution of the target facial action, and the bionic robot to be debugged currently needs to perform automatic adjustment of the motor movement amplitude, and the robot debugging device 10 will execute step S250 accordingly.

[0098] In an implementation of this embodiment, step S240 may include:

[0099] Comparing the absolute value of the facial expression difference with a preset difference threshold;

[0100] When the absolute value of the facial expression difference is greater than or equal to the preset difference threshold, determining that the facial expression difference does not satisfy the difference constraint condition;

[0101] When the absolute value of the facial expression difference is less than the preset difference threshold, it is determined that the facial expression difference satisfies the difference constraint condition.

[0102] The preset difference threshold is a positive number, and its value can be flexibly configured according to the debugging accuracy requirements of the robot debugger. The higher the debugging accuracy requirements, the closer the preset difference threshold is to 0.

[0103] Step S250, adjusting the maximum motor movement amplitude of the target motor involved in the target facial movement in the bionic robot to be debugged at the target facial movement.

[0104] In this embodiment, when it is determined that the bionic robot to be debugged currently needs to automatically adjust the motor movement amplitude, the robot debugging device 10 will select a target motor from all target motors involved in the target facial action in the bionic robot to be debugged as the motor to be adjusted, and then adjust the maximum motor movement amplitude (i.e., the current limit movement amplitude) currently actually used by the motor to be adjusted for the target facial action to complete a motor movement amplitude adjustment operation related to the target facial action of the bionic robot to be debugged, and then drive the adjusted bionic robot to be debugged to re-execute the target facial action according to the expected action instruction. At this time, the robot debugging device 10 will jump to the above-mentioned step S220 to continue execution until it is detected that the corresponding facial expression difference satisfies the difference constraint condition.

[0105] Optionally, see Figure 4 , Figure 4 yes Figure 2 In the embodiment of the present application, the step S250 may include sub-steps S251 to S254 to effectively reduce the deviation of facial expression effects exhibited by the bionic robot to be debugged and the reference bionic robot during the execution of the target facial action.

[0106] Sub-step S251, selecting a target motor from all target motors involved in the target facial action of the bionic robot to be debugged as the motor to be adjusted.

[0107] In this embodiment, when the number of target motors involved in the target facial action of the bionic robot to be debugged is 1, a single target motor involved in the target facial action of the bionic robot to be debugged can be directly used as the motor to be adjusted; when the number of target motors involved in the target facial action of the bionic robot to be debugged is multiple, one target motor can be selected from the multiple target motors as the motor to be adjusted according to a specific strategy (for example, cyclically using the multiple target motors in a specific order as the motors to be adjusted in sequence) or randomly.

[0108] In one implementation of the present embodiment, when a certain one-dimensional facial movement needs to rely on the cooperation of multiple head motors to be realized, the multiple head motors can be sorted according to their respective installation positions, motor models and other factors to obtain a descending result of the expression influence of the multiple head motors on the one-dimensional facial movement, wherein the head motor that is closer to the front in the descending result of the expression influence has a stronger influence on the facial expression of the one-dimensional facial movement.

[0109] On this basis, in order to improve the facial movement amplitude adjustment efficiency of the bionic robot to be debugged, when the number of target motors involved in the target facial movement of the bionic robot to be debugged is multiple, the robot debugging device 10 can perform at least one polling for all target motors involved in the target facial movement, and in each polling process, according to the expression influence of all target motors in descending order, select each target motor as the motor to be adjusted for a preset number of times in sequence. For example, when all target motors involved in a certain target facial movement include motor G1, motor G2 and motor G3, wherein the expression influence of these three target motors in descending order is "motor G3->motor G1->motor G2", assuming that the preset number of selections of these three target motors under the target facial movement is 3, in a single polling process, motor G3 needs to be used as the motor to be adjusted for 3 consecutive times before motor G1 can be used as the motor to be adjusted for 3 consecutive times, and then motor G2 can be used as the motor to be adjusted for 3 consecutive times, thereby completing one polling operation.

[0110] Sub-step S252, detecting whether the facial expression difference is positive or negative.

[0111] Sub-step S253, when it is detected that the facial expression difference is a positive number, the maximum motor movement amplitude actually used when the motor to be adjusted performs amplitude reduction processing when performing the target facial movement.

[0112] In this embodiment, when it is detected that the facial expression difference of the bionic robot to be debugged regarding the target facial action is a positive number, the facial movement amplitude of the bionic robot to be debugged for the target facial action is larger than that of the reference bionic robot. At this time, it is necessary to reduce the maximum motor movement amplitude (i.e., the current limit movement amplitude) currently actually used by the motor to be adjusted under the target facial action, so that the subsequent facial movement amplitude of the bionic robot to be debugged for the target facial action is as close as possible to that of the reference bionic robot.

[0113] In this embodiment, the adjustment size of the single motor movement amplitude of the motor to be adjusted for the target facial movement can be obtained by multiplying a preset adjustment amplitude coefficient (for example, 0.05) with the fine-tuning limit movement amplitude of the motor to be adjusted for the target facial movement at the reference bionic robot. Among them, each single motor movement amplitude adjustment operation involved in the same polling operation can be implemented using the same preset adjustment amplitude coefficient, and the preset adjustment amplitude coefficients used by different polling operations can be partially the same or different from each other. In one implementation of this embodiment, the preset adjustment amplitude coefficients used by two adjacent polling operations each change in a decreasing trend.

[0114] Sub-step S254, when it is detected that the facial expression difference is a negative number, the maximum motor movement amplitude actually used when the motor to be adjusted performs the target facial movement is increased.

[0115] In this embodiment, when it is detected that the facial expression difference of the bionic robot to be debugged regarding the target facial action is negative, the facial movement amplitude of the bionic robot to be debugged for the target facial action is smaller than that of the reference bionic robot. At this time, it is necessary to increase the maximum motor movement amplitude (i.e., the current limit movement amplitude) actually used by the motor to be adjusted under the target facial action, so that the subsequent facial movement amplitude of the bionic robot to be debugged for the target facial action is as close as possible to that of the reference bionic robot.

[0116] Therefore, the present application can effectively reduce the deviation of facial expression effects displayed by the bionic robot to be debugged and the reference bionic robot during the execution of the target facial action by executing the above sub-steps S251 to S254.

[0117] Step S260, taking the maximum motor motion amplitude actually used by all target motors in the bionic robot to be debugged for the target facial motion as the expected limit motion amplitude of the corresponding target motor to achieve the target facial motion.

[0118] In this embodiment, when it is detected that the difference degree of facial expression of the bionic robot to be debugged with respect to the target facial action currently satisfies the difference degree constraint condition, it indicates that the maximum motor movement amplitude (i.e., the current limit movement amplitude) actually used by all target motors involved in the target facial action in the bionic robot to be debugged under the target facial action can ensure that the reference bionic robot and the bionic robot to be debugged show the same or similar facial expression effect during the execution of the target facial action. At this time, the maximum motor movement amplitude actually used by all target motors for the target facial action can be used as the expected limit movement amplitude of the corresponding target motor for the target facial action that can meet the requirement of facial action performance consistency, so as to complete the facial action performance debugging operation of the bionic robot to be debugged and the reference bionic robot for the target facial action.

[0119] Therefore, the present application can execute the above steps S210 to S2560, use the manually fine-tuned reference bionic robot as a reference, and automatically adjust the motor movement amplitude of the bionic robot to be debugged, so as to ensure that the reference bionic robot and the adjusted bionic robot to be debugged can directly show the same or similar facial expression effects when performing the same facial movements, thereby effectively reducing the manual adjustment workload and the deviation of the robot's facial movement performance during the mass production of the robot, and improving the robot adjustment efficiency and the consistency of the robot's facial movement performance, so as to meet the timeliness requirements and facial movement performance consistency requirements during the mass production of the robot.

[0120] Optionally, see Figure 5 , Figure 5 FIG. 2 is a flow chart of the method for debugging facial movements of a bionic robot provided in the embodiment of the present application. Figure 2 Compared with the bionic robot facial action debugging method shown in the figure, Figure 5 The bionic robot facial motion debugging method shown may further include steps S270 to S280 to effectively avoid endlessly adjusting the motor motion amplitude of any bionic robot to be debugged, so as to ensure the timeliness of robot mass production.

[0121] Step S270, during the process of adjusting the motor movement amplitude related to the target facial movement of the bionic robot to be debugged, real-time detection is performed to determine whether the total number of motor adjustments of the bionic robot to be debugged for the target facial movement exceeds a preset number threshold.

[0122] In this embodiment, different one-dimensional facial movements correspond to different preset number thresholds; during the process of adjusting the motor movement amplitude of the bionic robot to be debugged for the target facial movement, the robot debugging device 10 will detect in real time whether the total number of motor adjustments of the bionic robot to be debugged for the target facial movement exceeds the preset number threshold corresponding to the target facial movement, to determine whether it is necessary to continue the motor movement amplitude adjustment operation for the target facial movement. Among them, when the total number of motor adjustments for the target facial action does not exceed the preset number threshold corresponding to the target facial action, it indicates that it is necessary to continue to adjust the motor movement amplitude for the target facial action, and the robot debugging device 10 will continue to execute the above steps S220 to S260; when the total number of motor adjustments for the target facial action exceeds the preset number threshold corresponding to the target facial action, it indicates that it is not necessary to continue to adjust the motor movement amplitude for the target facial action, even if the current facial expression difference of the bionic robot to be debugged regarding the target facial action does not meet the difference constraint condition, the robot debugging device 10 will suspend the execution of the above steps S220 to S260 and execute step S280 to avoid endlessly adjusting the motor movement amplitude of the bionic robot to be debugged, thereby effectively ensuring the timeliness of robot mass production.

[0123] In this process, the preset number thresholds corresponding to different unidimensional facial movements can be flexibly configured by the robot debugging personnel according to the timeliness requirements of robot mass production. In one implementation of this embodiment, for any unidimensional facial movement, the preset number threshold of the unidimensional facial movement can be obtained by multiplying the number of head motors corresponding to the unidimensional facial movement, the preset number of selections, and the preset number of polling. For example, when the number of head motors involved in a target facial movement is 3, the preset number of selections of the three head motors under the target facial movement is 3, and the preset number of pollings of the three head motors is 5, then the preset number threshold corresponding to the target facial movement is 3*3*5=45.

[0124] Step S280, when it is detected that the total number of motor adjustments exceeds the preset number threshold, the maximum motor movement amplitude actually used by all target motors in the bionic robot to be debugged for the target facial movement is directly used as the expected limit movement amplitude of the corresponding target motor to achieve the target facial movement.

[0125] In this embodiment, when it is detected that the total number of motor adjustments of the bionic robot to be debugged for the target facial action exceeds the preset number threshold corresponding to the target facial action, the maximum motor movement amplitudes (i.e., the current limit movement amplitudes) currently actually used by all target motors involved in the target facial action in the bionic robot to be debugged under the target facial action can be used as the expected limit movement amplitudes for achieving the target facial action, so as to complete the facial action performance debugging operation of the bionic robot to be debugged and the reference bionic robot for the target facial action.

[0126] Therefore, the present application can effectively avoid endless and unnecessary motor motion amplitude adjustment operations in the automatic adjustment of the motor motion amplitude of the bionic robot to be debugged by executing the above steps S210 to S280, so as to ensure the timeliness of robot mass production.

[0127] Optionally, see Figure 6 , Figure 6 This is the third flow chart of the bionic robot facial action debugging method provided in the embodiment of the present application. Figure 2 or Figure 5 Compared with the bionic robot facial action debugging method shown in the figure, Figure 6 The bionic robot facial action debugging method shown may also include steps S290 and S2100, so as to avoid the corresponding bionic robot being disturbed by the robot hardware position of the realized action state in the process of driving any bionic robot to perform target facial actions of different expected action states, thereby improving the data reliability of the corresponding facial expression feature data.

[0128] Step S290, obtaining multiple expected action state weights for the target facial action, and determining the actual action frame numbers of each of the multiple expected action state weights within the corresponding driving time period according to the unit action driving time and action driving frame rate of the bionic robot.

[0129] In this embodiment, the actual number of action frames of each expected action state weight in the corresponding driving time period is obtained by multiplying the unit action driving time and the action driving frame rate. For example, the unit action driving time of the bionic robot is 2 seconds, and the action driving frame rate of the bionic robot is 30FPS, then the actual number of action frames of each expected action state weight in the corresponding driving time period is 2*30=60, and the effective duration of the driving time period of each expected action state weight is 2 seconds. In one implementation of the present embodiment, the driving time periods of the various expected action state weights are arranged in ascending order according to the weight values ​​of the various expected action state weights.

[0130] Step S2100, reserving an expression reset time period of a preset number of action frames before and after a driving time period of each of a plurality of expected action state weights, to obtain an expected action instruction.

[0131] In this embodiment, the weight of the actual action state of the target facial action in the expression reset time period is 0, so as to ensure that the corresponding bionic robot is in a normal state before and after performing any target facial action in the expected action state, so as to improve the data reliability of the corresponding facial expression feature data. In one implementation of this embodiment, the preset action frame number is consistent with the action drive frame rate, so that the effective duration of a single expression reset time period is 1 second.

[0132] It is understandable that when the reserved operation of all expression reset time periods is completed for the multiple expected action state weights, the drive signal corresponding to the target facial action is a sawtooth wave signal. At this time, the drive signal can be smoothed and filtered to obtain a target drive signal with a relatively smooth change approximating a wave-shaped curve, so as to use the target drive signal to characterize the expected action instruction, so as to ensure that when the bionic robot executes the target facial actions of different expected action state weights, there will be no robot hardware damage caused by drastic changes in the action amplitude in a short time. Among them, the aforementioned smoothing filter processing operation needs to ensure that the actual action state weight for at least a period of time in each driving time period is consistent with the corresponding expected action state weight.

[0133] Therefore, the present application can avoid the corresponding bionic robot being disturbed by the robot hardware position of the realized action state in the process of driving any bionic robot to perform target facial actions in different expected action states by executing the above steps S290 and S2100, thereby improving the data reliability of the corresponding facial expression feature data.

[0134] In addition, the embodiment of the present application also provides a readable storage medium, on which a computer program is stored, and the computer program can be used to execute a computer device (for example, a personal computer, a server, or a network device, etc.) acting as the above-mentioned robot debugging device 10 to implement any possible bionic robot facial action debugging method disclosed in the above-mentioned method embodiment. Wherein, the readable storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a disk or an optical disk, and other media that can store program codes.

[0135] The above are only various implementations of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A bionic robot facial action debugging method, characterized in that: The method comprises: Acquire reference facial expression feature data of a reference bionic robot performing a target facial action according to an expected action instruction, and acquire actual facial expression feature data of a bionic robot to be debugged performing the target facial action according to the expected action instruction; Calculating the difference degree of facial expression matching the target facial action between the bionic robot to be debugged and the reference bionic robot according to the reference facial expression feature data and the actual facial expression feature data; Detecting whether the facial expression difference satisfies a difference constraint condition; If it is detected that the facial expression difference does not satisfy the difference constraint condition, the maximum motor movement amplitude of the target motor involved in the target facial action in the bionic robot to be debugged at the target facial action is adjusted, and the step of obtaining the actual facial expression feature data of the bionic robot to be debugged performing the target facial action according to the expected action instruction is skipped to continue the execution; If it is detected that the facial expression difference satisfies the difference constraint condition, the maximum motor movement amplitude actually used by all target motors in the bionic robot to be debugged for the target facial movement is used as the expected limit movement amplitude of the corresponding target motor to achieve the target facial movement.

2. The method according to claim 1, characterized in that The expected action instruction includes a plurality of expected action state weights of the target facial action; the step of calculating the difference degree of facial expression matching the target facial action between the bionic robot to be debugged and the reference bionic robot according to the reference facial expression feature data and the actual facial expression feature data comprises: Calculating a plurality of first facial expression quantization values ​​of the reference bionic robot that match the target facial action according to the reference facial expression feature data, wherein each first facial expression quantization value corresponds to a desired action state weight; Calculating a plurality of second facial expression quantization values ​​of the bionic robot to be debugged that match the target facial action according to the actual facial expression feature data, wherein each second facial expression quantization value corresponds to a desired action state weight alone; For each expected action state weight, calculating an actual quantized difference between a second facial expression quantized value corresponding to the expected action state weight and the first facial expression quantized value; A weighted sum operation is performed on the actual quantized differences of the weights of the multiple desired action states to obtain a difference degree of facial expression matching the target facial action.

3. The method according to claim 2, characterized in that The step of calculating a plurality of target facial expression quantization values ​​matching the target facial action for any set of target facial expression feature data in the reference facial expression feature data and the actual facial expression feature data comprises: Extracting target dimension data whose corresponding dimension matches the target facial action from the target facial expression feature data; For each expected action state weight, the target dimension data is screened according to a preset data distribution interval corresponding to the expected action state weight to obtain candidate dimension data matching the expected action state weight; At least one group of continuous steady-state data is screened out from the candidate dimensional data that matches the expected action state weight, and a mean operation is performed on the screened out at least one group of continuous steady-state data to obtain a target facial expression quantization value corresponding to the expected action state weight; wherein the target facial expression quantization value is a first facial expression quantization value that matches the reference facial expression feature data, or the target facial expression quantization value is a second facial expression quantization value that matches the actual facial expression feature data; the total number of data frames involved in each group of continuous steady-state data is greater than a preset frame number threshold, and the absolute value of the change between two adjacent frames of data in each group of continuous steady-state data is less than the same change threshold.

4. The method according to claim 1, characterized in that: The step of detecting whether the facial expression difference satisfies the difference constraint condition comprises: Comparing the absolute value of the facial expression difference with a preset difference threshold; When the absolute value of the facial expression difference is greater than or equal to the preset difference threshold, determining that the facial expression difference does not satisfy the difference constraint condition; When the absolute value of the facial expression difference is less than the preset difference threshold, it is determined that the facial expression difference satisfies the difference constraint condition.

5. The method according to claim 1, characterized in that The method further comprises: Acquire multiple expected action state weights for the target facial action, and determine the actual action frame numbers of each of the multiple expected action state weights in a corresponding driving time period according to the unit action driving time and action driving frame rate of the bionic robot; An expression reset time period of a preset number of action frames is reserved before and after the driving time period of each expected action state weight among the multiple expected action state weights to obtain the expected action instruction; wherein the actual action state weight corresponding to the expression reset time period is 0.

6. The method according to any one of claims 1 to 5, characterized in that: The step of adjusting the maximum motor movement amplitude of the target motor involved in the target facial movement in the bionic robot to be debugged at the target facial movement comprises: Among all target motors of the bionic robot to be debugged that are involved in the target facial action, one target motor is selected as the motor to be adjusted; Detecting whether the facial expression difference is positive or negative; When it is detected that the facial expression difference is a positive number, the maximum motor movement amplitude actually used when the motor to be adjusted performs the target facial movement is reduced; When it is detected that the facial expression difference is a negative number, the maximum motor movement amplitude actually used when the motor to be adjusted performs the target facial movement is increased.

7. The method according to claim 6, characterized in that The step of selecting a target motor as the motor to be adjusted from all target motors involved in the target facial action of the bionic robot to be adjusted comprises: In each polling process of all the target motors, according to the descending order of the expression influence of all the target motors, each target motor is selected in turn for a preset number of times as the motor to be adjusted.

8. The method according to claim 6, characterized in that The method further comprises: During the process of adjusting the motor movement amplitude of the bionic robot to be debugged related to the target facial movement, detecting in real time whether the total number of motor adjustments of the bionic robot to be debugged for the target facial movement exceeds a preset number threshold; When it is detected that the total number of motor adjustments exceeds a preset number threshold, the maximum motor movement amplitude actually used by all target motors in the bionic robot to be debugged for the target facial movement is directly used as the expected limit movement amplitude of the corresponding target motor to achieve the target facial movement.

9. A robot debugging device, characterized in that: It comprises a processor and a memory, wherein the memory stores a computer program that can be executed by the processor, and the processor can execute the computer program to implement the bionic robot facial action debugging method described in any one of claims 1-8.

10. A readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a computer device, the bionic robot facial action debugging method described in any one of claims 1 to 8 is implemented.

Images