Hearing detection method, robot, equipment and storage medium

Abstract

The invention discloses a hearing detection method, a robot, equipment and a storage medium, and the method comprises the steps: obtaining the detection condition information of hearing detection, and outputting the test audio information corresponding to the detection condition information; obtaining feedback audio information, and performing text conversion on the feedback audio information to obtain feedback text information; in response to a confirmation operation for the feedback text information, obtaining confirmed feedback text information; and determining a hearing detection result of the detection object based on standard text information corresponding to the test audio information and the confirmed feedback text information. Therefore, the hearing detection result of the detected object can be determined through the feedback text information which truly reflects the hearing level of the detected object, so that the accuracy of the hearing test is improved.

Description

Technical Field

[0001] The present application relates to the field of robotics, and in particular to a hearing detection method, robot, device and storage medium. Background Art

[0002] Hearing testing is a routine test performed every day in otolaryngology clinics, which is of great significance for assessing individual hearing conditions and guiding treatment. Existing hearing testing methods mostly rely on manual operations, with large errors, and repeated testing often takes up a lot of energy and time of testers. Summary of the invention

[0003] In view of this, the embodiments of the present application at least provide a hearing detection method, a robot, a device and a storage medium.

[0004] The technical solution of the embodiment of the present application is implemented as follows:

[0005] In a first aspect, an embodiment of the present application provides a hearing detection method, which is applied to a robot; the method comprises:

[0006] Acquire test condition information of the hearing test, and output test audio information corresponding to the test condition information;

[0007] Acquiring feedback audio information, and converting the feedback audio information into text to obtain feedback text information;

[0008] In response to a confirmation operation on the feedback text information, obtaining confirmed feedback text information;

[0009] Based on the standard text information corresponding to the test audio information and the confirmed feedback text information, a hearing test result of the test subject is determined.

[0010] In a second aspect, an embodiment of the present application provides a robot, the robot comprising a controller, a collection unit and a playback unit; wherein:

[0011] The controller is used to obtain the test condition information of the hearing test and control the playback unit to output the test audio information corresponding to the test condition information;

[0012] The collecting unit is used to collect feedback audio information;

[0013] The controller is also used to convert the feedback audio information into text to obtain feedback text information; in response to a confirmation operation on the feedback text information, obtain confirmed feedback text information; and determine the hearing test result of the test object based on the standard text information corresponding to the test audio information and the confirmed feedback text information.

[0014] In a third aspect, an embodiment of the present application provides a computer device, including a memory and a processor, wherein the memory stores a computer program that can be executed on the processor, and when the processor executes the program, some or all of the steps in the above method are implemented.

[0015] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon, which implements some or all of the steps in the above method when executed by a processor.

[0016] In a fifth aspect, an embodiment of the present application provides a computer program product, including a computer program or instructions, which implement some or all of the steps in the above method when executed by a processor.

[0017] In the embodiment of the present application, the robot first outputs the test audio information corresponding to the detection condition of the hearing test. In this way, the robot outputs the test audio information corresponding to the current test condition, which can not only enable the test object to hear the audio information output by the robot clearly during the test, thereby improving the accuracy of the hearing test, but also in the face of different detection conditions, compared with adjusting the detection conditions, it is easier for the robot to adjust the test audio information, thereby also improving the efficiency of the hearing test. Then the acquired feedback audio information is converted into text to obtain feedback text information, and in response to the confirmation operation for the feedback text information, the confirmed feedback text information is obtained. Finally, the hearing test result of the test object is determined by the standard text information corresponding to the test audio information and the confirmed feedback text information. In this way, after the robot performs text conversion, it can provide the test object with a review function for the feedback text information, so that the feedback text information after the robot conversion is consistent with the test audio information heard by the test object, so that the robot can determine the hearing test result of the test object through the feedback text information that truly reflects the hearing level of the test object, thereby improving the accuracy of the hearing test.

[0018] It should be understood that the above general description and the following detailed description are merely exemplary and explanatory, and are not intended to limit the technical solutions of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] The drawings herein are incorporated into the specification and constitute a part of the specification. These drawings illustrate embodiments consistent with the present application and are used together with the specification to illustrate the technical solution of the present application.

[0020] Figure 1 A schematic diagram of the implementation process of a hearing detection method provided in an embodiment of the present application Figure 1 ;

[0021] Figure 2A schematic diagram of the implementation process of a hearing detection method provided in an embodiment of the present application Figure 2 ;

[0022] Figure 3 A schematic diagram of the implementation process of a hearing detection method provided in an embodiment of the present application Figure 3 ;

[0023] Figure 4 A schematic diagram of the implementation process of a hearing detection method provided in an embodiment of the present application Figure 4 ;

[0024] Figure 5 A schematic diagram of the implementation process of a hearing detection method provided in an embodiment of the present application Figure 5 ;

[0025] Figure 6 A schematic diagram of the implementation process of a hearing detection method provided in an embodiment of the present application Figure 6 ;

[0026] Figure 7 A schematic diagram of the implementation process of a hearing detection method provided in an embodiment of the present application Figure 7 ;

[0027] Figure 8 A schematic diagram of the structure of the robot provided in the embodiment of the present application;

[0028] Fig. 9 A hardware entity diagram of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0029] In order to make the purpose, technical solutions and advantages of the present application clearer, the technical solutions of the present application are further elaborated in detail below in conjunction with the drawings and embodiments. The described embodiments should not be regarded as limiting the present application. All other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present application.

[0030] In the following description, reference is made to “some embodiments”, which describe a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0031] The terms "first / second / third" involved are merely used to distinguish similar objects and do not represent a specific ordering of the objects. It is understandable that "first / second / third" can be interchanged with a specific order or sequence where permitted so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.

[0032] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing this application and are not intended to limit this application.

[0033] In order to solve the technical problem of inaccurate hearing detection due to manual hearing detection in the related art, the present application embodiment provides a hearing detection method, which can be applied to the controller of a robot. For example, the robot can be an embodied intelligent robot. Figure 1 As shown, the hearing detection method includes steps S101 to S104:

[0034] Step S101, obtaining test condition information of a hearing test, and outputting test audio information corresponding to the test condition information.

[0035] Here, the detection condition information may represent the environment information of the hearing test and / or the distance information between the detection object and the robot. Exemplarily, the environment information of the hearing test may be the intensity of the ambient noise of the hearing test.

[0036] In an embodiment of the present application, the robot can collect environmental information of hearing detection through an audio collection component; send a sound signal to the detection object, and determine the distance information between the detection object and the robot based on the returned sound signal and the round-trip time. In some embodiments, the robot can also obtain image information of the detection object through an image acquisition unit, and process the image information through a preset distance measurement algorithm to obtain the distance information between the detection object and the robot. Exemplarily, the distance measurement algorithm can be at least one of a monocular vision distance measurement algorithm, a binocular vision distance measurement algorithm, and a time of flight method.

[0037] In the embodiment of the present application, after the robot obtains the detection condition information of the hearing test, it does not perform the hearing test after the detection condition information meets the preset detection condition; instead, it outputs the test audio information corresponding to the detection condition information. It is understandable that in some scenarios, it is difficult to make the current detection condition information meet the preset detection condition, for example: a scenario where the external noise cannot be controlled, it is difficult to improve the influence of the outside world on the detection by adjusting the position of the object due to the inconvenience of the detection object, etc. Therefore, in order to improve the convenience and accuracy of the hearing test, after obtaining the detection condition information of the hearing test, the test audio information corresponding to the detection condition information can be output.

[0038] In some embodiments, when the detection condition information includes the ambient noise intensity for hearing detection, the ambient noise intensity is positively correlated with the decibel of the test audio information, that is, the greater the ambient noise intensity, the greater the decibel of the test audio information.

[0039] In some embodiments, when the detection condition information includes distance information between the detection object and the robot, the distance information is positively correlated with the decibel of the test audio information, that is, the farther the detection object is from the robot, the louder the decibel of the test audio information.

[0040] In some embodiments, when the detection condition information includes the ambient noise intensity of the hearing test and the distance information between the detection object and the robot, the corresponding test audio information can be output in combination with the ambient noise intensity of the hearing test and the distance information between the detection object and the robot.

[0041] Step S102, obtaining feedback audio information, and converting the feedback audio information into text to obtain feedback text information.

[0042] In the embodiment of the present application, the robot can collect the feedback audio information sent by the detection object in response to the test audio information through the audio collection component. Then, the collected feedback audio information is converted into text to obtain feedback text information.

[0043] In some embodiments, the robot has pre-determined speech and language rules built in, and the feedback audio information is converted into text through the speech and language rules. In other embodiments, the robot can also convert the feedback audio information into text through a trained language model. Exemplarily, the language model can be a hidden Markov model.

[0044] Step S103: in response to a confirmation operation on the feedback text information, obtaining confirmed feedback text information.

[0045] In the embodiment of the present application, the robot can display the feedback text information through its own display or an external display device. After the detection object confirms the feedback text information after the text conversion, a confirmation operation for the feedback text information can be initiated, and then the robot can obtain the feedback text information after the detection object confirms.

[0046] It is understandable that because the test subject may have an accent, the feedback text information converted by the robot based on the feedback audio information spoken by the test subject may also contain errors. At this time, the feedback text information can be displayed to the test subject so that the test subject can review the feedback text information.

[0047] Step S104: determining the hearing test result of the test subject based on the standard text information corresponding to the test audio information and the confirmed feedback text information.

[0048] In the embodiment of the present application, the standard text information and the confirmed feedback text information can be compared, and the hearing test result of the test subject can be determined through the comparison result of the two.

[0049] In some embodiments, when the comparison result indicates that the feedback text information is consistent with the standard text information, it is determined that the hearing test of the test subject has passed; when the comparison result indicates that the feedback text information is inconsistent with the standard text information, it can be determined that the hearing test of the test subject has failed, and the hearing test result of the test subject can also be determined again through the comparison result.

[0050] In the embodiment of the present application, the robot first outputs the test audio information corresponding to the detection condition of the hearing test. In this way, the robot outputs the test audio information corresponding to the current test condition, which can not only enable the test object to hear the audio information output by the robot clearly during the test, thereby improving the accuracy of the hearing test, but also in the face of different detection conditions, compared with adjusting the detection conditions, it is easier for the robot to adjust the test audio information, thereby also improving the efficiency of the hearing test. Then the acquired feedback audio information is converted into text to obtain feedback text information, and in response to the confirmation operation for the feedback text information, the confirmed feedback text information is obtained. Finally, the hearing test result of the test object is determined by the standard text information corresponding to the test audio information and the confirmed feedback text information. In this way, after the robot performs text conversion, it can provide the test object with a review function for the feedback text information, so that the feedback text information after the robot conversion is consistent with the test audio information heard by the test object, so that the robot can determine the hearing test result of the test object through the feedback text information that truly reflects the hearing level of the test object, thereby improving the accuracy of the hearing test.

[0051] In some embodiments, the detection condition information includes the distance information between the detection object and the robot and the intensity of the environmental noise; Figure 2 As shown, the "outputting the test audio information corresponding to the detection condition information" in the above step S101 can be implemented through steps S201 to S203:

[0052] Step S201: determining a first decibel range of the test audio information based on the distance information between the detection object and the robot.

[0053] In the embodiment of the present application, the robot can determine the first decibel range of the test audio information by detecting the distance information between the object and the robot, and in the correspondence between multiple different distance information and multiple different decibel ranges.

[0054] In the embodiment of the present application, the distance information between the detection object and the robot is positively correlated with the average decibel of the first decibel range, that is, the greater the distance information between the detection object and the robot, the greater the average decibel of the first decibel range.

[0055] It can be understood that in the embodiment of the present application, the test subject does not need to move to the designated position to perform the hearing test. When the test subject determines to start the hearing test, the robot can adjust the decibel range of playing the test audio information according to the distance between the two, so that the test subject can hear the test audio information clearly without moving.

[0056] Step S202: determining first decibel information corresponding to the ambient noise intensity in the first decibel range.

[0057] Step S203: Use the first decibel information to output the test audio information.

[0058] In the embodiment of the present application, after the first decibel range corresponding to the distance information, the first decibel information needs to be determined in real time within the first decibel range according to the ambient noise intensity, wherein the first decibel information is positively correlated with the ambient noise intensity.

[0059] It is understandable that when there is no noise in the hearing test environment, any decibel output of the test audio information within the first decibel range can enable the test subject to clearly hear the test audio information. However, when there is a lot of noise in the hearing test environment, the test audio information may not be heard clearly by the test subject if a lower decibel is output within the first decibel range. Therefore, it is necessary to determine the first decibel information corresponding to the environmental noise intensity within the first decibel range.

[0060] In the embodiment of the present application, the first decibel range of the test audio information is determined by first detecting the distance information between the object and the robot, and then the test audio information is adjusted and outputted according to the intensity of the ambient noise within the first decibel range. In this way, the object does not need to be moved to a fixed position intentionally, and can receive relatively clear test audio information at any position. The decibel of the test audio information can also be adjusted within the decibel range corresponding to the position of the object according to the noise intensity of the current detection environment, thereby minimizing the impact of noise on hearing detection, thereby improving the accuracy of hearing detection.

[0061] In some embodiments, the above step S203 is implemented by step S2031 and step S2032:

[0062] Step S2031: when the environmental noise intensity is less than or equal to a first sound intensity threshold, determine the first decibel in the first decibel range as the decibel information of the test audio information.

[0063] Step S2032: When the ambient noise intensity is greater than a second sound intensity threshold, a second decibel greater than the first decibel in the first decibel range is determined as the decibel information of the test audio information.

[0064] Here, the first sound intensity threshold is less than or equal to the second sound intensity threshold.

[0065] It is understandable that when the ambient noise intensity is less than or equal to the first sound intensity threshold, it indicates that the noise in the current hearing test environment is relatively small, and test audio information with a smaller decibel can be output. In some embodiments, when the first decibel range includes a first decibel sub-range, the first decibel can be any decibel value within the first decibel sub-range.

[0066] When the ambient noise intensity is greater than the second sound intensity threshold, it indicates that the noise in the current hearing test environment is relatively loud, and a test audio information with a relatively loud decibel can be output. In some embodiments, when the first decibel range includes a second decibel sub-range, the first decibel can be any decibel value within the second decibel sub-range. The lower limit of the second decibel sub-range is greater than the upper limit of the first decibel sub-range.

[0067] In some embodiments, when the first sound intensity threshold is less than the second sound intensity threshold and the ambient noise intensity is greater than the first sound intensity threshold and less than or equal to the second sound intensity threshold, it indicates that the noise in the current hearing test environment is moderate and will not have a significant impact on the hearing test. At this time, the first preset decibel value in the first decibel range can be used to output the test audio information. Exemplarily, the first preset decibel value can be an average value of the first decibel range or a middle value of the first decibel range.

[0068] In some embodiments, Figure 3 As shown, the "outputting the test audio information corresponding to the detection condition information" in the above step S101 can be implemented through steps S301 to S303:

[0069] Step S301, when the distance information of the detection object is not within a preset distance range, controlling the distance between the robot and the detection object so that the distance information of the detection object is within the preset distance range.

[0070] In an embodiment of the present application, when the robot determines that the distance information between the detection object and itself is not within a preset distance range, the robot can shorten or extend the distance between the robot and the detection object so that the distance information of the detection object is within the preset distance range.

[0071] In some embodiments, controlling the distance between the robot and the detection object may be achieved by one of steps S3011 to S3013:

[0072] Step S3011, the robot controls its own moving parts to move toward the detection object. Wherein, in the case where the robot is an embodied intelligent robot, the moving parts of the robot may be leg parts.

[0073] It is understandable that when the detection object has difficulty in moving, or is older, or has other inconvenient conditions for moving, the robot needs to move towards the detection object so that the distance information between the detection object and the robot is within a preset distance range.

[0074] Step S3012: The robot displays first prompt information for prompting the detection object to move to the detection object. The first prompt information includes at least one of the following: voice prompt and image prompt. In some embodiments, when the robot is an embodied intelligent robot, the prompt information may also be a gesture prompt.

[0075] In some embodiments, the robot can identify obstacles in the current hearing test environment. If there are obstacles in the direction where the robot approaches the test object, prompt information can be displayed to the test object to prompt the test object to move.

[0076] In some embodiments, when the robot is difficult to move, the detection object is prompted to move toward the robot. Exemplarily, the situation where the robot is difficult to move may include but is not limited to at least one of the following: the robot is fixed to a certain position in the detection environment, the chassis and trunk of the robot cannot move at the same time because they are fixed or locked, and the chassis or trunk of the robot is prone to collision during movement due to obstacles in the environment, etc.

[0077] Step S3013: the robot controls its moving part to move to the first position, and displays second prompt information to the detection object for prompting the detection object to move to the second position, wherein the distance between the first position and the second position is within a preset distance range.

[0078] In the embodiment of the present application, the robot can determine the first position and the second position according to the distance between the robot and the detection object and the preset distance range, and then prompt the detection object to move to the second position while the robot moves to the first position. In this way, the efficiency of hearing detection can be improved by moving the robot and the detection object at the same time.

[0079] Step S302: determining second decibel information corresponding to the intensity of the ambient noise in a second decibel range corresponding to the preset distance range.

[0080] Step S303: Use the second decibel information to output the test audio information.

[0081] In an embodiment of the present application, when the ambient noise intensity is less than or equal to the first sound intensity threshold, the third decibel in the second decibel range is determined as the decibel information of the test audio information; when the ambient noise intensity is greater than the second sound intensity threshold, the fourth decibel greater than the third decibel in the second decibel range is determined as the decibel information of the test audio information.

[0082] In some embodiments, when the first sound intensity threshold is less than the second sound intensity threshold, and the ambient noise intensity is greater than the first sound intensity threshold, and less than or equal to the second sound intensity threshold, a second preset decibel value in the second decibel range may be used to output the test audio information. Exemplarily, the second preset decibel value may be an average value of the second decibel range, or a middle value of the second decibel range.

[0083] In the embodiment of the present application, the distance information between the robot and the detection object is first controlled so that the distance information of the detection object is within a preset distance range, and then the output test audio information is adjusted according to the intensity of the ambient noise within a second decibel range corresponding to the preset distance range. In this way, the flexibility of adjusting the decibel of the test audio information can be improved.

[0084] In some embodiments, the robot includes a display or a display device external to the robot; Figure 4 As shown, the above hearing detection method can also be implemented through step S401 and step S402, and the above step S301 can be implemented through step S403:

[0085] Step S401: Control the display or the display interface in the display device to display the feedback text information.

[0086] In an embodiment of the present application, after the robot obtains the feedback text information by performing text conversion on the feedback text information, it can control the robot's own display or the display interface in an external display device to display the feedback text information, so that the detection object can review the feedback text information.

[0087] It is understandable that, on the one hand, because different test subjects may have different accents, it is difficult for the robot to convert the test audio information into text without error. Therefore, it is necessary to show the feedback text information after text conversion to the test subject. On the other hand, the review process of the test subject to the feedback text information is also a part of the hearing test, because when the robot displays the feedback text information and the feedback text information has an error, and the test subject does not review the error, it can also be determined that the hearing test of the test subject is problematic. Therefore, by displaying the feedback text information, the accuracy of the hearing test can be improved.

[0088] Step S402: in response to receiving a modification operation on the feedback text information through at least one of the display interface, the audio collection component and the video collection component, determining the modified feedback text information.

[0089] In the embodiment of the present application, the detection object can modify the feedback text information through at least one of the display interface, the audio collection component and the video collection component to review the feedback text information.

[0090] In some embodiments, the display or display device may be a touch screen, so the detection object can modify the feedback text information on the display or display device, so that the robot receives the modification operation for the feedback text information and obtains the modified feedback text information. In other embodiments, the display or display device may also be connected to an input device, and the detection object modifies the feedback text information through the input device. Exemplarily, the input device may be a physical keyboard or a handwriting input device.

[0091] In some embodiments, the audio collection component of the robot can collect the modified voice instructions of the detection object for the feedback text information, and then modify the feedback text information based on the modified voice instructions to obtain the modified feedback text information. Exemplarily, the audio collection component can be a microphone.

[0092] In some embodiments, the video collection component of the robot can collect video information of the detection object for the feedback text information, and modify the feedback text information through the video information to obtain the modified feedback text information. Exemplarily, the video collection component can be a camera.

[0093] It is understandable that when the detection object is an elderly user or a user in an area where intelligent products are not popularized, these specific users cannot modify the feedback text information through the display interface, but the feedback text information can be modified through the audio collection component and the video collection component. This improves the convenience of the detection object to review the feedback text information.

[0094] Step S403, in response to the triggering operation of the detection object on the confirmation control of the display or the display device, the modified feedback text information is determined as the confirmed feedback text information, the confirmation control is presented through the display interface, or the confirmation control is directly deployed on the display or the display device.

[0095] Here, the confirmation control may be a virtual button on the display interface, that is, the confirmation control is presented through the display interface; the confirmation control may also be a physical button on a display or display device, that is, the confirmation control is deployed on the display or display device.

[0096] In the embodiment of the present application, the robot can determine the modified feedback text information as the confirmed feedback text information after the detection object triggers the confirmation control.

[0097] In the embodiment of the present application, the robot displays the feedback text information by controlling its own display or the display interface in the external display device, and then responds to the modification operation for the feedback text information to determine the modified feedback text information, and finally responds to the trigger operation of the confirmation control to determine the modified feedback text information as the confirmed feedback text information. In this way, by displaying the feedback text information, the detection object can intuitively determine whether the test audio information fed back by itself is correct, and then the feedback text information can be modified, thereby reducing the occurrence of the situation that the detection object is determined to have failed the hearing test due to errors in text conversion. At the same time, the feedback text information after the detection object's review can more accurately reflect the detection object's hearing level, thereby being able to improve the accuracy of determining the detection object's hearing test results.

[0098] In some embodiments, the feedback audio information includes a plurality of audio information to be screened; Figure 5 As shown, the above hearing detection method can also be implemented through step S501 and step S502, and the "converting the feedback audio information into text to obtain feedback text information" in the above step S102 can be implemented through step S503 and step S504:

[0099] Step S501, output guiding voice information.

[0100] Step S502: obtaining feedback voice information fed back by the detection object in response to the guiding voice information, and determining sound feature information of the detection object based on the feedback voice information.

[0101] Here, the guiding voice information may be voice information used to authenticate the identity information of the detection object. The feedback voice information may be voice information that the detection object answers based on the guiding voice information and can prove its own identity information. For example, the robot outputs "name, ID number", and the detection object answers "XX, XXXX".

[0102] In some embodiments, the guiding voice information may also be voice information for guiding the detection object to move to a specified position. For example, the robot outputs "please move to XX", and the detection object answers "ready".

[0103] In some embodiments, the guiding voice information may also be a voice information for greeting the detection object. For example, the robot outputs "Hello", and the detection object replies "Hello".

[0104] In an embodiment of the present application, after the feedback voice information of the detection object is collected, a preset sound feature extraction algorithm can be used to extract the sound feature information of the detection object in the feedback voice information. The sound feature information can be the voiceprint information of the detection object. Exemplarily, the sound feature collection algorithm can include at least one of the following: a linear prediction coding algorithm, a Mel frequency cepstral coefficient algorithm, and a Gaussian mixture model-general background model algorithm.

[0105] Step S503: based on the sound feature information of the detection object, a plurality of audio information to be screened are screened to obtain target audio information.

[0106] In the embodiment of the present application, the sound feature information of each audio information to be screened can be first extracted, and then based on the sound feature information of the detection object, the target audio information of the detection object is determined from the sound feature information of the multiple audio information to be screened. The method of extracting the sound feature information of the audio information to be screened can be the same as or different from the method of extracting the sound feature information of the detection object.

[0107] Step S504: convert the target audio information into text to obtain the feedback text information.

[0108] In the embodiment of the present application, the target audio information screened based on the sound feature information of the detection object can be converted into text to obtain feedback text information.

[0109] In the embodiment of the present application, the voice characteristic information of the test object can be determined in advance through the voice guidance before the hearing test, so that the target audio information can be screened in a timely manner according to the voice characteristic information of the test object in the hearing test process. In this way, the efficiency of determining the test object can be improved.

[0110] In some embodiments, Figure 6 As shown, the above step S104 can be implemented through step S601 and step S602:

[0111] Step S601, when the standard text information is consistent with the confirmed feedback text information, it is determined that the hearing test of the test subject has passed.

[0112] Step S602: When the standard text information is inconsistent with the confirmed feedback text information, a hearing test result of the test subject is determined based on a comparison result between the standard text information and the confirmed feedback text information.

[0113] In the embodiment of the present application, the positions of the characters in the confirmed feedback text information can be compared with the characters in the corresponding positions in the standard text information in sequence or simultaneously to determine the consistency between the standard text information and the confirmed feedback text information. For example, if the confirmed feedback text information is "A, B, C" and the standard text information is "A1, B1, C1", the first "A" in the confirmed feedback text information is compared with the first "A1" in the standard text information; the second "B" in the confirmed feedback text information is compared with the second "B1" in the standard text information; and the third "C" in the confirmed feedback text information is compared with the third "C1" in the standard text information.

[0114] In some embodiments, it is possible to first determine whether the number of characters in the standard text information is consistent with that in the confirmed feedback text information. If the number is inconsistent, character comparison may be omitted, and it is determined that the standard text information is inconsistent with the confirmed feedback text information, which means that the hearing test of the test subject has failed. If the number of characters in the standard text information is consistent with that in the confirmed feedback text information, character comparison may continue.

[0115] It is understandable that when the standard text information is consistent with the feedback text information after confirmation, the feedback audio information that can represent the test object's feedback is consistent with the test audio information, and the semantics are consistent, then it is determined that the test object's hearing test has passed. When the standard text information is inconsistent with the feedback text information after confirmation, it cannot be explained that the feedback audio information fed back by the test object is inconsistent with the test audio information, nor can it be explained that the semantics are inconsistent. Because there are some common homophonic typos, even after the review of the test object, the errors corresponding to the homophonic typos cannot be identified, so it is necessary to determine the hearing test result of the test object again based on the comparison result between the standard text information and the feedback text information after confirmation.

[0116] In some embodiments, "determining the hearing test result of the detection object based on the comparison result between the standard text information and the confirmed feedback text information" in step S602 can be implemented through step S6021 and step S6022:

[0117] Step S6021, based on the comparison result, determine a second character in the confirmed feedback text information that is different from the first character in the standard text information; the position of the first character in the standard text information is the same as the position of the second character in the confirmed feedback text information.

[0118] In the embodiments of the present application, a second character in the confirmed feedback text information that is different from the first character in the standard text information can be determined. Exemplarily, if the confirmed feedback text information is "A, B, C" and the standard text information is "A1, B1, C1", if "A" is different from "A1", then A can be used as the second character.

[0119] Step S6022, when the second character is homophonic with the first character and the number of the second characters is within a preset number range, determine that the hearing test of the detection object passes.

[0120] It can be understood that if the number of second characters in the feedback text information is small and each second character is homophonic with the corresponding first character, it can be determined that the hearing test of the detection object passes. Exemplarily, if the standard text information is "run quickly" and the confirmed feedback text information is "run of quickly", then the second character in the confirmed feedback text information is "的" (de), because "的" (de) is homophonic with "地" (di) and the number of second characters is small and within the preset number range, it can be determined that the hearing test of the detection object passes.

[0121] In the embodiments of the present application, when the standard text information is inconsistent with the confirmed feedback text information, it can be determined whether the hearing test of the detection object passes by determining the number of second characters in the confirmed feedback text information and whether the second characters are homophonic with the first characters in the standard text information. In this way, the accuracy of determining the hearing test can be improved.

[0122] In some embodiments, as Figure 7 shown, the above hearing test method can be implemented through step S701 to step S706:

[0123] Step S701, when the camera of the robot captures that the subject enters the hearing test environment, guide the subject to enter the designated position.

[0124] In the embodiment of the present application, the robot can display a smiling expression through the head display screen and control the limbs to greet the detection object.

[0125] Step S702: The robot collects the subject's voice and obtains the subject's voice characteristics based on the subject's voice.

[0126] Step S703: the robot plays the test audio and adjusts the decibel of the test audio according to the ambient noise and the position of the subject during the playback.

[0127] In an embodiment of the present application, the robot can detect the sound pressure level of the ambient noise. When the sound pressure level of the ambient noise is greater than a threshold, the decibel of the played audio is increased; when the sound pressure level of the ambient noise is less than or equal to the threshold, the decibel of the played audio is reduced.

[0128] In the embodiment of the present application, the robot can determine the location of the subject based on the voice dialogue between the subject and the robot.

[0129] In some embodiments, the robot can also determine the position of the subject by capturing images of the subject.

[0130] Step S704: the robot collects the audio content repeated by the subject through the audio collection component.

[0131] In the embodiment of the present application, when the robot detects that the companion / subject makes noise, it can remind the companion / subject by voice or gesture.

[0132] In some embodiments, the audio content corresponding to the current subject can be filtered out from the collected audio content using the subject's voiceprint.

[0133] Step S705: The robot converts the audio content and presents the converted text on the display screen of the robot.

[0134] In the embodiment of the present application, the subject can review the displayed content, adaptively adjust the displayed text, and correct the incorrectly recognized text.

[0135] Step S706: The robot obtains the hearing test result of the subject based on the matching between the text and the original text.

[0136] In some embodiments, when the hearing test is completed, the robot informs the subject of the end of the test through voice prompts or display screens. It can also display a smiling expression through the LED screen on its head, wave goodbye to the subject, and guide the subject to leave.

[0137] Figure 8 is a schematic diagram of the composition structure of a robot provided in an embodiment of the present application, such as Fig. 9As shown, the robot 800 includes: a controller 801, a collection unit 802 and a playback unit 803, wherein:

[0138] The controller 801 is used to obtain the test condition information of the hearing test and control the playing unit 803 to output the test audio information corresponding to the test condition information;

[0139] A collection unit 802 is used to collect feedback audio information;

[0140] Controller 801 is also used to convert the feedback audio information into text to obtain feedback text information; in response to a confirmation operation on the feedback text information, obtain confirmed feedback text information; and determine the hearing test result of the test object based on the standard text information corresponding to the test audio information and the confirmed feedback text information.

[0141] In some embodiments, the detection condition information includes the distance information between the detection object and the robot and the ambient noise intensity; the controller 801 is also used to determine the first decibel range of the test audio information based on the distance information between the detection object and the robot; in the first decibel range, determine the first decibel information corresponding to the ambient noise intensity; and use the first decibel information to output the test audio information.

[0142] In some embodiments, the controller 801 is also used to determine the first decibel in the first decibel range as the decibel information of the test audio information when the ambient noise intensity is less than or equal to a first sound intensity threshold; and to determine the second decibel in the first decibel range that is greater than the first decibel as the decibel information of the test audio information when the ambient noise intensity is greater than a second sound intensity threshold; and the first sound intensity threshold is less than or equal to the second sound intensity threshold.

[0143] In some embodiments, the controller 801 is also used to control the distance between the robot and the detection object so that the distance information of the detection object is within the preset distance range when the distance information of the detection object is not within the preset distance range; determine the second decibel information corresponding to the ambient noise intensity in the second decibel range corresponding to the preset distance range; and use the second decibel information to output the test audio information.

[0144] In some embodiments, the robot includes a display or a display device external to the robot; the controller 801 is also used to control the display or the display interface in the display device to display the feedback text information; in response to receiving a modification operation on the feedback text information through at least one of the display interface, the audio collection component and the video collection component, the modified feedback text information is determined; in response to the triggering operation of the detection object on the confirmation control of the display or the display device, the modified feedback text information is determined as the confirmed feedback text information, the confirmation control is presented through the display interface, or the confirmation control is directly deployed on the display or the display device.

[0145] In some embodiments, the controller 801 is also used to output guiding voice information; obtain feedback voice information fed back by the detection object in response to the guiding voice information, and determine the sound feature information of the detection object based on the feedback voice information; based on the sound feature information of the detection object, screen multiple audio information to be screened to obtain target audio information; convert the target audio information into text to obtain the feedback text information.

[0146] In some embodiments, the controller 801 is also used to determine that the hearing test of the test subject has passed when the standard text information is consistent with the confirmed feedback text information; and to determine the hearing test result of the test subject based on the comparison result between the standard text information and the confirmed feedback text information when the standard text information is inconsistent with the confirmed feedback text information.

[0147] In some embodiments, the controller 801 is also used to determine, based on the comparison result, a second character in the confirmed feedback text information that is different from the first character of the standard text information; the position of the first character in the standard text information is the same as the position of the second character in the confirmed feedback text information; when the second character is homophonic with the first character and the number of the second characters is within a preset number range, it is determined that the hearing test of the test subject has passed.

[0148] The description of the above device embodiment is similar to the description of the above method embodiment, and has similar beneficial effects as the method embodiment. In some embodiments, the functions or modules included in the device provided in the embodiment of the present application can be used to execute the method described in the above method embodiment. For technical details not disclosed in the device embodiment of the present application, please refer to the description of the method embodiment of the present application for understanding.

[0149] It should be noted that in the embodiment of the present application, if the above-mentioned data processing method is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the relevant technology can be embodied in the form of a software product, which is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the methods of each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a U disk, a mobile hard disk, a read-only memory (ROM), a disk or an optical disk. In this way, the embodiment of the present application is not limited to any specific hardware, software or firmware, or any combination of hardware, software, and firmware.

[0150] An embodiment of the present application provides a computer device, including a memory and a processor, wherein the memory stores a computer program that can be run on the processor, and when the processor executes the program, some or all of the steps in the above method are implemented.

[0151] The embodiment of the present application provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, some or all of the steps in the above method are implemented. The computer-readable storage medium can be transient or non-transient.

[0152] An embodiment of the present application provides a computer program, including a computer-readable code. When the computer-readable code is run in a computer device, a processor in the computer device executes some or all of the steps for implementing the above method.

[0153] The embodiment of the present application provides a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and when the computer program is read and executed by a computer, some or all of the steps in the above method are implemented. The computer program product can be implemented specifically by hardware, software or a combination thereof. In some embodiments, the computer program product is specifically embodied as a computer storage medium, and in other embodiments, the computer program product is specifically embodied as a software product, such as a software development kit (SDK) and the like.

[0154] It should be noted here that the description of the various embodiments above tends to emphasize the differences between the various embodiments, and the same or similar aspects can be referenced to each other. The description of the above device, storage medium, computer program and computer program product embodiments is similar to the description of the above method embodiment, and has similar beneficial effects as the method embodiment. For technical details not disclosed in the embodiments of the device, storage medium, computer program and computer program product of this application, please refer to the description of the method embodiment of this application for understanding.

[0155] Fig. 9 is a schematic diagram of the structure of a computer device provided in an embodiment of the present application, such as Fig. 9 As shown, the computer device 900 includes: a memory 910 and a processor 920; wherein the memory 910 stores a computer program that can be run on the processor 920; when the processor 920 executes the computer program, the hearing detection method provided in the above embodiment is implemented.

[0156] The memory 910 stores a computer program that can be run on the processor. The memory 910 is configured to store instructions and applications executable by the processor 920. It can also cache data to be processed or processed by the processor 920 and each module in the control device 900 (for example, image data, audio data, voice communication data, and video communication data). This can be achieved through flash memory (FLASH) or random access memory (Random Access Memory, RAM).

[0157] When the processor 920 executes the program, the steps of any of the above control methods are implemented. The processor 920 generally controls the overall operation of the computer device 900.

[0158] An embodiment of the present application provides a computer storage medium, which stores one or more programs. The one or more programs can be executed by one or more processors to implement the steps of the hearing detection method in any of the above embodiments.

[0159] It should be noted here that the description of the above storage medium and device embodiments is similar to the description of the above method embodiments, and has similar beneficial effects as the method embodiments. For technical details not disclosed in the storage medium and device embodiments of this application, please refer to the description of the method embodiments of this application for understanding.

[0160] The processor may be at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a Central Processing Unit (CPU), a controller, a microcontroller, and a microprocessor. It is understandable that the electronic device that implements the functions of the processor may also be other, and the embodiments of the present application are not specifically limited.

[0161] The above-mentioned computer storage medium / memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic random access memory (FRAM), a flash memory (Flash Memory), a magnetic surface memory, an optical disk, or a compact disc read-only memory (CD-ROM) and the like; it can also be various terminals including one or any combination of the above-mentioned memories, such as mobile phones, computers, tablet devices, personal digital assistants, etc.

[0162] It should be understood that "one embodiment" or "an embodiment" mentioned throughout the specification means that specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present application, the size of the serial number of each step / process mentioned above does not mean the order of execution, and the execution order of each step / process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application. The serial numbers of the embodiments of the present application mentioned above are for description only and do not represent the advantages and disadvantages of the embodiments.

[0163] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0164] The above is only an implementation method of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application.

Claims

1. A hearing detection method, characterized in that: The method is applied to a robot; the method comprises: Acquire test condition information of the hearing test, and output test audio information corresponding to the test condition information; Acquiring feedback audio information, and converting the feedback audio information into text to obtain feedback text information; In response to a confirmation operation on the feedback text information, obtaining confirmed feedback text information; Based on the standard text information corresponding to the test audio information and the confirmed feedback text information, a hearing test result of the test subject is determined.

2. The method according to claim 1, characterized in that The detection condition information includes the distance information between the detection object and the robot and the intensity of the environmental noise; the output of the test audio information corresponding to the detection condition information includes at least one of the following: Determine a first decibel range of the test audio information based on the distance information between the detection object and the robot; determine first decibel information corresponding to the intensity of the ambient noise in the first decibel range; and output the test audio information using the first decibel information; When the distance information of the detection object is not within the preset distance range, the distance between the robot and the detection object is controlled so that the distance information of the detection object is within the preset distance range; in a second decibel range corresponding to the preset distance range, second decibel information corresponding to the ambient noise intensity is determined; and the test audio information is output using the second decibel information.

3. The method according to claim 2, characterized in that Determining first decibel information corresponding to the ambient noise intensity in the first decibel range includes: In a case where the ambient noise intensity is less than or equal to a first sound intensity threshold, determining a first decibel in the first decibel range as the decibel information of the test audio information; In a case where the ambient noise intensity is greater than a second sound intensity threshold, determining a second decibel greater than the first decibel in the first decibel range as the decibel information of the test audio information; The first sound intensity threshold is less than or equal to the second sound intensity threshold.

4. The method according to any one of claims 1 to 3, characterized in that: The robot includes a display or a display device external to the robot; the method further includes: Controlling the display or the display interface in the display device to display the feedback text information; In response to receiving a modification operation on the feedback text information through at least one of the display interface, the audio collection component, and the video collection component, determining the modified feedback text information; The step of obtaining the confirmed feedback text information in response to the confirmation operation on the feedback text information includes: In response to a triggering operation of a confirmation control of the display or the display device by the detection object, the modified feedback text information is determined as the confirmed feedback text information, the confirmation control is presented through the display interface, or the confirmation control is directly deployed on the display or the display device.

5. The method according to any one of claims 1 to 4, characterized in that: The method further comprises: Output guiding voice information; Acquire feedback voice information fed back by the detection object in response to the guide voice information, and determine sound feature information of the detection object based on the feedback voice information; The feedback audio information includes a plurality of audio information to be screened; the text conversion of the feedback audio information to obtain feedback text information includes: Based on the sound feature information of the detection object, screening is performed among a plurality of audio information to be screened to obtain target audio information; The target audio information is converted into text to obtain the feedback text information.

6. The method according to any one of claims 1 to 5, characterized in that: The step of determining the hearing test result of the test subject based on the standard text information corresponding to the test audio information and the confirmed feedback text information includes: In a case where the standard text information is consistent with the confirmed feedback text information, determining that the hearing test of the test subject has passed; In the case that the standard text information is inconsistent with the confirmed feedback text information, the hearing test result of the test subject is determined based on the comparison result between the standard text information and the confirmed feedback text information.

7. The method according to claim 8, characterized in that The step of determining the hearing test result of the test subject based on the comparison result between the standard text information and the confirmed feedback text information includes: Based on the comparison result, determining a second character in the confirmed feedback text information that is different from the first character in the standard text information; a position of the first character in the standard text information is the same as a position of the second character in the confirmed feedback text information; When the second character is homophonic with the first character and the number of the second characters is within a preset number range, it is determined that the hearing test of the test subject has passed.

8. A robot, characterized in that: The robot includes a controller, a collection unit and a playback unit; wherein, The controller is used to obtain the test condition information of the hearing test and control the playback unit to output the test audio information corresponding to the test condition information; The collecting unit is used to collect feedback audio information; The controller is also used to convert the feedback audio information into text to obtain feedback text information; in response to a confirmation operation on the feedback text information, obtain confirmed feedback text information; and determine the hearing test result of the test object based on the standard text information corresponding to the test audio information and the confirmed feedback text information.

9. A computer device, wherein: include: A memory for storing executable instructions; A processor, configured to implement the method according to any one of claims 1 to 7 when executing the executable instructions stored in the memory.

10. A computer-readable storage medium, wherein: The storage medium stores executable instructions, which, when executed by a processor, implement the method described in any one of claims 1 to 7.

Images