Voice intensity control method of intelligent home service robot for hearing-impaired users

Abstract

The invention discloses a voice intensity control method for an intelligent service robot, and the method comprises the steps: storing the information of hearing aid equipment used by a user in a control system of the intelligent service robot, and storing a voice intensity control algorithm, the control algorithm executes the following steps: judging the power of the hearing aid device used by the user and classifying the power according to the size of the power; calculating the distance between the hearing-impaired user and the intelligent service robot according to the picture shot by the camera, and judging whether the hearing-impaired user wears a hearing aid or not; if the hearing-impaired user wears the hearing aid, the volume intensity of the voice sent by the intelligent service robot is adjusted according to the distance between the hearing-impaired user and the intelligent service robot; otherwise, adjusting the volume intensity of the voice sent by the intelligent service robot according to the distance between the hearing-impaired user and the intelligent service robot and the power of the hearing-aid device used by the hearing-impaired user. According to the method, smooth conversation between the hearing-impaired user and the smart home service robot can be realized.

Description

Technical Field

[0001] The present invention relates to an intelligent home service robot for hearing-impaired users, and in particular to a voice intensity control method for the intelligent home service robot for hearing-impaired users. Background Art

[0002] In the current smart home service robot market, there are no algorithms or products that can fully meet the needs of the hearing-impaired. In particular, for hearing-impaired users who want to have a smooth conversation with smart home service robots without relying on traditional hearing aids, there is a lack of effective solutions on the market. Most existing smart home service robots focus on the needs of ordinary users, and their voice interaction systems are not specifically optimized for the hearing-impaired. As a result, these hearing-impaired users may encounter problems such as unclear hearing during use, which seriously affects their experience. Summary of the invention

[0003] The purpose of the present invention is to overcome the shortcomings of the existing technology and provide a method for controlling the voice intensity of an intelligent home service robot for hearing-impaired users, which does not rely on traditional hearing aids and can still achieve smooth conversation between the user and the intelligent home service robot.

[0004] A voice intensity control method for an intelligent service robot of the present invention comprises the following steps:

[0005] Step 1: storing the hearing aid device information used by the hearing-impaired user and the voice intensity control algorithm in the control system of the intelligent service robot, wherein the intelligent service robot has a visual camera, and the voice intensity control algorithm performs the following steps:

[0006] The first step is to determine the power of the hearing aid device used by the hearing-impaired user and classify the power according to the power size;

[0007] The second step is to calculate the distance between the hearing-impaired user and the intelligent service robot based on the photos taken by the visual camera and determine whether the hearing-impaired user wears a hearing aid; if the hearing-impaired user wears a hearing aid, the volume intensity of the voice emitted by the intelligent service robot is adjusted according to the distance between the hearing-impaired user and the intelligent service robot; otherwise, the volume intensity of the voice emitted by the intelligent service robot is adjusted according to the distance between the hearing-impaired user and the intelligent service robot and the power of the hearing aid used by the hearing-impaired user.

[0008] The technical solution adopted by the present invention is as follows:

[0009] The algorithm of the present invention can adapt to the individual differences of hearing-impaired users. Through the feedback and distance information of hearing-impaired users, the algorithm can dynamically adjust the volume, gradually improve the accuracy and effectiveness of voice volume adjustment, and ultimately provide hearing-impaired users with a more personalized service experience. Therefore, for hearing-impaired users who do not rely on traditional hearing aids, the algorithm can still achieve smooth conversations between hearing-impaired users and smart home service robots. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Figure 1 It is a structural block diagram of voice control of an intelligent home service robot of the present invention;

[0011] Figure 2 It is a flowchart of a voice control method for an intelligent home service robot of the present invention. DETAILED DESCRIPTION

[0012] The present invention is described in detail below with reference to the accompanying drawings and specific embodiments.

[0013] This method is applicable to adjusting the voice intensity of the robot's feedback when a hearing-impaired user issues instructions to an intelligent service robot.

[0014] As shown in the accompanying drawings, a voice intensity control method for an intelligent service robot of the present invention comprises the following steps:

[0015] Step 1: Store the hearing aid device information used by the hearing-impaired user and the voice intensity control algorithm in the control system of the existing intelligent service robot, wherein the existing intelligent service robot has a visual camera, such as the Xiaomi brand artificial intelligence interaction engine "Xiao Ai", and the voice intensity control algorithm performs the following steps:

[0016] The first step is to determine the power of the hearing aid device used by the hearing-impaired user and classify the power according to the power size; the specific process is:

[0017] The hearing-impaired user inputs the saturated sound pressure level x and gain y from the hearing aid manual into the service robot control system and makes the following judgment:

[0018] If x < 105dB SPL, the hearing aid is judged to be a low-power hearing aid, and i = 1, x1 = 105db SPL;

[0019] If 105dB SPL≤x<114dB SPL, the hearing aid is judged to be a medium-power hearing aid, and i=2, x2=114dB SPL;

[0020] If 114dB SPL≤x<124dB SPL, the hearing aid is judged to be a medium-to-high power hearing aid, and i=3, x3=124dB SPL;

[0021] If 124dB SPL≤x<134dB SPL, the hearing aid is judged to be a high-power hearing aid, and i=4, x4=134dB SPL;

[0022] If x ≥ 134 dB SPL, the hearing aid is judged to be an extra-high-power hearing aid, and i = 5, x5 = 134 dB SPL;

[0023] The second step is to calculate the distance between the hearing-impaired user and the intelligent service robot based on the photos taken by the visual camera and determine whether the hearing-impaired user wears a hearing aid; if the hearing-impaired user wears a hearing aid, the voice volume intensity of the intelligent service robot is adjusted according to the distance between the hearing-impaired user and the intelligent service robot; otherwise, the voice volume intensity of the intelligent service robot is adjusted according to the distance between the hearing-impaired user and the intelligent service robot and the power of the hearing aid device used by the hearing-impaired user; the specific process can be:

[0024] Step 201, use the service robot's visual camera to capture an image of the environment including the hearing-impaired user, obtain the distance d (in meters) between the hearing-impaired user and the service robot through image processing, and determine whether the hearing-impaired user wears a hearing aid. If so, set q=1; if not, set q=0.

[0025] Step 202: when q=1 and d>2m, the voice intensity V of the service robot feedback is increased. The voice intensity adjustment formula is as follows:

[0026] V=V0+V Δ sgn(d-2),

[0027] Where V0 represents the voice volume intensity of the service robot during normal use, V Δ The voice volume intensity that needs to be increased for every 1m increase when the hearing-impaired user is 2m away from the service robot is calculated using the following formula:

[0028]

[0029] In this step, the hearing-impaired user wears the hearing aid normally. After the hearing aid is adjusted, clear hearing effect can be guaranteed within a range of 2m. At this time, the voice volume intensity of the service robot is not adjusted. When it is greater than 2m, the sound intensity is increased according to the formula;

[0030] When q=0, the voice volume intensity V of the service robot is:

[0031]

[0032] In the formula, α iThe power weight factor representing the hearing aid used is calculated using the following formula:

[0033]

[0034] Preferably, the method includes step 2, in order to ensure that the voice volume of the service robot can better meet the actual needs of the hearing-impaired user, the voice volume intensity adjustment algorithm can be optimized by collecting feedback information from the hearing-impaired user. Further preferably, the adjustment algorithm for optimizing the voice volume intensity includes the following steps:

[0035] Step 301, setting page options on the service robot screen, allowing the hearing-impaired user to directly give feedback on whether the current voice volume is appropriate, such as "too quiet", "too loud" or "moderate". When setting page options, a graphic design tool or a UI component in a development environment can be used to design user interface options. Taking Python as an example, a cross-platform GUI framework such as PyQt or PySide can be used to create a user interface.

[0036] Step 302: adjust the voice volume intensity using the following formula according to the hearing-impaired user's feedback:

[0037] V new =V+β·F·α i (d-2)

[0038] Where V new is the voice volume intensity of the robot optimized after user feedback, V is the voice volume intensity of the service robot in the above step 202, β·F·α i ·(d-2) represents the amount of adjustment to the voice volume based on the hearing-impaired user's feedback and current conditions. β is the adjustment coefficient, which is used to control the magnitude of each adjustment. It is usually a small positive number (e.g. 0.1). F represents the feedback direction of the hearing-impaired user. If the sound is too quiet, let F = -1, then increase the volume; if the sound is too loud, let F = 1, then reduce the volume; if the sound is moderate, let F = 0, then do not adjust. α i is the power weight coefficient of the hearing aid, which reflects the gain capability of the hearing aid and is taken according to step 202. d is the distance between the hearing-impaired user and the service robot.

[0039] It is worth noting that although the preferred embodiments of the present invention have been described in detail above in conjunction with the accompanying drawings, the present invention is not limited to the above-mentioned specific implementation methods. The above-mentioned implementation methods are merely illustrative and not restrictive. Relevant technical personnel in the field can be inspired by the present invention and make many forms without departing from the purpose of the present invention and the scope of protection of the claims, which all belong to the scope of protection of the present invention.

Claims

1. A method for controlling speech intensity of an intelligent service robot, characterized in that: The following steps are involved: Step 1: storing the hearing aid device information used by the hearing-impaired user and the voice intensity control algorithm in the control system of the intelligent service robot, wherein the intelligent service robot has a visual camera, and the voice intensity control algorithm performs the following steps: The first step is to determine the power of the hearing aid device used by the hearing-impaired user and classify the power according to the power size; The second step is to calculate the distance between the hearing-impaired user and the intelligent service robot based on the photos taken by the visual camera and determine whether the hearing-impaired user wears a hearing aid; if the hearing-impaired user wears a hearing aid, the volume intensity of the voice emitted by the intelligent service robot is adjusted according to the distance between the hearing-impaired user and the intelligent service robot; otherwise, the volume intensity of the voice emitted by the intelligent service robot is adjusted according to the distance between the hearing-impaired user and the intelligent service robot and the power of the hearing aid used by the hearing-impaired user.

2. The method for controlling the voice intensity of an intelligent service robot according to claim 1, characterized in that: The specific process of the first step is: The hearing-impaired user inputs the saturated sound pressure level x and gain y from the hearing aid manual into the service robot control system and makes the following judgment: If x < 105dB SPL, the hearing aid is judged to be a low-power hearing aid, and i = 1, x1 = 105db SPL; If 105dB SPL≤x<114dB SPL, the hearing aid is judged to be a medium-power hearing aid, and i=2, x2=114dB SPL; If 114dB SPL≤x<124dB SPL, the hearing aid is judged to be a medium-to-high power hearing aid, and i=3, x3=124dB SPL; If 124dB SPL≤x<134dB SPL, the hearing aid is judged to be a high-power hearing aid, and i=4, x4=134dB SPL; If x≥134dB SPL, the hearing aid is judged to be an extra-high-power hearing aid, and i=5, x5=134dB SPL.

3. The voice intensity control method for an intelligent service robot according to claim 1, characterized in that: The second step, the specific process can be: Step 201, using the visual camera of the service robot to capture an image of the environment including the hearing-impaired user, obtaining the distance d between the hearing-impaired user and the service robot through image processing, and determining whether the hearing-impaired user wears a hearing aid, if wearing a hearing aid, setting q=1, if not wearing a hearing aid, setting q=0; Step 202: when q=1 and d>2m, the voice intensity V of the service robot feedback is increased. The voice intensity adjustment formula is as follows: Where V0 represents the voice volume intensity of the service robot during normal use, V Δ The voice volume intensity that needs to be increased for every 1m increase when the hearing-impaired user is 2m away from the service robot is calculated using the following formula: When q=0, the voice volume intensity V of the service robot is: In the formula, α i The power weight factor representing the hearing aid used is calculated using the following formula:

4. The method for controlling the voice intensity of an intelligent service robot according to claim 3, characterized in that: After step 1, continue to perform step 2, by collecting feedback information from hearing-impaired users to optimize the adjustment algorithm of voice volume intensity, the adjustment algorithm for optimizing voice volume intensity includes the following steps: Step 301, setting a page option on the service robot screen to allow the hearing-impaired user to directly provide feedback on whether the current voice volume is appropriate; Step 302: adjust the voice volume intensity using the following formula according to the hearing-impaired user's feedback: V new =V+β·F·α i ·(d-2) Where V new is the voice volume intensity of the robot optimized after user feedback, V is the voice volume intensity of the service robot in the above step 202, β·F·α i (d-2) represents the amount of adjustment of the speech volume according to the feedback of the hearing-impaired user and the current conditions; β is the adjustment coefficient; F represents the feedback direction of the hearing-impaired user. If the sound is too soft, let F = -1, and increase the volume; if the sound is too loud, let F = 1, and reduce the volume; if the sound is moderate, let F = 0, and no adjustment is made; α i is the power weight coefficient of the hearing aid, which is taken according to step 202, and d is the distance between the hearing-impaired user and the service robot.

Images