Volume control method, device, multimedia playback device and readable storage medium
By detecting the distance and volume parameters between the user of the multimedia playback device and the audio device and adjusting the volume, the problem of volume management impact in multi-user scenes is solved, and better auditory compatibility is achieved.
Patent Information
- Application Number
- CN202011297958.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-11-18
- Publication Date
- 2024-12-10
- Estimated Expiration
- 2040-11-18
AI Technical Summary
In the use scenario of multimedia playback equipment, when different users choose different locations to listen to audio, adjusting the volume of a single user may affect the auditory feeling of other users, and there is a lack of effective volume management methods.
By detecting the distance and volume control parameters of multiple users and the audio playback device, adjusting the volume of the audio playback device to take into account the hearing feelings of each user, using the user positioning and identification device to obtain the user location and volume parameters, and using the processor to use the processor to These parameters control the volume.
It effectively reduces the auditory impact of single user on other users when adjusting volume, and improves personalized volume management and multi-user compatibility.
Smart Images

Figure CN114554349B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of electronic equipment, and in particular to a volume control method, device, multimedia playback device, and readable storage medium. Background Art
[0002] Multimedia playback devices usually use audio playback devices such as speakers to play audio. In the scenario where at least two users use the same multimedia playback device, audio management becomes an urgent problem to be solved. Because when using the same multimedia playback device, different users will choose different locations to listen to audio, and users will adjust the audio volume according to their own preferences, but the volume adjusted for one user may affect the hearing experience of other users. Summary of the invention
[0003] To solve the above problems, the present application provides an audio volume control method, apparatus, multimedia playback device, and readable storage medium, which can reduce the impact of adjusting the volume for a certain user on other users.
[0004] In a first aspect, the present application provides an audio volume control method, the method comprising:
[0005] If at least two users are detected, the distance between each user and the audio playback device and the volume control parameters of the audio playback device by each user are obtained;
[0006] The audio playback device is controlled to adjust the volume according to the distance between each user and the audio playback device and the volume control parameter.
[0007] The volume control method can take each user into consideration by adjusting the volume of the audio playback device according to the distance between each user and the audio playback device and the volume control parameter, thereby reducing the impact of adjusting the volume for a certain user on the auditory perception of other users.
[0008] In a second aspect, the present application provides a volume control device, comprising:
[0009] A volume control parameter and distance acquisition module, for acquiring the distance between each user and the audio playback device, and the volume control parameter of each user on the audio playback device, if at least two users are detected;
[0010] The volume control module is used to control the audio playback device to adjust the volume according to the distance between each user and the audio playback device and the volume control parameters.
[0011] In a third aspect, the present application proposes a multimedia playback device, including a memory, a processor, at least one audio playback device, and at least one user positioning and identification device, wherein the processor is respectively connected to the memory, the audio playback device, and the user positioning and identification device for communication, the audio playback device is used to play the audio of the multimedia playback device and adjust the volume in response to the control of the processor, and the user identification and positioning device is used to identify the user and detect the distance between the user and the audio playback device;
[0012] The memory stores a computer program, and when the computer program is executed by the processor, the processor executes the steps of the volume control method described in any of the above embodiments.
[0013] In a fourth aspect, the present application proposes one or more non-volatile readable storage media storing computer-readable instructions, characterized in that when the computer-readable instructions are executed by one or more processors, the one or more processors execute the steps of the method described in any of the above embodiments. BRIEF DESCRIPTION OF THE DRAWINGS
[0014] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.
[0015] Figure 1 A schematic diagram of an application environment of a volume control method according to an embodiment of the present application;
[0016] Figure 2 A flow chart of a volume control method according to an embodiment of the present application;
[0017] Figure 3 A flow chart of a volume control method according to another embodiment of the present application;
[0018] Figure 4 A schematic diagram of a process for establishing a regression fitting equation according to an embodiment of the present application;
[0019] Figure 5 A schematic diagram of inputting user volume control parameters according to an embodiment of the present application;
[0020] Figure 6 A schematic diagram of a process for updating audio setting information according to an embodiment of the present application;
[0021] Figure 7 A schematic diagram of a process for constructing a pre-training model according to an embodiment of the present application;
[0022] Figure 8 A schematic diagram of a process for setting a reference viewpoint in a multimedia presentation environment according to an embodiment of the present application;
[0023] Fig. 9 It is a structural schematic diagram of a multimedia playback device according to an embodiment of the present application. DETAILED DESCRIPTION
[0024] The technical solutions in the embodiments of the present application are clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present application. In the absence of conflict, the following embodiments and their technical features can be combined with each other.
[0025] As described in the background art, when using the same multimedia playback device, different users will choose different positions to listen to audio, and the users will adjust the audio volume according to their own preferences for the audio volume, but the volume adjusted for one user may affect the auditory experience of other users.
[0026] Based on this, an embodiment of the present application proposes a volume control method for an audio playback device, which can be applied to multimedia playback devices and can reduce the impact on other users when adjusting the volume for a certain user.
[0027] Figure 1 FIG. 1 is a schematic diagram of an application environment of a volume control method for an audio playback device in an embodiment. Figure 1 As shown, the application environment includes a multimedia playback device 100, an audio playback device 200, a user positioning and identification device 300, and a user 400. The user positioning and identification device 300 is used to detect the user 400, and the multimedia playback device 100 is used to control the volume of the audio playback device 200 according to the volume control method in any of the following embodiments according to the distance between the user and the audio playback device 200. The multimedia playback device 100 can specifically be an electronic device that can play audio, such as a television, a radio, a mobile phone, a tablet computer, a laptop computer, a handheld computer, etc. The audio playback device 200 can be a sound amplification device for the multimedia playback device 100. The user positioning and identification device 300 can include two devices, a user identification device and a distance detection device, or can be a device that has both distance measurement and user identification functions, such as a camera.
[0028] Figure 2 FIG. 1 is a flow chart of a volume control method for an audio playback device in one embodiment of the present application. Figure 2The volume control method of the audio playback device includes: S10, if at least two users are detected, obtaining the distance between each user and the audio playback device, and the volume control parameters corresponding to each user; and, S11, controlling the volume of the audio playback device according to the distance between each user and the audio playback device and the volume control parameters corresponding to each user.
[0029] The volume control method in the embodiment of the present application can take each user into consideration by adjusting the volume of the audio playback device according to the distance between each user and the audio playback device and the volume control parameters, thereby reducing the impact of adjusting the volume for a certain user on the auditory perception of other users.
[0030] Figure 3 FIG. 1 is a flow chart of a volume control method for an audio playback device in another embodiment of the present application. Figure 4 , the volume control method of the audio playback device includes: The volume control method of the audio playback device includes: Step 102, detecting users. Step 104, determining whether the number of users is greater than zero. If at least two users are detected, executing steps 106 to 108. If one user is detected, executing steps 202 to 204. If no user is detected, returning to step 102. Step 106, obtaining the distance between each user and the audio playback device, and the volume control parameters of each user for the audio playback device. Step 108, controlling the audio playback device to adjust the volume according to the distance between the user and the audio playback device and the volume control parameters.
[0031] The volume control parameters of the audio playback device for each user in the embodiment of the present application may refer to the volume preset by each user for the audio playback device, and the preset volume may be the volume at which the input user's hearing experience is optimal. When different users are at the same distance from the audio playback device, the preset volumes may be different. For example, the preset volumes of the audio playback device for user A, user B, and user C are 70 decibels, 75 decibels, and 80 decibels, respectively. When the same user is at the same distance from the audio playback device, the preset volumes may be different. For example, the preset volumes of user A when they are 1 meter, 2 meters, and 3 meters away from the audio playback device are 70 decibels, 75 decibels, and 80 decibels, respectively.
[0032] In specific implementation, the embodiment of the present application usually detects users in a multimedia demonstration environment. The multimedia demonstration environment can be the area facing the multimedia playback device, for example, it can be a room. The multimedia demonstration environment can also be the sound coverage of the audio played by the multimedia playback device, for example, within a radius of 10 meters with the sound source as the origin.
[0033] In some embodiments, there are at least two audio playback devices, and the method includes: if at least two users are detected and the audio playback device closest to each user is the same, obtaining the distance between each user and the same audio playback device and each audio control parameter corresponding to each user; controlling the volume of the same audio playback device according to the distance between each user and the same audio playback device and the each volume control parameter.
[0034] Specifically, the step of controlling the volume of the same audio playback device according to the distance between each user and the same audio playback device and the various volume control parameters also includes: controlling the power supply of the same audio playback device closest to each user to be in a working state, and other audio playback devices to be in a turned-off state, which can reduce power consumption and reduce crosstalk from other farther audio playback devices to the closest same audio playback device.
[0035] In other implementations, if there is an audio playback device, and the audio playback device closest to each user is the audio playback device, then the distance between each user and the same audio playback device and each audio control parameter corresponding to the user are obtained. The volume of the same audio playback device is controlled according to the distance between each user and the same audio playback device and the volume control parameters.
[0036] Specifically, the volume of the same audio playback device is controlled according to the distance between each user and the same audio playback device and each volume control parameter, which is determined by the following formula:
[0037]
[0038] Among them, V OUT is the adjusted volume control parameter, i is the number of users, Di is the distance between each user and the audio playback device, and Vi is the volume control parameter corresponding to each user. The volume control parameter corresponding to each user is related to the distance from the audio playback device. Distance is the weight of each volume control parameter. The farther the distance, the greater the corresponding volume control parameter weight. However, since the volume control parameter of the user near the audio playback device is also configured with a weight, both distant and nearby users are taken into account when adjusting the volume.
[0039] In the above formula, V OUT It may be an adjusted audio control parameter obtained by weighted calculation of various audio control parameters, or it may be an adjusted volume value obtained by weighted calculation of various volume values.
[0040] In some embodiments, there are at least two audio playback devices. If at least two users are detected, and the audio playback devices closest to each user are different, and the distance between each user is greater than a preset distance, the volume adjustment of each nearest audio playback device is controlled according to the volume control parameters of each user for the nearest audio playback device. In these embodiments, if the nearest audio playback devices of each user are different, and the distance between the users is large, the volume adjustment of the nearest audio playback devices of each user can be controlled according to the volume control parameters, and the volume of the audio playback device closest to a user has little effect on the hearing of other users.
[0041] In some embodiments, there are at least two audio playback devices. If a user is detected, the volume control method further includes step 202, obtaining the distance between the user and each audio playback device, and obtaining the corresponding volume control parameter according to the distance of the audio playback device closest to the user. And step 204, controlling the volume of the nearest audio playback device according to the volume control parameter. Among them, if it is detected that the position of the user has changed, the audio playback device closest to the user and / or the distance between the user and the nearest audio playback device may also change, and the corresponding volume control parameter will change accordingly, and the volume can be adjusted as the user's position changes. In order to reduce power consumption, specifically, when a user is detected, the power supply of the audio playback device closest to the user is controlled to be in a working state, and the power supplies of other audio playback devices are controlled to be in a turned-off state.
[0042] In some embodiments, see Figure 3 If no user is detected, the process returns to step 102. In other embodiments, if no user is detected, the power of each audio playback device may be controlled to enter a closed state. Specifically, if no user is detected, and no user is detected for a preset time or the audio playback device is detected to be in a closed playback state, the power of each audio playback device is controlled to enter a closed state, and the volume control method ends.
[0043] In some embodiments, Figure 4 As shown, the volume control method also pre-establishes the step of the regression fitting equation of "distance-volume" of each user, which specifically includes step 302, detecting the different distances between each user and the corresponding audio playback device, and obtaining the various audio control parameters adapted to the different distances input by the user. And step 304, performing regression fitting according to the different distances and the audio control parameters corresponding to each distance, and obtaining the regression fitting equation of the distance and volume control parameters.
[0044] Through the above steps, the volume control parameters of the user at different distances are tested, recorded and saved, so as to obtain the regression fitting equation of "distance-volume" of each user. Therefore, the volume control parameter is related to the distance between the user and the audio playback device, and the volume control parameters at different distances are different. For different users, the volume control parameters may be different at the same distance. Then, in the specific implementation, the volume control parameter of the user can be obtained based on the distance of the user relative to the audio playback device and the regression fitting equation of the user. The audio playback device in this embodiment may refer to the audio playback device with the closest corresponding distance to each user.
[0045] For example, Figure 5 As shown, the volume of the audio playback device 620 can be adjusted when the user 610 is at different distances from the audio playback device 620, and the adjustment is stopped when the user has the best hearing experience at the corresponding distance, and the volume at this time is used as the volume control parameter of the user at the distance. In this way, the relationship between the different distances from the audio playback device and the corresponding volume control parameter of the user is obtained, and regression fitting is performed to obtain the regression fitting equation of the different distances from the audio playback device and the corresponding volume control parameter of the user.
[0046] The regression fitting described in this embodiment may specifically include: based on a series of points on a plane of each discrete distance data and the corresponding volume control parameter, these points are connected with a smooth curve using a fitting method such as the least square method, and the fitting curve can be represented by a function, which can be used as the "distance-volume" regression fitting equation of the user. When a user is subsequently detected, the "distance-volume" regression fitting equation of the user is extracted, and the distance of the audio playback device closest to the user is input to obtain the corresponding volume control parameter.
[0047] Specifically, various volume control parameters input by the user through voice or remote control, etc., can be obtained but is not limited to. For example, when the user 610 is 5 meters away from the audio playback device 620, the user cannot directly contact the audio playback device, and the volume control parameters can be input through remote control.
[0048] Specifically, Figure 5 As shown, the user positioning and identification device 630 can be used to identify the identity of the user, and the identity of the user and its regression fitting equation can be stored in the processor or server of the multimedia playback device.
[0049] In some embodiments, Figure 6As shown, it also includes a step of pre-updating audio setting information, specifically including: step 402, identifying the identity of the user; step 404, obtaining the distance between the user and the audio playback device; step 406, obtaining the audio device closest to the user, and updating the audio setting information of the user, the audio setting information includes user identity information, distance and volume control parameters, and the volume control parameters have a corresponding relationship with the identity information of the user and the distance of the audio playback device closest to the user; the audio setting information can be stored in the memory or server of the multimedia playback device. Step 408, detecting the location of the user, if the location of the user is updated, returning to the step 402 of identifying the identity of the user. The step of obtaining the volume control parameter includes: when the user is detected, identifying the identity of the user, and obtaining the corresponding volume control parameter according to the identity authentication information of the user and the distance of the audio playback device closest to the user.
[0050] In step 406, after the user audio setting information is updated, the user's "distance-volume" regression fitting equation is updated. The user's "distance-volume" regression fitting equation can reflect the corresponding relationship between the user and the nearest audio playback device. The step of obtaining the volume control parameter can first authenticate the user, obtain the user's regression fitting equation based on the user's identity authentication information, and then obtain the corresponding volume control parameter based on the distance between the user and the audio playback device and the user's regression fitting equation.
[0051] In one embodiment, the step of identifying the user includes: obtaining the user's biometric identification information; and then identifying the user's identity using a pre-trained model based on the biometric identification information. Specifically, the biometric data includes but is not limited to at least one of the user's gait data and face data.
[0052] Specifically, in one embodiment, Figure 7 As shown, the step of using a pre-trained model to identify the identity of a user according to biometric identification information includes: step 502, calibrating the user's biometric data. Step 504, using the pre-trained model to obtain positioning data from the calibration data, the positioning data including bounding box area data on the three-dimensional or two-dimensional user image contour. Step 506, using the pre-trained model to extract features from the positioning data. Step 508, inputting the feature extraction data into the pre-trained model, and then using the pre-trained model to classify users, dividing users into known users and unknown users, and classifying known users according to the user's identity information. If the user is a new user and needs to set the volume, add it to the sample. If the user does not need to set the volume, remove the user from the sample library.
[0053] The calibration process may be preprocessing of the biometric data of the sample user. The biometric data may be user image data, specifically three-dimensional or two-dimensional user image data, and the preprocessing may correspond to preprocessing such as cropping, scaling, and brightness adjustment. The preprocessing may improve the image quality, which is beneficial for subsequent identification of the user from the preprocessed image. The bounding box area data may refer to the contour data of the user image, specifically three-dimensional or two-dimensional user image contour data, such as the user's facial contour, facial features contour, and other data.
[0054] The pre-trained model can be a face detection and recognition model. In the specific implementation process of identifying the user's identity, the face detection and recognition model is first used to obtain the user's face positioning data, and then features are extracted from the user's face positioning data. Specifically, facial features such as facial features in the user's face image can be extracted, and then face recognition is performed to identify the user's identity.
[0055] In this embodiment, the data in the sample library and the pre-trained model can be stored in the local processor of the server or multimedia player. The training process of the pre-trained model and the identification process of identifying the identity of the user using the pre-trained model can also be executed in the local processor of the server or multimedia player.
[0056] In some embodiments, see Figure 8 , the volume control method further comprises the following steps:
[0057] Step 602, obtaining scanning data of each user positioning and identification device at different positions in the multimedia demonstration environment. Step 604, merging each scanning data, and obtaining a three-dimensional space model of the multimedia demonstration environment based on the merged scanning data. Step 606, calibrating the merged scanning data with the actual coverage of the multimedia demonstration environment. Step 608, if the calibration passes, updating the position of the multimedia playback device in the three-dimensional space model to the reference viewpoint in the multimedia demonstration environment. The acquisition of the distance between the user and the audio playback device includes first obtaining the position of the user and the audio playback device relative to the reference viewpoint, and then calculating the distance between the user and the audio playback device. In other implementations, step 606 will also calibrate and check whether the scanning data of each user positioning and identification device has been successfully merged, and will also calibrate whether the relative positions of each audio playback device and the multimedia playback device are correct.
[0058] Specifically, each user positioning and identification device can be a camera, and the scan data can be image data. Each user positioning and identification device is evenly distributed in different positions in the multimedia presentation environment, which is conducive to the merging of scan data of each device. For example, the multimedia presentation environment is a room, and each user positioning and identification device can be evenly distributed on the walls and ceiling of the room.
[0059] If the various scanned data are not image data, the merging method may be image synthesis, that is, the images collected by the various user positioning and identification devices are synthesized into one image to form a three-dimensional space model.
[0060] Specifically, after step 608, the location information of each audio playback device and user location and identification device relative to the multimedia playback device can also be obtained, and number information can be configured for each audio playback device and user location and identification device. Subsequently, only the location information of the user needs to be obtained to calculate the distance between the audio playback device and the user, saving calculation time.
[0061] In summary, the volume control method in the embodiment of the present application can take each user into consideration by adjusting the volume of the audio playback device according to the distance between each user and the audio playback device and the volume control parameters, thereby reducing the impact of adjusting the volume for a certain user on the auditory perception of other users.
[0062] It should be understood that, although the various steps in the various flow charts of the audio control method in the embodiment of the present application are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a portion of the steps in the figure may include a plurality of sub-steps or a plurality of stages, and these sub-steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these sub-steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a portion of the sub-steps or stages of other steps.
[0063] The present application also provides a volume control device, including:
[0064] A volume control parameter and distance acquisition module, for acquiring the distance between each user and the audio playback device and the volume control parameter corresponding to each user if at least two users are detected;
[0065] The volume control module is used to control the volume of the audio playback device according to the distance between each user and the audio playback device and each volume control parameter corresponding to each user.
[0066] In one embodiment, the number of the audio playback devices is at least 2, and the volume control device further comprises:
[0067] A first volume control parameter and distance acquisition module, configured to, if at least two users are detected and if it is detected that the audio playback device closest to each user is the same, acquire the distance between each user and the same audio playback device and each audio control parameter corresponding to each user;
[0068] The first volume control module is used to control the volume of the same audio playback device according to the distance between each user and the same audio playback device and the various volume control parameters.
[0069] In one embodiment, the first volume control module includes a weighted volume control module, which is used to control the same audio playback device to adjust the volume according to the distance between each user and the audio playback device and the volume control parameters of the audio playback device by each user according to the following weighted volume control formula:
[0070]
[0071] Among them, V OUT is the adjusted volume control parameter, i is the number of users, Di is the distance between each user and the audio playback device, and Vi is the volume control parameter corresponding to each user.
[0072] In one embodiment, the first volume control module is specifically used to control the volume of each nearest audio playback device to be adjusted according to the volume control parameters of each user for the nearest audio playback device if at least two users are detected and the audio playback devices closest to each user are different, and the distance between each user is greater than a preset distance.
[0073] In one embodiment, the volume control device includes a second volume control module, which is used to obtain the distance between the user and each audio playback device if a user is detected, obtain the corresponding volume control parameter according to the distance between the user and the nearest audio playback device, and control the nearest audio playback device to adjust the volume according to the volume control parameter.
[0074] In one embodiment, the second volume control module includes a power control module, which is used to control the power of the audio playback device closest to the user to be in an operating state if a user is detected, and control the power of other audio playback devices to be in an off state.
[0075] In one embodiment, the volume control device includes a third volume control module, which is used to control the power of each audio playback device to enter the off state if no user is detected and no user is detected for a preset time or if it is detected that each audio playback device is in the off playback state.
[0076] In one embodiment, the volume control device further includes the following audio setting information pre-update module, specifically including:
[0077] User identification module, used to identify the user's identity;
[0078] A distance acquisition module is used to obtain the distance between the user and the audio playback device;
[0079] An audio setting information updating module, used to obtain the audio device closest to the user and update the audio setting information of the user, wherein the audio setting information includes user identity information, distance and volume control parameter, and the volume control parameter has a corresponding relationship with the user's identity information and the distance of the audio playback device closest to the user;
[0080] A user location detection module, used to detect the location of the user, and if the location of the user is updated, return to the step of identifying the user's identity;
[0081] The volume control parameter acquisition module includes a fourth volume control parameter acquisition module, which is used to identify the identity of the user when a user is detected, and acquire the corresponding volume control parameter according to the user's identity authentication information and the distance of the audio playback device closest to the user.
[0082] In one embodiment, the volume control device further includes the following distance and volume control parameter regression fitting equation pre-establishment module, specifically including:
[0083] A volume control parameter input module is used to detect different distances between the user and the audio playback device, and obtain various volume control parameters adapted to different distances input by the user through remote control;
[0084] A regression fitting equation acquisition module is used to perform regression fitting according to different distances and volume control parameters corresponding to each distance, and obtain a regression fitting equation of the distance and the corresponding volume control parameter;
[0085] The acquisition of volume control parameters includes a fifth volume control parameter acquisition module, which is used to acquire the volume control parameters corresponding to each user according to the distance between each user and the corresponding audio playback device and the regression fitting equation corresponding to each user.
[0086] In one embodiment, the user identification module includes:
[0087] A biometric data acquisition module, used to acquire the user's biometric data;
[0088] The user identification module is used to identify the user's identity using a pre-trained model based on the biometric data.
[0089] In one embodiment, the volume control device includes the pre-trained model building module for identifying the user, specifically including:
[0090] A calibration module, used to obtain the biometric data of the calibrated user;
[0091] A positioning data acquisition module, used to acquire positioning data from calibration data using a pre-trained model, wherein the positioning data includes bounding box area data on the contour of a three-dimensional or two-dimensional user image;
[0092] A feature extraction module is used to extract features from positioning data using a pre-trained model;
[0093] A transfer learning and model fine-tuning module, which is used to input feature extraction data into a pre-trained model for identifying users for transfer learning and model fine-tuning;
[0094] The classification module is used to use the pre-trained model for identifying users to classify users, divide users into known users and unknown users, and classify known users according to their identity information. If the user is a new user and needs to set the volume, the user is added to the sample library; if the user does not need to set the volume, the user is removed from the sample library.
[0095] In one embodiment, the volume control device comprises,
[0096] A scanning data acquisition module is used to acquire scanning data of each user positioning and identification device at different positions in the multimedia presentation environment;
[0097] A three-dimensional space model acquisition module, used for merging the various scan data and acquiring a three-dimensional space model of the multimedia demonstration environment according to the merged scan data;
[0098] A data calibration module for calibrating the merged scan data with the sound coverage of the multimedia presentation environment;
[0099] If the calibration is successful, updating the position of the multimedia playback device in the three-dimensional space model to a reference viewpoint in the multimedia presentation environment;
[0100] The distance acquisition module includes a fourth distance acquisition module, which is used to acquire the positions of the user and the audio playback device relative to the reference viewpoint and calculate the distance between the user and the audio playback device.
[0101] The division of the various modules in the above volume control device is only for illustration. In other embodiments, the volume control device may be divided into different modules as needed to complete all or part of the functions of the above volume control device.
[0102] The specific definition of the volume control device can be found in the definition of the volume control method above, which will not be repeated here. Each module in the above volume control device can be implemented in whole or in part by software, hardware, or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module above.
[0103] The implementation of each module in the volume control device provided in the embodiment of the present application can be in the form of a computer program. The computer program can be run on a terminal or a server. The program modules constituted by the computer program can be stored in the memory of the terminal or the server. When the computer program is executed by the processor, the steps of the method described in the embodiment of the present application are implemented.
[0104] The embodiment of the present application provides a multimedia playback device, including a memory, a processor, at least one audio playback device, and at least one user positioning and identification device, wherein the processor is respectively connected to the memory, the audio playback device, and the user positioning and identification device for communication, the audio playback device is used to play the audio of the multimedia playback device and adjust the volume in response to the control of the processor, and the user identification and positioning device is used to identify the user and detect the distance between the user and the audio playback device;
[0105] The memory stores a computer program, and when the computer program is executed by the processor, the processor executes the steps of the volume control method described in any of the above embodiments.
[0106] like Fig. 9 As shown, the processor may be a processor of the multimedia playback device body 710 or a processor of the server. The memory may be a memory of the multimedia playback device body 710 or a memory of the server. When it is a processor of the server, the server sends the execution result to the processor of the multimedia playback device body, and then the processor of the multimedia playback device relays and controls the audio playback device 720 to adjust the volume, etc.
[0107] The multimedia player body 710 can be a television, a radio, a mobile phone, a tablet computer, a laptop computer, a PDA, or other electronic device capable of playing audio. The audio player device can be a speaker. The audio player device can be built into the multimedia player body, or it can be connected to a computer such as a laptop computer. Fig. 9 The audio player is independent of the multimedia player body and serves as a sound amplification device for the multimedia player body. When the audio player is independent of the multimedia player body, the audio player can establish a wired or wireless communication connection with the multimedia player body, and the wireless method can be Bluetooth or the like.
[0108] like Fig. 9As shown, the multimedia playback device body 710 includes a processor, a memory and a network interface connected through a system bus. Among them, the processor is used to provide computing and control capabilities to support the operation of the entire electronic device. The memory is used to store data, programs, etc., and at least one computer program is stored on the memory. The computer program can be executed by the processor to implement the volume control method applicable to the multimedia playback device provided in the embodiment of the present application. The memory may include a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The computer program can be executed by the processor to implement a volume control method provided in each of the above embodiments. The internal memory provides a cache operating environment for the operating system computer program in the non-volatile storage medium. The network interface can be an Ethernet card or a wireless network card, etc., for communicating with an external electronic device such as a server.
[0109] In some embodiments, at least one user positioning and identification device 730 is configured corresponding to one audio playback device 720, the distance between the user positioning and identification device and the audio playback device is less than a preset value, and the scanning direction of the user positioning and identification device can be consistent with the direction of the audio playback device, for example, both are facing the user. In this way, it is convenient for the matching user positioning and identification device to detect users near the audio playback device.
[0110] The user positioning and identification device 300 may include two devices, namely a user identification device and a distance detection device, or may be a device having both distance measurement and user identification functions, such as a camera, which can capture images and obtain the user's depth information, and send this information to the multimedia playback device body to identify the user's identity and calculate the distance between the user and the audio playback device. The user positioning and identification device 730 may be a user positioning and identification device built into the multimedia playback device, such as a built-in camera in a mobile phone. Specifically, when there are multiple user positioning and identification devices 730, they can be used as a sensor network to locate and identify users, and send the positioning information and identification information to the multimedia playback device body.
[0111] In some embodiments, the multimedia playback device also includes a remote control device for remotely controlling the playback of the multimedia playback device body, and can also be used to receive user triggers and input the user's volume control parameters, user identity information, etc. into the multimedia playback device body.
[0112] The embodiment of the present application further provides a computer-readable storage medium, one or more non-volatile computer-readable storage media containing computer-executable instructions, when the computer-executable instructions are executed by one or more processors, the processors execute the steps of the volume control method.
[0113] A computer program product comprising instructions, when executed on a computer, causes the computer to perform a volume control method.
[0114] Any reference to memory, storage, database or other medium used in this application may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM), which is used as an external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
[0115] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.
Claims
1. A volume control method for an audio playback device, characterized in that: The method comprises: If at least two users are detected, obtaining the distance between each user and the audio playback device, and the volume control parameters corresponding to each user, and the number of the audio playback devices is at least two; If the audio playback device closest to each user is the same, the volume of the audio playback device is controlled according to the distance between each user and the audio playback device closest to each user and the volume control parameters corresponding to each user, wherein the volume control parameters corresponding to each user are weighted by weights of the volume control parameters corresponding to each user to obtain adjusted volume control parameters, and the adjusted volume control parameters are used to control the volume of the audio playback device, and the distance between the user and the audio playback device closest to each user is the weight of the volume control parameters corresponding to each user, and the greater the distance, the greater the weight of the volume control parameter; If the audio playback devices closest to the users are different and the distance between the users is greater than a preset distance, the volume of the audio playback devices closest to the users is controlled according to the audio control parameters of the audio playback devices closest to the users.
2. The method according to claim 1, characterized in that The volume of the audio playback device closest to the user is controlled according to the distance between the user and the audio playback device closest to the user and the volume control parameters, and is determined by the following formula: Among them, V OUT is the adjusted volume control parameter, i is the number of users, Di is the distance between each user and the audio playback device, and Vi is the volume control parameter of the audio playback device corresponding to each user.
3. The method according to claim 1, characterized in that There are at least two audio playback devices. If a user is detected, the distance between the user and each audio playback device is obtained, and a corresponding volume control parameter is obtained according to the distance of the audio playback device closest to the user, and the volume of the audio playback device closest to the user is controlled according to the volume control parameter.
4. The method according to claim 3, characterized in that If a user is detected, the power of the audio playback device closest to the user is controlled to be in an operating state, and the power of other audio playback devices is controlled to be in an off state.
5. The method according to claim 3, characterized in that: If no user is detected, and no user is detected for a preset time or it is detected that each audio playback device is in a closed playback state, the power of each audio playback device is controlled to enter a closed state.
6. The method according to claim 1, characterized in that The method further comprises: Identify the user; Obtaining the distance between the user and the audio playback device; Acquire the audio device closest to the user, and update the audio setting information of the user, wherein the audio setting information includes the user identity information, the distance and the volume control parameter, and the volume control parameter has a corresponding relationship with the user identity information and the distance of the audio playback device closest to the user; Detecting the location of the user, and if the location of the user is updated, returning to the step of identifying the user's identity; The step of obtaining the volume control parameter includes: when a user is detected, identifying the identity of the user, and obtaining the corresponding volume control parameter according to the identity verification information of the user and the distance of the audio playback device closest to the user.
7. The method according to claim 1, characterized in that The following steps are also included: Detecting different distances between each user and the corresponding audio playback device, and obtaining various audio control parameters adapted to different distances input by the user through remote control; Perform regression fitting according to the different distances and the audio control parameters corresponding to the respective distances to obtain a regression fitting equation of the distance and the volume control parameters; The acquiring the volume control parameter corresponding to each user includes: acquiring the volume control parameter corresponding to each user according to the distance between each user and the corresponding audio playback device and the regression fitting equation corresponding to each user.
8. The method according to claim 6, characterized in that The step of identifying the user identity comprises: Obtaining the user’s biometric data; Based on the biometric data, the user's identity is identified using a pre-trained model.
9. The method according to claim 8, characterized in that The identifying the identity of the user using a pre-trained model according to the biometric data includes: Calibrate the user's biometric data; Acquire positioning data from calibration data using the pre-trained model, the positioning data including bounding box area data on a three-dimensional or two-dimensional user image contour; Using the pre-trained model to extract features from the positioning data; The feature extraction data is input into the pre-trained model, and the pre-trained model is used to classify users into known users and unknown users, and known users are classified according to their identity information. If the user is a new user and the volume needs to be set, the user is added to the sample library. If the user does not need to set the volume, the user is removed from the sample library.
10. The method according to claim 1, characterized in that The method further comprises the following steps: Acquire scanning data of each user positioning and identification device at different positions in the multimedia presentation environment; Merging the scan data, and acquiring a three-dimensional space model of the multimedia demonstration environment according to the merged scan data; calibrating the combined scan data with the sound coverage of the multimedia presentation environment; If the calibration is successful, updating the position of the multimedia playback device in the three-dimensional space model to a reference viewpoint in the multimedia presentation environment; The obtaining of the distance between each user and the audio playback device includes obtaining the positions of each user and the audio playback device relative to the reference viewpoint, and calculating the distance between each user and the audio playback device.
11. A volume control device, characterized in that: include: An expected volume and distance acquisition module, for acquiring the distance between each user and the audio playback device and the volume control parameters corresponding to each user if at least two users are detected, and the number of the audio playback devices is at least two; A volume control module, for controlling the volume of the audio playback device according to the distance between each user and the audio playback device and the volume control parameters corresponding to each user, if the audio playback device closest to each user is the same, wherein the volume control parameters corresponding to each user are weighted by weights of the volume control parameters corresponding to each user to obtain adjusted volume control parameters, and the adjusted volume control parameters are used to control the volume of the audio playback device, and the distance between the user and the audio playback device closest to each user is the weight of the volume control parameters corresponding to each user, and the greater the distance, the greater the weight of the volume control parameter; if the audio playback devices closest to each user are different, and the distance between each user is greater than a preset distance, the volume of the audio playback device closest to each user is controlled according to the audio control parameters of each user for the audio playback device closest to each user.
12. A multimedia playback device, characterized in that: The device comprises a memory, a processor, at least one audio playback device and at least one user positioning and identification device, wherein the processor is respectively connected to the memory, the audio playback device and the user positioning and identification device for communication, the audio playback device is used to play the audio of the multimedia playback device and adjust the volume in response to the control of the processor, and the user identification and positioning device is used to identify the user and detect the distance between the user and the audio playback device; A computer program is stored in the memory. When the computer program is executed by the processor, the processor executes the steps of the volume control method according to any one of claims 1 to 10.
13. A non-volatile readable storage medium storing one or more computer readable instructions, characterized in that: When the computer readable instructions are executed by one or more processors, the one or more processors are caused to perform the steps of the method according to any one of claims 1 to 10.
Citation Information
Patent Citations
Volume adjusting method and display equipment
CN104618796A
Multimedia equipment playing control method and multimedia system
CN108429562A
Sound box control method, device and equipment and computer readable medium
CN108513207A
Intelligent device and volume control method thereof
CN110049404A
Intelligent device volume control method and system
CN110248021A
