Display method of sound information and electronic device

Abstract

The application relates to the terminal field and provides a display method of listening information and an electronic device. The display method is applied to the electronic device, and the display method comprises the following steps: a first interface is displayed, the first interface comprises a first control; a first operation on the first control is detected; in response to the first operation, a hearing protection mode of the electronic device is started; it is detected that the electronic device is connected with an audio playing device, the audio playing device is a wearable device of a user; listening information of the user is acquired, the listening information comprises volume information and time information, the volume information is used for indicating the volume size of the listening of the user through the audio playing device, and the time information is used for indicating the listening duration of the user through the audio playing device at different volume sizes; a second interface is displayed, and the second interface comprises the volume information and the time information. Based on the technical scheme of the application, the listening habit of the user can be accurately reflected based on multi-dimensional information, and the hearing protection of the user is facilitated.

Description

TECHNICAL FIELD

[0001] The present application relates to the terminal field, in particular to a display method of listening information and an electronic device. BACKGROUND

[0002] With the rapid development of mobile Internet and the popularization of intelligent mobile communication electronic devices, the functions carried by electronic devices are also increasing. In daily life, users can be seen wearing earphones to play music, play games or watch movies on electronic devices everywhere. In recent years, the field of hearing health has received widespread attention from users, and the monitoring of listening information (also known as listening dose) by electronic devices is an important part of the field of hearing health.

[0003] Currently, if the hearing protection function is enabled in the electronic device, the electronic device can display the maximum decibel value and the minimum decibel value of the user's listening monitored in a period of time; however, only displaying the maximum decibel value and the minimum decibel value of the user's listening monitored in the electronic device cannot accurately reflect the user's listening habits. SUMMARY

[0004] The present application provides a display method of listening information and an electronic device, which can accurately reflect the user's listening habits based on multi-dimensional information, and is beneficial to hearing protection for users.

[0005] In a first aspect, a display method of listening information is provided, applied to an electronic device, comprising:

[0006] displaying a first interface, the first interface comprising a first control;

[0007] detecting a first operation on the first control;

[0008] in response to the first operation, enabling a hearing protection mode of the electronic device;

[0009] detecting that the electronic device is connected to an audio playback device, the audio playback device being a wearable device of a user;

[0010] obtaining listening information of the user, the listening information comprising volume information and time information, the volume information being used to indicate a volume size of the user's listening through the audio playback device, and the time information being used to indicate a listening duration of the user at different volume sizes through the audio playback device;

[0011] displaying a second interface, the second interface comprising the volume information and the time information.

[0012] It should be understood that the hearing protection mode can refer to a mode of healthy use of a mobile phone in an electronic device; wherein the hearing protection refers to real-time monitoring of earphone volume and listening time, so that the user knows the situation of using the earphone volume. When the user uses the earphone for a long time or is exposed to high volume, the user is timely reminded to adjust the volume or give the ear a rest.

[0013] In a possible implementation, the first control can refer to a control for starting the hearing protection; and the first operation can refer to an operation of clicking the first control by the user.

[0014] It should be understood that the above is exemplified by taking the first operation as a clicking operation; the first operation can also include a voice instruction operation, or other operations for instructing the electronic device to start the hearing protection mode; the above is exemplified and does not limit the present application in any way.

[0015] In the embodiments of the present application, in the case that the electronic device starts the hearing protection mode, the volume information and the listening time of different volume sizes can be displayed in the electronic device, so as to accurately reflect the listening habit of the user in a period of time based on multi-dimensional listening information; thereby the listening information of the user can be intuitively reflected, which is beneficial to hearing protection of the user.

[0016] In combination with the first aspect, in some implementations of the first aspect, the second interface includes a first statistical chart, and the first statistical chart is used to display the listening time of the user at different volume sizes in a unit of time.

[0017] In the embodiments of the present application, the first statistical chart can be used to display the listening time of the user at different volume sizes in a unit of time; that is, not only the decibel value range of the user listening can be displayed, but also the listening time in each decibel range can be displayed; thereby the listening habit of the user can be accurately predicted, the user is reminded when the volume of the user listening is too large or the time process of the listening volume, which is beneficial to hearing protection of the user.

[0018] In combination with the first aspect, in some implementations of the first aspect, further comprising:

[0019] detecting a second operation on the first statistical chart;

[0020] in response to the second operation, displaying a third interface, and the third interface includes the volume information and the time information corresponding to at least one application program in the electronic device.

[0021] In the embodiments of the present application, the user can operate the first statistical diagram to realize switching of different statistical diagram images; for example, the first statistical diagram can be switched to a statistical diagram image displaying listening information corresponding to different application programs in the electronic device, so that the listening habit of the user can be accurately predicted, the user is reminded when the volume of the listening is too large or the time length of the listening volume, and the hearing protection of the user is facilitated.

[0022] With reference to the first aspect, in some implementations of the first aspect, the second operation is an operation of selecting a first volume range, and the third interface includes a second statistical diagram, the second statistical diagram being configured to display a listening time length of each of the at least one application program in the first volume range.

[0023] With reference to the first aspect, in some implementations of the first aspect, the third interface includes a third statistical diagram, the third statistical diagram being configured to display the volume size and the time information corresponding to each of the at least one application program.

[0024] With reference to the first aspect, in some implementations of the first aspect, the obtaining of the listening information of the user includes:

[0025] obtaining an audio signal sent by the electronic device to the audio playback device within a preset time length;

[0026] predicting the volume information based on the audio signal;

[0027] obtaining the time information based on the preset time length.

[0028] With reference to the first aspect, in some implementations of the first aspect, the predicting of the volume information based on the audio signal includes:

[0029] predicting the volume information based on the audio signal and a target first transfer function, the target first transfer function being configured to represent a transfer function from a loudspeaker in the audio playback device to an eardrum of the user in a current wearing state.

[0030] It should be understood that for different users, the depth and width of the ear canal are different, and the target first transfer function is different. For the same user, based on the tightness of the different wearing earphones, the target first transfer function from the loudspeaker in the audio playback device to the eardrum of the user is also different.

[0031] In the embodiments of the present application, the volume information can be predicted based on the audio signal and the target first transfer function conforming to the current wearing state, which can improve the accuracy of predicting the volume information heard by the eardrum of the user, thereby better protecting the hearing of the user.

[0032] With reference to the first aspect, in some implementations of the first aspect, the volume information is obtained by the following formula:

[0033]

[0034] wherein, represents an estimated value of the volume, FFT() represents a Fourier transform; W A represents an A-weighting vector; S F represents a frame of the audio signal, G represents the target first transfer function; t0 represents the preset time length.

[0035] It should be understood that the audio signal can be transformed into the frequency domain by the Fourier transform; the audio signal can be made to conform to the hearing characteristics of the user by the A-weighting vector; the function f() can obtain the listening volume estimate value of the A-weighting energy of the audio signal in the preset time interval t0

[0036] With reference to the first aspect, in some implementations of the first aspect, further comprising:

[0037] obtaining a current wearing state of the user, the current wearing state being a state in which the user currently wears the audio playback device;

[0038] determining the target first transfer function in a sample data set based on the current wearing state, the sample data set including a plurality of groups of data, each group of data in the plurality of groups of data including a first transfer function and a second transfer function, the first transfer function and the second transfer function corresponding to each other, the first transfer function being a transfer function from a loudspeaker in the audio playback device to an eardrum of the user, and the second transfer function being a transfer function from the loudspeaker in the audio playback device to a built-in microphone in the audio playback device.

[0039] With reference to the first aspect, in some implementations of the first aspect, the determining the target first transfer function in the sample data set based on the current wearing state comprises:

[0040] playing prompt information by the audio playback device after detecting that the user wears the audio playback device;

[0041] obtaining a target second transfer function based on the prompt information, the target second transfer function being the second transfer function that matches the current wearing state;

[0042] performing a difference between the target second transfer function and the second transfer function in the sample data set to obtain a target group of data in the sample data set;

[0043] obtaining the target first transfer function based on the target group data.

[0044] Exemplarily, after the user wears the earphone, an in-ear prompt sound is played by the loudspeaker of the audio playing device, and after the prompt sound is received by the built-in microphone of the audio playing device, the current listening state recognition can be performed to obtain an estimated value P1 of the transfer function from the loudspeaker to the built-in microphone in the audio playing device under the current listening state. The estimated value P1 is compared with all the transfer functions P i with the smallest difference from the estimated value P1 is obtained. i0 That is, a group of data {G i0 , P i0} is obtained; the group of data is the target first transfer function matched with the current wearing state.

[0045] With reference to the first aspect, in some implementations of the first aspect, the wearable device includes an earphone.

[0046] Optionally, in a possible implementation, the wearable device can be virtual reality glasses.

[0047] In a second aspect, an electronic device is provided, which includes one or more processors and a memory; the memory is coupled to the one or more processors, and the memory is configured to store computer program codes including computer instructions, and the one or more processors are configured to invoke the computer instructions to enable the electronic device to perform the following steps:

[0048] displaying a first interface, the first interface including a first control;

[0049] detecting a first operation on the first control;

[0050] in response to the first operation, starting a hearing protection mode of the electronic device;

[0051] detecting that the electronic device is connected to an audio playing device, the audio playing device being a wearable device of a user;

[0052] obtaining listening information of the user, the listening information including volume information and time information, the volume information being used to indicate a volume size at which the user listens to audio through the audio playing device, and the time information being used to indicate a listening duration of the user at different volume sizes through the audio playing device;

[0053] displaying a second interface, the second interface including the volume information and the time information.

[0054] With reference to the second aspect, in some implementations of the second aspect, the second interface includes a first statistical diagram, the first statistical diagram being configured to display listening time of the user at different volume levels in a unit of time.

[0055] With reference to the second aspect, in some implementations of the second aspect, the one or more processors invoke the computer instructions to cause the electronic device to perform:

[0056] detect a second operation on the first statistical diagram;

[0057] in response to the second operation, display a third interface, the third interface including the volume information and the time information corresponding to at least one application program in the electronic device.

[0058] With reference to the second aspect, in some implementations of the second aspect, the second operation is an operation of selecting a first volume range, and the third interface includes a second statistical diagram, the second statistical diagram being configured to display listening time of each of the at least one application program in the first volume range.

[0059] With reference to the second aspect, in some implementations of the second aspect, the third interface includes a third statistical diagram, the third statistical diagram being configured to display the volume level and the time information corresponding to each of the at least one application program.

[0060] With reference to the second aspect, in some implementations of the second aspect, the one or more processors invoke the computer instructions to cause the electronic device to perform:

[0061] obtain audio signals sent by the electronic device to the audio playback device in a preset time period;

[0062] obtain the volume information based on the audio signals;

[0063] obtain the time information based on the preset time period.

[0064] With reference to the second aspect, in some implementations of the second aspect, the one or more processors invoke the computer instructions to cause the electronic device to perform:

[0065] obtain the volume information based on the audio signals and a target first transfer function, the target first transfer function being configured to represent a transfer function from a loudspeaker in the audio playback device to an eardrum of the user in a current wearing state.

[0066] With reference to the second aspect, in some implementations of the second aspect, the volume information is obtained by the following formula:

[0067]

[0068] wherein, represents an estimated value of the volume; FFT() represents a Fourier transform; W A represents an A-weighting vector; S F represents a frame of the audio signal, G represents the target first transfer function; t0 represents the preset time length.

[0069] With reference to the second aspect, in some implementations of the second aspect, the one or more processors invoke the computer instructions to cause the electronic device to perform:

[0070] obtain a current wearing state of the user, the current wearing state being a state in which the user currently wears the audio playback device;

[0071] determine the target first transfer function in a sample data set based on the current wearing state, the sample data set including a plurality of groups of data, each group of data in the plurality of groups of data including a first transfer function and a second transfer function, the first transfer function and the second transfer function corresponding to each other, the first transfer function being a transfer function from a loudspeaker in the audio playback device to an eardrum of the user, and the second transfer function being a transfer function from the loudspeaker in the audio playback device to a built-in microphone in the audio playback device.

[0072] With reference to the second aspect, in some implementations of the second aspect, the one or more processors invoke the computer instructions to cause the electronic device to perform:

[0073] after detecting that the user wears the audio playback device, the audio playback device plays prompt information;

[0074] obtain a target second transfer function based on the prompt information, the target second transfer function being the second transfer function that matches the current wearing state;

[0075] subtract the target second transfer function from the second transfer function in the sample data set to obtain a target group of data in the sample data set;

[0076] obtain the target first transfer function based on the target group of data.

[0077] With reference to the second aspect, in some implementations of the second aspect, the wearable device includes a headset.

[0078] In a third aspect, an electronic device is provided, including a module / unit for executing the first aspect or the display method of the listening information in any of the first aspect.

[0079] In a fourth aspect, an electronic device is provided, which includes one or more processors, a memory; the memory is coupled with the one or more processors, the memory is configured to store computer program codes, the computer program codes include computer instructions, the one or more processors invoke the computer instructions to enable the electronic device to perform the display method in the first aspect and any one of the implementation manners of the first aspect.

[0080] In a fifth aspect, a chip system is provided, which is applied to an electronic device, the chip system includes one or more processors, the processor is configured to invoke computer instructions to enable the electronic device to perform the display method in the first aspect and any one of the implementation manners of the first aspect.

[0081] In a sixth aspect, a computer readable storage medium is provided, which stores computer program codes, when the computer program codes are run by an electronic device, the electronic device is enabled to perform the display method in the first aspect and any one of the implementation manners of the first aspect.

[0082] In a seventh aspect, a computer program product is provided, which includes computer program codes, when the computer program codes are run by an electronic device, the electronic device is enabled to perform the display method in the first aspect and any one of the implementation manners of the first aspect.

[0083] In the embodiments of the present application, when the electronic device is in the hearing protection mode, the volume information and the listening duration of different volume sizes can be displayed in the electronic device, so as to accurately reflect the user's listening habit in a period of time based on multi-dimensional listening information, thereby intuitively reflecting the user's listening information, reminding the user when the listening volume is too large or the listening volume duration is too long, and being beneficial to hearing protection of the user. BRIEF DESCRIPTION OF DRAWINGS

[0084] Figure 1 FIG. 1 is a schematic diagram of a hardware system suitable for the electronic device of the present application;

[0085] Figure 2 FIG. 1 is a schematic diagram of a hardware system suitable for the electronic device of the present application;

[0086] Figure 3 FIG. 1 is a schematic diagram of a hardware system suitable for the electronic device of the present application;

[0087] Figure 4 FIG. 1 is a schematic diagram of a hardware system suitable for the electronic device of the present application;

[0088] Figure 5 This is a schematic diagram of a graphical user interface applicable to embodiments of this application;

[0089] Figure 6 This is a schematic diagram of a graphical user interface applicable to embodiments of this application;

[0090] Figure 7 This is a schematic diagram illustrating the display of audio information provided in an embodiment of this application;

[0091] Figure 8 This is a schematic diagram of a graphical user interface applicable to embodiments of this application;

[0092] Figure 9 This is a schematic diagram of a graphical user interface applicable to embodiments of this application;

[0093] Figure 10 This is a schematic diagram of a graphical user interface applicable to embodiments of this application;

[0094] Figure 11 This is a schematic diagram of a graphical user interface applicable to embodiments of this application;

[0095] Figure 12 This is a schematic diagram of a graphical user interface applicable to embodiments of this application;

[0096] Figure 13 This is a schematic diagram of a graphical user interface applicable to embodiments of this application;

[0097] Figure 14 This is a schematic diagram of a graphical user interface applicable to embodiments of this application;

[0098] Figure 15 This is a schematic diagram of a graphical user interface applicable to embodiments of this application;

[0099] Figure 16 This is a schematic flowchart illustrating a method for displaying audio information provided in an embodiment of this application;

[0100] Figure 17 This is a schematic diagram illustrating the direction of sound volume division according to an embodiment of this application;

[0101] Figure 18 This is a schematic flowchart illustrating a method for displaying audio information provided in an embodiment of this application;

[0102] Figure 19 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application;

[0103] Figure 20 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. DETAILED DESCRIPTION

[0104] In the embodiments of the present application, the terms "first", "second" and the like are used only for descriptive purposes, and cannot be construed as indicating or implying relative importance or implying the number of the indicated technical features. Therefore, the features defined with "first", "second" can explicitly or implicitly include one or more of the features. In the description of the embodiments, the meaning of "a plurality of" is two or more, unless otherwise specified.

[0105] In order to facilitate the understanding of the embodiments of the present application, first, the related concepts involved in the embodiments of the present application are briefly described.

[0106] 1. Hearing protection

[0107] Hearing protection refers to real-time monitoring of earphone volume and listening time, so that the user can know the situation of using earphone volume. When the user uses the earphone for a long time or is exposed to high volume, the user is reminded to adjust the volume or let the ear rest in time.

[0108] 2. Transfer function

[0109] The transfer function refers to the ratio of the Laplace transform (or z transform) of the response (i.e. output) quantity of the linear system under zero initial condition to the Laplace transform of the excitation (i.e. input) quantity.

[0110] 3. Fourier transform

[0111] Fourier transform is a linear integral transform used to represent the transformation between the time domain (or, spatial domain) and the frequency domain of a signal.

[0112] 4. A weighting

[0113] As we know, the human ear's perception of sound intensity is not only related to sound pressure (the sound pressure range that the human ear can hear is 2×10 -5 Pa~20Pa, converted into sound pressure level SPL, i.e. 0~120dB), but also related to frequency (the frequency range that the human ear can hear is 20Hz~20kHz), and the human ear is not sensitive to different frequencies; A weighting corresponds to the equal response curve of the human ear to 40 pure tones.

[0114] Figure 1 A hardware system suitable for the electronic device of the present application is shown.

[0115] The electronic device 100 can be a mobile phone, a smart television, a tablet computer, a wearable electronic device, a vehicle-mounted electronic device, an augmented reality (AR) device, a virtual reality (VR) device, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), a projector, or the like. The embodiments of the present application do not limit the specific type of the electronic device 100.

[0116] The electronic device 100 can include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a loudspeaker 170A, a receiver 170B, a microphone 170C, a headset interface 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 can include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0117] It should be noted that, Figure 1 The structures shown do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 can include more or fewer components than those shown, or the electronic device 100 can include a combination of some of the components shown, or the electronic device 100 can include sub-components of some of the components shown. Figure 1 The structures shown do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 can include more or fewer components than those shown, or the electronic device 100 can include a combination of some of the components shown, or the electronic device 100 can include sub-components of some of the components shown. Figure 1 The structures shown do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 can include more or fewer components than those shown, or the electronic device 100 can include a combination of some of the components shown, or the electronic device 100 can include sub-components of some of the components shown. Figure 1 The structures shown do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 can include more or fewer components than those shown, or the electronic device 100 can include a combination of some of the components shown, or the electronic device 100 can include sub-components of some of the components shown. Figure 1 The components shown can be implemented in hardware, software, or a combination of software and hardware.

[0118] The processor 110 can include one or more processing units. For example, the processor 110 can include at least one of the following processing units: an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, a neural-network processing unit (NPU). Among them, different processing units can be independent devices or integrated devices. The controller can generate operation control signals according to instruction operation codes and timing signals, and complete the control of fetching and executing instructions.

[0119] The processor 110 can also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory can save instructions or data that the processor 110 has just used or repeatedly uses. If the processor 110 needs to use the instructions or data again, it can directly call from the memory. Avoiding repeated access reduces the waiting time of the processor 110, thereby improving the efficiency of the system.

[0120] Exemplarily, the processor 110 can be configured to execute the method for displaying listening information according to the embodiments of the present application. For example, a first interface is displayed, the first interface comprising a first control; a first operation on the first control is detected; in response to the first operation, a hearing protection mode of the electronic device is started; it is detected that the electronic device is connected to an audio playback device, the audio playback device being a wearable device of the user; listening information of the user is obtained, the listening information comprising volume information and time information, the volume information being used to indicate a volume size at which the user listens to audio through the audio playback device, and the time information being used to indicate a listening duration of the user at different volume sizes through the audio playback device; a second interface is displayed, the second interface comprising the volume information and the time information.

[0121] Figure 1 The connection relationship between the modules shown is only illustrative and does not constitute a limitation on the connection relationship between the modules of the electronic device 100. Alternatively, the modules of the electronic device 100 can also adopt a combination of the above-mentioned various connection modes.

[0122] The wireless communication function of the electronic device 100 can be realized through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor, etc.

[0123] Antenna 1 and antenna 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of antennas. For example: antenna 1 can be multiplexed as a diversity antenna of a wireless local area network. In some other embodiments, antennas can be used in combination with a tuning switch.

[0124] Electronic device 100 can realize display functions through GPU, display screen 194 and application processor. GPU is a microprocessor for image processing, connected to display screen 194 and application processor. GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 can include one or more GPUs that execute program instructions to generate or change display information.

[0125] Display screen 194 can be used to display images or videos.

[0126] Exemplarily, in the embodiments of the present application, display screen 194 can be used to display a second image.

[0127] Electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor, etc.

[0128] ISP is used to process data fed back by camera 193. For example, when taking a photo, the shutter is opened, the light passes through the camera and is transmitted to the camera photosensitive element, the light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing to convert it into an image visible to the naked eye. ISP can optimize the noise, brightness and color of the image through algorithms, and ISP can also optimize the exposure and color temperature of the shooting scene and other parameters. In some embodiments, ISP can be provided in camera 193.

[0129] The camera 193 (may also be referred to as a lens) is used to capture still images or videos. The camera 193 can be triggered to start by application instructions, and the camera 193 can be used to take pictures, such as capturing images of any scene. The camera 193 can include an imaging lens, a filter, an image sensor, and the like. Light emitted or reflected by an object enters the imaging lens, passes through the filter, and finally converges on the image sensor. The imaging lens is mainly used to converge the light emitted or reflected by all objects (may also be referred to as a scene to be photographed, a target scene, and can also be understood as a scene image that a user expects to photograph) in the photographing angle of view into an image; the filter is mainly used to filter out excess light waves (for example, light waves other than visible light, such as infrared) in the light; and the image sensor can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The image sensor is mainly used to perform photoelectric conversion on the received light signal, convert the light signal into an electrical signal, and then transmit the electrical signal to an ISP to convert the electrical signal into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into a standard RGB, YUV, or the like image signal.

[0130] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy, and the like.

[0131] The video codec is used to compress or decompress digital videos. The electronic device 100 can support one or more video codecs. In this way, the electronic device 100 can play or record videos in multiple encoding formats, such as moving picture experts group (MPEG) 1, MPEG 2, MPEG 3, and MPEG 4.

[0132] The gyroscope sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., the x-axis, the y-axis, and the z-axis) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for anti-shake photography. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of shaking of the electronic device 100, calculates the distance that needs to be compensated by the lens module according to the angle, and lets the lens offset the shaking of the electronic device 100 by reverse movement, thereby achieving anti-shake. The gyroscope sensor 180B can also be used in scenarios such as navigation and motion sensing games.

[0133] The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 100 in various directions (typically, x-axis, y-axis, and z-axis). The magnitude and direction of gravity can be detected when the electronic device 100 is stationary. The acceleration sensor 180E can also be used to identify the posture of the electronic device 100 as an input parameter for applications such as a horizontal-vertical screen switching and a pedometer.

[0134] The distance sensor 180F is used to measure distance. The electronic device 100 can measure distance by infrared or laser. In some embodiments, for example, in a scene shooting, the electronic device 100 can use the distance sensor 180F to measure distance to achieve fast focusing.

[0135] The ambient light sensor 180L is used to sense ambient light brightness. The electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the sensed ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking a photo. The ambient light sensor 180L can also work with the proximity light sensor 180G to detect whether the electronic device 100 is in a pocket to prevent accidental touch.

[0136] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to achieve functions such as unlocking, accessing application lock, taking photos, and answering incoming calls.

[0137] The touch sensor 180K, also known as a touch device. The touch sensor 180K can be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also known as a touch screen. The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor 180K can pass the detected touch operation to the application processor to determine the touch event type. The visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be disposed on the surface of the electronic device 100, and disposed at a different position from the display screen 194.

[0138] The hardware system of the electronic device 100 is described in detail above, and the software system of the electronic device 100 is introduced below.

[0139] Figure 2 is a software structure block diagram of the electronic device 100 of the embodiments of the present application.

[0140] It should be understood that the layered architecture can divide the software into several layers, each layer has a clear role and division of labor; layers can communicate with each other through a software interface.

[0141] As Figure 2As shown, the Android system can be divided into four layers; from top to bottom, they are the application layer, the application framework layer, the Android runtime and system library, and the kernel layer. The application layer can include a series of application packages.

[0142] As shown, the application packages can include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc. Figure 2

[0143] The application framework layer provides application programming interface (API) and programming framework for the applications of the application layer. The application framework layer includes some pre-defined functions.

[0144] As shown, the application framework layer can include window manager, content provider, view system, phone manager, resource manager, notification manager, etc. Figure 2

[0145] The window manager is used to manage window programs. The window manager can acquire the size of the display screen, determine whether there is a status bar, lock the screen, and intercept the screen, etc.

[0146] The content provider is used to store and acquire data, and make the data accessible by the applications. The data can include video, image, audio, dialed and received calls, browsing history and bookmarks, phonebook, etc.

[0147] The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a short message notification icon can include a view for displaying text and a view for displaying pictures.

[0148] The phone manager is used to provide the communication function of the electronic device 100. For example, the management of call status (including call connection, call hang-up, etc.).

[0149] The resource manager provides various resources for the applications, such as localized strings, icons, pictures, layout files, video files, etc.

[0150] ​​The notification manager enables applications to display notification information in the status bar, which can be used to convey alert-type messages that can automatically disappear after a brief stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the form of a figure or a scroll bar text in the top status bar of the system, such as a notification of an application running in the background, and can also be a notification that appears in the form of a dialog window on the screen. For example, the status bar prompts text information, emits a prompt sound, the terminal device vibrates, the indicator light flashes, etc.

[0151] The Android runtime includes a core library and a virtual machine; the Android runtime is responsible for scheduling and managing the Android system. The core library contains two parts: one part is the function function that the java language needs to call, and the other part is the core library of Android.

[0152] The application layer and the application framework layer run in the virtual machine. The virtual machine executes the java files of the application layer and the application framework layer into binary files. The virtual machine is used to perform the management of the object life cycle, the management of the stack, the management of the thread, the management of the security and the exception, and the garbage collection, etc.

[0153] The system library can include multiple functional modules, for example: a surface manager, media libraries, a three-dimensional graphics processing library (for example: open graphics library for embedded systems (OpenGL ES) and a 2D graphics engine (for example: skia graphics library (SGL)).

[0154] The surface manager is used to manage the display subsystem, and provides a fusion of 2D and 3D layers for multiple applications.

[0155] The media library supports playback and recording of multiple audio formats, playback and recording of multiple video formats, and static image files. The media library can support multiple audio and video encoding formats, such as MPEG4, H.264, moving picture experts group audio layer III (MP3), advanced audio coding (AAC), adaptive multi-rate (AMR), joint photographic experts group (JPG), and portable network graphics (PNG).

[0156] The three-dimensional graphics processing library is used to implement three-dimensional graphics drawing, image rendering, composition, and layer processing.

[0157] The 2D graphics engine is a drawing engine for 2D drawing.

[0158] The kernel layer is a layer between hardware and software. The kernel layer at least includes a display driver, a camera driver, an audio driver, and a sensor driver.

[0159] For ease of understanding, the following embodiments of the present application will take an electronic device as shown in Figure 1 and Figure 2 as an example, and the display method of the listening information provided by the embodiments of the present application will be specifically described in combination with the accompanying drawings and application scenarios.

[0160] Figure 3 is a schematic diagram of an application scenario of the display method of the listening information provided by the embodiments of the present application.

[0161] Exemplarily, as shown in Figure 3 the display method of the listening information provided by the embodiments of the present application can be applied to a scenario in which a user wears an audio playing device (for example, an earphone); for example, the earphone 220 is connected with the electronic device 100, and the user plays audio information through the earphone 220; after the electronic device opens the hearing protection mode, the electronic device 100 can display a display interface 210; the display interface 210 can include listening monitoring information of today and the past seven days, and the monitoring information can include a maximum decibel value of the user's listening and a minimum decibel value of the listening.

[0162] For example, as shown in Figure 3 the display interface 210 can include the maximum decibel value and the minimum decibel value of the user's listening at 0 o'clock, 8 o'clock, 16 o'clock and 24 o'clock today; and the average decibel value of the user's listening today is 72 decibel values.

[0163] Currently, after the electronic device opens the hearing protection function, the electronic device can display a hearing protection interface; the hearing protection interface can include the user's listening information monitored by the electronic device, such as the display interface 210 shown in Figure 3 Since only the maximum decibel value and the minimum decibel value of the user's listening monitored in the electronic device are displayed, the user's listening habits cannot be accurately reflected; for example, as shown in Figure 4 The maximum decibel value and the minimum decibel value in the column chart 230 and the column chart 240 are exactly the same, so the listening information of the user on Thursday and Friday is exactly the same according to the chart; however, the actual listening situation of the user on Thursday and Friday can be different, for example, the user can touch the volume adjustment control by mistake on Friday, so that the volume of the earphone is large for a few seconds; therefore, the existing hearing protection display interface cannot accurately reflect the user's listening information, so that the electronic device cannot effectively protect the user's hearing.

[0164] Therefore, the display method of listening information provided in the embodiments of the present application can display the volume information and the listening duration of different volume sizes in the electronic device when the electronic device opens the hearing protection mode, can intuitively reflect the user's listening information, and accurately reflect the user's listening habits in a period of time based on multi-dimensional listening information, which is beneficial to protect the user's hearing.

[0165] The display method of listening information and the electronic device provided in the embodiments of the present application will be described in detail below. Figures 5 to 18 The display method of listening information and the electronic device provided in the embodiments of the present application will be described in detail below.

[0166] Exemplarily, Figure 5 is a display interface schematic diagram of listening information provided in the embodiments of the present application.

[0167] In the embodiments of the present application, the hearing protection mode in the electronic device can be opened; after the electronic device opens the hearing protection mode, the electronic device can monitor the user's listening health and display the monitored user's listening information. For example, as shown in Figure 5 (a) of FIG. 1, after the electronic device detects that the user clicks the icon 302 of the setting application program on the desktop 301, the setting display interface can be displayed; as shown in Figure 5 (b), the setting display interface can include the controls of display and brightness, the controls of sound and vibration, the controls of notification, and the controls of healthy use of mobile phone 303; the electronic device detects the operation of the user clicking the controls of healthy use of mobile phone 303, as shown in Figure 5 (c); after the electronic device detects the operation of the controls of healthy use of mobile phone 303, the healthy use of mobile phone display interface can be displayed; the healthy use of mobile phone display interface can include the opening control 304, as shown in Figure 5(d) of FIG. 6B; the electronic device detects an operation of the user tapping the start control 304, as shown in (e) of FIG. 6B; after the electronic device detects the operation of the start control 304, a display interface 305 can be displayed, as shown in (f) of FIG. 6B; the display interface 305 can include a control of usage statistics and a control of hearing protection 306. Figure 5 Figure 5

[0168] As shown in (a) of FIG. 6C, the electronic device detects an operation of the user tapping the control of hearing protection 306; after the electronic device detects the operation of the control of hearing protection 306, a display interface of hearing protection can be displayed, as shown in (b) of FIG. 6C; the display interface of hearing protection can include a prompt information "after starting, provide information and guidance to you by detecting your earphone volume and listening time", and a control 307 for indicating starting of hearing protection; the electronic device detects an operation of the user tapping the control 307 for indicating starting of hearing protection, as shown in (c) of FIG. 6C; after the electronic device detects the operation of the user tapping the control 307 for indicating starting of hearing protection, a display interface of listening information can be displayed; the display interface of listening information can include a control of statistical period 308, an icon 309, and a statistical chart 310 of listening information of each volume range in the statistical period; for example, the user taps the control of statistical period 308 of week, and a statistical chart 310 of listening information of the user based on the week can be displayed, as shown in (d) of FIG. 6C. Figure 6 Figure 6 Figure 6 Figure 6 For example, as shown in (d) of FIG. 6C, the control of statistical period 308 can include hour, day, week, month, and year; when the electronic device detects an operation of the user tapping different controls in the control of statistical period 308, the electronic device can generate a corresponding statistical chart of listening information based on different statistical periods; the statistical chart 310 can be a statistical chart of listening information of the user in a week, and the listening information includes a maximum decibel value and a minimum decibel value of listening in a day, and a listening time length in each decibel range; the icon 309 includes: less than 10 minutes, 10-30 minutes, 30-60 minutes, 60-120 minutes, and more than 120 minutes; wherein, less than 10 minutes means that the listening time length is less than 10 minutes; 10-30 minutes means that the listening time length is 10 minutes to 30 minutes; 30-60 minutes means that the listening time length is 30 minutes to 60 minutes; 60-120 minutes means that the listening time length is 60 minutes to 120 minutes; and more than 120 minutes means that the listening time length is more than 120 minutes.

[0169] Figure 6

[0170] ​​​​​​​Exemplarily, as shown in the statistical chart 310, on Sunday, the listening time of the user in the "40 dB-50 dB" range is 10 minutes to 30 minutes; the listening time of the user in the "50 dB-60 dB" range is 60 minutes to 120 minutes; the listening time of the user in the "60 dB-70 dB" range is greater than 120 minutes; and the listening time of the user in the "70 dB-75 dB" range is less than 10 minutes.

[0171] The display interface obtained based on the display method of listening information provided in the embodiments of the present application can include multi-dimensional information; for example, the maximum decibel value and the minimum decibel value of the user's listening in each time period, and the listening time of the user in each decibel value range can be included. Based on the display interface of the listening information, not only the maximum decibel value and the minimum decibel value of the user's listening, but also the listening time of the user in each decibel range are included. Therefore, the display method of listening information provided in the embodiments of the present application can display more listening information to the user. In addition, the multi-dimensional listening information can accurately reflect the listening habits of the user in a period of time, which is beneficial to hearing protection of the user.

[0172] Exemplarily, as shown in Figure 7 , the listening information of the user on Saturday is displayed as an example; the listening volume can be divided into N segments, and the N segments can include x1, x2,..., x N ; for example, 0-100 dB can be divided into 10 segments, x1 can be 0-10 dB; x2 can be 10-20 dB;... x 10 may be 90-100 dB; when displaying the listening information of the user on Saturday, the listening time of the user in different volume ranges can be displayed; thereby the specific listening time of the user in each volume range can be displayed intuitively, and the listening habits of the user can be accurately reflected, which is beneficial to better hearing protection of the user.

[0173] Optionally, the above is an example of dividing the listening volume into equal N segments, and the listening volume can also be divided into unequal N segments, which is not limited in the present application.

[0174] In one example, as shown in (a) of Figure 8 , the electronic device detects that the user clicks the ordinate of the statistical chart 310; after the electronic device detects that the user clicks the ordinate of the statistical chart 310, the display interface 311 shown in (b) of Figure 8 may be displayed; the display interface 311 can include the icon 312 of the decibel range and the statistical chart 313 of the listening information based on a certain decibel range.

[0175] Exemplarily, as shown in Figure 8As shown in (a), after the electronic device detects that the user clicks on the vertical axis between 25dB and 50dB, the electronic device can display the user's listening time and / or percentage of listening time for each application on the electronic device when the decibel value is between 25dB and 50dB; Figure 8 As shown in (b), the decibel range icon 312 can include: 0dB~25dB, 25dB~50dB, 50dB~75dB, and 75dB~100dB; based on the user's click operation, the currently selected range is 25dB~50dB; for each application in the electronic device, when the user's listening decibel value is "25dB~50dB", the statistical chart of the listening time of each application is shown in Statistical Chart 313; for example, for the decibel range of 25dB~50dB, the user, through the application The listening time for program 1 is t1; for the decibel range of 25dB to 50dB, the listening time for the user through application 2 is t2; for the decibel range of 25dB to 50dB, the listening time for the user through application 3 is t3; for the decibel range of 25dB to 50dB, the listening time for the user through application 4 is t4; for the decibel range of 25dB to 50dB, the listening time for the user through application 5 is t5; for the decibel range of 25dB to 50dB, the user's total listening time is T.

[0176] In one example, such as Figure 9 As shown in (a), the electronic device detects user clicks on the bar chart in the statistics chart 310; after the electronic device detects user clicks on the bar chart in the statistics chart 310, it can display as shown in (a). Figure 9 The display interface 314 shown in (b) includes statistical charts 315 based on different applications.

[0177] For example, such as Figure 9 As shown in (a), after the electronic device detects that the user clicks on the bar chart in statistics graph 310, the electronic device can display the listening time of each application within a unit of time; such as Figure 9 As shown in (b), the monitoring unit duration can be one week, and the statistical chart 315 is used to display the listening time of each application during the week; for example, the application may include application 1, application 2 or application 3, etc.

[0178] In one example, such as Figure 10 As shown in (a), the electronic device detects user clicks on the bar chart in the statistics chart 310; after the electronic device detects user clicks on the bar chart in the statistics chart 310, it can display as shown in (a). Figure 10The display interface 316 shown in (b) includes an icon 317 for decibel ranges and a statistical chart 318 showing the listening time of different applications in each decibel range.

[0179] For example, such as Figure 10 As shown in (a), after the electronic device detects that the user clicks on the bar chart in statistics graph 310, the electronic device can display the listening duration of each application within a unit of time in different decibel ranges; such as Figure 10 As shown in (b), the monitoring unit duration can be one week. Statistical chart 318 is used to display the listening time of each application in different decibel ranges during the week. For example, within one week, application 1's listening time in the "0dB~25dB" range is 0.5 hours, in the "25dB~50dB" range is 0.75 hours, in the "50dB~75dB" range is 0.6 hours, and in the "75dB~100dB" range is 0.4 hours. Within one week, application 2's listening time in the "0dB~25dB" range is 0.4 hours, in the "25dB~50dB" range is 0.5 hours, in the "50dB~75dB" range is 0.65 hours, and in the "75dB~100dB" range is 0.32 hours. Over a week, the listening time for application 3 was 0.35 hours in the "0dB~25dB" range, 0.5 hours in the "25dB~50dB" range, 0.35 hours in the "50dB~75dB" range, and 0.25 hours in the "75dB~100dB" range.

[0180] In one example, such as Figure 11 As shown in (a), the electronic device detects user clicks on the bar chart in the statistics graph 310; after the electronic device detects user clicks on the bar chart in the statistics graph 310, it can display the listening time of each application within a unit of time (e.g., within a week), such as Figure 11 As shown in (b); the display interface 314 includes a statistical chart 315, which is used to display the listening time of each application during the week; for example, the applications may include application 1, application 2, or application 3, etc.; Figure 11 As shown in (c), the electronic device detects that the user clicked the bar chart of application 1 in the statistics chart 315; after the electronic device detects that the user clicked the bar chart of application 1 in the statistics chart 315, the display interface 316 is displayed, as shown in (c). Figure 11 As shown in (d); the display interface 316 includes an icon 317 for decibel ranges and a statistical chart 318 showing the listening time of different applications in each decibel range.

[0181] It should be understood that the aboveFigure 10 The relevant description in (a) applies to Figure 11 (a) in the middle; similarly, Figure 10 The relevant description in (b) applies to Figure 11 (d) in the text will not be elaborated upon here.

[0182] In one example, such as Figure 12 As shown in (a), the electronic device detects user clicks on the bar chart in the statistics graph 310; after the electronic device detects user clicks on the bar chart in the statistics graph 310, it can display the listening time of each application within a unit of time (e.g., within a week), such as Figure 12 As shown in (b); the display interface 314 includes a statistical chart 315, which is used to display the listening time of each application during the week; for example, the applications may include application 1, application 2, or application 3, etc.; Figure 12 As shown in (c), the electronic device detects that the user clicked on application 1 in statistics chart 315; after the electronic device detects that the user clicked on application 1 in statistics chart 315, it displays display interface 319, as shown in [image / image]. Figure 12 As shown in (d) in the figure; the display interface 319 includes a statistical chart 320, which is used to display the listening duration information of the application 1 at different times within a unit of time (e.g., within a week).

[0183] For example, such as Figure 12 As shown in (d), the user's listening time through Application 1 was 0.8 hours on Sunday; 1 hour on Monday; 0.8 hours on Tuesday; 1.2 hours on Wednesday; 1.3 hours on Thursday; 0.6 hours on Friday; and 0.9 hours on Saturday.

[0184] It should be understood that Figure 12 The statistical chart 320 shown in (d) is for illustrative purposes only. This application does not impose any restrictions on the specific listening time of the user.

[0185] In one example, such as Figure 13 As shown in (a), the electronic device detects that the user clicked on the bar chart in the statistics chart 310; after the electronic device detects that the user clicked on the bar chart in the statistics chart 310, it displays the display interface 316, as shown in (a). Figure 13 As shown in (b); the display interface 316 includes an icon 317 for decibel ranges and a statistical chart 318 showing the listening time of different applications at each decibel range; as shown in (b); Figure 13As shown in (c) of FIG. 3, the electronic device detects that the user taps application 1 in the statistical chart 318; after the electronic device detects that the user taps application 1 in the statistical chart 318, a display interface 319 can be displayed, as shown in (d) of FIG. 3; the display interface 319 includes a statistical chart 320 for displaying the listening time information of application 1 at different times within a unit time (for example, within a week). Figure 13 As shown in (c) of FIG. 3, the electronic device detects that the user taps application 1 in the statistical chart 318; after the electronic device detects that the user taps application 1 in the statistical chart 318, a display interface 319 can be displayed, as shown in (d) of FIG. 3; the display interface 319 includes a statistical chart 320 for displaying the listening time information of application 1 at different times within a unit time (for example, within a week).

[0186] It should be understood that the related description in (d) of FIG. 3 is applicable to (d) of FIG. 4, and details are not repeated here. Figure 12 It should be understood that the related description in (d) of FIG. 3 is applicable to (d) of FIG. 4, and details are not repeated here. Figure 13 It should be understood that the related description in (d) of FIG. 3 is applicable to (d) of FIG. 4, and details are not repeated here.

[0187] In one example, as shown in (a) of FIG. 3, the electronic device detects that the user taps the column chart in the statistical chart 310; after the electronic device detects that the user taps the column chart in the statistical chart 310, a display interface 314 can be displayed, as shown in (b) of FIG. 3; the display interface 314 includes a statistical chart 315 based on the listening time of different application programs. Figure 14 In one example, as shown in (a) of FIG. 3, the electronic device detects that the user taps the column chart in the statistical chart 310; after the electronic device detects that the user taps the column chart in the statistical chart 310, a display interface 314 can be displayed, as shown in (b) of FIG. 3; the display interface 314 includes a statistical chart 315 based on the listening time of different application programs. Figure 14 As shown in (c) of FIG. 3, the electronic device detects that the user taps application 1 in the statistical chart 318; after the electronic device detects that the user taps application 1 in the statistical chart 318, a display interface 319 can be displayed, as shown in (d) of FIG. 3; the display interface 319 includes a statistical chart 320 for displaying the listening time information of application 1 at different times within a unit time (for example, within a week). Figure 14 As shown in (c) of FIG. 3, the electronic device detects that the user taps application 1 in the statistical chart 318; after the electronic device detects that the user taps application 1 in the statistical chart 318, a display interface 319 can be displayed, as shown in (d) of FIG. 3; the display interface 319 includes a statistical chart 320 for displaying the listening time information of application 1 at different times within a unit time (for example, within a week). Figure 14 As shown in (c) of FIG. 3, the electronic device detects that the user taps application 1 in the statistical chart 318; after the electronic device detects that the user taps application 1 in the statistical chart 318, a display interface 319 can be displayed, as shown in (d) of FIG. 3; the display interface 319 includes a statistical chart 320 for displaying the listening time information of application 1 at different times within a unit time (for example, within a week). Figure 14 As shown in (c) of FIG. 3, the electronic device detects that the user taps application 1 in the statistical chart 318; after the electronic device detects that the user taps application 1 in the statistical chart 318, a display interface 319 can be displayed, as shown in (d) of FIG. 3; the display interface 319 includes a statistical chart 320 for displaying the listening time information of application 1 at different times within a unit time (for example, within a week). Figure 14 As shown in (c) of FIG. 3, the electronic device detects that the user taps application 1 in the statistical chart 318; after the electronic device detects that the user taps application 1 in the statistical chart 318, a display interface 319 can be displayed, as shown in (d) of FIG. 3; the display interface 319 includes a statistical chart 320 for displaying the listening time information of application 1 at different times within a unit time (for example, within a week).

[0188] It should be understood that the related description in (d) of FIG. 3 is applicable to (d) of FIG. 4, and details are not repeated here. Figure 12 It should be understood that the related description in (d) of FIG. 3 is applicable to (d) of FIG. 4, and details are not repeated here. Figure 14 It should be understood that the related description in (d) of FIG. 3 is applicable to (d) of FIG. 4, and details are not repeated here.

[0189] It should be understood that the above examples take the statistical chart 310, the statistical chart 315, the statistical chart 318, and the statistical chart 320 as column charts, and the statistical chart 313 as a fan-shaped statistical chart, and the specific form of the statistical chart is not limited in the present application.

[0190] Optionally, in the embodiments of the present application, the electronic device can display prompt information when the user wears the earphone for a long time, and the prompt information is used to remind the user to pay attention to ear health.

[0191] As shown in FIG. 3, Figure 15 the reminder box 322 can be displayed in the display interface 321 of the electronic device, and the reminder box includes prompt information; for example, the prompt information can be “long-term exposure to high volume can damage hearing, please lower the volume or take a break”.

[0192] Optionally, the reminder box 322 can automatically disappear in the display screen of the electronic device after a period of time, or the reminder box can disappear after the electronic device detects the operation of the user on the reminder box 322.

[0193] In the embodiments of the present application, multi-dimensional information is displayed in the hearing protection display interface; for example, the maximum decibel value and the minimum decibel value of the user listening to the sound in each time, and the listening time of the user in each decibel value range can be included; based on the display interface of the listening information, not only the maximum decibel value and the minimum decibel value of the user listening to the sound, but also the listening time of the user in each decibel range; therefore, the display method of the listening information provided by the embodiments of the present application can display more listening information to the user; in addition, the listening habit of the user in a period of time can be accurately reflected based on the multi-dimensional listening information, which is beneficial to hearing protection of the user.

[0194] Figure 16 is a schematic flowchart of the display method of the listening information provided by the embodiments of the present application. The method 400 can be executed by the electronic device as shown in FIG. 4; the method 400 includes steps S410 to S440, and the steps S410 to S440 will be described in detail below. Figure 1

[0195] Step S410, divide the listening volume into N segments.

[0196] As shown in FIG. 5, Figure 17 0dB-100dB listening volume can be divided into N segments, and the N segments can include x1, x2, …, xN. N .

[0197] In one example, 0dB-100dB listening volume can be uniformly divided; for example, 0dB-100dB can be uniformly divided based on 10dB.

[0198] ​In one example, the listening volume of 0dB-100dB can not be uniformly divided; that is, the values of the multiple listening volumes can not be equal; for example, the listening volume of 0dB-100dB can be divided into 0dB-20dB, 20dB-30dB, 30dB-60dB, 60dB-90dB, and 90dB-100dB.

[0199] In step S420, the listening volume (one example of the estimated value of the volume) is counted based on the preset time interval t0.

[0200] For example, when it is detected that the user wears the earphone and plays the audio information, the electronic device can transmit the downlink data stream to the loudspeaker of the earphone; the electronic device can estimate the listening volume of the user based on the preset time interval t0. For example, the listening volume estimate value can be obtained based on the following formula:

[0201]

[0202] wherein FFT() represents the Fourier transform; W A represents the A-weighting vector; S F represents one frame of downlink audio signal, and t0 represents the preset time interval.

[0203] It should be understood that the audio signal can be transformed into the frequency domain through the Fourier transform; the A-weighting vector can make the audio signal conform to the hearing characteristics of the user; the function f() can count the A-weighting energy of the listening volume estimate value of the audio signal in the preset time interval t0

[0204] In the embodiments of the present application, there can be a difference between the audio signal played by the loudspeaker in the earphone and the audio signal transmitted to the eardrum of the user; if the volume of the audio signal played by the loudspeaker in the earphone is used to represent the volume heard by the user at the eardrum, there can be a partial deviation; therefore, the transfer function conforming to the current listening state is selected, and the transfer function of the current listening state can accurately represent the difference between the audio signal played by the loudspeaker in the earphone and the audio signal transmitted to the eardrum of the user.

[0205] Optionally, in the embodiments of the present application, in order to improve the accuracy of the listening volume estimate value , the listening volume estimate value can be obtained based on the following formula:

[0206]

[0207] wherein FFT() represents a Fourier transform; G represents a transfer function from a speaker in the earphone to the eardrum of the user in the current listening state; W A represents an A-weighting vector; S F represents a frame of downlink audio signal, and t0 represents a preset time interval.

[0208] For example, assuming that the time length corresponding to a frame of downlink audio signal can be 10 ms, and the preset time interval is 2 s, a frame of downlink audio signal can be obtained every 10 ms, and the listening volume estimation value of the user in 2 s is counted

[0209] It should be understood that, for different users, the depth and width of their ear canals are different, and thus the transfer functions are different. For the same user, the transfer functions are different based on the tightness of the earphone worn.

[0210] Exemplarily, selecting the transfer function conforming to the current listening state includes the following steps:

[0211] Step 1: Pre-measure data.

[0212] For example, the transfer function G from the speaker in the earphone to the eardrum of the user is pre-measured i , the transfer function P from the speaker in the earphone to the built-in microphone is pre-measured i , and a data set {G i , P i} is obtained, i = 1,.., J; the pre-measured data needs to measure J groups of data, and one group of data can include two transfer functions G i and P i ; since G i and P i in one group of data are measured in the same wearing state, G i and P i in one group of data have a correlation.

[0213] wherein the transfer function G from the speaker in the earphone to the eardrum of the user can be measured by an additional device, such as a probe microphone; and the transfer function P can be obtained based on the earphone. i i

[0214] Optionally, the pre-measured data can be stored in the earphone.

[0215] Optionally, the pre-measured data can be stored in the electronic device.

[0216] ​​Step 2: After the user puts on the headphones, the speaker in the headphones plays an in-ear prompt tone. After the built-in microphone of the headphones receives the prompt tone, it can identify the current listening state and obtain the estimated value P1 of the transfer function from the speaker in the headphones to the built-in microphone in the current listening state.

[0217] It should be understood that for different users, or even the same user with different headphone wearing conditions, such as the tightness of the headphones, the estimated value P1 of the transfer function from the speaker to the built-in microphone in the headphones may be different.

[0218] Step 3: Compare the estimated value P1 with all transfer functions P in the pre-measured data. i By comparison, the transfer function P that differs least from the estimated value P1 is obtained. i0 That is, a set of data {G} can be obtained. i0 P i0 This set of data is a transfer function that corresponds to the current user and / or the user's headphone wearing status.

[0219] It should be understood that since the transfer function G from the speaker in the headphones to the user's eardrum cannot be directly measured when the user is wearing headphones, a set of data {G} can be determined from pre-measured data based on the transfer function P from the speaker to the built-in microphone in the current headphones. i0 P i0}; thus determining the transfer function G of the current listening state.

[0220] Optionally, based on the above method, it can be achieved through t(x) i ) indicates that the user is within the volume range x i The listening duration is initialized periodically (e.g., daily) for each volume range: t(x i )=0,i=1,…,N.

[0221] Step S430: Update the listening duration of the corresponding listening volume based on the listening volume estimate.

[0222] It should be understood that listening duration can refer to the duration of auditory exposure.

[0223] For example, based on the estimated listening volume value The corresponding listening volume range can be determined, and the listening duration for each volume range can be updated once:

[0224] For example, listening volume is divided into: x1 refers to 0dB to 25dB, x2 refers to 25dB to 50dB, x3 refers to 50dB to 75dB, and x4 refers to 75dB to 100dB; listening volume estimation value. If the value is 43dB, then the estimated listening volume belongs to x2; increase the listening duration corresponding to x2 by t0.

[0225] Step S440, display the listening time of different volume.

[0226] Exemplarily, as shown in (b) of FIG. 3, the listening time of each volume range is displayed; for example, the listening time of each volume range can be displayed by different icons. Figure 7

[0227] It should be understood that the above is exemplarily described in the scenario that the user wears the earphone to play the audio; since it is easier to estimate the listening volume of the user when the user wears the earphone; and the estimation of the listening volume of the user is also more accurate.

[0228] Optionally, the embodiments in the present application are also applicable to the scenario that the electronic device plays the audio externally.

[0229] In the embodiments of the present application, in the case that the electronic device starts the hearing protection mode, the volume information and the listening time of different volume sizes can be displayed in the electronic device, so as to accurately reflect the listening habit of the user in a period of time based on the multi-dimensional listening information; thereby the listening information of the user can be intuitively reflected, the user is reminded when the listening volume is too large or the listening time is too long, and the hearing protection of the user is facilitated.

[0230] Figure 18 FIG. 5 is a schematic flowchart of a method for displaying listening information provided by the embodiments of the present application. The method 500 can be executed by the electronic device as shown in FIG. 1; the method 500 includes steps S510 to S560, which are described in detail as follows. Figure 1

[0231] Step S510, display a first interface.

[0232] The first interface includes a first control.

[0233] Exemplarily, the first interface can be the interface as shown in (b) of FIG. 3; and the first control can be the control 307. Figure 6

[0234] Step S520, detect a first operation on the first control.

[0235] Exemplarily, the first operation can be an operation of clicking the first control by the user.

[0236] It should be understood that the above is exemplarily described in the case that the first operation is the clicking operation; the first operation can also include a voice instruction operation or other operation of instructing the electronic device to start the hearing protection mode; the above is exemplarily described, and does not limit the present application in any way.

[0237] ​​​Step S530, in response to the first operation, starting the hearing protection mode of the electronic device.

[0238] It should be understood that the hearing protection refers to monitoring the earphone volume and the listening time in real time, so that the user knows the situation of using the earphone volume. When the user uses the earphone for a long time or is exposed to high volume, the user is reminded to adjust the volume or give the ear a rest in time. The hearing protection mode can refer to a mode for healthy use of the mobile phone in the electronic device, for example, as shown in (f) of Figure 5 .

[0239] Step S540, detecting that the electronic device is connected to the audio playing device.

[0240] The audio playing device can be a wearable device of the user.

[0241] Exemplarily, the audio playing device can refer to a wearable device for playing audio information; for example, the audio playing device can be an earphone, such as the earphone 220 shown in Figure 3 .

[0242] Alternatively, the audio playing device can also be virtual reality glasses; the present application does not make any specific limitation to the audio playing device.

[0243] Step S550, obtaining the listening information of the user.

[0244] The listening information can include volume information and time information, the volume information being used to indicate the volume size of the user listening to the audio playing device, and the time information being used to indicate the listening time of the user at different volume sizes through the audio playing device.

[0245] Step S560, displaying a second interface.

[0246] The second interface includes the volume information and the time information.

[0247] Alternatively, the second interface can include a first statistical chart, the first statistical chart being used to display the listening time of the user at different volume sizes within a unit time.

[0248] Exemplarily, the first statistical chart can refer to the statistical chart 310 shown in (d) of Figure 6 ; wherein the unit time can refer to any one of hour, day, week, month or year; for example, the abscissa of the first statistical chart can refer to time (for example, day), and the ordinate of the first statistical chart can refer to decibel value.

[0249] It should be understood that the above takes the first statistical chart as a column chart as an example for illustration, and the first statistical chart can also be other forms of statistical charts, which are not limited by the present application.

[0250] Optionally, the electronic device detects a second operation on the first statistical image; in response to the second operation, a third interface may be displayed, the third interface including volume information and time information corresponding to at least one application in the electronic device.

[0251] For example, the second operation may be the operation of selecting a first volume range, and the third interface may include a second statistical chart, which may be used to display the listening duration of each application in at least one application within the first volume range.

[0252] For example, such as Figure 8 As shown in (a), the second operation can refer to the user clicking the vertical axis of the first statistical chart; the third interface can refer to, for example, Figure 8 The second statistical chart in the display interface 311 shown in (b) can refer to the statistical chart 313; the second statistical chart can be used to display the listening duration of each application (e.g., application 1, application 2, application 3, application 4 and application 5) in at least one application within the first volume range (e.g., 25dB to 50dB).

[0253] It should be understood that in the embodiments of this application, the second statistical chart and the first statistical chart can be switched between each other. That is, when a user clicks on the volume range in the first statistical chart, the user can switch from the first statistical chart to the second statistical chart, which displays the listening time of the user for different applications within that volume range.

[0254] Optionally, the third interface may include a third statistical chart, which is used to display the volume and time information of each application in at least one application.

[0255] For example, the third interface can refer to, for instance, Figure 9 The third statistical chart shown in (b) of the diagram can refer to, for example, the display interface 314. Figure 9 The third statistical chart is shown in (b) of the chart; it can be used to display the listening time of a user for each application in at least one application (e.g., application 1, application 2, application 3, etc.).

[0256] For example, the third interface can refer to, for instance, Figure 10 The third statistical chart shown in (b) of the diagram 316 can refer to, for example, the third statistical chart. Figure 10 The statistical graph 318 shown in (b) is a third statistical graph that can be used to show the listening duration of a user for each application in at least one application (e.g., application 1, application 2, application 3, etc.) in different decibel ranges.

[0257] Optionally, in the embodiments of the present application, the listening information of the user is obtained, including: obtaining audio signals sent by the electronic device to the audio playing device within a preset time length; obtaining volume information based on the audio signals; and obtaining time information based on the preset time length. For example, the specific implementation can be referred to Figure 16 The step S420 is shown in FIG. 4, and the step S430 is shown in FIG. 5, which will not be described here.

[0258] Optionally, in the embodiments of the present application, the volume information is obtained based on the audio signals, including:

[0259] The volume information is obtained based on the audio signals and a target first transfer function, the target first transfer function being used to represent a transfer function from a loudspeaker in the audio playing device to the eardrum of the user in the current wearing state.

[0260] It should be understood that, for different users, the depth and width of the ear canal are different, and the transfer function is different. For the same user, based on the tightness of the wearing earphone, the transfer function from the loudspeaker in the audio playing device to the eardrum of the user is different. In the embodiments of the present application, the volume information can be predicted based on the audio signals and the target first transfer function conforming to the current wearing state, which can improve the accuracy of predicting the volume information heard by the eardrum of the user, thereby better protecting the hearing of the user.

[0261] For example, the volume information can be obtained by the following formula:

[0262]

[0263] wherein, represents an estimated value of the volume; FFT() represents a Fourier transform; W A represents an A-weighting weighting vector; S F represents a frame of the audio signal, and G represents the target first transfer function; t0 represents the preset time length.

[0264] Optionally, in the embodiments of the present application, the volume information can be obtained by the following formula:

[0265]

[0266] wherein, represents an estimated value of the volume; FFT() represents a Fourier transform; W A represents an A-weighting weighting vector; S F represents a frame of the downlink audio signal, and t0 represents a preset time interval.

[0267] It should be understood that the audio signal can be transformed into the frequency domain by Fourier transform; the audio signal can be made to conform to the hearing characteristics of the user by A-weighting the weighting vector; the function f() can count the A-weighted energy of several frames of audio signals in a preset time interval t0 to obtain the listening volume estimation value

[0268] In the embodiments of the present application, there can be a difference between the audio signal played by the earphone speaker and the audio signal transmitted to the user's eardrum; if the volume of the audio signal played by the earphone speaker is used to represent the volume heard by the user's eardrum, there can be a partial deviation; therefore, the transfer function of the current listening state is selected, and the transfer function of the current listening state can accurately represent the difference between the audio signal played by the earphone speaker and the audio signal transmitted to the user's eardrum.

[0269] Optionally, in the embodiments of the present application, further comprising:

[0270] Obtaining the current wearing state of the user, the current wearing state being the state of the user wearing the audio playback device;

[0271] Determining a target first transfer function in the sample data set based on the current wearing state, the sample data set comprising a plurality of groups of data, each group of data in the plurality of groups of data comprising a first transfer function and a second transfer function, the first transfer function and the second transfer function corresponding to each other, the first transfer function being a transfer function from a speaker in the audio playback device to the eardrum of the user, and the second transfer function being a transfer function from the speaker in the audio playback device to a built-in microphone in the audio playback device.

[0272] Illustratively, the sample data set can refer to pre-measured data; the pre-measured data can be stored in the audio playback device, or the pre-measured data can be stored in the electronic device.

[0273] It should be understood that since the user cannot directly measure the first transfer function G from the speaker in the earphone to the eardrum of the user when wearing the earphone; therefore, a group of data {G i0 , P i0} can be determined from the pre-measured data based on the second transfer function P from the speaker in the earphone to the built-in microphone under the current wearing state; so as to determine the second transfer function G of the current wearing state, i.e., the target second transfer function.

[0274] Optionally, in the embodiments of the present application, determining the target first transfer function in the sample data set based on the current wearing state comprises:

[0275] After detecting that the user is wearing the audio playback device, the audio playback device plays a prompt message; based on the prompt message, a target second transfer function is obtained, which is a second transfer function that matches the current wearing state; based on the difference between the target second transfer function and the second transfer function in the sample data set, the target group data in the sample data set is obtained; based on the target group data, a target first transfer function is obtained.

[0276] For example, after a user puts on headphones, an in-ear prompt tone is played by the speaker of the audio playback device. Upon receiving the prompt tone, the built-in microphone of the audio playback device can identify the current listening state and obtain an estimated value P1 of the transfer function from the speaker to the built-in microphone in the audio playback device under the current listening state. This estimated value P1 is then compared with all transfer functions P1 in the pre-measured data. i By comparison, the transfer function P that differs least from the estimated value P1 is obtained. i0 That is, a set of data {G} can be obtained. i0 P i0 This set of data represents the target first transfer function that matches the current wearing state.

[0277] In the embodiments of this application, when the hearing protection mode of the electronic device is turned on, the volume information and listening duration at different volume levels can be displayed on the electronic device, so as to accurately reflect the user's listening habits over a period of time based on multi-dimensional listening information; thereby, it can intuitively reflect the user's listening information, and remind the user when the listening volume is too loud or during the listening volume duration, which is beneficial to the user's hearing protection.

[0278] It should also be understood that the above examples are provided to help those skilled in the art understand the embodiments of this application, and are not intended to limit the embodiments of this application to the specific values ​​or scenarios illustrated. Those skilled in the art can obviously make various equivalent modifications or changes based on the above examples, and such modifications or changes also fall within the scope of the embodiments of this application.

[0279] The above text combined Figures 1 to 18 The method for recognizing elevator scenes provided in the embodiments of this application has been described in detail; the following will be combined with Figure 19 and Figure 20 The apparatus embodiments of this application are described in detail below. It should be understood that the apparatus in the embodiments of this application can perform the various methods described in the foregoing embodiments of this application, that is, the specific working processes of the various products described below can be referred to the corresponding processes in the foregoing method embodiments.

[0280] Figure 19 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. The electronic device 600 includes a display module 610 and a processing module 620.

[0281] The display module 610 is configured to display a first interface, the first interface including a first control; the processing module 620 is configured to detect a first operation on the first control; in response to the first operation, start a hearing protection mode of the electronic device; detect that the electronic device is connected to an audio playing device, the audio playing device being a wearable device of a user; obtain hearing information of the user, the hearing information including volume information and time information, the volume information being used to indicate a volume size at which the user listens to audio through the audio playing device, and the time information being used to indicate a listening duration of the user at different volume sizes through the audio playing device; and the display module 610 is further configured to display a second interface, the second interface including the volume information and the time information.

[0282] Optionally, as an embodiment, the second interface includes a first statistical chart, the first statistical chart being used to display the listening duration of the user at different volume sizes within a unit time.

[0283] Optionally, as an embodiment, the processing module 620 is further configured to:

[0284] detect a second operation on the first statistical chart;

[0285] The display module 610 is further configured to:

[0286] in response to the second operation, display a third interface, the third interface including the volume information and the time information corresponding to at least one application program in the electronic device.

[0287] Optionally, as an embodiment, the second operation is an operation of selecting a first volume range, and the third interface includes a second statistical chart, the second statistical chart being used to display the listening duration of each of the at least one application program in the first volume range.

[0288] Optionally, as an embodiment, the third interface includes a third statistical chart, the third statistical chart being used to display the volume size and the time information corresponding to each of the at least one application program.

[0289] Optionally, as an embodiment, the processing module 620 is specifically configured to:

[0290] obtain audio signals sent by the electronic device to the audio playing device within a preset time duration;

[0291] predict the volume information based on the audio signals;

[0292] obtain the time information based on the preset time duration.

[0293] Optionally, as one embodiment, the processing module 620 is specifically used for:

[0294] The volume information is obtained based on the audio signal and a target first transfer function, the target first transfer function being used to represent a transfer function from a loudspeaker in the audio playback device to an eardrum of the user in a current wearing state.

[0295] Optionally, as one embodiment, the volume information is obtained by the following formula:

[0296]

[0297] Wherein, represents an estimated value of the volume; FFT() represents a Fourier transform; W A represents an A-weighting weighting vector; S F represents a frame of the audio signal, G represents the target first transfer function; t0 represents the preset time length.

[0298] Optionally, as one embodiment, the processing module 620 is further used for:

[0299] Obtaining a current wearing state of the user, the current wearing state being a state in which the user currently wears the audio playback device;

[0300] Determining the target first transfer function in a sample data set based on the current wearing state, the sample data set including a plurality of groups of data, each group of data in the plurality of groups of data including a first transfer function and a second transfer function, the first transfer function and the second transfer function corresponding to each other, the first transfer function being a transfer function from a loudspeaker in the audio playback device to an eardrum of the user, and the second transfer function being a transfer function from the loudspeaker in the audio playback device to a built-in microphone in the audio playback device.

[0301] Optionally, as one embodiment, the processing module 620 is specifically used for:

[0302] After detecting that the user wears the audio playback device, the audio playback device plays prompt information;

[0303] Obtaining a target second transfer function based on the prompt information, the target second transfer function being the second transfer function matched with the current wearing state;

[0304] Subtracting the target second transfer function from the second transfer function in the sample data set to obtain a target group of data in the sample data set;

[0305] The target first transfer function is obtained based on the target group data.

[0306] Optionally, as an embodiment, the wearable device includes a headset.

[0307] It should be noted that the electronic device 600 is embodied in the form of functional modules. The term "module" herein can be implemented in the form of software and / or hardware, and is not specifically limited.

[0308] For example, the "module" can be a software program, a hardware circuit, or a combination of both, which implements the above functions. The hardware circuit can include an application specific integrated circuit (ASIC), an electronic circuit, a processor (such as a shared processor, a dedicated processor, or a group processor, etc.) and a memory for executing one or more software or firmware programs, a combination logic circuit, and / or other suitable components that support the described functions.

[0309] Therefore, the units of the examples described in the embodiments of the present application can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether the functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. A person skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0310] Figure 20 A structural schematic diagram of an electronic device provided by the present application is shown. Figure 20 The dashed line in the electronic device 700 indicates that the unit or the module is optional; the electronic device 700 can be used to implement the display method of the listening information described in the method embodiments.

[0311] The electronic device 700 includes one or more processors 701, which can support the electronic device 700 to implement the display method of the listening information in the method embodiments.

[0312] Exemplarily, the processor 701 can be a general purpose processor or a special purpose processor. For example, the processor 701 can be a central processing unit (CPU), a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, such as a discrete gate or transistor logic device, or a discrete hardware component.

[0313] Optionally, the processor 701 can be configured to control the electronic device 700, execute a software program, and process data of the software program. The electronic device 700 can further include a communication unit 705 configured to implement input (reception) and output (transmission) of signals.

[0314] For example, the electronic device 700 can be a chip, the communication unit 705 can be an input and / or output circuit of the chip, or the communication unit 705 can be a communication interface of the chip, and the chip can be a component of an electronic device or other electronic devices.

[0315] For another example, the electronic device 700 can be a terminal device, and the communication unit 705 can be a transceiver of the terminal device, or the communication unit 705 can be a transceiver circuit of the terminal device.

[0316] Optionally, the electronic device 700 can include one or more memories 702, and a program 704 can be stored in the memory 702, and the program 704 can be executed by the processor 701 to generate an instruction 703, so that the processor 701 executes the display method of the listening information described in the above method embodiments according to the instruction 703.

[0317] Optionally, the memory 702 can further store data.

[0318] Optionally, the processor 701 can further read the data stored in the memory 702, and the data can be stored in the same storage address as the program 704, or the data can be stored in a different storage address from the program 704.

[0319] Optionally, the processor 701 and the memory 702 can be separately arranged, or can be integrated together, for example, integrated on a system on chip (SOC) of the terminal device.

[0320] Exemplarily, the memory 702 can be configured to store a program 704 related to the display method of the listening information provided in the embodiments of the present application, and the processor 701 can be configured to invoke the program 704 related to the display method of the listening information stored in the memory 702 when executing the display method of the listening information, and execute the display method of the listening information provided in the embodiments of the present application; for example, display a first interface, the first interface comprising a first control; detect a first operation on the first control; in response to the first operation, start a hearing protection mode of the electronic device; detect that the electronic device is connected to an audio playing device, the audio playing device being a wearable device of the user; obtain listening information of the user, the listening information comprising volume information and time information, the volume information being used to indicate a volume size of the user listening to audio through the audio playing device, and the time information being used to indicate a listening duration of the user at different volume sizes through the audio playing device; display a second interface, the second interface comprising the volume information and the time information.

[0321] The present application further provides a computer program product, which, when executed by the processor 701, implements the display method of the listening information of any method embodiment in the present application.

[0322] Exemplarily, the computer program product can be stored in the memory 702, for example, the program 704, which is finally converted into an executable object file capable of being executed by the processor 701 through a processing process such as preprocessing, compiling, assembling and linking.

[0323] The present application further provides a computer readable storage medium, which stores a computer program, and the computer program, when executed by a computer, implements the method for identifying an elevator scene provided in any method embodiment of the present application. The computer program can be a high-level language program or an executable target program.

[0324] Exemplarily, the computer readable storage medium is, for example, the memory 702. The memory 702 can be a volatile memory or a nonvolatile memory, or the memory 702 can include both volatile memory and nonvolatile memory. The nonvolatile memory can be a read-only memory (ROM), a programmable ROM (PROM), an erasable PROM (EPROM), an electrically EPROM (EEPROM), or a flash memory. The volatile memory can be a random access memory (RAM) used as an external cache. By way of example, and not limitation, many forms of RAM can be used, such as a static RAM (SRAM), a dynamic RAM (DRAM), a synchronous dynamic RAM (SDRAM), a double data rate SDRAM (DDR SDRAM), an enhanced SDRAM (ESDRAM), a synchlink DRAM (SLDRAM), and a direct rambus RAM (DR RAM).

[0325] Those skilled in the art can clearly understand that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be realized by electronic hardware or a combination of computer software and electronic hardware. Whether the functions are realized in hardware or software depends on the specific application and design constraints of the technical solution. A person skilled in the art can use different methods to realize the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0326] Those skilled in the art can clearly understand that, for the convenience and brevity of the description, the specific working processes of the above-described system, device and unit can refer to the corresponding processes in the foregoing method embodiments, which will not be described here.

[0327] In several embodiments provided in the present application, it should be understood that the disclosed system, device and method can be implemented in other manners. For example, the embodiments of the electronic device described above are merely illustrative. For example, the division of the modules is merely a logical function division. There can be another division manner for the actual implementation. For example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the displayed or discussed coupling or direct coupling or communication connection between the units can be indirect coupling or communication connection through some interfaces, devices or units, and can be electrical, mechanical or in other forms.

[0328] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, i.e., they can be located in one place, or can be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.

[0329] In addition, the functional units in the various embodiments of the present application can be integrated into a processing unit, or each unit can be a physically independent unit, or two or more units can be integrated into a unit.

[0330] It should be understood that in various embodiments of the present application, the size of the sequence of each process does not mean the execution order, and the execution order of each process should be determined according to its function and inherent logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0331] In addition, the term "and / or" in this paper is only a description of the association relationship between the associated objects, which means that there can be three relationships, for example, A and / or B, which can represent three cases of A alone, A and B together, and B alone. In addition, the character " / " in this paper generally represents that the front and rear associated objects are a "or" relationship.

[0332] If the functions are implemented in the form of software function units and sold or used as independent products, they can be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the present application essentially or the parts that contribute to the prior art or parts of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes a number of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various media that can store program codes.

[0333] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of changes or replacements within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims. In summary, the above is only a preferred embodiment of the technical solutions of the present application and is not used to limit the protection scope of the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principles of the present application should be included in the protection scope of the present application.

Claims

1. A display method of sound information, characterized by, The display method is applied to an electronic device and includes the following steps: displaying a first interface, wherein the first interface comprises a first control; detecting a first operation on the first control; in response to the first operation, starting a hearing protection mode of the electronic device; detecting that the electronic device is connected to an audio playing device, wherein the audio playing device is a wearable device of a user; obtaining listening information of the user, wherein the listening information comprises volume information and time information, the volume information is used to indicate a volume size at which the user listens to audio through the audio playing device, and the time information is used to indicate a listening duration of the user at different volume sizes through the audio playing device; displaying a second interface, wherein the second interface comprises the volume information and the time information; the obtaining of the listening information of the user comprises: obtaining a current wearing state of the user, wherein the current wearing state refers to a state in which the user currently wears the audio playing device; based on the current wearing state, determining a target first transfer function in a sample data set, and obtaining the volume information by predicting based on an audio signal and the target first transfer function; wherein the audio signal is sent by the electronic device to the audio playing device within a preset time length, the target first transfer function is used to represent a transfer function from a loudspeaker in the audio playing device to an eardrum of the user in the current wearing state, and the sample data set comprises a plurality of groups of data, each group of data in the plurality of groups of data comprises a first transfer function and a second transfer function, the first transfer function and the second transfer function correspond to each other, the first transfer function is a transfer function from the loudspeaker in the audio playing device to the eardrum of the user, and the second transfer function is a transfer function from the loudspeaker in the audio playing device to a built-in microphone in the audio playing device.

2. The display method according to claim 1, wherein the second interface comprises a first statistical chart, and the first statistical chart is used to display a listening duration of the user at different volume sizes within a unit time.

3. The display method according to claim 2, wherein further comprising: detecting a second operation on the first statistical chart; in response to the second operation, displaying a third interface, wherein the third interface comprises the volume information and the time information corresponding to at least one application program in the electronic device.

4. The display method according to claim 3, wherein the second operation is an operation of selecting a first volume range, the third interface comprises a second statistical chart, and the second statistical chart is used to display a listening duration of each application program in the at least one application program in the first volume range.

5. The display method according to claim 3, wherein the third interface comprises a third statistical chart, and the third statistical chart is used to display the volume size and the time information corresponding to each application program in the at least one application program.

6. The display method according to any one of claims 1 to 5, wherein the obtaining of the listening information of the user comprises: obtaining an audio signal sent by the electronic device to the audio playing device within a preset time length; obtaining the volume information by predicting based on the audio signal; obtaining the time information based on the preset time length.

7. The display method according to claim 6, wherein the volume information is obtained by the following formula: ； wherein, represents an estimated value of volume; FFT() represents a Fourier transform; W A represents an A-weighting weighting vector; represents a frame of the audio signal, G represents the target first transfer function; t0 represents the preset time length.

8. The display method according to claim 7, wherein The determining the target first transfer function in the sample data set based on the current wearing state comprises: After detecting that the user wears the audio playback device, the audio playback device plays prompt information; Based on the prompt information, a target second transfer function is obtained, the target second transfer function being the second transfer function matched with the current wearing state; Based on the target second transfer function and the second transfer functions in the sample data set, a target group data in the sample data set is obtained; Based on the target group data, the target first transfer function is obtained.

9. The display method according to any one of claims 1 to 5, wherein The wearable device comprises an earphone.

10. An electronic device, comprising: Comprise: One or more processors and memories; The memory is coupled with the one or more processors, and the memory is configured to store computer program codes, the computer program codes comprising computer instructions, and the one or more processors are configured to invoke the computer instructions to enable the electronic device to perform the display method according to any one of claims 1 to 9.

11. A chip system, characterized by The chip system is applied to an electronic device, and the chip system comprises one or more processors, and the processors are configured to invoke computer instructions to enable the electronic device to perform the display method according to any one of claims 1 to 9.

12. A computer-readable storage medium, characterized in that, The computer readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor executes the display method according to any one of claims 1 to 9.

Images