Hearing-back method and device, computer readable storage medium and earphone box

Abstract

The invention belongs to the technical field of hearing assistance, and particularly relates to a listening-back method and device, a computer readable storage medium and an earphone box. The method comprises the following steps: receiving audio data collected by the earphone through the communication link, and caching the received audio data in a preset data cache region of the earphone box; in response to a preset first listening-back instruction, controlling the earphone to play cached audio data; wherein the cached audio data is the audio data cached in the data cache region. Through the method, the audio data collected by the earphone can be cached in the data cache region of the earphone box, and when the audio needs to be listened back, the earphone can be controlled to play the cached audio data through the first listening-back instruction, so that the listening-back requirement of a user when the user cannot hear clearly or wrongly can be met, and the user experience can be improved.

Description

Technical Field

[0001] The present application belongs to the field of assistive hearing technology, and in particular, relates to a listening method, device, computer-readable storage medium, and earphone box. Background Art

[0002] At present, the growth rate of True Wireless Stereo (TWS) products has slowed down, and various market segments have gradually emerged. Designing headphones for different groups of people has become a new trend. In particular, with the deepening of the aging trend and the development of automatic gain technology, assistive listening headphones are rapidly emerging and becoming a product that has attracted much attention.

[0003] Although existing assistive listening earphones can enhance audio in specific frequency bands through automatic gain technology, they still cannot solve the problem of unclear or mishearing caused by users' lack of concentration during use. Summary of the invention

[0004] In view of this, the embodiments of the present application provide a listening back method, device, computer-readable storage medium and earphone box to solve the problem of unclear or wrong hearing caused by the user's lack of concentration when using auxiliary listening headphones.

[0005] A first aspect of an embodiment of the present application provides a listening back method, which is applied to an earphone box, wherein the earphone box is connected to an earphone via a preset communication link; the method may include:

[0006] receiving audio data collected by the earphone via the communication link, and buffering the received audio data in a preset data buffer area of ​​the earphone box;

[0007] In response to a preset first listening instruction, the earphone is controlled to play the cached audio data; wherein the cached audio data is the audio data cached in the data cache area.

[0008] In a specific implementation of the first aspect, the method may further include:

[0009] In response to the first listening back instruction, converting the buffered audio data into text to obtain text data corresponding to the buffered audio data;

[0010] The text data is displayed on a display interface of the earphone box.

[0011] In a specific implementation of the first aspect, the method may further include:

[0012] In response to the first listening back instruction, a listening back record corresponding to the buffered audio data is generated, and the created listening back record is stored in a preset storage medium of the earphone box.

[0013] In a specific implementation of the first aspect, the method may further include:

[0014] In response to a preset second listening back instruction, searching the storage medium for a target listening back record; wherein the target listening back record is a listening back record corresponding to the second listening back instruction;

[0015] The earphone is controlled to play the audio data in the target listening record.

[0016] In a specific implementation of the first aspect, searching the storage medium for the target listening record may include:

[0017] Extracting the listening record identifier in the second listening instruction;

[0018] The target listening record is searched for in the storage medium according to the listening record identifier.

[0019] In a specific implementation of the first aspect, the method may further include:

[0020] If there is an overdue listening record in the storage medium, the overdue listening record is deleted from the storage medium; wherein the overdue listening record is a listening record whose storage time in the storage medium is greater than a preset storage time threshold.

[0021] In a specific implementation of the first aspect, the step of caching the received audio data in a preset data cache area of ​​the earphone box may include:

[0022] When the playback duration corresponding to the audio data cached in the data cache area is greater than a preset playback duration threshold, the received audio data is cached in the data cache area according to a first-in-first-out strategy.

[0023] A second aspect of an embodiment of the present application provides a listening device, which is applied to an earphone box, wherein the earphone box is connected to the earphone via a preset communication link; the device may include:

[0024] An audio data caching module, used for receiving the audio data collected by the earphone through the communication link, and caching the received audio data in a preset data cache area of ​​the earphone box;

[0025] The audio data playing module is used to control the earphone to play the cached audio data in response to a preset first listening instruction; wherein the cached audio data is the audio data cached in the data cache area.

[0026] In a specific implementation of the second aspect, the device may further include:

[0027] a text conversion module, configured to perform text conversion on the buffered audio data in response to the first listen-back instruction to obtain text data corresponding to the buffered audio data;

[0028] The text data display module is used to display the text data on the display interface of the earphone box.

[0029] In a specific implementation of the second aspect, the device may further include:

[0030] The re-listening record generating module is used to generate a re-listening record corresponding to the buffered audio data in response to the first re-listening instruction, and store the created re-listening record in a preset storage medium of the earphone box.

[0031] In a specific implementation of the second aspect, the device may further include:

[0032] A listening record search module, configured to search for a target listening record in the storage medium in response to a preset second listening instruction; wherein the target listening record is a listening record corresponding to the second listening instruction;

[0033] The playback record playing module is used to control the earphone to play the audio data in the target playback record.

[0034] In a specific implementation of the second aspect, the listening record search module may include:

[0035] a listen back record identifier extraction submodule, used to extract the listen back record identifier in the second listen back instruction;

[0036] The playback record search submodule is used to search the target playback record in the storage medium according to the playback record identifier.

[0037] In a specific implementation of the second aspect, the device may further include:

[0038] A listening record deletion module is used to delete an overdue listening record from the storage medium if there is one in the storage medium; wherein the overdue listening record is a listening record whose storage time in the storage medium is greater than a preset storage time threshold.

[0039] In a specific implementation of the second aspect, the audio data caching module may include:

[0040] The audio data caching submodule is used to cache the received audio data in the data cache area according to a first-in-first-out strategy when the playback duration corresponding to the audio data cached in the data cache area is greater than a preset playback duration threshold.

[0041] A third aspect of the embodiments of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of any one of the above-mentioned listening back methods are implemented.

[0042] A fourth aspect of an embodiment of the present application provides an earphone box, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of any one of the above-mentioned listening back methods when executing the computer program.

[0043] A fifth aspect of the embodiments of the present application provides a computer program product. When the computer program product is run on an earphone box, the earphone box is enabled to execute any step of the above-mentioned listening back method.

[0044] Compared with the prior art, the embodiments of the present application have the following beneficial effects: the embodiments of the present application receive the audio data collected by the headset through the communication link, and cache the received audio data in the preset data cache area of ​​the headset box; in response to the preset first listen-back instruction, control the headset to play the cached audio data; wherein the cached audio data is the audio data cached in the data cache area. Through the embodiments of the present application, the audio data collected by the headset can be cached in the data cache area of ​​the headset box, and when the audio needs to be listened back, the headset can be controlled to play the cached audio data through the first listen-back instruction, thereby meeting the user's need to listen back when the audio is not clear or heard wrongly, and helping to improve the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0046] Figure 1 This is a flow chart of an embodiment of a listening back method in an embodiment of the present application;

[0047] Figure 2 This is a first schematic diagram of the audio data caching process in an embodiment of the present application;

[0048] Figure 3 This is a second schematic diagram of the audio data caching process in an embodiment of the present application;

[0049] Figure 4 This is a third schematic diagram of the audio data caching process in an embodiment of the present application;

[0050] Figure 5 A schematic diagram of a display interface of a listening process in an embodiment of the present application;

[0051] Figure 6 A schematic diagram of a display interface for listening back to a record in an embodiment of the present application;

[0052] Figure 7 A schematic diagram of a display interface for listening back in an embodiment of the present application;

[0053] Figure 8 This is a schematic diagram of an earphone box according to an embodiment of the present application;

[0054] Fig. 9 This is a structural diagram of an embodiment of a listening device in an embodiment of the present application;

[0055] Fig.10 This is a schematic block diagram of an earphone box in an embodiment of the present application. DETAILED DESCRIPTION

[0056] In order to make the purpose, features, and advantages of the invention of this application more obvious and easy to understand, the technical solutions in the embodiments of this application will be clearly and completely described below in conjunction with the drawings in the embodiments of this application. Obviously, the embodiments described below are only part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0057] It should be understood that when used in this specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or groups thereof.

[0058] It should also be understood that the terms used in this application specification are only for the purpose of describing specific embodiments and are not intended to limit the application. As used in this application specification and the appended claims, unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" are intended to include plural forms.

[0059] It should be further understood that the term “and / or” used in the specification and appended claims refers to any combination and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0060] As used in this specification and the appended claims, the term "if" may be interpreted as "when" or "upon" or "in response to determining" or "in response to detecting," depending on the context. Similarly, the phrases "if it is determined" or "if [described condition or event] is detected" may be interpreted as meaning "upon determination" or "in response to determining" or "upon detection of [described condition or event]" or "in response to detecting [described condition or event]," depending on the context.

[0061] In addition, in the description of the present application, the terms "first", "second", "third", etc. are only used to distinguish the description and cannot be understood as indicating or implying relative importance.

[0062] At present, the growth rate of True Wireless Stereo (TWS) products has slowed down, and various market segments have gradually emerged. Designing headphones for different groups of people has become a new trend. In particular, with the deepening of the aging trend and the development of automatic gain technology, assistive listening headphones are rapidly emerging and becoming a product that has attracted much attention.

[0063] Although existing assistive listening earphones can enhance audio in specific frequency bands through automatic gain technology, they still cannot solve the problem of unclear or mishearing caused by users' lack of concentration during use.

[0064] In view of this, the embodiments of the present application provide a listening back method, device, computer-readable storage medium and earphone box to solve the problem of unclear or wrong hearing caused by the user's lack of concentration when using auxiliary listening headphones.

[0065] It should be noted that existing assistive listening headphones usually use the headphones themselves as the main computing unit. By automatically controlling the gain of the collected audio through the headphones, the purpose of clear human voice can be achieved. However, due to the limited computing power of the headphones themselves and the size of the random access memory (RAM), the gain audio data stored in the RAM will be cleared almost immediately, making it impossible to achieve the function of listening back.

[0066] Therefore, in the present application, the earphone box can be used as the execution subject. After the auxiliary listening function is turned on, the earphone box can simultaneously receive the sound and participate in the operation of the automatic gain algorithm. Since the RAM of the earphone box is larger than that of the earphone, the audio data after automatic gain control can be cached, so that the user can listen to the cached audio data again. Among them, the earphone box can be connected to the earphone through a preset communication link, and its specific communication connection method can be set according to actual needs, which is not limited in the present application. For example, a communication connection can be established with the earphone through Bluetooth technology; for another example, a communication connection can be established with the earphone through wireless LAN technology.

[0067] See also Figure 1 In the embodiment of the present application, an embodiment of a listening back method applied in an earphone box may include:

[0068] Step S101: receiving audio data collected by the earphone via a communication link, and buffering the received audio data in a preset data buffer area of ​​the earphone box.

[0069] In an embodiment of the present application, the earphones can collect audio of the surrounding environment through a preset audio collection sensor to obtain audio data, and can send the audio data to the earphone box through a preset communication link for automatic gain control; the earphone box can receive the audio data collected by the earphones through the communication link, and can cache the received audio data in a preset data cache area in the earphone box.

[0070] It should be noted that in a specific implementation of the embodiment of the present application, the earphone box can also perform automatic gain control on the received audio data through a preset automatic gain algorithm, enhance the audio with too low frequency, weaken the audio with too high frequency, and control the volume of the audio to remain within an appropriate range, so that the audio can be easier to be heard by the user, and the audibility and clarity of the audio can be improved; then, the audio data after automatic gain control is cached in the data cache area of ​​the earphone box. Among them, the preset automatic gain algorithm can be any common automatic gain algorithm in the prior art, and this application does not specifically limit this.

[0071] It should be understood that the preset data cache area in the earphone box can cache audio data of a certain size, but when the size of the audio data to be cached exceeds the remaining cache space, the cached audio data can be deleted in the order of the audio data caching.

[0072] Specifically, in the embodiment of the present application, when the playback duration corresponding to the audio data cached in the data cache area is greater than the preset playback duration threshold, the received audio data can be cached in the data cache area according to the first-in-first-out strategy. The playback duration threshold can be specific and situationally set according to actual needs, and the present application does not limit this. For example, it can be set to 5 seconds, 10 seconds, 15 seconds, etc.

[0073] In a specific implementation of the embodiment of the present application, the playback time threshold can be set to 10 seconds, that is, 10 seconds of audio data can be cached in the data buffer area. Figure 2 , the data buffer area sequentially caches the audio data received at the 1st second, the audio data received at the 2nd second ... the audio data received at the 8th second, the audio data received at the 9th second and the audio data received at the 10th second (i.e. 1, 2 ... 8, 9 and 10 in the figure), and then, at the 11th second, the audio data to be cached is received again (i.e. 11 in the figure). At this time, the received audio data can be cached in the data buffer area according to the first-in-first-out strategy; specifically, the cached audio data that enters the data buffer area most in sequence can be deleted. Here, please refer to Figure 3 , the audio data received at the 1st second can be deleted, so that the audio data received at the 11th second can be cached in the data cache area; then, the audio data to be cached is received at the 12th second (i.e., 12 in the figure), at this time, the cached audio data that enters the frontmost order in the data cache area can be deleted. Here, refer to Figure 4 , the audio data received at the 2nd second can be deleted, so that the audio data received at the 12th second can be cached in the data cache area.

[0074] Step S102: In response to a preset first listening instruction, control the earphone to play the buffered audio data.

[0075] The cached audio data is the audio data cached in the data cache area.

[0076] In an embodiment of the present application, the user can issue a preset first listening back instruction when the user needs to listen back, wherein the first listening back instruction can be used to indicate that the user needs to listen back; after receiving the first listening back instruction, the earphone box can respond to the first listening back instruction and control the earphone to play the cached audio data.

[0077] It should be noted that the method of issuing the first listening instruction can be specific and situational according to actual needs, and this application does not limit this.

[0078] In a specific implementation of an embodiment of the present application, a user may issue a first listen back instruction by triggering a preset listen back button on the earphone box; specifically, a listen back button may be provided on the earphone box, and when the listen back button on the earphone box is triggered, a preset first listen back instruction may be generated.

[0079] In another specific implementation method of the embodiment of the present application, the user can also issue a first listen back instruction by triggering a preset listen back button on the headset; specifically, a listen back button can be provided on the headset, and when the listen back button on the headset is triggered, a preset first listen back instruction can be generated.

[0080] It should be understood that the replay button in the above two implementations can be a physical button or a virtual button, which is not specifically limited in the embodiments of the present application. In addition, the specific triggering method of the replay button can also be set according to actual needs, which is not limited in the embodiments of the present application. For example, it can be set to any common triggering method such as single click, double click, long press, etc.

[0081] In another specific implementation of the embodiment of the present application, the user can also issue a first listen back instruction through a preset listen back instruction keyword; specifically, after the earphone box receives the audio data collected by the earphone through the communication link, it can perform voice recognition on the audio data, and if the preset listen back instruction keyword is recognized, the first listen back instruction can be generated. Among them, the listen back keyword can be set according to actual needs, and the embodiment of the present application does not limit this. For example, it can be set to "listen back", "playback", "return to listen", etc. In addition, the listen back keyword can be set by the developer, or it can be specifically set by the user according to his own situation.

[0082] In another specific implementation method of the embodiment of the present application, the user can also issue a first listening instruction through a terminal device that establishes a communication connection with the earphone box; specifically, an application for controlling the earphone box and the earphones can be installed on the terminal device, and the user can issue the first listening instruction through the human-computer interaction interface of the application; wherein the terminal device can be any common terminal device in the prior art, such as a mobile phone, a tablet computer, a smart bracelet, etc., and the embodiment of the present application does not specifically limit this.

[0083] It should be noted that, in order to further improve the user experience, the audio data may be converted into text and the converted text may be displayed. Specifically, in the embodiment of the present application, the following process may also be included:

[0084] Step S103: In response to the first listening instruction, the buffered audio data is converted into text to obtain text data corresponding to the buffered audio data.

[0085] It should be understood that in some application scenarios, even if the cached audio data can be listened back, it may not be completely heard. Therefore, in an embodiment of the present application, the cached audio data can also be converted into text to obtain text data corresponding to the cached audio data.

[0086] Specifically, any artificial intelligence model in the existing technologies, such as hidden Markov model, recurrent neural network, convolutional neural network, etc., can be used to perform speech recognition on the cached audio data and convert it into corresponding text data.

[0087] Step S104: display the text data on the display interface of the earphone box.

[0088] It should be understood that the earphone box may be provided with a screen, and text data may be displayed on the display interface of the screen to assist the user in better understanding the cached audio data.

[0089] For example, if the playback time of the cached audio data is 10 seconds, the text data corresponding to the cached audio data can be displayed on the display interface of the earphone box screen, such as Figure 5 As shown, the effect of "listening and watching" can be achieved. When you cannot hear clearly or hear wrongly, there is no need to ask the source person to repeat it, which can avoid many embarrassments in life.

[0090] In a specific implementation method of an embodiment of the present application, in order to better improve the user experience, the corresponding text data can also be displayed through a preset display method. For example, the display font of the text data can be set to a larger font size; for example, the display color of the text data can also be set to a color with a large contrast with the background color so that the text data can be displayed more clearly.

[0091] In another specific implementation of the embodiment of the present application, the cached audio data can also be used for speaker recognition, and the text data corresponding to the cached audio data of different speakers can be displayed in different display modes on the display interface. For example, icons can be used to distinguish the text data corresponding to different speakers; for another example, different display colors can be used to distinguish the text data corresponding to different speakers.

[0092] It should be noted that a replay record corresponding to the cached audio data can also be generated, and the created replay record can be stored in a preset storage medium of the earphone box so that the user can relisten or view it. The replay information specifically included in the replay record can be set according to actual needs, for example, it can include cached audio data, text data corresponding to the cached audio data, replay time, playback time of the cached audio data, the number of times the cached audio data is replayed, and other replay information.

[0093] The generated re-listening record can be displayed on the display interface of the earphone box screen and / or the display interface of the terminal device that is communicatively connected to the earphone box. When the user needs to re-listen to a certain audio data that has been re-listened, a preset second re-listening instruction can be issued, and the second re-listening instruction can be used to indicate that the user needs to re-listen to the re-listening record. Here, the user can issue the second re-listening instruction through the preset display interface; after receiving the second re-listening instruction, the earphone box can respond to the second re-listening instruction, extract the re-listening record identifier in the second re-listening instruction, and search for the target re-listening record in the preset storage medium, and then control the earphone to play the audio data in the target re-listening record.

[0094] The target listening record is the listening record corresponding to the second listening instruction, and each listening record may correspond to a unique listening record identifier for distinguishing different listening records.

[0095] In a specific implementation method of an embodiment of the present application, text data corresponding to a certain listening record can be displayed on a display interface so that the user can know the specific content of the listening record and thus better distinguish between the various listening records. By clicking the play button corresponding to the target listening record, the target listening record can be listened to again.

[0096] For example, see Figure 6 , two playback records are displayed on the display interface, and the corresponding text data are "The next stop is Xinhe Road South Station" and "Have you eaten in the morning? I am a little hungry now". If the user clicks the corresponding play button on the left side of the text data "The next stop is Xinhe Road South Station", the earphone box can control the earphone to play the cached audio data corresponding to "The next stop is Xinhe Road South Station"; if the user clicks the corresponding play button on the left side of the text data "Have you eaten in the morning? I am a little hungry now", the earphone box can control the earphone to play the cached audio data corresponding to "Have you eaten in the morning? I am a little hungry now". In addition, the user can also delete the playback record by clicking the preset delete button in the display interface.

[0097] It should be understood that the method for issuing the second listen-back instruction may also be set with reference to the method for issuing the first listen-back instruction, and the embodiment of the present application does not specifically limit this.

[0098] It is understandable that the specific display mode of the target playback record on the display interface can also be set according to actual needs, and the embodiment of the present application is not limited to this. For example, the target playback record can be displayed on the display interface in the form of a slidable table, and the user can slide the screen with a finger to browse the target playback record up or down.

[0099] In a specific implementation of an embodiment of the present application, if there is an overdue re-listening record in the storage medium, the overdue re-listening record can be deleted from the storage medium to ensure sufficient storage space and improve the operating efficiency of the earphone box. Among them, the overdue re-listening record is a re-listening record in the storage medium whose storage time is greater than a preset storage time threshold. The storage time threshold can be set according to the actual storage space of the storage medium. If the storage space of the storage medium is large, the storage time threshold can be set to a larger value; if the storage space of the storage medium is small, the storage time threshold can be set to a smaller value. The embodiment of the present application does not specifically limit its value. Here, it can be preferably set to 30 days. That is, when the storage time of a re-listening record is greater than 30 days, the re-listening record can be deleted from the storage medium.

[0100] It should be noted that in actual use, the user can set the playback duration of the cached audio data that needs to be listened back, whether to automatically generate a listening record corresponding to the cached audio data, and the storage duration threshold of the listening record on the display interface of the headphone box, or on the display interface of the terminal device that is communicated with the headphone box, so as to better meet the user's personalized needs.

[0101] For example, see Figure 7 , the user can set the playback time of the cached audio data to be listened back to 10 seconds, that is, the "Return seconds: 10 seconds" in the figure, and set the automatic generation of the playback record corresponding to the cached audio data, that is, the "Automatically save records: Yes" in the figure, and the storage time threshold of the playback record can be set to 30 days, that is, the "Record preservation period: 30 days" in the figure.

[0102] For ease of understanding, the listening back method according to the embodiment of the present application will be described below with reference to the accompanying drawings.

[0103] Just as an example, Figure 8 A specific earphone box is shown, which may include basic structures or function buttons such as a left earphone storage cavity, a right earphone storage cavity, a power button, a listen back button, and a charging interface. When the user does not need to use the earphones, the earphones can be stored in the storage cavity of the earphone box. Specifically, the left earphone can be stored in the left earphone storage cavity, and the right earphone can be stored in the right earphone storage cavity, and the earphones can be turned off by the power button; if the earphone box detects that the earphones need to be charged, the earphones can be charged; in addition, the user can also charge the earphone box through the preset charging interface on the earphone box.

[0104] During specific use, the earphone box can be connected to the earphone through a preset communication link. When the assisted listening function is turned on, the earphone can send the collected audio data to the earphone box through the communication link, and the earphone box can perform automatic gain control on the received audio data to assist the user to hear clearly. Afterwards, the audio data can be cached in the data cache area of ​​the earphone box.

[0105] When the user cannot hear clearly or hears a certain audio data incorrectly, the user can send a first listen back instruction by pressing the listen back button on the earphone box. When the earphone box receives the first listen back instruction, it can respond to the first listen back instruction to control the earphone to play the cached audio data with a playback time of 10 seconds, and can display text data corresponding to the cached audio data on the display interface of the screen, forming a "watch and listen" effect; if the user wants to listen to the cached audio data again at this time, he can press the listen back button again.

[0106] If the user needs to listen to the re-listening record again, a second re-listening instruction can be sent to the earphone box; if the earphone box receives the second re-listening instruction, the target re-listening record corresponding to the second re-listening instruction can be displayed on the display interface of the screen; and through the preset buttons on the display interface, the cached audio data can be listened to again, or the re-listening record can be deleted.

[0107] In summary, the embodiment of the present application receives the audio data collected by the headset through the communication link, and caches the received audio data in the preset data cache area of ​​the headset box; in response to the preset first listen-back instruction, the headset is controlled to play the cached audio data; wherein the cached audio data is the audio data cached in the data cache area. Through the embodiment of the present application, the audio data collected by the headset can be cached in the data cache area of ​​the headset box, and when the audio needs to be listened back, the headset can be controlled to play the cached audio data through the first listen-back instruction, thereby meeting the user's need to listen back when the audio is not clear or heard wrongly, which helps to improve the user experience.

[0108] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0109] Corresponding to a listening method described in the above embodiment, Fig. 9 A structural diagram of an embodiment of a listening back device provided in an embodiment of the present application is shown.

[0110] The listening device in the embodiment of the present application may be applied to an earphone box, and the earphone box is connected to the earphone via a preset communication link; the device may include:

[0111] An audio data caching module 901 is used to receive the audio data collected by the earphone through the communication link, and cache the received audio data in a preset data cache area of ​​the earphone box;

[0112] The audio data playing module 902 is used to control the earphone to play the cached audio data in response to a preset first listening instruction; wherein the cached audio data is the audio data cached in the data cache area.

[0113] In a specific implementation of the embodiment of the present application, the device may further include:

[0114] a text conversion module, configured to perform text conversion on the buffered audio data in response to the first listen-back instruction to obtain text data corresponding to the buffered audio data;

[0115] The text data display module is used to display the text data on the display interface of the earphone box.

[0116] In a specific implementation of the embodiment of the present application, the device may further include:

[0117] The re-listening record generating module is used to generate a re-listening record corresponding to the buffered audio data in response to the first re-listening instruction, and store the created re-listening record in a preset storage medium of the earphone box.

[0118] In a specific implementation of the embodiment of the present application, the device may further include:

[0119] A listening record search module, configured to search for a target listening record in the storage medium in response to a preset second listening instruction; wherein the target listening record is a listening record corresponding to the second listening instruction;

[0120] The playback record playing module is used to control the earphone to play the audio data in the target playback record.

[0121] In a specific implementation of the embodiment of the present application, the listening record search module may include:

[0122] a listen back record identifier extraction submodule, used to extract the listen back record identifier in the second listen back instruction;

[0123] The playback record search submodule is used to search the target playback record in the storage medium according to the playback record identifier.

[0124] In a specific implementation of the embodiment of the present application, the device may further include:

[0125] A listening record deletion module is used to delete an overdue listening record from the storage medium if there is one in the storage medium; wherein the overdue listening record is a listening record whose storage time in the storage medium is greater than a preset storage time threshold.

[0126] In a specific implementation of the embodiment of the present application, the audio data caching module may include:

[0127] The audio data caching submodule is used to cache the received audio data in the data cache area according to a first-in-first-out strategy when the playback duration corresponding to the audio data cached in the data cache area is greater than a preset playback duration threshold.

[0128] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices, modules and units can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0129] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0130] Fig.10 A schematic block diagram of an earphone box provided in an embodiment of the present application is shown. For ease of explanation, only the parts related to the embodiment of the present application are shown.

[0131] like Fig.10 As shown, the earphone box 10 of this embodiment includes: a processor 100, a memory 101, and a computer program 102 stored in the memory 101 and executable on the processor 100. When the processor 100 executes the computer program 102, the steps in the above-mentioned various listening back method embodiments are implemented, for example Figure 1 Alternatively, when the processor 100 executes the computer program 102, the functions of each module / unit in the above-mentioned device embodiments are realized, for example Fig. 9 The functions of modules 901 to 902 are shown.

[0132] Exemplarily, the computer program 102 may be divided into one or more modules / units, which are stored in the memory 101 and executed by the processor 100 to complete the present application. The one or more modules / units may be a series of computer program instruction segments capable of completing specific functions, which are used to describe the execution process of the computer program 102 in the earphone box 10.

[0133] Those skilled in the art will understand that Fig.10It is only an example of the earphone box 10 and does not constitute a limitation of the earphone box 10. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, the earphone box 10 may also include input and output devices, network access devices, buses, etc.

[0134] The processor 100 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.

[0135] The memory 101 may be an internal storage unit of the earphone box 10, such as a hard disk or memory of the earphone box 10. The memory 101 may also be an external storage device of the earphone box 10, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the earphone box 10. Further, the memory 101 may also include both an internal storage unit of the earphone box 10 and an external storage device. The memory 101 is used to store the computer program and other programs and data required by the earphone box 10. The memory 101 may also be used to temporarily store data that has been output or is to be output.

[0136] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0137] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0138] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0139] In the embodiments provided in the present application, it should be understood that the disclosed device / earphone box and method can be implemented in other ways. For example, the device / earphone box embodiments described above are merely schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0140] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0141] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0142] If the integrated module / unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable storage medium may include: any entity or device capable of carrying the computer program code, recording medium, U disk, mobile hard disk, disk, optical disk, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium. It should be noted that the content contained in the computer-readable storage medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer-readable storage media do not include electric carrier signals and telecommunication signals.

[0143] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A listening method, characterized in that: Applied to an earphone box, the earphone box is connected to the earphone via a preset communication link; the method comprises: Receiving audio data collected by the earphone via the communication link, and buffering the received audio data in a preset data buffer area of ​​the earphone box; In response to a preset first listening instruction, the earphone is controlled to play the cached audio data; wherein the cached audio data is the audio data cached in the data cache area.

2. The listening back method according to claim 1, characterized in that: Also includes: In response to the first listening back instruction, converting the buffered audio data into text to obtain text data corresponding to the buffered audio data; The text data is displayed on a display interface of the earphone box.

3. The listening back method according to claim 1, characterized in that: Also includes: In response to the first listening back instruction, a listening back record corresponding to the buffered audio data is generated, and the created listening back record is stored in a preset storage medium of the earphone box.

4. The listening back method according to claim 3, characterized in that: Also includes: In response to a preset second listening back instruction, searching the storage medium for a target listening back record; wherein the target listening back record is a listening back record corresponding to the second listening back instruction; The earphone is controlled to play the audio data in the target listening record.

5. The listening back method according to claim 4, characterized in that: The step of searching the storage medium for the target listening record includes: extracting a listening record identifier in the second listening instruction; The target listening record is searched for in the storage medium according to the listening record identifier.

6. The listening back method according to claim 3, characterized in that: Also includes: If there is an overdue listening record in the storage medium, the overdue listening record is deleted from the storage medium; wherein the overdue listening record is a listening record whose storage time in the storage medium is greater than a preset storage time threshold.

7. The listening back method according to any one of claims 1 to 6, characterized in that: The step of caching the received audio data in a preset data cache area of ​​the earphone box includes: When the playback duration corresponding to the audio data cached in the data cache area is greater than a preset playback duration threshold, the received audio data is cached in the data cache area according to a first-in-first-out strategy.

8. A listening device, characterized in that: Applied to an earphone box, the earphone box is connected to the earphone via a preset communication link; the device comprises: An audio data caching module, used for receiving the audio data collected by the earphone through the communication link, and caching the received audio data in a preset data cache area of ​​the earphone box; The audio data playing module is used to control the earphone to play the cached audio data in response to a preset first listening instruction; wherein the cached audio data is the audio data cached in the data cache area.

9. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the listening back method according to any one of claims 1 to 7 are implemented.

10. An earphone box, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the steps of the listening back method according to any one of claims 1 to 7 are implemented.

Images