Audio display method and device
By acquiring and correlating the audio band and its position points, the problem of uncertain audio band position caused by changes in the position of the audio recording device is solved, and the intuitive display of the audio band position is achieved.
Patent Information
- Application Number
- CN202411640363.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-15
- Publication Date
- 2025-04-08
AI Technical Summary
During the audio recording process, if the position of the recording device is in a constantly changing state, the position point of the collected audio recording device is a discrete point, and it is impossible to intuitively determine the recording position of each audio band.
By obtaining the position points corresponding to each audio band of the target audio and displaying these audio bands with their corresponding position points, the boundaries of the audio band are determined by using the positioner to identify and record the position records whose recording time interval is less than the threshold duration.
It realizes the conversion of discrete position points into position points corresponding to the audio band, and then intuitively displays the recording positions of each audio band.
Smart Images

Figure CN119782575A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of data processing technology, and in particular to an audio presentation method and device. Background Art
[0002] In an audio recording scenario, if the position of the recording device is in a constantly changing state, the position points of the audio recording device are often collected during audio recording, so that the recording position points of each audio segment can be viewed during audio playback.
[0003] However, since the position points of the audio recording device are obtained at intervals, the position points corresponding to a segment of audio will be presented as multiple discrete position points. According to these discrete position points, it is not possible to intuitively determine the recording positions of each audio segment of the audio. Summary of the invention
[0004] In view of this, an embodiment of the present application provides an audio display method and device for intuitively displaying the recording positions corresponding to each segment of the audio.
[0005] In order to achieve the above purpose, the embodiments of the present application provide the following technical solutions:
[0006] In a first aspect, an embodiment of the present application provides an audio presentation method, comprising:
[0007] Get the position points corresponding to each audio segment of the target audio;
[0008] Associating and displaying each audio segment of the target audio with the corresponding position point;
[0009] Among them, each of the audio segments corresponds to at least one of the location points, each of the audio segments corresponds to multiple location records, each of the location records includes a recording time and a locator identifier, the locator identifier is associated with the location point, and the audio segment is determined by the location records with the same locator identifier and a recording time interval less than a first threshold duration.
[0010] As an optional implementation of the embodiment of the present application, the obtaining of the position points corresponding to each audio segment of the target audio includes:
[0011] Acquire a location record set corresponding to the target audio; the location record set includes: a location record generated based on a locator identifier of each locator scanned during recording the target audio;
[0012] Grouping the location records in the location record set according to the locator identifier to obtain a location record group corresponding to each locator;
[0013] According to the location records in the location record group corresponding to each locator whose interval time is less than the first threshold time, the time interval corresponding to each locator is obtained;
[0014] Segmenting the target audio into multiple audio segments according to the time intervals corresponding to the respective locators;
[0015] The position points corresponding to the respective audio segments for obtaining the target audio are determined according to the position points associated with the respective locators.
[0016] As an optional implementation of the embodiment of the present application, dividing the target audio into multiple audio segments according to the time intervals corresponding to each locator includes:
[0017] The target audio is divided into a plurality of audio segments according to time intervals corresponding to the respective locators whose interval lengths are greater than or equal to a second threshold time length.
[0018] As an optional implementation of the embodiment of the present application, before dividing the target audio into multiple audio segments according to the time intervals corresponding to each locator, the method further includes:
[0019] Determine whether each blank interval corresponding to each locator is less than a third threshold time length; a blank interval corresponding to any locator is an interval between two adjacent time intervals corresponding to the locator;
[0020] If the length of the first blank interval corresponding to the first locator is less than the third threshold duration, determining the first blank interval as the time interval corresponding to the first locator;
[0021] If the interval length of the second blank interval corresponding to the first locator is greater than or equal to the third threshold duration, the second blank interval is not determined as the time interval corresponding to the first locator.
[0022] As an optional implementation of the embodiment of the present application, before dividing the target audio into multiple audio segments according to the time intervals corresponding to each locator, the method further includes:
[0023] For each time interval corresponding to a locator, time intervals with intersections among the time intervals corresponding to the locators are merged.
[0024] As an optional implementation of the embodiment of the present application, the obtaining of the location record set corresponding to the target audio includes:
[0025] A plurality of recording times and a list of locator identifiers corresponding to each recording time sent by a receiving terminal device; the list of locator identifiers corresponding to any recording time includes the locator identifiers of each locator scanned at the recording time;
[0026] Generate a position record according to each locator identifier in the locator identifier list corresponding to each recording time, so as to obtain all position records corresponding to the target audio;
[0027] All position records corresponding to the target audio are combined to obtain a position record set corresponding to the target audio.
[0028] As an optional implementation of the embodiment of the present application, the associating and displaying each audio segment of the target audio with the corresponding position point includes:
[0029] A play progress bar of the target audio is displayed, and corresponding position points are displayed at preset positions of the play progress bar corresponding to each audio segment of the target audio.
[0030] As an optional implementation of the embodiment of the present application, the associating and displaying each audio segment of the target audio with the corresponding position point includes:
[0031] When the position points corresponding to the first audio segment of the target audio include multiple position points, the multiple position points are associated with the first audio segment and displayed.
[0032] As an optional implementation of the embodiment of the present application, the associating and displaying each audio segment of the target audio with the corresponding position point includes:
[0033] When the position point corresponding to the first audio segment of the target audio includes multiple position points, the first audio segment is associated with the target position point among the multiple position points and displayed;
[0034] Among them, the target position point is the position point whose corresponding time interval among the multiple position points has the longest interval length, or the target position point is the position point whose corresponding time interval among the multiple position points has the latest starting time, and the first audio segment is any audio segment of the target audio.
[0035] In a second aspect, an embodiment of the present application provides an audio presentation device, comprising: a memory and a processor, wherein the memory is used to store a computer program, and the processor is used to enable the audio presentation device to implement the audio presentation method described in any of the above-mentioned embodiments when executing the computer program.
[0036] In a third aspect, an embodiment of the present application provides a computer-readable storage medium, which, when the computer program is executed by a computing device, enables the computing device to implement any of the above-mentioned audio presentation methods.
[0037] In a fourth aspect, an embodiment of the present application provides a computer program product, which, when executed on a computer, enables the computer to implement any of the above-mentioned audio presentation methods.
[0038] The audio display method provided in the embodiment of the present application can obtain the position points corresponding to each audio segment of the target audio, and associate the each audio segment of the target audio with the corresponding position points for display, and each of the audio segments corresponds to at least one of the position points, and each of the audio segments corresponds to multiple position records, each of the position records includes a recording time and a locator identifier, and the locator identifier is associated with the position point, and the audio segment is determined by the position record with the same locator identifier and a recording time interval less than the first threshold duration. Since the audio display method provided in the embodiment of the present application can determine the each audio segment of the target audio according to the position record with the same locator identifier and a recording time interval less than the first threshold duration, and determine the position points corresponding to each audio segment of the target audio, the embodiment of the present application can convert discrete locator position points into position points corresponding to audio segments, and then associate the each audio segment of the target audio with the corresponding position points for display, so the embodiment of the present application can more intuitively display the recording positions corresponding to the audio segments of the audio. BRIEF DESCRIPTION OF THE DRAWINGS
[0039] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.
[0040] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the drawings required in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.
[0041] Figure 1 A schematic diagram of the structure of a data processing system provided in an embodiment of the present application;
[0042] Figure 2 One of the flow charts showing the location points of the audio provided in the embodiment of the present application;
[0043] Figure 3 The second flowchart showing the location points of the audio provided in the embodiment of the present application;
[0044] Figure 4 One of the schematic diagrams of the time interval corresponding to the locator provided in the embodiment of the present application;
[0045] Figure 5 The second schematic diagram of the time interval corresponding to the locator provided in the embodiment of the present application;
[0046] Figure 6 A schematic diagram of a display interface for audio location points provided in an embodiment of the present application;
[0047] Figure 7 The third schematic diagram of the time interval corresponding to the locator provided in the embodiment of the present application;
[0048] Figure 8 A fourth schematic diagram of the time interval corresponding to the locator provided in the embodiment of the present application;
[0049] Fig. 9 A fifth schematic diagram of the time interval corresponding to the locator provided in the embodiment of the present application;
[0050] Fig.10 Schematic diagram 6 of the time interval corresponding to the locator provided in the embodiment of the present application;
[0051] Fig.11 A schematic diagram of the structure of an audio display device provided in an embodiment of the present application;
[0052] Fig.12 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0053] In order to more clearly understand the above-mentioned purposes, features and advantages of the present application, the scheme of the present application will be further described below. It should be noted that the embodiments of the present application and the features in the embodiments can be combined with each other without conflict.
[0054] In the following description, many specific details are set forth to facilitate a full understanding of the present application, but the present application may also be implemented in other ways different from those described herein. Obviously, the embodiments in the specification are only part of the embodiments of the present application, rather than all of the embodiments.
[0055] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a concrete way. In addition, in the description of the embodiments of the present application, unless otherwise specified, the meaning of "multiple" refers to two or more.
[0056] The following first describes the data processing system involved in the embodiment of the present application. Figure 1As shown, the data processing system includes: a server 11, a terminal device 12, and a plurality of locators (beacons) 13 respectively arranged at different spatial positions.
[0057] Among them, the terminal device 12 can record the sound in the environment, and in the process of recording the sound in the environment, periodically scan the locator with a preset time period as a period, and generate a locator identifier list according to the locator identifiers of each locator scanned. When the recording of the sound in the environment is finished, the recorded audio file and the locator identifier list obtained by scanning the locator each time during the recording of the audio file are sent to the server 11. The server 11 is used to receive the audio file sent by the terminal device 12 and the locator identifier list obtained by scanning the locator each time during the recording of the audio file, and determine the position points corresponding to each audio segment of the target audio according to the locator identifier list obtained by scanning the locator each time and the position points corresponding to each locator.
[0058] The terminal device 12 in the embodiment of the present application can be an ID card, a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle terminal, a wearable device, a netbook, a personal digital assistant (PDA), etc., and the embodiment of the present application does not make specific limitations on this. Figure 1 In the figure, the terminal device 12 is taken as an example of a work badge.
[0059] The present application embodiment provides an audio presentation method, referring to Figure 2 As shown, the audio presentation method includes the following steps S201 and S202:
[0060] S201: Obtain position points corresponding to each audio segment of the target audio.
[0061] In the embodiment of the present application, the location point corresponding to the audio segment refers to the geographic space location point corresponding to the audio segment, specifically the geographic space location of the audio recording device when recording the audio segment. In addition, the location point corresponding to the audio segment can be one or more.
[0062] S202: Associating each audio segment of the target audio with a corresponding position point and displaying the same.
[0063] Among them, each of the audio segments corresponds to at least one of the location points, each of the audio segments corresponds to multiple location records, each of the location records includes a recording time and a locator identifier, the locator identifier is associated with the location point, and the audio segment is determined by the location records with the same locator identifier and a recording time interval less than a first threshold duration.
[0064] In some embodiments, displaying each audio segment of the target audio in association with a corresponding position point includes: displaying a playback progress bar of the target audio, and displaying a corresponding position point at a preset position of the playback progress bar corresponding to each audio segment of the target audio.
[0065] In addition, when an audio clip corresponds to multiple position points, the multiple position points can be displayed in association with the audio clip, or one position point can be selected from the multiple position points and the selected position point can be displayed in association with the audio clip.
[0066] The audio display method provided in the embodiment of the present application can obtain the position points corresponding to each audio segment of the target audio, and associate the each audio segment of the target audio with the corresponding position points for display, and each of the audio segments corresponds to at least one of the position points, and each of the audio segments corresponds to multiple position records, each of the position records includes a recording time and a locator identifier, and the locator identifier is associated with the position point, and the audio segment is determined by the position record with the same locator identifier and a recording time interval less than the first threshold duration. Since the audio display method provided in the embodiment of the present application can determine the each audio segment of the target audio according to the position record with the same locator identifier and a recording time interval less than the first threshold duration, and determine the position points corresponding to each audio segment of the target audio, the embodiment of the present application can convert discrete locator position points into position points corresponding to audio segments, and then associate the each audio segment of the target audio with the corresponding position points for display, so the embodiment of the present application can more intuitively display the recording positions corresponding to the audio segments of the audio.
[0067] The present application embodiment provides an audio presentation method, referring to Figure 3 As shown, the audio presentation method includes the following steps S301 to S306:
[0068] S301. Obtain target audio and a set of position records corresponding to the target audio.
[0069] The location record set includes: a location record generated based on a locator identifier of each locator scanned during the recording of the target audio; each location record includes a recording time and a locator identifier.
[0070] In some embodiments, the terminal device may periodically perform a locator scan during the audio recording process, and the number of locators that can be scanned each time the locator scan is performed may be any number (0 or 1 or 2 or more).
[0071] In some embodiments, the locator identifier can be the name of the locator, the identification code (ID) of the locator, the index of the locator, etc. The embodiments of the present application do not limit this, and the locator identifier of the locator can uniquely identify the locator.
[0072] In some embodiments, obtaining a location record set corresponding to the target audio includes the following steps a to c:
[0073] Step a: receiving multiple recording times and a list of locator identifiers corresponding to each recording time sent by a terminal device.
[0074] The locator identification list corresponding to any recording time includes identification information of each locator scanned at the recording time.
[0075] For example: the terminal device performs a locator scan at time T and scans locators A, B and C. The locator identification list corresponding to the recorded time T includes locator identification A of locator a, locator identification B of locator b and locator identification C of locator c.
[0076] Step b: Generate a location record according to each locator identifier in the locator identifier list corresponding to each recording time, so as to obtain all location records corresponding to the target audio.
[0077] Exemplarily, during the recording of the target audio, locator scans are performed at time T1, time T2, and time T3, respectively. Locator a, locator b, and locator c are scanned at recording time T1, and the corresponding locator identifier list is: {locator identifier A, locator identifier B, locator identifier C}; locator b, locator c, and locator d are scanned at recording time T2, and the corresponding locator identifier list is: {locator identifier B, locator identifier C, locator identifier D}; locator d and locator e are scanned at recording time T3, and the corresponding locator identifier list is: {locator identifier D, locator identifier E}. Then, by generating position records according to each locator identifier in the locator identifier list corresponding to time T1, time T2, and time T3, the following 8 position records can be obtained:
[0078] Location record 1: record time T1-locator identifier A;
[0079] Location record 2: record time T1-locator identifier B;
[0080] Location record 3: record time T1-locator identifier C;
[0081] Location record 4: record time T2-locator identifier B;
[0082] Location record 5: record time T2-locator identifier C;
[0083] Location record 6: record time T2-locator identifier D;
[0084] Location record 7: record time T3-locator identifier D;
[0085] Location record 8: recording time T3-locator identifier E.
[0086] Step c: combine all the position records corresponding to the target audio to obtain a set of position records corresponding to the target audio.
[0087] As described in the above example, when position records are generated according to each locator identifier in the locator identifier list corresponding to each recording time, position record 1 to position record 8 can be obtained. Then the position record set corresponding to the target audio is: {position record 1, position record 2, position record 3, position record 4, position record 5, position record 6, position record 7, position record 8}.
[0088] S302: Group the location records in the location record set according to the locator identifiers to obtain location record groups corresponding to each locator.
[0089] That is, the location records with the same locator identifier in the location record set are divided into the same location record group, and the location record group consisting of location records with the same locator identifier is used as the location record group corresponding to the locator identified by the locator identifier.
[0090] As described in the above example, the position record set corresponding to the target audio is: {position record 1, position record 2, position record 3, position record 4, position record 5, position record 6, position record 7, position record 8}, then after grouping the position records in the position record set according to the locator identifier, we can get the position record group corresponding to locator a, the position record group corresponding to locator b, the position record group corresponding to locator c and the position record group corresponding to locator d, and the position record group corresponding to locator a includes: position record 1; the position record group corresponding to locator b includes: position record 2 and position record 4; the position record group corresponding to locator c includes: position record 3 and position record 5; the position record group corresponding to locator d includes: position record 6 and position record 7; the position record group corresponding to locator e includes: position record 8.
[0091] S303: Obtain the time interval corresponding to each locator according to the location records in the location record group corresponding to each locator whose interval duration is less than the first threshold duration.
[0092] That is, the location records in the location record group corresponding to each locator whose recording time interval duration is less than the first threshold duration are merged into one time interval, and the merged time interval is used as the time interval corresponding to the locator.
[0093] In some embodiments, the first threshold duration is 2T, wherein T is the interval duration between two adjacent locator scans when the locator scan is performed periodically.
[0094] For example, refer to Figure 4 As shown, the location record group corresponding to locator b includes 5 location records, and the recording times of the 5 location records are T1, T2, T3, T4 and T5 respectively. Among them, the interval duration between T1 and T2 is T, the interval duration between T2 and T3 is 3T, the interval duration between T3 and T4 is 4T, and the interval duration between T4 and T5 is T. When the first threshold duration is 2T, since the interval duration (T) between T1 and T2 is less than the first threshold duration (2T), and the interval duration (T) between T4 and T5 is less than the first threshold duration (2T), the time interval corresponding to locator b includes: [T1, T2], [T4, T5].
[0095] S304: Segment the target audio into multiple audio segments according to the time intervals corresponding to the locators.
[0096] For example, refer to Figure 5 As shown, the time interval corresponding to locator a includes: [T2, T5], the time interval corresponding to locator b includes: [T1, T2] and [T7, T10], and the time interval corresponding to locator c includes: [T4, T8]. Therefore, the target audio can be divided into 6 audio frequency bands according to the time interval corresponding to locator a, the time interval corresponding to locator b and the time interval corresponding to locator c. The 6 audio frequency bands are: the first audio frequency band 51, the corresponding locator is locator b; the second audio frequency band 52, the corresponding locator is locator a; the third audio frequency band 53, the corresponding locators are locator a and locator c; the fourth audio frequency band 54, the corresponding locator is locator c; the fifth audio frequency band 55, the corresponding locators are locator b and locator c; the sixth audio frequency band 56, the corresponding locator is locator b.
[0097] S305: Determine, according to the position points associated with the respective locators, the position points corresponding to the respective audio segments for obtaining the target audio.
[0098] In some embodiments, before determining the position points corresponding to the respective audio segments of the target audio according to the position points associated with the respective locators, the method further includes:
[0099] Obtain the position points corresponding to each locator according to the preset corresponding relationship;
[0100] The preset corresponding relationship includes the position points corresponding to each locator.
[0101] In some embodiments, the position point corresponding to the locator may be the installation position of the locator.
[0102] Exemplarily, the preset corresponding relationship may be shown in the following Table 1:
[0103] Table 1 Correspondence between locators and position points
[0104]
[0105] Cheng Figure 4 In the example shown, the target audio is divided into 6 audio frequency bands, which are: the first audio frequency band 51, the corresponding locator is locator b; the second audio frequency band 52, the corresponding locator is locator a; the third audio frequency band 53, the corresponding locators are locator a and locator c; the fourth audio frequency band 54, the corresponding locator is locator c; the fifth audio frequency band 55, the corresponding locators are locator b and locator c; the sixth audio frequency band 56, the corresponding locator is locator b, because the locator corresponding to locator a is the position corresponding to locator c. The point is position point 1, the position point corresponding to the locator a is position point 2, and the position point corresponding to the locator c is position point 3. Therefore, the position point corresponding to the first audio frequency band 51 is position point 2; the position point corresponding to the second audio frequency band 52 is position point 1; the position point corresponding to the third audio frequency band 53 is position point 1 and position point 3; the position point corresponding to the fourth audio frequency band 54 is position point 3; the position point corresponding to the fifth audio frequency band 55 is position point 2 and position point 3; the position point corresponding to the sixth audio frequency band 56 is position point 2.
[0106] S306: Associate each audio segment of the target audio with the corresponding position point and display it.
[0107] In some embodiments, reference Figure 6 As shown, each audio segment of the target audio is associated with a corresponding position point and displayed, including: displaying a playback progress bar 600 of the target audio, and displaying a corresponding position point at a preset position of the playback progress bar corresponding to each audio segment of the target audio. Figure 6 In the figure, the preset position of the play progress bar 600 is taken as the upper side of the play progress bar as an example.
[0108] The audio display method provided in the embodiment of the present application first obtains the target audio and the target audio and the corresponding position record set, then groups the position records in the position record set according to the locator identifier to obtain the position record group corresponding to each locator, then obtains the time interval corresponding to each locator according to the position records with an interval duration less than a first threshold duration in the position record group corresponding to each locator, then divides the target audio into multiple audio segments according to the time interval corresponding to each locator, finally determines the position points corresponding to the respective audio segments of the target audio according to the position points associated with each locator, and displays the respective audio segments of the target audio in association with the corresponding position points. Since the audio location point display provided by the embodiment of the present application can obtain a location record set generated based on the locator identifier of each locator scanned during the recording of the target audio, group the location records in the location record set according to the locator identifier, and obtain the time interval corresponding to each locator based on the location records in the location record group corresponding to each locator with an interval duration less than a first threshold duration, the embodiment of the present application can convert discrete locator location points into location points of continuous time intervals, and then display the location points corresponding to each audio segment of the target audio. Therefore, the embodiment of the present application can more intuitively display the recording positions corresponding to the audio segments of the audio.
[0109] In some embodiments, dividing the target audio into multiple audio segments according to the time intervals corresponding to each locator includes: dividing the target audio into multiple audio segments according to the time intervals corresponding to each locator whose interval length is greater than or equal to the second threshold time length.
[0110] In some embodiments, the time intervals corresponding to each locator whose interval length is less than the second threshold time length can be deleted first, and then the target audio can be divided into multiple audio segments according to the time intervals corresponding to each locator, thereby achieving the goal of dividing the target audio into multiple audio segments according to the time intervals corresponding to each locator whose interval length is greater than or equal to the second threshold time length.
[0111] Exemplarily, since the time intervals corresponding to a certain locator include: [T1, T2], [T3, T4], [T5, T6], and the lengths of the time intervals [T1, T2], [T3, T4], [T5, T6] are 3T, T, and 4T respectively; when the second threshold time length is 2T, the time interval [T3, T4] is deleted from the time interval corresponding to the locator. After deletion, the time interval corresponding to the locator includes: [T1, T2] and [T5, T6].
[0112] In some embodiments, the audio position point display provided in the above embodiment further includes: before dividing the target audio into multiple audio segments according to the time intervals corresponding to each locator, performing the following steps 1 to 3:
[0113] Step 1: Determine whether the length of each blank interval corresponding to each locator is less than a third threshold time length.
[0114] The blank interval corresponding to any locator is an interval between two adjacent time intervals corresponding to the locator.
[0115] For example, refer to Figure 7 As shown, the locator c includes corresponding time intervals including: [T1, T2], [T3, T4], [T5, T6], and the blank intervals corresponding to the locator c include: a first blank interval 71 located between the time interval [T1, T2] and the time interval [T3, T4], and a second blank interval 72 located between the time interval [T3, T4] and the time interval [T5, T6].
[0116] Step 2: If the length of the first blank interval corresponding to the first locator is less than the third threshold duration, the first blank interval is determined as the time interval corresponding to the first locator.
[0117] Step 3: If the length of the second blank interval corresponding to the first locator is greater than or equal to the third threshold duration, the second blank interval is not determined as the time interval corresponding to the first locator.
[0118] Continued Figure 7 In the example shown, the blank interval corresponding to the locator c includes: a first blank interval 71 and a second blank interval 72. If the interval length of the first blank interval 71 is greater than the third threshold time length, and the interval length of the second blank interval 72 is less than the third threshold time length, the second blank interval 72 is determined as the time interval corresponding to the locator c, and the first blank interval 71 is not determined as the time interval corresponding to the locator c. After the above operation, the time interval corresponding to the locator c changes from [T1, T2], [T3, T4], [T5, T6] to [T1, T2], [T3, T4], [T4, T5], [T5, T6].
[0119] In some embodiments, the audio display method provided by the above embodiments also includes: before dividing the target audio into multiple audio segments according to the time intervals corresponding to each locator, for each time interval corresponding to the locator, merging the time intervals with intersection in the time intervals corresponding to the locator.
[0120] Exemplarily, when the time intervals corresponding to locator c are [T1, T2], [T3, T4], [T4, T5], and [T5, T6], since the time intervals [T3, T4], [T4, T5], and [T5, T6] have an intersection, [T3, T4], [T4, T5], and [T5, T6] are merged into [T3, T6]. After the merger, the time intervals corresponding to locator C are [T1, T2] and [T3, T6].
[0121] In some embodiments, displaying each audio segment of the target audio in association with a corresponding position point includes: when the position point corresponding to the first audio segment of the target audio includes multiple position points, displaying the multiple position points in association with the first audio segment.
[0122] The first audio segment is any audio segment of the target audio.
[0123] For example, refer to Figure 8 As shown, the time interval corresponding to locator d includes: time interval [T1, T3], and the time interval corresponding to locator e includes: time interval [T2, T4]. The audio segment [T2, T3] corresponds to two position points, namely position point 4 corresponding to locator d and position point 5 corresponding to locator e. Therefore, the audio segment [T2, T3] is displayed in association with position point 4 and position point 5.
[0124] In some embodiments, displaying each audio segment of the target audio in association with a corresponding position point includes:
[0125] When the position point corresponding to the first audio segment of the target audio includes multiple position points, the first audio segment is associated with the target position point among the multiple position points and displayed;
[0126] The target position point is a position point whose corresponding time interval has the longest interval length among the multiple position points, and the first audio segment is any audio segment of the target audio.
[0127] For example, refer to Fig. 9 As shown, the time interval corresponding to locator f includes: time interval [T1, T3], the time interval corresponding to locator g includes: time interval [T2, T5], and the position points corresponding to the audio segment [T2, T3] include 2, namely position point 6 corresponding to locator F and position point 7 corresponding to locator G. Since the interval length of the time interval corresponding to position point 6 is 2T, and the interval length of the time interval corresponding to position point 7 is 3T, the interval length of the time interval corresponding to position point 7 is greater than the interval length of the time interval corresponding to position point 6, so the audio segment [T2, T3] is displayed in association with position point 7.
[0128] In some embodiments, displaying each audio segment of the target audio in association with a corresponding position point includes:
[0129] When the position point corresponding to the first audio segment of the target audio includes multiple position points, the first audio segment is associated with the target position point among the multiple position points and displayed;
[0130] The target position point is a position point with the latest start time of the corresponding time interval among the multiple position points, and the first audio segment is any audio segment of the target audio.
[0131] exemplary, exemplary, reference Fig.10 As shown, the time interval corresponding to locator h includes: time interval [T1, T3], and the time interval corresponding to locator i includes: time interval [T2, T4]. Then, the audio segment [T2, T3] corresponds to two position points, namely, position point 8 corresponding to locator h and position point 9 corresponding to locator i. Since the starting time of the time interval corresponding to position point 8 is T1, and the starting time of the time interval corresponding to position point 9 is T2, the starting time of the time interval corresponding to position point 9 is later than the starting time of the time interval corresponding to position point 8, so the audio segment [T2, T3] is displayed in association with position point 9.
[0132] Based on the same inventive concept, as an implementation of the above method, the embodiment of the present application also provides an audio display device, which corresponds to the above method embodiment. For ease of reading, this embodiment will no longer repeat the details of the above method embodiment one by one, but it should be clear that the audio display device in this embodiment can correspond to all the contents in the above method embodiment.
[0133] The present application embodiment provides an audio display device, Fig.11 is a structural diagram of the audio display device, such as Fig.11 As shown, the audio display device 1100 includes:
[0134] An acquisition unit 111 is used to acquire position points corresponding to each audio segment of the target audio;
[0135] A display unit 112, configured to associate and display each audio segment of the target audio with a corresponding position point;
[0136] Among them, each of the audio segments corresponds to at least one of the location points, each of the audio segments corresponds to multiple location records, each of the location records includes a recording time and a locator identifier, the locator identifier is associated with the location point, and the audio segment is determined by the location records with the same locator identifier and a recording time interval less than a first threshold duration.
[0137] As an optional implementation of an embodiment of the present application, the acquisition unit 111 is specifically used to acquire a set of position records corresponding to the target audio; the position record set includes: a position record generated based on a locator identifier of each locator scanned during the recording of the target audio; grouping the position records in the position record set according to the locator identifier to obtain a position record group corresponding to each locator; acquiring a time interval corresponding to each locator based on the position records in the position record group corresponding to each locator whose interval duration is less than a first threshold duration; dividing the target audio into multiple audio segments based on the time interval corresponding to each locator; and determining the position points corresponding to each audio segment of the target audio based on the position points associated with each locator.
[0138] As an optional implementation of the embodiment of the present application, the acquisition unit 111 is specifically used to divide the target audio into multiple audio segments according to the time intervals corresponding to the respective locators whose interval lengths are greater than or equal to the second threshold time length.
[0139] As an optional implementation of an embodiment of the present application, the acquisition unit 111 is also used to determine whether the interval of each blank interval corresponding to each locator is less than a third threshold duration before dividing the target audio into multiple audio segments according to the time intervals corresponding to each locator; the blank interval corresponding to any locator is an interval between two adjacent time intervals corresponding to the locator; if the interval length of the first blank interval corresponding to the first locator is less than the third threshold duration, the first blank interval is determined as the time interval corresponding to the first locator; if the interval length of the second blank interval corresponding to the first locator is greater than or equal to the third threshold duration, the second blank interval is not determined as the time interval corresponding to the first locator.
[0140] As an optional implementation of the embodiment of the present application, the acquisition unit 111 is also used to merge the time intervals with intersections in the time intervals corresponding to the locators for each time interval corresponding to the locator before dividing the target audio into multiple audio segments according to the time intervals corresponding to each locator.
[0141] As an optional implementation of the embodiment of the present application, the acquisition unit 111 is specifically used to receive multiple recording times sent by the terminal device and a list of locator identifiers corresponding to each recording time; the list of locator identifiers corresponding to any recording time includes the locator identifiers of each locator scanned at the recording time; a location record is generated according to each locator identifier in the list of locator identifiers corresponding to each recording time to obtain all location records corresponding to the target audio; all location records corresponding to the target audio are combined to obtain a set of location records corresponding to the target audio.
[0142] As an optional implementation of the embodiment of the present application, the display unit 112 is specifically used to display the playback progress bar of the target audio, and display the corresponding position point at the preset position of the playback progress bar corresponding to each audio segment of the target audio.
[0143] As an optional implementation of the embodiment of the present application, the display unit 112 is specifically used to associate and display the multiple position points with the first audio segment when the position point corresponding to the first audio segment of the target audio includes multiple position points; the first audio segment is any audio segment of the target audio.
[0144] As an optional implementation of the embodiment of the present application, the display unit 112 is specifically configured to associate and display the first audio segment with a target location point among the multiple location points when the location point corresponding to the first audio segment of the target audio includes multiple location points;
[0145] Among them, the target position point is the position point whose corresponding time interval among the multiple position points has the longest interval length, or the target position point is the position point whose corresponding time interval among the multiple position points has the latest starting time, and the first audio segment is any audio segment of the target audio.
[0146] The audio display device provided in the embodiment of the present application can execute the audio display method provided in any of the above embodiments, and its implementation principle and technical effect are similar, which will not be repeated here.
[0147] Based on the same inventive concept, an embodiment of the present application also provides an audio display device. Fig.12 A schematic diagram of the structure of the audio display device provided in the embodiment of the present application, such as Fig.12 As shown, the audio presentation device provided in this embodiment includes: a memory 121 and a processor 122, wherein the memory 121 is used to store a computer program, and the processor 122 is used to enable the audio presentation device to perform any audio presentation method provided in the above embodiments when executing the computer program.
[0148] Based on the same inventive concept, an embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the computing device implements any audio presentation method provided in the above embodiments.
[0149] Based on the same inventive concept, an embodiment of the present application also provides a computer program product. When the computer program product is run on a computer, the computing device implements any audio presentation method provided in the above embodiments.
[0150] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media that include computer-usable program code.
[0151] The processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.
[0152] The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.
[0153] Computer readable media include permanent and non-permanent, removable and non-removable storage media. Storage media can be implemented by any method or technology to store information, and the information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.
[0154] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some or all of the technical features therein, and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.
Claims
1. An audio presentation method, characterized in that: include: Get the position points corresponding to each audio segment of the target audio; Associating and displaying each audio segment of the target audio with the corresponding position point; Among them, each of the audio segments corresponds to at least one of the location points, each of the audio segments corresponds to multiple location records, each of the location records includes a recording time and a locator identifier, the locator identifier is associated with the location point, and the audio segment is determined by the location records with the same locator identifier and a recording time interval less than a first threshold duration.
2. The method according to claim 1, characterized in that: The obtaining of the position points corresponding to the respective audio segments of the target audio includes: Acquire a location record set corresponding to the target audio; the location record set includes: a location record generated based on a locator identifier of each locator scanned during recording the target audio; Grouping the location records in the location record set according to the locator identifier to obtain a location record group corresponding to each locator; According to the location records in the location record group corresponding to each locator whose interval time is less than the first threshold time, the time interval corresponding to each locator is obtained; Segmenting the target audio into multiple audio segments according to the time intervals corresponding to the respective locators; The position points corresponding to the respective audio segments for obtaining the target audio are determined according to the position points associated with the respective locators.
3. The method according to claim 2, characterized in that The step of dividing the target audio into a plurality of audio segments according to the time intervals corresponding to the respective locators includes: The target audio is divided into a plurality of audio segments according to time intervals corresponding to the respective locators whose interval lengths are greater than or equal to a second threshold time length.
4. The method according to claim 2, characterized in that: Before segmenting the target audio into a plurality of audio segments according to the time intervals corresponding to the respective locators, the method further includes: Determine whether each blank interval corresponding to each locator is less than a third threshold time length; a blank interval corresponding to any locator is an interval between two adjacent time intervals corresponding to the locator; If the length of the first blank interval corresponding to the first locator is less than the third threshold duration, determining the first blank interval as the time interval corresponding to the first locator; If the interval length of the second blank interval corresponding to the first locator is greater than or equal to the third threshold duration, the second blank interval is not determined as the time interval corresponding to the first locator.
5. The method according to claim 2, characterized in that: The step of obtaining a location record set corresponding to the target audio includes: A plurality of recording times and a list of locator identifiers corresponding to each recording time sent by a receiving terminal device; the list of locator identifiers corresponding to any recording time includes the locator identifiers of each locator scanned at the recording time; Generate a position record according to each locator identifier in the locator identifier list corresponding to each recording time, so as to obtain all position records corresponding to the target audio; All position records corresponding to the target audio are combined to obtain a position record set corresponding to the target audio.
6. The method according to claim 1, characterized in that The displaying of associating each audio segment of the target audio with the corresponding position point includes: When the position points corresponding to the first audio segment of the target audio include multiple position points, the multiple position points are associated with the first audio segment and displayed; the first audio segment is any audio segment of the target audio.
7. The method according to claim 2, characterized in that The displaying of associating each audio segment of the target audio with the corresponding position point includes: When the position point corresponding to the first audio segment of the target audio includes multiple position points, the first audio segment is associated with the target position point among the multiple position points and displayed; Among them, the target position point is the position point whose corresponding time interval among the multiple position points has the longest interval length, or the target position point is the position point whose corresponding time interval among the multiple position points has the latest starting time, and the first audio segment is any audio segment of the target audio.
8. An audio display device, characterized in that: include: A memory and a processor, wherein the memory is used to store a computer program and the processor is used to enable the audio presentation device to implement the audio presentation method described in any one of claims 1-7 when executing the computer program.
9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a computing device, the computing device implements the audio presentation method according to any one of claims 1 to 7.
10. A computer program product, characterized in that When the computer program product runs on a computer, the computer implements the audio presentation method according to any one of claims 1 to 7.