Audio playing method of a pickup

By pre-downloading and comparing audio files at the playback end, deleting duplicate data, and using the seek method to skip overlapping parts, the stuttering problem in microphone audio playback was solved, and continuous and smooth playback of audio files was achieved.

CN115865893BActive Publication Date: 2026-07-21HANGZHOU VISION INSIGHT TECH CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
HANGZHOU VISION INSIGHT TECH CO LTD
Filing Date
2022-11-22
Publication Date
2026-07-21

Smart Images

  • Figure CN115865893B_ABST
    Figure CN115865893B_ABST
Patent Text Reader

Abstract

The present application relates to pickup audio playing technical field, and specifically provides a kind of audio playing method of pickup, to solve the problem of repeated data in the audio collected by pickup in prior art and the problem of playing not smooth when switching audio playing.The audio playing method includes that the Nth audio is downloaded to local by playing end and is passed to player, when the player starts playing, playing end judges the relationship between the N+1th audio and the Nth audio;If the N+1th audio is the same data, then delete the N+1th audio, then compare the N+2th audio;If the N+1th audio is the overlapping data, then pre-download and record the overlapping audio duration, if the N+1th audio is different data, then pre-download;When audio playing ends, start playing the pre-downloaded audio file.The overlapping audio is deleted and the audio is downloaded to local, the loading cache time when playing audio is reduced, so that the audio is played continuously and smoothly.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention belongs to the field of microphone audio playback technology, and specifically relates to an audio playback method for a microphone. Background Technology

[0002] As society develops, people have higher and higher requirements for quality of life and service. Service companies in all walks of life also have higher and higher requirements for their employees. In order to understand whether employees’ words and deeds when serving customers are appropriate and whether they satisfy customers, some companies have begun to pilot the installation of microphones in their business halls to record audio data of employees’ communication with customers during work. The audio data is then used to analyze whether employees are performing well at work.

[0003] The audio files captured by the microphone are segmented into data of 2 minutes or less. Due to factors such as the offline or online status of the device supporting the microphone (e.g., a camera or audio recorder), the device may perform supplementary recording operations, resulting in duplicate or overlapping sections of adjacent audio files. When playing these files using existing technology, duplicate audio will appear, impacting the user experience. Furthermore, since the audio files are stored continuously as a series of data with a maximum duration of 2 minutes, if playback is performed using a remote storage address returned by the server, the player needs to load the remote data for caching before playback. This can cause delays and stuttering when switching data sources, further affecting the user experience. Summary of the Invention

[0004] This invention provides an audio playback method using a microphone, aiming to solve the problems in the prior art where there is duplicate data in the audio files collected by the microphone and playback stuttering and unsmoothness when switching audio files during playback.

[0005] To solve the above-mentioned technical problems, the technical solution adopted by the present invention is as follows:

[0006] In a first aspect, the present invention provides an audio playback method for a microphone, comprising:

[0007] The playback device downloads the Nth audio file to the storage device and then transmits it to the player for playback; the playback device includes the storage device and the player; the storage device is located locally on the playback device; where N≥1;

[0008] When the Nth audio file starts playing, the playback terminal pre-downloads the N+1th audio file; when a notification is received that the audio file playback has ended, the playback terminal transmits the pre-downloaded N+1th audio file to the player for playback.

[0009] Before downloading the (N+1)th audio file, the playback terminal compares the (N+1)th audio file with the Nth audio file to determine the relationship between the (N+1)th audio file and the Nth audio file; the relationship includes audio file data being the same, data overlapping, and data being different;

[0010] If the audio file described in the (N+1)th clause is identical to the audio file described in the Nth clause, the playback device deletes the audio file described in the (N+1)th clause and compares the audio file described in the (N+2)th clause with the audio file described in the Nth clause; this continues until the two audio files being compared are either identical or have overlapping data.

[0011] If the audio file described in the N+1th clause has a data overlap with the audio file described in the Nth clause, then the playback terminal will pre-download the audio file described in the N+1th clause and record the audio duration of the data overlap between the audio file described in the N+1th clause and the audio file described in the Nth clause.

[0012] If the relationship between the audio file described in the N+1th item and the audio file described in the Nth item is different in terms of data, then the playback terminal will pre-download the audio file described in the N+1th item.

[0013] A further solution: When the relationship between the audio file mentioned in the (N+1)th entry and the audio file mentioned in the Nth entry is data overlap, the playback terminal pre-downloads the audio file mentioned in the (N+1)th entry. When the player receives a prompt that the audio file playback has ended, it passes the audio file mentioned in the (N+1)th entry to the player for playback using the seek method.

[0014] A further solution: The seek method includes: the playback terminal obtains the time node at which the audio in the N+1th audio file differs from the audio in the Nth audio file by recording the duration of the audio that overlaps with the data in the Nth audio file; the player skips the overlapping audio and plays it according to the time node.

[0015] Based on the above scheme, the seek method enables the player to skip repeated parts when playing audio, so that the audio captured by the microphone can be played continuously.

[0016] A further solution: For the audio file passed to the player via the seek method, the player plays it after receiving a notification that the seek method is complete.

[0017] Based on the above scheme, the player starts playing after receiving a notification that the seek method has completed. When the player is playing an audio file with overlapping data, the player will position the playback time node at the correct position in the audio file.

[0018] A further solution: The playback terminal compares the start and end times of the (N+1)th audio file with the start and end times of the Nth audio file to determine the relationship between the (N+1)th audio file and the Nth audio file; wherein the duration of each audio file is ≤2 minutes.

[0019] Based on the above scheme, since the audio collected by the microphone is divided by time nodes, the playback end can quickly and accurately determine the relationship between two adjacent audio files by comparing the start and end times of two adjacent audio files.

[0020] A further solution: The criterion used by the playback terminal to determine the relationship between the (N+1)th audio file and the Nth audio file is:

[0021] If the start and end times of the audio file described in the (N+1)th clause are the same as the start and end times of the audio file described in the Nth clause, or if the start and end times of the audio file described in the Nth clause include the start and end times of the audio file described in the (N+1)th clause, then the relationship between the audio file described in the (N+1)th clause and the audio file described in the Nth clause is determined to be that they have the same data.

[0022] If the start time of the audio file described in the (N+1)th clause is between the start and end times of the audio file described in the Nth clause, and the end time of the audio file described in the (N+1)th clause is later than the end time of the audio file described in the Nth clause, then the relationship between the audio file described in the (N+1)th clause and the audio file described in the Nth clause is determined to be data overlap.

[0023] If the start time of the audio file described in the (N+1)th clause is the same as the end time of the audio file described in the Nth clause, then the relationship between the audio file described in the (N+1)th clause and the audio file described in the Nth clause is determined to be that the data is different.

[0024] A further solution: Before downloading the Nth audio file on the playback terminal; initialize the player; the playback terminal retrieves the audio file based on the remote storage address returned by the server and a selected time point.

[0025] Based on the above scheme, the player is initialized to prepare it for playing the audio file.

[0026] The playback device requires users to select a time point before acquiring the audio file, allowing users to accurately locate the audio they want to listen to without having to listen to all the audio captured by the microphone, thus improving the efficiency of user supervision.

[0027] Second aspect: The present invention provides a playback terminal for executing an audio playback method for a microphone as described in the first aspect.

[0028] Third aspect: The present invention provides an electronic device, comprising:

[0029] At least one memory for storing programs;

[0030] At least one processor for executing the program stored in the memory;

[0031] Input devices are used to input programs into memory;

[0032] An output device for displaying the results of the processor executing the program stored in the memory;

[0033] When the program stored in the memory is executed, the processor is used to execute an audio playback method for a microphone as described in the first aspect.

[0034] Fourth aspect: The present invention provides a computer-readable storage medium storing computer instructions that cause the computer to implement an audio playback method for a microphone as described in the first aspect.

[0035] The beneficial effects of this invention are as follows:

[0036] This invention pre-downloads audio files to be played, providing the player with an audio source promptly upon completion of playback, resulting in smoother, more lag-free audio transitions. Compared to existing technologies where players need to load cached audio files stored in a remote database before playback, this invention pre-downloads remotely stored audio files to local storage. This allows the player to play locally stored audio files faster, reducing the loading and caching time of remote audio files and improving the smoothness of audio playback.

[0037] Furthermore, this invention determines whether two audio files have identical or overlapping data by comparing the (N+1)th audio file with the Nth audio file. The playback terminal deletes audio files with identical data, preventing the player from repeatedly playing audio captured by the microphone, thereby improving the user experience. When two audio files have overlapping audio data, the playback terminal records the duration of the overlapping audio, allowing the player to skip the overlapping audio during playback, ensuring continuous and smooth playback of the audio files. Attached Figure Description

[0038] To more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings used in the embodiments will be briefly introduced below. It should be understood that the following drawings only show some embodiments of the present invention and should not be regarded as a limitation of the scope. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0039] Figure 1 This is a schematic diagram of the judgment process of an audio playback method for a microphone according to the present invention;

[0040] Figure 2 This is a flowchart illustrating an audio playback method using a microphone according to the present invention.

[0041] Figure 3 This is a schematic diagram of the structure of an electronic device provided by the present invention. Detailed Implementation

[0042] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without inventive effort are within the protection scope of the present invention.

[0043] Example 1:

[0044] like Figure 1 As shown, this embodiment provides an audio playback method for a microphone, including:

[0045] The playback device downloads the Nth audio file to the storage device and then transmits it to the player for playback; the playback device includes the storage device and the player; the storage device is located locally on the playback device; where N≥1;

[0046] When the Nth audio file starts playing, the playback terminal pre-downloads the N+1th audio file; when a notification is received that the audio file playback has ended, the playback terminal transmits the pre-downloaded N+1th audio file to the player for playback.

[0047] Before downloading the (N+1)th audio file, the playback terminal compares the (N+1)th audio file with the Nth audio file to determine the relationship between the (N+1)th audio file and the Nth audio file; the relationship includes audio file data being the same, data overlapping, and data being different;

[0048] If the audio file described in the (N+1)th clause is identical to the audio file described in the Nth clause, the playback device deletes the audio file described in the (N+1)th clause and compares the audio file described in the (N+2)th clause with the audio file described in the Nth clause; this continues until the two audio files being compared are either identical or have overlapping data.

[0049] If the audio file described in the N+1th clause has a data overlap with the audio file described in the Nth clause, then the playback terminal will pre-download the audio file described in the N+1th clause and record the audio duration of the data overlap between the audio file described in the N+1th clause and the audio file described in the Nth clause.

[0050] If the relationship between the audio file described in the N+1th item and the audio file described in the Nth item is different in terms of data, then the playback terminal will pre-download the audio file described in the N+1th item.

[0051] Specifically, the playback device downloads the first audio file and transmits it to the player for playback;

[0052] When the first audio file starts playing, the playback device compares the second audio file with the first audio file. If the data of the second audio file and the first audio file are the same, the second audio file is deleted. Then, the third audio file is compared with the first audio file to determine the relationship between the two audio files. If the data of the second audio file and the first audio file overlap, the second audio file is pre-downloaded, and the duration of the overlap between the second audio file and the first audio file is recorded. If the data of the second audio file and the first audio file are different, the playback device pre-downloads both audio files.

[0053] When a notification is received that the audio file playback has ended, the playback device passes the second audio file to the player for playback. If the second audio file has overlapping audio, the player skips the overlapping audio and plays the second audio file immediately after the first audio file. If the data of the second audio file and the first audio file are different, the player plays the second audio file directly.

[0054] When the second audio file starts playing, the playback device compares the third audio file with the second audio file to determine the relationship between the two audio files and performs the above-mentioned processing.

[0055] The playback device sequentially pre-downloads and transmits the audio files that the user wants to listen to to the player for playback.

[0056] When the relationship between the audio file described in the (N+1)th entry and the audio file described in the Nth entry is data overlap, the playback terminal pre-downloads the audio file described in the (N+1)th entry. When the player receives a prompt that the audio file playback has ended, it passes the audio file described in the (N+1)th entry to the player for playback using the seek method.

[0057] The seek method includes: the playback terminal obtains the time node at which the audio in the N+1th audio file differs from the audio in the Nth audio file by recording the duration of the audio that overlaps with the data in the Nth audio file; the player skips the overlapping audio and plays it according to the time node.

[0058] For the audio file passed to the player via the seek method, the player plays it after receiving a notification that the seek method has completed.

[0059] Specifically, the `seek` method in Python moves the file read pointer to a specified position using the `seek` function. In this embodiment, the `seek` method allows the player to skip overlapping audio in the audio files. For example, the first audio file has a duration of 9:00-9:02, and the second audio file has a duration of 9:01-9:03. The second audio file overlaps with the first audio file. The playback device pre-downloads the second audio file and records the overlapping audio duration of 9:01-9:02. The `seek` method uses the overlapping audio duration of 9:01-9:02 to obtain the time point 9:02 where the data differs from the first audio file in the second audio file. When the player starts playing the second audio file, it skips the overlapping audio and starts playing directly from 9:02.

[0060] The playback device compares the start and end times of the (N+1)th audio file with the start and end times of the Nth audio file to determine the relationship between the (N+1)th audio file and the Nth audio file; wherein the duration of each audio file is ≤2 minutes.

[0061] A further solution: The criterion used by the playback terminal to determine the relationship between the (N+1)th audio file and the Nth audio file is:

[0062] If the start and end times of the audio file described in the (N+1)th clause are the same as the start and end times of the audio file described in the Nth clause, or if the start and end times of the audio file described in the Nth clause include the start and end times of the audio file described in the (N+1)th clause, then the relationship between the audio file described in the (N+1)th clause and the audio file described in the Nth clause is determined to be that they have the same data.

[0063] If the start time of the audio file described in the (N+1)th clause is between the start and end times of the audio file described in the Nth clause, and the end time of the audio file described in the (N+1)th clause is later than the end time of the audio file described in the Nth clause, then the relationship between the audio file described in the (N+1)th clause and the audio file described in the Nth clause is determined to be data overlap.

[0064] If the start time of the audio file described in the (N+1)th clause is the same as the end time of the audio file described in the Nth clause, then the relationship between the audio file described in the (N+1)th clause and the audio file described in the Nth clause is determined to be that the data is different.

[0065] Specifically, taking the first and second audio files as examples, the standard by which the playback terminal determines the relationship between the two audio files is:

[0066] If the time of the first audio file is 8:00-8:02; if the time of the second audio file is also 8:00-8:02, or if the time of the second audio file is between 8:00-8:02, then the relationship between the second audio file and the first audio file is that the data is the same.

[0067] If the time of the first audio file is 8:00-8:02, and the time of the second audio file is 8:01-8:03; or if the time of the first audio file is 8:00-8:01, and the time of the second audio file is also 8:00-8:02, then the relationship between the second audio file and the first audio file is determined to be data overlap.

[0068] If the time of the first audio file is 8:00-8:02, and the time of the second audio file is 8:02-8:04, then the relationship between the second audio file and the first audio file is that the data is different.

[0069] Before downloading the Nth audio file on the playback terminal, the player is initialized; the playback terminal retrieves the audio file based on the remote storage address returned by the server and the selected time point.

[0070] Specifically, since the audio captured by the microphone can be stored for approximately 30 days, the playback device needs to retrieve the audio file based on the time point selected by the user. The user can select the time using a calendar or a scrolling timeline.

[0071] Example 2:

[0072] This embodiment provides a playback terminal, which is used to execute an audio playback method for a microphone as described in Embodiment 1.

[0073] Specifically, the playback device can be a mobile phone or tablet running an Android system, or other terminal device with voice playback functionality.

[0074] Example 3:

[0075] This embodiment provides an electronic device, including:

[0076] At least one memory for storing programs;

[0077] At least one processor for executing the program stored in the memory;

[0078] Input devices are used to input programs into memory;

[0079] An output device for displaying the results of the processor running the program stored in the memory;

[0080] When the program stored in the memory is executed, the processor is used to execute an audio playback method for a microphone as described in Embodiment 1.

[0081] Specifically, the input device can be a keyboard, mouse, camera, etc., and in this embodiment, the input device is a keyboard; the output device can be an audio device, monitor, or printer, and in this embodiment, the input device is a monitor.

[0082] The memory, also known as RAM, is the storage space that the processor can directly address. The memory includes Random Access Memory (RAM), Read Only Memory (ROM), high-level cache, and external storage.

[0083] The processor can be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. The central processing unit includes a control unit (CU) and an arithmetic logic unit (ALU); the control unit is the command system of the point-to-point device, performing command functions for the electronic device; the arithmetic logic unit is used to perform arithmetic and logical operations.

[0084] like Figure 3 As shown, the relationship between the memory, the processor, the input device, and the output device is as follows:

[0085] The input device inputs a program, which is stored in the memory. The processor retrieves the program from the memory and executes it. The output device displays the result of the processor executing the program.

[0086] Example 4:

[0087] This embodiment provides a computer-readable storage medium storing computer instructions that enable the computer to implement an audio playback method for a microphone as described in Embodiment 1.

[0088] Specifically, when the computer instructions are executed on a computer, all or part of the audio playback method of the microphone as described in Embodiment 1 above is generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted through the computer-readable storage medium. The computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line) or wireless (e.g., infrared, wireless, or microwave). The computer-readable storage medium can be any available medium that a computer can access, or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state drive).

[0089] This invention is not limited to the above-described optional embodiments. Anyone can derive other various forms of products under the guidance of this invention. However, regardless of any changes made in their shape or structure, any technical solution that falls within the scope of the claims of this invention shall be protected by this invention.

Claims

1. An audio playback method for a microphone, characterized in that, include: The playback device downloads the Nth audio file to the storage device and then transmits it to the player for playback. The playback device includes a memory and a player; The memory is located locally on the playback device; where N≥1; When the Nth audio file starts playing, the playback device will pre-download the (N+1)th audio file. When a notification is received that the audio file playback has ended, the playback terminal will transmit the pre-downloaded N+1th audio file to the player for playback; Before downloading the (N+1)th audio file, the playback terminal compares the (N+1)th audio file with the Nth audio file to determine the relationship between the (N+1)th audio file and the Nth audio file; the relationship includes audio file data being the same, data overlapping, and data being different; If the audio file described in the (N+1)th clause is identical to the audio file described in the Nth clause, the playback device deletes the audio file described in the (N+1)th clause and compares the audio file described in the (N+2)th clause with the audio file described in the Nth clause; this continues until the two audio files being compared are either identical or have overlapping data. If the audio file described in the (N+1)th entry has overlapping data with the audio file described in the Nth entry, the playback terminal pre-downloads the audio file described in the (N+1)th entry and records the duration of the overlapping audio data between the audio file described in the (N+1)th entry and the audio file described in the Nth entry. When the player receives a notification that the audio file playback has ended, it uses the seek method to pass the audio file described in the (N+1)th entry to the player for playback. The playback terminal obtains the time point at which the audio data of the audio file described in the (N+1)th entry differs from that of the audio file described in the Nth entry based on the recorded duration of the overlapping audio data. The player skips the overlapping audio data and plays it according to the time point. The seek method includes: the playback terminal obtaining the start time node of the audio that is different between the N+1th audio file and the Nth audio file by recording the audio duration that overlaps with the data of the Nth audio file in the N+1th audio file; the player skips the overlapping audio and plays according to the time node; If the relationship between the audio file described in the N+1th item and the audio file described in the Nth item is different in terms of data, then the playback terminal will pre-download the audio file described in the N+1th item.

2. The audio playback method of a microphone according to claim 1, characterized in that: For the audio file passed to the player via the seek method, the player plays it after receiving a notification that the seek method has completed.

3. The audio playback method of a microphone according to claim 1, characterized in that: The playback device compares the start and end times of the (N+1)th audio file with the start and end times of the Nth audio file to determine the relationship between the (N+1)th audio file and the Nth audio file; wherein the duration of each audio file is ≤2 minutes.

4. The audio playback method of a microphone according to claim 3, characterized in that: The criterion used by the playback terminal to determine the relationship between the (N+1)th audio file and the Nth audio file is: If the start and end times of the audio file described in the (N+1)th clause are the same as the start and end times of the audio file described in the Nth clause, or if the start and end times of the audio file described in the Nth clause include the start and end times of the audio file described in the (N+1)th clause, then the relationship between the audio file described in the (N+1)th clause and the audio file described in the Nth clause is determined to be that they have the same data. If the start time of the audio file described in the (N+1)th clause is between the start and end times of the audio file described in the Nth clause, and the end time of the audio file described in the (N+1)th clause is later than the end time of the audio file described in the Nth clause, then the relationship between the audio file described in the (N+1)th clause and the audio file described in the Nth clause is determined to be data overlap. If the start time of the audio file described in the (N+1)th clause is the same as the end time of the audio file described in the Nth clause, then the relationship between the audio file described in the (N+1)th clause and the audio file described in the Nth clause is determined to be that the data is different.

5. The audio playback method of a microphone according to claim 1, characterized in that: Before downloading the Nth audio file on the playback terminal, the player is initialized; the playback terminal retrieves the audio file based on the remote storage address returned by the server and the selected time point.

6. An electronic device, characterized in that, include: At least one memory for storing programs; At least one processor for executing the program stored in the memory; Input devices are used to input programs into memory; An output device for displaying the results of the processor executing the program stored in the memory; When the program stored in the memory is executed, the processor is used to execute the audio playback method of the microphone as described in claim 1.

7. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions that cause the computer to implement the audio playback method of the microphone as described in claim 1.