An audio recording method, a wearable device, and an audio processing system
By setting up multiple recording components in wearable devices and automatically switching them according to resource status, the problems of discontinuous and incomplete recordings are solved, achieving continuity and integrity in recording and extending recording time.
Patent Information
- Application Number
- CN202611209832.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-08-10
- Publication Date
- 2026-11-10
AI Technical Summary
Wearable devices may automatically stop recording due to insufficient battery power during recording, resulting in discontinuous and incomplete recordings. Users may need to manually switch recording devices, causing the recording to be interrupted.
Multiple recording components are set up in wearable devices. By monitoring the remaining resource status of each component, the optimal component is automatically selected for recording. When one component is short of resources, the device switches to another component to continue recording, ensuring the continuity and integrity of the recording.
The recording time was extended, ensuring the integrity and smoothness of the recording, avoiding recording interruptions, and improving the user experience.
Smart Images

Figure CN123072433A_ABST
Abstract
Description
Technical Field
[0001] This application belongs to the field of audio processing technology, and in particular relates to an audio recording method, a wearable device, and an audio processing system. Background Technology
[0002] With the development of intelligent devices, their functions are becoming increasingly diverse to meet user needs. Wearable devices with recording capabilities, such as smart glasses or headphones, typically have a recording component. After receiving a user's recording request, the device activates this component. However, due to the high power consumption during recording, recording often stops when the recording component runs out of power. If the user wants to continue recording, they need to change the recording device, which takes time. During this time, audio cannot be recorded, resulting in discontinuous and incomplete recordings. Summary of the Invention
[0003] This application provides an audio recording method, a wearable device, and an audio processing system that can solve the problems of discontinuous and incomplete recordings.
[0004] In a first aspect, embodiments of this application provide an audio recording method applied to a wearable device, the wearable device including at least two recording components; the method includes: Upon receiving a recording start command, the system controls the first component to begin recording audio, wherein the first component is one of at least two recording components; If it is determined that the remaining resource status of the first component meets the resource shortage condition and no end recording command is received, the first component is controlled to stop recording audio, and the first recording file recorded by the first component is obtained. The second component is controlled to start recording audio, and a second audio file is obtained by the second component. The second component is one of the other components, which are at least two recording components other than the first component.
[0005] In this application, upon receiving a recording start command, the first component is first controlled to begin recording audio. The remaining resource status of the first component is monitored. If the remaining resource status of the first component meets the resource insufficiency condition and no end recording command is received, the first component is controlled to stop recording audio, and the recording is switched to the second component. This application sets up multiple recording components, using one component for each recording session. By alternating recording with multiple components, the audio recording time can be extended, ensuring the integrity of long audio clips. Furthermore, after one recording component finishes recording, the next recording component automatically starts to continue recording, ensuring uninterrupted audio recording and guaranteeing the integrity and smoothness of the audio recording.
[0006] In one possible implementation of the first aspect, before controlling the second component to start recording audio and obtaining the second audio file recorded by the second component, the method further includes: If there are multiple other components, obtain the remaining resource status of the multiple other components, wherein the remaining resource status includes the remaining power value and the remaining storage space value; The optimal resource is determined from the remaining resource states of the other components, and the other component corresponding to the optimal resource is determined as the second component. The optimal resource is the resource that supports the other components for the longest recording time.
[0007] In this application, when the resources of the first component are insufficient, the remaining recording components will not be randomly selected. Instead, components with sufficient remaining resources will be selected as the second component to take over the recording. This avoids selecting components with insufficient power or storage space, which would lead to frequent switching of recording components. This ensures that audio can be recorded for as long as possible after each switching of recording components.
[0008] In one possible implementation of the first aspect, determining the optimal resource from the remaining resource states of the plurality of other components, and identifying the other component corresponding to the optimal resource as the second component, includes: Based on the remaining resource status of multiple other components, a first candidate component is determined from the other components, wherein the first candidate component is an other component that meets preset status requirements, wherein the preset status requirements include a remaining battery value greater than a preset battery value and a remaining storage space value greater than a preset space value. If there are multiple first candidate components, then the optimal resource is determined from the remaining resource states of the multiple first candidate components, and the first candidate component corresponding to the optimal resource is determined as the second component; If there is one of the first candidate components, then the first candidate component is determined to be the second component.
[0009] In this application, recording components with low battery or insufficient storage space are first filtered out, and only the first candidate components with the basic ability to record continuously are retained; then the second component is determined from the first candidate components to avoid the phenomenon that the recording component is switched again in a short period of time due to insufficient battery or storage space after switching to the second component.
[0010] In one possible implementation of the first aspect, determining the optimal resource from the remaining resource states of a plurality of first candidate components, and determining the first candidate component corresponding to the optimal resource as the second component, includes: Based on the remaining battery power of the i-th first candidate component, determine the first recording duration of the i-th first candidate component, 1≤i≤N, where N is the number of the first candidate components; The second recording duration of the i-th first candidate component is determined based on the remaining storage space value of the i-th first candidate component. The minimum value of the first recording duration and the second recording duration is determined as the total recording duration of the i-th first candidate component; The maximum value among the total recording time of multiple first candidate components is determined, and the remaining resource state corresponding to the maximum value is the optimal resource. The first candidate component corresponding to the optimal resource is determined as the second component.
[0011] In this application, the recording duration is constrained by both the remaining battery power and the remaining storage space. Recording will terminate when either power is depleted. This application calculates the first recording duration based on the remaining battery power and the second recording duration based on the remaining storage space, and selects the minimum value between the first and second recording durations as the true total recording duration that the recording component can support. This accurately reflects the upper limit of the hardware's actual continuous recording capability and avoids misjudgments caused by a single indicator.
[0012] In one possible implementation of the first aspect, before controlling the second component to start recording audio and obtaining the second audio file recorded by the second component, the method further includes: If one of the other components exists, obtain the remaining resource status of that other component; If the remaining resource status of the other components meets the preset status requirements, then the other components are identified as the second component. The preset status requirements include that the remaining battery power is greater than a preset battery power value and the remaining storage space is greater than a preset storage space value.
[0013] In one possible implementation of the first aspect, the method further includes, before controlling the first component to begin recording audio: Obtain the remaining resource status of multiple recording components, wherein the remaining resource status includes the remaining battery power and the remaining storage space. The optimal resource is determined from the remaining resource states of the multiple recording components, and the recording component corresponding to the optimal resource is determined as the first component. The optimal resource is the resource that supports the recording component for the longest recording time.
[0014] In one possible implementation of the first aspect, after controlling the first component to stop recording audio and obtaining the first audio recording file recorded by the first component, the method further includes: Generate first file information for the first recording file. The first file information includes pointer information and metadata of the first recording file. The pointer information of the first recording file indicates whether there are other audio files connected to the audio files in the first recording file. Add the first file information of the first recording file to the file storage list of the wearable device; After controlling the second component to start recording audio and obtaining the second audio file recorded by the second component, the method further includes: The second file information of the second recording file is generated. The second file information includes pointer information and metadata of the second recording file. The pointer information of the second recording file indicates whether there are other audio files connected to the audio files in the second recording file. Add the second file information of the second recording file to the file storage list of the wearable device.
[0015] In this application, each audio file is accompanied by unique pointer information to mark whether there is connecting audio before and after the current audio segment, establishing a chain of relationships between different audio segments. Alternating recording by multiple recording components generates multiple independent audio files. Without continuity marking, mobile terminals cannot automatically distinguish the recording order, easily leading to reversed synthesized audio and misaligned segments. The pointer information directly stores the segment connection relationships, providing a core basis for subsequent automatic sorting.
[0016] Secondly, embodiments of this application provide a wearable device, which includes at least two recording components, including: The first component control module is used to control the first component to start recording audio after receiving a recording start command, wherein the first component is one of at least two recording components; The file generation module is used to control the first component to stop recording audio and obtain the first recording file recorded by the first component when it is determined that the remaining resource status of the first component meets the resource shortage condition and no end recording instruction is received. The second component control module is used to control the second component to start recording audio and obtain a second audio file recorded by the second component. The second component is one of the other components, which are at least two recording components other than the first component.
[0017] Thirdly, embodiments of this application provide a wearable device, including at least two recording components, a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the audio recording method described in any one of the first aspects above.
[0018] Fourthly, embodiments of this application provide a computer-readable storage medium storing a computer program that, when executed by a processor, implements the audio recording method described in any one of the first aspects above.
[0019] Fifthly, embodiments of this application provide a computer program product that, when run on a wearable device, causes the wearable device to execute the audio recording method described in any of the first aspects above.
[0020] Sixthly, embodiments of this application provide an audio processing system, the system including a mobile terminal and the wearable device described in the third aspect above. The execution process of a mobile terminal includes: The mobile terminal sends a list retrieval instruction to the wearable device, wherein the list retrieval instruction is used to instruct the wearable device to send a file storage list to the mobile terminal. The file storage list stores the file information of the recorded files of the wearable device. The file information of each recorded file includes the timestamp of the recorded file. Different timestamps are used to distinguish different recording events. The timestamps of all recorded files under the same recording event are the same. After receiving the file storage list sent by the wearable device, the mobile terminal filters the target recording file from the recorded files according to the time sequence of the timestamps of the recorded files, wherein the target recording file is the file recorded in the last recording event; If there are at least two target recording files, the mobile terminal determines the recording order of the at least two target recording files based on the pointer information in the file information of each target recording file; The mobile terminal obtains at least two target audio files from the wearable device, and synthesizes the audio according to the recording order of the at least two target audio files to obtain a total audio file.
[0021] It is understood that the beneficial effects of the second to sixth aspects mentioned above can be found in the relevant descriptions in the first aspect mentioned above, and will not be repeated here. Attached Figure Description
[0022] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0023] Figure 1 This is a schematic flowchart of an audio recording method provided in an embodiment of this application; Figure 2 This is a flowchart illustrating a method for determining a recording component according to an embodiment of this application; Figure 3 This is a flowchart illustrating an audio recording method provided in another embodiment of this application; Figure 4 This is a schematic diagram illustrating the storage of audio files in smart glasses according to an embodiment of this application; Figure 5 This is a schematic diagram of the storage of audio files in a conventional mobile terminal according to an embodiment of this application; Figure 6 This is a flowchart illustrating a method for processing audio files using a mobile terminal according to an embodiment of this application. Figure 7 This is a schematic diagram illustrating the storage of audio recording files in the mobile terminal of this application, provided in one embodiment of this application. Figure 8 This is a schematic diagram of the structure of a wearable device provided in an embodiment of this application; Figure 9 This is a schematic diagram of the structure of a wearable device provided in another embodiment of this application. Detailed Implementation
[0024] It should be understood that, when used in this application specification and the appended claims, the term "comprising" indicates the presence of the described features, integrals, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components and / or a collection thereof.
[0025] Furthermore, in the description of this application and the appended claims, the terms "first," "second," "third," etc., are used only to distinguish descriptions and should not be construed as indicating or implying relative importance.
[0026] References to "one embodiment" or "some embodiments" in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized.
[0027] In everyday meetings, creative work, or casual conversations, you can record the content of the meeting or creative inspiration using a recording device so that you can review it later.
[0028] To facilitate portability and use, wearable devices with recording capabilities were developed. Wearable devices are intelligent electronic devices that can be worn directly on the body, are equipped with built-in sensors, chips, and batteries, and can collect body data and interact with the internet. They conform to the body, are portable, and do not require handheld use. Examples include headphones, smart glasses, and smart bracelets with recording functions.
[0029] Because recording consumes a significant amount of power, wearable devices will automatically stop recording if their battery is low, resulting in incomplete audio recordings. To extend recording time, multiple recording components can be set up in the wearable device, allowing another component to be used when one is low on power. However, currently, wearable devices automatically stop recording when one component's battery is low. If the user wants to continue recording, they need to manually activate another recording component. Switching between components causes recording interruptions, resulting in some audio being missed.
[0030] To address the aforementioned issues, this application proposes an audio recording method. For a wearable device equipped with at least two recording components, after recording begins, the method automatically searches for the optimal component among the at least two recording components. The optimal component is designated as the master component, and the other recording components are designated as slave components. Recording begins using the master component. When the remaining resources of the master component are insufficient, the method continues to search for the optimal component among the slave components. The determined optimal component is then designated as the master component, and the other recording components are designated as slave components. Audio recording continues using the master component. This process is repeated until a recording end command is received, or until the remaining resources of all recording components are insufficient, at which point audio recording stops.
[0031] The method described in this application will now be described in detail. This method can operate in a wearable device. The wearable device includes at least two recording components, each with a recording function. Specifically, this method can operate in a main controller within the wearable device. The main controller can be a controller that controls all recording components; alternatively, if each recording component has its own controller, then the controller in the main component is designated as the main controller, and the main component is the recording component currently determined to require recording. In this case, the main controller changes in accordance with the changes in the main component.
[0032] The following reference Figure 1 The method is described in detail below: S101, after receiving the recording start command, control the first component to start recording audio, wherein the first component is one of at least two recording components.
[0033] In this embodiment, the recording start command can be generated in the following ways: the user touches a preset area of the wearable device, the user issues a voice command, or the user clicks a start control in the device application. For example, if a touch signal is detected where the user touches the temple of the smart glasses and the duration of the touch signal is longer than a preset duration, it is determined that a recording start command has been received.
[0034] In one approach, the recording order of at least two recording components is preset. After recording begins, the main controller controls the first recording component to record according to the preset recording order. The first recording component is referred to as the first component.
[0035] In another way, such as Figure 2 As shown, the method for determining the first component also includes: S1011, obtain the remaining resource status of the multiple recording components, wherein the remaining resource status includes the remaining battery power and the remaining storage space.
[0036] Specifically, the main controller sends a status query command to each recording component. After receiving the status query command, the recording component sends its remaining resource status to the main controller.
[0037] S1012, determine the optimal resource from the remaining resource states of the plurality of recording components, and determine the recording component corresponding to the optimal resource as the first component.
[0038] In this embodiment, the optimal resource is the one that supports the longest recording time for other components.
[0039] In one approach, the maximum value of the remaining battery power and the maximum value of the remaining storage space are found in the remaining resource states. If the maximum value of the remaining battery power and the maximum value of the remaining storage space come from the same remaining resource state, then the remaining resource state is the optimal resource, and the recording component corresponding to the remaining resource state is the first component.
[0040] If the maximum value of the remaining battery power and the maximum value of the remaining storage space come from different remaining resource states, then the optimal resource is determined based on the recording duration that the remaining resource state can support.
[0041] Specifically, based on the remaining battery power of the j-th recording component, the first recording duration of the j-th recording component is determined, 1≤j≤M, where M is the number of recording components; based on the remaining storage space of the j-th recording component, the second recording duration of the j-th recording component is determined; the minimum of the first and second recording durations of the j-th recording component is determined as the total recording duration of the j-th recording component; the maximum value among the total recording durations of multiple recording components is determined, and the remaining resource state corresponding to the maximum value is the optimal resource, and the recording component corresponding to the optimal resource is determined as the first component.
[0042] The method for determining the first recording duration is as follows: , This is the first recording duration. This represents the remaining battery level. This represents the power consumption per unit time during recording.
[0043] The method for determining the second recording duration is as follows: , This is the second recording duration. The remaining storage space This is the current recording encoding rate.
[0044] As an example, for headphones, if the total recording time of the left headphone is greater than the total recording time of the right headphone, then the left headphone is the first component.
[0045] In another approach, for a recording component, the first resource coefficient corresponding to its remaining battery power is found; the second resource coefficient corresponding to its remaining storage space is found; the first and second resource coefficients are weighted and summed to obtain the recording component's score. The recording component with the highest score among all recording components is then identified as the first component.
[0046] In practical use, after identifying the first component, the main controller sends a switching command to it to set it as the master component. The main controller also sends switching commands to other recording components (excluding the first component) to set them as slave components. During recording by the master component, slave components can enter a low-power monitoring state to save power.
[0047] S102, if it is determined that the remaining resource status of the first component meets the resource shortage condition and no end recording instruction is received, the first component is controlled to stop recording audio, and the first recording file recorded by the first component is obtained.
[0048] In this embodiment, the remaining resource status of the first component meets the resource insufficiency condition, indicating that the remaining resources of the first component can no longer support continued recording, and the audio recording of the first component needs to be stopped. The resource insufficiency condition includes the remaining battery power being less than or equal to a first preset threshold (e.g., 5%), and / or the remaining storage space being less than or equal to a second preset threshold (e.g., 3%).
[0049] The main controller monitors the remaining resource status of the first component. When the main controller determines that the first component has insufficient resources, it controls the first component to stop recording audio.
[0050] In this embodiment, after the first component finishes recording, a first recording file is generated, stored, and first file information of the first recording file is generated. This first file information is then added to the file storage list of the wearable device. The first file information includes pointer information and metadata of the first recording file. The pointer information of the first recording file indicates whether there are other audio files that connect to the audio in the first recording file.
[0051] The pointer information includes the first marker, the second marker, and the third marker.
[0052] The first flag is used to identify whether the first recording file is the starting file. If the first recording file is the starting file, the first flag is the first character, for example, the first flag AAA=true; if the first recording file is not the starting file, the first flag is the second character, for example, the first flag AAA=false.
[0053] The second marker is used to identify whether there are other recording files before or after the first recording file. If there are no other recording files before the first recording file, the second marker is the third character, for example, the second marker BBB=None; if there are other recording files before the first recording file, the second marker is the fourth character, for example, the second marker BBB=HasPrevious.
[0054] If there are no other recording files after the first recording file, the second marker is the fifth character, for example, the second marker BBB=None; if there are other recording files after the first recording file, the second marker is the sixth character, for example, the second marker BBB=HasNext.
[0055] As an example, if the first component is the first recording component to start recording, and the remaining resource status of the first component meets the resource shortage condition, it is determined that the second component needs to continue recording audio. Then, the pointer information in the first file information of the first recording file includes: first flag AAA=true, second flag BBB=None, HasNext.
[0056] Metadata includes the file name, recording duration, recording time, identification of the recording component, and file size of the first recording file.
[0057] The file storage list can display the metadata of the first recording file.
[0058] S103, control the second component to start recording audio, and obtain the second audio file recorded by the second component, wherein the second component is one of the other components, and the other components are at least two recording components other than the first component.
[0059] In this embodiment, since the first component has insufficient resources, the next recording component needs to continue recording. Therefore, the master-slave switching logic is triggered. The master controller determines the second component from the other components and sets the second component as the master component. All recording components other than the second component are slave components. The second component, which is determined to be the master component, continues to record.
[0060] When the remaining resources of the first component meet the resource shortage condition, the second component is determined from the other components according to the preset recording order. The second component is the recording component that follows the first component.
[0061] Alternatively, if the remaining resources of the first component meet the resource shortage condition, a second component that meets preset conditions is selected from other components. If it is determined that a second component can continue recording audio, the main controller sends a takeover command to the second component. Upon receiving the takeover command, the second component switches to become the main component, while the first component switches from main to slave. The main controller then sends a recording command to the second component, which begins recording audio upon receiving the command.
[0062] In this embodiment, second file information of the second recording file is generated. The second file information includes pointer information and metadata of the second recording file. The pointer information of the second recording file indicates whether there are other audio files connected to the audio files in the second recording file. The second file information of the second recording file is added to the file storage list of the wearable device.
[0063] The process of generating pointer information for the second recording file is the same as that of generating pointer information for the first recording file. Please refer to the explanation of the first recording file in step S102 above, which will not be repeated here.
[0064] The file storage list can display the metadata of the second recording file.
[0065] In this embodiment, the method for determining the second component may further include: S1031, if there are multiple other components, obtain the remaining resource status of the multiple other components, wherein the remaining resource status includes the remaining power value and the remaining storage space value.
[0066] In this embodiment, if there are other components a and other components b, the remaining resource status of other components a and other components b are obtained.
[0067] S1032, determine the optimal resource from the remaining resource states of the plurality of other components, and determine the other component corresponding to the optimal resource as the second component.
[0068] Method 1: For each other component, find the first resource coefficient corresponding to its remaining battery power; find the second resource coefficient corresponding to its remaining storage space; perform a weighted sum of the first and second resource coefficients to obtain the score of that other component. Find the other component with the highest score among all other components; the other component with the highest score is the second component.
[0069] Method 2: S11, based on the remaining resource status of multiple other components, determine a first candidate component from the other components, wherein the first candidate component is an other component that meets preset status requirements, wherein the preset status requirements include a remaining battery value greater than a preset battery value and a remaining storage space value greater than a preset storage space value.
[0070] For example, if there are other components a, other components b and other components c, and if the remaining resource status of other components a and the remaining resource status of other components b both meet the preset status requirements, then other components a and other components b are both first candidate components.
[0071] S12, if there are multiple first candidate components, then determine the optimal resource from the remaining resource states of the multiple first candidate components, and determine the first candidate component corresponding to the optimal resource as the second component.
[0072] In this embodiment, the maximum value of the remaining power and the maximum value of the remaining storage space are searched among the remaining resource states of multiple first candidate components. If the maximum value of the remaining power and the maximum value of the remaining storage space come from the same remaining resource state, then the remaining resource state is the optimal resource, and the first candidate component corresponding to the remaining resource state is the second component.
[0073] If the maximum value of the remaining battery power and the maximum value of the remaining storage space come from different remaining resource states, then the optimal resource is determined based on the recording duration that the remaining resource state can support.
[0074] Specifically, based on the remaining battery power of the i-th first candidate component, the first recording duration of the i-th first candidate component is determined, 1≤i≤N, where N is the number of first candidate components; based on the remaining storage space of the i-th first candidate component, the second recording duration of the i-th first candidate component is determined; the minimum of the first recording duration and the second recording duration is determined as the total recording duration of the i-th first candidate component; the maximum value among the total recording durations of multiple first candidate components is determined, and the remaining resource state corresponding to the maximum value is the optimal resource, and the first candidate component corresponding to the optimal resource is determined as the second component.
[0075] S13, if there is one of the first candidate components, then the first candidate component is determined as the second component.
[0076] S1033, if there is another component, obtain the remaining resource status of the other component.
[0077] S1034, if the remaining resource status of the other components meets the preset status requirements, then the other components are determined as the second component, wherein the preset status requirements include the remaining power value being greater than the preset power value and the remaining storage space value being greater than the preset space value.
[0078] For example, if there is another component 'a', obtain the remaining resource status of the other component 'a'. If the remaining battery power of the other component 'a' is greater than a preset battery power value (e.g., 40%) and the remaining storage space is greater than a preset storage space value (e.g., 60%), then the other component 'a' is determined to be available, and the other component 'a' is designated as the second component, and audio recording is performed using the other component 'a'.
[0079] In another implementation, if there is another component and the remaining resource status of that other component does not meet the preset status requirements, a prompt message is output. The prompt message is used to indicate that there is currently no available recording component, prompting the user to check the battery level and storage space of each recording component in a timely manner.
[0080] In one possible implementation, after the second component begins recording, the above method may further include: Control the second component to start recording audio and check the remaining resource status of the second component.
[0081] If the remaining resources of the second component meet the resource shortage condition and no end recording command is received, the second component is controlled to stop recording audio, and a second recording file recorded by the second component is obtained.
[0082] Continue to identify the third component from the other components, which are the recording components excluding the second component.
[0083] The third component is controlled to start recording audio, and this process is repeated until a stop recording command is received, or until no recording component meets the preset state requirements, at which point recording stops.
[0084] In one possible implementation, such as Figure 3 As shown, the above method is explained using smart glasses as an example of a wearable device. The smart glasses include a left temple and a right temple, which are two recording components. A left controller is located in the left temple, and a right controller is located in the right temple. Pre-set, the left controller is the primary controller when recording begins. Of course, in actual use, the right controller can also be set as the primary controller; this is not a restriction.
[0085] S21, after receiving the recording start command, the left controller sends a status query command to the right temple.
[0086] S22, after receiving the status query command, the right controller of the right temple sends the second remaining resource status of the right temple to the left controller.
[0087] S23, after receiving the second remaining resource status, the left controller determines the first remaining resource status as the optimal resource based on the first remaining resource status of the left temple and the second remaining resource status of the right temple, identifies the left temple as the main component, and controls the left temple to start recording.
[0088] In this embodiment, the method for determining the main component will not be described in detail.
[0089] The left controller sends a first switching command to the right controller. After receiving the first switching command, the right controller sets the right telescope as a slave component, and the slave component switches to low-power monitoring mode.
[0090] S24, the left controller monitors the remaining resource status of the left temple. If it is determined that the remaining resource status of the left temple meets the insufficient resource condition and no end recording command is received, the left controller obtains the third remaining resource status of the right temple.
[0091] Specifically, the left controller sends a status acquisition command to the right controller, and after receiving the status acquisition command, the right controller sends the third remaining resource status to the left controller.
[0092] S25, if the left controller determines that the third remaining resource status of the right telescope meets the preset status requirements, the left controller sends a second switching command to the right controller.
[0093] If the left controller determines that the third remaining resource state of the right temple does not meet the preset state requirements, then the audio recording will end.
[0094] S26, after receiving the second switching command, the right controller sets the right temple as the main component.
[0095] S27, the left controller sends a recording command to the right controller.
[0096] S28, the left controller controls the left temple to stop recording audio, obtains the first audio file recorded by the left temple, and switches the left temple to the slave component.
[0097] S29, after receiving the recording command, the right controller controls the right temple to start recording audio.
[0098] S30: Upon receiving the command to stop recording, the right controller controls the right temple to stop recording audio, thus obtaining the second audio file recorded by the right temple.
[0099] In this embodiment, after step S29, the right controller monitors the remaining resource status of the right temple. If it determines that the remaining resource status of the right temple meets the resource shortage condition and no end recording command is received, the right controller obtains the fourth remaining resource status of the left temple. If the right controller determines that the fourth remaining resource status of the left temple meets the preset status requirements, the right controller sends a third switching command to the left controller. After receiving the third switching command, the left controller sets the left temple as the master component. The right controller sends a recording command to the left controller. The right controller controls the right temple to stop recording audio, obtains the second audio file recorded by the right temple, and switches the right temple to the slave component. After receiving the recording command, the left controller controls the left temple to start recording audio; this cycle continues until an end recording command is received and audio recording stops; or the remaining resource status of both the left and right temples does not meet the preset status requirements, and audio recording stops.
[0100] In this application, before each recording session, the recording component with the best remaining resources is selected from among the recording components for audio recording based on the remaining resource status of the recording components. When the remaining resources of one recording component are insufficient, another recording component with the best remaining resources is automatically selected from other components for audio recording, and this process is repeated. This application uses one recording component for recording at a time, while other recording components can be charged, etc., extending the recording time and meeting the recording needs of large audio files. At the same time, when the remaining resources of one recording component are insufficient, this application automatically switches to the next recording component for recording, ensuring uninterrupted audio recording and guaranteeing the integrity and continuity of audio recording.
[0101] After the recording component finishes recording, it generates a corresponding audio file for the user to view. For wearable devices with multiple recording components, each component generates an audio file after recording ends, and the file storage list contains information about multiple audio files. If the user needs to view or export the complete recording content, they need to click on each audio file separately, which is inconvenient for the user.
[0102] For example, in smart glasses, external storage units (i.e., external Flash) are installed on the left and right temples respectively. These storage units are used to store audio recordings. The audio recordings made on the left and right temples are stored as two separate files in the smart glasses. Correspondingly, the file information for both audio recordings is displayed in the smart glasses' file storage list. Figure 4 As shown in the figure, the two files were recorded by different recording devices.
[0103] After the smart glasses upload the audio file to the mobile terminal, two audio files are generated on the mobile terminal: one for the left temple and another for the right temple. This process cannot guarantee the integrity of the audio files and makes it inconvenient for users to export and use them. Figure 5 As shown in the figure, the two files were recorded using different recording components.
[0104] To address the aforementioned issues, this application proposes an audio processing system, comprising a mobile terminal and a wearable device as described in the audio recording method. The mobile terminal is used to synthesize multiple audio files generated by the wearable device to obtain a single overall recording file, which is then displayed to the user for viewing or export.
[0105] The following reference Figure 6 As shown, the process of synthesizing the total audio file on the mobile terminal will now be explained.
[0106] S201, the mobile terminal sends a list retrieval instruction to the wearable device, wherein the list retrieval instruction is used to instruct the wearable device to send a file storage list to the mobile terminal, the file storage list stores the file information of the recorded files of the wearable device, the file information of each recorded file includes the timestamp of the recorded file, different timestamps are used to distinguish different recording events, and the timestamps of all recorded files under the same recording event are the same.
[0107] In this embodiment, the recorded files include various audio files recorded by the wearable device over a historical period. In this application, the recorded files may include the first audio file from step S102 and the second audio file from step S104. The file information includes the timestamp, pointer information, metadata, and recording time of the recorded file. The recording time is the specific recording time of the audio in the recorded file.
[0108] In this embodiment, the timestamp is determined based on the start time of the recording event, and the recording event is triggered after the recording start command is received.
[0109] For example, if a recording start command is received at 8:00 AM on May 3rd, the recording event start time is 8:00 AM on May 3rd; if a recording file is generated after the recording event is started, the recording file is recorded as a recorded file, and the timestamp of the recorded file is 8:00 AM on May 3rd.
[0110] If a recording start command is received at 10:00 AM on May 4th, then the recording event start time is 10:00 AM on May 4th. If recording file a and recording file b are generated after the recording event is started, then recording file a is recorded as recorded file a, and recording file b is recorded as recorded file b, with the timestamps of recorded file a and recorded file b being 10:00 AM on May 4th. If recorded file a was recorded at 10:00 AM on May 4th, then the recording time of recorded file a is 10:00 AM on May 4th; if recorded file b was recorded at 10:32 AM on May 4th, then the recording time of recorded file b is 10:32 AM on May 4th.
[0111] In another approach, upon receiving a first instruction from the user, the mobile terminal sends a list retrieval instruction to the wearable device. The first instruction can be configured as needed; for example, it could be an export instruction.
[0112] S202, after the mobile terminal receives the file storage list sent by the wearable device, the mobile terminal filters the target recording file from the recorded files according to the time sequence of the timestamps of the recorded files, wherein the target recording file is the file recorded in the last recording event.
[0113] S203, if there are at least two target recording files, the mobile terminal determines the recording order of the at least two target recording files based on the pointer information in the file information of each target recording file.
[0114] In this embodiment, the recording order can be determined based on the file information of the recorded files. For ease of description, the following explanation will use an example where the recorded files include a first recording file and a second recording file.
[0115] Specifically, methods for determining the recording order may include: Specifically, from the file information in the file storage list, each file information includes first file information and second file information, the file information marked with AAA=true is searched, and the recording file corresponding to the file information marked with AAA=true is recorded as the header node file.
[0116] Then, based on the pointer information in each file (e.g., the first file information and the second file information), the order of each recording file is determined. If the order of at least two recording files cannot be determined based on the pointer information, the recording times in the metadata of the recording files can be used to sort them, resulting in a recording chain. Recording cards for the recording chain are generated, and these cards include the total duration of the audio in the recording chain, recording time, etc. The generated recording cards are displayed on a screen. The user sees a single recording card for the entire recording on the screen and will not see multiple recording files corresponding to different recording components.
[0117] For example, suppose there are three audio files: the first, second, and third audio files. The first and third audio files were recorded using the left earphone, while the second audio file was recorded using the right earphone. The pointer information for the first audio file includes the first flag AAA=true, the second flag BBB=None, and HasNext. The pointer information for the second audio file includes the first flag AAA=false, the second flag BBB=HasPrevious, and HasNext. The pointer information for the third audio file includes the first flag AAA=false, the second flag BBB=HasPrevious, and None. Therefore, based on the pointer information of the three audio files, the recording order can be determined as: the first audio file, the second audio file, and the third audio file.
[0118] For example, suppose there are five audio files: the first, second, third, fourth, and fifth audio files. The first, third, and fifth audio files were all recorded using the left earphone, while the second and fourth audio files were recorded using the right earphone. The pointer information for the first audio file includes a first flag AAA=true, a second flag BBB=None, and HasNext. The pointer information for the second audio file includes a first flag AAA=false, a second flag BBB=HasPrevious, and HasNext. The pointer information for the third audio file includes a first flag AAA=false, a second flag BBB=HasPrevious, and HasNext. The pointer information for the fourth audio file includes a first flag AAA=false, a second flag BBB=HasPrevious, and None. The pointer information for the fifth audio file includes a first flag AAA=false, a second flag BBB=HasPrevious, and None. Therefore, based on the first flag AAA=true, the first audio file is determined to be the first recorded file. Since the first audio file was recorded using the left earphone, the next audio file is determined from the second and fourth audio files recorded using the right earphone. The pointer information for the second and fourth recording files is the same. Based on the recording times of the second and fourth recording files, the second recording file is determined to be the second recorded file. The third recording file is determined from the third and fifth recording files recorded from the left earphone, and based on their pointer information, the third recording file is confirmed as the third recorded file. Then, the fourth recording file is determined to be the fourth recorded file; and the fifth recording file is determined to be the fifth recorded file. Therefore, the recording order of the five recording files is: first recording file, second recording file, third recording file, fourth recording file, and fifth recording file.
[0119] Alternatively, after determining the first recorded file, the recording order of the second, third, and fourth recorded files can be determined according to the chronological order of their recording times.
[0120] S204, the mobile terminal obtains at least two target recording files from the wearable device, and performs audio synthesis according to the recording order of the at least two target recording files to obtain a total recording file.
[0121] In one approach, the method for generating the total audio recording file may include: a mobile terminal sending a file retrieval instruction to a wearable device; upon receiving the file retrieval instruction, the wearable device sending all target audio recording files to the mobile terminal according to the timestamp in the file retrieval instruction; and the mobile terminal performing audio synthesis according to the recording order of at least two of the target audio recording files to obtain a total audio recording file.
[0122] In another approach, the method for generating the total recording file may include: According to the recording order, the mobile terminal sends the j-th file retrieval instruction to the wearable device, wherein the j-th file retrieval instruction is used to instruct the wearable device to send the j-th target recording file to the mobile terminal, the j-th target recording file is the j-th recorded recording file, j is greater than 1, and the j-th file retrieval instruction includes the file information of the j-th target recording file; The mobile terminal receives the j-th target audio file sent by the wearable device; The mobile terminal determines, based on the recording order, that there is a (j+1)th target recording file after the j-th target recording file, and sends a (j+1)th file retrieval instruction to the wearable device. The (j+1)th file retrieval instruction instructs the wearable device to send the (j+1)th target recording file to the mobile terminal. The (j+1)th target recording file is the (j+1)th recorded recording file, and the (j+1)th file retrieval instruction includes the file information of the (j+1)th target recording file. The mobile terminal receives the (j+1)th target audio file sent by the wearable device; The mobile terminal performs audio synthesis processing on the j-th target recording file and the (j+1)-th target recording file to obtain a first candidate synthesized recording. The mobile terminal determines, based on the recording order, that there is a (j+1)th target recording file after the (j+2)th target recording file, and sends a (j+2)th file retrieval instruction to the wearable device. The (j+2)th file retrieval instruction instructs the wearable device to send the (j+2)th target recording file to the mobile terminal. The (j+2)th target recording file is the (j+2)th recorded recording file, and the (j+2)th file retrieval instruction includes the file information of the (j+2)th target recording file. The mobile terminal receives the (j+2)th target audio file sent by the wearable device; The mobile terminal performs audio synthesis processing on the candidate synthesized recording and the (j+2)th target recording file to obtain the second candidate synthesized recording. The mobile terminal determines that there are no other target recording files after the (j+2)th target recording file according to the recording order, and then determines the second candidate synthesized recording as the total recording file.
[0123] In this embodiment, if there are multiple audio files, after obtaining the first and second audio files from the wearable device, the first and second audio files are audio-synthesized to obtain a synthesized audio; the third audio file is obtained, and the synthesized audio is combined with the third audio file to obtain a synthesized audio; this process is repeated until the last audio file is audio-synthesized to obtain the total audio file.
[0124] For example, such as Figure 7 As shown, taking a mobile phone as an example, after the phone combines multiple audio files recorded by different recording components into a single audio file, the phone displays a description of the single audio file for the user to export and view. The description of the single audio file may include recording time, total recording duration, and recording tags.
[0125] It should be noted that the recording file needs to be decoded before audio synthesis. After obtaining the total recording file, the audio needs to be encoded.
[0126] It should be understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.
[0127] Corresponding to the audio recording method described in the above embodiments, Figure 8 A structural block diagram of a wearable device provided in an embodiment of this application is shown. For ease of explanation, only the parts related to the embodiments of this application are shown.
[0128] Reference Figure 8 The wearable device 300 may include: a first component control module 310, a file generation module 320, and a second component control module 330.
[0129] The first component control module 310 is used to control the first component to start recording audio after receiving a recording start command, wherein the first component is one of at least two recording components; The file generation module 320 is used to control the first component to stop recording audio and obtain the first recording file recorded by the first component when it is determined that the remaining resource status of the first component meets the resource shortage condition and no end recording instruction is received. The second component control module 330 is used to control the second component to start recording audio and obtain a second audio file recorded by the second component, wherein the second component is one of the other components, and the other components are at least two recording components other than the first component.
[0130] It should be noted that the information interaction and execution process between the above-mentioned devices / units are based on the same concept as the method embodiments of this application. For details on their specific functions and technical effects, please refer to the method embodiments section, and they will not be repeated here.
[0131] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. Furthermore, the specific names of the functional units and modules are only for easy differentiation and are not intended to limit the scope of protection of this application. The specific working process of the units and modules in the above system can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.
[0132] This application also provides a mobile terminal, including a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that the processor executes the computer program to implement the method executed by the mobile terminal in the above-described audio processing system.
[0133] This application also provides a wearable device, see [link to relevant documentation]. Figure 9 The wearable device 400 may include: at least one processor 410, a memory 420, and a computer program stored in the memory 420 and executable on the at least one processor 410. When the processor 410 executes the computer program, it implements the steps in any of the above-described method embodiments, for example... Figure 1 Steps S101 to S103 in the illustrated embodiment. Alternatively, when the processor 410 executes the computer program, it implements the functions of each module / unit in the above-described device embodiments, for example... Figure 8 The functions of the first component control module 310 to the second component control module 330 are shown.
[0134] For example, a computer program may be divided into one or more modules / units, one or more of which are stored in memory 420 and executed by processor 410 to complete this application. The one or more modules / units may be a series of computer program segments capable of performing a specific function, which are used to describe the execution process of the computer program in wearable device 400.
[0135] Those skilled in the art will understand that Figure 9 This is merely an example of a wearable device and does not constitute a limitation on wearable devices. It may include more or fewer components than illustrated, or combine certain components, or different components, such as input / output devices, network access devices, buses, etc.
[0136] The processor 410 can be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor.
[0137] The memory 420 can be an internal storage unit of the wearable device or an external storage device, such as a plug-in hard drive, a smart media card (SMC), a secure digital (SD) card, or a flash card. The memory 420 is used to store the computer program and other programs and data required by the wearable device. The memory 420 can also be used to temporarily store data that has been output or will be output.
[0138] The audio recording method provided in this application can be applied to terminal devices such as computers, tablets, laptops, netbooks, and personal digital assistants (PDAs). This application does not impose any restrictions on the specific type of terminal device.
[0139] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.
[0140] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.
[0141] In the embodiments provided in this application, it should be understood that the disclosed terminal devices, apparatuses, and methods can be implemented in other ways. For example, the terminal device embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interfaces, apparatuses, or units, and may be electrical, mechanical, or other forms.
[0142] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0143] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.
[0144] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments can also be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by one or more processors, it can implement the steps of the various method embodiments described above.
[0145] Similarly, as a computer program product, when the computer program product is run on a terminal device, it enables the terminal device to implement the steps in the above-described method embodiments.
[0146] The computer program includes computer program code, which can be in the form of source code, object code, executable file, or some intermediate form. The computer-readable medium can include: any entity or device capable of carrying the computer program code, recording media, USB flash drive, portable hard drive, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signals, telecommunication signals, and software distribution media, etc. It should be noted that the content included in the computer-readable medium can be appropriately added or removed according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer-readable media may not include electrical carrier signals and telecommunication signals.
[0147] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.
Claims
1. An audio recording method, characterized in that, Applied to wearable devices, the wearable devices including at least two recording components; the method includes: Upon receiving a recording start command, the system controls the first component to begin recording audio, wherein the first component is one of at least two recording components; If it is determined that the remaining resource status of the first component meets the resource shortage condition and no end recording command is received, the first component is controlled to stop recording audio, and the first recording file recorded by the first component is obtained. The second component is controlled to start recording audio, and a second audio file is obtained by the second component. The second component is one of the other components, which are at least two recording components other than the first component.
2. The method as described in claim 1, characterized in that, Before controlling the second component to start recording audio and obtaining the second audio file recorded by the second component, the method further includes: If there are multiple other components, obtain the remaining resource status of the multiple other components, wherein the remaining resource status includes the remaining power value and the remaining storage space value; The optimal resource is determined from the remaining resource states of the other components, and the other component corresponding to the optimal resource is determined as the second component. The optimal resource is the resource that supports the other components for the longest recording time.
3. The method as described in claim 2, characterized in that, The step of determining the optimal resource from the remaining resource states of the other components, and identifying the other component corresponding to the optimal resource as the second component, includes: Based on the remaining resource status of multiple other components, a first candidate component is determined from the other components, wherein the first candidate component is an other component that meets preset status requirements, wherein the preset status requirements include a remaining battery value greater than a preset battery value and a remaining storage space value greater than a preset space value. If there are multiple first candidate components, then the optimal resource is determined from the remaining resource states of the multiple first candidate components, and the first candidate component corresponding to the optimal resource is determined as the second component; If there is one of the first candidate components, then the first candidate component is determined to be the second component.
4. The method as described in claim 3, characterized in that, The step of determining the optimal resource from the remaining resource states of multiple first candidate components, and determining the first candidate component corresponding to the optimal resource as the second component, includes: Based on the remaining battery power of the i-th first candidate component, determine the first recording duration of the i-th first candidate component, 1≤i≤N, where N is the number of the first candidate components; The second recording duration of the i-th first candidate component is determined based on the remaining storage space value of the i-th first candidate component. The minimum value of the first recording duration and the second recording duration is determined as the total recording duration of the i-th first candidate component; The maximum value among the total recording time of multiple first candidate components is determined, and the remaining resource state corresponding to the maximum value is the optimal resource. The first candidate component corresponding to the optimal resource is determined as the second component.
5. The method as described in claim 1, characterized in that, Before controlling the second component to start recording audio and obtaining the second audio file recorded by the second component, the method further includes: If one of the other components exists, obtain the remaining resource status of that other component; If the remaining resource status of the other components meets the preset status requirements, then the other components are identified as the second component. The preset status requirements include that the remaining battery power is greater than a preset battery power value and the remaining storage space is greater than a preset storage space value.
6. The method according to any one of claims 1 to 5, characterized in that, Before controlling the first component to begin recording audio, the method further includes: Obtain the remaining resource status of multiple recording components, wherein the remaining resource status includes the remaining battery power and the remaining storage space. The optimal resource is determined from the remaining resource states of the multiple recording components, and the recording component corresponding to the optimal resource is determined as the first component. The optimal resource is the resource that supports the recording component for the longest recording time.
7. The method as described in claim 1, characterized in that, After controlling the first component to stop recording audio and obtaining the first audio file recorded by the first component, the method further includes: Generate first file information for the first recording file. The first file information includes pointer information and metadata of the first recording file. The pointer information of the first recording file indicates whether there are other audio files connected to the audio files in the first recording file. Add the first file information of the first recording file to the file storage list of the wearable device; After controlling the second component to start recording audio and obtaining the second audio file recorded by the second component, the method further includes: The second file information of the second recording file is generated. The second file information includes pointer information and metadata of the second recording file. The pointer information of the second recording file indicates whether there are other audio files connected to the audio files in the second recording file. Add the second file information of the second recording file to the file storage list of the wearable device.
8. A wearable device comprising at least two recording components, a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the audio recording method as described in any one of claims 1 to 7.
9. An audio processing system, characterized in that, include: The mobile terminal and the wearable device as described in claim 8, wherein the execution process of the mobile terminal includes: The mobile terminal sends a list retrieval instruction to the wearable device, wherein the list retrieval instruction is used to instruct the wearable device to send a file storage list to the mobile terminal. The file storage list stores the file information of the recorded files of the wearable device. The file information of each recorded file includes the timestamp of the recorded file. Different timestamps are used to distinguish different recording events. The timestamps of all recorded files under the same recording event are the same. After receiving the file storage list sent by the wearable device, the mobile terminal filters the target recording file from the recorded files according to the time sequence of the timestamps of the recorded files, wherein the target recording file is the file recorded in the last recording event; If there are at least two target recording files, the mobile terminal determines the recording order of the at least two target recording files based on the pointer information in the file information of each target recording file; The mobile terminal obtains at least two target audio files from the wearable device, and synthesizes the audio according to the recording order of the at least two target audio files to obtain a total audio file.
10. The system as described in claim 9, characterized in that, The mobile terminal obtains at least two target audio files from the wearable device, and performs audio synthesis according to the recording order of the at least two target audio files to obtain a total audio file, including: The mobile terminal sends a file retrieval instruction to the wearable device according to the recording order. The file retrieval instruction is used to instruct the wearable device to send the j-th target recording file to the mobile terminal. The j-th target recording file is the j-th recorded recording file, where j is greater than 1. The file retrieval instruction includes the file information of the j-th target recording file. The mobile terminal receives the j-th target audio file sent by the wearable device; The mobile terminal determines, based on the recording order, that there is a (j+1)th target recording file after the j-th target recording file, and sends a (j+1)th file retrieval instruction to the wearable device. The (j+1)th file retrieval instruction instructs the wearable device to send the (j+1)th target recording file to the mobile terminal. The (j+1)th target recording file is the (j+1)th recorded recording file, and the (j+1)th file retrieval instruction includes the file information of the (j+1)th target recording file. The mobile terminal receives the (j+1)th target audio file sent by the wearable device; The mobile terminal performs audio synthesis processing on the j-th target recording file and the (j+1)-th target recording file to obtain a first candidate synthesized recording; The mobile terminal determines, based on the recording order, that there is a (j+1)th target recording file after the (j+2)th target recording file, and sends a (j+2)th file retrieval instruction to the wearable device. The (j+2)th file retrieval instruction instructs the wearable device to send the (j+2)th target recording file to the mobile terminal. The (j+2)th target recording file is the (j+2)th recorded recording file, and the (j+2)th file retrieval instruction includes the file information of the (j+2)th target recording file. The mobile terminal receives the (j+2)th target audio file sent by the wearable device; The mobile terminal performs audio synthesis processing on the candidate synthesized recording and the (j+2)th target recording file to obtain the second candidate synthesized recording. The mobile terminal determines that there are no other target recording files after the (j+2)th target recording file according to the recording order, and then determines the second candidate synthesized recording as the total recording file.
