Recording equipment and recording data processing method
By using recording equipment to collect and position the device in the recording site to determine the sound position information and generate recording files corresponding to the time, the problem of complicated changes in designated positions in the middle and late stages of Dolby Sound technology is solved, and the production efficiency and playback effect of audio files are improved.
Patent Information
- Application Number
- CN202310781549.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-06-28
- Publication Date
- 2025-01-07
AI Technical Summary
The existing Dolby sound technology requires artificially specifying the change of sound position and trajectory information in audio and video post-production, resulting in large workload, long cycle and low efficiency.
A recording device and recording data processing method are provided. By using a sound acquisition device, a positioning device and a memory in the recording site, the sound position information is directly obtained, and the recording file corresponding to the time is generated to avoid the later import of position information.
It improves the production efficiency of audio files, can restore the live environment of the recording site during playback, and reduces the time and workload of post-production.
Smart Images

Figure CN119274595A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of audio processing, and more specifically, to a recording device and a recording data processing method. Background Art
[0002] As users' requirements for sound experience continue to improve, more realistic 2D immersive sound experience is increasingly needed, such as Dolby Atmos technology. Dolby Atmos technology can add sound source location information to a certain sound segment during the post-production of audio and video (such as movies) and store it together. When playing, the sound segment is generated according to the number and position of speakers in the playback venue to achieve 3D immersive sound playback.
[0003] However, currently Dolby sound technology can only manually specify the position changes and trajectory information of a certain sound segment during post-production. The post-production workload is large and the production cycle is long, which leads to low efficiency in audio and video post-production. Summary of the invention
[0004] In view of this, an embodiment of the present invention provides a recording device and a recording data processing method, so as to directly obtain the location of the sound when collecting sound in a recording venue, so that the recording file does not need to import the location during the post-production process, and can restore the on-site environment of the recording venue when playing, thereby improving the production efficiency of audio files.
[0005] In a first aspect, an embodiment of the present invention provides a recording device, the recording device comprising:
[0006] A sound collection device is configured to collect and obtain recording data;
[0007] a positioning device, configured to determine the location information of the recording device based on the received positioning signal; and
[0008] The memory is configured to store a recording file consisting of the recording data and the location information, wherein the time of the recording data and the location information in the recording file corresponds to each other.
[0009] Optionally, the recording device further includes:
[0010] The processor is configured to generate a recording file according to the recording data and the location information.
[0011] Optionally, the sound collecting device is a directional microphone.
[0012] Optionally, the positioning device is configured to receive positioning signals emitted by multiple signal transmitters deployed in the recording site, so as to determine the three-dimensional spatial position information of the recording device based on the multiple positioning signals.
[0013] Optionally, the positioning signal is a wireless radio frequency signal or an ultrasonic signal.
[0014] In a second aspect, an embodiment of the present invention provides a method for processing recorded data, the method comprising:
[0015] Control the recording equipment to collect and obtain recording data;
[0016] Determining the location information of the recording device through the received positioning signal;
[0017] A recording file is generated and stored according to the recording data and the location information, wherein the time of the recording data and the location information in the recording file corresponds to each other.
[0018] Optionally, determining the location information of the recording device through the received positioning signal includes:
[0019] Receive positioning signals emitted by multiple signal transmitters deployed in the recording site;
[0020] The three-dimensional spatial position information of the recording device is determined according to the multiple positioning signals.
[0021] Optionally, the method further includes:
[0022] Parsing the recording file to obtain the recording data and location information;
[0023] According to the received position adjustment information, the position of the corresponding recording segment is adjusted to update the recording file.
[0024] Optionally, the method further includes:
[0025] Mixing is performed according to the number and layout of sound playing devices in the playing environment to play the recording file.
[0026] In a third aspect, an embodiment of the present invention provides a recording data processing system, the system comprising:
[0027] Multiple wireless transmitters deployed in the recording site to periodically transmit positioning signals; and
[0028] Recording equipment as described above.
[0029] Optionally, the system further includes:
[0030] The audio processing device is used to parse the received recording file, obtain the corresponding recording data and position information, and adjust the position of the corresponding recording segment according to the received position adjustment information to update the recording file.
[0031] Optionally, the system further includes:
[0032] A sound playing device is used to play a recording file after mixing, and the recording file is mixed based on the data and layout of the sound playing device.
[0033] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method described above is implemented.
[0034] The recording device in the embodiment of the present invention includes a sound collection device, a positioning device and a memory, so that the sound collection device collects recording data, the positioning device determines the location information of the recording device, and the recording data and the location information are integrated into a recording file based on time correspondence and stored in the memory. Therefore, this embodiment can directly obtain the location of the sound when collecting sound in the recording site, so that the recording file does not need to import the location in the post-production process, and can restore the on-site environment of the recording site when playing, thereby improving the production efficiency of audio files. BRIEF DESCRIPTION OF THE DRAWINGS
[0035] The above and other objects, features and advantages of the present invention will become more apparent through the following description of the embodiments of the present invention with reference to the accompanying drawings, in which:
[0036] Figure 1 is a schematic diagram of a recording device according to an embodiment of the present invention;
[0037] Figure 2 is a schematic diagram of a positioning method of a recording device according to an embodiment of the present invention;
[0038] Figure 3 is a schematic diagram of a recording file according to an embodiment of the present invention;
[0039] Figure 4 is a schematic diagram of the working process of the recording device according to an embodiment of the present invention;
[0040] Figure 5 is a flow chart of a method for processing recorded data according to an embodiment of the present invention;
[0041] Figure 6 Schematic diagram of a recording data processing system according to an embodiment of the present invention. DETAILED DESCRIPTION
[0042] The present application is described below based on embodiments, but the present application is not limited to these embodiments. In the detailed description of the present application below, some specific details are described in detail. It is possible for those skilled in the art to fully understand the present application without the description of these details. In order to avoid confusing the essence of the present application, known methods, processes, flows, components and circuits are not described in detail.
[0043] In addition, persons of ordinary skill in the art will appreciate that the drawings provided herein are for illustration purposes and are not necessarily drawn to scale.
[0044] Unless the context clearly requires otherwise, the words "include", "comprising" and similar words throughout the application should be interpreted as including rather than exclusive or exhaustive; that is, the meaning is "including but not limited to".
[0045] In the description of this application, it should be understood that the terms "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or implying relative importance. In addition, in the description of this application, unless otherwise specified, the meaning of "plurality" is two or more.
[0046] The solutions described in this specification and in the examples, if they involve the processing of personal information, will be processed on the premise of having a legal basis (such as obtaining the consent of the subject of personal information, or being necessary for the performance of a contract, etc.), and will only be processed within the scope of regulations or agreements. If a user refuses to process personal information other than the necessary information for basic functions, it will not affect the user's use of basic functions.
[0047] In view of the technical defect that the current 3D immersive sound can only be produced through post-production, which leads to a large workload and a long production cycle for post-production, the embodiments of the present invention provide a recording device and a recording data processing method, which can directly obtain the location of the sound when collecting sound in the recording site, so that the recording file does not need to import the location during the post-production process, and can restore the on-site environment of the recording site during playback, thereby improving the production efficiency of audio files.
[0048] Figure 1 Schematic diagram of a recording device according to an embodiment of the present invention. Figure 1 As shown, the recording device 1 according to the embodiment of the present invention includes a sound collecting device 11 , a positioning device 12 and a memory 13 .
[0049] The sound collection device 11 is configured to collect and obtain recording data. In an optional implementation, the sound collection device 11 includes at least one microphone. Optionally, the sound collection device 11 is a directional microphone. It should be understood that the sound collection device 11 can be set with a microphone in one direction or microphones in multiple directions according to actual recording requirements, and this embodiment does not limit this.
[0050] The positioning device 12 is configured to determine the location information of the recording device 1 based on the received positioning signal. In an optional implementation, the positioning device 12 is configured to receive positioning signals emitted by multiple signal transmitters deployed in the recording site to determine the three-dimensional spatial location information of the recording device 1 based on the multiple positioning signals. Optionally, the positioning signal can be a wireless radio frequency signal or an ultrasonic signal. Further optionally, the wireless radio frequency signal can be a radio frequency signal of a protocol such as Bluetooth, NFC, etc., and this embodiment does not limit the type of the wireless radio frequency signal.
[0051] In this embodiment, a plurality of signal transmitters are deployed in advance at the recording site, and positioning signals are simultaneously transmitted at predetermined intervals. The positioning device 12 receives the positioning signals and determines the three-dimensional spatial position information of the corresponding recording device 1 according to the positions of the respective signal transmitters and the arrival time of the respective positioning signals. For example, this embodiment can use multi-point positioning and other methods to achieve positioning based on the positions of the signal transmitters and the arrival time of the corresponding positioning signals. This embodiment does not limit the specific positioning method. Optionally, the above-mentioned predetermined time can be set according to the specific recording scene, for example, according to the position change of the recording device. For example, if the recording device needs to be moved frequently in the recording scene, the above-mentioned predetermined time can be set to a shorter time. If the recording device does not need to be moved frequently in the recording scene, the above-mentioned predetermined time can be set to a longer time.
[0052] Figure 2 FIG. 2 is a schematic diagram of a positioning method of a recording device according to an embodiment of the present invention. Figure 3 As shown, it is assumed that signal transmitters 21-24 are pre-deployed in the recording site, and they transmit corresponding positioning signals s1-s4 at predetermined intervals. There is a recording device 20 in working state in the recording site, and the positioning device in the recording device 20 can receive the positioning signals s1-s4 transmitted by the signal transmitters 21-24 at predetermined intervals, and the recording device 20 can determine its own position information according to the position information of the signal transmitters 21-24 and the time when the positioning signals s1-s4 are received.
[0053] Optionally, the positioning signal includes identification information of the corresponding signal transmitter. In this embodiment, after deploying multiple signal transmitters, the identification and location information of each transmitted signal can be pre-configured into the positioning device 12. The positioning device 12 can determine the location of the corresponding signal transmitter based on the identification information in the positioning signal, and determine the three-dimensional spatial location information of the recording device 1 based on the location of each signal transmitter and the arrival time of each positioning signal.
[0054] Further optionally, the positioning signal may also include a corresponding transmission time. The positioning device 12 may determine the transmission time of the positioning signal according to the arrival time and the transmission time of the positioning signal, and determine the distance between the positioning device and the corresponding signal transmitter based on the transmission time, and then determine the location information of the recording device 1 based on the distance between the positioning device 12 and each signal transmitter, and the position of each signal transmitter.
[0055] In another optional implementation, the positioning device 12 can also determine the distance difference between the positioning device 12 and each signal transmitter based on the difference in arrival time of each positioning signal, and then determine the location information of the recording device 1 based on the distance difference and the position of each signal transmitter. For example, assuming that the difference in arrival time between the positioning device 12 receiving the positioning signal s1 transmitted by the signal transmitter x1 and the positioning signal s2 transmitted by the signal transmitter x2 is t, then the distance difference between the positioning device and the signal transmitter x1 and the signal transmitter x2 is t*v. Assuming that the positioning signal s1 arrives at the positioning device 12 first, the signal transmitter x1 is t*v closer to the positioning device 12 than the signal transmitter x2.
[0056] In another optional implementation, the positioning signal may also include the position information of the corresponding signal transmitter, and the positioning device 12 may determine the position information of the recording device 1 based on the position information in the positioning signal and the arrival time.
[0057] It should be understood that in the above description, the location information of the recording device 1 is determined by the positioning device 12 as an example, that is, a location calculation module is set in the positioning device 12 to calculate and obtain the location information of the recording device 1 in one of the above methods. In other optional implementations, a processor can be set in the recording device 1, and the positioning device 12 receives the positioning signal and sends the positioning signal to the processor, so that the processor calculates the location information of the recording device 1 in one of the above methods. This embodiment is not limited to this.
[0058] The memory 13 is configured to store a recording file consisting of the recording data collected by the sound collection device 11 and the location information of the recording device 1. The time of the recording data and the location information in the recording file corresponds to each other.
[0059] Figure 3 Schematic diagram of a recording file of an embodiment of the present invention. In this embodiment, the location information of the recording device 1 determined in the corresponding time period is associated with the recording data and then stored in the memory 13. Figure 3As shown, the signal transmission period of the signal transmitter in the recording venue is T (T>0). The position information of the recording device 1 determined by the positioning device 12 at time t0 is p1, the position information determined by the positioning device 12 at time t1 is p2, and the position information determined by the positioning device 12 at time t2 is p3. Then the position information corresponding to the recording data d1 collected during the time period t0-t1 is p1, the position information corresponding to the recording data d2 collected during the time period t1-t2 is p2, and the position information corresponding to the recording data d3 collected during the time period t2-t3 is p3. Therefore, this embodiment can obtain the position of the corresponding recording device in real time during the audio recording process, so that the stored recording file carries the position information of the recording venue. Therefore, the on-site environment of the recording venue can be restored when the recording file is played, saving the production time of re-importing the position during the post-production process and improving the production efficiency of audio and video.
[0060] In an optional implementation, the recorded data collected by the sound collection device 11 has collection time information, and the location information determined by the positioning device 12 also has corresponding time information (such as the emission time of the positioning signal, etc.). Therefore, when the sound collection device 11 and the positioning device 12 store the recorded data and the location information in the memory, the time can be determined based on the collection time information and the location information to achieve the time correspondence between the recorded data and the location information.
[0061] In another optional implementation, the recording device 1 may further include a processor, to receive the recording data and the location information through the processor, and to generate a recording file according to the recording data and the location information, and to store the generated recording file in the memory. Further, as described above, the processor may also be used to determine the location information of the recording device according to the positioning signal received by the positioning device and the location of each signal transmitter.
[0062] In an embodiment of the present invention, the recording device includes a sound collection device, a positioning device and a memory, so that the sound collection device collects recording data, the positioning device determines the location information of the recording device, and the recording data and the location information are integrated into a recording file based on time correspondence and stored in the memory. Therefore, this embodiment can directly obtain the location of the sound when receiving sound in the recording site, so that the recording file does not need to import the location in the post-production process, and can restore the on-site environment of the recording site when playing, thereby improving the production efficiency of audio files.
[0063] Figure 4 FIG. 1 is a schematic diagram of the working process of the recording device of an embodiment of the present invention. In this embodiment, multiple wireless transmitters are deployed in advance at the recording site to periodically transmit wireless positioning signals. Figure 3As shown, the recording device includes a sound collection device 41, a positioning device 42 and a memory 43. Among them, the positioning device 42 includes an antenna 421 and a position calculation module 422. After the recording starts, the sound collection device 41 in the recording device collects the recording data d. The antenna 421 in the positioning device 42 is used to receive the positioning signals s1-s3 and other signals transmitted by the wireless transmitter, and send the positioning signals s1-s3 to the position calculation module 422. The position calculation module 422 determines the position information p of the recording device according to the time when the positioning signals s1-s3 are received and the corresponding position of the wireless transmitter. The sound collection device 41 sends the recording data d to the memory corresponding to the memory 43 for storage, and the position calculation module 422 sends the position information p to the memory corresponding to the memory 43 for storage, so as to form a recording file in which the recording data d corresponds to the time of the position information p.
[0064] In other optional implementations, the present embodiment may further include a processor, which receives the recording data d and the location information p, and matches the recording data d with the location information p based on the corresponding time information, to form a recording file and store it in the memory 43. Furthermore, the positioning signals s1-s3 may also be received by the processor, so that the processor can determine the location information p of the recording device based on the reception time of the positioning signals s1-s3 and the location of each wireless transmitter, and the present embodiment does not limit this.
[0065] The embodiment of the present invention collects recording data through a sound collection device provided on the recording device, determines the location information of the recording device through a positioning device, and integrates the recording data and the location information into a recording file based on time correspondence and stores it in a memory. Therefore, the embodiment can directly obtain the location of the sound when collecting sound in the recording site, so that the recording file does not need to import the location in the post-production process, and can restore the on-site environment of the recording site when playing, thereby improving the production efficiency of audio files.
[0066] Figure 5 FIG. 1 is a flow chart of a method for processing recorded data according to an embodiment of the present invention. Figure 5 As shown, the recording processing method of this embodiment includes the following steps:
[0067] Step S100, controlling the recording device to collect and acquire recording data. Optionally, this embodiment collects recording data by controlling a sound collection device such as a microphone provided on the recording device. Further optionally, the microphone may be a directional microphone to record the corresponding audio data more clearly.
[0068] Step S200, determining the location information of the recording device through the received positioning signal. In this embodiment, a wireless transmitter is deployed in advance at the recording site, and a positioning signal is periodically transmitted during recording. The recording device receives the positioning signal transmitted by each wireless transmitter through a set positioning device to determine the location information of the recording device through the received multiple positioning signals. Further optionally, this embodiment can determine the three-dimensional spatial information of the recording device by the time when each positioning signal is received and the position of the corresponding wireless transmitter.
[0069] Step S300, generating and storing a recording file according to the recording data and the location information of the recording device, wherein the time of the recording data and the location information in the recording file corresponds to each other. For example, for a predetermined time interval t1-t2 (the time length is the transmission period T of the wireless transmitter), assuming that the location information of the recording device determined at time t1 is p1, and the location information of the recording device determined at time t2 is p2, then the location information p1 can be used as the location information of the recording data collected during the time period t1-t2, and the location information p2 can also be used as the location information of the recording data collected during the time period t1-t2, and this embodiment does not limit this.
[0070] In a further optional implementation, the present embodiment can also adjust the recording file to better meet the required audio playback effect. Specifically, the present embodiment can parse the recording file to obtain the recording data and position information, and adjust the position of the corresponding recording segment according to the received position adjustment information to update the recording file. Optionally, the present embodiment can import the recording file generated by the recording device into a corresponding electronic device (such as a mobile phone, tablet, computer and other electronic devices), and use a predetermined audio processing software to parse and obtain the recording data and position information. It should be understood that the present embodiment can use any audio editing software to perform audio analysis and position adjustment, and the present embodiment does not limit this. Further optionally, if the recording file has corresponding video data, the present embodiment can also import the parsed recording data and position information into the audio and video editing software, and synchronize it with the video.
[0071] In a further optional implementation, the present embodiment can also perform mixing according to the number and layout of sound playback devices in the playback environment to play the recording file, thereby achieving the sound field effect of restoring the recording scene.
[0072] The embodiment of the present invention collects recording data through a sound collection device provided on the recording device, determines the location information of the recording device through a positioning device, and integrates the recording data and the location information into a recording file based on time correspondence and stores it in a memory. Therefore, the embodiment can directly obtain the location of the sound when collecting sound in the recording site, so that the recording file does not need to import the location in the post-production process, and can restore the on-site environment of the recording site when playing, thereby improving the production efficiency of audio files.
[0073] Figure 6 Schematic diagram of a recording data processing system according to an embodiment of the present invention. Figure 6 As shown, the recording data processing system 6 of the embodiment of the invention includes a plurality of wireless transmitters 61 and recording equipment 62 deployed in a recording site.
[0074] The recording device 62 collects recording data through the sound collection device provided thereon, and receives the positioning signals transmitted by the multiple wireless transmitters 61 through the positioning device, so as to determine the position information of the recording device according to the reception time of the positioning signal and the position of each wireless transmitter 61, and integrates the recording data and the position information into a recording file based on the time correspondence and stores it in the memory of the recording device. Thus, this embodiment can directly obtain the position of the sound when receiving the sound in the recording site, so that the recording file does not need to import the position in the post-production process, and can restore the on-site environment of the recording site when playing, thereby improving the production efficiency of the audio file.
[0075] Further optionally, the recording data processing system 6 of the present embodiment also includes an audio processing device 63. In the present embodiment, the recording file in the recording device 62 can be imported into the audio processing device 63 for parsing, and the recording data and position information can be obtained, and the position of the corresponding recording segment can be adjusted according to the received position adjustment information to update the recording file. Thus, the playback effect of the recording file can be further made to be more in line with actual needs by adjusting the position of some audio segments in the recording file. Optionally, the audio processing device of the present embodiment can be an electronic device such as a mobile phone, a tablet, or a computer. It should be understood that the audio processing device can be installed with corresponding audio processing software, and the present embodiment does not limit its type.
[0076] Further optionally, the recording data processing system 6 of this embodiment further includes a sound playing device 64. The audio processing device 63 of this embodiment can mix audio based on the number and layout of the sound playing devices 64 in the playing environment, and play the recording file based on each sound playing device 64.
[0077] The embodiment of the present invention collects recording data through a sound collection device provided on the recording device, determines the location information of the recording device through a positioning device, and integrates the recording data and the location information into a recording file based on time correspondence and stores it in a memory. Therefore, the embodiment can directly obtain the location of the sound when collecting sound in the recording site, so that the recording file does not need to import the location in the post-production process, and can restore the on-site environment of the recording site when playing, thereby improving the production efficiency of audio files.
[0078] Another embodiment of the present invention relates to a non-volatile storage medium for storing a computer-readable program, wherein the computer-readable program is used for a computer to execute part or all of the above method embodiments.
[0079] That is, those skilled in the art can understand that all or part of the steps in the above-mentioned embodiment method can be completed by specifying relevant hardware through a program, and the program is stored in a storage medium, including several instructions for a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program codes.
[0080] The above description is only a preferred embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims
1. A recording device, characterized in that: The recording device comprises: A sound collection device is configured to collect and obtain recording data; a positioning device, configured to determine the location information of the recording device based on the received positioning signal; and The memory is configured to store a recording file consisting of the recording data and the location information, wherein the time of the recording data and the location information in the recording file corresponds to each other.
2. The recording device according to claim 1, characterized in that The recording device also includes: The processor is configured to generate a recording file according to the recording data and the location information.
3. The recording device according to claim 1, characterized in that: The sound collecting device is a directional microphone.
4. The recording device according to claim 1, characterized in that: The positioning device is configured to receive positioning signals transmitted by multiple signal transmitters deployed in the recording site, so as to determine the three-dimensional spatial position information of the recording device based on the multiple positioning signals.
5. The recording device according to claim 1 or 4, characterized in that: The positioning signal is a wireless radio frequency signal or an ultrasonic signal.
6. A method for processing recorded data, characterized in that: The method comprises: Control the recording equipment to collect and obtain recording data; Determining the location information of the recording device through the received positioning signal; A recording file is generated and stored according to the recording data and the location information, wherein the time of the recording data and the location information in the recording file corresponds to each other.
7. The method according to claim 6, characterized in that Determining the location information of the recording device by receiving the positioning signal includes: Receive positioning signals emitted by multiple signal transmitters deployed in the recording site; The three-dimensional spatial position information of the recording device is determined according to the multiple positioning signals.
8. The method according to claim 6, characterized in that The method further comprises: Parsing the recording file to obtain the recording data and location information; According to the received position adjustment information, the position of the corresponding recording segment is adjusted to update the recording file.
9. The method according to claim 6, characterized in that The method further comprises: Mixing is performed according to the number and layout of sound playing devices in the playing environment to play the recording file.
10. A recording data processing system, characterized in that: The system comprises: Multiple wireless transmitters deployed in the recording site to periodically transmit positioning signals; and A recording device as claimed in any one of claims 1 to 5.
11. The system according to claim 10, characterized in that The system further comprises: The audio processing device is used to parse the received recording file, obtain the corresponding recording data and position information, and adjust the position of the corresponding recording segment according to the received position adjustment information to update the recording file.
12. The system according to claim 10 or 11, characterized in that The system further comprises: A sound playing device is used to play a recording file after mixing, and the recording file is mixed based on the data and layout of the sound playing device.
13. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 6 to 9 is implemented.