A record audio identification and playing method, device and system based on visual processing

Abstract

Embodiments of the present application disclose a record audio recognition and playing method, device and system based on visual processing. The method is used in an electronic device comprising an image acquisition device, and the image acquisition device is movable relative to a record. The method comprises: determining image acquisition parameters of the image acquisition device when the image acquisition device acquires images of the record according to record information associated with audio playing in the record; acquiring audio track images of the record acquired by the image acquisition device based on the image acquisition parameters, and determining overlapping areas between adjacent frame audio track images according to the image acquisition parameters; correcting audio waveform data of the overlapping areas according to pixel lengths of the overlapping areas and audio waveform data of the adjacent audio track images, to obtain target audio waveform data of the record in visual processing; and playing audio of the record according to the target audio waveform data. The record audio recognition and playing based on visual processing replaces a traditional mechanical stylus, and can avoid record wear, audio quality degradation and mechanical noise.

Description

Technical Field

[0001] This invention relates to the field of audio processing technology, and in particular to a method, device and system for recognizing and playing record audio based on visual processing. Background Technology

[0002] A record is a music storage medium based on analog audio technology. Its core principle is to continuously record sound waveforms in grooves on the surface of the record through mechanical engraving. When the record is played, a mechanical stylus slides in the grooves, vibrating to drive the speaker and produce sound.

[0003] This mechanical contact method of record playback suffers from problems such as record wear, mechanical noise, electrostatic noise, and high maintenance costs. To avoid these issues, improvements to the mechanical contact record playback method are urgently needed. Summary of the Invention

[0004] This invention provides a method, device, and system for recording audio recognition and playback based on visual processing. It replaces the traditional mechanical stylus by using visual processing to recognize and play recording audio, thereby avoiding record wear, sound quality degradation, and mechanical noise.

[0005] According to one aspect of the present invention, a method for recognizing and playing record audio based on visual processing is provided. This method is used in an electronic device comprising an image acquisition device movable relative to the record. The record audio recognition and playback method includes: Based on the record information associated with audio playback, determine the image acquisition parameters when the image acquisition device acquires images of the record; The image acquisition device acquires the audio track images of the record based on the image acquisition parameters, and determines the overlapping area between adjacent frame audio track images according to the image acquisition parameters. Based on the pixel length of the overlapping region and the audio waveform data of the adjacent audio track images, the audio waveform data of the overlapping region is corrected to obtain the target audio waveform data of the record in visual processing. Play the record audio based on the target audio waveform data.

[0006] According to another aspect of the present invention, a record audio recognition and playback device based on vision processing is provided. This device is used in an electronic device including an image acquisition device movable relative to a record; the record audio recognition and playback device includes: The image acquisition parameter determination module is used to determine the image acquisition parameters when the image acquisition device acquires images of the record, based on the record information associated with audio playback. The overlapping region determination module is used to acquire the audio track images of the record acquired by the image acquisition device based on the image acquisition parameters, and to determine the overlapping region between adjacent frame audio track images according to the image acquisition parameters; The target audio waveform data determination module is used to correct the audio waveform data of the overlapping region based on the pixel length of the overlapping region and the audio waveform data of the adjacent audio track images, so as to obtain the target audio waveform data of the record in visual processing. The record audio playback module is used to play record audio based on the target audio waveform data.

[0007] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising: An image acquisition device, which is movable relative to the record; At least one processor; and a memory communicatively connected to the at least one processor; The memory stores a computer program that can be executed by the at least one processor, which is then executed by the at least one processor to enable the at least one processor to perform the visual processing-based record audio recognition and playback method according to any embodiment of the present invention.

[0008] According to another aspect of the present invention, a record audio recognition and playback system is provided, comprising: a turntable and an electronic device as described in any embodiment of the present invention, wherein the turntable is used to carry and drive the record to rotate.

[0009] According to another aspect of the present invention, a computer-readable storage medium is provided, the computer-readable storage medium storing computer instructions for causing a processor to execute and implement the record audio recognition and playback method based on vision processing according to any embodiment of the present invention.

[0010] According to another aspect of the present invention, a computer program product is provided, comprising a computer program that, when executed by a processor, implements the record audio recognition and playback method based on visual processing as described in any embodiment of the present invention.

[0011] The technical solution of this invention determines the image acquisition parameters of the image acquisition device when acquiring images of the record based on the record information associated with audio playback; obtains the audio track images of the record acquired by the image acquisition device based on the image acquisition parameters, and determines the overlapping area between adjacent frame audio track images based on the image acquisition parameters; corrects the audio waveform data of the overlapping area based on the pixel length of the overlapping area and the audio waveform data of the adjacent audio track images to obtain the target audio waveform data of the record in visual processing; and plays the record audio based on the target audio waveform data. This solves the problem that the record needs to play audio through the vibration of a traditional mechanical stylus in the groove. Through visual processing, non-contact audio recognition and playback between the record and the stylus can be achieved, avoiding record wear, sound quality degradation, and mechanical noise.

[0012] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of the present invention, nor is it intended to limit the scope of the invention. Other features of the invention will become readily apparent from the following description. Attached Figure Description

[0013] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0014] Figure 1 This is a flowchart of a record audio recognition and playback method based on visual processing according to Embodiment 1 of the present invention; Figure 2 This is a schematic diagram of an image acquisition device for acquiring record audio tracks according to Embodiment 1 of the present invention; Figure 3 This is a schematic diagram of an adjacent frame audio track image provided according to Embodiment 1 of the present invention; Figure 4 This is a flowchart of a record audio recognition and playback method based on visual processing according to Embodiment 2 of the present invention; Figure 5 This is a schematic diagram of pixel length correction for overlapping areas between adjacent audio track images according to Embodiment 2 of the present invention; Figure 6 This is a schematic diagram of a record audio recognition and playback device based on visual processing according to Embodiment 3 of the present invention; Figure 7 This is a schematic diagram of the structure of a record audio recognition and playback system according to Embodiment 4 of the present invention; Figure 8This is a schematic diagram of the structure of an electronic device that implements the visual processing-based record audio recognition and playback method according to an embodiment of the present invention. Detailed Implementation

[0015] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0016] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0017] Example 1 Figure 1 This is a flowchart of a record audio recognition and playback method based on visual processing according to Embodiment 1 of the present invention. This embodiment is applicable to situations where the changes in the audio track during record movement are collected and recognized by an image acquisition device to achieve contactless audio reading and playback of the record. This method can be executed by a record audio recognition and playback device based on visual processing. The record audio recognition and playback device based on visual processing can be implemented in hardware and / or software. The record audio recognition and playback device based on visual processing can be configured in electronic devices such as computers, record players, or karaoke machines.

[0018] This method is used in electronic devices that include an image acquisition device, which can move relative to a record. For example, Figure 2 This is a schematic diagram of an image acquisition device for acquiring audio tracks from a record, according to Embodiment 1 of the present invention. Figure 2 As shown, the image acquisition device can be positioned directly above the record's audio track. The image acquisition device captures the audio track during playback, and through the audio waveform data corresponding to the real-time captured audio track image, it performs audio recognition and playback, avoiding mechanical contact between the record and the stylus, thus achieving contactless, lossless record playback.

[0019] like Figure 1 As shown, the record audio recognition and playback method based on vision processing includes: Step 110: Determine the image acquisition parameters when the image acquisition device acquires images of the record based on the record information associated with audio playback.

[0020] The record can be a cylindrical record or a disc record, such as a vinyl record. The record information associated with audio playback includes, but is not limited to: the record's track radius, record audio time, record rotation speed, record pitch, record size, record period, record angular velocity, record linear velocity, and record radial velocity.

[0021] The image acquisition device can be a camera, digital camera, or industrial camera, etc. The image acquisition device moves relative to the playing record to acquire images of the corresponding audio track in real time. Therefore, when controlling the image acquisition device to acquire images from the record, the image acquisition parameters can be determined based on the record information associated with audio playback. Image acquisition parameters include, but are not limited to: the timing of the image acquisition device's capture, its movement speed, the size of the captured audio track image, and the real-time radius of its location.

[0022] By using the record information associated with audio playback on the record, the image acquisition device can be controlled to correspond to the audio track during record playback. For example, the image acquisition parameters can be determined experimentally using the record information associated with audio playback, thus controlling the image acquisition device to acquire the audio track during record playback. When determining the image acquisition parameters, it can be ensured that there is a certain degree of overlap in the audio track images acquired by the image acquisition device, and that the degree of overlap is less than a preset overlap parameter, to avoid data redundancy and ensure the integrity of the audio track acquisition. The image acquisition parameters corresponding to the current record information can be recorded experimentally and stored as a mapping table. In subsequent applications, the image acquisition parameters for the image acquisition device to acquire images from the record are directly determined based on the mapping table and the record information associated with audio playback.

[0023] Another example is the use of calculations to determine the image acquisition parameters of the image acquisition device in real time, based on the record information associated with audio playback. For instance, information about the record's movement can be used to determine the speed of the image acquisition device, ensuring it can follow the record's movement and capture the audio track at the current angle. Similarly, information such as the length of the record's movement can determine the size of the audio track image captured by the image acquisition device, ensuring it captures only the currently playing track. Furthermore, information such as the record's rotation angle can determine the timing of image capture, i.e., the sampling interval for each frame. By calculating the image acquisition parameters based on the record information associated with audio playback, the image acquisition device can dynamically capture audio tracks as the record moves, thereby achieving accurate audio waveform recognition and playback, and improving sound quality.

[0024] Step 120: Obtain the audio track images of the record acquired by the image acquisition device based on the image acquisition parameters, and determine the overlapping area between adjacent frame audio track images according to the image acquisition parameters.

[0025] For example, Figure 3 This is a schematic diagram of an adjacent frame audio track image provided according to Embodiment 1 of the present invention. Figure 3 As shown, there are overlapping areas between adjacent audio track images acquired by the image acquisition device. There are several ways to determine these overlapping areas. For example, the distance the image acquisition device moves between adjacent audio track images can be determined using image acquisition parameters, and then the overlapping area can be determined based on this distance. Alternatively, the overlapping area can be determined using image recognition technology or image similarity comparison. Identifying the overlapping areas between adjacent audio track images facilitates the correction of the audio waveform data in the overlapping areas, thereby improving the sound quality of the record.

[0026] Step 130: Based on the pixel length of the overlapping area and the audio waveform data of the adjacent audio track images, correct the audio waveform data of the overlapping area to obtain the target audio waveform data of the record in visual processing.

[0027] The audio waveform data of adjacent audio track images can be determined through image recognition. For example, image edge detection can be used to identify grooves and left and right waveforms in the audio track images to obtain the audio waveform data. The corresponding audio waveform data of adjacent audio track images can be determined based on the pixel length of the overlapping region, thus correcting the audio waveform data of the overlapping region. There are several ways to correct the audio waveform data of the overlapping region. For example, the audio waveform data of the overlapping region in the timestamped audio track images of adjacent audio track images can be directly used as the audio waveform data of the overlapping region. Alternatively, the audio waveform data corresponding to the overlapping region in adjacent audio track images can be fused using preset weights to obtain the audio waveform data of the overlapping region. The preset weights can be static or dynamic. For example, dynamic weights can be related to the overlapping positions in adjacent audio track images.

[0028] The audio waveform data of the non-overlapping areas in each audio track image is stitched together with the corrected audio waveform data of the overlapping areas between adjacent audio track images in sequence to obtain the target audio waveform data of the record in visual processing. By identifying the overlapping areas and correcting the audio waveform data of the overlapping areas, sound quality problems caused by overlapping audio tracks can be avoided, audio jumps can be prevented, and the sound quality of the record can be improved.

[0029] Step 140: Play the record audio based on the target audio waveform data.

[0030] The target audio waveform data obtained through visual processing is a spatial signal. Based on the relationship between distance and time during record movement, this spatial signal can be converted into a time-domain audio signal. Furthermore, the record audio can be played back based on the time-domain signal.

[0031] The technical solution of this invention obtains target audio waveform data through visual processing for record audio playback, avoiding wear and tear on the record by the mechanical phonograph, the resulting sound quality degradation and mechanical noise, thus improving the sound quality of record playback. Furthermore, by determining image acquisition parameters based on record information, the reliability of track acquisition is improved. By identifying overlapping areas and correcting the audio waveform data of overlapping areas, track jumps can be avoided, further enhancing sound quality.

[0032] Example 2 Figure 4 This is a flowchart of a record audio recognition and playback method based on visual processing according to Embodiment 2 of the present invention. This embodiment is a further refinement of the above technical solution, and the technical solution in this embodiment can be combined with various optional solutions in one or more of the above embodiments. This method is used in an electronic device including an image acquisition device that can move relative to the record.

[0033] Optionally, based on the record information associated with audio playback, the image acquisition parameters for the image acquisition device to acquire images of the record are determined, including: Based on the record's track radius, audio duration, and record rotation speed, determine the timing, movement speed, and size of the captured track image of the image acquisition device.

[0034] Optionally, the overlapping region between adjacent audio track images is determined based on the image acquisition parameters, including: The moving distance of the image acquisition device between adjacent audio track images is determined based on the image acquisition parameters. The pixel displacement between adjacent audio track images is determined based on the physical length and movement distance of a single pixel in the audio track image. The pixel length of the overlapping area between adjacent audio track images is determined based on the image length and pixel displacement of the audio track images.

[0035] Optionally, based on the pixel length of the overlapping region and the audio waveform data of adjacent audio track images, the audio waveform data of the overlapping region is corrected to obtain the target audio waveform data of the record in visual processing, including: The audio waveform weights at each position are determined based on the pixel length of the overlapping region and the pixel length at each position within the overlapping region. Based on the audio waveform data of the previous frame and the next frame of the adjacent audio track images, as well as the audio waveform weights at each position, the audio waveform data at each position in the overlapping area is determined, thus obtaining the target audio waveform data of the record in visual processing.

[0036] like Figure 4 As shown, the method includes: Step 410: Determine the shooting timing, moving speed, and size of the captured audio track image of the image acquisition device based on the record's track radius, audio duration, and record rotation speed.

[0037] The track radius of a record can include the radius at one or more locations. For example, the track radius gradually decreases from the outside to the inside of the record. The track radius can include the maximum radius at the beginning and the minimum radius at the end. For example, in a 12-inch vinyl record, the maximum radius at the beginning... Approximately 14.6cm, minimum radius at the end Approximately 6cm. Audio duration can be the playback time of the record's audio. For example, on a 12-inch vinyl record, the audio duration is 22 minutes (min). Record rotation speed can be the record's rotational speed, linear velocity, angular velocity, or radial velocity, etc. For example, on a 12-inch vinyl record, at a rotational speed of n=100 / 3, that is, 100 / 3 revolutions per minute, the record takes 60 / 33.33 seconds to complete one revolution, approximately 1.8 seconds (s). The record has a spiral shape from the outside in; the angular velocity is constant during the rotation of the record. The linear velocity at different positions is... . It is linear velocity (cm / s); It is angular velocity (rad / s); Let be the radius (cm) of the audio track at each position. For example, at the initial maximum radius, the linear velocity is . At the minimum radius at the end, the linear velocity is... Radial velocity can be determined based on the track radius and audio duration. For example, in a 22-minute record, the radial velocity is... .

[0038] When an image acquisition device captures images of a record, it can follow the record's movement to capture track images. Therefore, the timing of the image acquisition device's capture, its movement speed, and the size of the captured track image can be determined based on the record information. The capturing timing can be the image acquisition time, such as the distance, angle, or duration of the record's rotation before image acquisition. Thus, the capturing timing can be determined based on the record's track radius, audio duration, and record speed. The movement speed can be the control method for the image acquisition device as it follows the record's movement. For example, the image acquisition device can follow the record's radial speed, or it can follow other speeds of the record. The track image size can be the size of the track image captured by the image acquisition device. Controlling the track image size ensures comprehensive track capture and reduces repetition. For example, based on the track radius and record speed in the record information, the track change length per second of record movement can be determined, and the track image size can be determined based on this track change length to ensure comprehensive track capture and reduce repetition.

[0039] To further improve the reliability of audio track image acquisition and standardize the movement and shooting control of the image acquisition device, optionally, the shooting timing, movement speed, and captured audio track image size of the image acquisition device can be determined based on the record's track radius, audio duration, and record rotation speed. This includes: determining the radial speed of the record based on its track radius and audio duration; using the radial speed as the movement speed of the image acquisition device when moving from the outside to the inside of the record track; determining the period of one revolution of the record based on its rotation speed; determining the time taken for each degree of rotation based on the period; determining the rotation angle of the record per unit time based on the time taken for each degree of rotation; using the rotation angle as the shooting timing of the image acquisition device; determining the rotation length for one degree of rotation of the record based on its track radius; determining the track movement length based on the rotation length and rotation angle; and determining the captured audio track image size based on the track movement length.

[0040] For example, the radial velocity is The speed is approximately 0.065 mm / s, which allows the image acquisition device to move at a constant speed of 0.065 mm / s when moving from the outside to the inside of the record track. The record takes 1.8 seconds to complete one revolution, meaning the period of one revolution is 1.8 seconds. Therefore, the time taken for each degree of rotation of the record is... Similarly, each 0.2-degree rotation takes 1 ms, meaning the record rotates 0.2 degrees per unit of time. This rotation angle is used as the timing for the image acquisition device to capture images. In other words, the image acquisition device can capture one audio track image every 0.2-degree rotation.

[0041] At the radius of the audio track, the rotation length of the record when it rotates one degree is... Specifically, at the initial maximum radius, the rotation length of the record when it rotates one degree is... That is, approximately 2.55mm. At the minimum radius at the end, the rotation length of the record when it rotates one degree is... This is approximately 1.05mm. The track movement length is determined based on the rotation angle of the record per unit time and the rotation length when the record rotates one degree. For example, at the maximum radius at the beginning of the record, the track movement length is 2.55 × 0.2 = 0.51mm; at the minimum radius at the end, the track movement length is 1.05 × 0.2 = 0.21mm. The track movement length can be used to determine the size of the track image captured by the image acquisition device to ensure comprehensive capture and reduce overlap between adjacent frames. For example, a size larger than the track movement length at the maximum radius can be used as the capture length in the track image size; the capture width in the track image size is determined based on the neighborhood value of the track movement length at the minimum radius. For example, the track image size has a length of 0.6mm and a width of 0.2mm.

[0042] For example, taking a 12-inch vinyl record as an example, the audio duration is 22 minutes, the record speed is 100 / 3 revolutions per minute, the maximum radius is 14.6 cm, and the minimum radius is 6 cm. The image acquisition device moves at a constant speed of 0.065 mm / s from the outside to the inside of the record track. The image acquisition device can be a 1000 fps camera. The image acquisition device captures one image of the track with a length of 0.6 mm and a width of 0.2 mm for every 0.2 degrees of rotation. By determining the image acquisition parameters of the image acquisition device, the entire record track can be captured.

[0043] Based on the above implementation, optionally, the image acquisition parameters for the image acquisition device to acquire images of the record are determined according to the record information associated with audio playback in the record. This also includes: determining the record pitch according to the radial speed and period; and determining the real-time radius of the location of the image acquisition device according to the record rotation speed, record pitch and track radius.

[0044] The record pitch refers to the distance between the centers of the grooves. The product of radial velocity and period can be used as the record pitch. For example, the record pitch... The real-time radius is . The initial maximum radius, where n represents the rotational speed (e.g., 100 / 3). For record pitch, The time frame is used. By determining the real-time radius of the image acquisition device's location, the device's current position can be determined. When audio track images need correction, the real-time radius of the image acquisition device's location can be used for precise correction.

[0045] Step 420: Obtain the audio track image of the record acquired by the image acquisition device based on the image acquisition parameters.

[0046] Step 430: Determine the moving distance of the image acquisition device between adjacent audio track images based on the image acquisition parameters.

[0047] For example, based on the shooting timing and audio track radius in the image acquisition parameters, the movement distance between adjacent audio track images can be determined. For instance, the movement distance is... . For the timing of the shot, such as 0.2 degrees. This refers to the audio track radius, which can be either the maximum or minimum radius. To ensure the reliability of the overlapping area determination, a real-time radius can be used. That is, This can be the real-time radius of the location of the image acquisition device when it captures the k-th frame image. The displacement of the k-th frame image captured by the image acquisition device is the distance that the previous frame image moves to the next frame image.

[0048] Step 440: Determine the pixel displacement between adjacent audio track images based on the physical length and movement distance of a single pixel in the audio track image.

[0049] For example, pixel displacement is . This represents the physical length of a single pixel. For example, if an image is approximately 0.6 mm long and has 1080 pixels, then each pixel represents a physical length of approximately 0.5556 μm. This indicates how many pixels were skipped horizontally when moving from the previous frame to the next frame. If The larger the image size, the longer the image acquisition device moves, and the smaller the overlapping area becomes.

[0050] Step 450: Determine the pixel length of the overlapping area between adjacent audio track images based on the image length and pixel displacement of the audio track images.

[0051] The difference between image length and pixel displacement can be used as the pixel length of the overlapping area between adjacent audio track images.

[0052] Furthermore, considering errors during record playback, the pixel length of the overlapping area can be corrected. For example, the record pitch is not fixed during audio playback; it increases when there are more high frequencies and decreases when there are fewer high frequencies. Record pitch is related to radial velocity, and when a fixed radial velocity is used, the influence of variable record pitch on radial velocity is ignored. Due to the change in radial velocity, the overlapping area between adjacent audio tracks increases continuously from the outside in. Correction can be made based on the previously determined pixel length of the overlapping area to improve the reliability of the audio waveform data. For example, mechanical errors can be used to correct pixel displacement. Alternatively, image recognition processing methods can be used to identify pixel displacement.

[0053] Optionally, the pixel length of the overlapping region between adjacent audio track images is determined based on the image length and pixel displacement of the audio track images. This includes: correcting the pixel displacement of the overlapping region according to mechanical errors to obtain the target pixel displacement; performing correlation calculation based on the audio waveform data of the previous frame and the audio waveform data of the next frame of the adjacent audio track images, using the region corresponding to the target pixel displacement as the search space; taking the pixel displacement of the target pixel point corresponding to the maximum correlation value in the region as the actual pixel displacement between adjacent audio track images; and determining the pixel length of the overlapping region between adjacent audio track images based on the image length and the actual pixel displacement of the audio track images.

[0054] Among these, mechanical error can be a pixel displacement correction value set in advance based on experience. For example, mechanical error can be a range... Values ​​within, for example, The value is 20. For example, Figure 5 This is a schematic diagram illustrating pixel length correction for overlapping areas between adjacent audio track images according to Embodiment 2 of the present invention. Figure 5 As shown, assume there are 100 pixels overlapping between adjacent audio track images. In an image of 1080 pixels, this means the pixel displacement of the overlapping area is roughly calculated using the last 100 pixels of the previous frame and the first 100 pixels of the next frame. In the precise correction, the mechanical error is set to 20, resulting in a target pixel displacement of 120 pixels for the corrected overlapping area.

[0055] Based on the audio waveform data of the previous and subsequent audio track images in adjacent audio track images, correlation calculation can be performed using the region corresponding to the target pixel displacement as the search space. For example, by fixing the tail of the previous audio track image and moving the head of the subsequent audio track image, moving it pixel by pixel and comparing the audio waveform data, the most similar target pixel is determined. The target pixel position is the position where the previous and subsequent audio track images are most closely connected, and the pixel displacement of the target pixel is taken as the actual pixel displacement between adjacent audio track images.

[0056] There are several ways to calculate correlation. For example, normalized correlation coefficient, Pearson correlation coefficient, or Spearman's rank correlation coefficient. For instance, it can be calculated using a formula... Determine the correlation between the previous and next audio track images at each pixel point in the search space. For each pixel, the value is any pixel in the search space, such as... Figure 5 The search space consists of 0-120 pixels horizontally from left to right in the head of the next frame audio track image, or 0-120 pixels horizontally from left to right in the tail of the previous frame audio track image. Maximum The value is the target pixel. This represents the audio waveform data of the i-th pixel in the horizontal search space from left to right at the end of the previous frame's audio track image. This represents the audio waveform data of the i-th pixel in the horizontal search space of the head of the next frame audio track image, from left to right. This represents the average value of the audio waveform data within the search space at the end of the previous frame's audio track image. This represents the average value of the audio waveform data within the search space in the header of the next frame audio track image.

[0057] The pixel length of the overlapping region is .in, Image length; The pixel displacement of the target pixel, i.e. Figure 5 The pixel length from left to target pixel in the previous frame of the audio track image, or the pixel length from right to target pixel in the next frame of the audio track image.

[0058] By correcting the pixel length of the overlapping area, it is possible to avoid inaccurate track recognition caused by differences in pitch due to high and low frequencies and slight changes in the turntable, which would otherwise affect the sound quality of the record.

[0059] It should be noted that in practical applications, a coarse method for determining the pixel length of the overlapping region (i.e., without correction) or a precise method for determining the pixel length of the overlapping region (i.e., with correction) can be used depending on specific needs. When using the precise method for determining the pixel length of the overlapping region, it can be based on the coarse method, or it can directly use the entire adjacent audio track image as the search space for correlation calculation, and take the pixel displacement of the target pixel corresponding to the maximum correlation in the search space as the actual pixel displacement between adjacent audio track images; based on the image length of the audio track image and the actual pixel displacement, the pixel length of the overlapping region between adjacent audio track images is determined. Using a method that corrects the coarse method can reduce computational complexity and avoid introducing a large amount of unnecessary calculations.

[0060] The audio waveform data can be determined using image recognition methods. Optionally, the audio waveform data of the audio track image can be determined as follows: extract the inner and outer curves of the audio track in the audio track image to obtain the audio track waveform at each position in the audio track image; determine the arc length along the audio track at each position based on the pixel length at each position in the audio track image and the image acquisition parameters; and determine the audio waveform data of the audio track image based on the arc length at each position in the audio track image and the audio track waveform.

[0061] The grooves in a turntable are themselves the audio waveform; its stereo sound is based on a 45 / 45 degree system, and the audio track is a V-shaped groove with a 90-degree angle. The audio track image acquired by the image acquisition device is as follows... Figure 5 As shown, there are inner curves, outer curves, and the bottom of the groove in the image. By using image recognition methods, such as image edge detection algorithms like the Canny operator, to extract the inner and outer curves of the audio track in the image, the audio track waveform at each pixel location can be obtained. For example, the value of the inner curve at the i-th pixel horizontally is... The value of the audio track curve at the i-th pixel in the horizontal direction is Taking an audio track image with a resolution of 1080×540 pixels as an example, the number of pixels horizontally is 1080, and the number of pixels vertically is 540. Assuming the physical length of a single pixel... The value is 0.5556µm, and the vertical height is 540×0.5556µm, approximately 0.3mm. Assuming the audio track curve at the i-th horizontal pixel is at the 130th vertical pixel, then the value of the audio track curve at the i-th horizontal pixel is... .

[0062] In practical applications, the waveforms of the audio tracks at various locations within the audio track image can also be corrected. For example, considering that each audio track image is not captured in the exact center, meaning the y-values ​​of adjacent audio track images may fluctuate, differential processing can be used to mitigate this. Specifically, the center audio track waveform is determined based on the waveforms of the inner and outer curves of the audio track. 'r' represents the audio track radius, which can be, for example, the real-time radius of the location where the image acquisition device captures the current frame's audio track image. The corrected audio track waveforms for the inner and outer curves are respectively... , .

[0063] The pixel length at each position in the audio track image can be , where i is the i-th pixel in the horizontal direction. This is the physical length of a single pixel. The arc length along the audio track at each position is... r is the audio track radius, which can be, for example, the real-time radius of the location of the audio track when the image acquisition device acquires the current frame's audio track image.

[0064] Based on the arc lengths at various positions in the audio track image and the audio track waveform, the audio waveform data of the audio track image is determined as follows: , This represents the audio waveform data of the i-th pixel in the horizontal plane. The audio waveform data after the audio track image correction is as follows: .

[0065] Step 460: Determine the audio waveform weight at each position based on the pixel length of the overlapping region and the pixel length at each position in the overlapping region.

[0066] Considering that directly splicing audio waveform data within overlapping areas may result in abrupt changes, smoothing processing can be performed on the audio waveform data. For example, weighted waveform correction can be applied to the audio waveform data within the overlapping area using dynamic weights, i.e., weights at each position. For instance, the ratio of the pixel length at each position to the pixel length of the overlapping area can be used as the audio waveform weight at that position. For example, the audio waveform weights are... . The length is the pixel length of the overlapping region. A linearly varying weight array, Let be the pixel length at position i in the overlapping region. The audio waveform weights smoothly transition from 0 to 1, mitigating some noise or error issues. For example, at the starting point of the overlapping region... At the midpoint of the overlapping region At the end of the overlapping region .

[0067] Step 470: Based on the audio waveform data of the previous frame audio track image, the audio waveform data of the next frame audio track image, and the audio waveform weights at each position in the adjacent audio track images, determine the audio waveform data at each position in the overlapping area, and obtain the target audio waveform data of the record in visual processing.

[0068] By assigning audio waveform weights to each location, the audio waveform data from the preceding and following audio tracks at that location can be dynamically weighted and merged. For example, the audio waveform data at each location in the overlapping region can be... In the formula, For the (k-1)th frame audio track image The position of the audio track waveform, This represents the audio waveform at position i in the k-th frame of the audio track image. When determining the audio waveform data, the audio waveforms of the inner and outer curves within the overlapping region can be merged separately. By dynamically weighting and merging the audio waveform data in the overlapping region, the sound quality of the record can be improved.

[0069] Step 480: Play the record audio based on the target audio waveform data.

[0070] When the target audio waveform data is a spatial signal, it can be converted into a time-domain signal for audio playback. Optionally, playing record audio based on the target audio waveform data includes: determining the movement angle of the image acquisition device at each position in each frame of the audio track image based on the image acquisition parameters; determining the audio playback time of the record at each position in each frame of the audio track image based on the record angular velocity and movement angle in the record information; mapping the displacement information in the target audio waveform data according to the audio playback time at each position in each frame of the audio track image to obtain the audio time-domain signal; calculating the derivative of the audio time-domain signal with respect to time to obtain the audio playback speed signal, and playing record audio based on the audio playback speed signal.

[0071] The moving angle of the image acquisition device is: N represents the Nth frame of the audio track image. This represents the angle between two audio track images, such as 0.2 degrees determined based on the shooting motivation in the image acquisition parameters. Furthermore, the movement angle can be offset and corrected. For example, a small angular offset at each position is... The correction value for the movement angle of the image acquisition device is... The audio playback time of the record at each position is... . This represents angular velocity, expressed as 100 / 3 revolutions per minute. .

[0072] Therefore, the target audio waveform data can be... Displacement information in Mapping is performed to obtain the audio time-domain signal. .

[0073] Since audio time-domain signals are discrete data, they can be smoothed to ensure high-quality sound on the record. Optionally, based on the above implementation, after mapping the displacement information in the target audio waveform data according to the audio playback time at each position in each frame of the audio track image to obtain the audio time-domain signal, the method further includes: smoothing the audio time-domain signal and updating the audio time-domain signal.

[0074] For example, smoothing can be achieved through curve fitting or interpolation. For instance, cubic spline interpolation can be used for resampling to fit non-uniform discrete data into a continuous, smooth audio track curve. . This represents the smoothed audio time-domain signal, where n is the number of sampling points. Indicates to Perform cubic spline interpolation. This represents uniform sampling at a specified time t, where f is the frequency of the image acquisition device. Smoothing processing can smooth the audio time-domain signal, avoiding sharp angles or breaks, thereby improving the sound quality of the record.

[0075] The audio time-domain signal is obtained by processing the displacement of the audio track image acquired by the image acquisition device. In audio playback, a speed electrical signal can be used to avoid a muffled sound. Therefore, the audio playback speed signal can be obtained by calculating the derivative of the audio time-domain signal with respect to time. . For the smoothed audio time-domain signal and time Related.

[0076] By using the audio playback speed signal for record playback, lossless record playback under visual processing is achieved. To further improve the record playback effect, playback methods such as compression, restoration, or noise reduction can be applied to the audio playback speed signal. For example, equalization processing used in record playback can be used to optimize sound quality.

[0077] The technical solution of this invention determines the shooting timing, moving speed, and captured track image size of the image acquisition device based on the track radius, audio duration, and record rotation speed of the record; acquires the track image of the record acquired by the image acquisition device based on image acquisition parameters; determines the moving distance of the image acquisition device between adjacent track images based on the image acquisition parameters; determines the pixel displacement between adjacent track images based on the physical length of a single pixel in the track image and the moving distance; determines the pixel length of the overlapping area between adjacent track images based on the image length of the track image and the pixel displacement; determines the audio waveform weight at each position based on the pixel length of the overlapping area and the pixel length at each position in the overlapping area; and determines the audio waveform weight at each position based on the previous frame track image in the adjacent track images. By analyzing audio waveform data, the audio waveform data of the next frame of the audio track image, and the audio waveform weights at each position, the audio waveform data at each position in the overlapping area is determined, resulting in the target audio waveform data of the record in visual processing. Record audio playback is then performed based on this target audio waveform data, solving the problem of the record needing to vibrate in the groove using a traditional mechanical stylus for audio playback. Using visual processing to obtain the target audio waveform data for record audio playback avoids wear and tear on the record, the resulting sound quality degradation, and mechanical noise, thus improving the sound quality of record playback. Furthermore, by determining image acquisition parameters based on record information, the reliability of track acquisition is improved. Overlapping area identification and correction, along with the correction of audio waveform data in the overlapping area, prevents track jumps and improves sound quality.

[0078] Example 3 Figure 6 This is a schematic diagram of a record audio recognition and playback device based on visual processing, according to Embodiment 3 of the present invention. Figure 6 As shown, this device is used in an electronic device that includes an image acquisition unit, which is movable relative to a record; the record audio recognition and playback device includes: an image acquisition parameter determination module 610, an overlapping area determination module 620, a target audio waveform data determination module 630, and a record audio playback module 640. Wherein: The image acquisition parameter determination module 610 is used to determine the image acquisition parameters when the image acquisition device acquires images of the record based on the record information associated with audio playback. The overlapping area determination module 620 is used to acquire the audio track images of the record acquired by the image acquisition device based on the image acquisition parameters, and to determine the overlapping area between adjacent frame audio track images according to the image acquisition parameters. The target audio waveform data determination module 630 is used to correct the audio waveform data of the overlapping area based on the pixel length of the overlapping area and the audio waveform data of the adjacent audio track images, so as to obtain the target audio waveform data of the record in visual processing. The record audio playback module 640 is used to play record audio based on target audio waveform data.

[0079] Optionally, the image acquisition parameter determination module 610 includes: The image acquisition parameter determination unit is used to determine the shooting timing, moving speed, and size of the captured audio track image of the image acquisition device based on the track radius, audio duration, and record rotation speed.

[0080] Optionally, the image acquisition parameter determination unit includes: The moving speed determination subunit is used to determine the radial speed of the record based on the record's track radius and audio duration; and uses the radial speed as the moving speed of the image acquisition device when it moves from the outside to the inside of the record's track. The sub-unit for determining the time taken per degree of rotation is used to determine the cycle of one revolution of the record based on the record's rotation speed; and to determine the time taken per degree of rotation of the record based on the cycle. The shooting timing determination subunit is used to determine the rotation angle of the record per unit time based on the time taken for each degree of rotation; the rotation angle is used as the shooting timing of the image acquisition device; The audio track image size determination subunit is used to determine the rotation length when the record rotates one degree based on the audio track radius, and to determine the audio track movement length based on the rotation length and rotation angle; and to determine the size of the audio track image captured by the image acquisition device based on the audio track movement length.

[0081] Optionally, the image acquisition parameter determination module 610 further includes: The record pitch determination unit is used to determine the record pitch based on the radial velocity and the period. The real-time radius determination unit is used to determine the real-time radius of the image acquisition device based on the record rotation speed, record pitch, and track radius.

[0082] Optionally, the overlapping region determination module 620 includes: The adjacent image movement distance determination unit is used to determine the movement distance of the image acquisition device between adjacent audio track images based on the image acquisition parameters. The adjacent image pixel displacement determination unit is used to determine the pixel displacement between adjacent audio track images based on the physical length and moving distance of a single pixel in the audio track image. The overlapping region pixel length determination unit is used to determine the pixel length of the overlapping region between adjacent audio track images based on the image length and pixel displacement of the audio track images.

[0083] Optionally, the overlapping region pixel length determination unit includes: The target pixel displacement determination subunit is used to correct the pixel displacement of the overlapping area based on mechanical errors to obtain the target pixel displacement; The correlation calculation subunit is used to perform correlation calculation based on the audio waveform data of the previous frame audio track image and the audio waveform data of the next frame audio track image in adjacent audio track images, with the area corresponding to the target pixel displacement as the search space. The actual pixel displacement determination subunit is used to take the pixel displacement of the target pixel point corresponding to the maximum correlation value in the region as the actual pixel displacement between adjacent audio track images; The overlapping region pixel length correction unit is used to determine the pixel length of the overlapping region between adjacent audio track images based on the image length of the audio track image and the actual pixel displacement.

[0084] Optionally, the target audio waveform data determination module 630 includes: The audio waveform weight determination unit is used to determine the audio waveform weight at each position based on the pixel length of the overlapping region and the pixel length at each position in the overlapping region. The target audio waveform data determination unit is used to determine the audio waveform data at each position in the overlapping area based on the audio waveform data of the previous frame audio track image, the audio waveform data of the next frame audio track image, and the audio waveform weight at each position in the adjacent audio track images, so as to obtain the target audio waveform data of the record in visual processing.

[0085] Optional, the record audio playback module 640 includes: The movement angle determination unit is used to determine the movement angle of the image acquisition device at each position in each frame of the audio track image based on the image acquisition parameters. The audio playback time determination unit is used to determine the audio playback time of the record at each position in each frame of the audio track image based on the record angular velocity and movement angle in the record information. The audio time-domain signal determination unit is used to map the displacement information in the target audio waveform data according to the audio playback time at each position in each frame audio track image to obtain the audio time-domain signal. The record audio playback unit is used to calculate the derivative of the audio time-domain signal with respect to time to obtain the audio playback speed signal, and to play the record audio according to the audio playback speed signal.

[0086] Optionally, the device may also include: The smoothing module is used to map the displacement information in the target audio waveform data according to the audio playback time of each position in each frame of the audio track image, obtain the audio time domain signal, and then smooth the audio time domain signal to update the audio time domain signal.

[0087] Optionally, the device may also include: The audio track waveform extraction module is used to extract the inner curve and outer curve of the audio track in the audio track image before correcting the audio waveform data of the overlapping area based on the pixel length of the overlapping area and the audio waveform data of the adjacent audio track images, so as to obtain the audio track waveform at each position in the audio track image. The arc length determination module is used to determine the arc length along the audio track at each position based on the pixel length at each position in the audio track image and the image acquisition parameters. The audio waveform data determination module is used to determine the audio waveform data of the audio track image based on the arc length at each position in the audio track image and the audio track waveform.

[0088] The record audio recognition and playback device based on visual processing provided in the embodiments of the present invention can execute the record audio recognition and playback method based on visual processing provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of executing the method.

[0089] Example 4 Figure 7 This is a schematic diagram of the structure of a record audio recognition and playback system according to Embodiment 4 of the present invention. Figure 7 As shown, the record audio recognition and playback system includes a turntable 710 and an electronic device 720. The turntable 710 carries and drives the record to rotate. The electronic device 720 includes an image acquisition device 730, which is movable relative to the record. The image acquisition device 730 acquires track images of the record based on image acquisition parameters. These image acquisition parameters can be determined using the vision-processing-based record audio recognition and playback method provided in any embodiment of the present invention. The electronic device 720 can execute the vision-processing-based record audio recognition and playback method provided in any embodiment of the present invention to achieve contactless and wear-free audio playback of the record.

[0090] Example 5 Figure 8 This is a schematic diagram of the structure of an electronic device implementing the visual processing-based record audio recognition and playback method according to embodiments of the present invention. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices (such as helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the invention described and / or claimed herein.

[0091] like Figure 8As shown, the electronic device 720 includes an image acquisition device 730, which is movable relative to a record; the image acquisition device acquires audio track images of the record based on image acquisition parameters; at least one processor 11; and a memory, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., communicatively connected to the at least one processor 11. The memory stores computer programs executable by the at least one processor. The processor 11 can perform various appropriate actions and processes based on the computer program stored in the ROM 12 or loaded into the RAM 13 from the storage unit 18. The RAM 13 can also store various programs and data required for the operation of the electronic device 720. The processor 11, ROM 12, and RAM 13 are interconnected via a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0092] Multiple components in electronic device 720 are connected to I / O interface 15, including: input unit 16, such as keyboard, mouse, etc.; output unit 17, such as various types of displays, speakers, etc.; storage unit 18, such as disk, optical disk, etc.; and communication unit 19, such as network card, modem, wireless transceiver, etc. Communication unit 19 allows electronic device 720 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0093] Processor 11 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. Processor 11 performs the various methods described above, such as a visual processing-based record audio recognition and playback method.

[0094] In some embodiments, the visual processing-based record audio recognition and playback method can be implemented as a computer program tangibly contained in a computer-readable storage medium, such as storage unit 18. In some embodiments, part or all of the computer program can be loaded and / or installed on electronic device 720 via ROM 12 and / or communication unit 19. When the computer program is loaded into RAM 13 and executed by processor 11, one or more steps of the visual processing-based record audio recognition and playback method described above can be performed. Alternatively, in other embodiments, processor 11 can be configured to perform the visual processing-based record audio recognition and playback method by any other suitable means (e.g., by means of firmware).

[0095] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0096] Computer programs used to implement the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when executed by the processor, the computer programs cause the functions / operations specified in the flowcharts and / or block diagrams to be performed. The computer programs may be executed entirely on a machine, partially on a machine, or as a standalone software package, partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0097] In the context of this invention, a computer-readable storage medium can be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, apparatus, or device. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination thereof. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, RAM, ROM, erasable programmable read-only memory (EPROM), optical fibers, compact disc read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0098] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device for displaying information to the user (e.g., a cathode ray tube (CRT) or liquid crystal display (LCD) monitor); and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0099] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as data servers), or middleware components (e.g., application servers), or frontend components (e.g., user computers with graphical user interfaces or web browsers through which users can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., communication networks). Examples of communication networks include local area networks (LANs), wide area networks (WANs), blockchain networks, and the Internet.

[0100] A computing system can include clients and servers. Clients and servers are generally located far apart and typically interact through communication networks. The client-server relationship is created by computer programs running on the respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or cloud host, which is a hosting product within the cloud computing service system. It addresses the shortcomings of traditional physical hosts and Virtual Private Servers (VPS) in terms of management difficulty and weak business scalability.

[0101] It should be understood that the various forms of processes shown above can be used, with steps reordered, added, or deleted. For example, the steps described in this invention can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this invention can be achieved, and this is not limited herein.

[0102] The specific embodiments described above do not constitute a limitation on the scope of protection of this invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this invention should be included within the scope of protection of this invention.

[0103] This invention also provides a computer program product, including a computer program that, when executed by a processor, implements the record audio recognition and playback method based on visual processing as provided in any embodiment of this application.

[0104] In implementing the computer program product, computer program code for performing the operations of this invention can be written in one or more programming languages ​​or a combination thereof. Programming languages ​​include object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as C or similar languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including LANs or WANs—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0105] It should be noted that in the embodiments of this application, certain software, components, models and other existing solutions in the industry may be mentioned. These should be regarded as exemplary and are only intended to illustrate the feasibility of implementing the technical solution of this application. However, they do not mean that the solution has been or necessarily used.

[0106] Note that the above description is merely a preferred embodiment of the present invention and the technical principles employed. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and various obvious changes, readjustments, and substitutions can be made without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in detail through the above embodiments, the present invention is not limited to the above embodiments, and may include many other equivalent embodiments without departing from the concept of the present invention, the scope of which is determined by the scope of the appended claims.

Claims

1. A method for recognizing and playing record audio based on visual processing, characterized in that, Used in an electronic device that includes an image acquisition device, the image acquisition device being movable relative to a record; The record audio recognition and playback method includes: Based on the record information associated with audio playback, determine the image acquisition parameters when the image acquisition device acquires images of the record; The image acquisition device acquires the audio track images of the record based on the image acquisition parameters, and determines the overlapping area between adjacent frame audio track images according to the image acquisition parameters. Based on the pixel length of the overlapping region and the audio waveform data of the adjacent audio track images, the audio waveform data of the overlapping region is corrected to obtain the target audio waveform data of the record in visual processing. Play the record audio based on the target audio waveform data.

2. The method according to claim 1, characterized in that, The step of determining the image acquisition parameters when the image acquisition device acquires images of the record based on the record information associated with audio playback includes: The timing of the image acquisition device's capture, its movement speed, and the size of the captured audio track image are determined based on the record's track radius, audio duration, and record rotation speed.

3. The method according to claim 2, characterized in that, The process of determining the shooting timing, movement speed, and captured audio track image size of the image acquisition device based on the record's track radius, audio duration, and record rotation speed includes: The radial velocity of the record is determined based on the record's track radius and audio duration; and the radial velocity is used as the moving speed of the image acquisition device when it moves from the outside to the inside of the record's track. The period of one revolution of the record is determined based on the record's rotation speed; and the time taken for each degree of rotation of the record is determined based on the said period. The rotation angle of the record per unit time is determined based on the time taken for each degree of rotation; the rotation angle is used as the shooting time of the image acquisition device; The rotation length when the record rotates one degree is determined based on the track radius, and the track movement length is determined based on the rotation length and the rotation angle; the size of the track image captured by the image acquisition device is determined based on the track movement length.

4. The method according to claim 3, characterized in that, Based on the record information associated with audio playback, the image acquisition parameters for the image acquisition device to acquire images from the record are determined, including: The record pitch is determined based on the radial velocity and the period. The real-time radius of the image acquisition device is determined based on the record rotation speed, the record pitch, and the track radius.

5. The method according to claim 1, characterized in that, Determining the overlapping region between adjacent audio track images based on the image acquisition parameters includes: The moving distance of the image acquisition device between adjacent audio track images is determined based on the image acquisition parameters. The pixel displacement between adjacent audio track images is determined based on the physical length of a single pixel in the audio track image and the moving distance. The pixel length of the overlapping area between adjacent audio track images is determined based on the image length of the audio track image and the pixel displacement.

6. The method according to claim 5, characterized in that, Determining the pixel length of the overlapping region between adjacent audio track images based on the image length of the audio track image and the pixel displacement includes: The target pixel displacement is obtained by correcting the pixel displacement in the overlapping area based on mechanical errors. Based on the audio waveform data of the previous frame audio track image and the audio waveform data of the next frame audio track image in adjacent audio track images, correlation calculation is performed with the region corresponding to the target pixel displacement as the search space. The pixel displacement of the target pixel corresponding to the maximum correlation value in the region is taken as the actual pixel displacement between adjacent audio track images; The pixel length of the overlapping area between adjacent audio track images is determined based on the image length of the audio track image and the actual pixel displacement.

7. The method according to claim 5, characterized in that, Based on the pixel length of the overlapping region and the audio waveform data of adjacent audio track images, the audio waveform data of the overlapping region is corrected to obtain the target audio waveform data of the record in visual processing, including: The audio waveform weights at each position are determined based on the pixel length of the overlapping region and the pixel length at each position within the overlapping region. Based on the audio waveform data of the previous frame and the next frame of the adjacent audio track images, as well as the audio waveform weights at each position, the audio waveform data at each position in the overlapping area is determined, thus obtaining the target audio waveform data of the record in visual processing.

8. The method according to any one of claims 1 to 7, characterized in that, Playing record audio based on the target audio waveform data includes: The movement angle of the image acquisition device at each position in each frame of the audio track image is determined according to the image acquisition parameters. Based on the record angular velocity and the movement angle in the record information, determine the audio playback time of the record at each position in each frame of the audio track image; The displacement information in the target audio waveform data is mapped according to the audio playback time at each position in each frame of the audio track image to obtain the audio time domain signal; The audio time-domain signal is used to calculate the derivative with respect to time to obtain the audio playback speed signal, and the record audio is played according to the audio playback speed signal.

9. The method according to claim 8, characterized in that, After mapping the displacement information in the target audio waveform data according to the audio playback time at each position in each frame of the audio track image to obtain the audio time-domain signal, the method further includes: The audio time-domain signal is smoothed and then updated.

10. The method according to any one of claims 1 to 7, characterized in that, Before correcting the audio waveform data of the overlapping region based on the pixel length of the overlapping region and the audio waveform data of adjacent audio track images, the method further includes: Extract the inner curve and outer curve of the audio track from the audio track image to obtain the audio track waveform at each position in the audio track image; Based on the pixel length at each position in the audio track image and the image acquisition parameters, determine the arc length along the audio track at each position; The audio waveform data of the audio track image is determined based on the arc length at each position in the audio track image and the audio track waveform.

11. An electronic device, characterized in that, The electronic device includes: An image acquisition device, which is movable relative to the record; At least one processor; and a memory communicatively connected to said at least one processor; wherein, The memory stores a computer program executable by the at least one processor, which is executed by the at least one processor to enable the at least one processor to perform the visual processing-based record audio recognition and playback method according to any one of claims 1-10.

12. A record audio recognition and playback system, characterized in that, It includes a turntable and the electronic device of claim 11, the turntable being used to carry and drive the record to rotate.

13. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions that, when executed by a processor, implement the record audio recognition and playback method based on visual processing as described in any one of claims 1-10.

14. A computer program product, characterized in that, The computer program product includes a computer program that, when executed by a processor, implements the record audio recognition and playback method based on visual processing according to any one of claims 1-10.

Images