Vehicle-mounted three-dimensional cyanine color sound application system, method and device and storage medium

Abstract

The embodiment of the invention provides a vehicle-mounted three-dimensional cyanine color sound application system, method and device and a storage medium, and the system comprises a basic resource module which is used for storing audio and video files and database files used by the application system; the basic data module is used for classifying the data of the basic resource module and performing table establishment management on the classified data so as to add, delete, modify and query the classified data; the business service module is used for providing all services related to the business at the back end, and the services at least comprise a cyanine talkback content auditing service, a cyanine talkback operation management service and a cyanine talkback transcoding service; and the vehicle-mounted cyanine color sound terminal module is used for requesting cyanine color sound video list data, presenting the requested data, providing a user click interaction function and playing a three-dimensional cyanine color sound video according to an audio and video file selected by a user, and can accurately describe the position, size, track, appearance time and duration of each sound in a vehicle-mounted system.

Description

Technical Field

[0001] The present application relates to the field of terminal application technology, and in particular to a vehicle-mounted three-dimensional sound application system, method, device and storage medium. Background Art

[0002] Dolby Atmos is an object-based audio technology that allows audio engineers to process sound as independent objects instead of relying solely on traditional channels. Each audio object has its own metadata, including position information, motion trajectory, and other properties. By controlling metadata, Dolby Atmos can ensure a consistent sound experience on home theater playback devices.

[0003] However, Dolby Atmos is an overseas technology, and China needs to independently develop an audio technology that is more advantageous than Dolby Atmos. Summary of the invention

[0004] The embodiments of the present application provide a vehicle-mounted three-dimensional sound application system, method, device and storage medium.

[0005] In a first aspect of an embodiment of the present application, a vehicle-mounted three-dimensional sound application system is provided, comprising:

[0006] Basic resource module, used to store audio and video files and database files used by the application system;

[0007] The basic data module is used to classify the data of the basic resource module and create tables for the classified data, so as to add, delete, modify and query the classified data;

[0008] The business service module is used to provide all business-related services at the back end, wherein the services include at least the Jingcaisheng content review service, Jingcaisheng operation management service and Jingcaisheng transcoding service;

[0009] The vehicle-mounted Jingcai audio terminal module is used to request Jingcai audio and video list data, present the requested data, provide user click interaction function, and play three-dimensional Jingcai audio and video according to the audio and video files selected by the user.

[0010] In an optional embodiment of the present application, the system also includes a Qingcai sound decoder interface encapsulation module, which is used to merge with a preset audio and video framework, decapsulate, decode, resample and render the audio and video files, and generate pulse code modulation data corresponding to the audio and video files.

[0011] In an optional embodiment of the present application, the system further includes a rendering and playing module, which is used to send the pulse code modulation data to the sound card system through the sound card driver interface for rendering and playing by the speaker.

[0012] In an optional embodiment of the present application, the system further includes a channel conversion module for converting the number of audio and video channels so that the number of audio and video channels is consistent with the number of channels supported by the application system.

[0013] In an optional embodiment of the present application, in a channel conversion module, when converting a first channel format into a second channel format and the number of the first channel format is greater than that of the second channel format, the channels with dispersed layout in the first channel format are kept unchanged, at least two channels with concentrated distribution in the first channel format are synthesized into one channel, and the data in each channel of the synthesized channel is taken as 1 / N for data fusion, wherein N is the number of channels synthesized into one channel, and the first channel format is different from the second channel format.

[0014] In an optional embodiment of the present application, the first channel format is one of 7.1 channels, 5.1.4 channels and 7.1.4 channels, and the second channel format is 5.1 channels or 7.1 channels.

[0015] In an optional embodiment of the present application, the system also includes a sound field focus setting module, which is used to calculate and obtain new data based on the preset three-dimensional parameters of each channel of the application system and the data of the corresponding channel extracted from the audio and video data, and is used to replace the preset three-dimensional parameters of each channel of the application system to achieve rendering of the spatial position.

[0016] A second aspect of the embodiment of the present application provides a vehicle-mounted three-dimensional sound application method, including:

[0017] Use the basic resource module to store audio, video and database files used by the application system;

[0018] Use the basic data module to classify the data of the basic resource module and create tables for the classified data to add, delete, modify and query the classified data;

[0019] The business service module is used to provide all business-related services in the backend, wherein the services include at least the Jingcaisheng content review service, the Jingcaisheng operation management service and the Jingcaisheng transcoding service;

[0020] The vehicle-mounted Jingcai audio terminal module is used to request the Jingcai audio and video list data, present the requested data, provide user click interaction function, and play three-dimensional Jingcai audio and video according to the audio and video files selected by the user.

[0021] In a third aspect of an embodiment of the present application, a computer device is provided, comprising: a memory and a processor, the memory storing a computer program, and the processor implementing the steps of the above-mentioned vehicle-mounted three-dimensional colorful sound application method when executing the computer program.

[0022] According to a fourth aspect of the embodiments of the present application, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps of the vehicle-mounted three-dimensional sound application method as described above are implemented.

[0023] The above technical solution provided by the embodiment of the present application has at least some or all of the following advantages compared with the prior art:

[0024] The vehicle-mounted three-dimensional Jingcai sound application system described in the embodiment of the present application includes a basic resource module for storing audio and video files and database files used by the application system; a basic data module for classifying the data of the basic resource module and building tables for the classified data to add, delete, modify and query the classified data; a business service module for providing all business-related services in the back end, wherein the services at least include Jingcai sound content review service, Jingcai sound operation management service and Jingcai sound transcoding service; a vehicle-mounted Jingcai sound terminal module for requesting Jingcai sound and video list data, presenting the requested data, providing user click interaction functions, and playing three-dimensional Jingcai sound and video according to the audio and video files selected by the user. Applying Jingcai sound to the vehicle-mounted system makes the positioning of audio objects in the system more accurate and flexible. Moreover, Jingcai sound is the first audio codec standard based on AI technology. The three-dimensional Jingcai sound encoding efficiency is high, and it can accurately describe the position, size, trajectory, occurrence time and duration of each sound in the vehicle-mounted system, providing higher flexibility and details. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0026] Figure 1 An architecture diagram of a vehicle-mounted 3D sound application system provided for one embodiment of the present application;

[0027] Figure 2 An architectural diagram of a player provided for one embodiment of the present application;

[0028] Figure 3 A timing diagram of a channel conversion module provided in one embodiment of the present application;

[0029] Figure 4 A schematic diagram of converting 7.1 channels to 5.1 channels provided in one embodiment of the present application;

[0030] Figure 5 A working principle diagram of a sound field focus setting module provided in one embodiment of the present application;

[0031] Figure 6 A schematic diagram of the computer device structure provided for one embodiment of the present application. DETAILED DESCRIPTION

[0032] In order to make the technical solutions and advantages in the embodiments of the present application more clearly understood, the exemplary embodiments of the present application are further described in detail below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present application, rather than an exhaustive list of all the embodiments. It should be noted that the embodiments in the present application and the features in the embodiments can be combined with each other without conflict.

[0033] See also Figure 1 The vehicle-mounted three-dimensional sound application system provided by the embodiment of the present application includes:

[0034] Basic resource module, used to store audio and video files and database files used by the application system;

[0035] The basic data module is used to classify the data of the basic resource module and create tables for the classified data, so as to add, delete, modify and query the classified data;

[0036] The business service module is used to provide all business-related services at the back end, wherein the services include at least the Jingcaisheng content review service, Jingcaisheng operation management service and Jingcaisheng transcoding service;

[0037] The vehicle-mounted Jingcai audio terminal module is used to request Jingcai audio and video list data, present the requested data, provide user click interaction function, and play three-dimensional Jingcai audio and video according to the audio and video files selected by the user.

[0038] In an optional embodiment of the present application, the data flow from the basic resource module to the basic data module is: the basic resource module serves as the data storage center of the system, which stores all original audio, video and database files. When new content is uploaded to the system, the content is first stored here. The basic data module then accesses these original data, performs classification and preliminary management work, such as establishing indexes and tables, so as to manage and query these data more efficiently. This process ensures that the data is transformed from its original form to a more structured form, laying the foundation for subsequent processing. The data flow from the basic data module to the business service module is: the data processed by the basic data module becomes easier to implement business logic. The business service module relies on these sorted data to perform more complex operations, such as content review, transcoding and operation management. This means that the functional implementation of the business service module, such as providing standard-compliant content to users, requires accurate and reliable data provided by the basic data module. The data flow from the business service module to the in-vehicle Jingcaisheng terminal module is: the data or service results processed by the business service module are displayed to the end user through the in-vehicle Jingcaisheng terminal module. The user interacts with the system through this terminal module, such as browsing available audio and video content and choosing to play. The vehicle terminal module feeds back the user's choice to the business service module, which provides corresponding content or services accordingly. This may include calling a transcoding service to ensure that the selected content is suitable for playback on a specific terminal. Closed loop of user interaction and data flow: The user triggers a series of data flows and service calls through the interaction of the vehicle Jingcaisheng terminal module. This forms a closed loop from the terminal module to the business service module, and then to the query or update of the possible basic data module. This closed loop ensures that user needs and behaviors can guide the system to provide corresponding services and content, and it also means that any part of the system is constantly updated and adjusted based on user interaction.

[0039] The in-vehicle 3D Jingcai Audio Application System of this application realizes the complete process from data storage to user interaction through carefully designed modules and clear data flow. Each module plays a specific role and interacts with other modules through clearly defined interfaces, jointly providing end users with a rich, efficient and personalized audio and video experience.

[0040] In an optional embodiment of the present application, Jingcai Sound is a three-dimensional sound coding and decoding technology independently developed in China. The in-vehicle three-dimensional Jingcai Sound application system of the present application is an in-vehicle multi-channel immersive sound application system based on this three-dimensional sound coding and decoding technology, which realizes the presentation of multi-channel audio content such as surround sound in the in-vehicle environment, the rendering output of multi-channel, multi-scene, and multi-mode sound programs, and the in-vehicle Jingcai Sound playback based on the cloud listening client. Simulate the prototype of the audio playback system in the in-vehicle environment, and realize the rendering output of multi-channel audio ADM (Audio Driver Model, a framework model for managing audio drivers) / Pulse Code Modulation (Pulse Code Modulation) encoded content to multi-channel speakers through metadata.

[0041] In an optional embodiment of the present application, in addition to storing audio and video files and database files used by the application system, the basic resource module also has functions such as caching information, including object storage OSS, cloud service cache ECS, in-memory cache ES, key-value database cache Redis, query cache MySql, network attached storage NAS, K8s storage, kernel cache GPU / CPU, page cache RocketMQ, etc.

[0042] In an optional embodiment of the present application, the classified data in the basic data module includes user data, information data, radio station data, rights and interests data, account data, order data, reporting data, etc.

[0043] In an optional embodiment of the present application, the business service module also provides business logic and systematic functional services, such as functional services of systems such as account systems and equity systems.

[0044] In an optional embodiment of the present application, the Jingcai audio application terminal module can be an in-vehicle application responsible for presentation, interaction and playback, etc. On the application terminal, the first layer is the network interface layer, which is responsible for requesting the Jingcai audio and video list data, the second layer is the user interface layer, which develops pages and corresponding components for presenting network data including audio and video, the third layer is the business logic interaction layer, which can provide user click interaction functions, and the fourth layer is the audio and video playback layer, which finally plays the three-dimensional Jingcai audio and video according to the resources selected by the user.

[0045] In an optional embodiment of the present application, the system further includes a cyan color sound decoder interface encapsulation module, which is used to merge with the preset audio and video framework, decapsulate, decode, resample and render the audio and video files, and generate pulse code modulation data (pcm data) corresponding to the audio and video files, wherein, Figure 1 As shown, the Jingcai sound decoder is Figure 1The audiovivid in cannot be played alone. There are many steps from audio and video file resources to broadcast sound, including decapsulation, decoding, resampling, rendering, etc. Most players are developed based on the audio and video framework ffmpeg. ffmpeg contains decapsulation, decoding, resampling, filter and other modules. If most players are to support the optimal solution of Jingcai sound, audiovivid needs to be integrated into ffmpeg. To achieve this goal, it is necessary to encapsulate the middle-layer interface of audiovivid according to the framework requirements of ffmpeg, so that the interface of ffmpeg can call the audiovivid decoder when calling the decoding interface. The two classes of audiovividParser (audiovivid syntax analyzer) and audiovividDecoder (audiovivid decoder) implement the unified interface of ffmpeg and specifically call the interface of audiovivid decoder to realize decoding.

[0046] In an optional embodiment of the present application, the system further includes a rendering and playing module, which is used to send the pulse code modulation data to the sound card system through the sound card driver interface for rendering and playing by the speaker.

[0047] like Figure 2As shown, the player includes a network transmission layer, a demultiplexing layer, a decoding layer, a digital signal processing layer, and a rendering layer. The network transmission layer includes protocol (communication protocol), file (computer file), http (application layer protocol), https (security version of application layer protocol), hls (streaming media network transmission protocol based on HTTP) and private (private network, private IP address, etc.). The demultiplexing layer includes format (standard format for storing and transmitting data), mp4 (multimedia container format), mp3 (audio compression format), flv (lightweight video container format), m4a (one of the standard formats of MPEG-4 audio) and mkv (open multimedia container format). The decoding layer includes video and audio. Video includes hardware decoding and software decoding. Among them, hardware decoding includes mediacodec (a low-level audio and video encoding and decoding framework provided by the Android platform) and videotoolbox (an audio and video processing framework on the iOS platform). Software decoding includes ffmpeg (open source audio and video processing tool). Audio includes audiovivid, etc. The rendering layer includes video and audio. Video includes OpenGL (open graphics library), and audio includes OpenSL. ES (cross-platform audio API) / AudioTrack (a class for managing and playing a single audio resource in the Android system) and AudioQueue (an audio processing framework provided by Apple on iOS and macOS platforms) / AudioUnit (audio processing unit).

[0048] In an optional embodiment of the present application, the system also includes a channel conversion module for converting the number of audio and video channels so that the number of audio and video channels is consistent with the number of channels supported by the application system. Since the number of channels of audio and video resources is not fixed, and the number of channels supported by different vehicle systems is also not fixed, a channel conversion function is required to convert the number of audio channels to adapt to the output requirements of the vehicle. The input channel number can be obtained in the decoding stage and recorded as input_channel. According to the system interface, it can try to detect from high to low according to the number of channels. When the maximum supported number of channels is detected, it is immediately returned and recorded as outout_channel. At present, the input and output channel numbers are known, and then the conversion interface is called to pass these two parameters and the pulse code modulation data of each frame into the interface. The interface obtains the passed-in parameters and selects the corresponding conversion implementation according to input_channel and outout_channel. It can realize 7.1 to 5.1, 5.1.4 to 7.1, 7.1.4 to 7.1, 5.1.4 to 5.1, etc. Among them, the timing diagram of the channel conversion module is as follows Figure 3 shown.

[0049] In an optional embodiment of the present application, in a channel conversion module, when converting a first channel format into a second channel format and the number of the first channel format is greater than that of the second channel format, the channels with dispersed layout in the first channel format are kept unchanged, at least two channels with concentrated distribution in the first channel format are synthesized into one channel, and the data in each channel of the synthesized channel is taken as 1 / N for data fusion, wherein N is the number of channels synthesized into one channel, and the first channel format is different from the second channel format.

[0050] In an optional embodiment of the present application, the first channel format is one of 7.1 channels, 5.1.4 channels and 7.1.4 channels, and the second channel format is 5.1 channels or 7.1 channels.

[0051] like Figure 4 As shown, the 7.1 channel to 5.1 channel conversion keeps the data of the first four channels unchanged. Channels 5 and 7 in the 7.1 channel are distributed on the left, so they are synthesized into one as the 5th channel in 5.1. Half of the data in each of these two channels are taken and added together for fusion.

[0052] In an optional embodiment of the present application, the system also includes a sound field focus setting module, which is used to calculate and obtain new data based on the preset three-dimensional parameters of each channel of the application system and the data of the corresponding channel extracted from the audio and video data, and is used to replace the preset three-dimensional parameters of each channel of the application system to achieve rendering of the spatial position. Among them, the principle of realizing the conversion of the sound field focus is: the ear can distinguish how the direction is distinguished according to the natural sounds around it. The reason why the ear can distinguish whether a sound is emitted from the left or the right is mainly because the same sound reaches the two ears in different orders and strengths. For example, if a sound is emitted from the left, the sound heard by the left ear is louder, clearer, and faster, while the sound heard by the right ear is delayed, because the sound needs to be reflected before entering the right ear, so the volume will be reduced and delayed. The same volume effect can be achieved by performing corresponding gain and delay on the data of each channel in the pulse code modulation data through an algorithm. The specific method is to perform preset three-dimensional parameters for each channel according to the environment inside the car, such as Figure 5As shown, the preset three-dimensional parameters of the first channel are {"azimuth":-30, "distance":1, "elevation":0}, and the data of the first channel is extracted from the pulse code modulation data. The data of the first channel in the pulse code modulation data and the three-dimensional parameters are calculated through a preset spatial algorithm (reference standard "Three-dimensional sound coding, decoding and rendering GY / T 363-2023" D.2.2 part) to replace the original data of the first channel in the three-dimensional parameters with the new data to achieve rendering of the spatial position.

[0053] It should be understood that, although the various steps in the flow chart are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear description in this article, the execution of these steps is not strictly limited in order, and these steps can be executed in other orders. Moreover, at least a portion of the steps in the figure may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these sub-steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a portion of the sub-steps or stages of other steps.

[0054] An embodiment of the present application provides a vehicle-mounted three-dimensional sound application method, including:

[0055] Use the basic resource module to store audio, video and database files used by the application system;

[0056] Use the basic data module to classify the data of the basic resource module and create tables for the classified data to add, delete, modify and query the classified data;

[0057] The business service module is used to provide all business-related services in the backend, wherein the services include at least the Jingcaisheng content review service, the Jingcaisheng operation management service and the Jingcaisheng transcoding service;

[0058] The vehicle-mounted Jingcai audio terminal module is used to request the Jingcai audio and video list data, present the requested data, provide user click interaction function, and play three-dimensional Jingcai audio and video according to the audio and video files selected by the user.

[0059] In an optional embodiment of the present application, the vehicle-mounted three-dimensional Jingcai sound application method also includes: using the Jingcai sound decoder interface encapsulation module to merge with the preset audio and video framework, decapsulating, decoding, resampling and rendering the audio and video files, and generating pulse code modulation data corresponding to the audio and video files.

[0060] In an optional embodiment of the present application, the vehicle-mounted three-dimensional colorful sound application method also includes: using the rendering and playback module to send the pulse code modulation data to the sound card system through the sound card driver interface to perform rendering and playback on the speaker.

[0061] In an optional embodiment of the present application, the vehicle-mounted three-dimensional colorful sound application method further includes: using a channel conversion module to convert the number of audio and video channels so that the number of audio and video channels is consistent with the number of channels supported by the application system.

[0062] In an optional embodiment of the present application, the vehicle-mounted three-dimensional colorful sound application method also includes: in a channel conversion module, when converting the first channel format to the second channel format and the number of the first channel format is greater than that of the second channel format, the channels with dispersed layout in the first channel format are kept unchanged, at least two channels with concentrated distribution in the first channel format are synthesized into one channel, and the data in each channel of the synthesized channel is taken as 1 / N for data fusion, wherein N is the number of channels synthesized into one channel, and the first channel format is different from the second channel format.

[0063] In an optional embodiment of the present application, the first channel format is one of 7.1 channels, 5.1.4 channels and 7.1.4 channels, and the second channel format is 5.1 channels or 7.1 channels.

[0064] In an optional embodiment of the present application, the vehicle-mounted three-dimensional colorful sound application method also includes: using the sound field focus setting module to calculate the preset three-dimensional parameters of each channel of the application system and the data of the corresponding channel extracted from the audio and video data to obtain new data, which is used to replace the preset three-dimensional parameters of each channel of the application system to achieve rendering of the spatial position.

[0065] For the specific limitations of the above method, please refer to the above limitations on the vehicle-mounted three-dimensional sound application device, which will not be repeated here.

[0066] In one embodiment, a computer device is provided, the internal structure diagram of which can be as follows: Figure 6As shown. The computer device includes a processor, a memory, a network interface and a database connected via a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store data. The network interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a vehicle-mounted three-dimensional sound application method as described above is implemented. It includes: a memory and a processor, the memory stores a computer program, and when the processor executes the computer program, any step in the vehicle-mounted three-dimensional sound application method as described above is implemented.

[0067] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, any step in the above-mentioned vehicle-mounted three-dimensional colorful sound application method can be implemented.

[0068] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0069] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0070] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0071] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0072] Although the preferred embodiments of the present application have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications falling within the scope of the present application.

[0073] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. A vehicle-mounted three-dimensional sound application system, characterized in that: include: Basic resource module, used to store audio and video files and database files used by the application system; The basic data module is used to classify the data of the basic resource module and create tables for the classified data, so as to add, delete, modify and query the classified data; The business service module is used to provide all business-related services at the back end, wherein the services include at least the Jingcaisheng content review service, Jingcaisheng operation management service and Jingcaisheng transcoding service; The vehicle-mounted Jingcai audio terminal module is used to request Jingcai audio and video list data, present the requested data, provide user click interaction function, and play three-dimensional Jingcai audio and video according to the audio and video files selected by the user.

2. The vehicle-mounted three-dimensional sound application system according to claim 1 is characterized in that: The system also includes a Qingcai sound decoder interface encapsulation module, which is used to merge with a preset audio and video framework, decapsulate, decode, resample and render the audio and video files, and generate pulse code modulation data corresponding to the audio and video files.

3. The vehicle-mounted three-dimensional sound application system according to claim 2 is characterized in that: The system also includes a rendering and playing module, which is used to send the pulse code modulation data to the sound card system through the sound card driver interface to perform rendering and playing by the speaker.

4. The vehicle-mounted three-dimensional sound application system according to claim 1 is characterized in that: The system also includes a channel conversion module for converting the number of audio and video channels so that the number of audio and video channels is consistent with the number of channels supported by the application system.

5. The vehicle-mounted three-dimensional sound application system according to claim 4 is characterized in that: In the channel conversion module, when converting a first channel format into a second channel format and the first channel format has a larger number than the second channel format, channels with dispersed layout in the first channel format are kept unchanged, at least two channels with concentrated distribution in the first channel format are synthesized into one channel, and data in each channel synthesized into one channel is taken as 1 / N for data fusion, wherein N is the number of channels synthesized into one channel, and the first channel format is different from the second channel format.

6. The vehicle-mounted three-dimensional sound application system according to claim 5 is characterized in that: The first channel format is one of 7.1 channels, 5.1.4 channels and 7.1.4 channels, and the second channel format is 5.1 channels or 7.1 channels.

7. The vehicle-mounted three-dimensional sound application system according to claim 1 is characterized in that: The system also includes a sound field focus setting module, which is used to calculate and obtain new data based on the preset three-dimensional parameters of each channel of the application system and the data of the corresponding channel extracted from the audio and video data, and is used to replace the preset three-dimensional parameters of each channel of the application system to achieve rendering of the spatial position.

8. A vehicle-mounted three-dimensional sound application method, characterized in that: include: Use the basic resource module to store audio, video and database files used by the application system; Use the basic data module to classify the data of the basic resource module and create tables for the classified data to add, delete, modify and query the classified data; The business service module is used to provide all business-related services in the backend, wherein the services at least include Jingcaisheng content review service, Jingcaisheng operation management service and Jingcaisheng transcoding service; The vehicle-mounted Jingcai audio terminal module is used to request the Jingcai audio and video list data, present the requested data, provide user click interaction function, and play three-dimensional Jingcai audio and video according to the audio and video files selected by the user.

9. A computer device comprising: It includes a memory and a processor, the memory stores a computer program, and is characterized in that when the processor executes the computer program, the steps of the vehicle-mounted three-dimensional colorful sound application method as described in claim 8 are implemented.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by the processor, the steps of the vehicle-mounted three-dimensional colorful sound application method as described in claim 8 are implemented.

Images