Intelligent driving image data playing method and system
By optimizing data packaging methods, transcoding mechanisms and cache management strategies, the problems of low efficiency and insufficient real-time processing of multi-sensor data in intelligent driving systems are solved, and efficient data management and playback control are achieved.
Patent Information
- Application Number
- CN202411940772.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-26
- Publication Date
- 2025-05-06
AI Technical Summary
In intelligent driving systems, the processing efficiency of multi-sensor data is low and the real-time performance is insufficient, resulting in waste of resources and complex data management.
It provides a method and system for playing intelligent driving image data. By optimizing data packaging method, multi-format compatible transcoding mechanism, efficient cache management strategy and flexible data playback control, the problems of low data processing efficiency and insufficient real-time performance are solved.
It improves the processing efficiency and real-time nature of multi-sensor data in intelligent driving systems, reduces resource waste, and realizes efficient data management and playback control.
Smart Images
Figure CN119946032A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of intelligent driving technology, and in particular to a method and system for playing intelligent driving image data. Background Art
[0002] At present, with the development of intelligent driving technology, the demand for comprehensive processing capabilities of various sensor data is constantly increasing. In the intelligent driving system, in order to realize the vehicle's environmental perception and driving decision-making, it is usually necessary to collect and process data from multiple sensors, such as camera image data, lidar point cloud data, ultrasonic radar signal data and CAN (Controller Area Network) signal data. These data not only need to be collected in real time, but also need to be packaged in a specific format to facilitate subsequent storage, processing and transmission.
[0003] In the scenario of intelligent driving, the amount of data collected is extremely large, especially image data, which is not only large in volume but also has a variety of encoding formats, such as OpenCV's mat format or the video encoding standard h.265. This places higher demands on data storage efficiency, transmission bandwidth, and subsequent processing. In addition, the packaging and management of data needs to meet the requirements of efficiency and real-time performance. Especially when it comes to image data playback or other real-time operations, how to quickly parse, classify, and process data from packaged files becomes an important technical issue. Summary of the invention
[0004] Based on this, it is necessary to provide a method and system for playing intelligent driving image data to address the above technical issues.
[0005] In a first aspect, a method for playing intelligent driving image data is provided, the method being applied to a web terminal, the method comprising:
[0006] Send a data query request for the target recording file to the background service program;
[0007] Receive a signal data list corresponding to the target packet recording file sent by the background service program;
[0008] receiving an image data list sent by a background service program, and classifying the image data to be played in the image data list according to signal categories;
[0009] storing the to-be-played image data in a play list corresponding to the signal category in the order of timestamps;
[0010] Receive the selection result of the target signal category and the target playback mode input by the user;
[0011] If the image data to be played exists in the play list corresponding to the target signal category, the data is played according to the target play mode;
[0012] If the to-be-played image data does not exist in the play list corresponding to the marker signal category, a data request is sent to the background service program.
[0013] As an optional implementation, the method further includes:
[0014] Receiving a cache directory cleaning instruction sent by the user;
[0015] Based on the cache directory cleaning instruction, a cache directory cleaning request is sent to the background service program.
[0016] In a second aspect, a method for playing intelligent driving image data is provided, the method being applied to a background service program, the method comprising:
[0017] Receive data query requests for target recording files sent by users through the web terminal;
[0018] Accessing the target recording package file and generating a signal data list corresponding to the target recording package file;
[0019] The signal data list is sent to the web end, and data cache preprocessing is asynchronously initiated at the same time.
[0020] As an optional implementation manner, the initiating data cache preprocessing includes:
[0021] If a cache file corresponding to the target package file is found in the preset cache directory, the image data list in the cache file is read and sent to the web end;
[0022] If the cache file corresponding to the target packet recording file is not found in the cache directory, then the data packets corresponding to the signal data list are read one by one according to the timestamps;
[0023] Convert the data packet into a format to obtain original image data, and save the original image data into an image data list;
[0024] Transcoding the original image data in the image data list to obtain image data to be played;
[0025] Sending the image data list that has completed transcoding to the web end;
[0026] The image data list is stored as a cache file and stored in the cache directory.
[0027] As an optional implementation manner, the transcoding the original image data in the image data list includes:
[0028] According to the encoding method of the original image data, the original image data is transcoded using a data transcoding method corresponding to the encoding method.
[0029] As an optional implementation, the method further includes:
[0030] In a case where the web end does not have the target signal data, receiving a data request sent by the web end;
[0031] If the data cache preprocessing is not completed, a waiting message is sent to the web end.
[0032] As an optional implementation, the method further includes:
[0033] Receiving a cache directory cleanup request sent by the web client;
[0034] Based on the cache directory cleanup request, cache files in the cache directory are deleted.
[0035] In a third aspect, a method for playing intelligent driving image data is provided, the method being applied to an intelligent driving domain controller, the method comprising:
[0036] Collecting raw image data;
[0037] The original image data is packaged into a recording file according to the timestamp and a preset data packaging format.
[0038] As an optional implementation, the original image data includes image signal data, laser radar point cloud signal data, ultrasonic radar signal data and CAN signal data.
[0039] In a fourth aspect, a system for playing intelligent driving image data is provided, the system comprising the web terminal described in any one of the first aspect, the background service program described in any one of the second aspect, and the intelligent driving domain controller described in any one of the third aspect.
[0040] The present application provides a method and system for playing image data of intelligent driving. The technical solution provided by the embodiment of the present application brings at least the following beneficial effects: In the first aspect, the method is applied to a web terminal, and the method includes: sending a data query request for a target recording package file to a background service program; receiving a signal data list corresponding to the target recording package file sent by the background service program; receiving an image data list sent by the background service program, and classifying the image data to be played in the image data list according to the signal category; storing the image data to be played in a play list corresponding to the signal category in the order of timestamps; receiving the selection result of the target signal category and the target playback mode input by the user; if the image data to be played exists in the play list corresponding to the target signal category, playing the data according to the target playback mode; if the image data to be played does not exist in the play list corresponding to the target signal category, sending a data request to the background service program. In the second aspect, the method is applied to a background service program, and the method includes: receiving a data query request for a target recording package file sent by a user through a web terminal; accessing the target recording package file and generating a signal data list corresponding to the target recording package file; sending the signal data list to the web terminal, and asynchronously initiating data cache preprocessing at the same time. In the third aspect, the method is applied to an intelligent driving domain controller, and the method includes: collecting raw image data; and encapsulating the raw image data into a recording package file according to a timestamp and a preset data encapsulation format. The embodiment of the present application solves the problems of low efficiency, lack of real-time performance, and waste of resources in multi-sensor data processing in the prior art through optimized data encapsulation, multi-format compatible transcoding mechanism, efficient cache management strategy, and flexible data playback control, and has significant technical advancement and practical value.
[0041] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS
[0042] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0043] Figure 1 A schematic diagram of the structure of a system for playing intelligent driving image data provided in an embodiment of the present application;
[0044] Figure 2A flowchart of a method for playing intelligent driving image data applied to a web terminal provided in an embodiment of the present application;
[0045] Figure 3 A flowchart of another method for playing intelligent driving image data applied to a web terminal provided in an embodiment of the present application;
[0046] Figure 4 A flowchart of a method for playing intelligent driving image data applied to a background service program provided in an embodiment of the present application;
[0047] Figure 5 A flowchart of another method for playing intelligent driving image data applied to a background service program provided in an embodiment of the present application;
[0048] Figure 6 A flowchart of a method for playing intelligent driving image data applied to an intelligent driving domain controller provided in an embodiment of the present application;
[0049] Figure 7 A schematic diagram of the structure of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0050] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0051] The method for playing the intelligent driving image data provided in the embodiment of the present application can be applied to the system for playing the intelligent driving image data. Figure 1 As shown, the system includes a web terminal 110, a background service program 120 and an intelligent driving domain controller 130. The intelligent driving domain controller 130 and the background service program 120 can be connected through a network protocol (such as HTTP or FTP), and the background service program can directly access the recorded package files stored in the intelligent driving domain controller. The background service program 120 and the web terminal 110 can realize real-time interaction and transmission of data through a WebSocket long connection. The intelligent driving domain controller 130 can complete image data acquisition and packaging, and the background service program 120 can complete data parsing, cache management and data transmission. The web terminal 110 can realize user interaction, data playback and control functions.
[0052] The following will describe in detail a method for playing intelligent driving image data provided by an embodiment of the present application in conjunction with a specific implementation manner. Figure 2 A flowchart of a method for playing intelligent driving image data applied to a web terminal provided in an embodiment of the present application is shown in FIG. Figure 2As shown, the method is applied to the web side, and the specific steps are as follows:
[0053] Step 201, sending a data query request for a target recording file to a background service program.
[0054] In implementation, the user can open the recording package file list on the web end, and select a recording package file as a target recording package file for viewing. At this time, the web end can send a data query request for the target recording package file to the background service program, such as calling the background service program interface.
[0055] Step 202: Receive a signal data list corresponding to a target recording file sent by a background service program.
[0056] In implementation, the web end can receive the signal data list corresponding to the target recording package file through a long websocket link with the background service program, so that the user can select the data corresponding to the target signal category and the target playback method in the signal data list. For example: the web end receives the signal data list sent by the background service program through WebSocket and displays the list on the page. Each signal category in the signal data list is displayed in the form of an independent label, including the category name (such as "image signal data" or "lidar point cloud signal data", "forward camera image signal data" or "surround view camera image signal data"), the number of signals, and the acquisition time range and other information.
[0057] Step 203: receiving the image data list sent by the background service program, and classifying the image data to be played in the image data list according to the signal category.
[0058] In implementation, the web end can store the image data to be played in the image data list into corresponding playlists according to the signal category. For example, the front view camera data is stored in the "front view camera" playlist, and the surround view camera data is stored in the "surround view camera" playlist.
[0059] Step 204: store the image data to be played into a play list corresponding to the signal category in the order of timestamps.
[0060] In implementation, the web end can arrange the image data to be played in each playlist in the order of timestamps to ensure time synchronization and continuity during playback.
[0061] Step 205: receiving the target signal category selection result and the target playback mode input by the user.
[0062] In implementation, the user can select the target signal category and the corresponding playback mode (such as "play frame by frame in chronological order") in the web interface according to actual needs. The web can also record the user's selection and prepare to play the image data to be played corresponding to the selected signal category.
[0063] Step 206: If the play list corresponding to the target signal category contains image data to be played, the data is played in the target playback mode.
[0064] During implementation, the user can input the selection result of the target signal category and the target playback mode in the interactive interface of the web terminal, and send a data playback instruction to the web terminal. If the web terminal detects that there is image data to be played in the playback list corresponding to the target signal category, the data can be played according to the target playback mode.
[0065] Step 207: If the image data to be played does not exist in the play list corresponding to the marker signal category, a data request is sent to the background service program.
[0066] In implementation, if the web end detects that there is no to-be-played image data in the playlist corresponding to the target signal category, the web end sends a data request to the background service program.
[0067] As an optional implementation, Figure 3 A flowchart of another method for playing intelligent driving image data applied to a web terminal provided in an embodiment of the present application is shown in FIG. Figure 3 As shown, the specific steps are as follows:
[0068] Step 301, receiving a cache directory cleaning instruction sent by a user.
[0069] In implementation, the web end may provide a user operation interface (such as a button or menu item) to allow the user to initiate a cache cleanup operation. For example, when the user clicks a cache cleanup button, the web end may capture the operation event and generate a cache directory cleanup instruction.
[0070] Step 302: Based on the cache directory cleaning instruction, a cache directory cleaning request is sent to the background service program.
[0071] In implementation, the web end can send a cache cleaning instruction to the background service program through the WebSocket or HTTP interface, so that after receiving the cleaning request, the background service program deletes the cache files in the cache directory to release storage space.
[0072] As an optional implementation, the web side can receive the cleanup completion message returned by the background service program and prompt the user on the interactive interface, for example: "Cache cleanup successful." If the cleanup fails (such as insufficient permissions or file locks), the web side can also prompt a corresponding error message.
[0073] The embodiment of the present application also provides a method for playing intelligent driving image data, which is applied to a background service program. Figure 4 A flowchart of a method for playing intelligent driving image data applied to a background service program provided in an embodiment of the present application is shown in FIG. Figure 4 As shown, the specific steps are as follows:
[0074] Step 401: receiving a data query request for a target recording file sent by a user through a web terminal.
[0075] In implementation, after the user selects a target recording package file on the web side, the web side generates a data query request and sends it to the background service program via HTTP or WebSocket protocol. The background service program receives and parses the data query request to determine the path and related information of the target recording package file. For example: after the user selects the target recording package file, the web side sends a request via WebSocket, the background service program listens to the WebSocket message, receives and parses the user's request, and determines the name of the target recording package file selected by the user by parsing the name field of the target recording package file.
[0076] Step 402: access the target recording package file and generate a signal data list corresponding to the target recording package file.
[0077] During implementation, the background service program accesses the target recording package file, extracts various types of signal data recorded in the target recording package file (such as image signal data and lidar point cloud signal data, etc.), and generates a signal data list based on signal category for subsequent playback or processing.
[0078] As an optional implementation, there are two ways for the background service program to access the recorded package file: one is that after the intelligent driving domain controller collects the original image data and generates the recorded package file, the recorded package file is sent to the background service program through the network for storage. The background service program directly accesses the recorded package file from the local storage or specified directory. The other is that after the intelligent driving domain controller generates the recorded package file, it stores it on a local storage device (such as embedded storage or external storage). The background service program directly accesses the recorded package file from the intelligent driving domain controller through a network protocol (such as HTTP, FTP or other custom protocols).
[0079] Step 403: Send the signal data list to the web end, and asynchronously initiate data cache preprocessing at the same time.
[0080] In implementation, the background service program can send the generated signal data list to the web end through WebSocket, and at the same time start an asynchronous thread or task to cache pre-process the data to reduce the delay of subsequent access.
[0081] As an optional implementation, Figure 5 A flowchart of another method for playing intelligent driving image data applied to a background service program provided in an embodiment of the present application is shown in FIG. Figure 5 As shown, the specific steps of initiating data cache preprocessing in step 403 are as follows:
[0082] Step 501: If a cache file corresponding to the target package file is found in the preset cache directory, the image data list in the cache file is read and sent to the web end.
[0083] In implementation, the background service program searches for the corresponding cache file in the cache directory according to the file name of the target recording package file (for example,<file_name> .json). If found, the image data list in the cache file is directly read to avoid repeated decoding of data and improve processing efficiency. After reading, the data is sent to the web end through WebSocket.
[0084] Step 502: If the cache file corresponding to the target packet recording file is not found in the cache directory, the data packets corresponding to the signal data list are read one by one according to the timestamps.
[0085] In implementation, in the absence of a cache file, the background service program can read data packets one by one (each segment of data in the packet recording file) according to the timestamp recorded in the signal data list.
[0086] Step 503: convert the format of the data packet to obtain original image data, and save the original image data into an image data list.
[0087] In implementation, each data packet read by the background service program may store signal data in a specific format (such as protobuf, compression encoding, etc.), which needs to be decoded or decompressed to extract the original image data and store it in the image data list in the memory. For example: for data serialized by protobuf, protobuf deserialization can be performed to obtain the original image data, and the original image data can be saved in the image data list.
[0088] Step 504: transcode the original image data in the image data list to obtain image data to be played.
[0089] In practice, the image data collected by the intelligent driving domain controller include the front-view camera, surround-view camera, surround-view stitching bird's-eye view, etc. The encoding methods of the image data may be various (such as OpenCV's mat format or H.265 video encoding). In order to ensure that the web end can play the image correctly, the original image data needs to be uniformly transcoded into a specified format (such as Base64 encoding). Image data encodings include OpenCV mat and h.265. For different image encoding methods, the background service program can use OpenCV and ffpmeg to convert the image data, convert it into base64 encoding, and store the base64 encoding value in the corresponding image data.
[0090] Step 505: Send the transcoded image data list to the web end.
[0091] In implementation, the background service program can send the transcoded image data list to the web end through WebSocket for the user to choose to play.
[0092] Step 506: Store the image data list as a cache file and store it in the cache directory.
[0093] In implementation, the background service program can serialize the generated image data list in JSON format and save it as a cache file. The next time the same recording file is accessed, the cache data can be directly used to improve efficiency.
[0094] As an optional implementation, the background service program can set a global variable and monitor the data cache preprocessing process by changing the value of the global variable. For example: the background service program initiates image data preprocessing, sets the global variable isPreProcessing = true, and after completing the data cache preprocessing, sets the global variable isPreProcessing = false. The background service program can check whether isPreProcessing is true. If it is true, it means that the background service program already has other processes asynchronously processing data requests.
[0095] As an optional implementation, the specific method of transcoding the original image data in the image data list to obtain the image data to be played in step 504 is: according to the encoding method of the original image data, the original image data is transcoded using a data transcoding method corresponding to the encoding method.
[0096] In practice, the original image data may be encoded in different formats (such as JPEG, PNG, H.265, etc.). The background service program can parse its encoding method through the data header or metadata field to select the corresponding transcoding method. For example, JPEG and PNG formats can be processed by the image library, while video encoding (such as H.265) can use FFmpeg or other video decoding tools.
[0097] As an optional implementation, when the web end has no target signal data, a data request sent by the web end is received. If the data cache preprocessing is not completed, a waiting message is sent to the web end.
[0098] In implementation, when the web end tries to play the image data corresponding to the target signal category, if the web end does not have the image data, the web end can send a data request to the background service program. The background service program can determine whether the data cache preprocessing is completed to avoid repeated processing and waste of resources. If the preprocessing is not completed, the background service program should promptly feedback the waiting information to the web end to inform the user that the system is processing. For example: After the background service program receives the data request from the web end, it first checks the value of the global variable isPreProcessing of the preprocessing status. If isPreProcessing is true, it means that other processes are performing data cache preprocessing, and then a waiting message is sent to the web end to allow the user to wait patiently. If isPreProcessing is false, it means that the background service program has not found the cache file in the cache directory, and the data cache preprocessing process performs cache processing. After the background service program completes the data cache, it notifies the web end through WebSocket that the data can be played.
[0099] As an optional implementation, a cache directory cleanup request sent by the web end is received. Based on the cache directory cleanup request, cache files in the cache directory are deleted.
[0100] In practice, cache files may occupy a large amount of storage space or become unusable due to data anomalies during long-term use. Therefore, the web end can provide a cache cleaning function to delete unnecessary cache files in a timely manner, free up storage space, and ensure stable operation of the system. When the web end sends a cache directory cleaning request, the background service program can locate the cache directory based on the cache directory cleaning request and delete the cache files therein.
[0101] The embodiment of the present application also provides a method for playing intelligent driving image data, which is applied to an intelligent driving domain controller. Figure 6 A flowchart of a method for playing intelligent driving image data applied to an intelligent driving domain controller provided in an embodiment of the present application is shown in FIG. Figure 6 As shown, the specific steps are as follows:
[0102] Step 601, collecting original image data.
[0103] In practice, raw image data is the core data source for the operation of the intelligent driving domain controller, including image information from multiple sensors, such as the front-view camera, surround-view camera, etc. These sensors convert the external environment into digital signals for system processing through real-time acquisition, providing a basis for subsequent data processing and playback. The accuracy of the data and the consistency of the timestamp need to be ensured during acquisition in order to achieve subsequent synchronous playback. For example: the intelligent driving domain controller connects multiple sensors, such as the front-view camera and the surround-view camera, and initializes the acquisition module. Each camera acquires raw image data at a fixed frame rate and adds a timestamp.
[0104] Step 602: encapsulate the original image data into a recording file according to the timestamp and the preset data encapsulation format.
[0105] In practice, in order to improve data transmission efficiency and support multiple accesses, the original image data can be packaged according to a unified data encapsulation format (such as protobuf) and sorted by timestamp to form a structured package file. The package file can efficiently store a variety of sensor data (images, point clouds, etc.) to ensure data consistency and integrity.
[0106] As an optional implementation, the original image data includes image signal data, laser radar point cloud signal data, ultrasonic radar signal data and CAN signal data.
[0107] The embodiment of the present application provides a method for playing image data of intelligent driving. In the first aspect, the method is applied to the web end, and the method includes: sending a data query request for a target recording package file to a background service program; receiving a signal data list corresponding to the target recording package file sent by the background service program; receiving an image data list sent by the background service program, and classifying the image data to be played in the image data list according to the signal category; storing the image data to be played in the play list corresponding to the signal category in the order of timestamps; receiving the selection result of the target signal category and the target playback mode input by the user; if the image data to be played exists in the play list corresponding to the target signal category, the data is played according to the target playback mode; if the image data to be played does not exist in the play list corresponding to the target signal category, a data request is sent to the background service program. In the second aspect, the method is applied to the background service program, and the method includes: receiving a data query request for a target recording package file sent by a user through the web end; accessing the target recording package file and generating a signal data list corresponding to the target recording package file; sending the signal data list to the web end, and asynchronously initiating data cache preprocessing at the same time. In the third aspect, the method is applied to an intelligent driving domain controller, and the method includes: collecting raw image data; encapsulating the raw image data into a recording package file according to the timestamp and the preset data encapsulation format. The embodiment of the present application realizes efficient organization and management of data by sorting and encapsulating the timestamps of the raw image data by the intelligent driving domain controller, which is convenient for subsequent access and processing. At the same time, the background service program adopts a cache mechanism and an asynchronous preprocessing mode, which effectively reduces repeated calculations and improves data processing efficiency. For different image encoding formats (such as OpenCV mat and h.265), corresponding transcoding methods (OpenCV and FFmpeg) are adopted to achieve compatible processing of multiple formats, ensuring that the image data can be uniformly transcoded into a format suitable for playback, and enhancing the applicability of the system. Through the asynchronous image data preprocessing mechanism and WebSocket long link technology, the background service program can quickly respond to data requests from the web end, and immediately push the image data to the web end after the preprocessing is completed, which improves the real-time performance of data playback. Web users can freely select the target signal category and playback mode, and send data requests in real time according to playback requirements, realizing personalized and flexible data playback control and improving user experience. The cache directory is used to store the pre-processed image data list, which reduces repeated calculations and transcoding operations and improves the overall operating efficiency of the system. At the same time, a cache cleaning function is provided to effectively prevent cache space exhaustion or data anomalies, thereby enhancing the stability of the system. The signal data list and image data list parsed from the recording package file are classified and stored in the order of signal category and timestamp, which is convenient for rapid retrieval and management, and optimizes the organization of data playback.The intelligent driving domain controller, background service program and web terminal work together through clear task division and interactive protocols, forming an efficient data collection, processing and playback chain, ensuring the functional integrity and reliability of the overall system.
[0108] It should be understood that although Figures 2 to 6 The steps in the flowchart are shown in sequence as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified in this document, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. Moreover, Figures 2 to 6 At least part of the steps may include multiple steps or multiple stages. These steps or stages are not necessarily performed at the same time, but can be performed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed in turn or alternately with other steps or at least part of the steps or stages in other steps.
[0109] It can be understood that the same / similar parts between the various embodiments of the above method in this specification can refer to each other, and each embodiment focuses on the differences from other embodiments. For related points, please refer to the description of other method embodiments.
[0110] In one embodiment, a computer device is provided, such as Figure 7 As shown, it includes a memory and a processor, the memory stores a computer program that can be run on the processor, and the processor implements the method steps for playing the above-mentioned intelligent driving image data when executing the computer program.
[0111] In one embodiment, a computer-readable storage medium stores a computer program, which, when executed by a processor, implements the steps of the method for playing the above-mentioned intelligent driving image data.
[0112] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
[0113] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.
[0114] It should also be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for display, data for analysis, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties.
[0115] Each embodiment in this specification is described in a related manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.
[0116] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0117] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the attached claims.
Claims
1. A method for playing intelligent driving image data, characterized in that: The method is applied to a web terminal, and the method includes: Send a data query request for the target recording file to the background service program; Receive a signal data list corresponding to the target packet recording file sent by the background service program; receiving an image data list sent by a background service program, and classifying the image data to be played in the image data list according to signal categories; storing the to-be-played image data in a play list corresponding to the signal category in the order of timestamps; Receive the selection result of the target signal category and the target playback mode input by the user; If the image data to be played exists in the play list corresponding to the target signal category, the data is played according to the target play mode; If the to-be-played image data does not exist in the play list corresponding to the marker signal category, a data request is sent to the background service program.
2. The method according to claim 1, characterized in that The method further comprises: Receiving a cache directory cleaning instruction sent by the user; Based on the cache directory cleaning instruction, a cache directory cleaning request is sent to the background service program.
3. A method for playing intelligent driving image data, characterized in that: The method is applied to a background service program, and the method comprises: Receive data query requests for target recording files sent by users through the web terminal; Accessing the target recording package file and generating a signal data list corresponding to the target recording package file; The signal data list is sent to the web end, and data cache preprocessing is asynchronously initiated at the same time.
4. The method according to claim 3, characterized in that: The initiating data cache preprocessing includes: If a cache file corresponding to the target package file is found in the preset cache directory, the image data list in the cache file is read and sent to the web end; If the cache file corresponding to the target packet recording file is not found in the cache directory, then the data packets corresponding to the signal data list are read one by one according to the timestamps; Convert the data packet into a format to obtain original image data, and save the original image data into an image data list; Transcoding the original image data in the image data list to obtain image data to be played; Sending the image data list that has completed transcoding to the web end; The image data list is stored as a cache file and stored in the cache directory.
5. The method according to claim 4, characterized in that The transcoding of the original image data in the image data list includes: According to the encoding method of the original image data, the original image data is transcoded using a data transcoding method corresponding to the encoding method.
6. The method according to claim 3, characterized in that The method further comprises: In a case where the web end does not have the target signal data, receiving a data request sent by the web end; If the data cache preprocessing is not completed, a waiting message is sent to the web end.
7. The method according to claim 3, characterized in that The method further comprises: Receiving a cache directory cleanup request sent by the web client; Based on the cache directory cleanup request, cache files in the cache directory are deleted.
8. A method for playing intelligent driving image data, characterized in that: The method is applied to an intelligent driving domain controller, and the method comprises: Collecting raw image data; The original image data is packaged into a recording file according to the timestamp and a preset data packaging format.
9. The method according to claim 8, characterized in that The original image data includes image signal data, laser radar point cloud signal data, ultrasonic radar signal data and CAN signal data.
10. A system for playing intelligent driving image data, characterized in that: The system includes a web terminal as described in any one of claims 1-2, a background service program as described in any one of claims 3-7, and an intelligent driving domain controller as described in any one of claims 8-9.