Data processing method, electronic device, system, vehicle, medium, and program

Abstract

The invention discloses a data processing method, an electronic device, a system, a vehicle, a medium and a product, and is applied to the technical field of computers. The data processing method is applied to the controller and comprises the steps of obtaining data of at least two interfaces; and analyzing each piece of data, and storing each piece of data in the target region according to the target sequence. According to the technical scheme, the data of the at least two interfaces are correspondingly stored in the target area in a software mode so as to be synthesized into the corresponding target information, so that the process of synthesizing related hardware is omitted, the performance requirement on the hardware is low, and the production cost is reduced.

Description

Technical Field

[0001] The present application belongs to the field of computer technology, and in particular relates to a data processing method, an electronic device, a data acquisition system, a vehicle, a non-transitory computer-readable storage medium, and a computer program product. Background Art

[0002] During the driving process of the vehicle, in order to facilitate users to understand the situation around the vehicle in real time, by combining the data of multiple cameras into one frame and displaying it at a certain frame rate, users can see a continuous real-time panoramic image of the vehicle body, thereby improving driving safety and convenience.

[0003] The traditional method uses related hardware to synthesize the data of multiple data acquisition devices into one input, and then gives it to the electronic device for processing. The hardware of this method is powerful and can automatically splice, but it is costly.

[0004] As competition in the vehicle market becomes increasingly fierce, how to reduce production costs while maintaining overall data processing performance is one of the issues that urgently needs to be addressed. Summary of the Invention

[0005] The present application aims to address at least one of the technical problems existing in the prior art. To this end, the present application proposes a data processing method, an electronic device, a vehicle, a non-transitory computer-readable storage medium, and a computer program product, which can realize the synthesis of multiple frames of target information with synchronized acquisition time into a single frame of target information through software, thereby eliminating the related hardware synthesis process, reducing hardware performance requirements, and thus reducing production costs.

[0006] In a first aspect, the present application provides a data processing method, which includes acquiring data from at least two interfaces; parsing each of the data, and storing each of the data in a target area according to a target order.

[0007] In a second aspect, the present application provides an electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the above-mentioned data processing method when executing the program.

[0008] In a third aspect, the present application provides a data acquisition system, comprising a plurality of data acquisition devices and the above-mentioned electronic device.

[0009] In a fourth aspect, the present application provides a vehicle comprising the above-mentioned electronic device or the above-mentioned data acquisition system.

[0010] In a fifth aspect, the present application provides a non-transitory computer-readable storage medium having a computer program stored thereon, which implements the above-mentioned data processing method when executed by a processor.

[0011] In a sixth aspect, the present application provides a computer program product, comprising a computer program, which implements the above-mentioned data processing method when executed by a processor.

[0012] The data processing method, electronic device, data acquisition system, vehicle, non-transitory computer-readable storage medium, and computer program product provided in the embodiments of the present application parse each data through software and store it in a target area in a target order to synthesize corresponding target information. This eliminates the process of synthesizing target information with related hardware, reduces hardware performance requirements, and thus reduces production costs.

[0013] Additional aspects and advantages of the embodiments of the present application will be given in part in the description below, and in part will become obvious from the description below, or will be learned through practice of the embodiments of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:

[0015] Figure 1 This is an application scenario diagram of the data processing method provided in the embodiment of the present application;

[0016] Figure 2 This is a first flow chart of the data processing method provided in an embodiment of the present application;

[0017] Figure 3 This is a second flow chart of the data processing method provided in an embodiment of the present application;

[0018] Figure 4 3 is a schematic diagram of a third flow chart of the data processing method provided in an embodiment of the present application;

[0019] Figure 5 4 is a schematic diagram of a fourth flow chart of a data processing method provided in an embodiment of the present application;

[0020] Figure 6 5 is a schematic diagram of a fifth flow chart of a data processing method provided in an embodiment of the present application;

[0021] Figure 7 6 is a schematic diagram of a sixth flow chart of a data processing method provided in an embodiment of the present application;

[0022] Figure 8 This is a seventh flow chart of the data processing method provided in an embodiment of the present application;

[0023] Figure 9 This is an eighth flow chart of the data processing method provided in an embodiment of the present application;

[0024] Figure 10 This is a ninth flow chart of the data processing method provided in an embodiment of the present application;

[0025] Figure 11 This is a tenth flow chart of the data processing method provided in an embodiment of the present application;

[0026] Figure 12 is a module diagram of a data processing device provided in an embodiment of the present application;

[0027] Figure 13 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;

[0028] Figure 14 It is a structural diagram of the data acquisition system provided in an embodiment of the present application;

[0029] Figure 15 It is a schematic structural diagram of a vehicle provided in an embodiment of the present application. DETAILED DESCRIPTION

[0030] The following describes embodiments of the present application in detail. Examples of the embodiments of the present application are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present application, and should not be understood as limiting the present application.

[0031] For ease of understanding, the following first introduces the technical background and application scenarios of this application:

[0032] Panoramic vehicle technology uses multiple data acquisition devices installed on the vehicle to collect environmental information around the vehicle, process it, and then combine it to provide the driver with environmental information about the vehicle's surroundings. For example, by using multiple cameras working together, panoramic vehicle technology can eliminate the many blind spots that exist in traditional driving, allowing the driver to promptly detect surrounding obstacles, pedestrians, or other vehicles, effectively avoiding collisions caused by restricted vision.

[0033] Traditional data processing methods use a deserializer to automatically stitch together data collected by multiple cameras, synthesizing the data into a single channel and outputting it to an electronic device for subsequent processing. This method uses hardware-based deserializers to achieve the stitching function, resulting in high cost and high performance requirements for subsequent electronic devices, further increasing production costs.

[0034] The data processing method provided by this application implements a splicing function at the software level. By parsing the data in the interface, relevant information recorded in the data can be obtained. Based on the relevant information, the target order and target area to be stored for each data can be determined. Then, each data is stored in the corresponding target area according to the corresponding target order. In this way, data from at least two interfaces are spliced during storage through software, avoiding the need for related hardware to complete the splicing process, reducing hardware performance requirements, and thus reducing production costs.

[0035] See also Figure 1 , Figure 1 1 is an application scenario diagram of a data processing method provided in an embodiment of the present application. The application scenario provided in the present application includes a vehicle 100, which includes multiple data acquisition devices 10, multiple serializers 11, a deserializer 20, and a controller 30. The data processing method provided in the present application is executed by the controller 30.

[0036] The data acquisition device 10 is a device for collecting environmental information around the vehicle. Figure 1 It is shown as 4 by way of example, but it can be 2, 3, etc. The data acquisition device 10 includes a device capable of collecting environmental information, such as a camera or a radar, but this embodiment of the present application does not limit this.

[0037] For example, multiple cameras (usually four) are installed in the front, rear, left, and right sides of the vehicle, respectively, to collect image information around the vehicle. These image data are stored in the corresponding memory through various steps of the data processing method to complete the stitching. In subsequent extraction applications, they can be displayed as panoramic images, which can help the driver better understand the situation around the vehicle.

[0038] The serializer 11 is a device that converts parallel data into serial data for transmission. It is connected one-to-one with the data acquisition device 10. It is used to achieve high-speed data transmission, adapt to different interface standards, and improve signal interference resistance. The serializer 11 is used to convert the target information of the data acquisition device into a data format compatible with the deserializer 20, such as a data format that meets the FPD-Link3 protocol or the GSML protocol, and then transmit more target information to the deserializer per unit time.

[0039] Among them, the deserializer 20 is an electronic device used to improve the efficiency of data transmission. It mainly converts serial data into parallel data and can also generate information to be added to the data to be transmitted. One end of the deserializer 20 is connected to each serializer 11, and data is transmitted between the two using a transmission protocol such as FPD-Link3 or GMSL. The deserializer 20 is also used to broadcast a frame synchronization signal to each serializer 11 to ensure the time consistency of the image of the target information output by each data acquisition device 10. Optionally, the deserializer 20 can be a general deserializer, a dedicated deserializer, a multi-channel deserializer, etc., which is not limited in this embodiment of the present application.

[0040] Among them, the controller 30 is a device with data processing capabilities. The controller 30 is connected to the deserializer 20, and information is transmitted between the two using the MIPI CSI-2 transmission protocol. Optionally, FPD-Link3 or GMSL can also be used for information transmission. The controller 30 is also used to generate a frame synchronization signal and transmit it to the deserializer 20. The controller 30 includes multiple interfaces 31 and direct memory access (DMA) channels 32. The interfaces 31, DMA channels 32 and data acquisition device 10 correspond one to one. The interface 31 is used to acquire, process and forward the collected data transmitted by the deserializer 20, and the DMA channel 32 is used to receive and forward the data transmitted by the corresponding interface 31.

[0041] Optionally, the interface 31 may be a raw data interface (RDI) or the like, which is not limited in the embodiment of the present application.

[0042] The number of interfaces 31 of the controller 30 is greater than or equal to the number of data acquisition devices 10, and the number of DMA channels 32 is greater than or equal to the number of data acquisition devices 10. The high-performance interfaces 31 and DMA channels 32 correspond one-to-one to the data acquisition devices 10 to improve data transmission efficiency.

[0043] Optionally, the controller 30 may be a device including a system on chip (SoC) such as Qualcomm or MediaTek (MTK), which is not limited in the embodiment of the present application.

[0044] Based on the introduction of the above-mentioned related scenarios, the embodiment of the present application provides a data processing method, which is described in detail below:

[0045] See also Figure 2 A data processing method provided in an embodiment of the present application is implemented by steps 011 and 012, which are described in detail below.

[0046] Step 011: Acquire data of at least two interfaces;

[0047] Step 012: parse each data and store each data in the target area according to the target order.

[0048] Among them, the target order is the storage order preset based on demand.

[0049] The target area is the memory space used to store data obtained by the interface.

[0050] Specifically, data to be processed is stored in at least two related interfaces. By parsing the data in the interfaces, relevant information recorded in the data can be obtained. Based on the relevant information, the target order and target storage area of each data can be determined. Then, each data is stored in the corresponding target area according to the corresponding target order. In this way, data from at least two interfaces is spliced during storage through software, avoiding the need for related hardware to complete the splicing operation, reducing hardware performance requirements, and thus reducing production costs.

[0051] In some embodiments, see Figure 3 Optionally, step 011 includes:

[0052] Step 0111: Obtain image data output by at least two data acquisition devices through a deserializer, wherein the at least two data acquisition devices correspond one-to-one to the at least two interfaces.

[0053] Specifically, the data includes image data. The deserializer can convert serial data into parallel data. Obtaining the image data output by the data acquisition device through the deserializer can improve the efficiency of data transmission. A single data acquisition device is difficult to fully describe the environmental information of the vehicle. Usually, multiple (at least two) data acquisition devices are used to obtain environmental information, and then splicing is performed to help the driver and passengers fully understand the surrounding environment. The one-to-one correspondence between the data acquisition device and the interface can improve the orderliness of the data and avoid data confusion.

[0054] In some embodiments, see Figure 4 Optionally, step 0111 includes:

[0055] Step 01111: sending a frame synchronization signal to a serializer corresponding to each data acquisition device through the deserializer, so that the frame synchronization signal is sent to the corresponding data acquisition device through the serializer;

[0056] Step 01112: Obtain, through the deserializer, the time-synchronized image data output by the corresponding data acquisition device for the frame synchronization signal transmitted by each serializer.

[0057] The frame synchronization signal is used to synchronize data frames, ensuring the correct synchronization and timing relationship between frames during data transmission or processing. The frame synchronization signal can be generated by a controller.

[0058] Specifically, the controller generates a frame synchronization signal and transmits the frame synchronization signal to the deserializer for broadcasting. Each serializer obtains and forwards the frame synchronization signal to the corresponding data acquisition device. The data acquisition device that obtains the frame synchronization signal collects the environmental data of the corresponding time and synchronously outputs the multi-frame target information synchronized with the collection time to the serializer. The serializer converts the obtained data into a format that meets the relevant transmission protocol, and then converts the parallel data into serial data, and finally sends it to the deserializer.

[0059] Optionally, a frame synchronization signal may be generated by the deserializer and broadcast.

[0060] In some embodiments, see Figure 5 Optionally, step 012 includes:

[0061] Step 0121: Determine the virtual channel index of the data of each interface based on the packet header information in the data of each interface;

[0062] Step 0122: Determine the target order according to the virtual channel index, and store the data of each interface into the target area according to the target order.

[0063] The data includes header information and target information. The header information is generated by the deserializer based on the received target information. The target information is data collected by various data acquisition devices containing environmental information, including image data.

[0064] The packet header includes a virtual channel index. A virtual channel index is information used to point to a corresponding virtual channel. A virtual channel is a logical channel that uses logical partitioning and multiplexing techniques to enable independent transmission and interaction between target information and electronic devices over an IoT communication connection. This includes a DMA channel.

[0065] Specifically, the target information about environmental information collected by the data acquisition device is combined with the header information to form the data. After receiving the target information from each (at least two) data acquisition device, the deserializer generates the corresponding header information for each target information component based on the data acquisition device corresponding to the target information. The deserializer then transmits the data to the controller's interface for subsequent data parsing and transmission.

[0066] According to the virtual channel index in each packet header information, the target order and target area of the data can be determined accordingly, and then the data of each interface can be stored in the corresponding target area. The various target information can be spliced into a frame of target information, which can reflect the surrounding environment of the vehicle at the time of the frame corresponding to the target information.

[0067] Optionally, the packet header information may also be generated by a corresponding signal processor within the data acquisition device. For example, the packet header information of the target information of a camera may be generated by an image signal processor (ISP) of the camera.

[0068] The target information is converted into a data format that meets the corresponding transmission protocol (such as FPD-Link3 or GSML) by the serializer corresponding to the data acquisition device, and then sent to the deserializer. The deserializer parses and extracts the target data of the transmission protocol, adds the generated packet header information to the target information, and combines it into data. The deserializer then converts the format of each data into the data format of the transmission protocol of the corresponding electronic device (such as MIPI-CSI2).

[0069] In some embodiments, if the transmission protocol between the data acquisition device and the deserializer is different from the transmission protocol between the deserializer and the controller, the deserializer needs to first decode the target information transmitted from the data acquisition device to the deserializer, and then transcode it into a data format that meets the corresponding transmission protocol before transmitting it to the electronic device.

[0070] In this way, it can be ensured that each frame of target information is corresponding data, thereby improving the accuracy of data processing.

[0071] In some embodiments, see Figure 6 Optionally, step 012 further includes:

[0072] Step 0123: Based on the packet header information in the data of each interface, determine the virtual channel index and data type of the data of each interface;

[0073] Step 0124: Determine the address offset corresponding to the data of each interface based on the virtual channel index and data type;

[0074] Step 0125: Based on the address offset, store the data received by each interface into the target area respectively.

[0075] The data type refers to the type and nature of the environmental data acquired by the data acquisition device.

[0076] The address offset refers to the length of the storage space away from the first segment of the memory required to store the target information in the memory of the corresponding target information.

[0077] Specifically, after each data is transmitted into the interface through the deserializer, it is first decoded and converted from data that conforms to the transmission protocol between the deserializer and the interface to a commonly used data format (for example, if the target information is captured by a camera, the data format is converted to a commonly used image format). The virtual channel index and data type of each data item are obtained based on the packet header information in the decoded data.

[0078] The address offset of the virtual channel corresponding to the data can be calculated based on the virtual channel index and data type. Based on the address offset of each data, each frame of target information can be stored in the corresponding target area. By offsetting the address of each frame of target information based on the corresponding address offset, conflicts between data can be avoided. When the memory corresponding to the target area is filled with the corresponding target information, the splicing is complete.

[0079] Optionally, data is not limited to horizontally arranging the corresponding target information; it can be arranged in any manner to more flexibly meet application requirements. For example, if the target information is camera data and the number is 4, the individual target information can be arranged horizontally, and when used, it can be displayed as a horizontal continuous splicing of the photos taken by each camera at a certain moment. Alternatively, the individual target information can be arranged in a 2*2 grid format, so that when used, the photos taken by each camera at a certain moment are displayed in a 2*2 format, which is better displayed on the display device, thereby increasing the flexibility of target information display.

[0080] Optionally, the data acquisition device collects 10 copies of target information after acquiring the frame synchronization signal and starting to collect. The deserializer then transmits the target information collected by the data acquisition device corresponding to interface A to interface A in sequence, and then transmits the corresponding target information to interfaces B, C, and D in sequence. There are 10 corresponding target information. The first copy of the target information in each interface is spliced into a frame of target information, and the second to tenth copies are spliced in sequence. The principle is similar and will not be repeated here.

[0081] In this way, the target information is spliced in the controller, which reduces the execution pressure and performance of hardware such as the deserializer, reduces the cost of the deserializer, and thus reduces the overall production cost of the vehicle.

[0082] In some embodiments, see Figure 7 Optionally, step 0124 includes:

[0083] Step 01241: Based on the virtual channel index, data format, and data width, determine the address offset corresponding to the data of each interface.

[0084] The data format refers to the format of the target data collected by the data acquisition device.

[0085] The data width refers to the width of the target data collected by the data acquisition device.

[0086] Specifically, the data type includes data format and data width. The corresponding virtual channel can be determined according to the virtual channel index of each data, and the DMA channel corresponds to each interface one by one. Based on the virtual channel index, data format and data width, the address offset of the virtual channel corresponding to the data can be accurately calculated. For example, the virtual channel index in the header information of the data is 3, the data type is an image data type, the color encoding format is YUV422, and the number of pixels contained in the horizontal direction of the image data is 1920 bytes, then the address offset = 1920 (number of pixels) * 2 (one pixel in YUV422 occupies 2 bytes) * 3 (virtual channel index) = 11520.

[0087] In some embodiments, see Figure 8 Optionally, step 0125 includes:

[0088] Step 01251: Based on the address offset, the data received by each interface is stored in the target area through the DMA channel corresponding to each interface.

[0089] Specifically, the interfaces correspond to the DMA channels one by one. After each DMA channel applies to the relevant components in the controller (i.e., the CPU) for bus control, it will copy the data of the corresponding interface to store it in the corresponding memory, and offset the storage address of the data according to the address offset corresponding to each interface, so that the data of each interface is stored in the corresponding target area, thereby completing the splicing.

[0090] In some embodiments, see Figure 9 The data processing method also includes step 013, which is described in detail below.

[0091] Step 013: Based on the storage capacity required for the data received by each interface, apply for a target area from the memory.

[0092] The storage capacity required for data is determined based on the type and amount of data.

[0093] Specifically, different data types and amounts require different storage capacities, and the storage space must provide sufficient storage capacity to accommodate each target information. The required storage capacity can be determined based on the data type and amount contained in the packet header information. A target area in memory with a corresponding storage capacity (or greater than the corresponding storage capacity) must be provided based on the storage capacity of the data received by each interface to facilitate subsequent retrieval of the data in memory for application.

[0094] In some embodiments, see Figure 10Optionally, step 012 further includes:

[0095] Step 0126: parse the target information in the data of each interface, and store the target information in the data of each interface into the target area.

[0096] Specifically, the target information included in the data is to be subsequently extracted and applied, and the header information in the data has no effect on the subsequent extraction, display, etc. Therefore, after decoding the acquired data and calculating the interface, storage capacity, and address offset corresponding to the target information, the header information in the target information can be deleted, and the remaining target information can be stored in the corresponding target area; or after storing the entire data in the corresponding DMA channel, the header information can be deleted, and then the target information can be stored in the corresponding target area to complete the splicing.

[0097] In this way, the storage space resources of the controller are saved and the transmission efficiency is improved.

[0098] In some embodiments, see Figure 11 The data processing method also includes step 014, which is described in detail below.

[0099] Step 014: Generate a panoramic image based on the camera data.

[0100] Specifically, the data acquisition device includes a camera, and the target information collected by the camera includes camera data. The controller acquires multiple frames of camera data synchronized with the acquisition time, stitches them together, and stores them in the memory corresponding to the target information. When a panoramic display is required on the vehicle, the target information in the memory is extracted and converted into a panoramic image. The panoramic image corresponding to the target information is displayed on the vehicle's display device. This allows users to promptly understand the vehicle's surrounding conditions at the time corresponding to the target information, enhancing driving safety and improving the user's driving experience.

[0101] According to the method described in the above embodiment, the present application embodiment further provides a data processing device 200 for executing the steps in the above data processing method. Figure 12 , Figure 12 : is a module diagram of a data processing device 200 provided in an embodiment of the present application. The data processing device 200 includes:

[0102] An acquisition module 201 is configured to acquire data from at least two interfaces;

[0103] The processing module 202 is used to parse the data of each interface and store the data of each interface into the target area according to the target order.

[0104] It should be noted that the specific details of each module unit in the above-mentioned data processing device have been described in detail in the embodiment of the above-mentioned data processing method and will not be repeated here.

[0105] In the embodiments of the present application, the term "module" or "unit" refers to a computer program or a part of a computer program that has a predetermined function and works together with other related parts to achieve a predetermined goal, and can be implemented in whole or in part by using software, hardware (such as processing circuits or memories) or a combination thereof. Similarly, a processor (or multiple processors or memories) can be used to implement one or more modules or units. In addition, each module or unit can be part of an overall module or unit that includes the function of the module or unit.

[0106] In some embodiments, the data processing device in the embodiments of the present application can be implemented in hardware, such as an electronic device, or a component in an electronic device, such as an integrated circuit or a chip; the data processing device can also be implemented in software, such as as an application installed in an electronic device.

[0107] In some embodiments, see Figure 13 , Figure 13 3 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Electronic device 300 includes a processor 301 and a memory 302. Memory 302 stores a computer program 303 that is executable on processor 301. When executed by processor 301, program 303 implements the various processes of the aforementioned data processing method embodiment and achieves the same technical effects. To avoid repetition, these are not described here.

[0108] The present application also provides a data acquisition system. Figure 14 , Figure 14 4 is a structural diagram of a data acquisition system provided in an embodiment of the present application. The data acquisition system 400 includes a plurality of data acquisition devices 410 ( Figure 10 4) and the aforementioned electronic device 300. Multiple data acquisition devices 410 are used to acquire environmental information around the target information acquisition system. When executed, the electronic device 300 can implement each process of the embodiment of the above-mentioned data processing method and achieve the same technical effect. To avoid repetition, they are not described here.

[0109] The present application also provides a vehicle, which includes the electronic device 300 or the data acquisition system 400. In some embodiments, see Figure 15 , Figure 15is a schematic diagram of the structure of a vehicle provided in an embodiment of the present application. Vehicle 500 includes a data acquisition system 400. When executed, the electronic device 300 in the data acquisition system 400 can implement each process of the aforementioned data processing method embodiment and achieve the same technical effects. To avoid repetition, these steps are not described here.

[0110] An embodiment of the present application also provides a non-transitory computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the various processes of the embodiment of the above-mentioned data processing method are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0111] The processor may be the processor in the electronic device in the above embodiment. The computer readable storage medium may be a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0112] Computer-readable media may include computer storage media and communication media. Computer storage media include volatile and non-volatile, removable and non-removable media implemented by any method or technology for storing information such as computer-readable instructions, data structures, program modules or other data. Computer storage media include RAM, ROM, Erasable Programmable Read-Only Memory (EPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), flash memory or other solid-state memory technology, CD-ROM, Digital Versatile Disc (DVD) or other optical storage, tape cassettes, magnetic tape, disk storage or other magnetic storage devices. Of course, those skilled in the art will appreciate that computer storage media are not limited to the above.

[0113] The present application also provides a computer program product, including a computer program, which, when executed by a processor, implements the aforementioned data processing method. The processor may be a processor in the electronic device described in the aforementioned embodiment. When executed by the processor, the computer program implements each of the processes of the aforementioned data processing method embodiment, achieving the same technical effects. To avoid repetition, these processes are not described here.

[0114] It is understandable that in the specific implementation of this application, data related to user identity or characteristics is involved. When the above embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions.

[0115] In the description of this specification, the reference terms "certain embodiments", "in an example", "exemplarily", etc. mean that the specific features, structures, materials or characteristics described in conjunction with the embodiments or examples are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, unless they are mutually inconsistent.

[0116] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, segment or portion of code comprising one or more executable instructions for implementing the steps of a specific logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may be performed out of the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by those skilled in the art to which the embodiments of the present application belong.

[0117] Although the embodiments of the present application have been shown and described, those skilled in the art will appreciate that various changes, modifications, substitutions, and variations may be made to the embodiments without departing from the principles and intent of the present application, and that the scope of the present application is defined by the claims and their equivalents.

Claims

1. A data processing method, characterized in that: Applicable to controllers, including: Get data from at least two interfaces; The data of each interface is parsed, and the data of each interface is stored in a target area according to a target order.

2. The data processing method according to claim 1, wherein: The acquiring of data from at least two interfaces includes: Image data output by at least two data acquisition devices is acquired through a deserializer, wherein the at least two data acquisition devices correspond one-to-one to the at least two interfaces.

3. The data processing method according to claim 2, characterized in that: The method of obtaining image data output by at least two data acquisition devices through a deserializer includes: Sending a frame synchronization signal to a serializer corresponding to each of the data acquisition devices through the deserializer, so as to send the frame synchronization signal to the corresponding data acquisition device through the serializer; The deserializer obtains the time-synchronized image data output by the corresponding data acquisition device for the frame synchronization signal transmitted by each serializer.

4. The data processing method according to claim 2, wherein: The deserializer communicates with the controller via the MIPI CSI-2 protocol.

5. The data processing method according to claim 1, wherein: The parsing of the data of each interface and storing the data of each interface in a target area in a target order includes: Determining a virtual channel index of the data of each interface based on packet header information in the data of each interface; The target order is determined according to the virtual channel index, and the data of each interface is stored in the target area according to the target order.

6. The data processing method according to claim 1, wherein: The parsing of the data of each interface and storing the data of each interface in a target area in a target order includes: Determining the virtual channel index and data type of the data of each interface based on the header information in the data of each interface; Determining an address offset corresponding to the data of each of the interfaces based on the virtual channel index and the data type; Based on the address offset, the data received by each interface is stored in the target area respectively.

7. The data processing method according to claim 6, characterized in that: The data type includes a data format and a data width; and determining an address offset corresponding to data of each interface based on the virtual channel index and the data type includes: An address offset corresponding to the data of each interface is determined based on the virtual channel index, the data format, and the data width.

8. The data processing method according to claim 6, characterized in that: The storing the data received by each interface into the target area based on the address offset includes: Based on the address offset, the data received by each interface is stored in the target area through the DMA channel corresponding to each interface.

9. The data processing method according to any one of claims 1 to 8, characterized in that: Before storing the data of each interface in the target area in a target order, the method includes: Based on the storage capacity required by the data received by each interface, the target area is requested from the memory.

10. The data processing method according to any one of claims 1 to 8, characterized in that: The storage capacity required for the data is determined based on the data type and data amount of the data.

11. The data processing method according to any one of claims 5 to 8, characterized in that: The parsing of the data of each interface and storing the data of each interface in a target area in a target order further includes: The target information in the data of each of the interfaces is parsed and stored in the target area.

12. The data processing method according to claim 1, wherein: The interface includes a raw dump interface.

13. The data processing method according to claim 1, wherein: The data includes camera data, and the method further includes: Based on the camera data, a panoramic image is generated.

14. An electronic device, characterized in that: The method comprises a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the data processing method according to any one of claims 1 to 13 is implemented.

15. A data acquisition system, characterized in that: The device comprises a plurality of data acquisition devices and the electronic device according to claim 14. 16 . A vehicle comprising the electronic device according to claim 14 or the data acquisition system according to claim 15 .

17. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the data processing method according to any one of claims 1 to 13 is implemented.

18. A computer program product, characterized in that The method comprises a computer program, which implements the data processing method according to any one of claims 1 to 13 when the computer program is executed by a processor.

Images