Data processing method, device and server

Abstract

The present invention provides a data processing method, relating to the technical field of computers, comprising: obtaining sensor parameters of a sensor group configured for a target vehicle; calculating the transmission and storage requirements of the target vehicle based on the sensor parameters; wherein the transmission and storage requirements include transmission rate requirements and storage memory requirements; determining a target transmission device identifier from candidate transmission device identifiers and a target storage device identifier from candidate storage device identifiers based on the transmission and storage requirements, so as to transmit environmental data collected by the sensor group to a data storage device corresponding to the target storage device identifier for storage via the data transmission device corresponding to the target transmission device identifier. The present invention can significantly improve the data transmission and storage rate, and can also avoid regional restrictions when storing environmental data, thereby better meeting the data transmission and storage requirements when the data volume is large.

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to a data processing method, device and server. Background Art

[0002] To address the "long tail" problem of data distribution in autonomous driving projects, autonomous driving and data closure are often combined. The scale and collection capabilities of autonomous driving scenario data influence the speed of autonomous driving development. In practical applications, because the real world is infinitely rich, extremely complex, unpredictable, and inexhaustible, sensors can be used to collect real-world data for use in autonomous driving projects. Related technologies propose using cloud servers to transmit and store collected data. During data transmission, to more accurately reproduce the real scene, as many sensors as possible are deployed to reduce or even eliminate blind spots. This results in a large amount of data to be transmitted, making the cloud server's transmission rate unable to meet data transmission requirements. Regarding data storage, cloud servers face regional restrictions when storing data, making it difficult for them to fully meet data storage requirements. Summary of the Invention

[0003] In view of this, the purpose of the present invention is to provide a data processing method, device and server, which can significantly improve the data transmission and storage rate, and avoid regional restrictions when storing environmental data, so as to better meet the data transmission and storage needs when the data volume is large.

[0004] In a first aspect, an embodiment of the present invention provides a data processing method, which is applied to a server, the server being configured with multiple candidate transmission device identifiers and candidate storage device identifiers, and the method comprising:

[0005] Obtain sensor parameters of the sensor group configured on the target vehicle;

[0006] Calculate the transmission and storage requirements of the target vehicle based on the sensor parameters; wherein the transmission and storage requirements include transmission rate requirements and storage memory requirements;

[0007] According to the transmission and storage requirements, the target transmission device identifier is determined from the candidate transmission device identifiers, and the target storage device identifier is determined from the candidate storage device identifiers, so that the environmental data collected by the sensor group is transmitted to the data storage device corresponding to the target storage device identifier for storage through the data transmission device corresponding to the target transmission device identifier.

[0008] In one embodiment, the sensor group includes a plurality of image acquisition devices; and the step of calculating the transmission storage requirements of the target vehicle based on the sensor parameters includes:

[0009] Calculate the memory occupied by a single frame image corresponding to each image acquisition device in the sensor group based on sensor parameters; wherein the sensor parameters include image size, image encoding rules and sampling frame rate;

[0010] Calculate the transmission rate requirement of the target vehicle based on the number of image acquisition devices and the memory occupied by a single-frame image.

[0011] In one embodiment, the step of calculating the memory occupied by a single-frame image corresponding to each image acquisition device in the sensor group according to the sensor parameters includes:

[0012] Determine the memory occupied by a single pixel according to image coding rules;

[0013] The product of the single-pixel memory and the image size is calculated to obtain the memory occupied by the single-frame image corresponding to each image acquisition device in the sensor group.

[0014] In one embodiment, the step of calculating the transmission rate requirement of the target vehicle based on the number of image acquisition devices and the memory occupied by a single frame image includes:

[0015] The transmission rate requirement of the target vehicle is obtained by calculating the product of the number of image sampling devices, the memory occupied by a single frame image, and the sampling frame rate.

[0016] In one embodiment, the step of calculating the transmission storage requirement of the target vehicle based on the sensor parameters further includes:

[0017] Calculate the target vehicle's storage memory requirements based on the transmission rate requirements and the preset acquisition period.

[0018] In one embodiment, the data storage device includes a disk array;

[0019] The step of determining the target storage device identifier from the candidate storage device identifiers includes:

[0020] Acquire a plurality of preset candidate disk array levels; wherein the candidate disk array levels are used to characterize the number of disks included in the disk array and the description of the disk performance;

[0021] determining a target disk array level from candidate disk array levels based on storage memory requirements;

[0022] A target storage device ID is determined from the candidate storage device IDs based on the target disk array level.

[0023] In one embodiment, the disk array corresponding to the target storage device identifier includes at least one primary disk, or the disk array corresponding to the target storage device identifier includes at least one primary disk and at least one spare disk.

[0024] In a second aspect, an embodiment of the present invention further provides a data processing device, which is applied to a server, and the server is configured with multiple candidate transmission device identifiers and candidate storage device identifiers, and the method includes:

[0025] A parameter acquisition module, which acquires the sensor parameters of the sensor group configured for the target vehicle;

[0026] A demand determination module calculates the transmission and storage requirements of the target vehicle based on the sensor parameters; wherein the transmission and storage requirements include transmission rate requirements and storage memory requirements;

[0027] The data storage module determines the target transmission device identifier from the candidate transmission device identifiers and the target storage device identifier from the candidate storage device identifiers according to the transmission and storage requirements, so as to transmit the environmental data collected by the sensor group to the data storage device corresponding to the target storage device identifier through the data transmission device corresponding to the target transmission device identifier for storage.

[0028] In a third aspect, an embodiment of the present invention further provides a server, comprising a processor and a memory, wherein the memory stores computer-executable instructions that can be executed by the processor, and the processor executes the computer-executable instructions to implement any one of the methods provided in the first aspect.

[0029] In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium, which stores computer-executable instructions. When the computer-executable instructions are called and executed by a processor, the computer-executable instructions prompt the processor to implement any one of the methods provided in the first aspect.

[0030] The embodiments of the present invention bring the following beneficial effects:

[0031] An embodiment of the present invention provides a data processing method, apparatus, and server, wherein the server is configured with multiple candidate transmission device identifiers and candidate storage device identifiers. The server first analyzes and calculates the sensor parameters of the sensor group configured for the target vehicle to determine the transmission and storage requirements of the target vehicle, and then selects the corresponding target transmission device identifier and target storage device identifier from the multiple candidate transmission device identifiers and candidate storage device identifiers based on the transmission and storage requirements, thereby performing data transmission and data storage on the environmental data collected by the sensor group. The above method can automatically select the target transmission device identifier and target storage device identifier that meet the transmission and storage rate requirements based on the sensor parameters. Compared with the related art, which realizes data transmission and storage through a cloud server with a lower transmission rate and regional restrictions, the embodiment of the present invention can select from multiple candidate transmission device identifiers and candidate storage device identifiers according to actual needs, thereby better balancing the data transmission and storage requirements and the data transmission and storage costs.

[0032] Other features and advantages of the present invention will be described in the following description, and in part will become apparent from the description, or understood by practicing the present invention. The purposes and other advantages of the present invention are realized and obtained by the structures particularly pointed out in the description, claims and drawings.

[0033] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, preferred embodiments are given below and described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] In order to more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the specific embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0035] Figure 1 A schematic diagram of the structure of a server provided in an embodiment of the present invention;

[0036] Figure 2 A flowchart of a data processing method provided by an embodiment of the present invention;

[0037] Figure 3 An architectural diagram of a data processing method provided by an embodiment of the present invention;

[0038] Figure 4 A schematic structural diagram of a target vehicle provided by an embodiment of the present invention;

[0039] Figure 5 A schematic flow chart of another data processing method provided by an embodiment of the present invention;

[0040] Figure 6 A schematic structural diagram of a data processing device provided by an embodiment of the present invention;

[0041] Figure 7 A schematic diagram of the structure of a server provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0042] To make the objectives, technical solutions, and advantages of the embodiments of the present invention more clear, the technical solutions of the present invention will be clearly and completely described below in conjunction with the embodiments. Obviously, the embodiments described are only part of the embodiments of the present invention, not all of them. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present invention without making any creative efforts shall fall within the scope of protection of the present invention.

[0043] Currently, autonomous driving engineering has been recognized as a task to solve the long tail problem of data distribution (Long Tail Effect). It usually combines autonomous driving with data closed loop, so as to upgrade the data-driven algorithm model through extreme situations (Corner Case) that may occur from time to time. In the era of artificial intelligence, data plays a cornerstone role. The scale and collection capabilities of autonomous driving scene data determine the development speed of autonomous driving capabilities. However, scenes in the real world are infinitely rich, extremely complex, unpredictable and inexhaustible, making it difficult to classify them using unified standards. Existing technologies mainly classify scene data sources through natural driving scenes, standard and regulatory test scenes, functional design test scenes, dangerous working condition test scenes and simulation test scenes.

[0044] Existing technology uses cloud servers for data storage. Theoretically, the maximum transmission rate of 2G network is 150Kbps, the maximum transmission rate of 3G network is 1-6Mbps, the maximum transmission rate of 4G network is 10-100Mbps, and the maximum transmission rate of 5G network is 10-20Gbps. In the case of large data volume (greater than 200M / S), only 5G network can meet the requirements. However, my country's 5G network has not yet achieved full regional coverage. Therefore, cloud storage is not suitable for large-scale data transmission and storage.

[0045] To facilitate understanding of this embodiment, a data processing method disclosed in an embodiment of the present invention is first described in detail. The method is applied to a server and is used to process sensor parameters of a sensor group configured for a target vehicle. To facilitate understanding of the server, an embodiment of the present invention provides a structural diagram of a server, as shown in FIG. Figure 1 As shown, the server is configured with multiple candidate transmission device identifiers and candidate storage device identifiers, wherein the candidate transmission device identifiers include identifiers corresponding to network ports representing multiple transmission rates, and the candidate storage device identifiers include identifiers corresponding to multiple RAID (Redundant Arrays of Independent Disks) levels.

[0046] based on Figure 1 The structural diagram of the server shown in FIG. 1 is a schematic diagram of the structure of the server shown in FIG. 1 , and the data processing method is described in detail in the embodiment of the present invention. Figure 2 The flowchart of a data processing method shown in FIG. 1 mainly includes the following steps S202 to S206:

[0047] Step S202, obtain the sensor parameters of the sensor group configured for the target vehicle. The sensor group may include at least one image acquisition device, and the image acquisition device may include a device with image acquisition function such as a camera. Each image acquisition device in the sensor group can be used to collect environmental data of the target vehicle's environment, and the environmental data may be in the form of an image or video. The sensor parameters include image size, image encoding rule, and sampling frame rate. Specifically, the image size is the width and height of the image; the image encoding rule is used to determine the memory of a single pixel. The memory occupied by a single pixel is different under different encoding rules. For example, when the image encoding rule is YUV420, 1 pixel occupies 12 bits (Binary Digit, bits) of memory; the sampling frame rate is the amount of environmental data collected by the sensor per unit time.

[0048] In one embodiment, the server can obtain sensor parameters through various methods, such as scanning a code or manually uploading. For example, each image acquisition device can be affixed with an identifier such as a barcode or QR code. A user can scan the identifier with a handheld terminal to read the sensor parameters associated with the image acquisition device. The handheld terminal then uploads the scanned sensor parameters to the server. Alternatively, the server can provide a parameter upload channel for the user to upload the sensor parameters to the server. Furthermore, the sensor parameters can include information such as the number of devices and the data acquisition cycle.

[0049] Step S204: Calculate the target vehicle's transmission and storage requirements based on the sensor parameters. The transmission and storage requirements include transmission rate requirements and storage memory requirements. The transmission rate requirement can be the minimum data transmission rate, while the storage memory requirements can include requirements for read and write speed, storage security, total data storage capacity, and portability.

[0050] In one embodiment, the memory occupied by a single pixel (i.e., the memory occupied by one image frame, measured in bits / frame) can be determined based on image encoding rules and image size. The image memory occupied per unit time can then be calculated based on the sampling frame rate and the memory occupied by a single pixel. This image memory occupied per unit time can serve as the minimum rate. Optionally, the required transmission rate can be greater than or equal to the minimum rate. In another embodiment, the required disk capacity and read / write speed can be further determined based on the number of devices, the data sampling period, and the image memory occupied per unit time. Furthermore, the storage memory requirements can be determined in conjunction with storage security.

[0051] In step S206, a target transmission device identifier is determined from the candidate transmission device identifiers, and a target storage device identifier is determined from the candidate storage device identifiers, respectively, based on the transmission and storage requirements. The environmental data collected by the sensor group is transmitted to the data storage device corresponding to the target storage device identifier via the data transmission device corresponding to the target transmission device identifier for storage. The data transmission device includes a network port with different transmission rates for local transmission and storage, and the data storage device includes a disk array. The disk array corresponding to the target storage device identifier includes at least one primary disk, or the disk array corresponding to the target storage device identifier includes at least one primary disk and at least one backup disk, for local storage of the collected environmental data and protection of the stored environmental data.

[0052] In one embodiment, the server is configured with multiple candidate transmission device identifiers and candidate storage device identifiers, and may also be configured with device parameters corresponding to each device, such as the transmission rate of each network port, the disk capacity of each disk array, the read and write speeds, etc., so as to select a target transmission device identifier that meets the above transmission rate requirements according to the transmission rate of each network port. For example, the target transmission device identifier corresponding to the network port whose transmission rate is higher than the minimum rate and closest to the minimum rate is selected from the candidate transmission device identifiers. In the subsequent data collection process, the network port corresponding to the identifier can be used to transmit environmental data. In addition, the target storage device identifier that meets the above storage memory requirements is selected according to the disk memory, read and write speeds, and storage security requirements of each disk array, so that the disk array corresponding to the identifier is used to store the environmental data transmitted by the network port.

[0053] The above-mentioned data processing method provided by the real-time example of the present invention automatically selects the target transmission device identifier and the target storage device identifier that meet the transmission and storage rate requirements according to the sensor parameters. It can select from multiple candidate transmission device identifiers and candidate storage device identifiers according to actual needs, thereby better balancing the data transmission and storage requirements and the data transmission and storage costs.

[0054] In practical applications, the above-mentioned transmission and storage requirements include transmission rate requirements and storage memory requirements. For ease of understanding, the embodiments of the present invention provide implementation methods for determining the transmission rate requirements and storage memory requirements, respectively, as shown in (1) to (2) below:

[0055] (1) For transmission rate requirements, please refer to steps 1 and 2 below:

[0056] Step 1: Calculate the memory occupied by a single-frame image corresponding to each image acquisition device in the sensor group based on sensor parameters. Sensor parameters include image size, image encoding rules, and sampling frame rate. In one embodiment, the memory occupied by a single-frame image can be determined by following steps 1.1 to 1.2:

[0057] Step 1.1: Determine the memory occupied by a single pixel according to the image coding rule. In one embodiment, a mapping relationship between the image coding rule and the memory occupied by a single pixel can be predetermined, so that the memory occupied by a single pixel of each image acquisition device can be found based on the mapping relationship.

[0058] Step 1.2: Calculate the product of the single-pixel memory and the image size to obtain the memory occupied by a single frame image for each image acquisition device in the sensor group. In one embodiment, a camera, infrared image sensor, solid-state image sensor, and ultrasonic sensor are assembled as image acquisition devices in the sensor group. In a specific implementation, the following formula can be used to obtain the memory:

[0059] FRAME size =FRAME w *FRAME h *PIXEL bit ;

[0060] Among them, FRAME size Indicates the memory occupied by a single frame image (that is, the size of the memory occupied by 1 frame image), unit: bit / Frame; FRAME w Characterizes the width of the image frame size; FRAME h Characterizes high image frame size; PIXEL bit Represents a bitmap image (that is, a single pixel occupies memory).

[0061] Step 2: Calculate the target vehicle's required transmission rate based on the number of image acquisition devices and the memory occupied by a single-frame image. In one embodiment, the target vehicle's required transmission rate can be calculated by multiplying the number of image acquisition devices, the memory occupied by a single-frame image, and the sampling frame rate. Specifically, assuming that the image acquisition devices capture and generate images at the same sampling frame rate, the following formula can be used to calculate the image size generated per unit time:

[0062] DATA rate =FRAME size *FRAME rate *CAMERA num ;

[0063] Among them, DATA rate Represents the size of the image generated per unit time, in bit / s or M / s; FRAME rate Characterizes the camera sampling frame rate, in Frame / s; AMERA num The number of devices representing the image acquisition device. Optionally, the transmission rate requirement can be greater than or equal to the image size generated per unit time.

[0064] In one embodiment, a method for determining the number of image acquisition devices determines the number of sampling devices based on the size and appearance of a target vehicle. When the number of sampling devices meets the requirements, the acquisition areas of multiple sampling devices are combined to obtain the blind spot field of view of the target vehicle, thereby using the acquired environmental data to restore the real scene.

[0065] (2) Regarding storage memory requirements, the storage memory requirements of the target vehicle can be calculated based on the transmission rate requirements and the preset collection period. In one embodiment, based on the actual data collection situation of the target vehicle and factors such as the working environment, the user adjusts the statistical period of the data volume, and based on the total working hours of the target vehicle during the statistical period and the data transmission rate, the amount of data collected by the target vehicle during the statistical period is calculated as the storage memory requirements of the target vehicle. Among them, the storage memory requirements include at least storage capacity and read and write speed. For example, with respect to storage capacity, based on 5 days a week and 8 hours of collection time per day, the amount of data generated per week is approximately 28.5T. Currently, the mainstream storage disk capacities are 1T, 2T, and 4T. Considering the total data storage capacity and portability, 8 4T disks are selected as the storage medium; with respect to read and write speed, considering that the transmission rate limit of traditional mechanical hard disks (HHDs) is generally 200M / s, which cannot meet the transmission rate requirements, and the current mainstream solid-state hard disks can reach a read and write speed of more than 300M / s, solid-state disks (SSDs) can be selected.

[0066] On this basis, an embodiment of the present invention provides an implementation method for determining a target storage device identifier from the candidate storage device identifier: (1) obtaining a plurality of pre-set candidate disk array levels; (2) determining a target disk array level from the candidate disk array levels according to storage memory requirements; (3) determining a target storage device identifier from the candidate storage device identifier based on the target disk array level. The candidate disk array level is used to characterize the number of disks contained in the disk array and the description of the disk performance. The disk array includes at least one primary disk, or the disk array corresponding to the target storage device identifier includes at least one primary disk and at least one backup disk. The primary disk is used for normal operation, receiving environmental data and storing it. The number of primary disks determines the read and write speed of the disk array. The secondary disks are used for backing up data and ensuring data security. The number of secondary disks determines the security of the disk array. In one implementation method, as shown in Table 1 below, disk arrays of different levels have different performances.

[0067] Table 1

[0068]

[0069] To facilitate understanding of the data processing method provided in the above embodiment, an embodiment of the present invention provides an application example of the data processing method, see Figure 3 The architecture diagram of a data processing method shown in FIG. includes a data acquisition system and a data storage system. The data storage system uses a network storage server (such as RAID6). For example, a target vehicle is provided with 7 image acquisition devices (such as video sensors). Figure 4 A schematic structural diagram of a target vehicle is shown in FIG. Figure 4 The diagram shows that 7 image acquisition devices are installed on the target vehicle, based on which the blind spots of vision are reduced or even eliminated, and the real scene is restored more accurately. Figure 5 FIG. 5 is a flow chart of another data processing method shown in FIG. 5 , wherein the method mainly includes the following steps S502 to S514 :

[0070] In step S502, the server obtains target sensor parameters and the data collection cycle of the target vehicle. The target sensor parameters include image size, image encoding rules, and sampling frame rate, and the data collection cycle includes the number of collection days per week and the collection time per day.

[0071] In one embodiment, the sensor may use seven cameras, with a data collection period of five days a week and eight hours a day, and a sampling frame rate of 10 Frame / s.

[0072] In step S504, the server determines the memory occupied by a single frame of the image based on the product of the image size and the single pixel memory. The single pixel memory is determined by the image coding rule, and the memory occupied by a single pixel is different under different coding rules.

[0073] In one embodiment, YUV420 encoding is adopted, 1 pixel occupies 12 bits (Binary Digit) of memory, the image size is 1920 pixels in width, and the image size is 1080 pixels in height.

[0074] In step S506, the server determines the minimum required data transmission rate for the target vehicle based on the number of sampling devices, the memory occupied by a single frame image, and the sampling frame rate. The number of sampling devices is determined based on the size and appearance of the target vehicle. If the number of sampling devices meets the requirements, the collection areas of multiple sampling devices are combined to obtain the target vehicle's blind spot field of view, thereby using the acquired environmental data to restore the actual scene.

[0075] In one embodiment, DATA rate Indicates the size of the image generated per unit time, and DATA rateAs the minimum requirement for the target vehicle data transmission rate, it is calculated as follows:

[0076] DATA rate =1080pixel*1920pixel*12bit*10Frame / s*7;

[0077] =1741824000bit / s;

[0078] ≈207.6M / s.

[0079] In step S508, the server determines a target transmission identifier from the candidate transmission device identifiers based on the target vehicle's minimum data transmission rate requirement, and then determines the data transmission device corresponding to the target transmission identifier. The target transmission identifier corresponds to multiple network ports with different transmission rates, and the network port with a transmission rate greater than the target vehicle's minimum data transmission rate requirement is selected for local data storage.

[0080] In one embodiment, via DATA rate The calculation results show that the transmission rate between the data acquisition system and the data storage system must not be lower than 207M / s, so a 10Gbit network port is selected as the transmission port for local transmission and storage.

[0081] In step S510, the server calculates the storage requirement of the target vehicle based on the transmission rate requirement and the preset collection period, wherein the storage requirement is the amount of data collected by the target vehicle per week.

[0082] In one embodiment, data collection is performed according to a cycle of five days a week, eight hours a day, and a collection rate of 207M / s. The amount of data collected by the vehicle per week is approximately 28.5T.

[0083] In step S512, the server determines a target storage identifier from the candidate storage device identifiers based on the target vehicle's storage requirements, and then determines the data storage device corresponding to the target storage identifier. When determining the target storage identifier from the candidate storage device identifiers that meet the target vehicle's storage requirements, it is also necessary to comprehensively consider factors such as read / write speed, storage security, total data storage capacity, and portability.

[0084] In one embodiment, based on the amount of data collected by the vehicle every week, eight 4TB solid-state hard drives with a read and write speed of more than 300M / s are selected to form a disk array, and the level of the disk array is selected as RAID 6.

[0085] In step S514, the target vehicle transmits the collected environmental data to a data storage device via a data transmission device for storage. The environmental data is stored in a disk array of the data storage device, which includes at least one primary disk, or a primary disk and at least one backup disk.

[0086] In summary, the embodiments of the present invention can ensure normal transmission and storage of data when the data volume is large, and select corresponding transmission and storage configurations for different received environmental data, thereby avoiding resource waste while meeting data transmission and storage requirements.

[0087] Regarding the data processing method provided in the above embodiment, an embodiment of the present invention provides a data processing device, which is applied to a server. The server is configured with multiple candidate transmission device identifiers and candidate storage device identifiers. Figure 6 The structure diagram of a data processing device shown in FIG. 1 includes the following parts:

[0088] The parameter acquisition module 602 acquires the sensor parameters of the sensor group configured for the target vehicle;

[0089] The demand determination module 604 calculates the transmission and storage requirements of the target vehicle based on the sensor parameters; wherein the transmission and storage requirements include transmission rate requirements and storage memory requirements;

[0090] The data storage module 606 determines the target transmission device identifier from the candidate transmission device identifiers and determines the target storage device identifier from the candidate storage device identifiers according to the transmission and storage requirements, so as to transmit the environmental data collected by the sensor group to the data storage device corresponding to the target storage device identifier through the data transmission device corresponding to the target transmission device identifier for storage.

[0091] The above-mentioned data processing device provided in the embodiment of the present application can be equipped with enough sensors on the vehicle, thereby reducing and eliminating blind spots in the field of view, so that the sensor transmission data can better restore the real scene, use the network port for data transmission and use the disk array for data storage, thereby meeting a large number of data transmission and storage needs, and select the corresponding candidate transmission device identifier and candidate storage device identifier according to actual needs, so as to better take into account storage capacity, read and write speed and storage security issues, and avoid waste of resources. In addition, it solves the problem of regional restrictions that exist in the traditional use of cloud servers for data transmission and storage.

[0092] The transmission rate of cloud servers cannot meet the data transmission requirements, and there are regional restrictions, which will have an adverse impact on the transmission and storage of environmental data.

[0093] In one embodiment, when performing the step of calculating the transmission storage requirements of the target vehicle based on sensor parameters, the above-mentioned demand determination module 604 is also used to: calculate the memory occupied by a single-frame image corresponding to each image acquisition device in the sensor group based on the sensor parameters; wherein the sensor parameters include image size, image encoding rules and sampling frame rate; calculate the transmission rate requirement of the target vehicle based on the number of image acquisition devices and the memory occupied by a single-frame image.

[0094] In one embodiment, when performing the step of calculating the memory occupied by a single-frame image corresponding to each image acquisition device in the sensor group based on sensor parameters, the above-mentioned demand determination module 604 is also used to: determine the memory occupied by a single pixel point based on image encoding rules; calculate the product of the single-pixel point memory and the image size to obtain the memory occupied by a single-frame image corresponding to each image acquisition device in the sensor group.

[0095] In one embodiment, when performing the step of calculating the transmission rate requirement of the target vehicle based on the number of image acquisition devices and the memory occupied by a single-frame image, the above-mentioned requirement determination module 604 is also used to: calculate the product of the number of image sampling devices, the memory occupied by a single-frame image, and the sampling frame rate to obtain the transmission rate requirement of the target vehicle.

[0096] In one embodiment, when performing the step of calculating the transmission storage requirement of the target vehicle based on the sensor parameters, the requirement determination module 604 is further configured to calculate the storage memory requirement of the target vehicle based on the transmission rate requirement and the preset acquisition period.

[0097] In one embodiment, when performing the step of determining the target storage device identifier from the candidate storage device identifiers, the data storage module 606 is further used to: obtain a plurality of pre-set candidate disk array levels; wherein the candidate disk array levels are used to characterize the number of disks included in the disk array and the description of the disk performance; determine the target disk array level from the candidate disk array levels according to the storage memory requirement; and determine the target storage device identifier from the candidate storage device identifiers based on the target disk array level.

[0098] In one embodiment, the data storage module 606 is further configured to: limit the disk array corresponding to the target storage device identifier to include at least one primary disk, or limit the disk array corresponding to the target storage device identifier to include at least one primary disk and at least one backup disk.

[0099] The device provided in the embodiment of the present invention has the same implementation principle and technical effects as those in the aforementioned method embodiment. For the sake of brief description, for matters not mentioned in the device embodiment, reference can be made to the corresponding content in the aforementioned method embodiment.

[0100] An embodiment of the present invention provides a server. Specifically, the server includes a processor and a storage device. The storage device stores a computer program, and when the computer program is executed by the processor, it executes the method described in any one of the above-mentioned embodiments.

[0101] Figure 7 A structural diagram of a server provided in an embodiment of the present invention, wherein the server 100 includes: a processor 70, a memory 71, a bus 72 and a communication interface 73, wherein the processor 70, the communication interface 73 and the memory 71 are connected via the bus 72; the processor 70 is used to execute an executable module stored in the memory 71, such as a computer program.

[0102] The memory 71 may include high-speed random access memory (RAM) and may also include non-volatile memory, such as at least one disk storage. The system network element communicates with at least one other network element via at least one communication interface 73 (which may be wired or wireless), and may utilize the Internet, a wide area network, a local area network, a metropolitan area network, or the like.

[0103] The bus 72 may be an ISA bus, a PCI bus, or an EISA bus. The bus may be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, Figure 7 Only one bidirectional arrow is used in the diagram, but this does not mean that there is only one bus or one type of bus.

[0104] Among them, the memory 71 is used to store programs, and the processor 70 executes the program after receiving the execution instruction. The method executed by the device for flow process definition disclosed in any embodiment of the above-mentioned embodiment of the present invention can be applied to the processor 70 or implemented by the processor 70.

[0105] The processor 70 may be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above method may be completed by hardware integrated logic circuits or software instructions in the processor 70. The processor 70 may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it may also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. It may implement or execute the various methods, steps, and logic block diagrams disclosed in the embodiments of the present invention. The general-purpose processor may be a microprocessor or any conventional processor. The steps of the method disclosed in conjunction with the embodiments of the present invention may be directly implemented and executed by a hardware decoding processor, or by a combination of hardware and software modules in the decoding processor. The software module may be located in a storage medium well-known in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, or the like. The storage medium is located in the memory 71 , and the processor 70 reads the information in the memory 71 and completes the steps of the above method in combination with its hardware.

[0106] The computer program product of the readable storage medium provided in the embodiment of the present invention includes a computer-readable storage medium storing program code. The instructions included in the program code can be used to execute the method described in the previous method embodiment. The specific implementation can be referred to the previous method embodiment and will not be repeated here.

[0107] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0108] Finally, it should be noted that the above-described embodiments are only specific implementation methods of the present invention, which are used to illustrate the technical solutions of the present invention, rather than to limit them. The scope of protection of the present invention is not limited thereto. Although the present invention has been described in detail with reference to the above-described embodiments, those skilled in the art should understand that any person skilled in the art can modify or easily conceive of changes to the technical solutions described in the above-described embodiments within the technical scope disclosed by the present invention, or replace some of the technical features therein with equivalents. Such modifications, changes, or replacements do not deviate from the spirit and scope of the technical solutions of the embodiments of the present invention, and should be included in the scope of protection of the present invention. Therefore, the scope of protection of the present invention shall be subject to the scope of protection of the claims.

Claims

1. A data processing method, characterized in that: The method is applied to a server, the server being configured with a plurality of candidate transmission device identifiers and candidate storage device identifiers, and the method comprising: Obtain sensor parameters of the sensor group configured on the target vehicle; Calculating the transmission and storage requirements of the target vehicle based on the sensor parameters; wherein the transmission and storage requirements include a transmission rate requirement and a storage memory requirement, and calculating the storage memory requirement of the target vehicle based on the transmission rate requirement and a preset acquisition period; Determine the target transmission device identifier from the candidate transmission device identifiers and the target storage device identifier from the candidate storage device identifiers according to the transmission and storage requirements, so as to transmit the environmental data collected by the sensor group to the data storage device corresponding to the target storage device identifier for storage through the data transmission device corresponding to the target transmission device identifier; The sensor group includes a plurality of image acquisition devices; the step of calculating the transmission storage requirements of the target vehicle based on the sensor parameters includes: calculating the memory occupied by a single-frame image corresponding to each image acquisition device in the sensor group based on the sensor parameters; wherein the sensor parameters include image size, image encoding rules, and sampling frame rate; and calculating the transmission rate requirement of the target vehicle based on the number of image acquisition devices and the memory occupied by the single-frame image. The step of calculating the memory occupied by a single-frame image corresponding to each of the image acquisition devices in the sensor group according to the sensor parameters includes: determining the memory occupied by a single pixel according to the image encoding rule; calculating the product of the single-pixel memory and the image size to obtain the memory occupied by a single-frame image corresponding to each of the image acquisition devices in the sensor group; The memory occupied by a single frame image is obtained by the following formula: FRAME size =FRAME w *FRAME h *PIXEL bit ; Among them, FRAME size Indicates the memory occupied by a single frame image, which is the memory size occupied by 1 frame image, unit: bit / Frame; FRAME w Characterizes the width of the image frame size; FRAME h Characterizes high image frame size; PIXEL bit Represents a bitmap image, which occupies memory for a single pixel; The step of calculating the transmission rate requirement of the target vehicle based on the number of image acquisition devices and the memory occupied by the single-frame image comprises: calculating the product of the number of image acquisition devices, the memory occupied by the single-frame image, and the sampling frame rate to obtain the transmission rate requirement of the target vehicle; Wherein, the data storage device includes a disk array; the step of determining the target storage device identifier from the candidate storage device identifiers includes: obtaining a plurality of pre-set candidate disk array levels; wherein the candidate disk array levels are used to characterize the number of disks included in the disk array and the description of the disk performance; determining the target disk array level from the candidate disk array levels according to the storage memory requirement; and determining the target storage device identifier from the candidate storage device identifiers based on the target disk array level.

2. The method according to claim 1, characterized in that The disk array corresponding to the target storage device identifier includes at least one primary disk, or the disk array corresponding to the target storage device identifier includes at least one primary disk and at least one spare disk.

3. A data processing device, characterized in that: The device is applied to a server, the server is configured with a plurality of candidate transmission device identifiers and candidate storage device identifiers, and the device includes: A parameter acquisition module, which acquires the sensor parameters of the sensor group configured for the target vehicle; a demand determination module, calculating the transmission and storage requirements of the target vehicle based on the sensor parameters; wherein the transmission and storage requirements include a transmission rate requirement and a storage memory requirement, and calculating the storage memory requirement of the target vehicle based on the transmission rate requirement and a preset acquisition period; a data storage module, which determines a target transmission device identifier from the candidate transmission device identifiers and a target storage device identifier from the candidate storage device identifiers according to the transmission and storage requirements, so as to transmit the environmental data collected by the sensor group to the data storage device corresponding to the target storage device identifier through the data transmission device corresponding to the target transmission device identifier for storage; The sensor group includes a plurality of image acquisition devices; the step of calculating the transmission storage requirements of the target vehicle based on the sensor parameters includes: calculating the memory occupied by a single-frame image corresponding to each image acquisition device in the sensor group based on the sensor parameters; wherein the sensor parameters include image size, image encoding rules, and sampling frame rate; and calculating the transmission rate requirement of the target vehicle based on the number of image acquisition devices and the memory occupied by the single-frame image. The step of calculating the memory occupied by a single-frame image corresponding to each of the image acquisition devices in the sensor group according to the sensor parameters includes: determining the memory occupied by a single pixel according to the image encoding rule; calculating the product of the single-pixel memory and the image size to obtain the memory occupied by a single-frame image corresponding to each of the image acquisition devices in the sensor group; The memory occupied by a single frame image is obtained by the following formula: FRAME size =FRAME w *FRAME h *PIXEL bit ; Among them, FRAME size Indicates the memory occupied by a single frame image, which is the memory size occupied by 1 frame image, unit: bit / Frame; FRAME w Characterizes the width of the image frame size; FRAME h Characterizes high image frame size; PIXEL bit Represents a bitmap image, which occupies memory for a single pixel; The step of calculating the transmission rate requirement of the target vehicle based on the number of image acquisition devices and the memory occupied by the single-frame image comprises: calculating the product of the number of image acquisition devices, the memory occupied by the single-frame image, and the sampling frame rate to obtain the transmission rate requirement of the target vehicle; Wherein, the data storage device includes a disk array; the step of determining the target storage device identifier from the candidate storage device identifiers includes: obtaining a plurality of pre-set candidate disk array levels; wherein the candidate disk array levels are used to characterize the number of disks included in the disk array and the description of the disk performance; determining the target disk array level from the candidate disk array levels according to the storage memory requirement; and determining the target storage device identifier from the candidate storage device identifiers based on the target disk array level.

4. A server, characterized in that: The method comprises a processor and a memory, wherein the memory stores computer-executable instructions that can be executed by the processor, and the processor executes the computer-executable instructions to implement the method according to any one of claims 1 to 2.

5. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer-executable instructions. When the computer-executable instructions are called and executed by a processor, the computer-executable instructions prompt the processor to implement the method according to any one of claims 1 to 2.

Images