Data access processing method, device, electronic device and readable storage medium

Abstract

The present disclosure provides a data access processing method, device, electronic device and readable storage medium, which relate to the field of artificial intelligence, especially to the fields of intelligent transportation, autonomous driving and Internet of Things technology. The specific implementation scheme is: obtaining the communication protocol and data parsing protocol corresponding to the target device; configuring the data access service cluster corresponding to the target device according to the communication protocol corresponding to the target device; obtaining the target data uploaded to the data access service cluster by the target device based on the communication protocol, and parsing the target data based on the data parsing protocol; sending the parsed target data to the target storage node.

Description

Technical Field

[0001] The present disclosure relates to the field of artificial intelligence, in particular to the fields of intelligent transportation, autonomous driving, and the Internet of Things, and specifically to a data access processing method, device, electronic device, and readable storage medium. Background Art

[0002] Connecting data to the cloud is an important part of the intelligentization and networking of vehicles and equipment, so data access is a long-term task. Intelligent networked devices, vehicles themselves, and their derived data are also constantly changing and developing, and data access needs to cope with the iterative updates of various types of roadside equipment and vehicle-side data. At present, the access method of intelligent networked devices and vehicle data is usually to develop specific data access services for a specific usage scenario or data access needs to achieve data access. Summary of the invention

[0003] The present disclosure provides a data access processing method, device, electronic device and readable storage medium.

[0004] According to a first aspect of the present disclosure, a data access processing method is provided, comprising:

[0005] Obtain the communication protocol and data parsing protocol corresponding to the target device;

[0006] According to the communication protocol corresponding to the target device, configure the data access service cluster corresponding to the target device;

[0007] Acquire target data uploaded by the target device to the data access service cluster based on the communication protocol, and parse and process the target data based on the data parsing protocol;

[0008] The parsed target data is sent to the target storage node.

[0009] According to a second aspect of the present disclosure, a data access processing device is provided, comprising:

[0010] A first acquisition module, used to acquire the communication protocol and data parsing protocol corresponding to the target device;

[0011] A first configuration module, configured to configure a data access service cluster corresponding to the target device according to a communication protocol corresponding to the target device;

[0012] A processing module, used for acquiring target data uploaded by the target device to the data access service cluster based on the communication protocol, and performing parsing processing on the target data based on the data parsing protocol;

[0013] The first sending module is used to send the target data after parsing to a target storage node.

[0014] According to a third aspect of the present disclosure, there is provided an electronic device, including:

[0015] at least one processor; and

[0016] a memory communicatively connected to the at least one processor; wherein,

[0017] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method described in the first aspect.

[0018] According to a fourth aspect of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to cause the computer to execute the method described in the first aspect.

[0019] According to a fifth aspect of the present disclosure, a computer program product is provided, comprising a computer program, wherein the computer program implements the method described in the first aspect when executed by a processor.

[0020] In the disclosed embodiment, the service platform can flexibly configure data access service clusters for different devices according to the communication protocol, so that the service platform is no longer limited to receiving data from specific devices, effectively improving the application scenarios and scope of the service platform.

[0021] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] The accompanying drawings are used to better understand the present solution and do not constitute a limitation of the present disclosure.

[0023] Figure 1 is a flow chart of a data access processing method provided by an embodiment of the present disclosure;

[0024] Figure 2 It is a schematic diagram of a scenario in which a data access processing method provided by an embodiment of the present disclosure is applied;

[0025] Figure 3 It is one of the structural diagrams of a data access processing device provided by an embodiment of the present disclosure;

[0026] Figure 4 This is a second structural diagram of a data access processing device provided by an embodiment of the present disclosure;

[0027] Figure 5This is a third structural diagram of a data access processing device provided by an embodiment of the present disclosure;

[0028] Figure 6 It is a block diagram of an electronic device used to implement the data access processing method of the embodiment of the present disclosure. DETAILED DESCRIPTION

[0029] The following is a description of exemplary embodiments of the present disclosure in conjunction with the accompanying drawings, including various details of the embodiments of the present disclosure to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present disclosure. Similarly, for the sake of clarity and conciseness, the description of well-known functions and structures is omitted in the following description.

[0030] Please refer to Figure 1 , Figure 1 is a flow chart of a data access processing method provided by an embodiment of the present disclosure, such as Figure 1 As shown, the method comprises the following steps:

[0031] Step S101: Obtain the communication protocol and data analysis protocol corresponding to the target device.

[0032] It should be noted that the data access processing method provided in the embodiment of the present disclosure can be applied to a data access server, and the server can also be called a service platform for managing data access services. For better understanding, the specific implementation of the embodiment of the present disclosure will be explained in the subsequent embodiments using the service platform as the execution subject.

[0033] In the disclosed embodiments, the target device may also be referred to as a load. For example, the target device may be a connected vehicle, a third-party cloud platform, a road side unit (RSU), an edge computing technology (MEC) device, a signal controller, a smart lamp pole, a smart traffic light, etc. The target device is communicatively connected to the service platform, and thus the target device can transmit data with the service platform. It can be understood that different types of target devices may correspond to different communication protocols, that is, different types of target devices and service platforms need to implement data transmission based on corresponding communication protocols. In addition, different types of target devices may correspond to different data parsing protocols, and after the service platform obtains the data uploaded by the target device, it needs to process the uploaded data based on the corresponding data parsing protocol.

[0034] Optionally, the service platform may first determine the target device, that is, determine which type of device it is, and then obtain the communication protocol and data parsing protocol corresponding to the target device. For example, the service platform may pre-store the communication protocols and data parsing protocols corresponding to different devices. After determining the target device, for example, the service platform may receive the device name input by the user to determine the target device, and the service platform obtains the communication protocol and data parsing protocol that match the target device from the pre-stored communication protocols and data parsing protocols.

[0035] Optionally, the communication protocol includes but is not limited to http protocol, tcp protocol, udp protocol, websocket protocol, etc.; the data parsing protocol includes but is not limited to Json protocol, Bytes protocol, Protobuf protocol, etc.

[0036] Step S102: configuring a data access service cluster corresponding to the target device according to a communication protocol corresponding to the target device.

[0037] In this step, after obtaining the communication protocol and data parsing protocol corresponding to the target device, the service platform configures the corresponding data access service cluster for the target device based on the communication protocol corresponding to the target device, so that the data that the target device needs to upload to the service platform can be uploaded to the data access service cluster corresponding to the target device.

[0038] In the disclosed embodiment, different types of target devices correspond to different communication protocols, that is, different types of target devices need to transmit data through their respective corresponding communication protocols. The service platform creates a corresponding data access service cluster for each type of target device according to the communication protocols corresponding to the different types of target devices. Therefore, the service platform can receive data uploaded by various types of target devices, thereby expanding the application scenarios of the service platform.

[0039] It should be noted that the service platform configures the data access service cluster corresponding to the target device, which may include configuring a corresponding access channel for the target device, and then the target device accesses the data access service cluster through a specific access channel and uploads data through the access channel.

[0040] Step S103: acquiring target data uploaded by the target device to the data access service cluster based on the communication protocol, and parsing the target data based on the data parsing protocol.

[0041] In the disclosed embodiment, after the service platform configures the corresponding data access service cluster for the target device based on the communication protocol corresponding to the target device, the target device can upload the target data to be uploaded to the data access service cluster based on the communication protocol, and the service platform can also obtain the target data uploaded by the target device. Furthermore, the service platform can parse and process the target data based on the data parsing protocol corresponding to the target device. For example, the target device can upload the target data in a package, and the service platform parses and processes the packaged target data based on the corresponding data parsing protocol.

[0042] Optionally, the parsing process may also include operations such as filtering or modifying the target data. For example, the service platform may filter the target data based on a preset filtering principle, such as filtering out incorrectly formatted or duplicated data in the target data, or filtering out data that is not required by the business end according to the business end's demand for data; etc. Furthermore, by filtering the target data, the amount of target data can be effectively reduced, thereby saving the storage space occupied by the target data.

[0043] It should be noted that the service platform modifies the target data, for example, it may correct incorrectly formatted data in the target data, or perform modification operations such as adding and deleting the target data. For example, the target data may be modified based on processing methods such as Python or Java, and the present disclosure will not go into details about this.

[0044] Step S104: Send the parsed target data to a target storage node.

[0045] The target storage node may be a preset storage node, for example, the target storage node may be a preset message queue or database; or the target storage node may be a storage node configured by the service platform for the target device. After the service platform completes the analysis of the target data, it sends the analyzed target data to the target storage node, thereby realizing the reception and transmission of the target data.

[0046] In the disclosed embodiment, the service platform obtains the communication protocol corresponding to the target device, configures the data access service cluster corresponding to the target device, and receives the target data uploaded to the data access service cluster by the target device based on the communication protocol, thereby enabling the service platform to flexibly configure the data access service cluster for different devices according to the communication protocol, so that the service platform is no longer limited to receiving data from specific devices, effectively improving the application scenarios and scope of the service platform. In addition, after receiving the target data uploaded by the target device, the service platform can also parse and process the target data based on the data parsing protocol corresponding to the target device, and send the parsed target data to the target storage node, thereby enabling the service platform to not only receive data, but also send data, avoiding the service platform from storing too much data and occupying storage space.

[0047] Optionally, before sending the parsed target data to the target storage node, the method further includes:

[0048] A business end having a demand for acquiring the target data is identified, and the business end is configured as a target storage node for the target data.

[0049] It should be noted that the service platform can establish communication connections with multiple business terminals. For example, for business terminals that need to obtain data from the service platform, they can pre-connect to the service platform and then obtain relevant data from the service platform. After the service platform configures the data access service cluster for the target device, it can further identify the business terminals that have the need to obtain the data of the target device, and configure these business terminals as the target storage nodes of the target device. Then, when the service platform obtains the target data uploaded by the target device to the data access service cluster, it sends the target data to the target storage node, that is, to the business terminal that has the need to obtain the target data, so as to ensure that the business terminal obtains the target data in a timely manner.

[0050] In the disclosed embodiment, after the service platform configures the data access service cluster for the target device, it can also configure the corresponding target storage node for the target data uploaded by the target device, so that it can flexibly control the transmission direction of the target data, making the service platform's management of the target data more flexible and proactive, and can also avoid the target data from occupying the service platform's storage space, effectively freeing up the service platform's storage space.

[0051] Optionally, in the embodiment of the present disclosure, after configuring the data access service cluster corresponding to the target device, the method further includes:

[0052] Acquire a data type corresponding to the target device, and configure a data access service subset corresponding to the data type in the data access service cluster;

[0053] The obtaining target data uploaded by the target device to the data access service cluster based on the communication protocol includes:

[0054] Acquire target data uploaded to the first subset by the target device based on the communication protocol;

[0055] The data access service subset includes the first subset, and the data type corresponding to the first subset is the data type of the target data.

[0056] It should be noted that even for the same type of target device, the type of target device may include multiple data types. For example, the data type may be related to the device version, or the data type may be data corresponding to different individual target devices of the same type, and so on.

[0057] Exemplarily, assuming that the target device is a connected vehicle, the data type of the connected vehicle can be divided based on different individual connected vehicles, for example, connected vehicle A corresponds to a type of data, connected vehicle B corresponds to a type of data, connected vehicle C corresponds to a type of data... and thus, different connected vehicles correspond to different data types. After obtaining the data type corresponding to the target device, the service platform configures a data access service subset corresponding to the data type in the data access service cluster, that is, there is a one-to-one correspondence between the data type and the data access service subset, so that by configuring different data access service subsets, the service platform can better manage the data access service cluster.

[0058] Furthermore, after creating data access service subsets corresponding to different data types in the data access service cluster, for the target data uploaded by the target device, the service platform uploads the target data to the corresponding data access service subset (i.e., the first subset) according to the data type corresponding to the target data. In this way, the service platform can configure multiple data access service subsets in the corresponding data access service cluster according to the data type of the target device, so that even for the same type of target device, the target data can be saved in different data access service subsets based on the data type, thereby realizing the classified storage of data of different data types of the target device, and better realizing the management of the target data uploaded by the target device.

[0059] Optionally, after configuring the data access service subset corresponding to the data type in the data access service cluster, the method further includes:

[0060] Obtaining the offline data type of the target device;

[0061] A second subset corresponding to the offline data type in the data access service cluster is identified, and the second subset is deleted.

[0062] It is understandable that the target device can update its data type. For example, if the data type of the target device is related to the version of the target device, when the target device is updated to a new version, the data type of the target device will also be updated to the latest version accordingly. In this case, the target device may be an offline old version, and the data type corresponding to the old version will also be offline, that is, the target device will no longer generate data corresponding to the offline data type.

[0063] In the disclosed embodiment, the service platform can also obtain the data type of the target device offline, that is, the data type no longer used by the target device, further identify the second subset corresponding to the offline data type in the data access service cluster, and delete the second subset. In this way, the service platform can delete the data access service subset that is not in use in a timely manner, and better manage the data access service subset.

[0064] It should be noted that in the embodiment of the present disclosure, the service platform can create a corresponding data access service subset in the data access service cluster according to the data type of the target device, thereby achieving expansion of the data access service cluster; and for the data type that the target device has been offline, the service platform can promptly delete the data access service subset corresponding to the offline data type, thereby achieving reduction in the data access service cluster and avoiding occupation of the storage space of the data access service cluster.

[0065] Furthermore, the method may also include the following steps:

[0066] In the case that the target device has a data response requirement, configuring a response message format corresponding to the data response requirement;

[0067] After the target data after parsing is sent to the target storage node, a response message is sent to the target device based on the response message format, wherein the response message is used to indicate that the target data after parsing has been sent to the target storage node.

[0068] It should be noted that for certain types of target devices, after the service platform sends the target data uploaded by the target device to the target storage node, the target device requires the data recipient to return a response message as required. For example, some radar devices require the data recipient to return a response message as required.

[0069] In the disclosed embodiment, when the target device has a data response requirement, that is, the target device requires the data recipient to return a response message, for this type of target device, the service platform can also configure a response message format corresponding to the data response requirement. Among them, the response message format can be configured according to the data response requirement of the target device. For example, the data response requirement may include the expected data information, and the service platform configures the response message format according to the expected data information. After the service platform sends the parsed target data to the target storage node, the service platform sends a response message to the target device based on the response message format. The response message also includes the data information expected by the target device, and then the target device can promptly know that the service platform has sent the target data to the corresponding target storage node, so that the target device can determine the completion of the target data transmission stage and promptly enter the next stage of the business process, thereby ensuring the orderly advancement of the target device for the relevant business processes.

[0070] Optionally, after sending the parsed target data to the target storage node, the service platform may also send a request message to the target storage node based on the response message format, and the request message is used to instruct the target storage node to feedback a response message; after receiving the request message, the target storage node sends a response message to the service platform, and the response message is used to indicate that the target storage node has received the target data sent by the service platform, and may also include other data information expected by the target device; further, the service platform sends the response message to the target device to ensure that the target device can promptly know that the target data has been sent to the target storage node, so that the target device can enter the next stage of the business process.

[0071] Optionally, the method may further include:

[0072] Obtaining log information corresponding to the data access service cluster;

[0073] Determining whether the data access service cluster can receive and / or send the target data based on the log information;

[0074] In the case that the data access service cluster fails to receive and / or send the target data, the configuration of the data access service cluster is adjusted, or the data access service cluster corresponding to the target device is reconfigured.

[0075] In the disclosed embodiment, the service platform may also obtain the log information corresponding to the data access service cluster in real time or according to a preset period, and the log information may indicate whether the target data is received, the time when the target data is received, whether the target data is sent, and the time when the target data is sent, etc. Furthermore, the service platform may determine whether the data access service cluster has received and / or sent the target data based on the log information.

[0076] Furthermore, if the service platform finds based on the log information that the data access service cluster fails to receive and / or send the target data, for example, the log information does not record relevant information about receiving and / or sending the target data, then it is considered that the data access service cluster cannot successfully receive and / or send the target data. In this case, the service platform may adjust the configuration of the data access service cluster. For example, if the target data cannot be received normally due to insufficient storage space of the data access service cluster, the service platform may expand the capacity of the data access service cluster; or, the service platform may reconfigure the data access service cluster corresponding to the target device to ensure the normal reception of the target data uploaded by the target device.

[0077] It should be noted that if it is determined based on the log information that the data access service cluster can normally perform the reception and / or transmission of the target data, it means that the data access service cluster configured by the service platform for the target device can operate normally. Furthermore, the service platform obtains the address information corresponding to the data access service cluster, and can configure the address information to the target device and start the target device, so that the target device can upload the target data to the corresponding data access service cluster according to the address information, thereby ensuring that other business terminals (i.e., target storage nodes) obtain the target data.

[0078] Please refer to Figure 2 , Figure 2 This is a schematic diagram of a data access processing method provided by an embodiment of the present disclosure. Figure 2 The data access processing method provided in the embodiment of the present disclosure is explained.

[0079] It should be noted that the data access processing method provided in the embodiment of the present disclosure may be applied to the service platform as described above, and the service platform provides a user interface, and the service platform can receive the user's operation on the user interface to perform the configuration of the data access service cluster corresponding to the target device. For example, the user interface may provide multiple types of target devices for the user to select, such as Figure 2The user can select a target device from the connected vehicles, third-party cloud platforms, RSUs, MEC devices, signal controllers, smart light poles, etc. shown in the figure. The service platform obtains the communication protocol and data parsing protocol corresponding to the target device according to the selection operation made by the user, and configures the corresponding data access service cluster (also called data access channel service cluster) for the target device according to the communication protocol corresponding to the target device, such as Figure 2 The data access service cluster 1, data access service cluster 2, ..., data access service cluster N are shown in FIG. Different data access service clusters correspond to different types of target devices, wherein the service platform can manage multiple target devices and multiple data access service clusters through load balancing.

[0080] It should be noted that the service platform may include a service management module, through which the configuration and management of the data access service cluster is realized. For each data access service cluster, the service platform may also expand and reduce the capacity of the data access service cluster through the service management module. For example, multiple data access service subsets may be created for the data access service cluster according to the data type of the target device, such as Figure 2 The access service 1, access service 2, ... access service N shown in the figure can realize the expansion of the data access service cluster. In addition, the service management module can also delete the corresponding access service in time according to the data type of the target device that has been offline, so as to realize the reduction of the data access service cluster.

[0081] Furthermore, after the target device uploads the target data to the corresponding data access service cluster, the service platform may send the data in the data access service cluster to the next storage node, such as Figure 2 The message queue (such as Kafka message queue) or database (such as relational database management system (mysql)) shown in the figure can flexibly control the transmission direction of the target data. By creating data access service clusters corresponding to different target devices, the service platform can manage the target data more flexibly, which improves the application scenarios of the service platform.

[0082] Please refer to Figure 3 , Figure 3 is one of the structural diagrams of a data access processing device provided by an embodiment of the present disclosure, such as Figure 3 As shown, the data access processing device 300 includes:

[0083] The first acquisition module 301 is used to acquire the communication protocol and data parsing protocol corresponding to the target device;

[0084] A first configuration module 302, configured to configure a data access service cluster corresponding to the target device according to a communication protocol corresponding to the target device;

[0085] The processing module 303 is used to obtain the target data uploaded by the target device to the data access service cluster based on the communication protocol, and parse the target data based on the data parsing protocol;

[0086] The first sending module 304 is used to send the target data after parsing to a target storage node.

[0087] Optionally, please refer to Figure 4 , the data access processing device 300 further includes:

[0088] A second configuration module 305 is used to obtain a data type corresponding to the target device, and configure a data access service subset corresponding to the data type in the data access service cluster;

[0089] The processing module 303 is also used for:

[0090] Acquire target data uploaded to the first subset by the target device based on the communication protocol;

[0091] The data access service subset includes the first subset, and the data type corresponding to the first subset is the data type of the target data.

[0092] Optionally, please refer to Figure 5 , the data access processing device 300 further includes:

[0093] The second acquisition module 306 is used to acquire the data type of the offline target device;

[0094] The deleting module 307 is used to identify a second subset in the data access service cluster corresponding to the offline data type, and delete the second subset.

[0095] Optionally, the data access processing device 300 further includes:

[0096] The third configuration module is used to identify a business end that has a demand for acquiring the target data, and configure the business end as a target storage node for the target data.

[0097] Optionally, the data access processing device 300 further includes:

[0098] A fourth configuration module, configured to configure a response message format corresponding to the data response requirement when the target device has a data response requirement;

[0099] The second sending module is used to send a response message to the target device based on the response message format after sending the target data after parsing to the target storage node, wherein the response message is used to indicate that the target data after parsing has been sent to the target storage node.

[0100] Optionally, the data access processing device 300 further includes:

[0101] A third acquisition module is used to obtain log information corresponding to the data access service cluster;

[0102] A judgment module, used to judge whether the data access service cluster can perform reception and / or transmission of the target data based on the log information;

[0103] The processing module is further used to: when the data access service cluster fails to receive and / or send the target data, adjust the configuration of the data access service cluster, or reconfigure the data access service cluster corresponding to the target device.

[0104] The data access processing device 300 provided in the embodiment of the present disclosure can flexibly configure data access service clusters for different devices according to the communication protocol, so that the service platform is no longer limited to receiving data from specific devices, effectively improving the application scenarios and scope of the service platform.

[0105] It should be noted that the data access processing device 300 provided in the embodiment of the present disclosure can implement the above Figure 1 and Figure 2 The entire technical process of the data access processing method can achieve the same technical effect, so to avoid repetition, it will not be repeated here.

[0106] In the technical solution disclosed herein, the acquisition, storage and application of user personal information involved are in compliance with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0107] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium and a computer program product.

[0108] Figure 6A schematic block diagram of an example electronic device 600 that can be used to implement an embodiment of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or required herein.

[0109] like Figure 6 As shown, the device 600 includes a computing unit 601, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 602 or a computer program loaded from a storage unit 608 into a random access memory (RAM) 603. In the RAM 603, various programs and data required for the operation of the device 600 can also be stored. The computing unit 601, the ROM 602, and the RAM 603 are connected to each other via a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.

[0110] A number of components in the device 600 are connected to the I / O interface 605, including: an input unit 606, such as a keyboard, a mouse, etc.; an output unit 607, such as various types of displays, speakers, etc.; a storage unit 608, such as a disk, an optical disk, etc.; and a communication unit 609, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 609 allows the device 600 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0111] The computing unit 601 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 601 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 601 performs the various methods and processes described above, such as the above-mentioned data access processing method. For example, in some embodiments, the data access processing method may be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as a storage unit 608. In some embodiments, part or all of the computer program may be loaded and / or installed on the device 600 via the ROM 602 and / or the communication unit 609. When the computer program is loaded into the RAM 603 and executed by the computing unit 601, one or more steps of the data access processing method described above may be performed. Alternatively, in other embodiments, the computing unit 601 may be configured to perform the data access processing method in any other appropriate manner (e.g., by means of firmware).

[0112] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0113] The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, enables the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0114] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0115] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0116] The systems and techniques described herein may be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), and the Internet.

[0117] A computer system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The relationship of client and server is generated by computer programs running on respective computers and having a client-server relationship with each other. The server may be a cloud server, a server of a distributed system, or a server combined with a blockchain.

[0118] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this disclosure can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved, and this document does not limit this.

[0119] The above specific implementations do not constitute a limitation on the protection scope of the present disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present disclosure shall be included in the protection scope of the present disclosure.

Claims

1. A data access processing method, include: Obtain the communication protocol and data parsing protocol corresponding to the target device; According to the communication protocol corresponding to the target device, configure the data access service cluster corresponding to the target device; Acquire target data uploaded by the target device to the data access service cluster based on the communication protocol, and parse and process the target data based on the data parsing protocol; Sending the parsed target data to a target storage node; The obtaining target data uploaded by the target device to the data access service cluster based on the communication protocol includes: Acquire address information of a data access service cluster corresponding to the target device, configure the address information into the target device, and start the target device; The target device is obtained according to the address information and target data uploaded to the data access service cluster based on the communication protocol.

2. The method according to claim 1, in, After configuring the data access service cluster corresponding to the target device, the method further includes: Acquire a data type corresponding to the target device, and configure a data access service subset corresponding to the data type in the data access service cluster; The obtaining target data uploaded by the target device to the data access service cluster based on the communication protocol includes: Acquire target data uploaded to the first subset by the target device based on the communication protocol; The data access service subset includes the first subset, and the data type corresponding to the first subset is the data type of the target data.

3. The method according to claim 2, in, After configuring the data access service subset corresponding to the data type in the data access service cluster, the method further includes: Obtaining the offline data type of the target device; A second subset corresponding to the offline data type in the data access service cluster is identified, and the second subset is deleted.

4. The method according to claim 1, in, Before sending the parsed target data to the target storage node, the method further includes: A business end having a demand for acquiring the target data is identified, and the business end is configured as a target storage node for the target data.

5. The method according to any one of claims 1 to 4, further comprising: include: In the case where the target device has a data response requirement, configuring a response message format corresponding to the data response requirement; After the target data after parsing is sent to the target storage node, a response message is sent to the target device based on the response message format, wherein the response message is used to indicate that the target data after parsing has been sent to the target storage node.

6. The method according to any one of claims 1 to 4, further comprising: include: Obtaining log information corresponding to the data access service cluster; Determining whether the data access service cluster can receive and / or send the target data based on the log information; In the case that the data access service cluster fails to receive and / or send the target data, the configuration of the data access service cluster is adjusted, or the data access service cluster corresponding to the target device is reconfigured.

7. A data access processing device, include: A first acquisition module, used to acquire the communication protocol and data parsing protocol corresponding to the target device; A first configuration module, configured to configure a data access service cluster corresponding to the target device according to a communication protocol corresponding to the target device; A processing module, used for acquiring target data uploaded by the target device to the data access service cluster based on the communication protocol, and performing parsing processing on the target data based on the data parsing protocol; A first sending module, used for sending the target data after parsing to a target storage node; The processing module is specifically used for: Acquire address information of a data access service cluster corresponding to the target device, configure the address information into the target device, and start the target device; The target device is obtained according to the address information and target data uploaded to the data access service cluster based on the communication protocol.

8. The device according to claim 7, in, The device also includes: A second configuration module is used to obtain a data type corresponding to the target device, and configure a data access service subset corresponding to the data type in the data access service cluster; The processing module is also used for: Acquire target data uploaded to the first subset by the target device based on the communication protocol; The data access service subset includes the first subset, and the data type corresponding to the first subset is the data type of the target data.

9. The device according to claim 8, in, The device also includes: A second acquisition module is used to acquire the data type of the offline target device; The deletion module is used to identify a second subset in the data access service cluster corresponding to the offline data type, and delete the second subset.

10. The device according to claim 7, in, The device also includes: The third configuration module is used to identify a business end that has a demand for acquiring the target data, and configure the business end as a target storage node for the target data.

11. The device according to any one of claims 7 to 10, in, The device also includes: A fourth configuration module, configured to configure a response message format corresponding to the data response requirement when the target device has a data response requirement; The second sending module is used to send a response message to the target device based on the response message format after sending the target data after parsing to the target storage node, wherein the response message is used to indicate that the target data after parsing has been sent to the target storage node.

12. The device according to any one of claims 7 to 10, in, The device also includes: A third acquisition module is used to obtain log information corresponding to the data access service cluster; A judgment module, used to judge whether the data access service cluster can perform reception and / or transmission of the target data based on the log information; The processing module is further used to: when the data access service cluster fails to receive and / or send the target data, adjust the configuration of the data access service cluster, or reconfigure the data access service cluster corresponding to the target device.

13. An electronic device, include: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 6.

14. A non-transitory computer-readable storage medium storing computer instructions, in, The computer instructions are used to cause the computer to execute the method according to any one of claims 1-6.

15. A computer program product, comprising a computer program, which, when executed by a processor, implements the method according to any one of claims 1 to 6.

Images