Data Processing Method, Apparatus, and Storage Medium

By using electronic devices and AI models to process data on IoT devices and uploading them directly to the server, the problem of low data synchronization efficiency of IoT devices is solved, and efficient data synchronization and AI model optimization is achieved.

CN110659330BActive Publication Date: 2025-05-27BEIJING BAIDU NETCOM SCI & TECH CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN201910900339.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2019-09-23
Publication Date
2025-05-27
Estimated Expiration
2039-09-23

AI Technical Summary

Technical Problem

The prior art is inefficient and labor-intensive when processing and synchronizing massive data on IoT devices, especially in the process of data synchronization between edge computing devices and cloud servers.

Method used

Data from IoT devices are obtained through electronic devices, and data is processed using preset data processing strategies and AI models, and data is generated to be published, which is directly uploaded to the server to achieve data synchronization.

Benefits of technology

It improves data synchronization efficiency between edge computing devices and servers, reduces labor costs, and implements traffic limits and AI model optimization functions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN110659330B_ABST
    Figure CN110659330B_ABST
Patent Text Reader

Abstract

The present application discloses a data processing method, device and storage medium, which are related to the fields of Internet of Things and cloud computing. The specific implementation scheme is: an electronic device obtains data of a first topic of an Internet of Things device; the electronic device processes the data of the first topic using an artificial intelligence AI model according to a preset data processing strategy to obtain processed data; the electronic device generates data of a second topic to be published from the processed data, and sends the data of the second topic to a server. This scheme realizes data synchronization between the electronic device and the server, and is highly efficient.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a data processing method, device and storage medium in the Internet of Things. Background Art

[0002] With the continuous development of IoT technology, more and more devices are connected to IoT, and IoT technology has been widely used. Therefore, more and more data is generated on IoT devices. Due to the limited computing power and network bandwidth of IoT devices, in order to meet the needs of real-time response, edge computing has become one of the new trends in the development of IoT.

[0003] Artificial Intelligence (AI) inference, function computing and other services are often run on edge computing devices. On the one hand, these services generate a large amount of data results, including videos, image files, AI inference results, etc. On the other hand, edge computing devices also generate a large number of system logs. In the IoT scenario, it is very important to synchronize the massive data generated by edge computing devices to cloud servers.

[0004] The main way to solve this problem is to manually operate the edge computing device and manually copy the required files to synchronize the data to the cloud server. The above method has low processing efficiency and also wastes huge manpower costs. Summary of the invention

[0005] The present application provides a data processing method, device and storage medium to achieve data synchronization between edge computing devices and servers with high efficiency.

[0006] The first aspect of the present application provides a data processing method, comprising:

[0007] The electronic device obtains data of the first topic of the IoT device;

[0008] The electronic device processes the data of the first subject using an artificial intelligence (AI) model according to a preset data processing strategy to obtain processed data;

[0009] The electronic device generates data of a second topic to be published using the processed data, and sends the data of the second topic to a server.

[0010] In the above scheme, the electronic device obtains the data of the first topic of the IoT device; the electronic device processes the data of the first topic using the artificial intelligence AI model according to the preset data processing strategy to obtain the processed data; the electronic device generates the data of the second topic to be published from the processed data, and sends the data of the second topic to the server. This scheme realizes data synchronization between the electronic device and the server with high efficiency.

[0011] In a possible implementation manner, the electronic device stores the processed data;

[0012] The electronic device generates a message of a third topic according to the storage address of the processed data; the message of the third topic includes the storage address of the processed data;

[0013] The electronic device generates data of a second topic to be published from the processed data, including:

[0014] The electronic device generates data of the second topic to be published from the processed data according to the message of the third topic.

[0015] In a possible implementation, the method further includes:

[0016] The electronic device converts the data of the fourth topic into data of the fifth topic according to a preset forwarding rule, and sends the data of the fifth topic to the server.

[0017] In a possible implementation, the electronic device converts the data of the fourth topic into the data of the fifth topic according to a preset forwarding rule, including:

[0018] The electronic device generates a message of a sixth topic according to the data of the fourth topic, wherein the message of the sixth topic includes a storage address of the data of the fourth topic;

[0019] The electronic device converts the data of the fourth topic into the data of the fifth topic according to the message of the sixth topic and a preset forwarding rule.

[0020] In the above scheme, the data obtained from the IoT device or the local data of the electronic device is directly uploaded to the server, thereby realizing data synchronization between the electronic device and the server.

[0021] In a possible implementation, before sending the data of the second topic to the server, the method further includes:

[0022] The electronic device determines whether the sum of the amount of data sent to the server and the amount of data after the processing exceeds a preset data amount threshold;

[0023] If not, the electronic device sends the data of the second subject to the server.

[0024] In a possible implementation manner, after the electronic device sends the data of the second subject to the server, the method further includes:

[0025] The electronic device records the sum of the amount of data sent to the server and the amount of the processed data, and updates the amount of data sent to the server.

[0026] In the above solution, the function of flow restriction is realized.

[0027] In a possible implementation, the method further includes:

[0028] The electronic device receives the optimized AI model sent by the server; the optimized AI model is obtained by the server optimizing the established AI model according to the received processed data;

[0029] The electronic device processes the data sent by the IoT device according to the optimized AI model.

[0030] In the above implementation, the processed data of the AI ​​model is uploaded to the cloud server and the AI ​​model is continuously optimized to form positive feedback.

[0031] In a possible implementation, before sending the data of the second topic to the server, the method further includes:

[0032] The electronic device establishes a connection with the server according to configuration information; the configuration information includes: address information of the server and subject information supported by the server.

[0033] A second aspect of the present application provides a data processing device, including:

[0034] An acquisition module, used to acquire data of a first topic of an IoT device;

[0035] A processing module, used to process the data of the first subject using an artificial intelligence (AI) model according to a preset data processing strategy to obtain processed data;

[0036] The processing module is further used to generate data of a second topic to be published from the processed data;

[0037] A sending module is used to send the data of the second topic to the server.

[0038] A third aspect of the present application provides an electronic device, including:

[0039] at least one processor; and

[0040] a memory communicatively connected to the at least one processor; wherein,

[0041] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute any method in the first aspect of the present application.

[0042] A fourth aspect of the present application provides a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to enable the computer to execute any method according to the first aspect of the present application.

[0043] One embodiment of the above application has the following advantages or beneficial effects: the electronic device obtains data of a first topic of an IoT device; the electronic device processes the data of the first topic using an artificial intelligence AI model according to a preset data processing strategy to obtain processed data; the electronic device generates data of a second topic to be published from the processed data, and sends the data of the second topic to a server. This solution realizes data synchronization between the electronic device and the server with high efficiency.

[0044] Other effects of the above optional manner will be described below in conjunction with specific embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] The accompanying drawings are used to better understand the present solution and do not constitute a limitation of the present application.

[0046] Figure 1 An application scenario architecture diagram provided for an embodiment of the present application;

[0047] Figure 2 A flowchart of a data processing method provided in one embodiment of the present application;

[0048] Figure 3 A schematic diagram of a principle provided for an embodiment of the present application;

[0049] Figure 4 A schematic diagram of the structure of a data processing device provided in one embodiment of the present application;

[0050] Figure 5 A schematic diagram of the hardware structure of an electronic device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0051] The following is a description of exemplary embodiments of the present application in conjunction with the accompanying drawings, including various details of the embodiments of the present application to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of the present application. Similarly, for the sake of clarity and conciseness, the description of well-known functions and structures is omitted in the following description.

[0052] Before introducing the method provided by this application, first Figure 1 The application scenarios of the embodiments of the present application are introduced. Figure 1 This is an application scenario architecture diagram provided by the embodiment of the present application. Figure 1 As shown, the application scenario includes an IoT device 11, an electronic device 12 and a server 13; the IoT device 11 may include, for example, a video acquisition device (such as a surveillance camera), a vehicle-mounted device, a smart home device, etc. Electronic devices are edge computing devices such as computers.

[0053] Among them, the Internet of Things device 11 and the electronic device 12, and the electronic device 12 and the server 13 can be connected through the network.

[0054] The method provided by the present invention can be implemented by an electronic device such as a processor executing corresponding software codes, or can be implemented by an electronic device executing corresponding software codes while performing data interaction with a server.

[0055] The technical solution of the present application is described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. For ease of understanding, the specific examples in the following embodiments are described using the big data field as an example, but are not limited to this application scenario.

[0056] Figure 2 The following is a flow chart of a data processing method provided by an embodiment of the present application. Figure 2 As shown, the method provided in this embodiment includes the following steps:

[0057] S101, the electronic device obtains data of a first topic of the Internet of Things device;

[0058] Specifically, the electronic device obtains data of the Internet of Things device, and the data is, for example, data of a first topic, and the first topic is a topic supported by the electronic device.

[0059] Before sending data, the IoT device establishes a connection with the electronic device based on the acquired configuration information, such as the permission information for connecting to the electronic device and the themes that the electronic device can support. The permission information includes the account number, password and other information of the electronic device.

[0060] S102, the electronic device processes the data of the first subject using an artificial intelligence AI model according to a preset data processing strategy to obtain processed data;

[0061] In one implementation, the AI ​​model is used to process the data of the first topic. For example, the corresponding data processing instance can be called to process the data. The data processing instance includes, but is not limited to, AI inference functions, SQL statements, P5thon, Node.js, Java, C# and other functions, which makes it convenient for developers to choose familiar languages ​​to develop data processing instances and improve product usability.

[0062] Among them, the data processing strategy, for example, processes the data of topic A through AI model a and then sends it as the data of topic B.

[0063] S103: The electronic device generates data of a second topic to be published from the processed data, and sends the data of the second topic to the server.

[0064] Specifically, the processed data is used to generate data of a second theme, where the second theme is a theme supported by the server, and the data of the second theme is sent to the server. Whether the data synchronization is successful is verified by viewing the files stored in the server.

[0065] In one implementation, before sending data to the server, the electronic device establishes a connection with the server according to configuration information; the configuration information includes: address information of the server and information on topics supported by the server.

[0066] The configuration information may also include authentication information, such as key information of the electronic device, to verify the electronic device when establishing a connection, and if the verification is successful, the connection is established.

[0067] In the method of this embodiment, the electronic device obtains the data of the first topic of the IoT device; the electronic device processes the data of the first topic using the artificial intelligence AI model according to the preset data processing strategy to obtain the processed data; the electronic device generates the data of the second topic to be published from the processed data, and sends the data of the second topic to the server. This solution realizes data synchronization between the electronic device and the server with high efficiency.

[0068] On the basis of the above embodiment, further, the following operations may be performed after step S102:

[0069] The electronic device stores the processed data;

[0070] The electronic device generates a message of the third subject according to the storage address of the processed data; the message of the third subject includes the storage address of the processed data;

[0071] Accordingly, step S103 can be implemented by the following steps:

[0072] The electronic device generates data of the second topic to be published from the processed data according to the message of the third topic, and sends the data of the second topic to the server.

[0073] Specifically, the data processed by the AI ​​model can be stored in the local disk of the electronic device, and a message of the third topic can be generated. The message of the third topic includes the storage address of the processed data, that is, the file path of the processed data in the local disk. The third topic is the topic subscribed by the upload module.

[0074] In the above method, the processed data is persistently stored in the local disk, which can achieve the persistence of abnormal status.

[0075] In an optional embodiment, if Figure 3 As shown, the message processing module can send the acquired data of the IoT device to the data processing module, which uses the AI ​​model for processing and stores the processed data in the local disk. The message processing module generates a message of the third topic and sends it to the upload module; the upload module obtains the processed data according to the storage address included in the message of the third topic, and generates the data of the second topic to be published from the processed data, and sends it to the server. The IoT device is, for example, a video acquisition device that collects video data. Data processing, for example, recognizes the face in each frame of the video data, marks the position of the face in the image, and obtains multiple frames of processed images.

[0076] Based on the above embodiment, the method of this embodiment may further include:

[0077] The electronic device converts the data of the fourth topic into the data of the fifth topic according to a preset forwarding rule, and sends the data of the fifth topic to the server.

[0078] The data of the fourth topic may be data sent by IoT devices, such as videos, image files, etc., or data stored locally in electronic devices, such as system logs, device status information, etc. The forwarding rule refers to directly converting the data of topic A into data of topic B before sending it.

[0079] In one implementation, the above “the electronic device converts the data of the fourth topic into the data of the fifth topic according to a preset forwarding rule” can be implemented by the following steps:

[0080] The electronic device generates a message of a sixth topic according to the data of the fourth topic, wherein the message of the sixth topic includes a storage address of the data of the fourth topic;

[0081] The electronic device converts the data of the fourth topic into the data of the fifth topic according to the message of the sixth topic and the preset forwarding rule.

[0082] Specifically, Figure 3 As shown, the message processing module can generate a message of the sixth topic based on the data of the fourth topic obtained, and send it to the upload module. The upload module obtains the data of the fourth topic according to the storage address included in the message of the sixth topic, and generates the data of the fifth topic to be published from the data of the fourth topic, and sends it to the server. Among them, the sixth topic is the topic subscribed by the upload module, and the fifth topic is the topic supported by the server.

[0083] Based on the above embodiment, before sending the data to the server, the following operations may also be performed:

[0084] The electronic device determines whether the sum of the amount of data sent to the server and the amount of processed data exceeds a preset data amount threshold;

[0085] If not, the electronic device sends the data of the second subject to the server.

[0086] Specifically, the electronic device can implement flow control for uploading files to the server. For example, before sending the current data to be sent, determine whether the data stream sent to the server exceeds the preset data volume threshold, if so, stop sending, if not, further determine whether the sum of the amount of data sent to the server and the amount of data currently to be sent exceeds the preset data volume threshold, if the sum of the amount of data sent to the server and the amount of data currently to be sent does not exceed the data volume threshold, then send the current data to be sent to the server, the current data to be sent, for example, the data of the second topic (including the data processed by the AI ​​model), or the data of the fifth topic.

[0087] In one implementation, if it is determined that the sum of the amount of data sent to the server and the amount of data currently to be sent exceeds the data amount threshold, the electronic device records the sum of the amount of data sent to the server and the amount of processed data, and updates the amount of data sent to the server.

[0088] That is, the electronic device records the sum of the amount of data sent to the server and the amount of data to be sent currently, and updates the amount of data sent to the server, that is, updates the amount of data sent to the server to the sum of the above two amounts.

[0089] In an optional implementation, breakpoint resume transmission may also be implemented, for example, the current data to be sent is divided into at least two parts and sent through different threads.

[0090] In an optional implementation, the data may be compressed before being sent to the server, and the present application does not limit the method of compression.

[0091] In the above implementation method, the function of flow restriction is realized.

[0092] On the basis of the above embodiment, further, the method of this embodiment may also include:

[0093] The electronic device receives the optimized AI model sent by the server; the optimized AI model is obtained by the server optimizing the established AI model according to the received processed data;

[0094] The electronic device processes the data sent by the IoT device according to the optimized AI model.

[0095] Specifically, after the electronic device sends data to the cloud server, the cloud server optimizes the AI ​​model based on the received data and sends the optimized AI model to the electronic device.

[0096] Electronic devices process the data sent by IoT devices based on the optimized AI model.

[0097] In the above implementation, the processed data of the AI ​​model is uploaded to the cloud server and the AI ​​model is continuously optimized to form positive feedback.

[0098] In one implementation, Figure 3 As shown, the message processing module can be used to configure the connection permissions between the IoT device and the electronic device, as well as the topic sending and subscription permissions of the IoT device; the data processing module is used to formulate data processing strategies, configure function instance startup information, etc., use AI models to process data or use other data processing methods for processing.

[0099] The cloud proxy module is used to configure the connection between the electronic device and the cloud server, authentication information, and subject information of data transmission, etc., to obtain the AI ​​model issued by the server, and to receive messages forwarded by the cloud server by subscribing to the corresponding topic. The connection methods used by the cloud proxy module to establish a connection with the cloud server include, but are not limited to, TCP, SSL one-way authentication, SSL two-way authentication, etc.

[0100] The data format of the configuration information in the embodiments of the present application includes, but is not limited to, JSON, 5AML, XML, etc.

[0101] The upload module is used to upload local file data of the electronic device and limit the traffic of the uploaded data. The upload module can configure the server address and the authority of the electronic device to access the server, the breakpoint resume capability, the traffic limit function information, and the theme information of the supported received messages.

[0102] The cloud server includes, for example: a device access service module, an object storage service module, and an AI training platform.

[0103] According to the method of the embodiment of the present application, an electronic device (such as an edge computing device) is deployed locally near the IoT device end, and an inference function computing instance of the AI ​​model can be configured at the same time. This can realize the reception and forwarding of messages nearby to reduce latency, and at the same time, the inference function computing instance of the configured AI model is used to process data. The processing results can be uploaded to the cloud server based on traffic control.

[0104] To sum up, on the one hand, by utilizing data collection of localized IoT devices and data processing of electronic devices, the message security is ensured to be sufficient while also improving the message processing performance to a certain extent; on the other hand, electronic devices can also customize synchronization strategies, such as storing data in file collections, the storage location of file collections, traffic restrictions, file compression methods, etc., and uploading data file collections to cloud servers.

[0105] Figure 4 This is a schematic diagram of the structure of a data processing device provided in one embodiment of the present application. Figure 4 As shown, the data processing device 400 provided in this embodiment includes:

[0106] An acquisition module 401 is used to acquire data of a first topic of an IoT device;

[0107] The processing module 402 is used to process the data of the first subject using an artificial intelligence AI model according to a preset data processing strategy to obtain processed data;

[0108] The processing module 402 is further used to generate data of a second topic to be published from the processed data;

[0109] The sending module 403 is used to send the data of the second topic to the server.

[0110] In a possible implementation, the method further includes:

[0111] A storage module, used for storing the processed data;

[0112] The processing module 402 is further configured to generate a message of a third topic according to the storage address of the processed data; the message of the third topic includes the storage address of the processed data;

[0113] According to the message of the third topic, the processed data is used to generate data of the second topic to be published.

[0114] In a possible implementation, the processing module 402 is further configured to:

[0115] According to a preset forwarding rule, the data of the fourth topic is converted into the data of the fifth topic, and the data of the fifth topic is sent to the server.

[0116] In a possible implementation, the processing module 402 is specifically configured to:

[0117] Generate a message of a sixth topic according to the data of the fourth topic, wherein the message of the sixth topic includes a storage address of the data of the fourth topic;

[0118] According to the message of the sixth topic and the preset forwarding rule, the data of the fourth topic is converted into the data of the fifth topic.

[0119] In the above scheme, the data obtained from the IoT device or the local data of the electronic device is directly uploaded to the server, thereby realizing data synchronization between the electronic device and the server.

[0120] In a possible implementation, the processing module 402 is further configured to:

[0121] Determining whether the sum of the amount of data sent to the server and the amount of data after the processing exceeds a preset data amount threshold;

[0122] If not, the sending module 403 is used to send the data of the second topic to the server.

[0123] In a possible implementation, the processing module 402 is further configured to:

[0124] The sum of the amount of data sent to the server and the amount of processed data is recorded, and the amount of data sent to the server is updated.

[0125] In the above solution, the function of flow restriction is realized.

[0126] In a possible implementation, the method further includes:

[0127] A receiving module, configured to receive an optimized AI model sent by a server; the optimized AI model is obtained by the server optimizing an established AI model according to the received processed data;

[0128] The processing module 402 is further used to process the data sent by the IoT device according to the optimized AI model.

[0129] In the above implementation, the processed data of the AI ​​model is uploaded to the cloud server and the AI ​​model is continuously optimized to form positive feedback.

[0130] In a possible implementation, the processing module 402 is further configured to:

[0131] A connection is established with the server according to configuration information; the configuration information includes: address information of the server and information on themes supported by the server.

[0132] The data processing device provided in the embodiment of the present application can execute the technical solution in any of the above method embodiments, and its implementation principle and technical effects are similar, which will not be repeated here.

[0133] According to an embodiment of the present application, the present application also provides an electronic device and a readable storage medium.

[0134] like Figure 5 , is a block diagram of an electronic device according to a method for data processing of an embodiment of the present application. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workbenches, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present application described and / or required herein.

[0135] like Figure 5As shown, the electronic device includes: one or more processors 501, a memory 502, and interfaces for connecting various components, including high-speed interfaces and low-speed interfaces. The various components are interconnected using different buses and can be installed on a common mainboard or installed in other ways as needed. The processor can process instructions executed in the electronic device, including instructions stored in or on the memory to display the graphical information of the GUI on an external input / output device (such as a display device coupled to the interface). In other embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories and multiple memories. Similarly, multiple electronic devices can be connected, and each device provides some necessary operations (for example, as a server array, a group of blade servers, or a multi-processor system). Figure 5 A processor 501 is taken as an example.

[0136] The memory 502 is a non-transitory computer-readable storage medium provided in the present application. The memory stores instructions executable by at least one processor to enable the at least one processor to perform the data processing method provided in the present application. The non-transitory computer-readable storage medium of the present application stores computer instructions, which are used to enable a computer to perform the data processing method provided in the present application.

[0137] The memory 502 is a non-transient computer-readable storage medium that can be used to store non-transient software programs, non-transient computer executable programs and modules, such as program instructions / modules corresponding to the data processing method in the embodiment of the present application (for example, the attached Figure 4 The processor 501 executes various functional applications and data processing of the server by running the non-transient software programs, instructions and modules stored in the memory 502, that is, the data processing method in the above method embodiment is implemented.

[0138] The memory 502 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created according to the use of the electronic device, etc. In addition, the memory 502 may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some embodiments, the memory 502 may optionally include a memory remotely arranged relative to the processor 501, and these remote memories may be connected to the electronic device for data processing via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0139] The electronic device of the data processing method may further include: an input device 503 and an output device 504. The processor 501, the memory 502, the input device 503 and the output device 504 may be connected via a bus or other means. Figure 5 The example of connecting through bus is taken in the following.

[0140] The input device 503 can receive input digital or character information, and generate key signal input related to user settings and function control of the electronic device for data processing, such as a touch screen, a keypad, a mouse, a track pad, a touch pad, an indicator bar, one or more mouse buttons, a trackball, a joystick and other input devices. The output device 504 may include a display device, an auxiliary lighting device (e.g., an LED) and a tactile feedback device (e.g., a vibration motor), etc. The display device may include, but is not limited to, a liquid crystal display (LCD), a light emitting diode (LED) display and a plasma display. In some embodiments, the display device may be a touch screen.

[0141] Various implementations of the systems and techniques described herein can be realized in digital electronic circuit systems, integrated circuit systems, dedicated ASICs (application specific integrated circuits), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0142] These computer programs (also referred to as programs, software, software applications, or code) include machine instructions for programmable processors and can be implemented using high-level procedural and / or object-oriented programming languages, and / or assembly / machine languages. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, device, and / or means (e.g., disk, optical disk, memory, programmable logic device (PLD)) for providing machine instructions and / or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal for providing machine instructions and / or data to a programmable processor.

[0143] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0144] The systems and techniques described herein may be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), and the Internet.

[0145] A computer system may include clients and servers. Clients and servers are generally remote from each other and usually interact through a communication network. The relationship of client and server is generated by computer programs running on respective computers and having a client-server relationship to each other.

[0146] According to the technical solution of the embodiment of the present application, the electronic device obtains the data of the first topic of the IoT device; the electronic device processes the data of the first topic using the artificial intelligence AI model according to the preset data processing strategy to obtain the processed data; the electronic device generates the data of the second topic to be published from the processed data, and sends the data of the second topic to the server. This solution realizes data synchronization between the electronic device and the server with high efficiency.

[0147] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this application can be executed in parallel, sequentially or in different orders, as long as the expected results of the technical solution disclosed in this application can be achieved, and this document is not limited here.

[0148] The above specific implementations do not constitute a limitation on the protection scope of this application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of this application should be included in the protection scope of this application.

Claims

1. A data processing method, characterized in that, it includes: An electronic device obtains data of a first topic of an Internet of Things device; the first topic is a topic supported by the electronic device; The electronic device processes the data of the first topic by using an artificial intelligence AI model according to a preset data processing strategy to obtain processed data; The electronic device generates data of a second topic to be published from the processed data and sends the data of the second topic to a server; The second topic is a topic supported by the server; After obtaining the processed data, it further includes: The electronic device stores the processed data; The electronic device generates a message of a third topic according to the storage address of the processed data; the message of the third topic includes the storage address of the processed data; The electronic device generates data of a second topic to be published from the processed data, including: The electronic device generates data of a second topic to be published from the processed data according to the message of the third topic.

2. The method according to claim 1, characterized in that, the method further includes: The electronic device converts data of a fourth topic into data of a fifth topic according to a preset forwarding rule and sends the data of the fifth topic to the server.

3. The method according to claim 2, characterized in that, The electronic device converts data of a fourth topic into data of a fifth topic according to a preset forwarding rule, including: The electronic device generates a message of a sixth topic according to the data of the fourth topic, and the message of the sixth topic includes the storage address of the data of the fourth topic; The electronic device converts the data of the fourth topic into the data of the fifth topic according to the message of the sixth topic and a preset forwarding rule.

4. The method according to any one of claims 1-3, characterized in that, before sending the data of the second topic to the server, it further includes: The electronic device determines whether the sum of the data volume already sent to the server and the data volume of the processed data exceeds a preset data volume threshold; If not, the electronic device sends the data of the second topic to the server.

5. The method according to claim 4, characterized in that, after the electronic device sends the data of the second topic to the server, it further includes: The electronic device records the sum of the data volume already sent to the server and the data volume of the processed data and updates the data volume already sent to the server.

6. The method according to any one of claims 1-3, characterized in that, it further includes: The electronic device receives an optimized AI model sent by the server; the optimized AI model is obtained by the server optimizing the established AI model according to the received processed data; The electronic device processes the data sent by the Internet of Things device according to the optimized AI model.

7. The method according to any one of claims 1-3, characterized in that, Before sending the data of the second topic to the server, it further includes: The electronic device establishes a connection with the server according to the configuration information; the configuration information includes: the address information of the server and the topic information supported by the server.

8. A data processing device Characterized in that It includes: An acquisition module, configured to acquire data of a first topic of an Internet of Things device; the first topic is a topic supported by the electronic device; A processing module, configured to perform data processing on the data of the first topic by using an artificial intelligence AI model according to a preset data processing strategy to obtain processed data; The processing module is further configured to generate data of a to-be-published second topic from the processed data; A sending module, configured to send the data of the second topic to the server; the second topic is a topic supported by the server; A storage module, configured to store the processed data; The processing module is further configured to generate a message of a third topic according to the storage address of the processed data; the message of the third topic includes the storage address of the processed data; Generate the data of the to-be-published second topic from the processed data according to the message of the third topic.

9. The device according to claim 8 Characterized in that The processing module is further configured to: Convert the data of the fourth topic into the data of the fifth topic according to a preset forwarding rule, and send the data of the fifth topic to the server.

10. The device according to claim 9 Characterized in that The processing module is specifically configured to: Generate a message of a sixth topic according to the data of the fourth topic, and the message of the sixth topic includes the storage address of the data of the fourth topic; Convert the data of the fourth topic into the data of the fifth topic according to the message of the sixth topic and a preset forwarding rule.

11. The device according to any one of claims 8-10 Characterized in that The processing module is further configured to: Determine whether the sum of the data volume already sent to the server and the data volume of the processed data exceeds a preset data volume threshold; If not, the sending module is configured to send the data of the second topic to the server.

12. The device according to claim 11 Characterized in that The processing module is further configured to: Record the sum of the data volume already sent to the server and the data volume of the processed data, and update the data volume already sent to the server.

13. The device according to any one of claims 8-10 Characterized in that It further includes: A receiving module, configured to receive an optimized AI model sent by the server; the optimized AI model is obtained by the server optimizing the established AI model according to the received processed data; The processing module is further configured to: process the data sent by the Internet of Things device according to the optimized AI model.

14. The device according to any one of claims 8-10 Characterized in that The processing module is further configured to: Establish a connection with the server according to the configuration information; the configuration information includes: the address information of the server and the topic information supported by the server.

15. An electronic device, characterized in that, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein, the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the method according to any one of claims 1-7.

16. A non-transitory computer-readable storage medium storing computer instructions, characterized in that, the computer instructions are used to cause the computer to execute the method according to any one of claims 1-7.

Citation Information

Patent Citations

  • Method for directly accessing hardware data into a big data platform

    CN109657003A