Intelligent Output Control Method, Device, Equipment and Medium Based on Cloud-Edge Hybrid

By evaluating the computing capabilities and types of hardware devices, determining the information control type and performing information processing, the problem that hardware devices cannot accurately control content output is solved, and timely and efficient content management is achieved.

CN115801630BActive Publication Date: 2025-07-04BEIJING TOPSEC NETWORK SECURITY TECH +2
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202211246819.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-10-12
Publication Date
2025-07-04
Estimated Expiration
2042-10-12

AI Technical Summary

Technical Problem

The prior art cannot accurately control the content output of different hardware devices, resulting in the inability to limit the playback and display of special information under specific users and environments.

Method used

By collecting attribute information of the hardware device, evaluating its computing capability level and device type, determining the information control type, and performing information processing based on preset configuration information, generating target information to control the output of the hardware device.

Benefits of technology

It realizes timely and precise control of the content output of hardware equipment, improves control efficiency, and adapts to monitoring strategies and content output management of different types of equipment.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115801630B_ABST
    Figure CN115801630B_ABST
Patent Text Reader

Abstract

An embodiment of the present disclosure discloses an intelligent output control method, device, electronic device, and storage medium based on cloud-edge hybrid. The method includes: collecting attribute information of the connected hardware device, performing performance evaluation on the hardware device based on the attribute information, and determining the computing power level of the hardware device; obtaining the device type of the hardware device, and determining the information control type corresponding to the hardware device based on the computing power level and the device type; obtaining the to-be-controlled information corresponding to the information control type of the hardware device and preset configuration information, performing information processing on the to-be-controlled information based on the preset configuration information to generate target information for the hardware device to output the target information. This application can adopt different monitoring strategies and control strategies based on the type and computing power of the hardware device, so as to achieve timely and accurate control of the output content of the hardware device.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application belongs to the technical field of the Internet of Things. Specifically, it relates to an intelligent output control method, device, equipment and medium based on cloud-edge hybrid. Background Art

[0002] With the progress of Internet and Internet of Things technologies, Internet data has become extremely complex, and various Internet of Things devices have entered various scenarios of people's daily lives. This leads to a problem that although the data transmitted in the Internet environment has been audited and checked by the uploading party, it is not suitable for playing and displaying in some specific users and usage scenarios. For example, intelligent devices used by specific users need to restrict special nature application software, and special information cannot be displayed in specific environments, etc.

[0003] Therefore, there is an urgent need to provide an automatic and efficient intelligent output control method. Summary of the Invention

[0004] This application provides an intelligent output control method, device, equipment and medium based on cloud-edge hybrid, which effectively solves the problem that the content output cannot be accurately controlled for different hardware devices.

[0005] To achieve the above object, an embodiment of this application provides an intelligent output control method based on cloud-edge hybrid, and the method includes:

[0006] Collect the attribute information of the accessed hardware device, perform performance evaluation on the hardware device based on the collected attribute information, and determine the computing power level of the hardware device;

[0007] Obtain the device type of the hardware device, and determine the information control type corresponding to the hardware device based on the computing power level and device type;

[0008] Obtain the to-be-controlled information and preset configuration information corresponding to the information control type of the hardware device, perform information processing on the to-be-controlled information based on the preset configuration information, and generate target information for the hardware device to output the target information.

[0009] Optionally, when the computing power level of the hardware device is low, the information control type includes the transmitted data during the data communication process of the hardware device;

[0010] The obtaining the to-be-controlled information corresponding to the information control type of the hardware device, performing information processing on the to-be-controlled information based on the preset configuration information, and generating target information for the hardware device to output the target information includes:

[0011] The edge network node obtains the transmitted data during the communication process of the hardware device;

[0012] When the transmission data needs to be processed, process the transmission data based on the preset configuration information to obtain the target information;

[0013] Send the target information to the hardware device for output display.

[0014] Optionally, when the computing power level of the hardware device is high, the information control type includes the transmission data during the data communication process of the hardware device;

[0015] The information processing of the to-be-controlled information based on the preset configuration information to generate target information for the hardware device to output the target information includes:

[0016] The edge network node obtains the cached data of the hardware device accessing the Internet;

[0017] When the cached data needs to be processed, process the cached data based on the preset configuration information to obtain the target information;

[0018] Send the target information to the hardware device for output display.

[0019] Optionally, the information control type further includes software operation information and / or device operation information, and the method further includes:

[0020] The edge network node obtains the software operation information and / or device operation information of the hardware device;

[0021] Control the software operation state and / or device operation state of the hardware device according to the preset configuration information, the software operation information and / or device operation information.

[0022] Optionally, the when it is recognized that the cached data needs to be processed, processing the cached data based on the preset configuration information to obtain the target information includes:

[0023] Estimate the computing power required for processing the cached data according to the configuration information. When the computing power level of the hardware device meets the pre-estimated computing power requirement, control the hardware device to process the cached data based on the configuration information to obtain the target information.

[0024] Optionally, the obtaining the device type of the hardware device and determining the information control type corresponding to the hardware device based on the computing power level and device type includes:

[0025] Obtain a pre-determined mapping table of device types and information control types;

[0026] Determine a first information control type corresponding to the hardware device based on the device type of the hardware device and the mapping table;

[0027] Based on the computing power level, screen the first information control type to obtain a second information control type;

[0028] Use the second information control type as the information control type finally corresponding to the hardware device.

[0029] Optionally, the information processing the to-be-controlled information based on the preset configuration information to generate target information for the hardware device to output the target information includes:

[0030] Monitor and identify the to-be-controlled information, and determine whether the to-be-controlled information needs to be processed according to the identification result;

[0031] When it is determined that the to-be-controlled information needs to be processed, call a data processing model corresponding to the configuration information to process the to-be-controlled information to generate the target information;

[0032] Control the hardware device to output the target information.

[0033] Optionally, the method further includes:

[0034] At every preset time interval or when the edge network node is idle, self-train the data processing model to obtain an updated data processing model; or

[0035] When there is an updated data processing model in the cloud or the edge network, obtain the updated data processing model.

[0036] Optionally, the information processing includes at least one of audio-visual processing, picture processing, and text processing;

[0037] The preset configuration information includes scenario configuration information and / or user configuration information.

[0038] Optionally, the attribute information includes one or more of a processor, a microcontroller, a memory, an external memory, and an operating system.

[0039] An embodiment of the present application further provides an intelligent output control device based on cloud-edge hybrid, and the device includes:

[0040] An evaluation module, configured to collect attribute information of an access hardware device, perform performance evaluation on the hardware device based on the collected attribute information, and determine the computing power level of the hardware device;

[0041] A type determination module, configured to obtain the device type of the hardware device, and determine an information control type corresponding to the hardware device based on the computing power level and the device type;

[0042] A processing and control module, configured to obtain the information to be controlled corresponding to the information control type of the hardware device and preset configuration information, perform information processing on the information to be controlled based on the preset configuration information, and generate target information for the hardware device to output the target information.

[0043] An embodiment of the present application further provides an electronic device, including: at least one processor; and a memory communicatively connected to the at least one processor; wherein, the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the above-mentioned intelligent output control method based on cloud-edge hybrid.

[0044] An embodiment of the present application further provides a computer-readable storage medium, which stores computer instructions for causing a computer to execute the above-mentioned intelligent output control method based on cloud-edge hybrid.

[0045] The intelligent output control method, device, equipment and medium based on cloud-edge hybrid proposed in the embodiments of the present application collect the attribute information of the accessed hardware device, perform performance evaluation on the hardware device based on the collected attribute information, and determine the computing power level of the hardware device; obtain the device type of the hardware device, and determine the information control type corresponding to the hardware device based on the computing power level and the device type; obtain the information to be controlled corresponding to the information control type of the hardware device and preset configuration information, perform information processing on the information to be controlled based on the preset configuration information, and generate target information for the hardware device to output the target information. By adopting different monitoring strategies and control strategies for different types of hardware devices, timely and accurate control of the output content of the hardware device is realized; at the same time, different control strategies are adopted based on the computing power information of the hardware device, which can improve the efficiency of content output control of the hardware device.

[0046] The above description is only an overview of the technical solution of the present disclosure. In order to understand the technical means of the present disclosure more clearly, it can be implemented according to the content of the specification. And in order to make the above and other purposes, features and advantages of the present disclosure more obvious and understandable, the following specific preferred embodiments are given and described in detail in conjunction with the drawings. Description of the Drawings

[0047] To more clearly illustrate the technical solutions of the embodiments of the present disclosure, the accompanying drawings required for the embodiments will be briefly introduced below. Obviously, the accompanying drawings in the following description are only some embodiments of the present disclosure. For those of ordinary skill in the art, without creative efforts, other accompanying drawings can be obtained based on these drawings.

[0048] Figure 1 It is a flowchart of an intelligent output control method based on cloud-edge hybrid in an embodiment;

[0049] Figure 2 It is a structural block diagram of an intelligent output control device based on cloud-edge hybrid in an embodiment;

[0050] Figure 3 It is an internal structure diagram of a computer device in an embodiment. Detailed implementation manners

[0051] The embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings.

[0052] It should be clear that the following illustrates the implementation manners of the present disclosure through specific specific examples. Those skilled in the art can easily understand other advantages and effects of the present disclosure from the content disclosed in this specification. Obviously, the described embodiments are only part of the embodiments of the present disclosure, rather than all the embodiments. The present disclosure can also be implemented or applied through other different specific implementation manners. Various details in this specification can also be modified or changed based on different viewpoints and applications without departing from the spirit of the present disclosure. It should be noted that, without conflict, the following embodiments and the features in the embodiments can be combined with each other. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in the present disclosure without creative efforts belong to the scope of protection of the present disclosure.

[0053] It should be noted that the following describes various aspects of the embodiments within the scope of the appended claims. It should be obvious that the aspects described herein can be embodied in a wide variety of forms, and any specific structure and / or function described herein is illustrative only. Based on the present disclosure, those skilled in the art should understand that one aspect described herein can be implemented independently of any other aspect, and two or more of these aspects can be combined in various ways. For example, any number of aspects described herein can be used to implement the device and / or practice the method. In addition, this device and / or this method can be implemented using other structures and / or functions in addition to one or more of the aspects described herein.

[0054] It should also be noted that the diagrams provided in the following embodiments only illustrate the basic concept of the present disclosure schematically. The diagrams only show the components related to the present disclosure, rather than being drawn according to the number, shape, and size of the components in actual implementation. The type, quantity, and proportion of each component in actual implementation can be arbitrarily changed, and the component layout type may also be more complex.

[0055] In addition, in the following description, specific details are provided to facilitate a thorough understanding of the examples. However, those skilled in the art will understand that the described aspects can be practiced without these specific details.

[0056] With the progress of Internet and Internet of Things technologies, Internet data has become extremely complex, and various Internet of Things devices have entered various scenarios of people's daily lives. This leads to a problem that although the data transmitted in the Internet environment has been audited and checked by the uploading party, it is not suitable for playback and display in some specific users and usage scenarios. For example, smart devices used by specific users need to restrict special nature application software, and special information cannot be displayed in specific environments, etc.

[0057] Currently, the relatively conventional approach is to manually detect and control hardware devices without artificial intelligence type automatic control, resulting in untimely monitoring and control of hardware devices, and at the same time, it is impossible to avoid the consequences brought by human operation errors.

[0058] To solve the above problems, the inventor creatively proposes: by collecting the attribute information of the accessed hardware device, performing a performance evaluation on the hardware device based on the collected attribute information, and determining the computing power level of the hardware device; obtaining the device type of the hardware device, and determining the information control type corresponding to the hardware device based on the computing power level and device type; obtaining the to-be-controlled information and preset configuration information corresponding to the information control type of the hardware device, performing information processing on the to-be-controlled information based on the preset configuration information, and generating target information for the hardware device to output the target information. By adopting different monitoring strategies and control strategies for different types of hardware devices, precise control of the output content of the hardware device can be achieved; at the same time, by adopting different control strategies based on the computing power information of the hardware device, the efficiency of controlling the content output of the hardware device can be improved.

[0059] As Figure 1 shown, the embodiment of the present application provides an intelligent output control method based on cloud-edge hybrid, which is applied to an edge network node. The method includes the following steps S1-S3:

[0060] S1. Collect the attribute information of the accessed hardware device, perform a performance evaluation on the hardware device based on the collected attribute information, and determine the computing power level of the hardware device.

[0061] In this embodiment, the hardware device accesses the edge network through an edge network node. The role of the edge network is to identify the characteristics of the data related to the hardware device and determine the final display and / or operation effect according to the user's configuration or the specific scenario. Among them, the hardware device can be an electronic device with computing power, such as a notebook, a central control device, a smart phone, a terminal computer, a wearable electronic device, etc., or an electronic device without computing power, such as a smart speaker, a projector, a display screen, etc.

[0062] In addition to supporting common wired methods such as serial ports and network cables, the edge network node also uses the Thread (Thread, a communication protocol technology for the Internet of Things in the home) technical principle and supports most Internet of Things wireless communication protocols, including but not limited to communication protocols such as wifi, Bluetooth, zigbee, and z-wave.

[0063] Specifically, the hardware device can access an edge network node in the edge network through a wired or wireless method. After the hardware device accesses the edge network node, the edge network node will obtain the attribute information of the hardware device to perform a performance evaluation and prediction on the hardware device, and record the computing power of the hardware devices existing in the current network. Among them, the attribute information includes but not limited to one or more of parameters such as a processor (CPU), a microprocessor, a memory, an external memory, and an operating system.

[0064] In this embodiment, the edge network node fuses the data of the accessed intelligent devices at regular intervals or during some special periods, performs feature recognition on the fused data, and judges the data characteristics in the current node's scenario to facilitate subsequent data recognition and measurement, etc.

[0065] Specifically, based on the collected attribute information, a performance evaluation is performed on the hardware device to determine the computing power level of the hardware device, including steps A11 - A15:

[0066] Step A11: Evaluate the performance of the CPU (processor) or MCU (microcontroller) of the hardware device; specifically, detect parameters such as the model, main frequency, cores, threads, cache, and architecture of the CPU (processor) of the hardware device, and detect parameters such as the memory organization structure, processor byte length, and instruction set of the MCU (microcontroller).

[0067] Step A12: Evaluate the memory performance; specifically, detect the memory size of the current hardware device and determine the memory performance based on the memory size.

[0068] Step A13: Evaluate the external memory performance; specifically, detect the size of the external storage of the current hardware device and determine the memory performance based on the external memory size.

[0069] Step A14: Evaluate the performance of the operating system; specifically, detect the version of the operating system of the current hardware device, the existing hardware drivers, and the hardware peripherals, and comprehensively determine the performance of the operating system.

[0070] Step A15: Determine the performance evaluation result of the hardware device based on the above evaluation results, classify the computing power of the hardware device, and determine the computing power level of the hardware device. As an implementation, scores can be given based on the evaluation results, and then a preset algorithm can be used to calculate the comprehensive score of the current hardware device, and the computing power level of the current hardware device can be determined based on the mapping relationship between the preset score and the computing power level. It should be noted that the technical solutions for performance evaluation and determination of the computing power level can be adjusted according to actual needs and are not limited here.

[0071] S2. Obtain the device type of the hardware device, and determine the information control type corresponding to the hardware device based on the computing power level and the device type.

[0072] After determining the computing power level of the current device, determine the device type of the current hardware device. Among them, the device types of the hardware device include but are not limited to: computer devices, communication devices, consumer devices, radio and television, and instrumentation devices.

[0073] As an implementation, the device type of the hardware device can be determined according to the device name of the hardware device. For example, it can be confirmed through a pre-determined mapping table. For example, a smart phone belongs to a communication device, a smart screen belongs to a radio and television and instrumentation device, a smart speaker belongs to a consumer device, a gaming laptop belongs to a computer device, etc. As another implementation, the device type of the hardware device can also be determined through the attribute information of the hardware device. For example, it can be comprehensively judged from the processor model and the existing drivers. For example, if the processor is of the Intel Pentium, Celeron, Core, Xeon, or Itanium type, and the current running device has memory, network card, etc., it can be judged that the current hardware device belongs to a computer device.

[0074] After determining the device type of the current hardware device, its corresponding information control type can be determined. Among them, the information control type includes at least one of the transmitted data during communication, the cached data for accessing the Internet, the running status of the application software installed on the hardware device, and the running status of the hardware device.

[0075] In this embodiment, when the computing power level of the current hardware device is low, the information control type includes the transmitted data during the data communication process of the hardware device. For example, when the current hardware device is a consumer device or a radio and television and instrumentation device, its computing power level is generally low and the supported functions are relatively few. Correspondingly, the types of information to be monitored and controlled are relatively few, and the transmitted data includes but is not limited to text information, streaming media information, etc. When the computing power level of the current hardware device is high, the information control type includes the cached data of the hardware device accessing the Internet, software operation information, and device operation information. For example, when the current hardware device is a computer device or a communication device, its computing power level is generally high and the supported functions are relatively many. Correspondingly, the types of information to be monitored and controlled are relatively many. For example, it includes all traffic data of the hardware device accessing the Internet, the operation status information of the application software installed on the current hardware device, and the device operation information of the hardware device, etc.

[0076] In order to better implement the information control of the hardware device, the information control type corresponding to the hardware device does not completely depend on the device type of the hardware device, but is related to the computing power level of the hardware device. As an implementation manner, obtaining the device type of the hardware device and determining the information control type corresponding to the hardware device based on the computing power level and the device type includes steps B11 - B14:

[0077] Step B11: Obtain the mapping table of the pre - determined device type and information control type;

[0078] In this embodiment, an example of the mapping relationship between the hardware device name, device type, performance evaluation index, and monitoring and control content is as follows:

[0079]

[0080]

[0081] Step B12: Based on the device type of the hardware device and the mapping table, determine the first information control type corresponding to the hardware device; Based on the content of the above mapping example, the information control type corresponding to the current hardware device can be initially determined, denoted as the first information control type. For example, the first information control type corresponding to all communication devices is the traffic data of the network card and the operation status of each application, etc.

[0082] Step B13: Screen the first information control type based on the computing power level to obtain a second information control type. Specifically, given that there are slight differences in the computing power of hardware devices of the same device type, even for hardware devices of the same type, their information control processing capabilities will also be different. Therefore, in order to improve the information control effect of hardware devices, the information control scope is appropriately adjusted based on the computing power level of the hardware device, that is, the first information control type is selected or discarded, so that the information corresponding to the second information control type after selection or discard can be adapted to the computing power level of the hardware device.

[0083] Step B14: Use the second information control type as the final information control type corresponding to the hardware device. After determining the final information control type corresponding to the current hardware device, the corresponding information can be monitored and controlled during use.

[0084] S3. Obtain the information to be controlled corresponding to the information control type of the hardware device and preset configuration information, and perform information processing on the information to be controlled based on the preset configuration information to generate target information for the hardware device to output the target information.

[0085] Among them, the preset configuration information includes but is not limited to at least one of scenario configuration information, user configuration information, etc. For different preset configuration information, the information processing control of the information to be controlled is different. For example, the scenario configuration information is the usage place, such as a school classroom, a meeting room, etc.; the user configuration information is the user configuration information of the hardware device, such as children, the elderly, etc. Information processing includes but is not limited to at least one of audio and video processing, picture processing, text processing, etc.

[0086] In this embodiment, when the computing power level of the hardware device is low, the information control type includes the transmission data during the data communication process of the hardware device. Then, the obtaining the information to be controlled corresponding to the information control type of the hardware device, performing information processing on the information to be controlled based on the preset configuration information to generate target information for the hardware device to output the target information includes steps C11 - C13:

[0087] Step C11: The edge network node obtains the transmission data during the communication process of the hardware device.

[0088] Step C12: When the transmission data needs to be processed, perform data processing on the transmission data based on the preset configuration information to obtain the target information.

[0089] Step C13: Send the target information to the hardware device for output display.

[0090] For hardware devices with only low computing power or basically no computing power, such as wireless receiving devices without applications running, since such hardware devices cannot install application software, they can only be configured by devices such as mobile phones, tablets, or computers belonging to the same edge network. For example, the wireless screen mirroring device in a meeting room can be configured through a computer on the same network to set the usage scenario as a meeting room. Then, the dedicated software pre-installed on the computer can automatically generate a configuration for the wireless screen mirroring device, such as not displaying and playing entertainment-related streaming media data. The dedicated software shows these configurations to the user for confirmation. The user can modify the configuration based on the automatically generated one and send it to the edge network node after confirmation. Then, the edge network node obtains the data during the communication of the hardware device. For example, the screen mirroring content obtained by the wireless screen mirroring device through Bluetooth. The edge network node monitors and processes the obtained data. For example, if there is a politically sensitive picture in the PPT displayed by the wireless screen mirroring device in a meeting room, the edge network node will blur the picture and then send the processed data to the wireless screen mirroring device, and finally, a partially blurred picture will be displayed on the screen mirroring device.

[0091] In this embodiment, when the computing power level of the hardware device is high, the information control type includes the cached data of the hardware device accessing the Internet. Then, obtaining the to-be-controlled information corresponding to the information control type of the hardware device and performing information processing on the to-be-controlled information based on the preset configuration information to generate target information for the hardware device to output the target information includes steps D11 - D13:

[0092] Step D11: The edge network node obtains the cached data of the hardware device accessing the Internet;

[0093] Step D12: When the cached data needs to be processed, perform information processing on the cached data based on the preset configuration information to obtain the target information;

[0094] Step D13: Send the target information to the hardware device for output display.

[0095] Furthermore, the method of this embodiment further includes:

[0096] The edge network node obtains the software running information and / or device running information of the hardware device;

[0097] Control the software running state and / or device running state of the hardware device according to the preset configuration information, the software running information, and / or the device running information.

[0098] Specifically, for a hardware device with high computing power, a dedicated software for collecting and managing user configurations such as users and scenarios for using the hardware device will be deployed in advance on the hardware device. For example, if a parent configures the user of a tablet computer as a 10-year-old child, the dedicated software on the tablet computer will automatically generate some configurations based on the user characteristics, such as closing pop-up windows and software with payment functions, requiring an adult to manually unlock the video playback software every 45 minutes, and desensitizing Internet information that is not suitable for a 10-year-old child (for example, mosaicing or muting pornographic and violent streaming media). The dedicated software will display these configurations to the user for confirmation. The user can modify the configurations based on the automatically generated ones and send them to the edge network node after confirmation. Therefore, during the actual use of the hardware device, the edge network node will obtain and monitor the data of the hardware device accessing the Internet. At the same time, it will perform corresponding processing on the obtained data based on the configuration information and control the running status of relevant application software on the hardware device based on the configuration information. When necessary, it can also directly control the running status of the hardware device.

[0099] It can be understood that if all data processing needs to be executed by the edge network node and then sent to the hardware device, it will affect the information output efficiency to a certain extent. Therefore, for a hardware device with high computing power, the hardware device can monitor and process the control information by itself. In this embodiment, when it is recognized that the cache data needs to be processed, the cache data is processed based on the preset configuration information to obtain the target information, including steps E11 - E12:

[0100] Step E11: Estimate the computing power required to process the cache data according to the configuration information;

[0101] Step E12: When the computing power level of the hardware device meets the pre-estimated computing power requirements, control the hardware device to process the cache data based on the configuration information to obtain the target information.

[0102] It can be understood that even for a hardware device with a certain computing power, its computing power may or may not meet the computing power requirements for data processing. Therefore, it is necessary to pre-estimate the computing power required for possible data processing in advance and compare it with the computing power of the hardware device based on the preset computing power. If the computing power of the hardware device exceeds the pre-estimated computing power for data processing, the hardware device will process the cache data based on the configuration information and directly output and display it. If the computing power of the hardware device is lower than the pre-estimated computing power for data processing, the edge network node can process the cache data based on the configuration information to obtain the target information and send the target information to the hardware device.

[0103] In other embodiments, the information processing of the to-be-controlled information based on the preset configuration information to generate target information for the hardware device to output the target information includes steps F11 - F13:

[0104] Step F11: Monitor and identify the to-be-controlled information, and judge whether the to-be-controlled information needs to be processed according to the identification result;

[0105] Step F12: When it is judged that the to-be-controlled information needs to be processed, call the data processing model corresponding to the configuration information to process the to-be-controlled information to generate the target information;

[0106] Step F13: Control the hardware device to output the target information.

[0107] Specifically, different types of configuration information correspond to different data processing models. When it is recognized that the monitored to-be-controlled information needs to be processed, the corresponding data processing model is called for information processing. For example, a graphics processing model, an audio-video processing model, etc. The data processing model can be obtained by training and validating a convolutional neural network through a model database, but is not limited to a convolutional neural network. The model training process already has relatively mature technologies and will not be elaborated here.

[0108] It should be noted that for hardware devices with low computing power, the edge network node calls the model to process and obtain the target information and then sends it to the hardware device for output display. For hardware devices with high computing power, after the edge network node accesses the edge network, it will send the model file to the hardware device. When the hardware device detects the to-be-controlled information during use, it calls the model to process and obtain the target information and directly outputs and displays it.

[0109] In other embodiments, in order to improve the accuracy of information processing, the data processing model is self-trained at preset time intervals or when the edge network node is idle to obtain an updated data processing model; or when there is an updated data processing model in the cloud or the adjacent edge network nodes in the edge network, the updated data processing model is obtained. During the non-busy period of the edge network, the models in the network can be self-trained or updated from the cloud. The materials for self-training include data collected from daily operations and current affairs news and hotspots calculated from data on various news consulting platforms. A convolutional neural network can be used to learn and understand some popular words. In subsequent data recognition processes, the analysis of the emotional meanings contained in some pictures, texts, and audio-video will be more accurate, thereby improving the accuracy of information monitoring and control.

[0110] Taking the edge network node as the campus intelligent gateway as an example, this application proposes an intelligent output control method based on cloud-edge hybrid to achieve more secure and pure data transmission on campus. The specific process is as follows:

[0111] The hardware devices on campus access the Internet through the intelligent gateway. Here, the hardware devices are mostly computers, mobile phones, tablets, smart screens equipped with network cards, smart speakers that can access wifi, etc.

[0112] During the process of hardware devices accessing the Internet, the network data received will pass through the intelligent gateway node. The gateway node first identifies the network data. For example, for streaming media data, it is analyzed through a specific model to determine whether there is pornographic, violent or other content. Such content that cannot be spread in a special place like campus is processed. The processing scheme can be determined according to the size, level, etc. of the content. For example, if the content is relatively large, the streaming media playback is directly terminated. If the content is relatively small, it can be simply processed by adding codes, muting and then played.

[0113] In addition to enabling hardware devices to access the Internet, the intelligent gateway can serve as the gateway or repeater for multiple wireless mesh networks such as zigbee, Bluetooth, and wifi. Thus, the content to be played by the intelligent device can be obtained, and the played content can be monitored and controlled.

[0114] According to the active characteristics of network traffic on campus, when the traffic is not heavy at night, the intelligent gateway interacts with the server, uploads the network data of the day to the cloud server as the material for model training, and the cloud server sends the updated model to the intelligent gateway to improve the subsequent detection and control effect.

[0115] It should be understood that although the steps in the flowcharts involved in the above-described embodiments are shown in sequence according to the arrows, these steps do not necessarily have to be executed in the order indicated by the arrows. Unless there is a clear description in this article, the execution of these steps has no strict order limit, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-described embodiments may include multiple steps or multiple stages. These steps or stages do not necessarily have to be executed at the same time, but can be executed at different times. The execution order of these steps or stages does not necessarily have to be sequential, but can be executed alternately or in turn with at least a part of other steps or steps or stages in other steps.

[0116] Based on the same inventive concept, an embodiment of the present application further provides a control device for implementing the above-mentioned intelligent output control method based on cloud-edge hybrid. The solution provided by this device to solve the problem is similar to the solution described in the above method. Therefore, the specific limitations in the embodiment of the intelligent output control device based on cloud-edge hybrid provided below can refer to the limitations on the intelligent output control method based on cloud-edge hybrid in the above text, and will not be elaborated here.

[0117] In one embodiment, as Figure 2 shown, it is a schematic diagram of the modules of the intelligent output control device 100 based on cloud-edge hybrid in an embodiment of the present application, which includes: an evaluation module 110, a type determination module 120, and a processing and control module 130, where:

[0118] The evaluation module 110 is configured to collect the attribute information of the accessed hardware device, perform a performance evaluation on the hardware device based on the collected attribute information, and determine the computing power level of the hardware device;

[0119] The type determination module 120 is configured to obtain the device type of the hardware device, and determine the information control type corresponding to the hardware device based on the computing power level and the device type;

[0120] The processing and control module 130 is configured to obtain the to-be-controlled information and the preset configuration information corresponding to the information control type of the hardware device, perform information processing on the to-be-controlled information based on the preset configuration information, and generate target information for the hardware device to output the target information.

[0121] Specifically, the evaluation module 110 is further configured to perform the following steps:

[0122] Step A11: Evaluate the performance of the CPU (processor) or MCU (microcontroller) of the hardware device;

[0123] Step A12: Evaluate the memory performance;

[0124] Step A13: Evaluate the external memory performance;

[0125] Step A14: Evaluate the operating system performance;

[0126] Step A15: Determine the performance evaluation result of the hardware device based on the above evaluation results, classify the computing power of the hardware device, and determine the computing power level of the hardware device.

[0127] Specifically, the type determination module 120 is further configured to perform the following steps:

[0128] Step B11: Obtain a pre-determined mapping table between device types and information control types;

[0129] Step B12: Based on the device type of the hardware device and the mapping table, determine the first information control type corresponding to the hardware device;

[0130] Step B13: Filter the first information control type based on the computing power level to obtain a second information control type;

[0131] Step B14: Use the second information control type as the final information control type corresponding to the hardware device.

[0132] Specifically, when the computing power level of the hardware device is low, the information control type includes the transmitted data during the data communication process of the hardware device. Then, the processing and control module 130 is specifically configured to perform the following steps:

[0133] Step C11: The edge network node obtains the transmitted data during the communication process of the hardware device;

[0134] Step C12: When the transmitted data needs to be processed, process the transmitted data based on the preset configuration information to obtain the target information;

[0135] Step C13: Send the target information to the hardware device for output display.

[0136] Specifically, when the computing power level of the hardware device is high, the information control type includes the cached data of the hardware device accessing the Internet. Then, the processing and control module 130 is specifically configured to perform the following steps:

[0137] Step D11: The edge network node obtains the cached data of the hardware device accessing the Internet;

[0138] Step D12: When the cached data needs to be processed, process the cached data based on the preset configuration information to obtain the target information;

[0139] Step D13: Send the target information to the hardware device for output display.

[0140] Specifically, the processing and control module 130 is further configured to obtain the software running information and / or device running information of the hardware device; and control the software running state and / or device running state of the hardware device according to the preset configuration information, the software running information and / or device running information.

[0141] Specifically, the processing and control module 130 is further configured to perform the following steps:

[0142] Step E11: Estimate the computing power required for information processing of the cache data according to the configuration information;

[0143] Step E12: When the computing power level of the hardware device meets the pre - estimated computing power requirements, control the hardware device to perform information processing on the cache data based on the configuration information to obtain the target information.

[0144] Specifically, the processing and control module 130 is further configured to perform the following steps:

[0145] Step F11: Monitor and identify the information to be controlled, and judge whether the information to be controlled needs to be processed according to the identification result;

[0146] Step F12: When it is judged that the information to be controlled needs to be processed, call the data processing model corresponding to the configuration information to process the information to be controlled and generate the target information;

[0147] Step F13: Control the hardware device to output the target information.

[0148] The specific implementation manners of the above - mentioned analysis device embodiments are basically the same as those of the foregoing method embodiments, and will not be elaborated herein.

[0149] Each module in the above - mentioned intelligent output control device based on cloud - edge hybrid can be implemented in whole or in part by software, hardware, and their combinations. The above - mentioned modules can be embedded in the processor of the computer device in hardware form or be independent of it, or be stored in the memory of the computer device in software form, so as to facilitate the processor to call and execute the operations corresponding to the above - mentioned modules.

[0150] In one embodiment, a computer device is further provided. This computer device is the edge network node mentioned in the foregoing method embodiment, and its internal structure diagram can be as Figure 3 shown. This computer device includes a processor, a memory, an input / output interface (Input / Output, abbreviated as I / O), and a communication interface. Among them, the processor, the memory, and the input / output interface are connected through a system bus, and the communication interface is connected to the system bus through the input / output interface.

[0151] Among them, the processor of the computer device is used to provide computing and control capabilities, which can be a general-purpose processor, a central processing unit, a graphics processing unit, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., without limitation. The processor may include one or more processors, for example, including one or more central processing units (CPUs). In the case where the processor is a single CPU, the CPU can be a single-core CPU or a multi-core CPU. The processor may also include one or more dedicated processors, and the dedicated processors may include GPUs, FPGAs, etc., for acceleration processing. The processor is used to call the program code and data in the memory and execute the steps in the above method embodiments. For details, please refer to the description in the method embodiments and will not be elaborated here.

[0152] The memory of the computer device includes but is not limited to non-volatile storage media and internal memory. The non-volatile memory may include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. The volatile memory may include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc. The non-volatile storage media stores an operating system, computer programs, and a database. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media.

[0153] The input / output interface of the computer device is used for the processor to exchange information with external devices.

[0154] The communication interface of the computer device is used to communicate with external terminals through a network connection.

[0155] When the computer program is executed by the processor, it realizes an intelligent output control method based on cloud-edge hybrid.

[0156] In several embodiments provided by the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the division of each unit / module is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. The couplings, direct couplings, or communication connections shown or discussed with each other can be through some interfaces. The indirect couplings or communication connections of systems or units can be in electrical, mechanical, or other forms.

[0157] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they can be located in one place or distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0158] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on a computer, the processes or functions according to the embodiments of the present application are generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable systems. The computer instructions can be stored in a computer-readable storage medium or transmitted through the computer-readable storage medium. The computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center in a wired manner (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wirelessly (such as infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that includes one or more integrated available media. The available medium can be a read-only memory (ROM), a random access memory (RAM), a magnetic medium, such as a floppy disk, a hard disk, a magnetic tape, a magnetic disk, or an optical medium, such as a digital versatile disc (DVD), or a semiconductor medium, such as a solid state disk (SSD), etc.

[0159] The above are only specific embodiments of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art within the technical scope disclosed by the present application can easily think of various equivalent modifications or substitutions, and these modifications or substitutions should be covered within the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A cloud-edge hybrid-based intelligent output control method, applied to an edge network node, characterized in that The method includes: Collecting the attribute information of the connected hardware device, evaluating the performance of the hardware device based on the collected attribute information, and determining the computing power level of the hardware device; Obtaining the device type of the hardware device, and determining the information control type corresponding to the hardware device based on the computing power level and the device type; Obtaining the to-be-controlled information corresponding to the information control type of the hardware device and the preset configuration information, performing information processing on the to-be-controlled information based on the preset configuration information to generate target information for the hardware device to output the target information; The performing information processing on the to-be-controlled information based on the preset configuration information to generate target information for the hardware device to output the target information includes: Monitoring and identifying the to-be-controlled information, and judging whether the to-be-controlled information needs to be processed according to the identification result; When it is judged that the to-be-controlled information needs to be processed, calling the data processing model corresponding to the preset configuration information to process the to-be-controlled information to generate the target information; Controlling the hardware device to output the target information.

2. The method according to claim 1, wherein When the computing power level of the hardware device is low, the information control type includes the transmitted data during the data communication process of the hardware device; The obtaining the to-be-controlled information corresponding to the information control type of the hardware device, performing information processing on the to-be-controlled information based on the preset configuration information to generate target information for the hardware device to output the target information includes: The edge network node obtains the transmitted data during the communication process of the hardware device; When the transmitted data needs to be processed, performing data processing on the transmitted data based on the preset configuration information to obtain the target information; Sending the target information to the hardware device for output display.

3. The method according to claim 1, wherein When the computing power level of the hardware device is high, the information control type includes the cached data for the hardware device to access the Internet; The obtaining the to-be-controlled information corresponding to the information control type of the hardware device, the performing information processing on the to-be-controlled information based on the preset configuration information to generate target information for the hardware device to output the target information includes: The edge network node obtains the cached data for the hardware device to access the Internet; When the cached data needs to be processed, performing information processing on the cached data based on the preset configuration information to obtain the target information; Sending the target information to the hardware device for output display.

4. The method according to claim 3, wherein The information control type further includes software operation information and / or device operation information, and the method further includes: The edge network node obtains the software operation information and / or device operation information of the hardware device; Controlling the software operation state and / or device operation state of the hardware device according to the preset configuration information, the software operation information and / or device operation information.

5. The method according to claim 3, characterized in that, The when the cached data needs to be processed, performing information processing on the cached data based on the preset configuration information to obtain the target information includes: Estimate the computing power required for processing the cache data according to the preset configuration information. When the computing power level of the hardware device meets the pre-estimated computing power requirements, control the hardware device to process the cache data based on the preset configuration information to obtain the target information.

6. The method according to claim 1, wherein The obtaining the device type of the hardware device and determining the information control type corresponding to the hardware device based on the computing power level and the device type includes: Obtain a pre-determined mapping table of device types and information control types; Based on the device type of the hardware device and the mapping table, determine the first information control type corresponding to the hardware device; Based on the computing power level, screen the first information control type to obtain a second information control type; Use the second information control type as the final information control type corresponding to the hardware device.

7. The method according to claim 1, wherein The method further includes: Self-train the data processing model at preset time intervals or when the edge network node is idle to obtain an updated data processing model; or When there is an updated data processing model in the cloud or the edge network, obtain the updated data processing model.

8. The method according to claim 1, characterized in that The information processing includes at least one of audio-video processing, picture processing, and text processing; The preset configuration information includes scenario configuration information and / or user configuration information.

9. The method according to claim 1, wherein The attribute information includes one or more of a processor, a microcontroller, a memory, an external memory, and an operating system.

10. An intelligent output control device based on cloud-edge hybrid, characterized in that, The device includes: An evaluation module, configured to collect the attribute information of the accessed hardware device, perform a performance evaluation on the hardware device based on the collected attribute information, and determine the computing power level of the hardware device; A type determination module, configured to obtain the device type of the hardware device and determine the information control type corresponding to the hardware device based on the computing power level and the device type; A processing and control module, configured to obtain the information to be controlled corresponding to the information control type of the hardware device and the preset configuration information, process the information to be controlled based on the preset configuration information to generate target information for the hardware device to output the target information; The processing the information to be controlled based on the preset configuration information to generate target information for the hardware device to output the target information includes: Monitor and identify the information to be controlled, and determine whether the information to be controlled needs to be processed according to the identification result; When it is determined that the information to be controlled needs to be processed, call a data processing model corresponding to the preset configuration information to process the information to be controlled to generate the target information; Control the hardware device to output the target information.

11. A computer device, characterized in that, The computer device includes: At least one processor; and, A memory communicatively connected to the at least one processor; wherein, The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the cloud-edge hybrid-based intelligent output control method according to any one of claims 1-9.

12. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions for causing a computer to execute the cloud-edge hybrid-based intelligent output control method according to any one of claims 1-9.

Citation Information

Patent Citations

  • Method and device for transmitting and acquiring equipment capacity information

    CN102984761A

  • Offshore edge computing low-overhead cloud-side intelligent collaborative franchisee discovery method

    CN112235385A