Asymmetric device sharing method and system for visual data

Abstract

The present application relates to the field of data management of asymmetric device groups. Disclosed are an asymmetric device sharing method and system for visual data, which associates the combination of objects in which data collection and decision execution are performed by different objects in the same system, and limits the transmission mode of shared data according to the network state of the data channel. In particular, for the scenario in which multiple side objects jointly execute decisions, such scheduling management can effectively solve the delay caused by the difference in communication state of different sides, is suitable for the case where the side obtains visual data and autonomously makes decisions, avoids the queue delay that may occur when the same center end makes decisions and controls multiple sides, and ensures the data acquisition efficiency of multiple sides while optimizing the decision coordination between sides.

Description

Technical Field

[0001] This invention relates to the field of data management of asymmetric device groups, specifically to a method and system for asymmetric sharing of visual data among devices. Background Technology

[0002] Asymmetric device sharing is an unavoidable problem in the construction of complex systems. Differences in the suppliers and production specifications of different edge devices will lead to asymmetry in the final system. Specifically, the asymmetry is mainly reflected in three aspects: differences in computing power, as edge devices are widely distributed and have large differences in computing power; differences in network, as the network of distributed device groups has greater uncertainty, is highly volatile, and has unstable broadband latency; and data distribution usually exhibits extreme non-independent and identically distributed characteristics, that is, there are significant differences in the category characteristics and data volume of visual data collected by different sensors.

[0003] In such systems, when multiple side-end or central-end objects need to exchange information and the scenario involves decision synchronization across multiple side-ends, there are two visual data processing solutions. One is for multiple side-end devices to collect visual data, and then for data synchronization and further processing decisions in the scheduling center. In this process, the limitations are the data acquisition capabilities of the side-end devices and the network conditions during data transmission. The other type is for the central end to collect visual data and then generate control signals based on the visual data to control the side-ends. Both of these methods suffer from queue latency. If the central processing method is used to distribute decision control, there will be a situation where tasks from multiple side-ends are calculated in the response queue, resulting in a sequential decision-making process. This will cause a delay in the execution sequence of actions from multiple side-ends that originally needed to perform actions simultaneously, affecting the accuracy of action execution. Summary of the Invention

[0004] The purpose of this invention is to provide a method and system for asymmetric device sharing of visual data to solve the problems mentioned in the background art.

[0005] To achieve the above objectives, the present invention provides the following technical solution: A method and system for asymmetric device sharing of visual data, including: The system acquires the object composition of the data system, synchronizes the execution functions of multiple objects and the data flow relationships between multiple objects based on the execution functions, and filters to obtain a shared association list. The shared management list is used to represent the object association list where data acquisition and control execution are separated. Based on the flow of data information, network communication tests are conducted on the data channels between multiple objects in the shared association list to obtain the channel network status, which includes network transmission speed, network latency, and network fluctuation characteristics. The decision-making requirements are determined based on the status of the channel network and the relationships between them. A data sharing scheme is selected based on the determination results. The data sharing scheme is used to characterize the data transmission mode and the execution object of the decision. The decision requirements characterize the need for timeliness of decision-making. The data system is scheduled and redistributed based on the data sharing scheme, and data sharing and decision execution are carried out according to the data sharing scheme.

[0006] As a further aspect of the present invention: the step of making a judgment based on the decision requirements of the channel network status and correlation, and selecting a data sharing scheme based on the judgment result, specifically includes: Obtain the corresponding data transmission and decision requirements, and determine whether it is an instant transmission decision type for multi-side object synchronization; If the determination result is characterized as an instantaneous transmission decision type for multi-side object synchronization, then based on the network status of multiple data channels, available communication scheduling is performed, and stable channel bandwidth for current instantaneous information synchronization is allocated. The information compression ratio of shared data in each data channel is calculated based on the stable channel bandwidth, and a direct data transmission scheme is established based on the information compression ratio. The direct data transmission scheme is a side-end decision management type. If the transmission decision type is not a real-time transmission decision type with multi-side synchronization, a circular sharing scheme is established based on the central end decision. The circular sharing scheme is used to coordinate several transmission decision requirements.

[0007] As a further embodiment of the present invention: the circular sharing scheme includes the following steps: The decision requirements are obtained by acquiring the demand frequency of multiple side-end decisions, and the decision requirements of multiple side-ends are arranged according to the demand frequency to establish a cyclical response list, which cycles within a common multiple period. The data throughput of the corresponding side data channel is calculated based on the time interval corresponding to the demand frequency, and compared with the original data volume of the decision demand data in the time interval to obtain the information compression ratio of the corresponding data channel. Based on the cyclic response list and the corresponding information compression ratio, the information sharing and synchronization of data and decisions are performed cyclically.

[0008] As a further aspect of the present invention, it also includes the following steps: The information density of visual data of multiple visual objects is judged in consecutive frames. If the amount of information change of the current visual data in consecutive frames is lower than a preset value, it is marked as a more shared type. Perform volume data synchronization on the visual data of the volume sharing type, and divide the data channel into volume channel and constant channel based on the volume of volume data per unit time. The changing pixel data of continuous frames of visual data is synchronized in real time through a variable channel, and updated through a constant channel when the number of changing pixels in continuous frames exceeds the set data volume per unit time.

[0009] As a further aspect of the present invention, it also includes the following steps: When the computing power of the side end cannot make decisions on visual processing within the preset time, the visual decision-making requirements for synchronizing multiple side end objects are established through the central end object. A delay queue is established to temporarily store decision control information of multiple side objects. When the corresponding decisions of multiple side objects have been completed, the multiple decision control information in the delay queue is forwarded through the corresponding data channel and the queue is cleared.

[0010] This invention aims to provide a method and system for asymmetric device sharing of visual data, comprising: The data flow association module is used to obtain the object composition of the data system, synchronize the execution functions of multiple objects and the data flow association between multiple objects based on the execution functions, so as to filter and obtain a shared association list. The shared management list is used to represent the object association list where data acquisition and control execution are separated. The associated communication test module is used to perform network communication tests on the data channels between multiple objects in the shared association list based on the flow of data information, and to obtain the channel network status, which includes network transmission speed, network latency, and network fluctuation characteristics. The decision requirement judgment module is used to make judgments based on the channel network status and correlation, and select a data sharing scheme based on the judgment results. The data sharing scheme is used to characterize the data transmission mode and the execution object of the decision, and the decision requirement characterizes the requirement for decision timeliness. The shared scheduling and execution module is used to schedule and redistribute the data system based on the data sharing scheme, and to perform data sharing and decision execution according to the data sharing scheme.

[0011] As a further aspect of the present invention: the decision-making requirement judgment module includes: The decision type determination unit is used to obtain the decision requirements for the transmission and decision type of the corresponding data, and to determine whether it is an instant transmission decision type for multi-side object synchronization. The communication scheduling and allocation unit is used to allocate stable channel bandwidth for real-time information synchronization based on the network status of multiple data channels when the determination result is characterized as an instantaneous transmission decision type for multi-side object synchronization. The direct-access transmission decision unit is used to calculate the information compression ratio of shared data in each data channel based on the stable channel bandwidth, and to establish a direct-access transmission scheme based on the information compression ratio. The direct-access transmission scheme is a side-end decision management type. A cyclic transmission decision unit is used to establish a cyclic sharing scheme based on the central end decision if the transmission decision is not a real-time transmission decision type that is not synchronized across multiple ends. The cyclic sharing scheme is used to coordinate several transmission decision requirements.

[0012] As a further aspect of the present invention, it also includes: A cyclic queue unit is used to obtain the demand frequency of multiple side-end decisions through decision requirements, and to arrange the decision requirements of multiple side-ends based on the demand frequency to establish a cyclic response list, which cyclically cycles within a common multiple period. The cyclic constraint unit is used to calculate the data throughput of the corresponding side data channel based on the time interval corresponding to the demand frequency, and compare it with the original data volume of the decision demand data in the time interval to obtain the information compression ratio of the corresponding data channel. The cyclic synchronization unit is used to perform information sharing and synchronization of data and decisions in a cyclical manner based on the cyclic response list and the corresponding information compression ratio.

[0013] As a further aspect of the present invention, it also includes: The change feature judgment unit is used to judge the information density of visual data of multiple visual objects in consecutive frames. If the amount of change data information of the current visual data in consecutive frames is lower than a preset value, it is marked as a more shared type. A volume channel partitioning unit is used to perform volume data synchronization on the visual data of the volume sharing type, and divide the data channel into volume channels and constant channels based on the volume of data per unit time of the volume data. The variable data transmission unit is used to synchronize the changing pixel data of continuous frames of visual data in real time through the variable channel, and to update through the constant channel when the number of changing pixels in the continuous frames exceeds the set data volume per unit time.

[0014] As a further aspect of the present invention, it also includes: The side-end evaluation unit is used to establish the visual decision-making requirements of multiple side-end objects through the central-end object when the side-end computing power cannot realize the decision-making of visual processing within the preset specification time. The delay synchronization unit is used to establish a delay queue, which is used to temporarily store decision control information of multiple side objects. When the corresponding decisions of multiple side objects have been completed, the multiple decision control information in the delay queue is forwarded through the corresponding data channel and the queue is cleared.

[0015] Compared with the prior art, the beneficial effects of the present invention are: by associating objects that perform data acquisition and decision execution in the same system with different objects, and by making decisions and limiting the transmission method of shared data according to the network status of the data channel, especially in scenarios where multiple side objects jointly perform decisions, this scheduling and management method can effectively solve the delay caused by the difference in communication status between different side objects. It is suitable for situations where side objects acquire visual data and make autonomous decisions, avoiding the queue delay that may occur when the same central end makes decisions and controls multiple side objects, ensuring the efficiency of data acquisition by multiple side objects, and optimizing the decision collaboration between side objects. Attached Figure Description

[0016] Figure 1 A flowchart for an asymmetric device sharing method for visual data.

[0017] Figure 2 A flowchart for selecting a sharing scheme in an asymmetric device sharing method for visual data.

[0018] Figure 3 This is a diagram of the components of an asymmetric device-sharing system for visual data. Detailed Implementation

[0019] To make the objectives, technical solutions, and advantages of this invention clearer, the invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the invention.

[0020] The specific implementation of the present invention will be described in detail below with reference to specific embodiments.

[0021] like Figure 1 The method for asymmetric device sharing of visual data, provided in one embodiment of the present invention, includes the following steps: S10, obtain the object composition of the data system, synchronize the execution functions of multiple objects and the data flow association between multiple objects based on the execution functions, so as to filter and obtain a shared association list. The shared management list is used to represent the object association list where data acquisition and control execution are separated. S20, based on the flow of data information, perform network communication tests on the data channels between multiple objects in the shared association list, and obtain the channel network status, which includes network transmission speed, network latency, and network fluctuation characteristics. S30, make a judgment based on the decision requirements of the channel network status and correlation, and select a data sharing scheme based on the judgment result. The data sharing scheme is used to characterize the data transmission mode and the execution object of the decision. The decision requirements characterize the requirement for the timeliness of the decision. S40, the data system is scheduled and redistributed based on the data sharing scheme, and data sharing and decision execution are performed according to the data sharing scheme.

[0022] This embodiment presents an asymmetric device sharing method for visual data. It associates objects within the same system, where data acquisition and decision-making are performed by different objects, and limits the transmission method of shared data based on the network status of the data channel. Especially in scenarios where multiple side-end objects jointly execute decisions, this scheduling and management method effectively solves the latency issues caused by differences in communication states between different side-ends. It is suitable for situations where side-ends acquire visual data and make autonomous decisions, avoiding queue delays that may occur when a central terminal makes decisions and controls multiple side-ends. This ensures efficient data acquisition from multiple side-ends while optimizing decision-making between them. The asymmetry in decision-making is mainly reflected in three aspects: differences in computing power (edge ​​devices are widespread but have significant differences in computing power); network differences (distributed device groups have greater network uncertainty, are highly volatile, and have unstable broadband latency); and data distribution typically exhibits extreme non-independent and identically distributed characteristics, meaning that the category characteristics and data volume of visual data collected by different sensors differ significantly. In a system that makes decisions based on visual data, the data acquisition end and the decision-making and execution end may not be integrated due to different decision-making processes. In the case of integration, the data transfer and transmission process involves less information. This doesn't have many additional impacts. The target device can make its own judgment and decision after acquiring visual data. However, in the case of multiple devices being separated, a data sharing process is involved. The data in this process may be decision data or visual data; for example, the central device acquires visual data and makes a decision, and then transmits the decision data to multiple side devices. But in this case, when there are many side devices and each needs to make an individual decision, and the multi-device control needs to be synchronized, the central device decision-making method will result in a decision queue delay. That is, the central device needs to process the queue order when making a decision, which will cause significant differences in the generation of decision results from multiple side devices. The sequential delays cause synchronization disorder, and this queue characteristic is determined by the characteristics of the computing system, so it cannot be completely eliminated. Therefore, in this case, this embodiment provides a multi-terminal visual data synchronization scheme, that is, by evaluating the data communication of different sides, the visual data is compressed and synchronized on multiple sides, so as to realize the decision-making authority of multi-side synchronous decision-making and facilitate the decision-making time coordination between multiple sides, thereby effectively avoiding the queue delay caused by central decision-making. In step S10, the execution action here refers to the functional effect of the object in the system, such as visual data acquisition, decision-making or execution.

[0023] like Figure 2 As shown, in another preferred embodiment of the present invention, the step of making a judgment based on the decision requirements of the channel network status and correlation, and selecting a data sharing scheme based on the judgment result, specifically includes: S31, obtain the decision requirements for the transmission and decision type of the corresponding data, and determine whether it is an instant transmission decision type for multi-side object synchronization; S32, if the determination result is characterized as the real-time transmission decision type of multi-side object synchronization, then based on the network status of multiple data channels, available communication scheduling is performed, and stable channel bandwidth for current real-time information synchronization is allocated. S33, calculate the information compression ratio of shared data in each data channel based on the stable channel bandwidth, and establish a direct data transmission scheme based on the information compression ratio. The direct data transmission scheme is a side-end decision management type. S34. If it is not a real-time transmission decision type with multi-side synchronization, then a circular sharing scheme is established based on the central end decision. The circular sharing scheme is used to coordinate several transmission decision requirements.

[0024] In this embodiment, step S30 is further subdivided. It mainly involves determining whether the decision type is a real-time transmission decision type for multi-side synchronization to determine the transmission scheme. In other words, it involves determining whether the scenario state described in the previous embodiment requires synchronization of multi-side decisions. When this state is determined, it means that multiple sides need to perform rapid synchronous transmission of visual data. In a system with asymmetric device combinations, the communication states of different sides are also quite different. Therefore, it is necessary to define the amount of data transmitted per unit time by judging the network state of the data channel, and then compress the visual data proportionally to ensure the synchronization of transmission efficiency.

[0025] As another preferred embodiment of the present invention, the circular sharing scheme includes the following steps: The decision requirements are obtained by acquiring the demand frequency of multiple side-end decisions, and the decision requirements of multiple side-ends are arranged according to the demand frequency to establish a cyclical response list, which cycles within a common multiple period. The data throughput of the corresponding side data channel is calculated based on the time interval corresponding to the demand frequency, and compared with the original data volume of the decision demand data in the time interval to obtain the information compression ratio of the corresponding data channel. Based on the cyclic response list and the corresponding information compression ratio, the information sharing and synchronization of data and decisions are performed cyclically.

[0026] In this embodiment, the circular sharing scheme used in the previous embodiment for the real-time transmission decision type that is determined to be non-multi-side-end synchronization is explained. The main point is to establish a circular queue scheme for the limited decision requirements of the system. Based on the frequency of each decision requirement, that is, the update time interval required for the decision, multiple decisions are integrated to establish a circular decision queue, so that the corresponding side can obtain the decision update synchronization in a timely manner in subsequent decisions.

[0027] As another preferred embodiment of the present invention, the method further includes the following steps: The information density of visual data of multiple visual objects is judged in consecutive frames. If the amount of information change of the current visual data in consecutive frames is lower than a preset value, it is marked as a more shared type. Perform volume data synchronization on the visual data of the volume sharing type, and divide the data channel into volume channel and constant channel based on the volume of volume data per unit time. The changing pixel data of continuous frames of visual data is synchronized in real time through a variable channel, and updated through a constant channel when the number of changing pixels in continuous frames exceeds the set data volume per unit time.

[0028] In this embodiment, during data synchronization (referring to visual data; decision data is only used to implement action command control on the side, involving a small amount of data, and the control data is all important data, so compression is neither possible nor necessary), in order to ensure synchronization between asymmetric devices, compression is required based on the network status of the data channel. However, using compression will result in a loss of information density and accuracy, and the higher the compression ratio, the more information is lost. Therefore, it is very important to reduce the compression ratio as much as possible when conditions permit. Therefore, another type of volume sharing is given here, which is suitable for visual data synchronization in fixed or slowly changing scenarios. In this case, the amount of effective data in continuous video frames is not large, and most of the data in continuous video frames is unchanged. Therefore, visual data synchronization sharing can be achieved by transmitting only a small amount of changing volume data, while the unchanging part is treated as constant data and updated only in the frame when it changes. This part of the update can be performed by first compressing the information and then slowly updating the fine data, based on the division of volume channels and constant channels.

[0029] As another preferred embodiment of the present invention, the method further includes the following steps: When the computing power of the side end cannot make decisions on visual processing within the preset time, the visual decision-making requirements for synchronizing multiple side end objects are established through the central end object. A delay queue is established to temporarily store decision control information of multiple side objects. When the corresponding decisions of multiple side objects have been completed, the multiple decision control information in the delay queue is forwarded through the corresponding data channel and the queue is cleared.

[0030] In this embodiment, for different decision content, there are also some relevant information that can only be decided at the central end and then transmitted to the side end (such as decisions involving large models or large amounts of data). In this case, a delayed transmission queue can be established. Multiple side ends can be synchronized by uniformly distributing all decisions after they are obtained from the delayed queue. Since it is a decision involving a large amount of data, the latency requirement is usually relatively low. At the same time, in order to further optimize, a safe buffer period can be reserved for the device based on the previous decision information. This buffer period is pre-controlled by prediction and used to obtain and update the delay information. For example, the device speed can be slowed down to ensure a safe period of half a second to connect to the decision information of the next delayed queue.

[0031] like Figure 3 As shown, the present invention also provides an asymmetric device sharing system for visual data, which includes: The data flow association module 100 is used to obtain the object composition of the data system, synchronize the execution functions of multiple objects and the data flow association between multiple objects based on the execution functions, so as to filter and obtain a shared association list. The shared management list is used to represent the object association list where data acquisition and control execution are separated. The associated communication test module 200 is used to perform network communication tests on the data channels between multiple objects in the shared association list based on the flow direction of data information, and to obtain the channel network status, which includes network transmission speed, network latency and network fluctuation characteristics. The decision requirement judgment module 300 is used to make judgments based on the decision requirements of the channel network status and correlation, and select a data sharing scheme based on the judgment results. The data sharing scheme is used to characterize the data transmission mode and the execution object of the decision, and the decision requirement characterizes the requirement for decision timeliness. The shared scheduling execution module 400 is used to schedule and redistribute the data system based on the data sharing scheme, and to perform data sharing and decision execution according to the data sharing scheme.

[0032] In another preferred embodiment of the present invention, the decision requirement judgment module includes: The decision type determination unit is used to obtain the decision requirements for the transmission and decision type of the corresponding data, and to determine whether it is an instant transmission decision type for multi-side object synchronization. The communication scheduling and allocation unit is used to allocate stable channel bandwidth for real-time information synchronization based on the network status of multiple data channels when the determination result is characterized as an instantaneous transmission decision type for multi-side object synchronization. The direct-access transmission decision unit is used to calculate the information compression ratio of shared data in each data channel based on the stable channel bandwidth, and to establish a direct-access transmission scheme based on the information compression ratio. The direct-access transmission scheme is a side-end decision management type. A cyclic transmission decision unit is used to establish a cyclic sharing scheme based on the central end decision if the transmission decision is not a real-time transmission decision type that is not synchronized across multiple ends. The cyclic sharing scheme is used to coordinate several transmission decision requirements.

[0033] As another preferred embodiment of the present invention, it further includes: A cyclic queue unit is used to obtain the demand frequency of multiple side-end decisions through decision requirements, and to arrange the decision requirements of multiple side-ends based on the demand frequency to establish a cyclic response list, which cyclically cycles within a common multiple period. The cyclic constraint unit is used to calculate the data throughput of the corresponding side data channel based on the time interval corresponding to the demand frequency, and compare it with the original data volume of the decision demand data in the time interval to obtain the information compression ratio of the corresponding data channel. The cyclic synchronization unit is used to perform information sharing and synchronization of data and decisions in a cyclical manner based on the cyclic response list and the corresponding information compression ratio.

[0034] As another preferred embodiment of the present invention, it further includes: The change feature judgment unit is used to judge the information density of visual data of multiple visual objects in consecutive frames. If the amount of change data information of the current visual data in consecutive frames is lower than a preset value, it is marked as a more shared type. A volume channel partitioning unit is used to perform volume data synchronization on the visual data of the volume sharing type, and divide the data channel into volume channels and constant channels based on the volume of data per unit time of the volume data. The variable data transmission unit is used to synchronize the changing pixel data of continuous frames of visual data in real time through the variable channel, and to update through the constant channel when the number of changing pixels in the continuous frames exceeds the set data volume per unit time.

[0035] As another preferred embodiment of the present invention, it further includes: The side-end evaluation unit is used to establish the visual decision-making requirements of multiple side-end objects through the central-end object when the side-end computing power cannot realize the decision-making of visual processing within the preset specification time. The delay synchronization unit is used to establish a delay queue, which is used to temporarily store decision control information of multiple side objects. When the corresponding decisions of multiple side objects have been completed, the multiple decision control information in the delay queue is forwarded through the corresponding data channel and the queue is cleared.

[0036] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, storage, databases, or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in various forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), Rambus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

[0037] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the disclosure in the specification and embodiments. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and embodiments are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the claims.

[0038] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. A method and system for asymmetric device sharing of visual data, characterized in that, Include: The system acquires the object composition of the data system, synchronizes the execution functions of multiple objects and the data flow relationships between multiple objects based on the execution functions, and filters to obtain a shared association list. The shared management list is used to represent the object association list where data acquisition and control execution are separated. Based on the flow of data information, network communication tests are conducted on the data channels between multiple objects in the shared association list to obtain the channel network status, which includes network transmission speed, network latency, and network fluctuation characteristics. The decision-making requirements are determined based on the status of the channel network and the relationships between them. A data sharing scheme is selected based on the determination results. The data sharing scheme is used to characterize the data transmission mode and the execution object of the decision. The decision requirements characterize the need for timeliness of decision-making. The data system is scheduled and redistributed based on the data sharing scheme, and data sharing and decision execution are carried out according to the data sharing scheme.

2. The method and system for asymmetric device sharing of visual data according to claim 1, characterized in that, The step of making a judgment based on the decision requirements of the channel network status and correlation, and selecting a data sharing scheme based on the judgment result, specifically includes: Obtain the corresponding data transmission and decision requirements, and determine whether it is an instant transmission decision type for multi-side object synchronization; If the determination result is characterized as an instantaneous transmission decision type for multi-side object synchronization, then based on the network status of multiple data channels, available communication scheduling is performed, and stable channel bandwidth for current instantaneous information synchronization is allocated. The information compression ratio of shared data in each data channel is calculated based on the stable channel bandwidth, and a direct data transmission scheme is established based on the information compression ratio. The direct data transmission scheme is a side-end decision management type. If the transmission decision type is not a real-time transmission decision type with multi-side synchronization, a circular sharing scheme is established based on the central end decision. The circular sharing scheme is used to coordinate several transmission decision requirements.

3. The method and system for asymmetric device sharing of visual data according to claim 2, characterized in that, The circular sharing scheme includes the following steps: The decision requirements are obtained by acquiring the demand frequency of multiple side-end decisions, and the decision requirements of multiple side-ends are arranged according to the demand frequency to establish a cyclical response list, which cycles within a common multiple period. The data throughput of the corresponding side data channel is calculated based on the time interval corresponding to the demand frequency, and compared with the original data volume of the decision demand data in the time interval to obtain the information compression ratio of the corresponding data channel. Based on the cyclic response list and the corresponding information compression ratio, the information sharing and synchronization of data and decisions are performed cyclically.

4. The method and system for asymmetric device sharing of visual data according to claim 3, characterized in that, It also includes the following steps: The information density of visual data of multiple visual objects is judged in consecutive frames. If the amount of information change of the current visual data in consecutive frames is lower than a preset value, it is marked as a more shared type. Perform volume data synchronization on the visual data of the volume sharing type, and divide the data channel into volume channel and constant channel based on the volume of volume data per unit time. The changing pixel data of continuous frames of visual data is synchronized in real time through a variable channel, and updated through a constant channel when the number of changing pixels in continuous frames exceeds the set data volume per unit time.

5. The method and system for asymmetric device sharing of visual data according to claim 4, characterized in that, It also includes the following steps: When the computing power of the side end cannot make decisions on visual processing within the preset time, the visual decision-making requirements for synchronizing multiple side end objects are established through the central end object. A delay queue is established to temporarily store decision control information of multiple side objects. When the corresponding decisions of multiple side objects have been completed, the multiple decision control information in the delay queue is forwarded through the corresponding data channel and the queue is cleared.

6. A method and system for asymmetric device sharing of visual data, characterized in that, Include: The data flow association module is used to obtain the object composition of the data system, synchronize the execution functions of multiple objects and the data flow association between multiple objects based on the execution functions, so as to filter and obtain a shared association list. The shared management list is used to represent the object association list where data acquisition and control execution are separated. The associated communication test module is used to perform network communication tests on the data channels between multiple objects in the shared association list based on the flow of data information, and to obtain the channel network status, which includes network transmission speed, network latency, and network fluctuation characteristics. The decision requirement judgment module is used to make judgments based on the channel network status and correlation, and select a data sharing scheme based on the judgment results. The data sharing scheme is used to characterize the data transmission mode and the execution object of the decision, and the decision requirement characterizes the requirement for decision timeliness. The shared scheduling and execution module is used to schedule and redistribute the data system based on the data sharing scheme, and to perform data sharing and decision execution according to the data sharing scheme.

7. The method and system for asymmetric device sharing of visual data according to claim 6, characterized in that, The decision-making requirement assessment module includes: The decision type determination unit is used to obtain the decision requirements for the transmission and decision type of the corresponding data, and to determine whether it is an instant transmission decision type for multi-side object synchronization. The communication scheduling and allocation unit is used to allocate stable channel bandwidth for real-time information synchronization based on the network status of multiple data channels when the determination result is characterized as an instantaneous transmission decision type for multi-side object synchronization. The direct-access transmission decision unit is used to calculate the information compression ratio of shared data in each data channel based on the stable channel bandwidth, and to establish a direct-access transmission scheme based on the information compression ratio. The direct-access transmission scheme is a side-end decision management type. A cyclic transmission decision unit is used to establish a cyclic sharing scheme based on the central end decision if the transmission decision is not a real-time transmission decision type that is not synchronized across multiple ends. The cyclic sharing scheme is used to coordinate several transmission decision requirements.

8. The method and system for asymmetric device sharing of visual data according to claim 7, characterized in that, Also includes: A cyclic queue unit is used to obtain the demand frequency of multiple side-end decisions through decision requirements, and to arrange the decision requirements of multiple side-ends based on the demand frequency to establish a cyclic response list, which cyclically cycles within a common multiple period. The cyclic constraint unit is used to calculate the data throughput of the corresponding side data channel based on the time interval corresponding to the demand frequency, and compare it with the original data volume of the decision demand data in the time interval to obtain the information compression ratio of the corresponding data channel. The cyclic synchronization unit is used to perform information sharing and synchronization of data and decisions in a cyclical manner based on the cyclic response list and the corresponding information compression ratio.

9. The method and system for asymmetric device sharing of visual data according to claim 8, characterized in that, Also includes: The change feature judgment unit is used to judge the information density of visual data of multiple visual objects in consecutive frames. If the amount of change data information of the current visual data in consecutive frames is lower than a preset value, it is marked as a more shared type. A volume channel partitioning unit is used to perform volume data synchronization on the visual data of the volume sharing type, and divide the data channel into volume channels and constant channels based on the volume of data per unit time of the volume data. The variable data transmission unit is used to synchronize the changing pixel data of continuous frames of visual data in real time through the variable channel, and to update through the constant channel when the number of changing pixels in the continuous frames exceeds the set data volume per unit time.

10. The method and system for asymmetric device sharing of visual data according to claim 9, characterized in that, Also includes: The side-end evaluation unit is used to establish the visual decision-making requirements of multiple side-end objects through the central-end object when the side-end computing power cannot realize the decision-making of visual processing within the preset specification time. The delay synchronization unit is used to establish a delay queue, which is used to temporarily store decision control information of multiple side objects. When the corresponding decisions of multiple side objects have been completed, the multiple decision control information in the delay queue is forwarded through the corresponding data channel and the queue is cleared.

Images