A task-feedforward image key semantic communication method

Abstract

The present invention provides a task feedforward image key semantic communication method, which belongs to the field of semantic communication technology. The method includes: parsing and processing task feedforward information to determine the target task to be executed; dividing the image into multiple information units according to the task requirement information of the target task, and allocating bandwidth resources of the communication link to the information units according to the importance of the task requirement; according to the allocated bandwidth resources, selecting image compression or outputting semantic tags to process the information units; integrating the data generated after processing into data to be transmitted, and inputting the communication link to realize the return of semantic information. The present invention realizes the task-oriented semantic information screening, sorting and compression process, improves the retention rate of task-related information and the compression rate of irrelevant information when compressing image data, and ensures the return of key semantic information related to the task while achieving the ultimate compression rate.

Description

Technical Field

[0001] The present invention relates to the field of semantic communication technology, and in particular to a task feedforward image key semantic communication method. Background Art

[0002] Semantic communication technology is an emerging communication mode in the field of communication. Its main function is to reduce the amount of transmitted data through information processing during the communication process. The main idea of ​​semantic communication is to extract the meaning of the original data and filter out useless, irrelevant and non-essential information, thereby further compressing the data while retaining the semantics of the data, thereby reducing the amount of information transmitted and reducing the requirements for channel bandwidth. Specifically, semantic communication refers to the realization of semantically accessible communication under the premise that the communicating parties have a common "knowledge base". The biggest difference between semantic communication and traditional communication is that semantic communication has a knowledge base existing at the sending and receiving ends. The sending end extracts semantic information from the source based on knowledge, and the receiving end reconstructs information based on semantic information based on knowledge, thereby reducing the amount of information that needs to be transmitted.

[0003] Existing semantic communication schemes and frameworks usually include eight parts: source, semantic knowledge base, semantic encoder, grammatical encoder, channel, grammatical decoder, semantic decoder and destination. Among them, the five modules of source, grammatical encoder, channel, grammatical decoder and destination are the classic point-to-point communication system model discussed by Shannon. Semantic communication is a system superimposed on the classic communication model, which constitutes semantic-level communication, introduces semantic encoder, semantic decoder and semantic knowledge base, and expands channels and destinations.

[0004] So far, semantic communication technology has carried out a lot of research in network architecture, basic theory, coding technology, security mechanism, etc., and has achieved great results, which has promoted the development of semantic communication technology. Semantic communication has stronger information expression power. Compared with traditional communication, it pays more attention to the meaning of the transmitted information to ensure that both parties can correctly understand the true intention of the information and achieve the task objectives. At the same time, combined with deep learning technology, semantic communication can automatically adapt to various communication environments, optimize coding and transmission strategies, and adopt technologies such as adaptive modulation and automatic retransmission request to improve the robustness and adaptability of communication. Through secure sharing of knowledge bases and combined with technologies such as adversarial encryption, semantic communication can improve the privacy protection of data and prevent potential attackers from stealing information.

[0005] Although semantic communication has shown great potential in many aspects, there are still many unresolved issues and its application development faces many challenges. Under low-bandwidth communication conditions, it is difficult for existing technologies to achieve feedforward key semantic feedback with certain interpretability. Summary of the invention

[0006] The present invention provides a task feedforward image key semantic communication method, which is used to solve the defect of the prior art that it is difficult to realize information feedback under low bandwidth.

[0007] In a first aspect, the present invention provides a task feedforward image key semantic communication method, comprising: parsing and processing task feedforward information to determine a target task to be executed; the content of the target task includes at least one task requirement information, and a task requirement importance corresponding to the task requirement information; dividing the image into multiple information units according to the task requirement information of the target task, and allocating bandwidth resources of a communication link to the information units according to the task requirement importance; wherein the size of the allocated bandwidth resources is positively correlated with the task requirement importance; according to the allocated bandwidth resources, selecting image compression or outputting semantic tags to process the information units; integrating the data generated after processing into data to be transmitted, and inputting the communication link to realize the return of semantic information.

[0008] According to a task feedforward image key semantic communication method provided by the present invention, task feedforward information is parsed and processed to determine a target task to be executed, including: receiving task feedforward information preset according to demand; when the demand is to call a task, calling the target task from a task knowledge base according to the task feedforward information; when the demand is to modify the content of a task, modifying the content of a task according to the task feedforward information, and taking the task after the modified content as the target task, and updating the task knowledge base; when the demand is to add a new task, adding a new task according to the task feedforward information, and taking the new task as the target task, and updating the task knowledge base.

[0009] According to a task feedforward image key semantic communication method provided by the present invention, an image is segmented into multiple information units according to task requirement information of a target task, including: according to the task requirement information, a semantic segmentation algorithm is used to segment the image to obtain multiple information units; information units corresponding to task requirement importance greater than a first preset threshold are used as key semantic information units, information units corresponding to task requirement importance less than or equal to the first preset threshold and greater than a second preset threshold are used as general semantic information units, information units whose task requirement importance is less than or equal to the second preset threshold are used as redundant semantic information units, and the other remaining parts constitute a background information unit.

[0010] According to a task feedforward image key semantic communication method provided by the present invention, bandwidth resources of a communication link are allocated to information units according to the importance of task requirements, including: based on the bandwidth resources of the communication link and the importance of task requirements, bandwidth resources are allocated to information units according to preset priorities; the preset priorities are arranged from front to back in the following order: key semantic information unit, general semantic information unit, redundant semantic information unit.

[0011] According to a task feedforward image key semantic communication method provided by the present invention, according to the allocated bandwidth resources, the information unit is processed by selecting image compression or outputting semantic tags, including: when the information unit is a key semantic information unit, compressing the key semantic information unit based on the image compression method to obtain compressed image data; and when the information unit is a general semantic information unit, using the semantic tag of the general semantic information unit as the object to be transmitted.

[0012] According to a task feedforward image key semantic communication method provided by the present invention, after completing the return of semantic information, it also includes: determining an image data model corresponding to the semantic label from a preset domain knowledge base for use in image reconstruction.

[0013] According to a task feedforward image key semantic communication method provided by the present invention, the algorithm used for image compression is the JEPEG2000 image compression algorithm.

[0014] In a second aspect, the present invention provides an electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the steps of the task-feedforward image key semantic communication method as described above are implemented.

[0015] In a third aspect, the present invention further provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of any of the task-feedforward image key semantic communication methods described above.

[0016] In a fourth aspect, the present invention further provides a computer program product having a computer program stored thereon, which, when executed by a processor, implements the steps of any of the task-feedforward image key semantic communication methods described above.

[0017] The present invention realizes a task-oriented semantic information screening, sorting and compression process, improves the retention rate of task-related information and the compression rate of irrelevant information during image data compression, and ensures the return of key semantic information related to the task while achieving an extreme compression rate.

[0018] The task feedforward image key semantic communication method provided by the present invention designs a semantic feedback mode of task requirement feedforward, provides an interface for the control end to adjust the unmanned end, and improves the pertinence and effectiveness of image data feedback during task execution.

[0019] The present invention provides support for the process of semantic communication by establishing a task knowledge base and a domain knowledge base, designs corresponding interaction mechanisms and update mechanisms, ensures the synchronization and completeness of the knowledge base, and provides support for semantic communication technology to achieve high compression ratio and high task efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0021] Figure 1 This is one of the flow charts of the task feedforward image key semantic communication method provided by the present invention;

[0022] Figure 2 It is a schematic diagram of the structure of the task knowledge base provided by the present invention;

[0023] Figure 3 It is a flowchart of the task feedforward information generation method provided by the present invention;

[0024] Figure 4 It is a schematic diagram of dividing an image into different types of information units provided by the present invention;

[0025] Figure 5 This is the second flow chart of the task feedforward image key semantic communication method provided by the present invention;

[0026] Figure 6 It is a structural schematic diagram of the task feedforward image key semantic communication system provided by the present invention;

[0027] Figure 7 It is a structural schematic diagram of the electronic device provided by the present invention. DETAILED DESCRIPTION

[0028] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the drawings of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0029] It should be noted that, in the description of the embodiments of the present invention, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "include one..." do not exclude the existence of other identical elements in the process, method, article or device including the elements. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to the specific circumstances.

[0030] The terms "first", "second", etc. in this application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of the same type, and the number of objects is not limited. For example, the first object can be one or more.

[0031] Combine the following Figure 1-Figure 7 The task feedforward image key semantic communication method and device provided by the embodiments of the present invention are described.

[0032] Figure 1 is one of the flow charts of the task feedforward image key semantic communication method provided by the present invention, such as Figure 1 As shown, including but not limited to the following steps:

[0033] Step 101: parse and process the task feedforward information to determine the target task to be executed; the content of the target task includes at least one task requirement information and the task requirement importance corresponding to the task requirement information.

[0034] It should be noted that the implementation of the technical solution of the present invention mainly involves the unmanned end and the control end. Among them, the unmanned end can be an unmanned system such as a drone or an autonomous vehicle; the control end can be a control system such as a ground control station or a cloud server. Before the start of the task, the control end will pre-set a series of instructions and expected behaviors according to the task objectives and environmental conditions. These instructions may include but are not limited to flight routes, data types collected, target tasks, target detection requirements, etc., to achieve control of the unmanned end and perform semantic feedback.

[0035] Specifically, in the embodiment of the present invention, the control end can generate task feedforward information. Once the task feedforward information is ready, the control end will send it to the unmanned end. After receiving this information, the unmanned end immediately begins to parse and understand the instructions and requirements therein to implement a series of operations such as calling, adjusting and executing the task.

[0036] Figure 2 is a schematic diagram of the structure of the task knowledge base provided by the present invention, such as Figure 2 As shown, a general implementation project (such as the task knowledge base of post-disaster reconstruction) includes multiple tasks (i.e., subtasks, such as trapped situation analysis), and a task includes multiple task requirement information, each of which corresponds to a task requirement importance. The task requirement importance can be pre-set by experts according to the specific situation of the implementation project.

[0037] Taking the target task of trapped situation analysis as an example, the task requirement information of trapped situation analysis includes: trapped location, trapped person and trapped environment; further, the task requirement importance corresponding to the trapped location is 8, the task requirement importance corresponding to the trapped person is 10, and the task requirement importance corresponding to the trapped environment is 6. The value range of the task requirement importance is 0 to 10.

[0038] Step 102: Segment the image into multiple information units according to the task requirement information of the target task, and allocate bandwidth resources of the communication link to the information units according to the importance of the task requirement.

[0039] Among them, the size of the allocated bandwidth resources is positively correlated with the importance of task requirements.

[0040] It can be understood that among the information units segmented in the present invention, there are such information units: the information unit corresponds to a specific area or feature in the image, and these areas or features correspond to the task requirement information.

[0041] For example, for the task of analyzing the trapped situation, the information unit corresponding to the trapped position, the information unit corresponding to the trapped person, and the information unit corresponding to the trapped environment can be obtained; of course, some other irrelevant information units are also included.

[0042] According to the importance of the task requirements of each information unit, the present invention will allocate corresponding bandwidth resources to them. Information units with high importance will obtain more bandwidth resources to ensure that key information can be transmitted first.

[0043] Step 103: According to the allocated bandwidth resources, a method of image compression or outputting semantic tags is selected to process the information unit.

[0044] The present invention can reduce the amount of data by image compression to adapt to the allocated bandwidth resources.

[0045] The present invention can also provide descriptive labels for information units by outputting semantic tags to adapt to the less allocated bandwidth resources.

[0046] For example, the semantic label may be “personnel”, “road”, etc.

[0047] Step 104: Integrate the processed data into data to be transmitted, and input it into the communication link to realize the return of semantic information.

[0048] Finally, the processed information is integrated into the information to be transmitted and input into the communication link for encoding, transmission and decoding to realize the return of semantic information. Among them, the data information transmitted through the link is the semantic information of the source image.

[0049] Based on the contents of the above embodiments, as an optional embodiment, the task feedforward image key semantic communication method provided by the present invention parses and processes the task feedforward information to determine the target task to be executed, including: receiving task feedforward information preset according to requirements; when the requirement is to call a task, calling the target task from the task knowledge base according to the task feedforward information; when the requirement is to modify the content of a task, modifying the content of a task according to the task feedforward information, and taking the task after the modification as the target task, and updating the task knowledge base; when the requirement is to add a new task, adding a new task according to the task feedforward information, and taking the new task as the target task, and updating the task knowledge base. Refer to the following Figure 3 An embodiment of the present invention will be described.

[0050] Figure 3 is a flow chart of the task feedforward information generation method provided by the present invention, such as Figure 3 As shown, the control end analyzes the current task and determines whether the current task is included in the task knowledge base. If it is a new task, it is necessary to fully define the task and the content of the task (task requirement information and task requirement importance), and output relevant information; if the task knowledge base already has related tasks, it is determined whether the task content has changed. If there is a change, the task requirement information and task requirement importance are updated in time, and relevant information is output. If there is no change, the task name is directly output; finally, the current task-oriented demand feedforward information is generated and sent to the unmanned end. At the same time, the task can be adjusted at any time during the task execution process to improve the effectiveness of information feedback.

[0051] The requirements generated by the control end include three forms: 1. Defining new tasks (there is no relevant information in the task knowledge base); 2. Adding existing task requirement information (the task knowledge base already has relevant tasks, and new requirements are added); 3. Modifying task requirement information (the task knowledge base already has tasks, and the requirements part is added, deleted, and modified).

[0052] The present invention can realize the updating and synchronization of the knowledge base of the control end and the unmanned end through task feedforward information, provides an interface for more fully utilizing the resources of the knowledge base in semantic communication technology, improves the efficiency of semantic communication, and reduces the semantic distortion rate.

[0053] Based on the contents of the above embodiments, as an optional embodiment, the task feedforward image key semantic communication method provided by the present invention divides the image into multiple information units according to the task requirement information of the target task, including: according to the task requirement information, using a semantic segmentation algorithm to segment the image to obtain multiple information units; using the information unit corresponding to the task requirement importance greater than a first preset threshold as the key semantic information unit, using the information unit corresponding to the task requirement importance less than or equal to the first preset threshold and greater than the second preset threshold as the general semantic information unit, using the information unit whose task requirement importance is less than or equal to the second preset threshold as the redundant semantic information unit, and the other remaining parts constitute a background information unit.

[0054] Figure 4 is a schematic diagram of the present invention for dividing an image into different types of information units, such as Figure 4 As shown, the present invention can perform target detection through algorithms such as Yolo, match it with the demand information of the task knowledge base, set a first preset threshold k1 and a second preset threshold k2, and use the above method to classify the information units.

[0055] Figure 5 This is the second flow chart of the task feedforward image key semantic communication method provided by the present invention, and the following reference is made to Figure 5 The optional technical solutions of the present invention are further described.

[0056] As an optional embodiment, the task feedforward image key semantic communication method provided by the present invention allocates bandwidth resources of the communication link to the information unit according to the importance of the task requirement, including: allocating bandwidth resources to the information unit according to preset priorities based on the bandwidth resources of the communication link and the importance of the task requirement; the preset priorities are arranged from front to back in the following order: key semantic information unit, general semantic information unit, redundant semantic information unit.

[0057] Specifically, all information units are classified and sorted according to their importance. The adaptive semantic information organization module analyzes bandwidth conditions and allocates bandwidth, considering key semantic information units, general semantic information units, and redundant semantic information units in turn. If there is sufficient bandwidth, redundant semantic information units do not need to be deleted, and general semantic information units can be adjusted to image data transmission; if bandwidth is limited, all redundant semantic information units are deleted; if bandwidth is extremely scarce, general semantic information units can also be deleted.

[0058] As an optional embodiment, the task feedforward image key semantic communication method provided by the present invention selects image compression or output semantic label method to process the information unit according to the allocated bandwidth resources, including: when the information unit is a key semantic information unit, compressing the key semantic information unit based on the image compression method to obtain compressed image data; and when the information unit is a general semantic information unit, using the semantic label of the general semantic information unit as the object to be transmitted.

[0059] The image compression algorithm may be the JEPEG2000 image compression algorithm, and the compression rate may be determined according to the allocated bandwidth. For example, if the size of an information unit is 10 bits and the allocated bandwidth is 6 bits, a compression rate of 60% is performed.

[0060] As an optional embodiment, the task feedforward image key semantic communication method provided by the present invention, after completing the return of semantic information, also includes: determining the image data model corresponding to the semantic label from a preset domain knowledge base for image reconstruction.

[0061] The control end has a comprehensive domain knowledge base, which contains basic image models corresponding to various semantic tags. For information with low importance, semantic tags are transmitted to reduce bandwidth consumption. The control end calls the image data model in the domain knowledge base based on the semantic tags to improve the visual effect of the reconstructed image.

[0062] On the other hand, in order to further illustrate the technical solution of the present invention, a task feedforward image key semantic communication system is provided below, such as Figure 6 As shown, Figure 6 It is a structural schematic diagram of the task feedforward image key semantic communication system provided by the present invention.

[0063] The task feedforward image key semantic communication system provided by the present invention includes: a control end, an unmanned end and a communication link; wherein the unmanned end includes two supporting knowledge bases, namely a task knowledge base and a domain knowledge base, and four information processing units, namely a task parsing unit, a semantic segmentation unit, a semantic screening unit and a multi-scale compression unit; the receiving end includes two supporting knowledge bases, namely a task knowledge base and a domain knowledge base, and four information processing units, namely an information supplementation unit, an image reconstruction unit, an information presentation unit and a demand generation unit, and its specific composition and principle are as follows.

[0064] (1) Domain knowledge base: The domain knowledge base is formed by investigating the usage background and application field and organizing the domain knowledge that may be used in the task execution process. The unmanned end can perform in-depth processing of information based on the domain knowledge base to support processes such as de-redundancy; the control end can supplement the information based on the domain knowledge base to improve the visual effect of the reconstructed image. During the key semantic feedback process, the sender and receiver complete the synchronization of the domain knowledge base.

[0065] (2) Task knowledge base: The task knowledge base is formed by analyzing the tasks facing the usage context, organizing the tasks, task information requirements, and the importance scores of the information requirements. The control end can generate feedforward demand information by selecting tasks, defining tasks, modifying task requirements, modifying task requirement importance scores, etc., and adjust and control the unmanned end. The unmanned end can adjust the task and information processing focus in a timely manner based on the task feedforward information to ensure the feedback of key semantics related to the task. In the process of task knowledge feedforward, the sender and receiver complete the knowledge base synchronization.

[0066] (3) Task parsing unit: The task parsing unit is mainly implemented through a matching query algorithm. After the task feedforward information is input, it is matched with the task knowledge base. If the task feedforward information is the task name, the task in the task knowledge base is directly called; if the task feedforward information is the task and the modified task requirement information / task requirement importance, the task requirement information / task requirement importance of the corresponding task in the task library is modified and called; if the task feedforward information is a newly defined task, it is added to the task knowledge base and then called.

[0067] (4) Semantic segmentation unit: The semantic segmentation unit can be implemented by algorithms such as Segment Anything Model. In specific applications, it should be retrained based on the task background and domain knowledge. The main goal of the semantic segmentation unit is to segment the collected image S into n information units based on task requirements for subsequent in-depth processing.

[0068] (5) Semantic screening unit: The semantic screening unit can be implemented in the form of label matching through a matching algorithm. After inputting all the segmented information units and their semantic labels, a matching query is performed with the task knowledge base and the domain knowledge base to divide the information units into: key semantic information units, general semantic information units, redundant semantic information units, and background information units.

[0069] (6) Adaptive compression unit: The adaptive compression unit allocates bandwidth resources to information units by analyzing the importance scores of information units and existing bandwidth resources, and compresses different information units with different compression ratios. The compression process can use various compression algorithms such as JEPEG2000, and some non-critical information units can be transmitted or deleted in the form of tags when necessary.

[0070] (7) Information supplement unit: The information supplement unit is based on the domain knowledge base and restores the semantic labels into image information units to provide the overall visual effect of the image.

[0071] (8) Image reconstruction unit: The image reconstruction unit restores all information units into a complete image through image processing algorithms such as Alpha fusion, thereby achieving image reconstruction.

[0072] Figure 7 is a schematic diagram of the structure of the electronic device provided by the present invention, such as Figure 7 As shown, the electronic device may include: a processor 710, a communication interface 720, a memory 730 and a communication bus 740, wherein the processor 710, the communication interface 720 and the memory 730 communicate with each other through the communication bus 740. The processor 710 may call the logic instructions in the memory 730 to execute the task feedforward image key semantic communication method, which includes: parsing the task feedforward information to determine the target task to be executed; the content of the target task includes at least one task requirement information and the task requirement importance corresponding to the task requirement information; dividing the image into multiple information units according to the task requirement information of the target task, and allocating the bandwidth resources of the communication link to the information unit according to the task requirement importance; wherein the size of the allocated bandwidth resources is positively correlated with the task requirement importance; according to the allocated bandwidth resources, selecting the image compression or outputting the semantic label to process the information unit; integrating the data generated after processing into the data to be transmitted, and inputting the communication link to realize the return of the semantic information.

[0073] On the other hand, the present invention also provides a computer program product, which includes a computer program stored on a non-transitory computer-readable storage medium, and the computer program includes program instructions. When the program instructions are executed by a computer, the computer can execute the task feedforward image key semantic communication method provided by the above-mentioned embodiments, the method including: parsing and processing the task feedforward information to determine the target task to be executed; the content of the target task includes at least one task requirement information, and the task requirement importance corresponding to the task requirement information one by one; according to the task requirement information of the target task, the image is divided into multiple information units, and according to the task requirement importance, the bandwidth resources of the communication link are allocated to the information units; wherein the size of the allocated bandwidth resources is positively correlated with the task requirement importance; according to the allocated bandwidth resources, the information unit is processed by selecting image compression or outputting semantic tags; the data generated after processing is integrated into the data to be transmitted, and input into the communication link to realize the return of semantic information.

[0074] On the other hand, the present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, is implemented to execute the task feedforward image key semantic communication method provided by the above-mentioned embodiments, the method comprising: parsing and processing task feedforward information to determine a target task to be executed; the content of the target task includes at least one task requirement information, and a task requirement importance corresponding to the task requirement information; dividing the image into multiple information units according to the task requirement information of the target task, and allocating bandwidth resources of the communication link to the information units according to the task requirement importance; wherein the size of the allocated bandwidth resources is positively correlated with the task requirement importance; according to the allocated bandwidth resources, selecting image compression or outputting semantic tags to process the information units; integrating the data generated after processing into data to be transmitted, and inputting the communication link to realize the return of semantic information.

[0075] The system embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated. Some or all of the modules may be selected according to actual needs to achieve the purpose of the present embodiment. Those of ordinary skill in the art may understand and implement the present invention without creative effort.

[0076] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0077] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A task feedforward image key semantic communication method, characterized in that: include: Analyze and process the task feedforward information to determine the target task to be executed; the content of the target task includes at least one task requirement information and the task requirement importance corresponding to the task requirement information; The image is divided into multiple information units according to the task requirement information of the target task, and the bandwidth resources of the communication link are allocated to the information units according to the importance of the task requirement; wherein the size of the allocated bandwidth resources is positively correlated with the importance of the task requirement; According to the allocated bandwidth resources, the information unit is processed by selecting image compression or outputting semantic labels; The processed data is integrated into data to be transmitted and input into the communication link to realize the return of semantic information.

2. The task feedforward image key semantic communication method according to claim 1, characterized in that: Analyze and process the task feedforward information to determine the target task to be executed, including: Receive task feedforward information pre-set according to requirements; When the demand is to call a task, the target task is called from the task knowledge base according to the task feedforward information; When the requirement is to modify the content of a task, the content of the task is modified according to the task feedforward information, and the task after the modification is used as the target task, and the task knowledge base is updated; When the demand is to add a new task, the new task is added according to the task feedforward information, and the new task is used as the target task, and the task knowledge base is updated.

3. The task feedforward image key semantic communication method according to claim 1, characterized in that: The image is segmented into multiple information units according to the task requirements of the target task, including: According to the task requirement information, the image is segmented using the semantic segmentation algorithm to obtain multiple information units; The information unit corresponding to the task requirement importance greater than the first preset threshold is taken as the key semantic information unit, the information unit corresponding to the task requirement importance less than or equal to the first preset threshold and greater than the second preset threshold is taken as the general semantic information unit, the information unit whose task requirement importance is less than or equal to the second preset threshold is taken as the redundant semantic information unit, and the remaining parts constitute a background information unit.

4. The task feedforward image key semantic communication method according to claim 3, characterized in that: According to the importance of the task requirements, bandwidth resources of the communication link are allocated to the information unit, including: Based on the bandwidth resources of the communication link and the importance of the task requirements, bandwidth resources are allocated to the information units according to the preset priority; The preset priorities are arranged in order from front to back: key semantic information unit, general semantic information unit, redundant semantic information unit.

5. The task feed-forward image key semantic communication method according to claim 3, characterized in that: According to the allocated bandwidth resources, the information unit is processed by selecting image compression or outputting semantic labels, including: In the case where the information unit is a key semantic information unit, compressing the key semantic information unit based on an image compression method to obtain compressed image data; and When the information unit is a general semantic information unit, the semantic tag of the general semantic information unit is used as the object to be transmitted.

6. The task feed-forward image key semantic communication method according to claim 5, characterized in that: After completing the return of semantic information, it also includes: From the preset domain knowledge base, the image data model corresponding to the semantic label is determined for image reconstruction.

7. The task feed-forward image key semantic communication method according to claim 1, characterized in that: The algorithm used for image compression is the JEPEG2000 image compression algorithm.

8. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, the steps of the task feed-forward image key semantic communication method as described in any one of claims 1 to 7 are implemented.

9. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the task feed-forward image key semantic communication method as claimed in any one of claims 1 to 7 are implemented.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the task feed-forward image key semantic communication method as claimed in any one of claims 1 to 7 are implemented.

Images