An information processing method, device, storage medium, and program product
By generating target data packets and considering the semantic information and transmission performance information of the information to be transmitted, the transmission delay problem of traditional communication systems under network congestion is solved, and efficient communication is achieved.
Patent Information
- Application Number
- CN202610976667.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-07-01
- Publication Date
- 2026-11-17
AI Technical Summary
When faced with network congestion, traditional communication systems rely on retransmission mechanisms or forward error correction, which increases transmission delays and affects communication efficiency.
By determining the semantic information content of the information to be transmitted and multiple data packets with different semantic bit rates, a target data packet is generated. During the transmission process, the semantic information content of the object and the transmission performance information are considered to avoid retransmission.
It improved system performance, ensured communication efficiency, and solved the transmission delay problem caused by network congestion.
Smart Images

Figure CN123124000A_ABST
Abstract
Description
Technical Field
[0001] This application relates to information processing technology in the field of communication technology, and more particularly to an information processing method, device, storage medium and program product. Background Technology
[0002] With the widespread adoption of 5G and 6G mobile communication technologies, the application of high-dimensional data is becoming increasingly common, leading to an exponential increase in data volume and resulting in channel congestion. Traditional communication systems optimize by minimizing the bit error rate (BER), using retransmission mechanisms or forward error correction to address packet loss caused by channel congestion. However, they do not consider the semantic information of data packets during transmission, which increases transmission latency, reduces system performance, and impacts communication efficiency. Summary of the Invention
[0003] This application provides an information processing method, device, storage medium, and program product, which solves the problem that transmission schemes for network congestion in related technologies increase transmission delay, thereby improving system performance and ensuring communication efficiency.
[0004] The technical solution of this application embodiment is implemented as follows: An information processing method, applied to a first terminal, includes: Determine the semantic information content of each object in the information to be transmitted; Data packets with different semantic bit rates are determined based on the target semantic information content and target bit information; Based on transmission performance information, the semantic information of each object, and the multiple data packets with different semantic bit rates, a target data packet corresponding to the information to be transmitted is generated; The target data packet is sent to the second terminal so that the second terminal can determine the information to be transmitted based on the target data packet.
[0005] In the above scheme, determining the semantic information content of each object in the information to be transmitted includes: Multiple segmentation masks are obtained by processing the information to be transmitted using a target semantic segmentation model; Based on each segmentation mask and the information to be transmitted, generate relational feature information of the object of the information to be transmitted; Based on the relational feature information and the similarity between the objects, the semantic information content of each object is determined.
[0006] In the above scheme, determining the semantic information content of each object based on the similarity between the relational feature information and the objects includes: The matching degree between objects is determined based on the aforementioned relationship feature information; Determine the similarity between the objects whose information is to be transmitted; Based on the matching degree, the similarity, the first weight corresponding to the matching degree, and the second weight corresponding to the similarity, the semantic information content of each object is determined.
[0007] In the above scheme, generating the target data packet corresponding to the information to be transmitted based on transmission performance information, the semantic information content of each object, and the multiple data packets with different semantic bit rates includes: Based on the initial transmission performance information, the semantic information of each object, and the multiple data packets with different semantic bit rates, the initial data packet corresponding to the information to be transmitted is determined; Determine real-time transmission performance information; The target data packet is determined based on the real-time transmission performance information, the initial data packet, and the multiple data packets with different semantic bit rates.
[0008] In the above scheme, determining the target data packet based on the real-time transmission performance information, the initial data packet, and the multiple data packets with different semantic bit rates includes: Determine the first real-time transmission performance metric; If the first real-time transmission performance indicator meets the first threshold, the initial data packet is updated step by step based on the multiple data packets with different semantic bit rates to obtain the target data packet; If the first real-time transmission performance indicator meets the second threshold, a data packet with a target bit rate is determined from the multiple data packets with different semantic bit rates, and the initial data packet is updated to the data packet with the target bit rate to obtain the target data packet.
[0009] In the above scheme, the step of updating the initial data packet level by level based on the multiple data packets with different semantic bit rates to obtain the target data packet includes: For the untransmitted objects in the information to be transmitted, the first proportion data packet in the initial data packet is updated to a data packet with a first semantic bit rate to obtain a first data packet to be determined, and a second real-time transmission performance index is determined; wherein, the bit rate of the data packet with the first semantic bit rate is greater than the bit rate of the initial data packet; If the second real-time performance indicator meets the first threshold, update the second proportion data packet in the first data to be determined to a data packet with the first semantic bit rate to obtain the second data packet to be determined, until the Nth data packet to be determined is a data packet with the first semantic bit rate; the second proportion is greater than the first proportion; Determine the third real-time transmission performance indicator; If the third real-time transmission performance indicator meets the first threshold, the third proportion data packet in the Nth data packet to be determined is updated to a data packet with the second semantic bit rate, until all the target data packets are data packets with the Nth semantic bit rate; wherein, the data packet with the Nth semantic bit rate is the data packet with the largest bit rate among the multiple data packets with different semantic bit rates; the second semantic bit rate is greater than the first semantic bit rate.
[0010] An information processing method, applied to a second terminal, includes: The system receives a target data packet corresponding to the information to be transmitted sent by a first terminal; wherein the target data packet is generated by the first terminal based on the initial performance information of the network, the semantic information content of each object of the information to be transmitted, and multiple data packets with different semantic bit rates. The target data packet is parsed to obtain the parsed information; Determine the semantic information content of each object in the parsed information; If the semantic information of each object in the parsed information matches the semantic information of the corresponding object in the information to be transmitted, then the parsed information is transmitted.
[0011] A first information processing apparatus, the apparatus comprising: The first determining unit is used to determine the semantic information content of each object of the information to be transmitted; The first determining unit is further configured to determine multiple data packets with different semantic bit rates based on the target semantic information content and the target bit information; The first processing unit is used to generate a target data packet corresponding to the information to be transmitted based on transmission performance information, the semantic information of each object, and the multiple data packets with different semantic bit rates. A sending unit is configured to send the target data packet to a second terminal, so that the second terminal determines the information to be transmitted based on the target data packet.
[0012] A second information processing apparatus, the apparatus comprising: The receiving unit is configured to receive a target data packet corresponding to the information to be transmitted sent by the first terminal; wherein the target data packet is generated by the first terminal based on the initial performance information of the network, the semantic information content of each object of the information to be transmitted, and multiple data packets with different semantic bit rates; The second processing unit is used to parse the target data packet to obtain parsed information. The second determining unit is used to determine the amount of semantic information of each object in the parsed information; The second processing unit is further configured to transmit the parsed information if the semantic information of each object in the parsed information matches the semantic information of the corresponding object in the information to be transmitted.
[0013] An information processing device, the device comprising: a processor, a memory, and a communication bus; The communication bus is used to realize the communication connection between the processor and the memory; The processor is used to execute the information determination program in the memory to implement the steps of the information determination method described above.
[0014] A computer-readable storage medium storing one or more programs that can be executed by one or more processors to implement the steps of the information processing method described above.
[0015] A computer program product comprising a computer program that, when executed by a processor, implements the aforementioned information processing method.
[0016] The information processing method, device, storage medium, and program product provided in this application embodiment can determine the semantic information content of each object in the information to be transmitted, determine multiple data packets with different semantic bit rates based on the target semantic information content and target bit information, generate a target data packet corresponding to the information to be transmitted based on transmission performance information, the semantic information content of each object, and the multiple data packets with different semantic bit rates, and send the target data packet to a second terminal so that the second terminal can determine the information to be transmitted based on the target data packet. In this way, the target data packet of the information to be transmitted can be determined according to the semantic information content of the objects in the information to be transmitted and the determined multiple data packets with different semantic bit rates, combined with the transmission performance information, and the target data packet can be sent to the corresponding second terminal. Obviously, the semantic information content of the objects in the information to be transmitted and the transmission performance information are considered when transmitting the information to be transmitted, ensuring the successful transmission of the target data packet without retransmission. This solves the problem that transmission schemes for network congestion in related technologies will increase transmission delay, thereby improving system performance and ensuring communication efficiency. Attached Figure Description
[0017] Figure 1 This is a flowchart illustrating an information processing method provided in an embodiment of this application; Figure 2 This is a schematic diagram illustrating the relationship between the semantic information content and the number of bits in a data packet in an information processing method provided in this application embodiment; Figure 3 This is a schematic diagram of data packet updating in an information processing method provided in an embodiment of this application; Figure 4 This is a flowchart illustrating another information processing method provided in an embodiment of this application; Figure 5 This is a schematic diagram of the structure of a first information processing device provided in an embodiment of this application; Figure 6 This is a schematic diagram of the structure of a second information processing device provided in an embodiment of this application; Figure 7 This is a schematic diagram of the structure of a first terminal provided in an embodiment of this application; Figure 8 This is a schematic diagram of the structure of a second terminal provided in an embodiment of this application. Detailed Implementation
[0018] The technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings.
[0019] It should be understood that the phrases "embodiments of this application" or "foreign embodiments" throughout the specification mean that a specific feature, structure, or characteristic related to an embodiment is included in at least one embodiment of this application. Therefore, "embodiments of this application" or "in the foreign embodiments" appearing throughout the specification do not necessarily refer to the same embodiment. Furthermore, these specific features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. In the various embodiments of this application, the sequence numbers of the above-described processes do not imply a sequential order of execution; the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application. The sequence numbers of the above-described embodiments are merely descriptive and do not represent the superiority or inferiority of the embodiments.
[0020] Unless otherwise specified, any step in the embodiments of this application performed by the electronic device may be executed by the processor of the electronic device. It is also worth noting that the embodiments of this application do not limit the order in which the electronic device performs the following steps. Furthermore, the methods used to process data in different embodiments may be the same or different methods. It should also be noted that any step in the embodiments of this application can be executed independently by the electronic device; that is, when the electronic device performs any step in the following embodiments, it may not depend on the execution of other steps.
[0021] It should be understood that the specific embodiments described herein are for illustrative purposes only and are not intended to limit the scope of this application.
[0022] This application provides an information processing method, which can be applied to a first terminal, as shown below. Figure 1 As shown, the information processing method may include the following steps: Step 101: Determine the semantic information content of each object in the information to be transmitted.
[0023] Here, the information to be transmitted can refer to an image or video that needs to be transmitted from the sender to the receiver; the first terminal can refer to the sender and the second terminal can refer to the receiver; the object can refer to the object in the information to be transmitted, specifically the object in the image or video to be transmitted.
[0024] It should be noted that the semantic information content of each object can be determined based on the similarity and matching degree between objects in the information to be transmitted.
[0025] Step 102: Determine multiple data packets with different semantic bit rates based on the target semantic information content and target bit information.
[0026] The target semantic information and target bit information can be pre-set according to specific needs and actual application scenarios. Target bit information can refer to the target number of bits.
[0027] In the embodiments of this application, the ratio between the target semantic information content and the corresponding target number of bits can be calculated to obtain multiple data packets with different semantic bit rates.
[0028] In one feasible embodiment, two data packets with different semantic bit rates, namely data packet A and data packet B, can be determined; wherein, data packet A has a target semantic information content of 100 and a target bit count of 100; and data packet B has a target semantic information content of 70 and a bit count of 50.
[0029] Step 103: Based on transmission performance information, the semantic information of each object, and multiple data packets with different semantic bit rates, generate the target data packet corresponding to the information to be transmitted.
[0030] The transmission performance information refers to the performance information during communication between the first terminal and the second terminal. It should be noted that the transmission performance information can include various transmission performance indicators that characterize communication quality. Specifically, the transmission performance information can include initial transmission performance information and real-time transmission performance information.
[0031] Specifically, the first terminal can process transmission performance information, the amount of semantic information for each object, and multiple data packets with different semantic bit rates to generate target data packets for the information to be transmitted.
[0032] Step 104: Send the target data packet to the second terminal so that the second terminal can determine the information to be transmitted based on the target data packet.
[0033] In this embodiment, the target data packet may include multiple data packet sequences with semantic bit rates, which can be sent to the second terminal in sequence; furthermore, the first terminal can send the target data packet to the second terminal through a conventional digital communication system. It should be noted that the digital communication system may include Quadrature Amplitude Modulation (QAM0) or Pulse Amplitude Modulation (PAM).
[0034] Based on the foregoing embodiments, in other embodiments of this application, step 101 can be implemented in the following ways: A1. Multiple segmentation masks are obtained by processing the information to be transmitted using the target semantic segmentation model.
[0035] Among them, the target semantic segmentation model can refer to the Segment Anything Model (SAM).
[0036] Specifically, if the information to be transmitted is an image, the SAM model can be directly used to perform semantic segmentation on the image to obtain a segmentation mask. If the information to be transmitted is a video, each frame of the video to be transmitted is first determined, and then the SAM model is used to perform semantic segmentation on each frame to obtain a segmentation mask.
[0037] A2. Generate the relational feature information of the object to be transmitted based on each segmentation mask and the information to be transmitted.
[0038] It should be noted that relational feature information can be generated by processing each segmentation mask and the information to be transmitted. Specifically, a Scene Graph Generation (SGG) model can be used to process each segmentation mask and the image to be transmitted or each frame of image to obtain relational feature information. In one feasible embodiment, relational feature information can refer to a feature matrix that can characterize the relationship between objects.
[0039] A3. Based on relational feature information and the similarity between objects, determine the semantic information content of each object.
[0040] Specifically, the matching degree between objects in the information to be transmitted can be determined based on relational feature information, and the semantic information content of each object can be determined based on the matching degree and similarity between objects.
[0041] In other embodiments of this application, determining the semantic information content of each object based on relational feature information and the similarity between objects includes: The degree of matching between objects is determined based on relational feature information.
[0042] Among these methods, the matching degree between objects in the information to be transmitted can be obtained by analyzing the relational feature information.
[0043] Determine the similarity between the objects whose information is to be transmitted.
[0044] Specifically, the similarity between objects in the information to be transmitted can be determined using a multimodal large model. It should be noted that the multimodal large model can refer to a Contrastive Language–Image Pre-training (CLIP) model.
[0045] The semantic information content of each object is determined based on the matching degree, similarity, the first weight corresponding to the matching degree, and the second weight corresponding to the similarity.
[0046] In this embodiment of the application, for each object in the information to be transmitted, the matching degree between objects, the first weight, the similarity between objects, and the second weight can be calculated to obtain the semantic information of each object.
[0047] In other embodiments of this application, step 103 described above can be implemented in the following ways: B1. Based on the initial transmission performance information, the semantic information of each object, and multiple data packets with different semantic bit rates, determine the initial data packet corresponding to the information to be transmitted.
[0048] The initial transmission performance information refers to the communication quality between the first terminal and the second terminal at the very beginning. Specifically, based on the initial transmission performance information and the semantic information of each object, a data packet with an appropriate semantic bit rate can be selected from a plurality of pre-determined data packets with different semantic bit rates, and an initial data packet corresponding to the information to be transmitted can be generated.
[0049] In one feasible embodiment, the initial transmission performance information may include an initial channel quality indicator, the signal-to-interference plus-noise ratio (SNR). Furthermore, the initial data packets include the data packet with the lowest bit rate among multiple data packets with different semantic bit rates.
[0050] B2. Obtain real-time transmission performance information.
[0051] It should be noted that transmission performance can be monitored in real time. After generating the initial data packet corresponding to the information to be transmitted, the current real-time transmission performance information can be determined based on the monitoring results.
[0052] B3. Determine the target data packet based on real-time transmission performance information, initial data packets, and data packets with multiple different semantic bit rates.
[0053] Specifically, the target data packet can be obtained by updating the initial data packet based on real-time transmission performance information and multiple data packets with different semantic bit rates.
[0054] In other embodiments of this application, determining the target data packet based on real-time transmission performance information, the initial data packet, and multiple data packets with different semantic bit rates includes: Determine the first real-time transmission performance metric.
[0055] The first real-time performance metric may include metrics such as transmit buffer occupancy rate, response rate, and network status reported by the receiver; the response rate may include acknowledgment (ACK) response rate or negative acknowledgment (NACK) response rate; and the reported network status may include parameters such as packet loss rate, latency, and jitter.
[0056] Specifically, the first terminal can send probe packets to the second terminal according to the target period, and the second terminal can send the first real-time performance indicators of the network obtained in real time to the first terminal to ensure the accuracy of the network status data monitored by the first terminal.
[0057] If the first real-time transmission performance indicator meets the first threshold, the initial data packet is updated step by step based on multiple data packets with different semantic bit rates to obtain the target data packet.
[0058] In this embodiment, the first threshold may refer to the threshold corresponding to each performance indicator in the pre-set real-time performance information. In one feasible embodiment, if the first real-time transmission performance indicator includes packet loss rate, then the first threshold is the threshold corresponding to packet loss rate; if the first real-time transmission performance indicator includes latency, then the first threshold is the threshold corresponding to latency. The first threshold corresponding to packet loss rate can be 5%-25%, and the first threshold corresponding to latency can be 100-600ms. If the packet loss rate of the first real-time performance indicator is within the range of 5%-25%, then it is considered to meet the first threshold; if the latency of the first real-time performance indicator is within the range of 100-600ms, then it is considered to meet the first threshold.
[0059] In other embodiments of this application, if all first real-time performance transmission indicators meet the first threshold, it is determined that the network has experienced mild and moderate congestion. At this time, the target data packet can be obtained by updating the initial data packet step by step according to the size of the bit rate based on the data packets with different semantic bit rates.
[0060] If the first real-time transmission performance indicator meets the second threshold, the target bit rate data packet is determined from multiple data packets with different semantic bit rates, and the initial data packet is updated to the target bit rate data packet to obtain the target data packet.
[0061] In one feasible embodiment, if the first real-time transmission performance indicator includes packet loss rate, then the second threshold is the threshold corresponding to the packet loss rate; if the first real-time transmission performance indicator includes latency, then the second threshold is the threshold corresponding to the latency; the second threshold corresponding to the packet loss rate can be 25%, and the second threshold corresponding to the latency can be 600ms; if the packet loss rate of the second real-time performance indicator is greater than 25%, then it is considered to meet the second threshold; if the latency of the second real-time performance indicator is greater than 600ms, then it is considered to meet the second threshold.
[0062] In other embodiments of this application, if all second real-time performance transmission indicators meet the second threshold, it is determined that severe network congestion has occurred (i.e., the congestion is very serious). In this case, all data packets in the initial data packet can be directly updated to data packets with the target bit rate to obtain the target data packet. It should be noted that the target bit rate data packet can be the optimal bit rate data packet among multiple data packets with different semantic bit rates, specifically as follows... Figure 2 As shown, the target bit rate can refer to Figure 2 Point a in the middle.
[0063] In other embodiments of this application, the above-mentioned method of updating the initial data packet step by step based on multiple data packets with different semantic bit rates to obtain the target data packet includes: For the untransmitted objects in the information to be transmitted, update the first proportional data packet in the initial data packet to a data packet with the first semantic bit rate to obtain the first data packet to be determined, and determine the second real-time transmission performance index.
[0064] Among them, the bit rate of the data packet with the first semantic bit rate is greater than the bit rate of the initial data packet.
[0065] Specifically, if the first real-time performance metric meets the first threshold, then a first proportion of the data packets in the initial data packet can be updated to data packets of the next level (i.e., data packets of the first semantic bit rate) with a bit rate value equal to the bit rate value in the initial data packet. It should be noted that the first proportion can be a pre-set proportion value.
[0066] In one feasible implementation, if the initial data packets are all data packets with the smallest bit rate, then the data packet with the first semantic bit rate can be the second-ranked data packet among multiple data packets with different semantic bit rates, sorted from smallest to largest bit rate.
[0067] If the second real-time transmission performance index meets the first threshold, the second proportion data packet in the first data to be determined is updated to a data packet with the first semantic bit rate to obtain the second data packet to be determined, until the Nth data packet to be determined is a data packet with the first semantic bit rate.
[0068] The second proportion is greater than the first proportion.
[0069] Specifically, after the update, if the current second real-time performance metric still meets the first threshold, then a second proportion of data packets in the second data packet to be determined can be updated to data packets with the first semantic bit rate among multiple data packets with different semantic bit rates. Next, the real-time transmission performance metric is determined again. If the determined real-time transmission performance metric still meets the first threshold, then a certain proportion of data packets in the second data packet to be determined that are greater than the second proportion are updated to data packets with the first semantic bit rate, until all data packets in the Nth data packet to be determined are data packets with the first semantic bit rate.
[0070] Determine the third real-time transmission performance metric.
[0071] If the third real-time transmission performance index meets the first threshold, update the third proportion data packet in the Nth data packet to be determined to a data packet with the second semantic bit rate, until all the target data packets are data packets with the Nth semantic bit rate.
[0072] Among them, the data packet with the Nth semantic bit rate is the data packet with the largest bit rate among multiple data packets with different semantic bit rates.
[0073] In this embodiment of the application, when all data packets are data packets with the first semantic bit rate, the third real-time transmission performance index obtained by monitoring is determined. If the third real-time performance index still meets the first threshold, the third proportion of data packets in the Nth data packet to be determined is updated to data packets with the second semantic bit rate. The updated proportion is continuously increased and the step is repeated until all data packets in the target data packet are data packets with the Nth semantic bit rate, and then the final target data packet is obtained.
[0074] It should be noted that the proportion of updated data packets can increase linearly.
[0075] In other embodiments of this application, the entire process of updating the data packet in this embodiment can be as follows: Figure 3As shown, the proportion of updated data packets is linearly increased based on real-time performance metrics, while the semantic bit rate of the data packets is also increased; that is, starting with data packet A with a lower semantic bit rate, the updated portion is replaced with data packet B with a slightly higher semantic bit rate, until all data packets are replaced with data packet B; further, the updated portion of the data packets is replaced with data packet C with an even higher semantic bit rate, until all data packets are replaced with data packets of the Nth semantic bit rate.
[0076] In other embodiments of this application, if network congestion is determined to be alleviated by monitored performance metrics, the proportion of low semantic bit rate data packets can be gradually restored.
[0077] The information processing method provided in the embodiments of this application can determine the target data packet of the information to be transmitted based on the semantic information of the object in the information to be transmitted and the determined data packets with multiple different semantic bit rates, combined with transmission performance information. It can also send the target data packet to the corresponding second terminal. Obviously, when transmitting the information to be transmitted, the semantic information of the object in the information to be transmitted and the transmission performance information are considered, which ensures the successful transmission of the target data packet without retransmission. This solves the problem that transmission schemes for network congestion in related technologies will increase transmission delay, thereby improving system performance and ensuring communication efficiency.
[0078] Based on the foregoing embodiments, embodiments of this application provide an information processing method that can be applied to a second terminal, as described above. Figure 4 As shown, the information processing method may include the following steps: Step 201: Receive the target data packet corresponding to the information to be transmitted sent by the first terminal.
[0079] The target data packet is generated by the first terminal based on the initial performance information of the network, the semantic information of each object of the information to be transmitted, and multiple data packets with different semantic bit rates.
[0080] Step 202: Parse the target data packet to obtain the parsed information.
[0081] Specifically, the second terminal can first decode the received target data packet to extract the relational feature information in the target data packet, and then decode the obtained relational feature information to obtain the parsed information.
[0082] In this embodiment of the application, the target data packet can be processed using a decoding model corresponding to the first terminal to obtain relational feature information; at the same time, the relational feature information can be processed by a semantic decoder based on the Transformer model to obtain parsed information.
[0083] Step 203: Determine the semantic information content of each object in the parsed information.
[0084] It should be noted that the semantic information of each object in the parsed information can be calculated using the same method as the method used to calculate the semantic information of each object in the information to be transmitted in the above embodiments. The specific implementation method is described in the above embodiments and will not be repeated here.
[0085] Step 204: If the semantic information of each object in the parsed information matches the semantic information of the corresponding object in the information to be transmitted, then transmit the parsed information.
[0086] Specifically, for each object, the ratio between the semantic information of the object in the parsed information and the semantic information of the corresponding object in the information to be transmitted is calculated. If the ratio is within a pre-set similarity threshold, the parsed information is considered complete, and the parsed information is transmitted to the application layer. If the ratio is not within the pre-set similarity threshold, the parsed information is incomplete, and the first terminal can be requested to retransmit the data packet. It should be noted that the decoding process utilizes the noise resistance advantage of semantic communication, achieving high-accuracy recovery even in congested environments.
[0087] It should be noted that the descriptions of the same or corresponding contents in the embodiments of this application and other embodiments can be referred to the descriptions in the above embodiments, and will not be repeated here.
[0088] The information processing method provided in the embodiments of this application can receive a target data packet of the information to be transmitted, which is determined by a first terminal based on the semantic information of the objects in the information to be transmitted and multiple data packets with different semantic bit rates, combined with transmission performance information. When it is determined that the semantic information of the information parsed from the target data packet matches the semantic information of the original information to be transmitted, the parsed information is transmitted. Obviously, the semantic information of the objects in the information to be transmitted and the transmission performance information are considered when transmitting the information to be transmitted, which ensures the successful transmission of the target data packet without retransmission. This solves the problem that transmission schemes for network congestion in related technologies will increase transmission delay, thereby improving system performance and ensuring communication efficiency.
[0089] Based on the foregoing embodiments, embodiments of this application provide a first information processing apparatus, which can be applied to... Figure 1 In the information processing method provided in the corresponding embodiment, refer to Figure 5 As shown, the first information processing device 3 may include: a first determining unit 31, a first processing unit 32, and a sending unit 33, wherein: The first determining unit 31 is used to determine the semantic information content of each object of the information to be transmitted; The first determining unit 32 is also used to determine multiple data packets with different semantic bit rates based on the target semantic information content and the target bit information; The first processing unit 32 is used to generate a target data packet corresponding to the information to be transmitted based on transmission performance information, the semantic information of each object and multiple data packets with different semantic bit rates. The sending unit 33 is used to send the target data packet to the second terminal so that the second terminal can determine the information to be transmitted based on the target data packet.
[0090] In other embodiments of this application, the first determining unit 31 is further configured to perform the following steps: Multiple segmentation masks are obtained by processing the information to be transmitted using a target semantic segmentation model; Generate relational feature information of the object to be transmitted based on each segmentation mask and the information to be transmitted. Based on relational feature information and the similarity between objects, the semantic information content of each object is determined.
[0091] In other embodiments of this application, the first determining unit 31 is further configured to perform the following steps: Determine the degree of matching between objects based on relational feature information; Determine the similarity between the objects whose information is to be transmitted; The semantic information content of each object is determined based on the matching degree, similarity, the first weight corresponding to the matching degree, and the second weight corresponding to the similarity.
[0092] In other embodiments of this application, the first processing unit 32 is further configured to perform the following steps: Based on the initial transmission performance information, the semantic information of each object, and multiple data packets with different semantic bit rates, determine the initial data packet corresponding to the information to be transmitted; Determine real-time transmission performance information; The target data packet is determined based on real-time transmission performance information, the initial data packet, and multiple data packets with different semantic bit rates.
[0093] In other embodiments of this application, the first processing unit 32 is further configured to perform the following steps: Determine the first real-time transmission performance metric; If the first real-time performance metric meets the first threshold, the initial data packet is updated step by step based on multiple data packets with different semantic bit rates to obtain the target data packet; If the first real-time transmission performance indicator meets the second threshold, the target bit rate data packet is determined from multiple data packets with different semantic bit rates, and the initial data packet is updated to the target bit rate data packet to obtain the target data packet.
[0094] In other embodiments of this application, the first processing unit 32 is further configured to perform the following steps: For the untransmitted objects in the information to be transmitted, update the first proportional data packet in the initial data packet to a data packet with a first semantic bit rate to obtain a first data packet to be determined, and determine a second real-time transmission performance index; wherein, the bit rate of the data packet with the first semantic bit rate is greater than the bit rate of the initial data packet; If the second real-time performance indicator meets the first threshold, update the second proportion of data packets in the first data to be determined to data packets with the first semantic bit rate to obtain the second data packets to be determined, until the Nth data packets to be determined are all data packets with the first semantic bit rate; the second proportion is greater than the first proportion; Determine the third real-time transmission performance indicator; If the third real-time transmission performance index meets the first threshold, update the third proportion data packet in the Nth data packet to be determined to a data packet with the second semantic bit rate, until all the target data packets are data packets with the Nth semantic bit rate; wherein, the data packet with the Nth semantic bit rate is the data packet with the largest bit rate among multiple data packets with different semantic bit rates; the second semantic bit rate is greater than the first semantic bit rate.
[0095] It should be noted that the specific implementation process of the steps performed by each unit in the embodiments of this application can be referred to Figure 1 The implementation process of the information processing method provided in the corresponding embodiments will not be described in detail here.
[0096] The first information processing apparatus provided in the embodiments of this application can determine the target data packet of the information to be transmitted based on the semantic information of the object in the information to be transmitted and the determined data packets with multiple different semantic bit rates, combined with transmission performance information. It can also send the target data packet to the corresponding second terminal. Obviously, when transmitting the information to be transmitted, the semantic information of the object in the information to be transmitted and the transmission performance information are considered, which ensures the successful transmission of the target data packet without retransmission. This solves the problem that transmission schemes for network congestion in related technologies will increase transmission delay, thereby improving system performance and ensuring communication efficiency.
[0097] Based on the foregoing embodiments, embodiments of this application provide a second information processing apparatus, which can be applied to... Figure 4 In the information processing method provided in the corresponding embodiment, refer to Figure 6 As shown, the second information processing device 4 may include: a receiving unit 41, a second processing unit 42, and a second determining unit 43, wherein: The receiving unit 41 is used to receive the target data packet corresponding to the information to be transmitted sent by the first terminal; wherein the target data packet is generated by the first terminal based on the initial performance information of the network, the semantic information of each object of the information to be transmitted, and multiple data packets with different semantic bit rates; The second processing unit 42 is used to parse the target data packet to obtain parsed information. The second determining unit 43 is used to determine the amount of semantic information of each object in the parsed information; The second processing unit 42 is also used to transmit the parsed information if the semantic information of each object in the parsed information matches the semantic information of the corresponding object in the information to be transmitted.
[0098] It should be noted that the specific implementation process of the steps performed by each unit in the embodiments of this application can be referred to Figure 4 The implementation process of the information processing method provided in the corresponding embodiments will not be described in detail here.
[0099] The second information processing device provided in the embodiments of this application can receive a target data packet of the information to be transmitted, which is determined by the semantic information of the object in the information to be transmitted and multiple data packets with different semantic bit rates, combined with transmission performance information, sent by a first terminal. When it is determined that the semantic information of the information parsed from the target data packet matches the semantic information of the original information to be transmitted, the parsed information is transmitted. Obviously, the semantic information of the object in the information to be transmitted and the transmission performance information are considered when transmitting the information to be transmitted, which ensures the successful transmission of the target data packet without retransmission. This solves the problem that transmission schemes for network congestion in related technologies will increase transmission delay, thereby improving system performance and ensuring communication efficiency.
[0100] Based on the foregoing embodiments, embodiments of this application provide a first terminal, which can be applied to... Figure 1 In the information processing method provided in the corresponding embodiment, refer to Figure 7 As shown, the first terminal 5 may include: a first processor 51, a first memory 52, and a first communication bus 53, wherein: The first communication bus 53 is used to realize the communication connection between the first processor 51 and the first memory 52; The first memory 52 is used to store computer programs that can run on the first processor 51; The first processor 51 is used to run computer programs to perform the following steps: Determine the semantic information content of each object in the information to be transmitted; Data packets with different semantic bit rates are determined based on the target semantic information content and target bit information; Based on transmission performance information, the semantic information of each object, and multiple data packets with different semantic bit rates, a target data packet corresponding to the information to be transmitted is generated. Send the target data packet to the second terminal so that the second terminal can determine the information to be transmitted based on the target data packet.
[0101] In other embodiments of this application, the first processor 51 is used to run a computer program and can also perform the following steps: Multiple segmentation masks are obtained by processing the information to be transmitted using a target semantic segmentation model; Generate relational feature information of the object to be transmitted based on each segmentation mask and the information to be transmitted. Based on relational feature information and the similarity between objects, the semantic information content of each object is determined.
[0102] In other embodiments of this application, the first processor 51 is used to run a computer program and can also perform the following steps: Determine the degree of matching between objects based on relational feature information; Determine the similarity between the objects whose information is to be transmitted; The semantic information content of each object is determined based on the matching degree, similarity, the first weight corresponding to the matching degree, and the second weight corresponding to the similarity.
[0103] In other embodiments of this application, the first processor 51 is used to run a computer program and can also perform the following steps: Based on the initial transmission performance information, the semantic information of each object, and multiple data packets with different semantic bit rates, determine the initial data packet corresponding to the information to be transmitted; Determine real-time transmission performance information; The target data packet is determined based on real-time transmission performance information, the initial data packet, and multiple data packets with different semantic bit rates.
[0104] In other embodiments of this application, the first processor 51 is used to run a computer program and can also perform the following steps: Determine the first real-time transmission performance metric; If the first real-time performance metric meets the first threshold, the initial data packet is updated step by step based on multiple data packets with different semantic bit rates to obtain the target data packet; If the first real-time transmission performance indicator meets the second threshold, the target bit rate data packet is determined from multiple data packets with different semantic bit rates, and the initial data packet is updated to the target bit rate data packet to obtain the target data packet.
[0105] In other embodiments of this application, the first processor 51 is used to run a computer program and can also perform the following steps: For the untransmitted objects in the information to be transmitted, update the first proportional data packet in the initial data packet to a data packet with a first semantic bit rate to obtain a first data packet to be determined, and determine a second real-time transmission performance index; wherein, the bit rate of the data packet with the first semantic bit rate is greater than the bit rate of the initial data packet; If the second real-time performance indicator meets the first threshold, update the second proportion of data packets in the first data to be determined to data packets with the first semantic bit rate to obtain the second data packets to be determined, until the Nth data packets to be determined are all data packets with the first semantic bit rate; the second proportion is greater than the first proportion; Determine the third real-time transmission performance indicator; If the third real-time transmission performance index meets the first threshold, update the third proportion data packet in the Nth data packet to be determined to a data packet with the second semantic bit rate, until all the target data packets are data packets with the Nth semantic bit rate; wherein, the data packet with the Nth semantic bit rate is the data packet with the largest bit rate among multiple data packets with different semantic bit rates; the second semantic bit rate is greater than the first semantic bit rate.
[0106] It should be noted that a detailed description of the steps performed by the first processor can be found in [reference needed]. Figure 1 The information processing methods provided in the corresponding embodiments will not be described in detail here.
[0107] The first terminal provided in the embodiments of this application can determine the target data packet of the information to be transmitted based on the semantic information of the object in the information to be transmitted and the determined data packets with multiple different semantic bit rates, combined with the transmission performance information. It can also send the target data packet to the corresponding second terminal. Obviously, when transmitting the information to be transmitted, the semantic information of the object in the information to be transmitted and the transmission performance information are taken into consideration, which ensures the successful transmission of the target data packet without retransmission. This solves the problem that transmission schemes for network congestion in related technologies will increase transmission delay, thereby improving system performance and ensuring communication efficiency.
[0108] Based on the foregoing embodiments, embodiments of this application provide a second terminal, which can be applied to... Figure 4 In the information processing method provided in the corresponding embodiment, refer to Figure 8 As shown, the second terminal 6 may include: a second processor 61, a second memory 62, and a second communication bus 63, wherein: The second communication bus 63 is used to realize the communication connection between the second processor 61 and the second memory 62; The second memory 62 is used to store computer programs that can run on the second processor 61; The second processor 61 is used to run computer programs to perform the following steps: Receive the target data packet corresponding to the information to be transmitted sent by the first terminal; wherein the target data packet is generated by the first terminal based on the initial performance information of the network, the semantic information of each object of the information to be transmitted, and multiple data packets with different semantic bit rates; The target data packet is parsed to obtain the parsed information; Determine the amount of semantic information for each object in the parsed information; If the semantic information of each object in the parsed information matches the semantic information of the corresponding object in the information to be transmitted, then the parsed information is transmitted.
[0109] It should be noted that a detailed description of the steps performed by the second processor can be found in [reference needed]. Figure 4 The information processing methods provided in the corresponding embodiments will not be described in detail here.
[0110] The second terminal provided in the embodiments of this application can receive a target data packet of the information to be transmitted, which is determined by the first terminal based on the semantic information of the objects in the information to be transmitted and multiple data packets with different semantic bit rates, combined with transmission performance information. When it is determined that the semantic information of the information parsed from the target data packet matches the semantic information of the original information to be transmitted, the parsed information is transmitted. Obviously, the semantic information of the objects in the information to be transmitted and the transmission performance information are considered when transmitting the information to be transmitted, which ensures the successful transmission of the target data packet without retransmission. This solves the problem that transmission schemes for network congestion in related technologies will increase transmission delay, thereby improving system performance and ensuring communication efficiency.
[0111] Based on the foregoing embodiments, embodiments of this application provide a computer-readable storage medium storing one or more programs, which can be executed by one or more first processors 51 and second processors 61 to achieve... Figure 1 and Figure 4 The corresponding embodiments provide the steps of the information processing method.
[0112] Based on the foregoing embodiments, embodiments of this application provide a computer program product, including a computer program that can be executed by a first processor 51 and a second processor 61 to perform... Figure 1 and Figure 4 The corresponding embodiments provide the steps of the information processing method.
[0113] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of hardware embodiments, software embodiments, or embodiments combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage and optical storage) containing computer-usable program code.
[0114] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart... Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.
[0115] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.
[0116] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.
[0117] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.
Claims
1. An information processing method, characterized in that, The method is applied to a first terminal and includes: Determine the semantic information content of each object in the information to be transmitted; Data packets with different semantic bit rates are determined based on the target semantic information content and target bit information; Based on transmission performance information, the semantic information of each object, and the multiple data packets with different semantic bit rates, a target data packet corresponding to the information to be transmitted is generated; The target data packet is sent to the second terminal so that the second terminal can determine the information to be transmitted based on the target data packet.
2. The method according to claim 1, characterized in that, The determination of the semantic information content of each object in the information to be transmitted includes: Multiple segmentation masks are obtained by processing the information to be transmitted using a target semantic segmentation model; Based on each segmentation mask and the information to be transmitted, generate relational feature information of the object of the information to be transmitted; Based on the relational feature information and the similarity between the objects, the semantic information content of each object is determined.
3. The method according to claim 2, characterized in that, The step of determining the semantic information content of each object based on the similarity between the relational feature information and the objects includes: The matching degree between objects is determined based on the aforementioned relationship feature information; Determine the similarity between the objects whose information is to be transmitted; Based on the matching degree, the similarity, the first weight corresponding to the matching degree, and the second weight corresponding to the similarity, the semantic information content of each object is determined.
4. The method according to claim 1, characterized in that, The process of generating the target data packet corresponding to the information to be transmitted, based on transmission performance information, the semantic information content of each object, and the multiple data packets with different semantic bit rates, includes: Based on the initial transmission performance information, the semantic information of each object, and the multiple data packets with different semantic bit rates, the initial data packet corresponding to the information to be transmitted is determined; Determine real-time transmission performance information; The target data packet is determined based on the real-time transmission performance information, the initial data packet, and the multiple data packets with different semantic bit rates.
5. The method according to claim 4, characterized in that, The determination of the target data packet based on the real-time transmission performance information, the initial data packet, and the multiple data packets with different semantic bit rates includes: Determine the first real-time transmission performance metric; If the first real-time transmission performance indicator meets the first threshold, the initial data packet is updated step by step based on the multiple data packets with different semantic bit rates to obtain the target data packet; If the first real-time transmission performance indicator meets the second threshold, a data packet with a target bit rate is determined from the multiple data packets with different semantic bit rates, and the initial data packet is updated to the data packet with the target bit rate to obtain the target data packet.
6. The method according to claim 5, characterized in that, The process of sequentially updating the initial data packet based on the multiple data packets with different semantic bit rates to obtain the target data packet includes: For the untransmitted objects in the information to be transmitted, the first proportion data packet in the initial data packet is updated to a data packet with a first semantic bit rate to obtain a first data packet to be determined, and a second real-time transmission performance index is determined; wherein, the bit rate of the data packet with the first semantic bit rate is greater than the bit rate of the initial data packet; If the second real-time performance indicator meets the first threshold, update the second proportion data packet in the first data to be determined to a data packet with the first semantic bit rate to obtain the second data packet to be determined, until the Nth data packet to be determined is a data packet with the first semantic bit rate; the second proportion is greater than the first proportion; Determine the third real-time transmission performance indicator; If the third real-time transmission performance indicator meets the first threshold, the third proportion data packet in the Nth data packet to be determined is updated to a data packet with the second semantic bit rate, until all the target data packets are data packets with the Nth semantic bit rate; wherein, the data packet with the Nth semantic bit rate is the data packet with the largest bit rate among the multiple data packets with different semantic bit rates; the second semantic bit rate is greater than the first semantic bit rate.
7. An information processing method, characterized in that, The method is applied to a second terminal and includes: The system receives a target data packet corresponding to the information to be transmitted sent by a first terminal; wherein the target data packet is generated by the first terminal based on the initial performance information of the network, the semantic information content of each object of the information to be transmitted, and multiple data packets with different semantic bit rates. The target data packet is parsed to obtain the parsed information; Determine the semantic information content of each object in the parsed information; If the semantic information of each object in the parsed information matches the semantic information of the corresponding object in the information to be transmitted, then the parsed information is transmitted.
8. An information processing device, characterized in that, The device includes: a processor, a memory, and a communication bus; The communication bus is used to realize the communication connection between the processor and the memory; The processor is used to execute an information processing program in the memory to implement the steps of the information processing method as described in any one of claims 1 to 6 or claim 7.
9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores one or more programs, which can be executed by one or more processors to implement the steps of the information processing method as described in any one of claims 1 to 6 or claim 7.
10. A computer program product, the computer program product comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the information processing method according to any one of claims 1 to 6 or claim 7.
