Hand-held terminal signal processing method and device

Abstract

The invention discloses a handheld terminal signal processing method and device. The method comprises the following steps: acquiring to-be-transmitted data information and alternative communication channel information; the to-be-transmitted data information comprises a data transmission type and basic data information; performing optimization processing on the alternative communication channel information to obtain target communication channel information; the target communication channel information comprises first target communication channel information and / or second target communication channel information; the first target communication channel information comprises at least one piece of first preferred communication channel information; and performing transmission processing on the to-be-transmitted data information by using the target communication channel information to obtain target communication information.

Description

Technical Field

[0001] The present invention relates to the technical field of signal processing, and particularly to a signal processing method and device for a handheld terminal. Background Art

[0002] In scenarios such as emergency rescue and outdoor exploration, the handheld terminal is a key tool for rescuers to communicate with the command center and other team members. However, due to factors such as complex environment and unstable network, the communication of the handheld terminal is often affected by problems such as weak signal and frequent interruption. Therefore, how to improve the communication stability and reliability of the handheld terminal in a complex environment has become a major challenge in current communication technologies. Traditional handheld terminals usually rely on a single communication method, such as cellular network, satellite communication or Wi-Fi. When the single communication method fails, the communication may be interrupted, seriously affecting the smooth progress of the task. Therefore, there is provided a signal processing method and device for a handheld terminal to improve the communication stability and reliability of the handheld terminal in a complex environment, and further enhance the practicability of the handheld terminal in a complex environment. Summary of the Invention

[0003] The technical problem to be solved by the present invention is to provide a signal processing method and device for a handheld terminal, which is beneficial to improving the communication stability and reliability of the handheld terminal in a complex environment, and further enhancing the practicability of the handheld terminal in a complex environment.

[0004] To solve the above technical problem, in the first aspect, an embodiment of the present invention discloses a signal processing method for a handheld terminal, the method comprising:

[0005] Obtaining the data information to be transmitted and the alternative communication path information; the data information to be transmitted includes the data transmission type and the basic data information;

[0006] Performing an optimization process on the alternative communication path information to obtain the target communication path information; the target communication path information includes the first target communication path information, and / or, the second target communication path information; the first target communication path information includes at least one first optimized communication path information;

[0007] Transmitting and processing the data information to be transmitted by using the target communication path information to obtain the target communication information.

[0008] In the second aspect, an embodiment of the present invention discloses a signal processing device for a handheld terminal, the device comprising:

[0009] An obtaining module, configured to obtain the data information to be transmitted and the alternative communication path information; the data information to be transmitted includes the data transmission type and the basic data information;

[0010] A first processing module, configured to perform optimization processing on the alternative communication path information to obtain target communication path information; the target communication path information includes first target communication path information, and / or, second target communication path information; the first target communication path information includes at least one first optimized communication path information.

[0011] A second processing module, configured to perform transmission processing on the data information to be transmitted by using the target communication path information to obtain target communication information.

[0012] A third aspect of the present invention discloses another handheld terminal signal processing device, the device includes:

[0013] A memory storing executable program code;

[0014] A processor coupled to the memory;

[0015] The processor calls the executable program code stored in the memory and executes some or all of the steps in the handheld terminal signal processing method disclosed in the first aspect of the embodiments of the present invention.

[0016] A fourth aspect of the present invention discloses a computer-readable storage medium, the computer-readable storage medium stores computer instructions, and when the computer instructions are called, they are used to execute some or all of the steps in the handheld terminal signal processing method disclosed in the first aspect of the embodiments of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the following drawings are only some embodiments of the present invention, and those of ordinary skill in the art can obtain other drawings without creative efforts based on these drawings.

[0018] Figure 1 is a schematic diagram of the scenario of the handheld terminal signal processing system provided by the embodiments of the present invention;

[0019] Figure 2 is a schematic flowchart of a handheld terminal signal processing method disclosed in the embodiments of the present invention;

[0020] Figure 3 is a schematic structural diagram of a handheld terminal signal processing device disclosed in the embodiments of the present invention;

[0021] Figure 4 is a schematic structural diagram of another handheld terminal signal processing device disclosed in the embodiments of the present invention;

[0022] Figure 5It is a schematic structural diagram of an object detection and evaluation model disclosed in an embodiment of the present invention. Detailed implementation manners

[0023] In order to enable those skilled in the art to better understand the solution of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0024] The terms "first", "second", etc. in the specification and claims of the present invention and the above drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, device, product or equipment that includes a series of steps or units is not limited to the listed steps or units, but optionally further includes steps or units not listed, or optionally further includes other steps or units inherent to these processes, methods, products or equipment.

[0025] Referring to "embodiments" herein means that a particular feature, structure or characteristic described in connection with the embodiments can be included in at least one embodiment of the present invention. The phrase appears in various places in the specification and does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. Those skilled in the art will explicitly and implicitly understand that the embodiments described herein can be combined with other embodiments.

[0026] In this application, the term "exemplary" is used to mean "serving as an example, illustration, or description". Any embodiment described as "exemplary" in this application is not necessarily to be construed as more preferred or more advantageous than other embodiments. In order for any person skilled in the art to implement and use this application, the following description is given. In the following description, details are set forth for the purpose of explanation. It should be understood that those of ordinary skill in the art can recognize that this application can be implemented without using these specific details. In other instances, well-known structures and processes are not described in detail to avoid unnecessary details from obscuring the description of this application. Therefore, this application is not intended to be limited to the embodiments shown, but is to be accorded the widest scope consistent with the principles and features disclosed herein.

[0027] It should be noted that since the method of the embodiment of the present application is executed in a computer device, the processing objects of each computer device exist in the form of data or information. For example, time, which is actually time information. It can be understood that in subsequent embodiments, if dimensions, quantities, positions, etc. are mentioned, they are all corresponding data existences for the computer device to process, and specific details will not be elaborated here.

[0028] It should be noted that a brief introduction to the artificial intelligence related technologies that may be involved in the present application is given. Artificial Intelligence (AI) is to use a digital computer or a machine controlled by a digital computer to simulate, extend and expand human intelligence, and is a theory, method, technology and application system that can perceive the environment, acquire knowledge and use knowledge to obtain the best results. In other words, artificial intelligence is a comprehensive technology in computer science, which attempts to understand the essence of intelligence and produce a new intelligent machine that can react in a way similar to human intelligence. Artificial intelligence is also to study the design principles and implementation methods of various intelligent machines, so that the machines have the functions of perception, reasoning and decision-making.

[0029] Artificial intelligence technology is an interdisciplinary subject, involving a wide range of fields, including both hardware-level technologies and software-level technologies. The basic technologies of artificial intelligence generally include technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing technology, operation / interaction systems, and mechatronics. The software technologies of artificial intelligence mainly include several major directions such as computer vision technology, speech processing technology, natural language processing technology, and machine learning / deep learning.

[0030] Computer Vision Technology (CV) Computer vision is a science that studies how to enable machines to "see". Further, it refers to using cameras and computers to replace human eyes to identify and measure targets, etc., which is machine vision, and further performing graphic processing to make the computer process into an image that is more suitable for human eyes to observe or be transmitted to instruments for detection. As a scientific discipline, computer vision studies related theories and technologies, and attempts to establish an artificial intelligence system that can obtain information from images or multi-dimensional data. Computer vision technology usually includes technologies such as image processing, image recognition, image semantic understanding, image retrieval, OCR, video processing, video semantic understanding, video content / behavior recognition, three-dimensional object reconstruction, 3D technology, virtual reality, augmented reality, simultaneous localization and mapping, etc., and also includes common biometric recognition technologies such as face recognition and fingerprint recognition.

[0031] Single-modal information is data of only one type, such as one of data information like text, image, audio, video, electromagnetic signal, etc. Multi-modal information is data information that includes at least two types of single-modal information. Further, multi-modal information is applicable to complex tasks that require integrating multiple information sources, such as sentiment analysis, robot interaction, autonomous driving, etc. By integrating information of multiple modalities, higher performance and accuracy can usually be achieved in tasks.

[0032] A large model refers to an artificial neural network model with a very large number of parameters. In the field of artificial intelligence, a large model usually refers to a model with hundreds of millions to trillions of parameters. The model usually needs to be trained on a large-scale dataset and requires a large amount of computing resources for optimization and adjustment. Large models are usually used to solve complex tasks such as natural language processing, computer vision, and speech recognition. Generative AI is a type of AI that can create new content and ideas, including conversations, stories, images, videos, and music. In the embodiments of this application, the large model can be large language models such as ChatGPT, BERT, XLNet, Zhipu Model, Claude, Moonshot AI Model, ChatGLM Model, Qianyitongwen Model, MiniMax Model, Spark Model, Llama Model, 360GPT Model, Qwen Model, Baichuan Model, Lark Model, vivoLM Model, and Wenxin Yiyan, and the embodiments of this application do not make any limitations.

[0033] The embodiments of this application provide a method, device, computer device, and computer-readable storage medium for processing signals of a handheld terminal, which will be described in detail below respectively.

[0034] Please refer to Figure 1 , Figure 1 which is a schematic diagram of the scenario of the handheld terminal signal processing system provided by the embodiments of this application. The handheld terminal signal processing system may include a computer device 100, and a handheld terminal signal processing device is integrated in the computer device 100, such as Figure 1 the computer device in

[0035] In the embodiments of this application, the computer device 100 is mainly used to obtain data information to be transmitted and alternative communication path information; the data information to be transmitted includes a data transmission type and basic data information;

[0036] perform an optimization process on the alternative communication path information to obtain target communication path information; the target communication path information includes first target communication path information, and / or, second target communication path information; the first target communication path information includes at least one first preferred communication path information;

[0037] use the target communication path information to perform a transmission process on the data information to be transmitted to obtain target communication information.

[0038] It can improve the communication stability and reliability of the handheld terminal in complex environments, thereby enhancing the practicability of the handheld terminal in complex environments.

[0039] In the embodiments of the present application, the computer device 100 may be an independent server or a server network or server cluster composed of servers. For example, the computer device 100 described in the embodiments of the present application includes, but is not limited to, a computer, a network host, a single network server, a set of multiple network servers, or a cloud server composed of multiple servers. Among them, the cloud server is composed of a large number of computers or network servers based on cloud computing.

[0040] It can be understood that the computer device 100 used in the embodiments of the present application may be a device that includes both receiving and transmitting hardware, that is, a device having receiving and transmitting hardware capable of performing two-way communication on a two-way communication link. Such devices may include: cellular or other communication devices, which have a single-line display or a multi-line display or a cellular or other communication device without a multi-line display. Specifically, the computer device 100 may specifically be a desktop terminal or a mobile terminal, and the computer device 100 may specifically also be one of a mobile phone, a tablet computer, a laptop computer, etc.

[0041] Those skilled in the art can understand that Figure 1 the application environment shown in Figure 1 is only one application scenario of the solution of the present application and does not constitute a limitation on the application scenario of the solution of the present application. Other application environments may also include more or fewer computer devices than those shown in Figure 1 For example, only 1 computer device is shown in

[0042] It can be understood that the handheld terminal signal processing system may further include one or more other services, which are not specifically limited here. Figure 1 In addition, as shown in

[0043] It should be noted that Figure 1 the scenario schematic diagram of the handheld terminal signal processing system shown in

[0044] The present invention discloses a method and device for signal processing of a handheld terminal, which is beneficial to improving the communication stability and reliability of the handheld terminal in a complex environment, and further enhancing the practicability of the handheld terminal in a complex environment. The following will be described in detail respectively.

[0045] Embodiment 1

[0046] Please refer to Figure 2 , Figure 2 which is a schematic flowchart of a method for signal processing of a handheld terminal disclosed in an embodiment of the present invention. Among them, Figure 2 the described method for signal processing of a handheld terminal is applied in a management system, such as a local server or a cloud server for management, etc., which is not limited in the embodiments of the present invention. As Figure 2 shown, the method for signal processing of a handheld terminal may include the following operations:

[0047] 101. Obtain the data information to be transmitted and the alternative communication path information.

[0048] In an embodiment of the present invention, the data information to be transmitted includes a data transmission type and basic data information.

[0049] 102. Perform an optimization process on the alternative communication path information to obtain the target communication path information.

[0050] In an embodiment of the present invention, the target communication path information includes first target communication path information, and / or second target communication path information; the first target communication path information includes at least one first optimized communication path information.

[0051] 103. Use the target communication path information to perform a transmission process on the data information to be transmitted to obtain the target communication information.

[0052] It should be noted that the above alternative communication path information includes several connected communication path information that can communicate with each other between the handheld terminal and the target communication device (such as a communication base station, a mobile communication terminal, a satellite, a space-based communication terminal, etc.), which is not limited in the embodiments of the present invention. Further, the above connected communication path information includes data information such as a path identifier, a delay parameter, a bandwidth, and a signal strength, which is not limited in the embodiments of the present invention.

[0053] It should be noted that the above data transmission type includes a first transmission type (large bandwidth transmission) and a second transmission type (low latency transmission), which is not limited in the embodiments of the present invention.

[0054] It should be noted that the method of this application significantly improves the communication stability of the terminal in complex environments by integrating multiple communication methods and automatically switching channels. Even if a certain channel fails, the system can automatically switch to other available channels, avoiding communication interruptions and increasing the success rate of tasks. Through multi-channel parallel transmission and dynamic load balancing, the existing communication resources are fully utilized, enhancing the speed and efficiency of data transmission. The system automatically monitors and recovers communication faults, reducing user intervention and improving the reliability of communication and the user experience.

[0055] It can be seen that implementing the signal processing method of the handheld terminal described in the embodiments of the present invention is beneficial to improving the communication stability and reliability of the handheld terminal in complex environments, and thus enhancing the practicality of the handheld terminal in complex environments.

[0056] In an alternative embodiment, the above-mentioned preferential processing of the alternative communication channel information to obtain the target communication channel information includes:

[0057] Using a target detection and evaluation model to perform detection and evaluation processing on the alternative communication channel information to obtain the first communication channel information; the first communication channel information includes at least one available communication channel information;

[0058] Performing allocation processing on the first communication channel information to obtain the target communication channel information.

[0059] It should be noted that the above-mentioned use of the target detection and evaluation model to perform detection and evaluation processing on the alternative communication channel information is to use a lightweight artificial intelligence model to efficiently and quickly screen the connected communication channels to select the communication channels that can be used in the current complex environment, so as to be more conducive to the efficient and reliable allocation of communication channels, thereby improving the communication stability and reliability. The embodiments of the present invention do not make limitations.

[0060] It can be seen that implementing the signal processing method of the handheld terminal described in the embodiments of the present invention is beneficial to improving the communication stability and reliability of the handheld terminal in complex environments, and thus enhancing the practicality of the handheld terminal in complex environments.

[0061] In another alternative embodiment, performing allocation processing on the first communication channel information to obtain the target communication channel information includes:

[0062] Performing quantization processing on the first communication channel information to obtain communication channel quantization information; the communication channel quantization information includes at least one communication channel quantization value information; the communication channel quantization value information includes a first communication channel quantization value and a second communication channel quantization value;

[0063] Judging whether the data transmission type is the first transmission type to obtain a type judgment result;

[0064] When the type judgment result is yes, use the first transmission calculation model to calculate and process the communication path quantization information to obtain the communication path calculation value information; the communication path calculation value information includes at least one communication path calculation value.

[0065] Among them, the first transmission calculation model is:

[0066] Communication path calculation value = first calculation coefficient * first communication path quantization value + second calculation coefficient * second communication path quantization value; the first calculation coefficient is greater than the second calculation coefficient.

[0067] When the type judgment result is no, use the second transmission calculation model to calculate and process the communication path quantization information to obtain the communication path calculation value information.

[0068] Among them, the second transmission calculation model is:

[0069] Communication path calculation value = third calculation coefficient * first communication path quantization value + fourth calculation coefficient * second communication path quantization value; the fourth calculation coefficient is greater than the third calculation coefficient.

[0070] Based on the communication path calculation value information, determine the target communication path information.

[0071] It should be noted that the above quantization processing of the first communication path information is to standardize the bandwidth and delay parameters in the available communication path information, so as to obtain the corresponding first communication path quantization value and second communication path quantization value, which are not limited in the embodiments of the present invention. Further, the above standardization processing process can be implemented based on a look-up table method. Further, the bandwidth and delay standardization table can be:

[0072]

[0073]

[0074] It should be noted that the above bandwidth standard unit can be 1M, 1T, etc., which are not limited in the embodiments of the present invention. The above time delay unit can be 1 millisecond, 1 second, etc., which are not limited in the embodiments of the present invention.

[0075] It should be noted that the above first calculation coefficient, second calculation coefficient, third calculation coefficient, and fourth calculation coefficient are values between 0 and 1, which are not limited in the embodiments of the present invention. Further, the difference between the first calculation coefficient and the second calculation coefficient is greater than 0.2; the difference between the fourth calculation coefficient and the third calculation coefficient is greater than 0.2. The above coefficient difference greater than 0.2 can effectively ensure the selection of the communication path for data transmission according to the transmission type, avoid the excessive influence of interference factors on the communication path, and improve the accuracy and reliability of the communication path selection, which are not limited in the embodiments of the present invention.

[0076] It can be seen that implementing the handheld terminal signal processing method described in the embodiments of the present invention is conducive to improving the communication stability and reliability of the handheld terminal in a complex environment, and further enhancing the practicality of the handheld terminal in a complex environment.

[0077] In yet another alternative embodiment, based on the communication path calculation value information, the target communication path information is determined, including:

[0078] Determine whether the number of communication path calculation values in the communication path calculation value information is greater than the number threshold to obtain a number judgment result;

[0079] When the number judgment result is negative, determine the first communication path information as the first target communication path information;

[0080] When the number judgment result is positive, obtain the path allocation ratio;

[0081] Perform calculation and allocation processing on the path allocation ratio and the communication path calculation value information to obtain the target communication path information.

[0082] It should be noted that the above number threshold can be set by the user, or can be the default value given by the system, or can be determined by taking the average of the historical number thresholds. The embodiments of the present invention do not make any limitations. Further, the above number threshold is a positive integer not less than 3, and the embodiments of the present invention do not make any limitations. Further, by judging the size of the number corresponding to the communication path and the number threshold, it can be realized that when there are fewer available communication paths, all communication paths are used for data transmission to ensure the efficiency of data transmission. At the same time, when there are more available communication paths, the path allocation ratio is used to divide the main path directly used for data transmission and the backup path, so that when the signal of the main path becomes weak or the line is disconnected, the backup path is used to replace the main path for data transmission, that is, when it is detected that the signal of the current main path is weak, the delay is too high or an interruption occurs, the terminal will automatically switch to the backup path with better signal to continue communication, thereby ensuring the stability of the signal and improving the efficiency and reliability of data transmission. The embodiments of the present invention do not make any limitations.

[0083] It should be noted that the above path allocation ratio represents the main path for data transmission and the backup path for replacing the main path. The embodiments of the present invention do not make any limitations. Further, the above path allocation ratio can be one of 1:1, 2:1, 3:1. The embodiments of the present invention do not make any limitations.

[0084] It can be seen that implementing the handheld terminal signal processing method described in the embodiments of the present invention is conducive to improving the communication stability and reliability of the handheld terminal in a complex environment, and further enhancing the practicality of the handheld terminal in a complex environment.

[0085] In yet another alternative embodiment, a calculation and allocation process is performed on the channel allocation ratio and the communication channel calculation value information to obtain target communication channel information, including:

[0086] Sort all the communication channel calculation values in the communication channel calculation value information from largest to smallest according to the communication channel calculation value to obtain a communication channel calculation value sequence;

[0087] Use an allocation calculation model to perform a calculation process on the number of communication channel calculation values and the channel allocation ratio to obtain an allocation value;

[0088] Among them, the allocation calculation model is:

[0089]

[0090] Take the first N communication channel calculation values in the front of the communication channel calculation value sequence as the first target communication channel values, and take the communication channel calculation values corresponding to the non-first target communication channel values in the communication channel calculation value sequence as the second target communication channel values; N is the allocation value;

[0091] Take the available communication channel information corresponding to the first target communication channel values as the first preferred communication channel information in the first target communication channel information;

[0092] Take the available communication channel information corresponding to the second target communication channel values as the second preferred communication channel information in the second target communication channel information.

[0093] It should be noted that the above allocation calculation model first multiplies the channel allocation ratio by the number of communication channel calculation values and then rounds down. The embodiments of the present invention do not make any limitations. Further, the consideration of the above rounding down is mainly because the number of available communication channels is greater than the number threshold, indicating that its quantity is relatively large. Therefore, a sufficient number of main channels can be guaranteed for current data transmission. However, considering the reliability of the communication channels, a certain number of backup channels must be reserved. Therefore, the rounded-down number is selected to ensure that there will inevitably be backup channels, thereby improving the stability and reliability of the communication signal. The embodiments of the present invention do not make any limitations.

[0094] It can be seen that implementing the signal processing method of the handheld terminal described in the embodiments of the present invention is beneficial to improving the communication stability and reliability of the handheld terminal in a complex environment, and further enhancing the practicality of the handheld terminal in a complex environment.

[0095] In an alternative embodiment, as Figure 5 shown, the above target detection and evaluation model includes a first convolutional module, a second convolutional module, a first pooling module, a second pooling module, a first regularization module, a second regularization module, a first network module, an attention module, a first connection module, a second connection module, and a third connection module; among them,

[0096] The input end of the first convolutional module is configured to receive the model input information of the target detection evaluation model, and the output end of the first convolutional module is connected to the input end of the first pooling module; the output end of the first pooling module is connected to the input end of the second convolutional module; the output end of the second convolutional module is connected to the input end of the second pooling module; the output end of the second pooling module is connected to the input end of the first connection module; the output end of the first connection module is connected to the input end of the second connection module; the output end of the second connection module is connected to the input end of the first regularization module; the output of the first regularization module is connected to the input end of the first network module; the output end of the first network module is connected to the input end of the second regularization module; the output end of the second regularization module is connected to the input end of the attention module; the output end of the attention module is connected to the input end of the third connection module; the output end of the third connection module is configured to output the model output information of the target detection evaluation model.

[0097] It should be noted that the above first regularization module and second regularization module are constructed based on the Dropout layer, which is mainly to prevent overfitting. The embodiments of the present invention are not limited thereto.

[0098] It should be noted that the above first network module can be bidirectional long short-term memory. The embodiments of the present invention are not limited thereto. Further, the above first network module can efficiently capture long-term dependencies in the time series, and can consider bidirectional information through the bidirectional structure, improving the feature extraction ability of the model. The embodiments of the present invention are not limited thereto.

[0099] It should be noted that the above attention module is constructed based on the multi-head attention mechanism. The embodiments of the present invention are not limited thereto.

[0100] It should be noted that the above first connection module, second connection module and third connection module are fully connected layers. The embodiments of the present invention are not limited thereto.

[0101] It should be noted that the above first pooling module and second pooling module are constructed based on the max pooling layer. The embodiments of the present invention are not limited thereto.

[0102] It should be noted that the convolutional kernel sizes of the above first convolutional module and second convolutional module are one of 1×1, 3×1, 5×1, and 5×3. Further, the activation function corresponding to the convolutional module is the RELU function. The embodiments of the present invention are not limited thereto.

[0103] It should be noted that the loss function for model training can be the cross-entropy loss function. The embodiments of the present invention are not limited thereto.

[0104] It can be seen that implementing the handheld terminal signal processing method described in the embodiments of the present invention is beneficial to improving the communication stability and reliability of the handheld terminal in complex environments, and further enhancing the practicability of the handheld terminal in complex environments.

[0105] In another optional embodiment, the target communication path information is used to perform transmission processing on the data information to be transmitted, and the target communication information is obtained, including:

[0106] Determine whether the basic data information in the data information to be transmitted is audio-visual data, and obtain a data determination result;

[0107] When the data determination result is yes, perform audio-visual separation processing on the basic data information to obtain audio data information and video data information;

[0108] Use the target communication path information to perform transmission processing on the audio data information and video data information to obtain target audio information and target video information;

[0109] Perform fusion processing on the target audio information and target video information to obtain target communication information;

[0110] When the data determination result is no, perform segmentation processing on the basic data information to obtain target segmentation data information;

[0111] Use the target communication path information to perform transmission processing on the target segmentation data information to obtain target communication information.

[0112] It should be noted that the above-mentioned audio-visual separation processing of the basic data information and the use of the target communication path information to perform transmission processing on the audio data information and video data information transmit the audio and video data through different paths to ensure that even if there is a problem with the audio or video transmission on a certain path, the basic communication ability can still be maintained. The embodiments of the present invention do not make any limitations. Further, the above-mentioned fusion processing of the target audio information and target video information may be to match the audio data to the corresponding video position, which may be implemented based on a convolutional neural network or based on the MACAW-LLM multimodal large model. The embodiments of the present invention do not make any limitations.

[0113] It should be noted that the above-mentioned target segmentation data information includes a number of sequentially distributed sub-target segmentation data information. Further, splitting the data into multiple parts and transmitting them in parallel through different paths to improve the transmission speed and reliability are not limited in the embodiments of the present invention.

[0114] It should be noted that the communication path calculation values corresponding to the first preferred communication path information in the first target communication path information are distributed from large to small, which is not limited in the embodiments of the present invention.

[0115] In this optional embodiment, as an optional implementation manner, the above-mentioned transmission processing of the target segmentation data information using the target communication path information to obtain the target communication information includes:

[0116] Using a data allocation model to perform calculation processing on the target segmentation data information and the first target communication path information in the target communication path information to obtain a first allocation value and a second allocation value;

[0117] Among them, the data allocation model is:

[0118]

[0119] In the formula, DY and DE respectively represent the first allocation value and the second allocation value; FG represents the number of sub-target segmentation data information in the target segmentation data information; FG represents the number of first preferred communication path information in the first target communication path information;

[0120] Allocating the M sub-target segmentation data information with the top rankings to the first preferred communication path information ranked first to obtain the allocated target segmentation data information corresponding to the first preferred communication path information ranked first; M is the sum of the first allocation value and the second allocation value;

[0121] Sequentially allocating the other sub-target segmentation data information ranked after M to the other first preferred communication path information other than the first-ranked one in groups of L to obtain the allocated target segmentation data information corresponding to several other first preferred communication path information other than the first-ranked one; L is the first allocation value;

[0122] Performing parallel data transmission on the allocated target segmentation data information using the first preferred communication path information and the second preferred communication path information to obtain several target received segmentation data information;

[0123] Performing splicing processing on the several target received segmentation data information to obtain the target communication information.

[0124] It should be noted that the above-mentioned allocation of the M sub-target segmentation data information with the top rankings to the first preferred communication path information ranked first is considered that the communication path of the first preferred communication path information ranked first has advantages in bandwidth and low latency, and more data to be transmitted is preferentially allocated to improve the data transmission efficiency.

[0125] It should be noted that the above-mentioned sequential allocation of the other sub-target segmentation data information ranked after M to the other first preferred communication path information other than the first-ranked one in groups of L is to evenly distribute all the other sub-target segmentation data information other than the one allocated to the first preferred communication path information ranked first to the first preferred communication path information, so as to achieve the full utilization of the communication path. The embodiments of the present invention are not limited thereto.

[0126] It should be noted that the parallel data transmission of the allocated target segmented data information using the first preferred communication path information and the second preferred communication path information is to first utilize the correspondence between the first preferred communication path information and the allocated target segmented data information, and transmit the allocated target segmented data information through the communication path corresponding to the first preferred communication path information. When the communication path corresponding to the first preferred communication path information fails, one of the second preferred communication path information is selected as a replacement communication path to transmit the data, thereby ensuring the stability and reliability of data transmission.

[0127] Furthermore, when all communication paths are unavailable, the terminal will attempt to re-establish a communication connection, record the fault information in a log or notify the user through other available means. The system will also regularly detect the communication paths and promptly resume the restored communication paths to ensure the continuity of communication. The embodiments of the present invention do not make any limitations in this regard.

[0128] It should be noted that the above-mentioned transmission and processing of audio data information and video data information using the target communication path information is to first evenly distribute the first preferred communication path information in the target communication path information to the audio data information and the video data information, and then transmit the audio data information and the video data information in the same manner as the transmission and processing of the target segmented data information using the target communication path information. The embodiments of the present invention do not make any limitations in this regard.

[0129] It can be seen that implementing the handheld terminal signal processing method described in the embodiments of the present invention is beneficial to improving the communication stability and reliability of the handheld terminal in a complex environment, and further enhancing the practicability of the handheld terminal in a complex environment.

[0130] Embodiment 2

[0131] Please refer to Figure 3 , Figure 3 which is a schematic structural diagram of a handheld terminal signal processing device disclosed in the embodiments of the present invention. Among them, Figure 3 the described device can be applied to a management system, such as a local server or a cloud server for management, etc. The embodiments of the present invention do not make any limitations in this regard. As Figure 3 shown, the device may include:

[0132] An acquisition module 201, configured to acquire data information to be transmitted and alternative communication path information; the data information to be transmitted includes a data transmission type and basic data information;

[0133] The first processing module 202 is configured to perform optimization processing on the alternative communication path information to obtain target communication path information; the target communication path information includes first target communication path information and / or second target communication path information; the first target communication path information includes at least one first optimized communication path information.

[0134] The second processing module 203 is configured to perform transmission processing on the data information to be transmitted by using the target communication path information to obtain target communication information.

[0135] It can be seen that implementing Figure 3 the described handheld terminal signal processing device is beneficial to improving the communication stability and reliability of the handheld terminal in a complex environment, and further enhancing the practicability of the handheld terminal in a complex environment.

[0136] In another optional embodiment, as Figure 3 shown, the first processing module 202 performs optimization processing on the alternative communication path information to obtain target communication path information, including:

[0137] Performing detection and evaluation processing on the alternative communication path information by using a target detection and evaluation model to obtain first communication path information; the first communication path information includes at least one available communication path information.

[0138] Performing allocation processing on the first communication path information to obtain target communication path information.

[0139] It can be seen that implementing Figure 3 the described handheld terminal signal processing device is beneficial to improving the communication stability and reliability of the handheld terminal in a complex environment, and further enhancing the practicability of the handheld terminal in a complex environment.

[0140] In yet another optional embodiment, as Figure 3 shown, the first processing module 202 performs allocation processing on the first communication path information to obtain target communication path information, including:

[0141] Performing quantization processing on the first communication path information to obtain communication path quantization information; the communication path quantization information includes at least one communication path quantization value information; the communication path quantization value information includes a first communication path quantization value and a second communication path quantization value.

[0142] Judging whether the data transmission type is a first transmission type to obtain a type judgment result.

[0143] When the type judgment result is yes, performing calculation processing on the communication path quantization information by using a first transmission calculation model to obtain communication path calculation value information; the communication path calculation value information includes at least one communication path calculation value.

[0144] Among them, the first transmission calculation model is as follows:

[0145] Calculated value of communication path = First calculation coefficient * First communication path quantization value + Second calculation coefficient * Second communication path quantization value; The first calculation coefficient is greater than the second calculation coefficient;

[0146] When the type judgment result is no, use the second transmission calculation model to calculate and process the communication path quantization information to obtain the communication path calculated value information;

[0147] Among them, the second transmission calculation model is as follows:

[0148] Calculated value of communication path = Third calculation coefficient * First communication path quantization value + Fourth calculation coefficient * Second communication path quantization value; The fourth calculation coefficient is greater than the third calculation coefficient;

[0149] Based on the communication path calculated value information, determine the target communication path information.

[0150] It can be seen that implementing Figure 3 The described handheld terminal signal processing device is beneficial to improving the communication stability and reliability of the handheld terminal in a complex environment, and thus enhancing the practicability of the handheld terminal in a complex environment.

[0151] In another alternative embodiment, as Figure 3 shown, the first processing module 202 determines the target communication path information based on the communication path calculated value information, including:

[0152] Judge whether the number of communication path calculated values in the communication path calculated value information is greater than the number threshold to obtain a number judgment result;

[0153] When the number judgment result is no, determine the first communication path information as the first target communication path information;

[0154] When the number judgment result is yes, obtain the path allocation ratio;

[0155] Perform calculation and allocation processing on the path allocation ratio and the communication path calculated value information to obtain the target communication path information.

[0156] It can be seen that implementing Figure 3 The described handheld terminal signal processing device is beneficial to improving the communication stability and reliability of the handheld terminal in a complex environment, and thus enhancing the practicability of the handheld terminal in a complex environment.

[0157] In another alternative embodiment, as Figure 3 shown, the first processing module 202 performs calculation and allocation processing on the path allocation ratio and the communication path calculated value information to obtain the target communication path information, including:

[0158] Sort all the communication path calculation values in the communication path calculation value information in descending order according to the communication path calculation values to obtain a communication path calculation value sequence;

[0159] Use the allocation calculation model to perform calculation processing on the quantity of communication path calculation values and the path allocation ratio to obtain an allocation value;

[0160] Among them, the allocation calculation model is:

[0161]

[0162] Take the first N communication path calculation values in the front of the communication path calculation value sequence as the first target communication path values, and take the communication path calculation values corresponding to the non-first target communication path values in the communication path calculation value sequence as the second target communication path values; N is the allocation value;

[0163] Take the available communication path information corresponding to the first target communication path value as the first preferred communication path information in the first target communication path information;

[0164] Take the available communication path information corresponding to the second target communication path value as the second preferred communication path information in the second target communication path information.

[0165] It can be seen that implementing Figure 3 the described handheld terminal signal processing device is beneficial to improving the communication stability and reliability of the handheld terminal in a complex environment, and further enhancing the practicability of the handheld terminal in a complex environment.

[0166] In another optional embodiment, as Figure 3 shown, the target detection and evaluation model includes a first convolutional module, a second convolutional module, a first pooling module, a second pooling module, a first regularization module, a second regularization module, a first network module, an attention module, a first connection module, a second connection module, and a third connection module; among them,

[0167] The input end of the first convolution module is configured to receive the model input information of the target detection evaluation model, and the output end of the first convolution module is connected to the input end of the first pooling module; the output end of the first pooling module is connected to the input end of the second convolution module; the output end of the second convolution module is connected to the input end of the second pooling module; the output end of the second pooling module is connected to the input end of the first connection module; the output end of the first connection module is connected to the input end of the second connection module; the output end of the second connection module is connected to the input end of the first regularization module; the output of the first regularization module is connected to the input end of the first network module; the output end of the first network module is connected to the input end of the second regularization module; the output end of the second regularization module is connected to the input end of the attention module; the output end of the attention module is connected to the input end of the third connection module; the output end of the third connection module is configured to output the model output information of the target detection evaluation model.

[0168] It can be seen that implementing Figure 3 the described handheld terminal signal processing device is beneficial to improving the communication stability and reliability of the handheld terminal in a complex environment, and further enhancing the practicability of the handheld terminal in a complex environment.

[0169] In another alternative embodiment, as Figure 3 shown, the second processing module 203 performs transmission processing on the data information to be transmitted by using the target communication path information to obtain target communication information, including:

[0170] Judge whether the basic data information in the data information to be transmitted is audio-visual data to obtain a data judgment result;

[0171] When the data judgment result is yes, perform audio-visual separation processing on the basic data information to obtain audio data information and video data information;

[0172] Perform transmission processing on the audio data information and video data information by using the target communication path information to obtain target audio information and target video information;

[0173] Perform fusion processing on the target audio information and target video information to obtain target communication information;

[0174] When the data judgment result is no, perform segmentation processing on the basic data information to obtain target segmentation data information;

[0175] Perform transmission processing on the target segmentation data information by using the target communication path information to obtain target communication information.

[0176] It can be seen that implementing Figure 3 the described handheld terminal signal processing device is beneficial to improving the communication stability and reliability of the handheld terminal in a complex environment, and further enhancing the practicability of the handheld terminal in a complex environment.

[0177] Embodiment III

[0178] Please refer to Figure 4 , Figure 4 which is a schematic structural diagram of another hand-held terminal signal processing device disclosed in the embodiments of the present invention. Among them, Figure 4 the described device can be applied to a management system, such as a local server or a cloud server for management, etc., which is not limited in the embodiments of the present invention. As Figure 4 shown, the device may include:

[0179] A memory 301 storing executable program code;

[0180] A processor 302 coupled to the memory 301;

[0181] The processor 302 calls the executable program code stored in the memory 301 to execute the steps in the hand-held terminal signal processing method described in Embodiment I.

[0182] Embodiment IV

[0183] The embodiments of the present invention disclose a computer-readable storage medium that stores a computer program for electronic data exchange, wherein the computer program causes the computer to execute the steps in the hand-held terminal signal processing method described in Embodiment I.

[0184] Embodiment V

[0185] The embodiments of the present invention disclose a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause the computer to execute the steps in the hand-held terminal signal processing method described in Embodiment I.

[0186] The device embodiments described above are only illustrative. The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical modules, that is, they may be located in one place or distributed to multiple network modules. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art can understand and implement it without creative labor.

[0187] Through the specific descriptions of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on such an understanding, the essence of the above technical solution, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, and the storage medium includes read-only memory (ROM), random access memory (RAM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), one-time programmable read-only memory (OTPROM), electrically-erasable programmable read-only memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc memories, magnetic disk memories, tape memories, or any other medium that can be used to carry or store data and is computer-readable.

[0188] Finally, it should be noted that: The handheld terminal signal processing method and device disclosed in the embodiments of the present invention only disclose the preferred embodiments of the present invention, and are only used to illustrate the technical solutions of the present invention, rather than limiting them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements on some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A handheld terminal signal processing method, characterized in that: The method comprises: Acquire information about data to be transmitted and information about an alternative communication path; the information about data to be transmitted includes a data transmission type and basic data information; The candidate communication path information is preferentially processed to obtain target communication path information; the target communication path information includes first target communication path information and / or second target communication path information; the first target communication path information includes at least one first preferred communication path information; The target communication path information is used to perform transmission processing on the data information to be transmitted to obtain target communication information.

2. The handheld terminal signal processing method according to claim 1, characterized in that: The step of performing optimal processing on the candidate communication path information to obtain target communication path information includes: Using a target detection and evaluation model to perform detection and evaluation processing on the candidate communication path information to obtain first communication path information; the first communication path information includes at least one available communication path information; The first communication path information is distributed and processed to obtain target communication path information.

3. The handheld terminal signal processing method according to claim 2, characterized in that: The step of performing distribution processing on the first communication path information to obtain target communication path information includes: Quantizing the first communication path information to obtain communication path quantization information; the communication path quantization information includes at least one communication path quantization value information; the communication path quantization value information includes a first communication path quantization value and a second communication path quantization value; Determine whether the data transmission type is the first transmission type, and obtain a type determination result; When the type judgment result is yes, the communication path quantization information is calculated and processed by using the first transmission calculation model to obtain communication path calculation value information; the communication path calculation value information includes at least one communication path calculation value; Wherein, the first transmission calculation model is: Communication channel calculation value = first calculation coefficient * first communication channel quantization value + second calculation coefficient * second communication channel quantization value; the first calculation coefficient is greater than the second calculation coefficient; When the type determination result is no, the communication path quantization information is calculated and processed by using a second transmission calculation model to obtain the communication path calculation value information; Wherein, the second transmission calculation model is: Communication channel calculation value = third calculation coefficient * first communication channel quantization value + fourth calculation coefficient * second communication channel quantization value; the fourth calculation coefficient is greater than the third calculation coefficient; Based on the communication path calculation value information, target communication path information is determined.

4. The handheld terminal signal processing method according to claim 3, characterized in that: The step of determining target communication path information based on the communication path calculation value information includes: determining whether the number of the communication path calculation values ​​in the communication path calculation value information is greater than a number threshold, and obtaining a number determination result; When the result of the quantity determination is no, determining the first communication path information as the first target communication path information; When the result of the quantity determination is yes, obtaining a channel allocation ratio; The path allocation ratio and the communication path calculation value information are subjected to calculation and allocation processing to obtain target communication path information.

5. The handheld terminal signal processing method according to claim 4, characterized in that: The step of calculating and allocating the path allocation ratio and the communication path calculated value information to obtain target communication path information includes: sorting all the communication path calculation values ​​in the communication path calculation value information from large to small according to the communication path calculation values ​​to obtain a communication path calculation value sequence; Using a distribution calculation model, the number of communication path calculation values ​​and the path distribution ratio are calculated and processed to obtain a distribution value; Wherein, the allocation calculation model is: The first N communication path calculation values ​​in the communication path calculation value sequence are used as first target communication path values, and the communication path calculation values ​​in the communication path calculation value sequence that do not correspond to the first target communication path values ​​are used as second target communication path values; N is the allocated value; using the available communication path information corresponding to the first target communication path value as the first preferred communication path information in the first target communication path information; The available communication path information corresponding to the second target communication path value is used as the second preferred communication path information in the second target communication path information.

6. The handheld terminal signal processing method according to claim 2, characterized in that: The target detection evaluation model includes a first convolution module, a second convolution module, a first pooling module, a second pooling module, a first regularization module, a second regularization module, a first network module, an attention module, a first connection module, a second connection module and a third connection module; wherein, The input end of the first convolution module is configured to receive model input information of the target detection evaluation model, the output end of the first convolution module is connected to the input end of the first pooling module; the output end of the first pooling module is connected to the input end of the second convolution module; the output end of the second convolution module is connected to the input end of the second pooling module; the output end of the second pooling module is connected to the input end of the first connection module; the output end of the first connection module is connected to the input end of the second connection module; the output end of the second connection module is connected to the input end of the first regularization module; the output of the first regularization module is connected to the input end of the first network module; the output end of the first network module is connected to the input end of the second regularization module; the output end of the second regularization module is connected to the input end of the attention module; the output end of the attention module is connected to the input end of the third connection module; the output end of the third connection module is configured to output the model output information of the target detection evaluation model.

7. The handheld terminal signal processing method according to claim 1, characterized in that: The step of using the target communication path information to perform transmission processing on the data information to be transmitted to obtain target communication information includes: Determine whether the basic data information in the data information to be transmitted is audio or video data, and obtain a data determination result; When the data judgment result is yes, performing audio and video separation processing on the basic data information to obtain audio data information and video data information; Using the target communication path information to transmit and process the audio data information and the video data information, to obtain target audio information and target video information; fusing the target audio information and the target video information to obtain target communication information; When the data judgment result is no, segmenting the basic data information to obtain target segmented data information; The target communication path information is used to perform transmission processing on the target segmented data information to obtain target communication information.

8. A handheld terminal signal processing device, characterized in that: The device comprises: An acquisition module, used to acquire data information to be transmitted and information of an alternative communication path; the data information to be transmitted includes a data transmission type and basic data information; a first processing module, configured to perform optimal processing on the candidate communication path information to obtain target communication path information; the target communication path information includes first target communication path information and / or second target communication path information; the first target communication path information includes at least one first optimal communication path information; The second processing module is used to perform transmission processing on the data information to be transmitted by using the target communication path information to obtain target communication information.

9. A handheld terminal signal processing device, characterized in that: The device comprises: A memory storing executable program code; a processor coupled to the memory; The processor calls the executable program code stored in the memory to execute the handheld terminal signal processing method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and when the computer instructions are called, they are used to execute the handheld terminal signal processing method according to any one of claims 1 to 7.

Images