A signal processing method and apparatus for a handheld terminal

Abstract

The present invention discloses a method and device for signal processing of a handheld terminal. The method includes: obtaining data information to be transmitted and alternative communication path information; the data information to be transmitted includes a data transmission type and basic data information; performing an optimization process on the alternative communication path information to obtain target communication path information; the target communication path information includes first target communication path information and / or second target communication path information; the first target communication path information includes at least one first optimized communication path information; using the target communication path information to perform a transmission process on the data information to be transmitted to obtain target communication information.

Description

Technical Field

[0001] The present invention relates to the technical field of signal processing, and particularly to a signal processing method and device for a handheld terminal. Background Art

[0002] In scenarios such as emergency rescue and outdoor exploration, the handheld terminal is a key tool for rescue personnel to communicate with the command center and other team members. However, due to factors such as complex environments and unstable networks, the communication of the handheld terminal is often affected by problems such as weak signals and frequent interruptions. Therefore, how to improve the communication stability and reliability of the handheld terminal in complex environments has become a major challenge in current communication technologies. Traditional handheld terminals usually rely on a single communication method, such as cellular networks, satellite communication, or Wi-Fi. When the single communication method fails, the communication may be interrupted, seriously affecting the smooth progress of tasks. Therefore, a signal processing method and device for a handheld terminal are provided to improve the communication stability and reliability of the handheld terminal in complex environments, and further enhance the practicality of the handheld terminal in complex environments. Summary of the Invention

[0003] The technical problem to be solved by the present invention is to provide a signal processing method and device for a handheld terminal, which is beneficial to improving the communication stability and reliability of the handheld terminal in complex environments, and further enhancing the practicality of the handheld terminal in complex environments.

[0004] To solve the above technical problem, in the first aspect, an embodiment of the present invention discloses a signal processing method for a handheld terminal, and the method includes:

[0005] Obtain the data information to be transmitted and the alternative communication path information; the data information to be transmitted includes the data transmission type and the basic data information;

[0006] Perform an optimization process on the alternative communication path information to obtain the target communication path information; the target communication path information includes the first target communication path information, and / or, the second target communication path information; the first target communication path information includes at least one first optimized communication path information;

[0007] Use the target communication path information to perform a transmission process on the data information to be transmitted to obtain the target communication information.

[0008] In the second aspect, an embodiment of the present invention discloses a signal processing device for a handheld terminal, and the device includes:

[0009] An obtaining module, configured to obtain the data information to be transmitted and the alternative communication path information; the data information to be transmitted includes the data transmission type and the basic data information;

[0010] A first processing module, configured to perform optimization processing on the alternative communication path information to obtain target communication path information; the target communication path information includes first target communication path information and / or second target communication path information; the first target communication path information includes at least one first optimized communication path information.

[0011] A second processing module, configured to perform transmission processing on the data information to be transmitted by using the target communication path information to obtain target communication information.

[0012] A third aspect of the present invention discloses another handheld terminal signal processing device, the device includes:

[0013] A memory storing executable program code;

[0014] A processor coupled to the memory;

[0015] The processor calls the executable program code stored in the memory and executes some or all of the steps in the handheld terminal signal processing method disclosed in the first aspect of the embodiments of the present invention.

[0016] A fourth aspect of the present invention discloses a computer-readable storage medium, the computer-readable storage medium stores computer instructions, and when the computer instructions are called, they are used to execute some or all of the steps in the handheld terminal signal processing method disclosed in the first aspect of the embodiments of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the following drawings are only some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0018] Figure 1 is a schematic diagram of the scenario of the handheld terminal signal processing system provided by the embodiments of the present invention;

[0019] Figure 2 is a schematic flowchart of a handheld terminal signal processing method disclosed in the embodiments of the present invention;

[0020] Figure 3 is a schematic structural diagram of a handheld terminal signal processing device disclosed in the embodiments of the present invention;

[0021] Figure 4 is a schematic structural diagram of another handheld terminal signal processing device disclosed in the embodiments of the present invention;

[0022] Figure 5It is a schematic structural diagram of an object detection and evaluation model disclosed in an embodiment of the present invention. Detailed implementation manners

[0023] In order to enable those skilled in the art to better understand the solution of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without making creative efforts shall fall within the protection scope of the present invention.

[0024] The terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, device, product or equipment that includes a series of steps or units is not limited to the listed steps or units, but optionally further includes steps or units not listed, or optionally further includes other steps or units inherent to these processes, methods, products or equipment.

[0025] Referring to "embodiment" herein means that a specific feature, structure or characteristic described in connection with the embodiment can be included in at least one embodiment of the present invention. The phrase appears in various places in the specification and does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. Those skilled in the art will explicitly and implicitly understand that the embodiments described herein can be combined with other embodiments.

[0026] In this application, the term "exemplary" is used to mean "serving as an example, illustration or explanation". Any embodiment described as "exemplary" in this application is not necessarily construed as being more preferred or having more advantages than other embodiments. In order to enable any person skilled in the art to implement and use this application, the following description is given. In the following description, details are set forth for purposes of explanation. It should be understood that those of ordinary skill in the art can recognize that this application can be implemented without these specific details. In other instances, well-known structures and processes are not elaborated in detail to avoid unnecessary details from obscuring the description of this application. Therefore, this application is not intended to be limited to the embodiments shown, but is consistent with the broadest scope that conforms to the principles and features disclosed in this application.

[0027] It should be noted that since the method of the embodiment of this application is executed in a computer device, the processing objects of each computer device exist in the form of data or information. For example, time, which is actually time information. It can be understood that in subsequent embodiments, if dimensions, quantities, positions, etc. are mentioned, they are all corresponding data existences for the computer device to process, and specific details are not elaborated here.

[0028] It should be noted that a brief introduction to the artificial intelligence-related technologies that may be involved in this application is provided. Artificial Intelligence (AI) is the theory, method, technology, and application system that uses digital computers or machines controlled by digital computers to simulate, extend, and expand human intelligence, perceive the environment, acquire knowledge, and use knowledge to obtain the best results. In other words, artificial intelligence is a comprehensive technology in computer science that attempts to understand the essence of intelligence and produce a new intelligent machine that can respond in a way similar to human intelligence. Artificial intelligence also studies the design principles and implementation methods of various intelligent machines to enable the machines to have the functions of perception, reasoning, and decision-making.

[0029] Artificial intelligence technology is an interdisciplinary subject with a wide range of fields, including both hardware-level technologies and software-level technologies. The basic technologies of artificial intelligence generally include technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing technology, operation / interaction systems, and mechatronics. The software technologies of artificial intelligence mainly include several major directions such as computer vision technology, speech processing technology, natural language processing technology, and machine learning / deep learning.

[0030] Computer Vision Technology (CV) Computer vision is a science that studies how to make machines "see". More specifically, it refers to using cameras and computers to replace human eyes to identify and measure targets, etc., in machine vision, and further perform graphic processing to make the computer-processed images more suitable for human eyes to observe or be transmitted to instruments for detection. As a scientific discipline, computer vision studies related theories and technologies and attempts to establish an artificial intelligence system that can obtain information from images or multi-dimensional data. Computer vision technology usually includes technologies such as image processing, image recognition, image semantic understanding, image retrieval, OCR, video processing, video semantic understanding, video content / behavior recognition, three-dimensional object reconstruction, 3D technology, virtual reality, augmented reality, simultaneous localization and mapping, etc., and also includes common biometric recognition technologies such as face recognition and fingerprint recognition.

[0031] Unimodal information is data of only one type, such as one of the data information types of text, image, audio, video, electromagnetic signal, etc. Multimodal information is data information that includes at least two types of unimodal information. Further, multimodal information is applicable to complex tasks that require integrating multiple information sources, such as sentiment analysis, robot interaction, autonomous driving, etc. By integrating information of multiple modalities, higher performance and accuracy can usually be achieved in tasks.

[0032] A large model refers to an artificial neural network model with a very large number of parameters. In the field of artificial intelligence, a large model usually refers to a model with hundreds of millions to trillions of parameters. The model usually needs to be trained on a large-scale dataset and requires a large amount of computing resources for optimization and adjustment. Large models are usually used to solve complex natural language processing, computer vision, speech recognition, and other tasks. Generative AI is a type of AI that can create new content and ideas, including conversations, stories, images, videos, and music. In the embodiments of this application, the large model can be large-scale language models such as ChatGPT, BERT, XLNet, Zhipu Model, Claude, Moonshot AI Model, ChatGLM Model, Qianyitongwen Model, MiniMax Model, Spark Model, Llama Model, 360GPT Model, Qwen Model, Baichuan Model, Lark Model, vivoLM Model, and Wenxin Yiyan, and the embodiments of this application do not make any limitations.

[0033] The embodiments of this application provide a method, device, computer device, and computer-readable storage medium for processing signals of a handheld terminal, which will be described in detail below.

[0034] Please refer to Figure 1 , Figure 1 , which is a schematic diagram of the scenario of the signal processing system of the handheld terminal provided by the embodiments of this application. The signal processing system of the handheld terminal may include a computer device 100, and a handheld terminal signal processing device is integrated in the computer device 100, such as Figure 1 the computer device in

[0035] In the embodiments of this application, the computer device 100 is mainly used to obtain data information to be transmitted and alternative communication path information; the data information to be transmitted includes a data transmission type and basic data information;

[0036] Perform an optimization process on the alternative communication path information to obtain target communication path information; the target communication path information includes first target communication path information, and / or, second target communication path information; the first target communication path information includes at least one first preferred communication path information;

[0037] Use the target communication path information to perform a transmission process on the data information to be transmitted to obtain target communication information.

[0038] It can improve the communication stability and reliability of the handheld terminal in complex environments, and thus enhance the practicability of the handheld terminal in complex environments.

[0039] In the embodiments of the present application, the computer device 100 can be an independent server, or a server network or server cluster composed of servers. For example, the computer device 100 described in the embodiments of the present application includes, but is not limited to, a computer, a network host, a single network server, a set of multiple network servers, or a cloud server composed of multiple servers. Among them, the cloud server is composed of a large number of computers or network servers based on cloud computing.

[0040] It can be understood that the computer device 100 used in the embodiments of the present application can be a device that includes both receiving and transmitting hardware, that is, a device having receiving and transmitting hardware capable of performing two-way communication on a two-way communication link. Such devices can include: cellular or other communication devices, which have a single-line display or a multi-line display, or cellular or other communication devices without a multi-line display. Specifically, the computer device 100 can be a desktop terminal or a mobile terminal, and the computer device 100 can also be a mobile phone, a tablet computer, a laptop computer, etc.

[0041] Those skilled in the art can understand that Figure 1 the application environment shown in is only one application scenario of the solution of the present application, and does not constitute a limitation on the application scenario of the solution of the present application. Other application environments can also include more or fewer computer devices than Figure 1 shown in, for example Figure 1 only 1 computer device is shown in. It can be understood that the handheld terminal signal processing system can also include one or more other services, which are not specifically limited here.

[0042] In addition, as Figure 1 shown, the handheld terminal signal processing system can also include a memory 200 for storing data, such as image data, location information, etc.

[0043] It should be noted that Figure 1 the scene schematic diagram of the handheld terminal signal processing system shown is only an example. The handheld terminal signal processing system and the scene described in the embodiments of the present application are for more clearly explaining the technical solutions of the embodiments of the present application, and do not constitute a limitation on the technical solutions provided by the embodiments of the present application. Those skilled in the art know that with the evolution of the handheld terminal signal processing system and the emergence of new service scenarios, the technical solutions provided by the embodiments of the present application are equally applicable to similar technical problems.

[0044] The present invention discloses a method and device for signal processing of a handheld terminal, which is beneficial to improving the communication stability and reliability of the handheld terminal in a complex environment, and further enhancing the practicability of the handheld terminal in a complex environment. The following will be described in detail respectively.

[0045] Embodiment 1

[0046] Please refer to Figure 2 , Figure 2 which is a schematic flowchart of a method for signal processing of a handheld terminal disclosed in an embodiment of the present invention. Among them, Figure 2 the described method for signal processing of the handheld terminal is applied to a management system, such as a local server or a cloud server for management, etc., which is not limited in the embodiments of the present invention. As Figure 2 shown, the method for signal processing of the handheld terminal may include the following operations:

[0047] 101. Obtain the information of the data to be transmitted and the information of the alternative communication paths.

[0048] In an embodiment of the present invention, the information of the data to be transmitted includes the data transmission type and the basic data information.

[0049] 102. Perform an optimization process on the information of the alternative communication paths to obtain the information of the target communication path.

[0050] In an embodiment of the present invention, the information of the target communication path includes the first target communication path information, and / or, the second target communication path information; the first target communication path information includes at least one first optimized communication path information.

[0051] 103. Use the information of the target communication path to perform a transmission process on the information of the data to be transmitted to obtain the target communication information.

[0052] It should be noted that the above information of the alternative communication paths includes several connected communication path information through which the handheld terminal and the target communication device (such as a communication base station, a mobile communication terminal, a satellite, a space-based communication terminal, etc.) can communicate with each other, which is not limited in the embodiments of the present invention. Further, the above connected communication path information includes data information such as a path identifier, a delay parameter, a bandwidth, a signal strength, etc., which is not limited in the embodiments of the present invention.

[0053] It should be noted that the above data transmission type includes the first transmission type (large bandwidth transmission) and the second transmission type (low latency transmission), which is not limited in the embodiments of the present invention.

[0054] It should be noted that the method of this application significantly improves the communication stability of the terminal in complex environments by integrating multiple communication methods and automatically switching channels. Even if a certain channel fails, the system can automatically switch to other available channels, avoiding communication interruption and increasing the success rate of tasks. Through multi-channel parallel transmission and dynamic load balancing, the existing communication resources are fully utilized, improving the speed and efficiency of data transmission. The system automatically monitors and recovers communication faults, reducing user intervention and enhancing the reliability of communication and the user experience.

[0055] It can be seen that implementing the signal processing method of the handheld terminal described in the embodiments of the present invention is beneficial to improving the communication stability and reliability of the handheld terminal in complex environments, and thus enhancing the practicality of the handheld terminal in complex environments.

[0056] In an optional embodiment, the above-mentioned preferential processing of the alternative communication channel information to obtain the target communication channel information includes:

[0057] Using a target detection and evaluation model to perform detection and evaluation processing on the alternative communication channel information to obtain the first communication channel information; the first communication channel information includes at least one available communication channel information;

[0058] Performing allocation processing on the first communication channel information to obtain the target communication channel information.

[0059] It should be noted that the above-mentioned use of the target detection and evaluation model to perform detection and evaluation processing on the alternative communication channel information is to use a lightweight artificial intelligence model to efficiently and quickly screen the connected communication channels to screen out the communication channels that can be used in the current complex environment, so as to be more conducive to the efficient and reliable allocation of communication channels, and thus improve the stability and reliability of communication. The embodiments of the present invention do not make limitations.

[0060] It can be seen that implementing the signal processing method of the handheld terminal described in the embodiments of the present invention is beneficial to improving the communication stability and reliability of the handheld terminal in complex environments, and thus enhancing the practicality of the handheld terminal in complex environments.

[0061] In another optional embodiment, the allocation processing of the first communication channel information to obtain the target communication channel information includes:

[0062] Performing quantization processing on the first communication channel information to obtain communication channel quantization information; the communication channel quantization information includes at least one communication channel quantization value information; the communication channel quantization value information includes a first communication channel quantization value and a second communication channel quantization value;

[0063] Judging whether the data transmission type is the first transmission type to obtain a type judgment result;

[0064] When the type judgment result is yes, use the first transmission calculation model to calculate and process the communication path quantization information to obtain the communication path calculation value information; the communication path calculation value information includes at least one communication path calculation value;

[0065] Among them, the first transmission calculation model is:

[0066] Communication path calculation value = first calculation coefficient * first communication path quantization value + second calculation coefficient * second communication path quantization value; the first calculation coefficient is greater than the second calculation coefficient;

[0067] When the type judgment result is no, use the second transmission calculation model to calculate and process the communication path quantization information to obtain the communication path calculation value information;

[0068] Among them, the second transmission calculation model is:

[0069] Communication path calculation value = third calculation coefficient * first communication path quantization value + fourth calculation coefficient * second communication path quantization value; the fourth calculation coefficient is greater than the third calculation coefficient;

[0070] Based on the communication path calculation value information, determine the target communication path information.

[0071] It should be noted that the above quantization processing of the first communication path information is to standardize the bandwidth and delay parameters in the available communication path information, so as to obtain the corresponding first communication path quantization value and second communication path quantization value, which are not limited in the embodiments of the present invention. Further, the above standardization processing process can be implemented based on a look-up table method. Further, the bandwidth and delay standardization table can be:

[0072]

[0073]

[0074] It should be noted that the above bandwidth standard unit can be 1M, 1T, etc., which are not limited in the embodiments of the present invention. The above time delay unit can be 1 millisecond, 1 second, etc., which are not limited in the embodiments of the present invention.

[0075] It should be noted that the above first calculation coefficient, second calculation coefficient, third calculation coefficient, and fourth calculation coefficient are values between 0 and 1, which are not limited in the embodiments of the present invention. Further, the difference between the first calculation coefficient and the second calculation coefficient is greater than 0.2; the difference between the fourth calculation coefficient and the third calculation coefficient is greater than 0.2. The above coefficient difference being greater than 0.2 can effectively ensure the selection of the communication path for data transmission according to the transmission type, avoid the excessive influence of interference factors on the communication path, and improve the accuracy and reliability of the communication path selection, which are not limited in the embodiments of the present invention.

[0076] It can be seen that implementing the handheld terminal signal processing method described in the embodiments of the present invention is beneficial to improving the communication stability and reliability of the handheld terminal in complex environments, and further enhancing the practicability of the handheld terminal in complex environments.

[0077] In another optional embodiment, based on the communication path calculation value information, determining the target communication path information includes:

[0078] Judging whether the number of communication path calculation values in the communication path calculation value information is greater than the number threshold to obtain a number judgment result;

[0079] When the number judgment result is negative, determining the first communication path information as the first target communication path information;

[0080] When the number judgment result is positive, obtaining the path allocation ratio;

[0081] Performing calculation and allocation processing on the path allocation ratio and the communication path calculation value information to obtain the target communication path information.

[0082] It should be noted that the above number threshold can be set by the user, or can be a default value given by the system, or can be determined by taking the average of historical number thresholds. The embodiments of the present invention do not make limitations. Further, the above number threshold is a positive integer not less than 3, and the embodiments of the present invention do not make limitations. Further, by judging the size of the number corresponding to the communication path and the number threshold, it can be realized that when there are fewer available communication paths, all communication paths are used for data transmission to ensure the efficiency of data transmission. At the same time, when there are more available communication paths, the path allocation ratio is used to divide the main path directly used for data transmission and the standby path, so that when the signal of the main path becomes weak or the line is disconnected, the standby path is used to replace the main path for data transmission, that is, when it is detected that the current main path signal is weak, the delay is too high or an interruption occurs, the terminal will automatically switch to the standby path with better signal to continue communication, thus ensuring the signal stability and improving the efficiency and reliability of data transmission. The embodiments of the present invention do not make limitations.

[0083] It should be noted that the above path allocation ratio represents the main path for data transmission and the standby path for replacing the main path. The embodiments of the present invention do not make limitations. Further, the above path allocation ratio can be one of 1:1, 2:1, 3:1. The embodiments of the present invention do not make limitations.

[0084] It can be seen that implementing the handheld terminal signal processing method described in the embodiments of the present invention is beneficial to improving the communication stability and reliability of the handheld terminal in complex environments, and further enhancing the practicability of the handheld terminal in complex environments.

[0085] In yet another alternative embodiment, calculation and allocation processing is performed on the channel allocation ratio and communication channel calculation value information to obtain target communication channel information, including:

[0086] Sort all the communication channel calculation values in the communication channel calculation value information from largest to smallest according to the communication channel calculation value to obtain a communication channel calculation value sequence;

[0087] Use an allocation calculation model to perform calculation processing on the number of communication channel calculation values and the channel allocation ratio to obtain an allocation value;

[0088] Among them, the allocation calculation model is:

[0089]

[0090] Take the first N communication channel calculation values in the front of the communication channel calculation value sequence as the first target communication channel values, and take the communication channel calculation values corresponding to the non-first target communication channel values in the communication channel calculation value sequence as the second target communication channel values; N is the allocation value;

[0091] Take the available communication channel information corresponding to the first target communication channel value as the first preferred communication channel information in the first target communication channel information;

[0092] Take the available communication channel information corresponding to the second target communication channel value as the second preferred communication channel information in the second target communication channel information.

[0093] It should be noted that the above allocation calculation model first multiplies the channel allocation ratio by the number of communication channel calculation values and then rounds down. The embodiments of the present invention do not make any limitations. Further, the consideration of the above rounding down is mainly because the number of available communication channels is greater than the number threshold, indicating that its number is relatively large, so it can ensure that there are enough main channels for current data transmission. However, considering the reliability of the communication channels, a certain number of backup channels must be reserved. Therefore, the number of rounding down is selected to ensure that there will definitely be backup channels, thereby improving the stability and reliability of the communication signal. The embodiments of the present invention do not make any limitations.

[0094] It can be seen that implementing the handheld terminal signal processing method described in the embodiments of the present invention is beneficial to improving the communication stability and reliability of the handheld terminal in a complex environment, and further enhancing the practicability of the handheld terminal in a complex environment.

[0095] In an alternative embodiment, as Figure 5 shown, the above target detection and evaluation model includes a first convolutional module, a second convolutional module, a first pooling module, a second pooling module, a first regularization module, a second regularization module, a first network module, an attention module, a first connection module, a second connection module, and a third connection module; among them,

[0096] The input end of the first convolutional module is configured to receive the model input information of the target detection evaluation model, and the output end of the first convolutional module is connected to the input end of the first pooling module; the output end of the first pooling module is connected to the input end of the second convolutional module; the output end of the second convolutional module is connected to the input end of the second pooling module; the output end of the second pooling module is connected to the input end of the first connection module; the output end of the first connection module is connected to the input end of the second connection module; the output end of the second connection module is connected to the input end of the first regularization module; the output of the first regularization module is connected to the input end of the first network module; the output end of the first network module is connected to the input end of the second regularization module; the output end of the second regularization module is connected to the input end of the attention module; the output end of the attention module is connected to the input end of the third connection module; the output end of the third connection module is configured to output the model output information of the target detection evaluation model.

[0097] It should be noted that the above first regularization module and second regularization module are constructed based on the Dropout layer, which is mainly to prevent overfitting. The embodiments of the present invention are not limited thereto.

[0098] It should be noted that the above first network module can be a bidirectional long short-term memory. The embodiments of the present invention are not limited thereto. Further, the above first network module can efficiently capture long-term dependencies in the time series, and can consider bidirectional information through the bidirectional structure, improving the feature extraction ability of the model. The embodiments of the present invention are not limited thereto.

[0099] It should be noted that the above attention module is constructed based on the multi-head attention mechanism. The embodiments of the present invention are not limited thereto.

[0100] It should be noted that the above first connection module, second connection module, and third connection module are fully connected layers. The embodiments of the present invention are not limited thereto.

[0101] It should be noted that the above first pooling module and second pooling module are constructed based on the max pooling layer. The embodiments of the present invention are not limited thereto.

[0102] It should be noted that the convolution kernel sizes of the above first convolutional module and second convolutional module are one of 1×1, 3×1, 5×1, and 5×3. Further, the activation function corresponding to the convolutional module is the RELU function. The embodiments of the present invention are not limited thereto.

[0103] It should be noted that the loss function for model training can be the cross-entropy loss function. The embodiments of the present invention are not limited thereto.

[0104] It can be seen that implementing the signal processing method of the handheld terminal described in the embodiments of the present invention is beneficial to improving the communication stability and reliability of the handheld terminal in complex environments, and further enhancing the practicability of the handheld terminal in complex environments.

[0105] In another optional embodiment, the target communication path information is used to perform transmission processing on the data information to be transmitted to obtain target communication information, including:

[0106] Determine whether the basic data information in the data information to be transmitted is audio-visual data to obtain a data determination result;

[0107] When the data determination result is yes, perform audio-visual separation processing on the basic data information to obtain audio data information and video data information;

[0108] Use the target communication path information to perform transmission processing on the audio data information and video data information to obtain target audio information and target video information;

[0109] Perform fusion processing on the target audio information and target video information to obtain target communication information;

[0110] When the data determination result is no, perform segmentation processing on the basic data information to obtain target segmentation data information;

[0111] Use the target communication path information to perform transmission processing on the target segmentation data information to obtain target communication information.

[0112] It should be noted that the above audio-visual separation processing of the basic data information and the use of the target communication path information to perform transmission processing on the audio data information and video data information transmit the audio and video data through different paths to ensure that even if there are problems with the audio or video transmission in a certain path, the basic communication ability can still be maintained. The embodiments of the present invention do not make any limitations. Further, the above fusion processing of the target audio information and target video information can be to match the audio data to the corresponding video position, which can be implemented based on a convolutional neural network or based on the MACAW-LLM multimodal large model. The embodiments of the present invention do not make any limitations.

[0113] It should be noted that the above target segmentation data information includes several sequentially distributed sub-target segmentation data information. Further, splitting the data into multiple parts and transmitting them in parallel through different paths to improve the transmission speed and reliability are not limited in the embodiments of the present invention.

[0114] It should be noted that the communication path calculation values corresponding to the first preferred communication path information in the first target communication path information are distributed from large to small, and the embodiments of the present invention do not make any limitations.

[0115] In this optional embodiment, as an optional implementation manner, the above-mentioned transmission processing of the target segmentation data information using the target communication path information to obtain the target communication information includes:

[0116] Performing calculation processing on the target segmentation data information and the first target communication path information in the target communication path information by using a data allocation model to obtain a first allocation value and a second allocation value;

[0117] Among them, the data allocation model is:

[0118]

[0119] In the formula, DY and DE respectively represent the first allocation value and the second allocation value; FG represents the number of sub-target segmentation data information in the target segmentation data information; FG represents the number of first preferred communication path information in the first target communication path information;

[0120] Allocating M sub-target segmentation data information with higher rankings to the first-ranked first preferred communication path information to obtain the allocated target segmentation data information corresponding to the first-ranked first preferred communication path information; M is the sum of the first allocation value and the second allocation value;

[0121] Sequentially allocating the other sub-target segmentation data information ranked after M to the other first preferred communication path information other than the first-ranked one in groups of L to obtain the allocated target segmentation data information corresponding to several other first preferred communication path information other than the first-ranked one; L is the first allocation value;

[0122] Performing parallel data transmission on the allocated target segmentation data information by using the first preferred communication path information and the second preferred communication path information to obtain several target received segmentation data information;

[0123] Performing splicing processing on the several target received segmentation data information to obtain the target communication information.

[0124] It should be noted that the above-mentioned allocation of M sub-target segmentation data information with higher rankings to the first-ranked first preferred communication path information is considering that the communication path of the first-ranked first preferred communication path information has advantages in bandwidth and low latency, and preferentially allocating more data to be transmitted, thereby improving the data transmission efficiency.

[0125] It should be noted that the above-mentioned sequential allocation of the other sub-target segmentation data information ranked after M to the other first preferred communication path information other than the first-ranked one in groups of L is to evenly distribute all the other sub-target segmentation data information other than the one allocated to the first-ranked first preferred communication path information to the first preferred communication path information, so as to achieve the full utilization of the communication path, and the embodiments of the present invention do not make any limitations.

[0126] It should be noted that the parallel data transmission of the allocated target segmentation data information by using the first preferred communication path information and the second preferred communication path information is to first use the correspondence between the first preferred communication path information and the allocated target segmentation data information, and transmit the allocated target segmentation data information through the communication path corresponding to the first preferred communication path information. When the communication path corresponding to the first preferred communication path information fails, one of the second preferred communication path information is selected as the replacement communication path to transmit the data, thus ensuring the stability and reliability of the data transmission.

[0127] Furthermore, when all communication paths are unavailable, the terminal will attempt to re-establish a communication connection, record the fault information in a log or notify the user through other available means. The system will also regularly detect the communication paths and restore the restored communication paths in a timely manner to ensure the continuity of communication. The embodiments of the present invention do not make any limitations.

[0128] It should be noted that the above-mentioned transmission and processing of audio data information and video data information by using the target communication path information is to first evenly distribute the first preferred communication path information in the target communication path information to the audio data information and the video data information, and then use the same method as the transmission and processing of the target segmentation data information by using the target communication path information to transmit the audio data information and the video data information. The embodiments of the present invention do not make any limitations.

[0129] It can be seen that implementing the hand-held terminal signal processing method described in the embodiments of the present invention is beneficial to improving the communication stability and reliability of the hand-held terminal in a complex environment, and further enhancing the practicality of the hand-held terminal in a complex environment.

[0130] Embodiment 2

[0131] Please refer to Figure 3 , Figure 3 which is a schematic structural diagram of a hand-held terminal signal processing device disclosed in the embodiments of the present invention. Among them, Figure 3 the described device can be applied to a management system, such as a local server or a cloud server for management, etc. The embodiments of the present invention do not make any limitations. As Figure 3 shown, the device may include:

[0132] An acquisition module 201, configured to acquire the data information to be transmitted and the alternative communication path information; the data information to be transmitted includes the data transmission type and the basic data information;

[0133] The first processing module 202 is configured to perform an optimization process on the alternative communication path information to obtain target communication path information; the target communication path information includes first target communication path information and / or second target communication path information; the first target communication path information includes at least one first optimized communication path information.

[0134] The second processing module 203 is configured to perform a transmission process on the data information to be transmitted by using the target communication path information to obtain target communication information.

[0135] It can be seen that implementing Figure 3 the described handheld terminal signal processing device is beneficial to improving the communication stability and reliability of the handheld terminal in a complex environment, and further enhancing the practicality of the handheld terminal in a complex environment.

[0136] In another alternative embodiment, as Figure 3 shown, the first processing module 202 performs an optimization process on the alternative communication path information to obtain target communication path information, including:

[0137] Performing a detection and evaluation process on the alternative communication path information by using a target detection and evaluation model to obtain first communication path information; the first communication path information includes at least one available communication path information.

[0138] Performing an allocation process on the first communication path information to obtain target communication path information.

[0139] It can be seen that implementing Figure 3 the described handheld terminal signal processing device is beneficial to improving the communication stability and reliability of the handheld terminal in a complex environment, and further enhancing the practicality of the handheld terminal in a complex environment.

[0140] In yet another alternative embodiment, as Figure 3 shown, the first processing module 202 performs an allocation process on the first communication path information to obtain target communication path information, including:

[0141] Performing a quantization process on the first communication path information to obtain communication path quantization information; the communication path quantization information includes at least one communication path quantization value information; the communication path quantization value information includes a first communication path quantization value and a second communication path quantization value.

[0142] Determining whether the data transmission type is a first transmission type to obtain a type determination result.

[0143] When the type determination result is yes, performing a calculation process on the communication path quantization information by using a first transmission calculation model to obtain communication path calculation value information; the communication path calculation value information includes at least one communication path calculation value.

[0144] Among them, the first transmission calculation model is as follows:

[0145] Calculated value of communication path = First calculation coefficient * First communication path quantization value + Second calculation coefficient * Second communication path quantization value; The first calculation coefficient is greater than the second calculation coefficient;

[0146] When the type judgment result is no, the second transmission calculation model is used to calculate and process the communication path quantization information to obtain the communication path calculated value information;

[0147] Among them, the second transmission calculation model is as follows:

[0148] Calculated value of communication path = Third calculation coefficient * First communication path quantization value + Fourth calculation coefficient * Second communication path quantization value; The fourth calculation coefficient is greater than the third calculation coefficient;

[0149] Based on the communication path calculated value information, the target communication path information is determined.

[0150] It can be seen that implementing Figure 3 The described handheld terminal signal processing device is beneficial to improving the communication stability and reliability of the handheld terminal in a complex environment, and thus enhancing the practicality of the handheld terminal in a complex environment.

[0151] In another optional embodiment, as Figure 3 shown, the first processing module 202 determines the target communication path information based on the communication path calculated value information, including:

[0152] Judge whether the number of calculated values of the communication path in the communication path calculated value information is greater than the number threshold to obtain a number judgment result;

[0153] When the number judgment result is no, the first communication path information is determined as the first target communication path information;

[0154] When the number judgment result is yes, obtain the path allocation ratio;

[0155] Perform calculation and allocation processing on the path allocation ratio and the communication path calculated value information to obtain the target communication path information.

[0156] It can be seen that implementing Figure 3 The described handheld terminal signal processing device is beneficial to improving the communication stability and reliability of the handheld terminal in a complex environment, and thus enhancing the practicality of the handheld terminal in a complex environment.

[0157] In another optional embodiment, as Figure 3 shown, the first processing module 202 performs calculation and allocation processing on the path allocation ratio and the communication path calculated value information to obtain the target communication path information, including:

[0158] Sort all the communication path calculation values in the communication path calculation value information in descending order according to the communication path calculation values, and obtain a communication path calculation value sequence;

[0159] Use the allocation calculation model to perform calculation processing on the number of communication path calculation values and the path allocation ratio to obtain an allocation value;

[0160] Among them, the allocation calculation model is:

[0161]

[0162] Take the first N communication path calculation values in the front of the communication path calculation value sequence as the first target communication path values, and take the communication path calculation values corresponding to the non-first target communication path values in the communication path calculation value sequence as the second target communication path values; N is the allocation value;

[0163] Take the available communication path information corresponding to the first target communication path value as the first preferred communication path information in the first target communication path information;

[0164] Take the available communication path information corresponding to the second target communication path value as the second preferred communication path information in the second target communication path information.

[0165] It can be seen that implementing Figure 3 the described handheld terminal signal processing device is beneficial to improving the communication stability and reliability of the handheld terminal in a complex environment, and further improving the practicability of the handheld terminal in a complex environment.

[0166] In another optional embodiment, as Figure 3 shown, the target detection and evaluation model includes a first convolutional module, a second convolutional module, a first pooling module, a second pooling module, a first regularization module, a second regularization module, a first network module, an attention module, a first connection module, a second connection module, and a third connection module; among them,

[0167] The input end of the first convolution module is configured to receive the model input information of the target detection evaluation model, and the output end of the first convolution module is connected to the input end of the first pooling module; the output end of the first pooling module is connected to the input end of the second convolution module; the output end of the second convolution module is connected to the input end of the second pooling module; the output end of the second pooling module is connected to the input end of the first connection module; the output end of the first connection module is connected to the input end of the second connection module; the output end of the second connection module is connected to the input end of the first regularization module; the output of the first regularization module is connected to the input end of the first network module; the output end of the first network module is connected to the input end of the second regularization module; the output end of the second regularization module is connected to the input end of the attention module; the output end of the attention module is connected to the input end of the third connection module; the output end of the third connection module is configured to output the model output information of the target detection evaluation model.

[0168] It can be seen that implementing Figure 3 the described handheld terminal signal processing device is conducive to improving the communication stability and reliability of the handheld terminal in a complex environment, and thus enhancing the practicality of the handheld terminal in a complex environment.

[0169] In another optional embodiment, as Figure 3 shown, the second processing module 203 performs transmission processing on the data information to be transmitted by using the target communication path information, and obtains the target communication information, including:

[0170] Judging whether the basic data information in the data information to be transmitted is audio-visual data, and obtaining a data judgment result;

[0171] When the data judgment result is yes, performing audio-visual separation processing on the basic data information to obtain audio data information and video data information;

[0172] Performing transmission processing on the audio data information and the video data information by using the target communication path information to obtain target audio information and target video information;

[0173] Performing fusion processing on the target audio information and the target video information to obtain the target communication information;

[0174] When the data judgment result is no, performing segmentation processing on the basic data information to obtain target segmentation data information;

[0175] Performing transmission processing on the target segmentation data information by using the target communication path information to obtain the target communication information.

[0176] It can be seen that implementing Figure 3 the described handheld terminal signal processing device is conducive to improving the communication stability and reliability of the handheld terminal in a complex environment, and thus enhancing the practicality of the handheld terminal in a complex environment.

[0177] Embodiment III

[0178] Please refer to Figure 4 , Figure 4 which is a schematic structural diagram of another signal processing device for a handheld terminal disclosed in an embodiment of the present invention. Among them, Figure 4 the described device can be applied to a management system, such as a local server or a cloud server for management, etc., which is not limited in the embodiments of the present invention. As Figure 4 shown, the device may include:

[0179] A memory 301 storing executable program code;

[0180] A processor 302 coupled to the memory 301;

[0181] The processor 302 calls the executable program code stored in the memory 301 to execute the steps in the handheld terminal signal processing method described in Embodiment I.

[0182] Embodiment IV

[0183] An embodiment of the present invention discloses a computer-readable storage medium, which stores a computer program for electronic data exchange, wherein the computer program causes a computer to execute the steps in the handheld terminal signal processing method described in Embodiment I.

[0184] Embodiment V

[0185] An embodiment of the present invention discloses a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute the steps in the handheld terminal signal processing method described in Embodiment I.

[0186] The device embodiments described above are only illustrative. The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical modules, that is, they may be located in one place, or may be distributed to multiple network modules. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art can understand and implement it without creative efforts.

[0187] Through the specific descriptions of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on such an understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, and the storage medium includes read-only memory (ROM), random access memory (RAM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), one-time programmable read-only memory (OTPROM), electrically-erasable programmable read-only memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc memories, magnetic disk memories, tape memories, or any other computer-readable medium capable of carrying or storing data.

[0188] Finally, it should be noted that: What is disclosed in an embodiment of a signal processing method and device for a handheld terminal of the present invention is only a preferred embodiment of the present invention, and is only used to illustrate the technical solution of the present invention, rather than limiting it; Although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: They can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements on some of the technical features; And these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A handheld terminal signal processing method, characterized in that: The method comprises: Acquiring data information to be transmitted and alternative communication path information; the data information to be transmitted includes a data transmission type and basic data information; performing optimal processing on the candidate communication path information to obtain target communication path information; the target communication path information includes first target communication path information and / or second target communication path information; the first target communication path information includes at least one first optimal communication path information; performing transmission processing on the data information to be transmitted using the target communication path information to obtain target communication information; The step of performing optimal processing on the candidate communication path information to obtain target communication path information includes: Performing detection and evaluation processing on the candidate communication path information using a target detection and evaluation model to obtain first communication path information; the first communication path information includes at least one available communication path information; performing distribution processing on the first communication path information to obtain target communication path information; The step of allocating and processing the first communication path information to obtain target communication path information includes: quantizing the first communication path information to obtain communication path quantization information; the communication path quantization information includes at least one communication path quantization value information; the communication path quantization value information includes a first communication path quantization value and a second communication path quantization value; Determine whether the data transmission type is the first transmission type, and obtain a type determination result; When the type determination result is yes, the communication path quantification information is calculated and processed using a first transmission calculation model to obtain communication path calculation value information; the communication path calculation value information includes at least one communication path calculation value; The first transmission calculation model is: Communication path calculation value = first calculation coefficient * first communication path quantization value + second calculation coefficient * second communication path quantization value; the first calculation coefficient is greater than the second calculation coefficient; When the type determination result is no, calculating and processing the communication path quantification information using a second transmission calculation model to obtain the communication path calculation value information; The second transmission calculation model is: Communication path calculation value = third calculation coefficient * first communication path quantization value + fourth calculation coefficient * second communication path quantization value; the fourth calculation coefficient is greater than the third calculation coefficient; Based on the communication path calculation value information, target communication path information is determined.

2. The handheld terminal signal processing method according to claim 1, characterized in that: The determining target communication path information based on the communication path calculated value information includes: determining whether the number of the communication path calculation values in the communication path calculation value information is greater than a number threshold, and obtaining a number determination result; When the result of the quantity determination is negative, determining the first communication path information as the first target communication path information; When the result of the quantity determination is yes, obtaining a channel allocation ratio; The path allocation ratio and the communication path calculated value information are subjected to calculation and allocation processing to obtain target communication path information.

3. The handheld terminal signal processing method according to claim 2, characterized in that: The step of calculating and allocating the path allocation ratio and the communication path calculated value information to obtain target communication path information includes: sorting all the communication path calculation values in the communication path calculation value information from largest to smallest according to the communication path calculation values to obtain a communication path calculation value sequence; Calculating the number of communication path calculation values and the path allocation ratio using an allocation calculation model to obtain an allocation value; Wherein, the allocation calculation model is: The first N communication path calculation values in the communication path calculation value sequence are used as first target communication path values, and the communication path calculation values in the communication path calculation value sequence that do not correspond to the first target communication path values are used as second target communication path values; N is the allocated value; using the available communication path information corresponding to the first target communication path value as the first preferred communication path information in the first target communication path information; The available communication path information corresponding to the second target communication path value is used as the second preferred communication path information in the second target communication path information.

4. The handheld terminal signal processing method according to claim 1, wherein: The target detection evaluation model includes a first convolution module, a second convolution module, a first pooling module, a second pooling module, a first regularization module, a second regularization module, a first network module, an attention module, a first connection module, a second connection module and a third connection module; wherein, The input end of the first convolution module is configured to receive the model input information of the target detection evaluation model, the output end of the first convolution module is connected to the input end of the first pooling module; the output end of the first pooling module is connected to the input end of the second convolution module; the output end of the second convolution module is connected to the input end of the second pooling module; the output end of the second pooling module is connected to the input end of the first connection module; the output end of the first connection module is connected to the input end of the second connection module; the output end of the second connection module is connected to the input end of the first regularization module; the output of the first regularization module is connected to the input end of the first network module; the output end of the first network module is connected to the input end of the second regularization module; the output end of the second regularization module is connected to the input end of the attention module; the output end of the attention module is connected to the input end of the third connection module; the output end of the third connection module is configured to output the model output information of the target detection evaluation model.

5. The handheld terminal signal processing method according to claim 1, wherein: The step of performing transmission processing on the data information to be transmitted by utilizing the target communication path information to obtain target communication information includes: Determining whether the basic data information in the data information to be transmitted is audio or video data, and obtaining a data determination result; When the data judgment result is yes, performing audio and video separation processing on the basic data information to obtain audio data information and video data information; Using the target communication path information to transmit and process the audio data information and the video data information to obtain target audio information and target video information; fusing the target audio information and the target video information to obtain target communication information; When the data judgment result is no, segmenting the basic data information to obtain target segmented data information; The target segmented data information is transmitted and processed using the target communication path information to obtain target communication information.

6. A handheld terminal signal processing device, characterized in that: The device comprises: An acquisition module, configured to acquire information about data to be transmitted and information about an alternative communication path; the information about data to be transmitted includes a data transmission type and basic data information; a first processing module configured to perform optimal processing on the candidate communication path information to obtain target communication path information; the target communication path information includes first target communication path information and / or second target communication path information; the first target communication path information includes at least one first optimal communication path information; A second processing module is configured to perform transmission processing on the data information to be transmitted using the target communication path information to obtain target communication information; The step of performing optimal processing on the candidate communication path information to obtain target communication path information includes: Performing detection and evaluation processing on the candidate communication path information using a target detection and evaluation model to obtain first communication path information; the first communication path information includes at least one available communication path information; performing distribution processing on the first communication path information to obtain target communication path information; The step of allocating and processing the first communication path information to obtain target communication path information includes: quantizing the first communication path information to obtain communication path quantization information; the communication path quantization information includes at least one communication path quantization value information; the communication path quantization value information includes a first communication path quantization value and a second communication path quantization value; Determine whether the data transmission type is the first transmission type, and obtain a type determination result; When the type determination result is yes, the communication path quantification information is calculated and processed using a first transmission calculation model to obtain communication path calculation value information; the communication path calculation value information includes at least one communication path calculation value; The first transmission calculation model is: Communication path calculation value = first calculation coefficient * first communication path quantization value + second calculation coefficient * second communication path quantization value; the first calculation coefficient is greater than the second calculation coefficient; When the type determination result is no, calculating and processing the communication path quantification information using a second transmission calculation model to obtain the communication path calculation value information; The second transmission calculation model is: Communication path calculation value = third calculation coefficient * first communication path quantization value + fourth calculation coefficient * second communication path quantization value; the fourth calculation coefficient is greater than the third calculation coefficient; Based on the communication path calculation value information, target communication path information is determined.

7. A handheld terminal signal processing device, characterized in that: The device comprises: a memory storing executable program code; a processor coupled to the memory; The processor calls the executable program code stored in the memory to execute the handheld terminal signal processing method according to any one of claims 1 to 5.

8. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer instructions, and when the computer instructions are called, they are used to execute the handheld terminal signal processing method according to any one of claims 1 to 5.

Images