Experiment operation picture coding and decoding transmission method and device, equipment and storage medium
By using a redundancy removal matrix and mapping table to encode and decode the experimental screen, the problem of data transmission delay in remote network experiments was solved, achieving synchronization and timeliness of data and screen, and improving the experimental operation experience.
Patent Information
- Application Number
- CN202511786718.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-12-01
- Publication Date
- 2026-02-10
AI Technical Summary
In existing network-based remote experiment solutions, unstable data transmission leads to high latency and poor interactivity, affecting students' experimental experience. In particular, the latency problem still exists when multiple users are operating the experiment.
A redundancy removal matrix is used to remove redundancy from the experimental screen, a mapping table is used for data mapping, and encoding is performed based on the transmission and reception delay to optimize the data transmission rate and achieve synchronization and timeliness between data and screen.
By eliminating redundancy, mapping, and encoding, the data transmission speed was optimized, and the synchronicity and quality of the experimental operation were improved.
Smart Images
Figure CN121509404A_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of data coding and decoding transmission, and particularly relates to an experimental operation picture coding and decoding transmission method, device, equipment and storage medium. BACKGROUND
[0002] Network remote control of real physical experiment equipment and high-fidelity virtual physical experiment equipment is a new type of experimental tool developed relying on technologies such as Internet of Things, cloud computing and simulation, and is widely used in fields such as education and scientific research, and can break through the time and space limitations of traditional experiments. The following are detailed introductions of the two: Network remote control of real physical experiment equipment This type of equipment is to connect real physical experiment instruments to the network, and users send instructions through remote terminals to realize operation, and is matched with cameras and data acquisition modules to synchronously obtain experimental phenomena and data, and is commonly used in physical teaching scenes in middle schools and universities. For example, the remote numerical control reading microscope experiment instrument of Yueguang Intelligence can enable users to remotely carry out high-precision observation experiments, and the equipment has functions such as soft limit and power failure protection, which can avoid damage to the instrument due to remote operation errors; the self-induction phenomenon remote experiment platform developed by LabVIEW integrates data acquisition equipment, relay modules and high-definition cameras, and after students remotely send circuit on-off instructions, they can see the light bulb on-off phenomenon in real time, and obtain voltage and current change curves. In addition, the thermoelectric sensor remote experiment device for MOOCs can support users to remotely complete characteristic research experiments of various thermoelectric sensors such as platinum resistance and thermocouple.
[0003] Network remote control of high-fidelity virtual physical experiment equipment This type of equipment is built based on professional simulation software, and restores the appearance, operation logic and experimental phenomena of real experiment instruments in a digital form, with extremely small errors, and users can remotely access and operate through a webpage or a client, and is mainly used for experimental teaching of circuits and electromagnetism. For example, the signal and system virtual experiment platform built based on LabVIEW and Multisim enables students to remotely adjust resistance and capacitance parameters in a circuit, and can observe the difference between undistorted transmission waveforms and distorted waveforms in real time; the Internet + remote virtual-real integrated electronic technology experiment system of Beijing Gexin Exhibition has instruments such as virtual oscilloscopes and logic analyzers built-in, and users can remotely design circuit schematics and load application software, and synchronously view running results of digital and analog signals.
[0004] Existing network environment data transmission has high instability, which leads to high delay and poor interactivity of remote experiment schemes, and picture transmission delay greatly limits the experience of students using experiment equipment. In some methods, the problem of data transmission is solved by priority scheduling, however, these methods still have many delay problems when multiple students operate at the same time.
[0005] Therefore, it is necessary to develop and design an experimental operation screen encoding, decoding and transmission method. Summary of the Invention
[0006] The present invention provides a method, apparatus, device and storage medium for encoding, decoding and transmitting experimental operation screens, which solves the problem that data transmission delay affects the remote operation experimental experience in the prior art.
[0007] In a first aspect, embodiments of the present invention provide a method for encoding, decoding, and transmitting experimental operation screens, including: Acquire a first interactive data segment and a first experimental screen, wherein the first interactive data segment and the first experimental screen correspond to the same time period; The first experimental screen is deredundant row by row or column by column using a redundancy removal matrix to obtain the second data block; The first interactive data segment and the second data block are mapped according to the mapping table to obtain the second data segment and the third data block; The third data block is encoded based on the transmission and reception delay, and the second data segment and the encoded data block are then sent.
[0008] In one possible implementation, the redundancy removal matrix is constructed based on a plurality of first history vectors, including: Multiple first historical vectors and multiple first matrices are obtained, wherein the first historical vectors are constructed based on data extracted by row or column from the first historical experimental screen; For each first matrix, the plurality of first historical vectors are transformed according to the first formula, and the resulting plurality of second historical vectors are used to construct a reconstructed dataset, wherein the first formula is:
[0009] In the formula, As the second history vector, As the first historical vector, This is the first matrix; For each first matrix, the reconstruction bias is calculated based on the plurality of first historical vectors and the plurality of vectors in the corresponding reconstructed dataset; If the minimum reconstruction deviation is greater than the reconstruction deviation threshold, then the multiple first matrices are adjusted according to the multiple reconstruction deviations, and the process jumps to the step of transforming the multiple first historical vectors according to the first formula for each first matrix. Otherwise, the first matrix corresponding to the smallest reconstruction deviation is used as the redundancy removal matrix.
[0010] In one possible implementation, calculating the reconstruction bias for each first matrix based on the plurality of first historical vectors and the corresponding vectors in the reconstructed dataset includes: The reconstruction deviation is determined according to the second formula, whereby the second formula is:
[0011] In the formula, For the first A first historical vector, For the first A second historical vector, The total number of first history vectors, This is for reconstruction deviation; The adjustment of the plurality of first matrices based on multiple reconstruction deviations includes: Add each reconstruction deviation to the deviation array corresponding to the first matrix; Find the reconstruction deviation with the smallest value in each deviation array, and take the first historical matrix corresponding to the found reconstruction deviation as the process optimal matrix; The first matrix corresponding to the minimum value among the multiple reconstruction deviations is taken as the current optimal matrix; For each first matrix, adjustments are made based on the process-optimal matrix, the current optimal matrix, and the third formula, wherein the third formula is:
[0012] In the formula, For the adjusted number The first matrix Line number Column elements, For the first time before the adjustment The first matrix Line number Column elements, The process optimal matrix is the first... Line number Column elements, As the first coefficient, The current optimal matrix is the first... Line number Column elements, This is the second coefficient.
[0013] In one possible implementation, the mapping table is constructed based on multiple first historical data sets, including: Multiple first historical data points were acquired, with the first historical data obtained based on the experimental footage; Calculate the frequency of each historical data point appearing in the multiple first historical data points; Mapping data is assigned to each historical data point based on its frequency of occurrence, wherein the data space occupied by the mapping data is negatively correlated with the frequency of occurrence of the historical data in the plurality of first historical data points.
[0014] In one possible implementation, the step of encoding the third data block according to the transmission and reception delay, and then sending the second data segment and the encoded data block, includes: Extract the first timestamp from the first interactive data segment, wherein the first timestamp represents the moment when the previously sent data packet was received; The transmit / receive time difference is determined based on the first timestamp and the second timestamp, wherein the second timestamp represents the moment when the previous data packet was sent; The ratio of the size of the previously sent data packet to the time difference between transmission and reception is used as the transmission rate; The size of the encoded data block is determined by the product of the transmit / receive time difference threshold and the transmission rate; The third data block is encoded according to the size of the encoded data block to obtain a fourth data block and a first coding rate, wherein the first coding rate is the ratio of encoding the third data block into the fourth data block; The current timestamp, the fourth data block, the second data segment, and the first coding rate are packaged and sent.
[0015] In one possible implementation, encoding the third data block according to the size of the encoded data block to obtain the fourth data block and the first coding rate includes: Obtain the second coding rate; The second coding rate is multiplied by the number of rows and the number of columns of the third data block to obtain the number of first rows and the number of first columns; The elements of the fourth data block are generated based on the first row number, the first column number, and the fourth formula, wherein the fourth formula is:
[0016] In the formula, For the fourth data block Line number Column elements, This represents the row number of the third data block. The column number of the third data block. For the third data block Line number The data in the column, It is a natural constant. Pi The imaginary unit; If the size deviation between the fourth data block and the encoded data block is greater than the deviation threshold, then the second coding rate is incremented, and the process jumps to the step of multiplying the second coding rate by the number of rows and the number of columns of the third data block to obtain the number of rows and the number of columns. The second coding rate is used as the first coding rate.
[0017] Secondly, embodiments of the present invention provide a method for decoding and transmitting experimental operation screens, including: Obtain the first data packet; The first data packet is parsed to obtain the fourth data block, the second data segment, and the first coding rate; The fourth data block is parsed according to the first coding rate to obtain the third data block; The third data block and the second data segment are reverse-mapped according to the mapping table to obtain the second data block and the first interactive data segment. The second data block is inversely transformed according to the redundancy removal matrix to obtain the first experimental screen. The step of parsing the fourth data block according to the first coding rate to obtain the third data block includes: The fourth data block is parsed according to the fifth formula and the first coding rate to obtain the third data block, wherein the fifth formula is:
[0018] In the formula, For the third data block Line number The data in the column, For the fourth data block Line number Column elements, This is the row number of the fourth data block. This is the column number of the fourth data block. This represents the row number of the third data block. The column number of the third data block. It is a natural constant. Pi The imaginary unit, This is the first coding rate.
[0019] Thirdly, embodiments of the present invention provide an experimental operation screen encoding and transmission apparatus for implementing the experimental operation screen encoding and decoding transmission method as described in the first aspect or any possible implementation thereof, the experimental operation screen encoding and transmission apparatus comprising: The experimental operation screen acquisition module is used to acquire a first interactive data segment and a first experimental screen, wherein the first interactive data segment and the first experimental screen correspond to the same time period; The redundancy removal module is used to perform redundancy removal operations on the first experimental screen row by row or column by column using a redundancy removal matrix to obtain the second data block; The data mapping module is used to map the first interactive data segment and the second data block according to the mapping table to obtain the second data segment and the third data block respectively. as well as, The encoding and transmission module is used to encode the third data block according to the transmission and reception delay, and to transmit the second data segment and the encoded data block.
[0020] Fourthly, embodiments of the present invention provide an electronic device, including a memory and a processor, wherein the memory stores a computer program executable on the processor, and the processor executes the computer program to implement the steps of the method as described in the first aspect or any possible implementation of the first aspect.
[0021] Fifthly, embodiments of the present invention provide a computer-readable storage medium storing a computer program that, when executed by a processor, implements the steps of the method as described in the first aspect or any possible implementation thereof.
[0022] The beneficial effects of the embodiments of the present invention compared with the prior art are: This invention discloses a method for encoding, decoding, and transmitting experimental operation screens. First, a first interactive data segment and a first experimental screen are acquired, wherein the first interactive data segment and the first experimental screen correspond to the same time period. Then, a redundancy removal matrix is used to remove redundancy from the first experimental screen row by row or column by column to obtain a second data block. Next, the first interactive data segment and the second data block are mapped according to a mapping table to obtain a second data segment and a third data block. Finally, the third data block is encoded according to the transmission and reception delay, and the second data segment and the encoded data block are transmitted. This invention encodes the experimental screen through redundancy removal, mapping table mapping, and encoding to obtain data adapted to the data transmission rate, ensuring the timeliness of data transmission. Furthermore, because the operation data undergoes both mapping table mapping and data transmission simultaneously, the data and screen synchronization is good, optimizing the experimental operation experience. Attached Figure Description
[0023] To more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0024] Figure 1 This is a flowchart of the experimental operation screen encoding, decoding and transmission method provided in the embodiments of the present invention; Figure 2 This is a schematic diagram of the redundancy removal matrix construction process provided by the embodiments of the present invention; Figure 3 This is a functional block diagram of the experimental operation screen encoding and transmission device provided in the embodiments of the present invention; Figure 4 This is a functional block diagram of an electronic device provided in an embodiment of the present invention. Detailed Implementation
[0025] In the following description, specific details such as particular system structures and techniques are set forth for illustrative purposes and not for limitation, so as to provide a thorough understanding of embodiments of the invention. However, those skilled in the art will understand that the invention can be implemented in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, apparatuses, and methods are omitted so as not to obscure the description of the invention with unnecessary detail.
[0026] To make the objectives, technical solutions, and advantages of the present invention clearer, specific embodiments will be described below in conjunction with the accompanying drawings.
[0027] The embodiments of the present invention will be described in detail below. This example is implemented based on the technical solution of the present invention, and provides detailed implementation methods and specific operation processes. However, the protection scope of the present invention is not limited to the following embodiments.
[0028] Figure 1 A flowchart of the experimental operation screen encoding, decoding and transmission method provided for embodiments of the present invention.
[0029] like Figure 1 As shown, a flowchart illustrating the implementation of the experimental operation screen encoding / decoding transmission method provided in the first aspect of the present invention is illustrated, and is described in detail below: In step 101, a first interactive data segment and a first experimental screen are acquired, wherein the first interactive data segment and the first experimental screen correspond to the same time period.
[0030] In step 102, a redundancy removal matrix is used to perform redundancy removal operation on the first experimental screen row by row or column by column to obtain the second data block.
[0031] In some implementations, the redundancy removal matrix is constructed based on a plurality of first history vectors, including: Multiple first historical vectors and multiple first matrices are obtained, wherein the first historical vectors are constructed based on data extracted by row or column from the first historical experimental screen; For each first matrix, the plurality of first historical vectors are transformed according to the first formula, and the resulting plurality of second historical vectors are used to construct a reconstructed dataset, wherein the first formula is:
[0032] In the formula, As the second history vector, As the first historical vector, This is the first matrix; For each first matrix, the reconstruction bias is calculated based on the plurality of first historical vectors and the plurality of vectors in the corresponding reconstructed dataset; If the minimum reconstruction deviation is greater than the reconstruction deviation threshold, then the multiple first matrices are adjusted according to the multiple reconstruction deviations, and the process jumps to the step of transforming the multiple first historical vectors according to the first formula for each first matrix. Otherwise, the first matrix corresponding to the smallest reconstruction deviation is used as the redundancy removal matrix.
[0033] In some implementations, calculating the reconstruction bias for each first matrix based on the plurality of first historical vectors and the corresponding vectors in the reconstructed dataset includes: The reconstruction deviation is determined according to the second formula, whereby the second formula is:
[0034] In the formula, For the first A first historical vector, For the first A second historical vector, The total number of first history vectors, This is for reconstruction deviation; The adjustment of the plurality of first matrices based on multiple reconstruction deviations includes: Add each reconstruction deviation to the deviation array corresponding to the first matrix; Find the reconstruction deviation with the smallest value in each deviation array, and take the first historical matrix corresponding to the found reconstruction deviation as the process optimal matrix; The first matrix corresponding to the minimum value among the multiple reconstruction deviations is taken as the current optimal matrix; For each first matrix, adjustments are made based on the process-optimal matrix, the current optimal matrix, and the third formula, wherein the third formula is:
[0035] In the formula, For the adjusted number The first matrix Line number Column elements, For the first time before the adjustment The first matrix Line number Column elements, The process optimal matrix is the first... Line number Column elements, As the first coefficient, The current optimal matrix is the first... Line number Column elements, This is the second coefficient.
[0036] For example, the present invention aims to provide a method for encoding and packaging experimental interactive data and experimental screen data for transmission, so as to achieve synchronization of interactive data and screen data, and adapt data packets according to the network environment to optimize data transmission speed and improve the user experience.
[0037] To achieve the above objectives, the present invention first performs a redundancy removal operation on the first experimental screen, and the resulting second data block is mapped to the first interactive data through a data mapping table into data with a smaller data size: the third data block and the second data segment. Finally, the third data block is encoded, and the resulting encoded data is sent synchronously with the second data segment.
[0038] In this process, since the image data is typically large, it is a crucial factor affecting real-time performance. Therefore, this invention performs encoding processing based on the transmission and reception latency to achieve higher real-time performance. Interactive data, such as operation commands or returned response data, usually cannot be compressed or deconstructed without loss of accuracy. Therefore, this invention uses data mapping to ensure the accuracy of the reconstructed data.
[0039] Regarding redundancy removal, this invention extracts data row by row or column by column to form vectors for the first experimental screen, and uses a redundancy removal matrix to remove redundant terms. In one scenario, the following formula is applied:
[0040] In the above formula, E is the vector after redundancy removal, D is the vector constructed based on the extracted data, and F is the redundancy removal matrix.
[0041] The redundancy removal matrix needs to ensure the recoverability and accuracy of the removed data, which is generally achieved through the following equation:
[0042] In the above formula, Let be the restored vector of D.
[0043] We can see that the redundancy removal matrix plays a crucial role in this process.
[0044] In fact, this matrix is constructed from multiple first historical vectors extracted from the first historical experimental footage. During construction, multiple first matrices are first initialized, and each matrix is used to reconstruct and transform the multiple first historical vectors, as expressed by the formula:
[0045] In the formula, As the second history vector, As the first historical vector, This is the first matrix.
[0046] In other words, each first matrix will reconstruct multiple second history vectors, and these second history vectors will be used to calculate the reconstruction bias using the second formula:
[0047] In the formula, For the first A first historical vector, For the first A second historical vector, The total number of first history vectors, This is a reconstruction deviation.
[0048] In fact, the reconstruction deviation reflects the accuracy of the data restored by the first matrix.
[0049] If there is a first matrix among the reconstruction deviations of multiple first matrices that is less than the reconstruction deviation threshold, then the first matrix with the smallest reconstruction deviation can be used as the redundancy removal matrix.
[0050] Otherwise, each reconstruction deviation is added to the deviation array corresponding to the first matrix, and the reconstruction deviation with the smallest value is found from each deviation array. The historical first matrix corresponding to the found reconstruction deviation is taken as the process optimal matrix. Then, the first matrix corresponding to the minimum value among multiple reconstruction deviations is taken as the current optimal matrix.
[0051] Finally, for each first matrix, adjustments are made based on the process-optimal matrix, the current-optimal matrix, and the third formula, where the third formula is:
[0052] In the formula, For the adjusted number The first matrix Line number Column elements, For the first time before the adjustment The first matrix Line number Column elements, The process optimal matrix is the first... Line number Column elements, As the first coefficient, The current optimal matrix is the first... Line number Column elements, This is the second coefficient.
[0053] After the adjustment is complete, repeat the process of data reconstruction using the first matrix.
[0054] After multiple iterations, a matrix that can guarantee data restoration accuracy can be obtained.
[0055] In step 103, the first interactive data segment and the second data block are mapped according to the mapping table to obtain the second data segment and the third data block.
[0056] In some implementations, the mapping table is constructed based on multiple first historical data, including: Multiple first historical data points were acquired, with the first historical data obtained based on the experimental footage; Calculate the frequency of each historical data point appearing in the multiple first historical data points; Mapping data is assigned to each historical data point based on its frequency of occurrence, wherein the data space occupied by the mapping data is negatively correlated with the frequency of occurrence of the historical data in the plurality of first historical data points.
[0057] For example, the present invention maps the first interactive data and the second data block obtained by the aforementioned process. The purpose is to represent data that occurs more frequently using shorter mapped data, thereby saving space. For example, the mapped data is divided into 1-byte, 2-byte, 3-byte, and 4-byte data. The data that occurs most frequently is mapped using 1-byte data, while the data with the lowest repetition rate is mapped using 4-byte data or represented by the data itself. In this way, the space occupied by the data will be reduced to a certain extent. Since the data is compressed using a mapping method, the operation speed is also faster, and the data can be restored 100% through the mapping table.
[0058] The frequency of data occurrence is obtained through statistics from the first historical data. Mapping data is assigned to the data based on the frequency to form a data mapping table.
[0059] In step 104, the third data block is encoded according to the transmission and reception delay, and the second data segment and the encoded data block are sent.
[0060] In some implementations, the step of encoding the third data block according to the transmission and reception delay, and then sending the second data segment and the encoded data block, includes: Extract the first timestamp from the first interactive data segment, wherein the first timestamp represents the moment when the previously sent data packet was received; The transmit / receive time difference is determined based on the first timestamp and the second timestamp, wherein the second timestamp represents the moment when the previous data packet was sent; The ratio of the size of the previously sent data packet to the time difference between transmission and reception is used as the transmission rate; The size of the encoded data block is determined by the product of the transmit / receive time difference threshold and the transmission rate; The third data block is encoded according to the size of the encoded data block to obtain a fourth data block and a first coding rate, wherein the first coding rate is the ratio of encoding the third data block into the fourth data block; The current timestamp, the fourth data block, the second data segment, and the first coding rate are packaged and sent.
[0061] In some implementations, encoding the third data block according to the size of the encoded data block to obtain the fourth data block and the first coding rate includes: Obtain the second coding rate; The second coding rate is multiplied by the number of rows and the number of columns of the third data block to obtain the number of first rows and the number of first columns; The elements of the fourth data block are generated based on the first row number, the first column number, and the fourth formula, wherein the fourth formula is:
[0062] In the formula, For the fourth data block Line number Column elements, This represents the row number of the third data block. The column number of the third data block. For the third data block Line number The data in the column, It is a natural constant. Pi The imaginary unit; If the size deviation between the fourth data block and the encoded data block is greater than the deviation threshold, then the second coding rate is incremented, and the process jumps to the step of multiplying the second coding rate by the number of rows and the number of columns of the third data block to obtain the number of rows and the number of columns. The second coding rate is used as the first coding rate.
[0063] For example, the first experimental screen in the aforementioned step is converted into a third data block. As mentioned above, the third data block, as the main body of data transmission, will be compressed with variable encoding rate in combination with latency to optimize the user experience.
[0064] Specifically, the first time stamp is the moment when the previously sent data packet was received, which is the first timestamp, is extracted from the first interactive data segment. Then, the transmission and reception time difference is determined based on the first timestamp and the second timestamp when the previously sent data packet was sent.
[0065] Next, the ratio of the size of the previously sent data packet to the transmit / receive time difference is calculated; this ratio is the transmission rate. Multiplying the transmit / receive time difference threshold by the transmission rate yields the expected encoded data block size. Encoding the third data block according to the expected encoded data block size yields the fourth data block and the first coding rate, which is the ratio at which the third data block is encoded into the fourth data block.
[0066] When generating the fourth data block, the present invention first initializes a second coding rate, and then multiplies the second coding rate by the number of rows and the number of columns of the third data block to obtain the number of first rows and the number of first columns.
[0067] Then, the elements of the fourth data block are generated based on the first row number, the first column number, and the fourth formula, wherein the fourth formula is:
[0068] In the formula, For the fourth data block Line number Column elements, This represents the row number of the third data block. The column number of the third data block. For the third data block Line number The data in the column, It is a natural constant. Pi It is the imaginary unit.
[0069] The fourth data block should be slightly smaller than the expected size of the encoded data block. Therefore, after obtaining the fourth data block, the deviation between its size and the size of the encoded data block is calculated. If this deviation is greater than the deviation threshold, the second coding rate is incremented, and then the steps for generating the elements of the fourth data block are repeated.
[0070] After multiple iterations, a fourth data block slightly smaller than the expected encoded data block size can be obtained.
[0071] Once encoding is complete, the current timestamp, the fourth data block, the second data segment, and the first encoding rate can be packaged and sent.
[0072] A second aspect of the present invention provides a method for decoding and transmitting experimental operation screens, comprising: Obtain the first data packet generated according to the screen encoding and transmission method of the first aspect of the experiment; The first data packet is parsed to obtain the fourth data block, the second data segment, and the first coding rate; The fourth data block is parsed according to the first coding rate to obtain the third data block; The third data block and the second data segment are reverse-mapped according to the mapping table to obtain the second data block and the first interactive data segment. The second data block is inversely transformed according to the redundancy removal matrix to obtain the first experimental screen. The step of parsing the fourth data block according to the first coding rate to obtain the third data block includes: The fourth data block is parsed according to the fifth formula and the first coding rate to obtain the third data block, wherein the fifth formula is:
[0073] In the formula, For the third data block Line number The data in the column, For the fourth data block Line number Column elements, This is the row number of the fourth data block. This is the column number of the fourth data block. This represents the row number of the third data block. The column number of the third data block. It is a natural constant. Pi The imaginary unit, This is the first coding rate.
[0074] For example, for the experimental operation screen receiving end, after receiving the data packet generated by the first aspect, the data packet is first decomposed to obtain the fourth data block, the second data segment, and the first coding rate. Then, the fourth data block is parsed according to the first coding rate to obtain the third data block. Specifically, the fifth formula is applied:
[0075] In the formula, For the third data block Line number The data in the column, For the fourth data block Line number Column elements, This is the row number of the fourth data block. This is the column number of the fourth data block. This represents the row number of the third data block. The column number of the third data block. It is a natural constant. Pi The imaginary unit, This is the first coding rate.
[0076] The obtained third data block and second data segment are reverse mapped according to the mapping table to obtain the second data block and the first interactive data segment. Finally, the second data block is inversely transformed using the redundancy removal matrix to obtain the first experimental screen.
[0077] The present invention discloses an experimental operation screen encoding, decoding, and transmission method. First, it acquires a first interactive data segment and a first experimental screen, wherein the first interactive data segment and the first experimental screen correspond to the same time period. Then, it uses a redundancy removal matrix to perform redundancy removal operations row by row or column by column on the first experimental screen to obtain a second data block. Next, it maps the first interactive data segment and the second data block according to a mapping table to obtain a second data segment and a third data block. Finally, it encodes the third data block according to the transmission and reception delay, and then transmits the second data segment and the encoded data block. This invention encodes the experimental screen through redundancy removal, mapping table mapping, and encoding to obtain data adapted to the data transmission rate, ensuring the timeliness of data transmission. Furthermore, because the operation data undergoes both mapping table mapping and data transmission simultaneously, the data and screen synchronization is good, optimizing the experimental operation experience.
[0078] It should be understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.
[0079] The following are embodiments of the apparatus of the present invention. For details not described in detail, please refer to the corresponding method embodiments described above.
[0080] Figure 3 This is a functional block diagram of the experimental operation screen encoding and transmission device provided in the embodiments of the present invention, with reference to... Figure 3 The experimental operation screen encoding and transmission device includes: an experimental operation screen acquisition module 301, a redundancy removal module 302, a data mapping module 303, and an encoding and transmission module 304, wherein: The experimental operation screen acquisition module 301 is used to acquire a first interactive data segment and a first experimental screen, wherein the first interactive data segment and the first experimental screen correspond to the same time period; The redundancy removal module 302 is used to perform redundancy removal operation on the first experimental screen row by row or column by column using a redundancy removal matrix to obtain the second data block; The data mapping module 303 is used to map the first interactive data segment and the second data block according to the mapping table to obtain the second data segment and the third data block; as well as, The encoding and transmission module 304 is used to encode the third data block according to the transmission and reception delay, and to transmit the second data segment and the encoded data block.
[0081] Figure 4 This is a functional block diagram of the electronic device provided in an embodiment of the present invention. For example... Figure 4 As shown, the electronic device 4 of this embodiment includes a processor 400 and a memory 401, wherein the memory 401 stores a computer program 402 that can run on the processor 400. When the processor 400 executes the computer program 402, it implements the steps of the above-described experimental operation screen encoding / decoding transmission methods and embodiments, for example... Figure 1 Steps 101 to 104 are shown.
[0082] For example, the computer program 402 may be divided into one or more modules / units, which are stored in the memory 401 and executed by the processor 400 to complete the present invention.
[0083] The electronic device 4 can be a desktop computer, laptop, handheld computer, cloud server, or other computing device. The electronic device 4 may include, but is not limited to, a processor 400 and a memory 401. Those skilled in the art will understand that... Figure 4This is merely an example of electronic device 4 and does not constitute a limitation on electronic device 4. It may include more or fewer components than shown, or combine certain components, or different components. For example, electronic device 4 may also include input / output devices, network access devices, buses, etc.
[0084] The processor 400 may be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor.
[0085] The memory 401 can be an internal storage unit of the electronic device 4, such as a hard disk or memory. The memory 401 can also be an external storage device of the electronic device 4, such as a plug-in hard disk, Smart Media Card (SMC), Secure Digital (SD) card, or Flash Card. Furthermore, the memory 401 can include both internal and external storage units of the electronic device 4. The memory 401 is used to store the computer program 402 and other programs and data required by the electronic device 4. The memory 401 can also be used to temporarily store data that has been output or will be output.
[0086] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. Furthermore, the specific names of the functional units and modules are only for easy differentiation and are not intended to limit the scope of protection of this application. The specific working process of the units and modules in the above system can be referred to the corresponding process in the aforementioned method embodiments, and will not be repeated here.
[0087] In the above embodiments, the descriptions of each embodiment have their own emphasis. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.
[0088] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementations should not be considered beyond the scope of this invention.
[0089] In the embodiments provided by this invention, it should be understood that the disclosed devices / electronic devices and methods can be implemented in other ways. For example, the device / electronic device embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.
[0090] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment, depending on actual needs.
[0091] Furthermore, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.
[0092] If the integrated module / unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the above-described embodiments can also be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various methods and apparatus embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable medium can include: any entity or device capable of carrying the computer program code, a recording medium, a USB flash drive, a portable hard drive, a magnetic disk, an optical disk, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electrical carrier signal, a telecommunication signal, and a software distribution medium, etc.
[0093] The above-described embodiments are only used to illustrate the technical solutions of the present invention, and are not intended to limit them. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention, and should all be included within the protection scope of the present invention.
Claims
1. A method for encoding and transmitting experimental operation screens, characterized in that, include: Acquire a first interactive data segment and a first experimental screen, wherein the first interactive data segment and the first experimental screen correspond to the same time period; The first experimental screen is deredundant row by row or column by column using a redundancy removal matrix to obtain the second data block; The first interactive data segment and the second data block are mapped according to the mapping table to obtain the second data segment and the third data block; The third data block is encoded based on the transmission and reception delay, and the second data segment and the encoded data block are then sent.
2. The experimental operation screen encoding and transmission method according to claim 1, characterized in that, The redundancy removal matrix is constructed based on multiple first history vectors, including: Multiple first historical vectors and multiple first matrices are obtained, wherein the first historical vectors are constructed based on data extracted by row or column from the first historical experimental screen; For each first matrix, the plurality of first historical vectors are transformed according to the first formula, and the resulting plurality of second historical vectors are used to construct a reconstructed dataset, wherein the first formula is: In the formula, As the second history vector, As the first historical vector, This is the first matrix; For each first matrix, the reconstruction bias is calculated based on the plurality of first historical vectors and the plurality of vectors in the corresponding reconstructed dataset; If the minimum reconstruction deviation is greater than the reconstruction deviation threshold, then the multiple first matrices are adjusted according to the multiple reconstruction deviations, and the process jumps to the step of transforming the multiple first historical vectors according to the first formula for each first matrix. Otherwise, the first matrix corresponding to the smallest reconstruction deviation is used as the redundancy removal matrix.
3. The experimental operation screen encoding and transmission method according to claim 2, characterized in that, For each first matrix, the reconstruction bias is calculated based on the plurality of first historical vectors and the corresponding vectors in the reconstructed dataset, including: The reconstruction deviation is determined according to the second formula, whereby the second formula is: In the formula, For the first The first historical vector, For the first A second historical vector, The total number of first history vectors, This is a reconstruction deviation; The adjustment of the plurality of first matrices based on multiple reconstruction deviations includes: Add each reconstruction deviation to the deviation array corresponding to the first matrix; Find the reconstruction deviation with the smallest value in each deviation array, and take the first historical matrix corresponding to the found reconstruction deviation as the process optimal matrix; The first matrix corresponding to the minimum value among the multiple reconstruction deviations is taken as the current optimal matrix; For each first matrix, adjustments are made based on the process-optimal matrix, the current-optimal matrix, and the third formula, wherein the third formula is: In the formula, For the adjusted number The first matrix Line number Column elements, For the first time before the adjustment The first matrix Line number Column elements, The process optimal matrix is the first... Line number Column elements, As the first coefficient, The current optimal matrix is the first... Line number Column elements, This is the second coefficient.
4. The experimental operation screen encoding and transmission method according to claim 1, characterized in that, The mapping table is constructed based on multiple first historical data, including: Multiple first historical data points were acquired, with the first historical data points obtained based on the experimental footage; Calculate the frequency of each historical data point appearing in the multiple first historical data points; Mapping data is assigned to each historical data point based on its frequency of occurrence, wherein the data space occupied by the mapping data is negatively correlated with the frequency of occurrence of the historical data in the plurality of first historical data points.
5. The experimental operation screen encoding and transmission method according to any one of claims 1-4, characterized in that, The step of encoding the third data block according to the transmission and reception delay, and then sending the second data segment and the encoded data block, includes: Extract the first timestamp from the first interactive data segment, wherein the first timestamp represents the moment when the previously sent data packet was received; The transmit / receive time difference is determined based on the first timestamp and the second timestamp, wherein the second timestamp represents the moment when the previous data packet was sent; The ratio of the size of the previously sent data packet to the time difference between transmission and reception is used as the transmission rate; The size of the encoded data block is determined by the product of the transmit / receive time difference threshold and the transmission rate; The third data block is encoded according to the size of the encoded data block to obtain a fourth data block and a first coding rate, wherein the first coding rate is the ratio of encoding the third data block into the fourth data block; The current timestamp, the fourth data block, the second data segment, and the first coding rate are packaged and sent.
6. The experimental operation screen encoding and transmission method according to claim 5, characterized in that, The step of encoding the third data block according to the size of the encoded data block to obtain the fourth data block and the first coding rate includes: Obtain the second coding rate; The second coding rate is multiplied by the number of rows and the number of columns of the third data block to obtain the number of first rows and the number of first columns; The elements of the fourth data block are generated based on the first row number, the first column number, and the fourth formula, wherein the fourth formula is: In the formula, For the fourth data block Line number Column elements, This represents the row number of the third data block. The column number of the third data block. For the third data block Line number The data in the column, It is a natural constant. Pi The imaginary unit; If the size deviation between the fourth data block and the encoded data block is greater than the deviation threshold, then the second coding rate is incremented, and the process jumps to the step of multiplying the second coding rate by the number of rows and the number of columns of the third data block to obtain the number of rows and the number of columns. The second coding rate is used as the first coding rate.
7. A method for decoding and transmitting experimental operation screens, characterized in that, include: Obtain the first data packet generated by the experimental operation screen encoding and transmission method according to any one of claims 1-6; The first data packet is parsed to obtain the fourth data block, the second data segment, and the first coding rate; The fourth data block is parsed according to the first coding rate to obtain the third data block; The third data block and the second data segment are reverse-mapped according to the mapping table to obtain the second data block and the first interactive data segment. The second data block is inversely transformed according to the redundancy removal matrix to obtain the first experimental screen. The step of parsing the fourth data block according to the first coding rate to obtain the third data block includes: The fourth data block is parsed according to the fifth formula and the first coding rate to obtain the third data block, wherein the fifth formula is: In the formula, For the third data block Line number The data in the column, For the fourth data block Line number Column elements, This is the row number of the fourth data block. This is the column number of the fourth data block. This represents the row number of the third data block. The column number of the third data block. It is a natural constant. Pi The imaginary unit, This is the first coding rate.
8. An experimental operation screen encoding and transmission device, characterized in that, For implementing the experimental operation screen encoding / decoding and transmission method as described in any one of claims 1-6, the experimental operation screen encoding and transmission device comprises: The experimental operation screen acquisition module is used to acquire a first interactive data segment and a first experimental screen, wherein the first interactive data segment and the first experimental screen correspond to the same time period; The redundancy removal module is used to perform redundancy removal operations on the first experimental screen row by row or column by column using a redundancy removal matrix to obtain the second data block; The data mapping module is used to map the first interactive data segment and the second data block according to the mapping table to obtain the second data segment and the third data block respectively. as well as, The encoding and transmission module is used to encode the third data block according to the transmission and reception delay, and to transmit the second data segment and the encoded data block.
9. An electronic device comprising a memory and a processor, wherein the memory stores a computer program executable on the processor, characterized in that, When the processor executes the computer program, it implements the steps of the method as described in any one of claims 1 to 6 above.
10. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method as described in any one of claims 1 to 6 above.