Remote screen projection terminal control system and method of remote interaction interface

Abstract

The application discloses a remote screen projection terminal control system and method of a remote interactive interface, and relates to the technical field of electric digital data processing.The remote screen projection terminal control system of the remote interactive interface comprises an input response judgment module, a terminal response control module and a response feedback judgment module.The application judges whether to trigger the remote screen projection terminal response by combining the input interactive signal interference influence result, if the remote screen projection terminal response is not triggered, the input interactive signal transmission optimization adjustment is prompted to be executed, otherwise, the picture quality of the remote screen projection terminal in the remote screen projection terminal response process is evaluated, and whether to trigger the remote screen projection terminal response feedback is judged, the terminal picture quality control in the remote conference screen projection interactive process is realized more efficiently, and the problem that the terminal picture quality and the interactive signal interference difference correlation are insufficient in the screen projection interactive process of the remote conference is solved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of digital data processing, and particularly relates to a remote screen projection terminal control system and method of a remote interactive interface. BACKGROUND

[0002] With the continuous acceleration of digitalization, traditional office methods and meeting forms have gradually transitioned to online and remote. As an important tool for realizing remote control, communication and collaboration, the remote interactive interface undertakes the heavy task of improving meeting efficiency and enhancing communication effect. In this process, remote screen projection technology has become an important interactive way, which allows users to remotely operate devices and can share their operations, content and screens in real time with others. In remote meetings, remote screen projection terminal control is not just a simple content sharing, but also can provide more flexible and efficient interactive experience for participants. For example, in the process of resume screening, the employer can use remote screen projection technology to share the content of the individual's resume, analyze the candidate's information, and provide real-time feedback. In the practical application process of remote interactive interface and remote screen projection terminal control technology, although these technologies have played a positive role in promoting remote collaboration and improving work efficiency, there are still some problems. Although the existing remote interactive interface and screen projection technology can share screens, there may be deficiencies in interactivity, operation convenience and picture flexibility. Under the promotion of globalization, digitization and intelligentization, remote screen projection terminal control technology, as one of the digital collaboration tools, is increasingly becoming one of the key technologies for efficient interaction and cooperation of cross-regional teams, enterprises and individuals.

[0003] The existing remote screen projection terminal control implementation relies on the support of cloud computing, network technology, security guarantee, and virtualization and other key technologies. Through the integration of video conference platforms, remote desktop control, low-latency networks and encryption technologies, enterprises and teams can maintain efficient information sharing and decision-making capabilities in remote recruitment, interviews, cross-regional collaboration and other scenarios. Among them, the most core function of remote screen projection is real-time screen sharing. Common remote screen projection tools such as AirPlay (between Apple devices), Miracast (Windows and Android devices) and Google's Chromecast allow users to transmit local screen image data to remote devices for remote interaction through dedicated software or platforms.

[0004] For example, the patent application with publication number CN114237531A discloses a remote screen projection control method and system, which includes: establishing a connection between a master control device and one or more target controlled devices in a local area network; the master control device receives the screen projection information transmitted by the controlled device through the connection and displays the screen projection information in a window; the master control device monitors the input operation information of the screen projection interaction interface of all controlled devices and converts the information into control instructions; the control instructions are sent to the corresponding controlled device, and the controlled terminal device executes the corresponding operation according to the agreed instructions.

[0005] For example, the invention patent with publication number CN118819450B discloses a screen projection anti-control method, a screen projection system and a screen projection device, which includes: receiving anti-control information sent by a screen projection screen; according to the target type of the control operation, the anti-control information is packaged into an operation message supported by the kernel; the operation message is transmitted to the event node corresponding to the type of the control operation, and the operation message is converted into a control signal about the terminal device through the event node; the control signal is sent to the terminal device, so that the terminal device receives the control signal and executes the anti-control operation of the target type based on the position information.

[0006] However, in the process of implementing the technical scheme of the embodiments of the present application, it is found that the above-mentioned technology at least has the following technical problems:

[0007] In the process of remote screen projection, the video stream is usually compressed to save bandwidth. However, the compression process may cause loss of picture quality, such as blurring, pixelization, etc. In addition, remote screen projection depends on network transmission, if the network bandwidth is insufficient or the delay is too high, the picture quality will also be affected, and the picture may appear stuttering, distortion, frame dropping, etc., thereby affecting the control of the remote screen projection terminal.

[0008] It also needs to be considered that modern wireless devices usually operate in a shared spectrum resource environment, especially in a dense wireless environment, and the decline of interactive signal transmission quality will also affect remote screen projection, and there is a problem that the terminal picture quality and interactive signal interference difference are not fully related in the process of screen projection interaction in remote conference. SUMMARY

[0009] The embodiments of the present application provide a remote screen projection terminal control system and method of a remote interaction interface, which solves the problem that the terminal picture quality and interactive signal interference difference are not fully related in the process of screen projection interaction in remote conference in the prior art, and realizes more efficient terminal picture quality control in the process of screen projection interaction in remote conference.

[0010] The embodiment of the application provides a remote screen projection terminal control system of a remote interaction interface, comprising: an input response judgment module, a terminal response control module and a response feedback judgment module; the input response judgment module is used for evaluating the influence degree of spectrum overlap interference on the input interaction signal transmission process of a screen projection control terminal, and judging whether to trigger a remote screen projection terminal response in combination with the input interaction signal interference influence result; the terminal response control module is used for prompting to perform input interaction signal transmission optimization adjustment if the remote screen projection terminal response is not triggered, otherwise, evaluating the picture quality of the remote screen projection terminal in the remote screen projection terminal response process, judging whether to trigger remote screen projection terminal response feedback based on the obtained terminal control picture quality result, and the input interaction signal transmission optimization adjustment represents that the input interaction signal transmission process is modified in combination with the input interaction signal interference influence result, so as to reduce the influence degree of spectrum overlap interference on the input interaction signal transmission process of the screen projection control terminal; and the response feedback judgment module is used for prompting to perform remote screen projection terminal response feedback if the remote screen projection terminal response feedback is triggered, otherwise, performing remote screen projection terminal response optimization.

[0011] The embodiment of the application provides a remote screen projection terminal control method of a remote interaction interface, comprising the following steps: evaluating the influence degree of spectrum overlap interference on the input interaction signal transmission process of a screen projection control terminal, and judging whether to trigger a remote screen projection terminal response in combination with the input interaction signal interference influence result; prompting to perform input interaction signal transmission optimization adjustment if the remote screen projection terminal response is not triggered, otherwise, evaluating the picture quality of the remote screen projection terminal in the remote screen projection terminal response process, judging whether to trigger remote screen projection terminal response feedback based on the obtained terminal control picture quality result, and the input interaction signal transmission optimization adjustment represents that the input interaction signal transmission process is modified in combination with the input interaction signal interference influence result, so as to reduce the influence degree of spectrum overlap interference on the input interaction signal transmission process of the screen projection control terminal; prompting to perform remote screen projection terminal response feedback if the remote screen projection terminal response feedback is triggered, otherwise, performing remote screen projection terminal response optimization.

[0012] The one or more technical solutions provided in the embodiment of the application have at least the following technical effects or advantages:

[0013] 1、By combining the input interaction signal interference effect result to determine whether to trigger the remote screen projection terminal response, if not to trigger the remote screen projection terminal response, then prompt to execute the input interaction signal transmission optimization adjustment, otherwise, based on the terminal control picture quality result to determine whether to trigger the remote screen projection terminal response back, thereby realizing the optimization adjustment of the terminal picture quality and the interference degree of the interaction signal in the remote screen projection interaction process, and further realizing the more efficient terminal picture quality control in the remote conference screen projection interaction process, effectively solving the problem of insufficient correlation between the terminal picture quality and the interference difference of the interaction signal in the screen projection interaction process of the remote conference in the prior art.

[0014] 2、By comparing the input interaction interference score with the preset input interaction interference effect allowed range obtained from the preset database to obtain the input interaction signal interference effect result, and combining the input interaction signal interference effect result to determine whether to trigger the remote screen projection terminal response, thereby realizing more accurate judgment of the input interaction signal transmission process of the screen projection control terminal affected by the spectrum overlap interference and effective reduction of the interference degree, and further realizing the improvement of the control accuracy of the terminal picture quality under the interaction signal interference difference in the remote conference screen projection interaction process.

[0015] 3、By quantitatively evaluating the picture quality of the remote screen projection terminal through the picture quality correlation data to obtain the terminal picture quality score, and comparing the difference between the terminal picture quality score and the preset picture quality qualified range to obtain the terminal control picture quality result, thereby realizing more accurate judgment of the picture quality of the remote screen projection terminal, and further realizing the improvement of the reliability of the terminal picture quality control in the remote conference screen projection interaction process. BRIEF DESCRIPTION OF DRAWINGS

[0016] Figure 1 A structure diagram of a remote screen projection terminal control system of a remote interaction interface provided by an embodiment of the present application;

[0017] Figure 2 A module logic diagram of a remote screen projection terminal control system of a remote interaction interface provided by an embodiment of the present application;

[0018] Figure 3 A terminal control picture quality result acquisition flowchart of a remote screen projection terminal control system of a remote interaction interface provided by an embodiment of the present application;

[0019] Figure 4 A flowchart of a remote screen projection terminal control method of a remote interaction interface provided by an embodiment of the present application. DETAILED DESCRIPTION

[0020] This application provides a remote screen-sharing terminal control system and method with a remote interactive interface. It solves the problem in existing technologies where the correlation between terminal image quality and interference differences in interactive signals during remote conferencing is insufficient. By evaluating the degree of influence of spectral overlap interference on the input interactive signal transmission process of the screen-sharing control terminal, and combining the results of the input interactive signal interference, it determines whether to trigger a remote screen-sharing terminal response. If no remote screen-sharing terminal response is triggered, it prompts for input interactive signal transmission optimization adjustment; otherwise, it evaluates the image quality of the remote screen-sharing terminal during the response process and determines whether to trigger a remote screen-sharing terminal response feedback based on the obtained terminal control image quality result. If a remote screen-sharing terminal response feedback is triggered, it prompts for remote screen-sharing terminal response feedback; otherwise, it performs remote screen-sharing terminal response optimization. This achieves more efficient control of terminal image quality during remote conferencing screen-sharing interactions.

[0021] The technical solution in this application embodiment addresses the problem of insufficient correlation between terminal image quality and interference differences in interactive signals during the screen projection interaction process in remote conferencing. The overall approach is as follows:

[0022] By combining the results of interference with the input interaction signal, it is determined whether to trigger a response from the remote screen projection terminal. If the remote screen projection terminal does not respond, it prompts the user to perform input interaction signal transmission optimization adjustment. Otherwise, it determines whether to trigger a response from the remote screen projection terminal based on the terminal's screen quality control results. This achieves more efficient control of the terminal's screen quality during remote conference screen projection interaction.

[0023] To better understand the above technical solutions, the following will provide a detailed explanation of the technical solutions in conjunction with the accompanying drawings and specific implementation methods.

[0024] like Figure 1 The diagram shown is a structural schematic of a remote screen projection terminal control system with a remote interactive interface provided in this application embodiment. The remote screen projection terminal control system with a remote interactive interface provided in this application embodiment includes: an input response judgment module, a terminal response control module, and a response feedback judgment module.

[0025] Specifically, the input response judgment module is used to evaluate the degree of influence of spectrum overlap interference on the transmission process of the input interaction signal of the screen projection control terminal, and to determine whether to trigger the remote screen projection terminal response based on the interference effect of the input interaction signal.

[0026] The terminal response control module is configured to, if the remote projection terminal response is not triggered, prompt execution of input interaction signal transmission optimization adjustment, otherwise, evaluate the picture quality of the remote projection terminal in the remote projection terminal response process, and determine whether to trigger remote projection terminal response feedback based on the obtained terminal control picture quality result. The input interaction signal transmission optimization adjustment means that the input interaction signal transmission process is corrected in combination with the input interaction signal interference influence result, so as to reduce the influence degree of the spectrum overlap interference in the input interaction signal transmission process of the projection control terminal.

[0027] The response feedback judgment module is configured to, if the remote projection terminal response feedback is triggered, prompt execution of the remote projection terminal response feedback, otherwise, execute remote projection terminal response optimization.

[0028] As shown in Figure 2 Fig. 1 is a remote projection terminal control system module logic diagram of a remote interaction interface provided by an embodiment of the present application. The corresponding logic is as follows: the influence degree of the spectrum overlap interference in the input interaction signal transmission process of the projection control terminal is evaluated by the signal transmission interference quantization data to obtain an input interaction interference score. The input interaction interference score is compared with a preset input interaction interference influence allowable range to obtain an input interaction signal interference influence result. The input interaction signal interference influence result includes interaction interference influence compliance and interaction interference influence exceeding the standard. If the input interaction interference score is within the preset input interaction interference influence allowable range, the input interaction signal interference influence result corresponds to interaction interference influence compliance, the remote projection terminal response is triggered, and a terminal control picture quality result is obtained. The terminal control picture quality result includes terminal picture quality compliance and terminal picture quality abnormality. If the terminal control picture quality result corresponds to terminal picture quality compliance, the remote projection terminal response feedback is triggered, otherwise, the remote projection terminal response feedback is not triggered, and remote projection terminal response optimization is prompted to be executed. If the input interaction interference score is not within the preset input interaction interference influence allowable range, the input interaction signal interference influence result corresponds to interaction interference influence exceeding the standard, the remote projection terminal response is not triggered, and an input interaction signal transmission optimization adjustment instruction is sent.

[0029] In this embodiment, the resume screening is a high-precision and high-efficiency task, and the recruitment personnel need to pay attention to every detail (such as text, format, layout, etc.) in the resume and make decisions according to these details. If the picture quality of the screen projection during the remote meeting process cannot be guaranteed, important information in the resume may be missed, or the screening efficiency may be affected due to the blurred picture. Through remote screen projection, the headhunter consultant can display the complete information of the candidate, including the resume, interview performance, recommendation letter, skill certificate, work experience and other multi-dimensional data, so as to evaluate whether the candidate meets the requirements of the post from multiple angles. During the resume screening process, the remote interaction interface can synchronize various data in real time, including the interview situation of the candidate, the salary requirement, whether the candidate has contacted other positions, and other information. The recruitment personnel can view and screen the resume content on multiple devices at the same time, use the remote screen projection function to remotely project the resume screening results, cooperate to improve the screening efficiency, and help the consultant adjust the screening strategy in real time to ensure that the recommended candidate meets the requirements. In addition, if the interaction signal is not accurate, it may cause the discussion to be not smooth, the decision to be delayed, and the accuracy of the enterprise's decision on the employment to be affected. In the remote meeting, the real-time and accuracy of information transmission is very important, and through the in-depth correlation analysis of the terminal picture quality and the interference difference of the input interaction signal, the technical bottleneck affecting the meeting quality can be identified and solved, so as to improve the overall effect of the remote meeting, ensure the timeliness and accuracy of the enterprise decision, and realize more efficient terminal picture quality control in the process of remote meeting screen projection interaction.

[0030] Further, the influence degree of the input interaction signal quality on the input interaction signal transmission process of the screen projection control end is evaluated, and the specific steps are as follows:

[0031] Firstly, the signal transmission interference quantization data in the preset transmission monitoring time period is obtained, and the transmission interference quantization data includes the interaction channel utilization rate, the signal power spectrum density peak value, the interaction channel bandwidth and the signal transmission bit error rate; wherein, the signal transmission interference quantization data is all processed by removing the unit, the interaction channel utilization rate is obtained by a network monitoring tool (such as Wireshark), the signal power spectrum density peak value is obtained by a spectrum analyzer, the interaction channel bandwidth is obtained by network interface card information, and the signal transmission bit error rate is obtained by a wireless network monitoring tool (such as Ekahau).

[0032] Secondly, the signal input effective interaction operation result (i.e. the part of the input interaction interference score) and the signal input accurate interaction operation result (i.e. the part of the input interaction interference score) are weighted and coupled with the input effective weighting coefficient and the input accurate weighting coefficient obtained from the preset database to obtain the input interaction interference score. The method for obtaining the input interaction interference score is as follows:

[0033]

[0034] In the formula, RJ k represents the input interaction interference score in the preset transmission monitoring time period, Q1ξ represents the input effective weighting coefficient, Q2ξ represents the input accurate weighting coefficient, X1 represents the interaction channel utilization rate in the preset transmission monitoring time period, MAX Hf represents the reference channel maximum utilization rate threshold, Hf represents the signal power spectral density peak value in the preset transmission monitoring time period, Xd represents the interaction channel bandwidth in the preset transmission monitoring time period, MIN Xd represents the reference minimum channel bandwidth threshold, and Hb represents the signal transmission bit error rate in the preset transmission monitoring time period.

[0035] The sum of the input effective weighting coefficient and the input accurate weighting coefficient is 1, and is respectively used to describe the influence degree of the signal input effective interaction operation result and the signal input accurate interaction operation result on the input interaction interference score. The corresponding input effective weighting coefficient and input accurate weighting coefficient are obtained by inputting the real-time signal input effective interaction operation result and the signal input accurate interaction operation result into the mapping set of the preset signal input effective interaction operation result, the signal input accurate interaction operation result and the weighting coefficient corresponding thereto in the database.

[0036] In addition, the signal input effective interaction operation result represents the result of parameter interaction processing of the interaction channel utilization rate and the signal power spectral density peak value relative deviation, and the signal power spectral density peak value relative deviation (i.e. the part of the signal input effective interaction operation result) represents the result of the proportion operation of the difference between the reference channel maximum utilization rate threshold and the interaction channel utilization rate and the reference channel maximum utilization rate threshold. The reference channel maximum utilization rate threshold is the maximum value of the interaction channel utilization rate in the collected historical time period. The signal input accurate interaction operation result represents the result of parameter interaction processing of the interaction channel bandwidth relative deviation and the signal transmission bit error rate, and the interaction channel bandwidth relative deviation (i.e. the part of the signal input accurate interaction operation result) represents the result of the proportion operation of the difference between the interaction channel bandwidth and the reference minimum channel bandwidth threshold and the reference minimum channel bandwidth threshold. The reference minimum channel bandwidth threshold is the minimum value of the interaction channel bandwidth in the collected historical time period.

[0037] In the embodiment, the input interaction interference score represents quantized data of the evaluation of the influence of spectral overlap interference on the input interaction signal transmission process of the screen projection control terminal, and is used to quantitatively evaluate the influence of spectral overlap interference on the input interaction signal transmission process of the screen projection control terminal; wherein the input interaction interference score considers the correlation and mutual influence relationship between parameters through quantization, for example, the interaction channel utilization rate represents the use degree of the channel bandwidth, and the relationship between the interaction channel utilization rate and the signal power spectrum density peak mainly reflects the influence of signal strength on bandwidth use. The higher the utilization rate of the channel, the greater the load of the channel, and the greater the possibility of network congestion. Under the limited frequency spectrum resource, the signal power spectrum density peak decreases, indicating that the influence of spectral overlap interference on the input interaction signal transmission process of the screen projection control terminal increases, and the input interaction interference score increases. At the same time, the relationship between the interaction channel bandwidth and the signal transmission bit error rate depends on the error tolerance and data transmission rate of the channel to a certain extent. Increasing the bandwidth usually increases the throughput in the signal transmission process, but as the interaction channel bandwidth increases, the relative power of the signal may be dispersed, resulting in an increase in the error rate, especially at high load. Excessive bandwidth may reduce the tolerance of the transmission process to errors, thereby increasing the signal transmission bit error rate. Through the quantitative evaluation of the influence of spectral overlap interference on the input interaction signal transmission process of the screen projection control terminal, more accurate judgment of the influence of spectral overlap interference on the input interaction signal transmission process of the screen projection control terminal is realized, and the improvement of the control accuracy of the terminal picture quality under the difference of interaction signal interference in the remote conference screen projection interaction process is realized.

[0038] Further, whether to trigger the remote screen projection terminal response is judged according to the input interaction signal interference influence result, and the specific process is as follows:

[0039] A1, the input interaction interference score is compared with the preset input interaction interference influence allowable range obtained from the preset database to obtain the input interaction signal interference influence result. The input interaction signal interference influence result includes interaction interference influence compliance and interaction interference influence over standard. Specifically, the interaction interference influence compliance represents the input interaction signal interference influence result corresponding to the input interaction interference score within the preset input interaction interference influence allowable range (including the endpoints of the preset input interaction interference influence allowable range), and the interaction interference influence over standard represents the input interaction signal interference influence result corresponding to the input interaction interference score not within the preset input interaction interference influence allowable range. The preset input interaction interference influence allowable range is set by professionals according to the standards in the field.

[0040] A2, if the input interaction signal interference influence result corresponds to interaction interference influence exceeding the standard, the remote projection terminal response is not triggered, and an input interaction signal transmission optimization adjustment instruction is sent, which is used to prompt the execution of input interaction signal transmission optimization adjustment.

[0041] A3, if the input interaction signal interference influence result corresponds to interaction interference influence compliance, the remote projection terminal response is triggered, and the terminal control picture quality result is obtained.

[0042] It should be noted that the specific process of executing input interaction signal transmission optimization adjustment is as follows:

[0043] First, an input terminal transmission adjustment prompt is sent to the projection control terminal, and it is judged whether the remote projection terminal response is triggered after the input terminal transmission adjustment is executed at the projection control terminal; wherein the input terminal transmission adjustment includes input power adjustment and input bandwidth adjustment, the input power adjustment refers to updating the initial input interaction signal transmission power to the input interaction signal transmission power, the input interaction signal transmission power is the sum of the input interaction signal transmission power correction value and the initial input interaction signal transmission power, which represents the deviation degree of the input interaction interference score and the interaction interference reference threshold value; the input bandwidth adjustment refers to updating the initial input interaction signal channel bandwidth to the input interaction signal channel bandwidth, the input interaction signal channel bandwidth is the sum of the input interaction signal channel bandwidth correction value and the initial input interaction signal channel bandwidth, which represents the deviation degree of the input interaction interference score and the interaction interference reference threshold value; the interaction interference reference threshold value is the minimum value of the collected historical input interaction interference score.

[0044] Secondly, if it is triggered, an input interaction signal transmission optimization adjustment end prompt is sent, and the obtained input interaction interference score is continuously monitored and compared with the preset input interaction interference influence allowed range, if the remote projection terminal response is still not triggered, the input interaction signal terminal adjustment is executed; the input interaction signal terminal adjustment includes signal amplification correction, signal filtering correction and signal coding correction.

[0045] In addition, the specific process of executing input interaction signal terminal adjustment is as follows:

[0046] M1, the deviation degree of the input interaction interference score and the interaction interference reference threshold value is taken as the signal amplification correction value, and the input interaction signal is corrected by inputting the signal amplification correction value into the signal amplifier; the deviation degree of the input interaction interference score and the interaction interference reference threshold value is the difference between the input interaction interference score and the interaction interference reference threshold value.

[0047] M2, the deviation degree of the input interaction interference score and the interaction interference reference threshold value is taken as the signal filtering correction value, and the input interaction signal is corrected by inputting the signal filtering correction value into the adaptive filter.

[0048] M3, encode and correct the input interaction signal by taking the degree of deviation of the input interaction interference score from the interaction interference reference threshold as a signal coding rate correction value, the encoding and correction refers to updating the initial signal coding rate to a signal coding rate, the signal coding rate is the sum of the signal coding rate correction value and the initial signal coding rate, and the signal coding rate represents the degree of deviation of the input interaction interference score from the interaction interference reference threshold;

[0049] M4, judge whether to trigger the remote projection terminal response, if yes, send an input interaction signal transmission optimization adjustment end prompt, otherwise, re-execute M1 until the remote projection terminal response is triggered.

[0050] As Figure 3 shown, a terminal control picture quality result acquisition flowchart of a remote projection terminal control system of a remote interaction interface provided by the embodiment of the application, the corresponding logic is: the picture quality associated data is used to quantitatively evaluate the picture quality of the remote projection terminal to obtain a terminal picture quality score, the terminal picture quality score is compared with a preset picture quality qualified range to obtain a terminal control picture quality result, the terminal control picture quality result includes terminal picture quality qualification and terminal picture quality abnormality, the terminal control picture quality result corresponding to the terminal picture quality score in the preset picture quality qualified range is terminal picture quality qualification, the remote projection terminal response is triggered to return, the terminal control picture quality result corresponding to the terminal picture quality score not in the preset picture quality qualified range is terminal picture quality abnormality, the remote projection terminal response is not triggered to return, and the remote projection terminal response optimization is prompted to be executed.

[0051] Specifically, the specific process of obtaining the terminal control picture quality result is:

[0052] X1, obtain the picture quality associated data in the terminal response monitoring time period, quantitatively evaluate the picture quality of the remote projection terminal based on the obtained picture quality associated data, and obtain a terminal picture quality score. The picture quality associated data includes picture resolution, picture definition, picture frame rate, picture delay jitter and input interaction interference score. Specifically, the picture resolution is obtained through Windows API (Application Programming Interface), the picture definition is obtained through an image processing library (such as OpenCV), the picture frame rate is obtained through OpenGL, and the picture delay jitter is obtained through a frame rate monitoring tool (such as Fraps).

[0053] X2, the terminal picture quality score is compared with the preset picture quality qualified range obtained from the preset database to obtain a terminal control picture quality result. The terminal control picture quality result includes terminal picture quality qualification and terminal picture quality abnormality. Specifically, the terminal picture quality qualification indicates that the terminal picture quality score is within the preset picture quality qualified range (including the endpoints of the preset picture quality qualified range), and the terminal picture quality abnormality indicates that the terminal picture quality score is not within the preset picture quality qualified range. The preset picture quality qualified range is set by professionals according to the standards in the field.

[0054] The terminal picture quality score is obtained by the following steps:

[0055] X11, the picture clarity interaction operation result (i.e., the part of the picture quality index) and the picture delay interaction operation result (i.e., the part of the picture quality index) are coupled after being processed by weighting operation with the picture clarity compensation amount and the picture delay compensation value obtained from the preset database to obtain the picture quality index. The picture quality index is obtained by the following method:

[0056]

[0057] In the formula, PL represents the picture quality index, Q1 represents the picture clarity compensation amount, Q2 represents the picture delay compensation value, BL represents the picture resolution, ΔBL represents the reference picture resolution, XQ represents the picture clarity, FL represents the picture frame rate, ΔFL represents the reference picture frame rate, MAX YD represents the reference maximum picture delay jitter, and YD represents the picture delay jitter.

[0058] Specifically, the picture clarity compensation amount and the picture delay compensation value are both in the range of 0 to 1 and their sum is 1, and are used to describe the influence of the picture clarity interaction operation result and the picture delay interaction operation result on the picture quality index. The corresponding picture clarity compensation amount and picture delay compensation value are obtained by inputting the real-time picture clarity interaction operation result and the picture delay interaction operation result into the preset picture clarity interaction operation result and the picture delay interaction operation result in the database and their corresponding mapping sets.

[0059] In addition, the picture clarity interaction operation result represents the result of parameter interaction between the picture resolution ratio result and the picture clarity, and the picture delay interaction operation result represents the result of parameter interaction between the picture frame rate ratio result and the picture delay jitter relative deviation. The picture delay jitter relative deviation (i.e., the The part) represents the result of the ratio operation of the difference between the reference maximum picture delay jitter and the picture delay jitter and the reference maximum picture delay jitter; the reference picture resolution and the reference picture frame rate are the results of averaging the collected historical picture resolution and picture frame rate respectively, and the reference maximum picture delay jitter is the maximum value of the picture delay jitter in the collected historical time period.

[0060] X12, the input interaction interference score deviation (i.e., the PL part in the terminal picture quality score The part), the picture quality index (i.e., the PL part in the terminal picture quality score) and the picture interference weighting coefficient and the picture quality weighting coefficient obtained from the preset database are weighted and coupled to obtain the terminal picture quality score; the method for obtaining the terminal picture quality score is as follows:

[0061]

[0062] In the formula, RJ l represents the terminal picture quality score, Q1X represents the picture interference weighting coefficient, Q2X represents the picture quality weighting coefficient, Y RJk represents the interaction interference reference threshold, RJ k represents the input interaction interference score.

[0063] The picture interference weighting coefficient and the picture quality weighting coefficient are respectively used to describe the influence degree of the input interaction interference score deviation and the picture quality index on the terminal picture quality score, and the corresponding picture interference weighting coefficient and picture quality weighting coefficient are obtained by inputting the real-time input interaction interference score deviation and the picture quality index into the mapping set of the preset input interaction interference score deviation and the picture quality index and the weighting coefficients corresponding thereto in the database.

[0064] It should be understood that the terminal picture quality score is used to quantitatively evaluate the picture quality of the remote projection terminal; the terminal picture quality score is directly affected by the input interaction interference score and the picture quality index, specifically, as the input interaction interference score deviates from the interaction interference reference threshold, the terminal picture quality score decreases, and as the picture quality index increases, the terminal picture quality score increases.

[0065] In addition, the terminal picture quality score represents the quantitative data of the picture quality associated data on the remote projection terminal picture quality evaluation; by considering the correlation and mutual influence between the parameters, the picture resolution is the number of pixels in each frame of image, the higher the picture resolution, the clearer the picture, the more detailed, high resolution can provide more pixel information, improve the definition of the image, so that the picture definition increases; at the same time, the frame rate refers to the number of pictures displayed per second, and the delay jitter is the delay fluctuation between each frame, under high frame rate, the picture should be smooth and smooth, but if the delay jitter is too large (i.e. the rendering time of each frame is inconsistent), the picture is easy to appear lag or tearing, and with the decrease of picture delay jitter, the picture quality index increases; in addition, with the increase of the deviation degree of the input interaction interference score and the interaction interference reference threshold, it is indicated that the input interaction signal transmission process of the projection control terminal is affected by the spectral overlap interference to a lower degree, which further increases the picture quality index, enhances the picture quality of the remote projection terminal, and increases the terminal picture quality score. The text, charts, photos or other information contained in the resume can be clearer and easier to read on a high-definition terminal. For resume screening personnel, high-quality terminal pictures can reduce misreading, omissions or incorrect judgments caused by blurred images or unclear text. In addition, the detailed information contained in the resume, such as contact information, educational background, work experience, etc., can only be clearly identified in qualified terminal picture quality display to avoid omissions caused by unclear pictures. For example, the specific position, work experience and education background of the candidate, which are key information, can enable the recruiter to make a judgment more quickly.

[0066] In the embodiment, by combining the preset input interaction interference allowed range to judge the input interaction interference score to obtain the corresponding input interaction signal interference effect result, whether the remote projection terminal response is triggered is judged based on the corresponding input interaction signal interference effect result, and the input interaction signal transmission optimization adjustment is performed when the input interaction signal interference effect result corresponds to the interaction interference over standard, so as to realize the effective reduction of the influence degree of the spectral overlap interference on the input interaction signal transmission process of the projection control terminal, and further realize the improvement of the control accuracy of the terminal picture quality under the interaction signal interference difference in the remote conference projection interaction process.

[0067] Further, whether the remote projection terminal response feedback is triggered is judged based on the obtained terminal control picture quality result, and the specific process is as follows:

[0068] Among them, if the terminal control picture quality result corresponds to the qualified terminal picture quality, the remote projection terminal response feedback is triggered, and the difference between the terminal picture quality score and the preset picture quality qualified range is continuously compared and judged.

[0069] In addition, if the terminal control picture quality result corresponds to terminal picture quality abnormality, the remote projection terminal response feedback is not triggered, and the remote projection terminal response optimization is prompted to be performed.

[0070] Specifically, the remote projection terminal response optimization is performed, and the specific process is as follows:

[0071] N1, the deviation degree of the terminal picture quality score and the terminal picture quality threshold value is taken as a picture compression ratio correction value, the picture compression correction of the remote projection terminal is performed, the picture compression correction refers to updating the initial picture compression ratio to the picture compression ratio, the picture compression ratio is the sum of the picture compression ratio correction value and the initial picture compression ratio, and the deviation degree of the terminal picture quality score and the terminal picture quality threshold value, that is, the difference between the terminal picture quality score and the terminal picture quality threshold value, the terminal picture quality threshold value is the minimum value of the collected historical terminal picture quality score.

[0072] N2, the deviation degree of the terminal picture quality score and the terminal picture quality threshold value is taken as a picture resolution correction value, the picture resolution correction of the remote projection terminal is performed, the picture resolution correction refers to updating the initial picture resolution to the picture resolution, the picture resolution is the sum of the picture resolution correction value and the initial picture resolution, and the deviation degree of the terminal picture quality score and the terminal picture quality threshold value.

[0073] N3, the deviation degree of the terminal picture quality score and the terminal picture quality threshold value is taken as a picture frame rate correction value, the picture frame rate correction of the remote projection terminal is performed, the picture frame rate correction refers to updating the initial picture frame rate to the picture frame rate, the picture frame rate is the sum of the picture frame rate correction value and the initial picture frame rate, and the deviation degree of the terminal picture quality score and the terminal picture quality threshold value.

[0074] N4, whether to trigger the remote projection terminal response feedback is judged based on the reacquired terminal control picture quality result, if yes, the remote projection terminal response feedback is prompted to be performed, otherwise, it is returned to N1 until the terminal control picture quality result corresponds to the qualified terminal picture quality.

[0075] In the embodiment, the remote projection terminal response optimization means that the picture of the remote projection terminal is corrected in combination with the terminal control picture quality result to improve the picture quality of the remote projection terminal. The judgment of triggering the remote projection terminal response feedback is made by combining the corresponding terminal control picture quality result, and the remote projection terminal response optimization is made when the corresponding terminal control picture quality result is terminal picture quality abnormality. The effective improvement of the remote projection terminal picture quality is realized, and the reliability of the terminal picture quality control in the remote conference projection interaction process is improved.

[0076] As Figure 4As shown, a flowchart of a remote screen projection terminal control method of a remote interaction interface provided by the embodiment of the present application is provided, and the method comprises the following steps: evaluating the influence degree of the spectrum overlap interference on the input interaction signal transmission process of the screen projection control terminal, judging whether to trigger the remote screen projection terminal response in combination with the input interaction signal interference influence result; if the remote screen projection terminal response is not triggered, prompting to perform the input interaction signal transmission optimization adjustment, otherwise, evaluating the picture quality of the remote screen projection terminal in the remote screen projection terminal response process, judging whether to trigger the remote screen projection terminal response feedback based on the obtained terminal control picture quality result, the input interaction signal transmission optimization adjustment means that the input interaction signal transmission process is modified in combination with the input interaction signal interference influence result, so as to reduce the influence degree of the spectrum overlap interference on the input interaction signal transmission process of the screen projection control terminal; if the remote screen projection terminal response feedback is triggered, prompting to perform the remote screen projection terminal response feedback, otherwise, performing the remote screen projection terminal response optimization.

[0077] In conclusion, the embodiment of the present application judges whether to trigger the remote screen projection terminal response in combination with the input interaction signal interference influence result, if the remote screen projection terminal response is not triggered, prompting to perform the input interaction signal transmission optimization adjustment, otherwise, judging whether to trigger the remote screen projection terminal response feedback based on the terminal control picture quality result, so as to realize the optimization adjustment of the terminal picture quality and the interference degree of the interaction signal in the remote screen projection interaction process, and further realize the terminal picture quality control in the remote conference screen projection interaction process more efficiently, and effectively solve the problem that the correlation between the terminal picture quality and the interaction signal interference in the screen projection interaction process of the remote conference is insufficient in the prior art.

[0078] Those skilled in the art should understand that the embodiments of the present application can be provided as a method, a system, or a computer program product. Therefore, the present application can adopt a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer usable storage media containing computer usable program code (including but not limited to disk storage, CD-ROM, optical storage, etc.).

[0079] The present application is described with reference to flowcharts and / or block diagrams of the method, device (system), and computer program product according to the embodiments of the present application. It should be understood that each flow and / or block in the flowcharts and / or block diagrams, and the combination of the flows and / or blocks in the flowcharts and / or block diagrams can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing devices to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing devices produce a machine that implements the flowcharts and / or block diagrams. Figure 1one or more processes and / or blocks Figure 1 an apparatus for performing the functions specified in the flowchart

[0080] These computer program instructions can also be stored in a computer- readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instructions which implement the flowchart Figure 1 one or more processes and / or blocks Figure 1 an apparatus for performing the functions specified in the flowchart

[0081] These computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the flowchart Figure 1 one or more processes and / or blocks Figure 1 an apparatus for performing the functions specified in the flowchart

[0082] While the preferred embodiments of the application have been described, additional variations and modifications can be made to the embodiments by those skilled in the art once they learn of the basic inventive concepts. Therefore, the appended claims are intended to encompass within their scope all such variations and modifications as are included within the scope of the invention.

[0083] Obviously, numerous modifications and variations of the present application are possible in light of the above teachings. It is therefore to be understood that within the scope of the appended claims and their equivalents, the application can be practiced otherwise than as specifically described.

Claims

1. A remote screen projection terminal control system of a remote interaction interface, characterized in that, The application relates to a remote screen projection terminal response control method and device. The input response judgment module is used for evaluating the influence degree of spectrum overlap interference on the input interaction signal transmission process of the screen projection control terminal, and judging whether to trigger the remote screen projection terminal response according to the input interaction signal interference influence result; the input interaction signal quality is evaluated according to the influence degree of spectrum overlap interference on the input interaction signal transmission process of the screen projection control terminal, and the specific steps are as follows: Signal transmission interference quantization data in a preset transmission monitoring time period are acquired, and the transmission interference quantization data include interaction channel utilization rate, signal power spectrum density peak value, interaction channel bandwidth and signal transmission bit error rate; The signal input effective interaction operation result and the signal input accurate interaction operation result are weighted and coupled with the input effective weighting coefficient and the input accurate weighting coefficient acquired from the preset database to obtain an input interaction interference score, which represents the quantization data of the evaluation of the influence degree of spectrum overlap interference on the input interaction signal transmission process of the screen projection control terminal, and is used for quantitatively evaluating the influence degree of spectrum overlap interference on the input interaction signal transmission process of the screen projection control terminal. The signal input effective interaction operation result represents the result of the parameter interaction processing of the relative deviation of the interaction channel utilization rate and the signal power spectrum density peak value, and the signal input accurate interaction operation result represents the result of the parameter interaction processing of the relative deviation of the interaction channel bandwidth and the signal transmission bit error rate; the input interaction signal interference influence result is obtained by comparing the input interaction interference score with the preset input interaction interference influence allowable range acquired from the preset database, and the input interaction signal interference influence result includes interaction interference influence compliance and interaction interference influence over standard. If the input interaction signal interference influence result corresponds to the interaction interference influence over standard, the remote screen projection terminal response is not triggered, and an input interaction signal transmission optimization adjustment instruction is sent, which is used for prompting the execution of the input interaction signal transmission optimization adjustment. If the input interaction signal interference influence result corresponds to the interaction interference influence compliance, the remote screen projection terminal response is triggered, and a terminal control picture quality result is acquired. The interaction interference influence compliance represents the input interaction signal interference influence result corresponding to the input interaction interference score in the preset input interaction interference influence allowable range, and the interaction interference influence over standard represents the input interaction signal interference influence result corresponding to the input interaction interference score not in the preset input interaction interference influence allowable range. ​ ​ The terminal response control module is configured to, if the remote projection terminal response is not triggered, prompt execution of input interaction signal transmission optimization adjustment, otherwise, evaluate the picture quality of the remote projection terminal in the remote projection terminal response process, and determine whether to trigger remote projection terminal response feedback based on the obtained terminal control picture quality result, wherein the input interaction signal transmission optimization adjustment means modifying the input interaction signal transmission process in combination with the input interaction signal interference influence result, so as to reduce the influence degree of the spectrum overlap interference in the input interaction signal transmission process of the projection control terminal. The response feedback judgment module is configured to, if the remote projection terminal response feedback is triggered, prompt execution of the remote projection terminal response feedback, otherwise, execute remote projection terminal response optimization.

2. The remote screen projection terminal control system of the remote interaction interface according to claim 1, wherein, The specific process of executing the input interaction signal transmission optimization adjustment is as follows: The input terminal transmission adjustment prompt is sent to the projection control terminal, and it is determined whether the remote projection terminal response is triggered after the input terminal transmission adjustment is executed on the projection control terminal. If the remote projection terminal response is triggered, an input interaction signal transmission optimization adjustment end prompt is sent, and the obtained input interaction interference score is continuously monitored and compared with the preset input interaction interference influence allowed range. If the remote projection terminal response is still not triggered, the input interaction signal terminal adjustment is executed. The input terminal transmission adjustment includes input power adjustment and input bandwidth adjustment. The input power adjustment means updating the initial input interaction signal transmission power to the input interaction signal transmission power, which is the sum of the input interaction signal transmission power correction value and the initial input interaction signal transmission power, representing the deviation degree of the input interaction interference score and the interaction interference reference threshold. The input bandwidth adjustment means updating the initial input interaction signal channel bandwidth to the input interaction signal channel bandwidth, which is the sum of the input interaction signal channel bandwidth correction value and the initial input interaction signal channel bandwidth, representing the deviation degree of the input interaction interference score and the interaction interference reference threshold. The input interaction signal terminal adjustment includes signal amplification correction, signal filtering correction, and signal coding correction. 3.The remote screen projection terminal control system of the remote interaction interface according to claim 2, wherein, The specific process of executing the input interaction signal terminal adjustment is as follows: M1. The deviation degree of the input interaction interference score and the interaction interference reference threshold is taken as the signal amplification correction value, and the input interaction signal is corrected by inputting the signal amplification correction value to the signal amplifier. M2. The deviation degree of the input interaction interference score and the interaction interference reference threshold is taken as the signal filtering correction value, and the input interaction signal is corrected by inputting the signal filtering correction value to the adaptive filter. M3. The deviation degree of the input interaction interference score and the interaction interference reference threshold is taken as the signal coding rate correction value, and the input interaction signal is corrected by updating the initial signal coding rate to the signal coding rate, which is the sum of the signal coding rate correction value and the initial signal coding rate, representing the deviation degree of the input interaction interference score and the interaction interference reference threshold. M4, determining whether to trigger the remote projection terminal response, if triggered, sending an input interaction signal transmission optimization adjustment end prompt, otherwise, re-executing M1 until the remote projection terminal response is triggered.

4. The remote screen projection terminal control system of the remote interaction interface according to claim 1, wherein, The specific process of obtaining the terminal control picture quality result is as follows: Obtain picture quality associated data in the terminal response monitoring time period, and quantitatively evaluate the picture quality of the remote projection terminal based on the obtained picture quality associated data to obtain a terminal picture quality score. The terminal picture quality score represents the quantitative data of the picture quality associated data on the evaluation of the picture quality of the remote projection terminal, and the picture quality associated data includes picture resolution, picture definition, picture frame rate, picture delay jitter, and input interaction interference score. Differences between the terminal picture quality score and the preset picture quality qualified range obtained from the preset database are compared to determine the terminal control picture quality result, which includes terminal picture quality qualification and terminal picture quality anomaly. The terminal picture quality qualification indicates that the terminal picture quality score is within the corresponding terminal control picture quality result of the preset picture quality qualified range, and the terminal picture quality anomaly indicates that the terminal picture quality score is not within the corresponding terminal control picture quality result of the preset picture quality qualified range. 5.The remote screen projection terminal control system of the remote interaction interface according to claim 4, wherein, The specific steps of obtaining the terminal picture quality score are as follows: After weighting operation of the picture clarity interaction operation result, the picture delay interaction operation result and the picture clarity compensation value and the picture delay compensation value obtained from the preset database, the picture quality index is obtained, the picture clarity interaction operation result represents the result of parameter interaction processing of the picture resolution ratio result and the picture definition, and the picture delay interaction operation result represents the result of parameter interaction processing of the picture frame rate ratio result and the picture delay jitter relative deviation. The input interaction interference score deviation degree and the picture quality index are coupled and processed by weighting the picture interference weighting coefficient and the picture quality weighting coefficient obtained from the preset database to obtain the terminal picture quality score. The terminal picture quality score is used to quantitatively evaluate the picture quality of the remote projection terminal.

6. The remote screen projection terminal control system of the remote interaction interface according to claim 1, wherein, The specific process of determining whether to trigger the remote projection terminal response based on the obtained terminal control picture quality result is as follows: If the terminal control picture quality result corresponds to the terminal picture quality qualification, the remote projection terminal response is triggered, and the difference between the terminal picture quality score and the preset picture quality qualified range is continuously compared; If the terminal control picture quality result corresponds to the terminal picture quality anomaly, the remote projection terminal response is not triggered, and the remote projection terminal response optimization is prompted to be executed. The remote projection terminal response optimization means that the picture of the remote projection terminal is corrected based on the terminal control picture quality result to improve the picture quality of the remote projection terminal.

7. The remote screen projection terminal control system of the remote interaction interface according to claim 6, wherein, The specific process of executing the remote projection terminal response optimization is as follows: N1, taking the deviation degree of the terminal picture quality score from the terminal picture quality threshold as a picture compression ratio correction value, performing picture compression correction on the remote projection terminal, the picture compression correction refers to updating the initial picture compression ratio to the picture compression ratio, the picture compression ratio is the sum of the picture compression ratio correction value and the initial picture compression ratio, and the deviation degree of the terminal picture quality score from the terminal picture quality threshold; N2, taking the deviation degree of the terminal picture quality score from the terminal picture quality threshold as a picture resolution correction value, performing picture resolution correction on the remote projection terminal, the picture resolution correction refers to updating the initial picture resolution to the picture resolution, the picture resolution is the sum of the picture resolution correction value and the initial picture resolution, and the deviation degree of the terminal picture quality score from the terminal picture quality threshold; N3, taking the deviation degree of the terminal picture quality score from the terminal picture quality threshold as a picture frame rate correction value, performing picture frame rate correction on the remote projection terminal, the picture frame rate correction refers to updating the initial picture frame rate to the picture frame rate, the picture frame rate is the sum of the picture frame rate correction value and the initial picture frame rate, and the deviation degree of the terminal picture quality score from the terminal picture quality threshold; N4, judging whether to trigger the remote projection terminal response back transmission based on the reacquired terminal control picture quality result, if yes, prompting to execute the remote projection terminal response back transmission, otherwise, returning to N1 until the terminal control picture quality result corresponds to the terminal picture quality qualified.

8. A remote screen projection terminal control method of a remote interaction interface, applied to the remote screen projection terminal control system of any one of claims 1-7, characterized in that, The steps include: The influence degree of the input interaction signal transmission process of the projection control end on the spectrum overlap interference is evaluated, and it is judged whether to trigger the remote projection terminal response combined with the input interaction signal interference influence result; If the remote projection terminal response is not triggered, the input interaction signal transmission optimization adjustment is prompted to be executed, otherwise, the picture quality of the remote projection terminal in the remote projection terminal response process is evaluated, and it is judged whether to trigger the remote projection terminal response back transmission based on the obtained terminal control picture quality result, the input interaction signal transmission optimization adjustment means that the input interaction signal transmission process is corrected combined with the input interaction signal interference influence result to reduce the influence degree of the input interaction signal transmission process of the projection control end on the spectrum overlap interference; If the remote projection terminal response back transmission is triggered, the remote projection terminal response back transmission is prompted to be executed, otherwise, the remote projection terminal response optimization is executed.

Images