An interactive control system and method for a long-distance imaging display

Abstract

The present invention proposes an interactive control system and method for a long-distance imaging display. A touch panel is scanned based on a preconfigured scanning frequency to obtain a capacitive image of the touch panel. The capacitive image is a two-dimensional capacitive value image generated by mapping the coupling capacitance between each capacitive sensor on the touch panel and the ground to a standard pixel value interval. A display projection area is determined on an observation window of the long-distance imaging display. The display projection area is a projection area on the observation window where a display screen of the long-distance imaging display viewed by a user through the observation window falls. The capacitive image is cropped according to the shape and position of the display projection area to generate a touch operation image. A touch operation gesture input by a user is identified from the touch operation image. An interactive control instruction corresponding to the touch operation gesture is executed. The interactive control experience of the user using the long-distance imaging display can be effectively improved.

Description

Technical Field

[0001] The present invention relates to the field of display technology, and in particular to an interactive control system and method for a long-distance imaging display. Background Art

[0002] Unlike electronic products such as mobile phones and computers that need to be viewed at close range, long-distance imaging displays reduce the damage to the user's eyes caused by long-term screen viewing by enlarging the display screen and extending the imaging distance. They are more suitable for application scenarios such as online teaching and remote teaching that require long-term screen viewing. By projecting the screen of a mobile phone or computer onto a long-distance imaging display through a wired or wireless connection, you can see the enlarged screen on the long-distance imaging display, and perform interactive controls such as input or screen switching on the mobile phone or computer. However, the traditional method of using a mouse for interactive control or touch operation on the mobile phone screen is not convenient for use with a long-distance imaging display. The traditional mouse control solution is more suitable for scenarios with close-range and high-frequency operations, such as computer office. In scenarios such as long-term viewing and a small amount of operation on a long-distance imaging display, the connection, placement and holding method of the mouse will bring restrictions and inconvenience to the use of the long-distance imaging display. If the display image is transmitted from a mobile phone to a long-distance imaging display, it is generally most direct to use the touch operation of the mobile phone screen itself for interactive control. However, since mobile phone screens are generally small, users need to pick up the phone and move their eyes from the long-distance imaging display to the mobile phone screen during operation, resulting in a poor interactive control experience. Summary of the invention

[0003] Based on the above problems, the present invention proposes an interactive control system and method for a long-distance imaging display, which can effectively improve the interactive control experience of users using the long-distance imaging display.

[0004] In view of this, a first aspect of the present invention proposes an interactive control system for a long-distance imaging display, comprising a long-distance imaging display for performing long-distance magnified imaging of display content and a terminal device for providing display content, wherein the long-distance imaging display comprises a display screen arranged at the bottom of the long-distance imaging display with its front side facing upward, a circuit board electrically connected to the display screen, a spectroscope arranged above the display screen, a concave mirror arranged on one side of the spectroscope, and an observation window arranged on the other side of the spectroscope, wherein a communication module for communicating with the terminal device is arranged on the circuit board, and the circuit board obtains display content from the terminal device through the communication module and provides it to the display screen, wherein the interactive control system further comprises a touch panel arranged on the observation window and an interactive control device connected to the touch panel and the terminal device, wherein the interactive control device is configured as follows:

[0005] Scanning the touch panel based on a preconfigured scanning frequency to obtain a capacitance image of the touch panel, wherein the capacitance image is a two-dimensional capacitance value image generated by mapping the coupling capacitance between each capacitive sensor on the touch panel and the ground to a standard pixel value interval;

[0006] Determine a display projection area on an observation window of the long-distance imaging display, wherein the display projection area is a projection area on the observation window where a display image on the display screen of the long-distance imaging display viewed by a user through the observation window falls;

[0007] Cutting the capacitive image according to the shape and position of the display projection area to generate a touch operation image;

[0008] Identifying a touch operation gesture input by a user from the touch operation image;

[0009] Execute the interactive control instruction corresponding to the touch operation gesture.

[0010] A second aspect of the present invention provides an interactive control method for a long-distance imaging display, comprising:

[0011] Scanning the touch panel based on a preconfigured scanning frequency to obtain a capacitance image of the touch panel, wherein the capacitance image is a two-dimensional capacitance value image generated by mapping the coupling capacitance between each capacitive sensor on the touch panel and the ground to a standard pixel value interval;

[0012] Determine a display projection area on an observation window of the long-distance imaging display, wherein the display projection area is a projection area on the observation window where a display image on the display screen of the long-distance imaging display viewed by a user through the observation window falls;

[0013] Cutting the capacitive image according to the shape and position of the display projection area to generate a touch operation image;

[0014] Identifying a touch operation gesture input by a user from the touch operation image;

[0015] Execute the interactive control instruction corresponding to the touch operation gesture.

[0016] Furthermore, the step of identifying the touch operation gesture input by the user from the touch operation image specifically includes:

[0017] Identifying a touch operation point on the touch operation image, wherein the touch operation point is a coordinate point of a capacitive sensor on the touch panel where a change in coupling capacitance to ground is greater than a preset change threshold when a user approaches or touches the touch panel with a finger or a touch tool;

[0018] Analyzing the position change and timing change of the touch operation points on the touch panel in the continuous multiple-frame touch operation images;

[0019] A touch operation gesture corresponding to the touch operation point is determined according to a position change and a time sequence change of the touch operation point on the touch panel, and the touch operation gesture includes a click operation, a long press operation, and a slide operation.

[0020] Furthermore, the step of identifying the touch operation point on the touch operation image specifically includes:

[0021] generating a no-operation image of the touch panel, wherein the no-operation image is a capacitive image generated when the touch panel is powered on and there is no external operation;

[0022] Performing calibration processing on the touch operation image based on the no-operation image to generate a target calibration image;

[0023] Extracting extreme points from the target calibration image;

[0024] The extreme point is determined as a touch operation point on the touch operation image.

[0025] Furthermore, the touch panel is a self-capacitive projection touch panel, and before the step of identifying the touch operation gesture input by the user from the touch operation image, the method further includes:

[0026] Obtain pre-configured icon display distance interval and touch operation distance interval;

[0027] Calculating a real-time distance between an operating body and the touch panel according to the size of the extreme point, wherein the operating body includes a user's finger or a stylus;

[0028] When the real-time distance falls within the icon display distance interval, displaying an operation icon at a corresponding position on the display screen of the long-distance imaging display;

[0029] When the real-time distance falls within the touch operation distance interval, the steps of determining a touch operation gesture corresponding to the touch operation point according to a position change and a timing change of the touch operation point on the touch panel and executing an interactive control instruction corresponding to the touch operation gesture are performed.

[0030] Furthermore, the step of generating the no-operation image of the touch panel specifically includes:

[0031] Get the capacitance image P(t i ), where t i ∈(t b ,t t ), i∈[1,nt ], t b is the starting point of the sampling period, t t is the end point of the sampling period, t i t b to t The i-th sampling time point between t t b to t The number of sampling points between

[0032] Calculate each frame of capacitance image P(t i ) of the capacitance fluctuation amplitude pr(t i ), the capacitance fluctuation amplitude pr(t i ) is the i-th frame capacitive image P(t i ) the capacitance fluctuation amplitude of the pixel position with the largest capacitance fluctuation amplitude;

[0033] Based on the capacitance fluctuation amplitude pr(t i ) constructs the sampling time period (t b ,t t ) is the capacitance fluctuation amplitude variation curve f(t);

[0034] Determine the stable interval (tstable) on the capacitance fluctuation amplitude change curve f(t) b ,tstable t );

[0035] Based on the stable interval (tstable b ,tstable t ) to generate a no-operation capacitive image.

[0036] Furthermore, the capacitance image P(t i ) of the capacitance fluctuation amplitude pr(t i ) specifically include:

[0037] Get the sampling time period (t b ,t t ) in each frame of the capacitance image P(t i ) with coordinates x and y in the pixel value p[x,y](t i );

[0038] Calculate the position x, y of each pixel in the sampling time period (t b ,t t ) is the mean of the first pixel in:

[0039]

[0040] Calculate each frame of capacitance image P(t i ) is the relative pixel value of the pixel with coordinates x, y:

[0041]

[0042] Each frame of capacitance image P(t i ) is determined as the capacitance fluctuation amplitude:

[0043]

[0044] Where m s is the maximum number of columns of the capacitive image, n s is the maximum number of rows of the capacitive image.

[0045] Furthermore, a stable interval (tstable) is determined on the capacitance fluctuation amplitude variation curve f(t). b ,tstable t ) specifically include:

[0046] Get the preset noise threshold p0;

[0047] Obtain a peak point peak whose amplitude is greater than the noise threshold p0 on the capacitance fluctuation amplitude change curve f(t) j , where j∈[1,n peak ],n peak is the number of peak points on the capacitance fluctuation amplitude variation curve f(t) whose amplitude is greater than the noise threshold p0;

[0048] Calculate the two adjacent peak points peak on the capacitance fluctuation amplitude change curve f(t) j The time interval between:

[0049] Δt_peak j =t(peak j+1 )-t(peak j );

[0050] Determine two adjacent peak points t(peak j0+1 ) and t(peak j0 ) to satisfy:

[0051]

[0052] Where j0 is [1,n peak -1] any integer in the range;

[0053] t(peak j0 ) is determined as the lower bound of the stable interval tstable b , t(peakj0+1 ) is determined as the upper bound of the stable interval tstable t .

[0054] Furthermore, the step of determining the display projection area on the observation window of the long-distance imaging display specifically includes:

[0055] Get the real-time position of the user's two eyes;

[0056] The midpoint of the line connecting the real-time positions of the two eyes of the user is determined as the observation point;

[0057] Calculating four first optical paths between the observation point and four inner corners of the display screen of the long-distance imaging display;

[0058] Determine the four inner angle intersection points of the four optical paths and the plane where the observation window is located;

[0059] An area surrounded by the lines connecting the four intersection points is determined as the display projection area.

[0060] Furthermore, the step of determining the touch operation gesture corresponding to the touch operation point according to the position change and the time sequence change of the touch operation point on the touch panel specifically includes:

[0061] Determining a second optical path corresponding to a line connecting the touch operation point and the observation point according to the position of the observation point;

[0062] Determine an intersection point of the second optical path and the display screen as a mapping point of the touch operation point on the display screen;

[0063] The touch operation gesture corresponding to the mapping point is determined according to the position change and the time sequence change of the mapping point on the display screen.

[0064] The present invention proposes an interactive control system and method for a long-distance imaging display. A touch panel is scanned based on a preconfigured scanning frequency to obtain a capacitive image of the touch panel. The capacitive image is a two-dimensional capacitive value image generated by mapping the coupling capacitance between each capacitive sensor on the touch panel and the ground to a standard pixel value interval. A display projection area is determined on an observation window of the long-distance imaging display. The display projection area is a projection area on the observation window where a display screen of the long-distance imaging display viewed by a user through the observation window falls. The capacitive image is cropped according to the shape and position of the display projection area to generate a touch operation image. A touch operation gesture input by a user is identified from the touch operation image. An interactive control instruction corresponding to the touch operation gesture is executed. The interactive control experience of the user using the long-distance imaging display can be effectively improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0065] Figure 1 is a schematic diagram of an interactive control system for a long-distance imaging display provided by an embodiment of the present invention;

[0066] Figure 2 The present invention is a flowchart of an interactive control method for a long-distance imaging display provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0067] In order to more clearly understand the above-mentioned purpose, features and advantages of the present invention, the present invention is further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be noted that the embodiments of the present application and the features in the embodiments can be combined with each other without conflict.

[0068] In the following description, many specific details are set forth to facilitate a full understanding of the present invention. However, the present invention may also be implemented in other ways different from those described herein. Therefore, the protection scope of the present invention is not limited to the specific embodiments disclosed below.

[0069] In the description of the present invention, the term "plurality" refers to two or more than two. Unless otherwise clearly defined, the terms "upper" and "lower" indicate positions or positional relationships based on the positions or positional relationships shown in the drawings. They are only for the convenience of describing the present invention and simplifying the description. They do not indicate or imply that the device or element referred to must have a specific position, be constructed and operated in a specific position. Therefore, they cannot be understood as limiting the present invention. The terms "connect", "install", "fix", etc. should be understood in a broad sense.

[0070] For example, "connection" can be a fixed connection, a detachable connection, or an integral connection; it can be directly connected or indirectly connected through an intermediate medium. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to the specific circumstances. In addition, the terms "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, features defined as "first", "second", etc. may explicitly or implicitly include one or more of the features. In the description of the present invention, unless otherwise specified, "multiple" means two or more.

[0071] In the description of this specification, the description of the terms "one embodiment", "some implementations", "specific embodiments", etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described can be combined in any one or more embodiments or examples in a suitable manner.

[0072] The following describes an interactive control system and method for a remote imaging display according to some embodiments of the present invention with reference to the accompanying drawings.

[0073] like Figure 1 As shown, the first aspect of the present invention proposes an interactive control system for a long-distance imaging display, including a long-distance imaging display for performing long-distance magnified imaging of display content and a terminal device for providing display content, the long-distance imaging display includes a display screen arranged at the bottom of the long-distance imaging display with its front side facing upward, a circuit board electrically connected to the display screen, a spectroscope arranged above the display screen, a concave mirror arranged on one side of the spectroscope, and an observation window arranged on the other side of the spectroscope, a communication module for communicating with the terminal device is arranged on the circuit board, the circuit board obtains display content from the terminal device through the communication module and provides it to the display screen, the interactive control system also includes a touch panel arranged on the observation window and an interactive control device connected to the touch panel and the terminal device.

[0074] Exemplarily, the communication module may be a wireless communication module such as Wi-Fi or Bluetooth, and the terminal device may be an intelligent terminal device such as a personal computer, a smart phone or a tablet computer. The touch panel may be arranged on the observation window of the remote imaging display in an external installation or an embedded installation manner. In the technical solutions of some embodiments of the present invention, the interactive control device is a control chip arranged on the circuit board of the remote imaging display, and the control chip is connected to the touch panel through the driving circuit of the touch panel to obtain the user's interactive operation from the touch panel. In the technical solutions of other embodiments of the present invention, the processor of the terminal device can be reused as the interactive control device. Similarly, the touch panel is connected to the terminal device through a driving circuit so that the terminal device can obtain the user's interactive operation from the touch panel.

[0075] Furthermore, the touch panel includes a plurality of capacitive sensors distributed on the touch panel, the touch panel is composed of two layers of ITO (Indium Tin Oxide) electrodes arranged vertically and staggered with each other, the ITO electrodes are so-called capacitive sensors, and the scanning circuit extracts touch information by scanning the coupling capacitance between each ITO electrode and the ground.

[0076] like Figure 2 As shown, the interactive control device is configured as follows:

[0077] Scanning the touch panel based on a preconfigured scanning frequency to obtain a capacitance image of the touch panel, wherein the capacitance image is a two-dimensional capacitance value image generated by mapping the coupling capacitance between each capacitive sensor on the touch panel and the ground to a standard pixel value interval;

[0078] Determine a display projection area on an observation window of the long-distance imaging display, wherein the display projection area is a projection area on the observation window where a display image on the display screen of the long-distance imaging display viewed by a user through the observation window falls;

[0079] Cutting the capacitive image according to the shape and position of the display projection area to generate a touch operation image;

[0080] Recognizing a touch operation gesture input by a user from the touch operation image;

[0081] Execute the interactive control instruction corresponding to the touch operation gesture.

[0082] Specifically, the standard pixel value interval is a pre-configured standard interval for converting the ground coupling capacitance of the capacitive sensor of the touch panel into the pixel value of the capacitive image, which has an upper limit p of the pixel value interval. b And the upper bound of the pixel value interval p t , exemplarily, the upper bound of the pixel value interval p b =0, the upper limit of the pixel value interval p t =255. By converting the ground coupling capacitance of the capacitive sensor of the touch panel into a standard interval of pixel values ​​of a capacitive image, the capacitive image can be converted into a grayscale image for visual display when processing or testing the capacitive image. The two-dimensional capacitance value image is a grayscale image generated after the ground coupling capacitance of the capacitive sensor is mapped to the standard pixel value interval.

[0083] Further, in the step of scanning the touch panel based on a preconfigured scanning frequency to acquire a capacitive image of the touch panel, the interactive control device is configured as follows:

[0084] Sequentially read the coupling capacitance C of each capacitive sensor on the touch panel to the ground o ;

[0085] The coupling capacitor C o Mapped to the standard pixel value interval to obtain the pixel value p of the current capacitance value of the capacitive sensor on the capacitive image s , the current capacitance value is the coupling capacitance C of the capacitive sensor to ground o ;

[0086] The pixel value p s The capacitive image filled into the current frame corresponds to the pixel position of the capacitive sensor.

[0087] In the technical solution of the above implementation, in the step of mapping the ground coupling capacitance to a standard pixel value interval to obtain a standard capacitance of the capacitive sensor, the interactive control device is configured as follows:

[0088] Get the capacitance lower bound C of the touch panel b And the upper limit of capacitance value C t ;

[0089] Calculate the pixel value of the current capacitance value of the capacitive sensor on the capacitive image:

[0090]

[0091] Due to differences in hardware parameters, different touch panels often have different capacitance ranges, so the lower limit of the capacitance value of the touch panel is C b And the upper limit of capacitance value C t Need to be obtained through regular scanning tests.

[0092] Further, in the step of scanning the touch panel based on a preconfigured scanning frequency to acquire a capacitive image of the touch panel, the interactive control device is configured as follows:

[0093] Sequentially read the coupling capacitance C of each capacitive sensor on the touch panel to the ground o ;

[0094] The coupling capacitor C o Mapped to the standard pixel value interval to obtain the pixel value p of the current capacitance value of the capacitive sensor on the capacitive image s , the current capacitance value is the coupling capacitance C of the capacitive sensor to ground o ;

[0095] The pixel value p s The capacitive image filled into the current frame corresponds to the pixel position of the capacitive sensor.

[0096] In the technical solution of the above implementation, in the step of mapping the ground coupling capacitance to a standard pixel value interval to obtain a standard capacitance of the capacitive sensor, the interactive control device is configured as follows:

[0097] Get the capacitance lower bound C of the touch panel b And the upper limit of capacitance value C t ;

[0098] Calculate the pixel value of the current capacitance value of the capacitive sensor on the capacitive image:

[0099]

[0100] Due to differences in hardware parameters, different touch panels often have different capacitance ranges, so the lower limit of the capacitance value of the touch panel is C b And the upper limit of capacitance value C t Need to be obtained through regular scanning tests.

[0101] Furthermore, in the step of identifying a touch operation gesture input by a user from the touch operation image, the interactive control device is configured to:

[0102] Identifying a touch operation point on the touch operation image, wherein the touch operation point is a coordinate point of a capacitive sensor on the touch panel where a change in coupling capacitance to ground is greater than a preset change threshold when a user approaches or touches the touch panel with a finger or a touch tool;

[0103] Analyzing the position change and timing change of the touch operation points on the touch panel in the continuous multiple-frame touch operation images;

[0104] A touch operation gesture corresponding to the touch operation point is determined according to a position change and a time sequence change of the touch operation point on the touch panel, and the touch operation gesture includes a click operation, a long press operation, and a slide operation.

[0105] Specifically, the user can operate on the touch panel directly with a finger, or can operate on the touch panel through a touch tool such as a stylus. Preferably, the touch panel is a self-capacitive projection touch panel, and when a finger or a stylus is close to any capacitive sensor on the touch panel, the coupling capacitance of the corresponding capacitive sensor to the ground will change. Furthermore, the touch operation gestures also include multi-finger click operation, multi-finger sliding operation, multi-finger pinching operation, multi-finger spreading operation, etc.

[0106] Furthermore, in the step of identifying the touch operation point on the touch operation image, the interactive control device is configured to:

[0107] generating a no-operation image of the touch panel, wherein the no-operation image is a capacitive image generated when the touch panel is powered on and there is no external operation;

[0108] Performing calibration processing on the touch operation image based on the no-operation image to generate a target calibration image;

[0109] Extracting extreme points from the target calibration image;

[0110] The extreme point is determined as a touch operation point on the touch operation image.

[0111] Specifically, when the touch panel is powered on, in the absence of external operation, that is, when no external conductor is close, each capacitive sensor, that is, the ITO electrode, has a basic coupling capacitance C to ground. p When the user's finger or other touch tool approaches or touches the touch panel, the ground coupling capacitance C of the capacitive sensor it is close to is p A coupling capacitor C is superimposed on the h , so that the coupling capacitance of the capacitive sensor to ground becomes C p +C h Due to hardware differences and manufacturing errors, the basic coupling capacitance C of each capacitive sensor to ground is p They will not be completely consistent. In order to improve the accuracy of touch operation detection, it is necessary to generate the no-operation image as a reference image when the touch panel is in a state without external operation, so as to calibrate the touch operation image of the touch panel when receiving the user's touch operation.

[0112] Further, in the step of performing calibration processing on the touch operation image based on the no-operation image to generate a target calibration image, the interactive control device is configured to:

[0113] Subtract the pixel value of the corresponding coordinate in the no-operation image from the pixel value of each pixel in the touch operation image to generate a first calibration image;

[0114] Eliminating random noise in the first calibration image whose pixel value is less than a preset noise threshold value to generate a second calibration image;

[0115] The second calibration image is determined as the target calibration image.

[0116] In the technical solution of the above-mentioned implementation mode, when a finger or a stylus pen approaches the touch panel, the coupling capacitance to ground of the capacitive sensors at the position where the finger or the stylus pen approaches and in its surroundings will change, which will be reflected in the touch operation image as a grayscale area covering multiple capacitive sensors. It is necessary to take the extreme value in the grayscale area to determine the position of the capacitive sensor closest to the user's finger or the stylus pen, and determine it as the operation point.

[0117] Furthermore, the touch panel is a self-capacitive projection touch panel, and before the step of identifying a touch operation gesture input by a user from the touch operation image, the interactive control device is configured as follows:

[0118] Obtain pre-configured icon display distance interval and touch operation distance interval;

[0119] Calculating a real-time distance between an operating body and the touch panel according to the size of the extreme point, wherein the operating body includes a user's finger or a stylus;

[0120] When the real-time distance falls within the icon display distance interval, displaying an operation icon at a corresponding position on the display screen of the long-distance imaging display;

[0121] When the real-time distance falls within the touch operation distance interval, the steps of determining a touch operation gesture corresponding to the touch operation point according to a position change and a timing change of the touch operation point on the touch panel and executing an interactive control instruction corresponding to the touch operation gesture are performed.

[0122] Specifically, within the icon display distance interval, the operation icon moves as the user's finger moves over the touch panel, so that the user can intuitively understand the position where the finger's touch point is mapped to the display screen, thereby avoiding erroneous operations caused by optical path calculation errors or calculation delays.

[0123] Furthermore, in the step of generating the no-operation image of the touch panel, the interactive control device is configured to:

[0124] Get the capacitance image P(t i ), where t i ∈(t b ,t t ), i∈[1,n t ], t b is the starting point of the sampling period, t t is the end point of the sampling period, t i t b to t The i-th sampling time point between tt b to t The number of sampling points between

[0125] Calculate each frame of capacitance image P(t i ) of the capacitance fluctuation amplitude pr(t i ), the capacitance fluctuation amplitude pr(t i ) is the i-th frame capacitive image P(t i ) the capacitance fluctuation amplitude of the pixel position with the largest capacitance fluctuation amplitude;

[0126] Based on the capacitance fluctuation amplitude pr(t i ) constructs the sampling time period (t b ,t t ) capacitance fluctuation amplitude variation curve f(t t );

[0127] Determine the stable interval (tstable) on the capacitance fluctuation amplitude change curve f(t) b ,tstable t );

[0128] Based on the stable interval (tstable b ,tstable t ) to generate a no-operation capacitive image.

[0129] In the technical solution of the above-mentioned embodiment, a sampling point in the sampling time period is a time point for acquiring a capacitive image, and the system generates a capacitive image at a time interval of, that is, the generation frame rate of the capacitive image is

[0130] Further, based on the capacitance fluctuation amplitude pr(t i ) constructs the sampling time period (t b ,t t ), the interactive control device is configured as follows:

[0131] Get the sampling time period (t b ,t t ) is a discrete sequence of capacitance fluctuation amplitudes within:

[0132]

[0133] The discrete sequence of capacitance fluctuation amplitude is fitted into the capacitance fluctuation amplitude variation curve f(t) using a curve fitting algorithm, and the curve fitting algorithm can be any one of a polynomial fitting algorithm, a least squares fitting algorithm, a linear interpolation algorithm or a spline interpolation algorithm.

[0134] Furthermore, when calculating each frame of the capacitance image P(t i ) of the capacitance fluctuation amplitude pr(t i ), the interactive control device is configured as follows:

[0135] Get the sampling time period (t b ,t t ) in each frame of the capacitance image P(t i ) with coordinates x and y in the pixel value p[x,y](t i );

[0136] Calculate the position x, y of each pixel in the sampling time period (t b ,t t ) is the mean of the first pixel in:

[0137]

[0138] Calculate each frame of capacitance image P(t i ) is the relative pixel value of the pixel with coordinates x, y:

[0139]

[0140] Each frame of capacitance image P(t i ) is determined as the capacitance fluctuation amplitude:

[0141]

[0142] Where m s is the maximum number of columns of the capacitive image, n s is the maximum number of rows of the capacitive image.

[0143] Specifically, the capacitance image includes m s ×n s For example, the touch panel has m pixels. s ×n s capacitive sensor. In this case, for any t i The capacitance image P(t i ), satisfying 1≤x≤m s , 1≤y≤n s Similarly, when calculating the position x, y of each pixel point in the sampling time period (t b ,t t ) In the steps, 1≤x≤m s , 1≤y≤n s .

[0144] Furthermore, a stable interval (tstable) is determined on the capacitance fluctuation amplitude variation curve f(t). b ,tstable t ) specifically include:

[0145] Get the preset noise threshold p0;

[0146] Obtain a peak point peak whose amplitude is greater than the noise threshold p0 on the capacitance fluctuation amplitude change curve f(t) j , where j∈[1,n peak ],n peak is the number of peak points on the capacitance fluctuation amplitude variation curve f(t) whose amplitude is greater than the noise threshold p0;

[0147] Calculate the two adjacent peak points peak on the capacitance fluctuation amplitude change curve f(t) j The time interval between:

[0148] Δt_peak j =t(peak j+1 )-t(peak j );

[0149] Determine two adjacent peak points t(peak j0+1 ) and t(peak j0 ) to satisfy:

[0150]

[0151] Where j0 is [1,n peak -1] any integer in the range;

[0152] t(peak j0 ) is determined as the lower bound of the stable interval tstable b , t(peak j0+1 ) is determined as the upper bound of the stable interval tstable t .

[0153] Specifically, t(peak j+1 ) is the peak point on the capacitance fluctuation amplitude variation curve f(t). j+1 ) corresponding to the time point. Similarly, t(peak j ) is the peak point on the capacitance fluctuation amplitude variation curve f(t). j ) corresponding to the time point.

[0154] Further, based on the stable interval (tstable b ,tstable tThe steps of generating a no-operation capacitive image from a capacitive image of the image ) specifically include:

[0155] Read the stable interval (tstable b ,tstable t ) in each frame of the capacitance image P(t k ), where t k ∈(tstable b ,tstable t ), k∈[1,n stable ],n stable is the stable interval (tstable b ,tstable t ) within the capacitive image frame number;

[0156] Calculate the x and y positions of each pixel in the stable interval (tstable b ,tstable t ) within the second pixel mean:

[0157]

[0158] Set each pixel position x, y in the stable interval (tstable b ,tstable t ) The pixel value of the non-operation capacitive image at the pixel position x, y is determined.

[0159] Furthermore, the step of determining the display projection area on the observation window of the long-distance imaging display specifically includes:

[0160] Get the real-time position of the user's two eyes;

[0161] The midpoint of the line connecting the real-time positions of the two eyes of the user is determined as the observation point;

[0162] Calculating four first optical paths between the observation point and four inner corners of the display screen of the long-distance imaging display;

[0163] Determine the four inner angle intersection points of the four optical paths and the plane where the observation window is located;

[0164] An area surrounded by the lines connecting the four intersection points is determined as the display projection area.

[0165] Specifically, the first optical path is a path starting from one of the inner corners of the display screen, where the light is reflected by the beam splitter to the concave mirror, and then reflected by the concave mirror and passes through the beam splitter and the observation window to reach the light measuring point. Since the observation window is located between the optical path of the display screen and the user's eyes, and the display screen of the display screen is reflected and magnified by the beam splitter and the concave mirror, when the user's eye position is different, the optical path corresponding to the line connecting the four corners of the display screen, i.e., the four inner corners of the long-distance imaging display, is also different, that is, the offset of the user's eye position will inevitably cause the projection position of the display screen on the observation window to change. In the technical solutions of some embodiments of the present invention, the long-distance imaging display further includes an image sensor for real-time monitoring of the user's eye position, and the image sensor is used to obtain the user's eye position in real time to determine the projection area of ​​the display screen of the display screen on the observation window. In the technical solutions of the above embodiments, when the coordinates of the observation point and the four inner corners of the display screen are known, the coordinates of the inner angle intersection of the first optical path and the plane where the observation window is located can be calculated.

[0166] Furthermore, the step of determining the touch operation gesture corresponding to the touch operation point according to the position change and the time sequence change of the touch operation point on the touch panel specifically includes:

[0167] Determining a second optical path corresponding to a line connecting the touch operation point and the observation point according to the position of the observation point;

[0168] Determine an intersection point of the second optical path and the display screen as a mapping point of the touch operation point on the display screen;

[0169] The touch operation gesture corresponding to the mapping point is determined according to the position change and the time sequence change of the mapping point on the display screen.

[0170] Specifically, the second optical path is a path starting from the mapping point, where the light is reflected by the beam splitter to the concave mirror, and then reflected by the concave mirror, passes through the beam splitter and the observation window, and reaches the light measuring point. The intersection of the second optical path and the observation window is the touch operation point. In the technical solution of the above embodiment, when the coordinates of the observation point and the touch operation point are known, the coordinates of the mapping point, i.e., the second optical path falling on the display screen, can be inferred in reverse.

[0171] like Figure 2 As shown, the second aspect of the present invention provides an interactive control method for a long-distance imaging display, comprising:

[0172] Scanning the touch panel based on a preconfigured scanning frequency to obtain a capacitance image of the touch panel, wherein the capacitance image is a two-dimensional capacitance value image generated by mapping the coupling capacitance between each capacitive sensor on the touch panel and the ground to a standard pixel value interval;

[0173] Determine a display projection area on an observation window of the long-distance imaging display, wherein the display projection area is a projection area on the observation window where a display image on the display screen of the long-distance imaging display viewed by a user through the observation window falls;

[0174] Cutting the capacitive image according to the shape and position of the display projection area to generate a touch operation image;

[0175] Recognizing a touch operation gesture input by a user from the touch operation image;

[0176] Execute the interactive control instruction corresponding to the touch operation gesture.

[0177] Specifically, the standard pixel value interval is a pre-configured standard interval for converting the ground coupling capacitance of the capacitive sensor of the touch panel into the pixel value of the capacitive image, which has an upper limit p of the pixel value interval. b And the upper bound of the pixel value interval p t , exemplarily, the upper bound of the pixel value interval p b =0, the upper limit of the pixel value interval p t =255. By converting the ground coupling capacitance of the capacitive sensor of the touch panel into a standard interval of pixel values ​​of a capacitive image, the capacitive image can be converted into a grayscale image for visual display when processing or testing the capacitive image. The two-dimensional capacitance value image is a grayscale image generated after the ground coupling capacitance of the capacitive sensor is mapped to the standard pixel value interval.

[0178] Furthermore, the step of scanning the touch panel based on a preconfigured scanning frequency to obtain a capacitive image of the touch panel specifically includes:

[0179] Sequentially read the coupling capacitance C of each capacitive sensor on the touch panel to the ground o ;

[0180] The coupling capacitor C o Mapping to the standard pixel value interval to obtain the pixel value p of the current capacitance value of the capacitive sensor on the capacitive image s , the current capacitance value is the coupling capacitance C of the capacitive sensor to ground o ;

[0181] The pixel value p sThe capacitive image filled into the current frame corresponds to the pixel position of the capacitive sensor.

[0182] In the technical solution of the above implementation, the step of mapping the ground coupling capacitance to a standard pixel value interval to obtain the standard capacitance of the capacitive sensor specifically includes:

[0183] Get the capacitance lower bound C of the touch panel b And the upper limit of capacitance value C t ;

[0184] Calculate the pixel value of the current capacitance value of the capacitive sensor on the capacitive image:

[0185]

[0186] Due to differences in hardware parameters, different touch panels often have different capacitance ranges, so the lower limit of the capacitance value of the touch panel is C b And the upper limit of capacitance value C t Need to be obtained through regular scanning tests.

[0187] Furthermore, the step of identifying the touch operation gesture input by the user from the touch operation image specifically includes:

[0188] Identifying a touch operation point on the touch operation image, wherein the touch operation point is a coordinate point of a capacitive sensor on the touch panel where a change in coupling capacitance to ground is greater than a preset change threshold when a user approaches or touches the touch panel with a finger or a touch tool;

[0189] Analyzing the position change and timing change of the touch operation points on the touch panel in the continuous multiple-frame touch operation images;

[0190] A touch operation gesture corresponding to the touch operation point is determined according to a position change and a time sequence change of the touch operation point on the touch panel, and the touch operation gesture includes a click operation, a long press operation, and a slide operation.

[0191] Specifically, the user can operate on the touch panel directly with a finger, or can operate on the touch panel through a touch tool such as a stylus. Preferably, the touch panel is a self-capacitive projection touch panel, and when a finger or a stylus is close to any capacitive sensor on the touch panel, the coupling capacitance of the corresponding capacitive sensor to the ground will change. Furthermore, the touch operation gestures also include multi-finger click operation, multi-finger sliding operation, multi-finger pinching operation, multi-finger spreading operation, etc.

[0192] Furthermore, the step of identifying the touch operation point on the touch operation image specifically includes:

[0193] generating a no-operation image of the touch panel, wherein the no-operation image is a capacitive image generated when the touch panel is powered on and there is no external operation;

[0194] Performing calibration processing on the touch operation image based on the no-operation image to generate a target calibration image;

[0195] Extracting extreme points from the target calibration image;

[0196] The extreme point is determined as a touch operation point on the touch operation image.

[0197] Specifically, when the touch panel is powered on, in the absence of external operation, that is, when no external conductor is close, each capacitive sensor, that is, the ITO electrode, has a basic coupling capacitance C to ground. p When the user's finger or other touch tool approaches or touches the touch panel, the ground coupling capacitance C of the capacitive sensor it is close to is p A coupling capacitor C is superimposed on the h , so that the coupling capacitance of the capacitive sensor to ground becomes C p +C h Due to hardware differences and manufacturing errors, the basic coupling capacitance C of each capacitive sensor to ground is p They will not be completely consistent. In order to improve the accuracy of touch operation detection, it is necessary to generate the no-operation image as a reference image when the touch panel is in a state without external operation, so as to calibrate the touch operation image of the touch panel when receiving the user's touch operation.

[0198] Furthermore, the step of performing calibration processing on the touch operation image based on the no-operation image to generate a target calibration image specifically includes:

[0199] Subtract the pixel value of the corresponding coordinate in the no-operation image from the pixel value of each pixel in the touch operation image to generate a first calibration image;

[0200] Eliminating random noise in the first calibration image whose pixel value is less than a preset noise threshold value to generate a second calibration image;

[0201] The second calibration image is determined as the target calibration image.

[0202] In the technical solution of the above-mentioned implementation mode, when a finger or a stylus pen approaches the touch panel, the coupling capacitance to ground of the capacitive sensors at the position where the finger or the stylus pen approaches and in its surroundings will change, which will be reflected in the touch operation image as a grayscale area covering multiple capacitive sensors. It is necessary to take the extreme value in the grayscale area to determine the position of the capacitive sensor closest to the user's finger or the stylus pen, and determine it as the operation point.

[0203] Furthermore, the touch panel is a self-capacitive projection touch panel, and before the step of identifying the touch operation gesture input by the user from the touch operation image, the method further includes:

[0204] Obtain pre-configured icon display distance interval and touch operation distance interval;

[0205] Calculating a real-time distance between an operating body and the touch panel according to the size of the extreme point, wherein the operating body includes a user's finger or a stylus;

[0206] When the real-time distance falls within the icon display distance interval, displaying an operation icon at a corresponding position on the display screen of the long-distance imaging display;

[0207] When the real-time distance falls within the touch operation distance interval, the steps of determining a touch operation gesture corresponding to the touch operation point according to a position change and a timing change of the touch operation point on the touch panel and executing an interactive control instruction corresponding to the touch operation gesture are performed.

[0208] Specifically, within the icon display distance interval, the operation icon moves as the user's finger moves over the touch panel, so that the user can intuitively understand the position where the finger's touch point is mapped to the display screen, thereby avoiding erroneous operations caused by optical path calculation errors or calculation delays.

[0209] Furthermore, the step of generating the no-operation image of the touch panel specifically includes:

[0210] Get the capacitance image P(t i ), where t i ∈(t b ,t t ), i∈[1,n t ], t b is the starting point of the sampling period, t t is the end point of the sampling period, t i t b to t The i-th sampling time point between t t b tot The number of sampling points between

[0211] Calculate each frame of capacitance image P(t i ) of the capacitance fluctuation amplitude pr(t i ), the capacitance fluctuation amplitude pr(t i ) is the i-th frame capacitive image P(t i ) the capacitance fluctuation amplitude of the pixel position with the largest capacitance fluctuation amplitude;

[0212] Based on the capacitance fluctuation amplitude pr(t i ) constructs the sampling time period (t b ,t t ) is the capacitance fluctuation amplitude variation curve f(t);

[0213] Determine the stable interval (tstable) on the capacitance fluctuation amplitude change curve f(t) b ,tstable t );

[0214] Based on the stable interval (tstable b ,tstable t ) to generate a no-operation capacitive image.

[0215] In the technical solution of the above-mentioned embodiment, a sampling point in the sampling time period is a time point for acquiring a capacitive image, and the system generates a capacitive image at a time interval of, that is, the generation frame rate of the capacitive image is

[0216] Further, based on the capacitance fluctuation amplitude pr(t i ) constructs the sampling time period (t b ,t t The steps of calculating the capacitance fluctuation amplitude variation curve f(t) within ) specifically include:

[0217] Get the sampling time period (t b ,t t ) is the discrete sequence of capacitance fluctuation amplitude within:

[0218]

[0219] The discrete sequence of capacitance fluctuation amplitude is fitted into the capacitance fluctuation amplitude variation curve f(t) using a curve fitting algorithm, and the curve fitting algorithm can be any one of a polynomial fitting algorithm, a least squares fitting algorithm, a linear interpolation algorithm or a spline interpolation algorithm.

[0220] Furthermore, the capacitance image P(t i ) of the capacitance fluctuation amplitude pr(ti ) specifically include:

[0221] Get the sampling time period (t b ,t i ) in each frame of the capacitance image P(t i ) with coordinates x and y in the pixel value p[x,y](t i );

[0222] Calculate the position x, y of each pixel in the sampling time period (t b ,t t ) is the mean of the first pixel in:

[0223]

[0224] Calculate each frame of capacitance image P(t i ) is the relative pixel value of the pixel with coordinates x, y:

[0225]

[0226] Each frame of capacitance image P(t i ) is determined as the capacitance fluctuation amplitude:

[0227]

[0228] Where m s is the maximum number of columns of the capacitive image, n s is the maximum number of rows of the capacitive image.

[0229] Specifically, the capacitance image includes m s ×n s For example, the touch panel has m pixels. s ×n s capacitive sensor. In this case, for any t i The capacitance image P(t i ), satisfying 1≤x≤m s , 1≤y≤n s Similarly, when calculating the position x, y of each pixel point in the sampling time period (t b ,t t ) In the steps, 1≤x≤m s , 1≤y≤n s .

[0230] Furthermore, a stable interval (tstable) is determined on the capacitance fluctuation amplitude variation curve f(t). b ,tstable t ) specifically include:

[0231] Get the preset noise threshold p0;

[0232] Obtain a peak point peak whose amplitude is greater than the noise threshold p0 on the capacitance fluctuation amplitude change curve f(t) j , where j∈[1,n peak ],n peak is the number of peak points on the capacitance fluctuation amplitude variation curve f(t) whose amplitude is greater than the noise threshold p0;

[0233] Calculate the two adjacent peak points peak on the capacitance fluctuation amplitude change curve f(t) j The time interval between:

[0234] Δt_peak j =t(peak j+1 )-t(peak j );

[0235] Determine two adjacent peak points t(peak j0+1 ) and t(peak j0 ) to satisfy:

[0236]

[0237] Where j0 is [1,n peak -1] any integer in the range;

[0238] t(peak j0 ) is determined as the lower bound of the stable interval tstable b , t(peak j0+1 ) is determined as the upper bound of the stable interval tstable t .

[0239] Specifically, t(peak j+1 ) is the peak point on the capacitance fluctuation amplitude variation curve f(t). j+1 ) corresponding to the time point. Similarly, t(peak j ) is the peak point on the capacitance fluctuation amplitude variation curve f(t). j ) corresponding to the time point.

[0240] Further, based on the stable interval (tstable b ,tstable t The steps of generating a no-operation capacitive image from a capacitive image of the image ) specifically include:

[0241] Read the stable interval (tstable b,tstable t ) in each frame of the capacitance image P(t k ), where t k ∈(tstable b ,tstable t ), k∈[1,n stable ],n stable is the stable interval (tstable b ,tstable t ) within the capacitive image frame number;

[0242] Calculate the x and y positions of each pixel in the stable interval (tstable b ,tstable t ) within the second pixel mean:

[0243]

[0244] Set each pixel position x, y in the stable interval (tstable b ,tstable t ) The pixel value of the no-operation capacitive image at the pixel position x, y is determined.

[0245] Furthermore, the step of determining the display projection area on the observation window of the long-distance imaging display specifically includes:

[0246] Get the real-time position of the user's two eyes;

[0247] The midpoint of the line connecting the real-time positions of the two eyes of the user is determined as the observation point;

[0248] Calculating four first optical paths between the observation point and four inner corners of the display screen of the long-distance imaging display;

[0249] Determine the four inner angle intersection points of the four optical paths and the plane where the observation window is located;

[0250] An area surrounded by the lines connecting the four intersection points is determined as the display projection area.

[0251] Specifically, the first optical path is a path starting from one of the inner corners of the display screen, where the light is reflected by the beam splitter to the concave mirror, and then reflected by the concave mirror and passes through the beam splitter and the observation window to reach the light measuring point. Since the observation window is located between the optical path of the display screen and the user's eyes, and the display screen of the display screen is reflected and magnified by the beam splitter and the concave mirror, when the user's eye position is different, the optical path corresponding to the line connecting the four corners of the display screen, i.e., the four inner corners of the long-distance imaging display, is also different, that is, the offset of the user's eye position will inevitably cause the projection position of the display screen on the observation window to change. In the technical solutions of some embodiments of the present invention, the long-distance imaging display further includes an image sensor for real-time monitoring of the user's eye position, and the image sensor is used to obtain the user's eye position in real time to determine the projection area of ​​the display screen of the display screen on the observation window. In the technical solutions of the above embodiments, when the coordinates of the observation point and the four inner corners of the display screen are known, the coordinates of the inner angle intersection of the first optical path and the plane where the observation window is located can be calculated.

[0252] Furthermore, the step of determining the touch operation gesture corresponding to the touch operation point according to the position change and the time sequence change of the touch operation point on the touch panel specifically includes:

[0253] Determining a second optical path corresponding to a line connecting the touch operation point and the observation point according to the position of the observation point;

[0254] Determine an intersection point of the second optical path and the display screen as a mapping point of the touch operation point on the display screen;

[0255] The touch operation gesture corresponding to the mapping point is determined according to the position change and the time sequence change of the mapping point on the display screen.

[0256] Specifically, the second optical path is a path starting from the mapping point, where the light is reflected by the beam splitter to the concave mirror, and then reflected by the concave mirror, passes through the beam splitter and the observation window, and reaches the light measuring point. The intersection of the second optical path and the observation window is the touch operation point. In the technical solution of the above embodiment, when the coordinates of the observation point and the touch operation point are known, the coordinates of the mapping point, i.e., the second optical path falling on the display screen, can be inferred in reverse.

[0257] The third aspect of the present invention proposes an interactive control system for a long-distance imaging display, including a long-distance imaging display for performing long-distance magnified imaging of display content and a terminal device for providing display content, wherein the long-distance imaging display includes a display screen arranged at the bottom of the long-distance imaging display with its front side facing upward, a circuit board electrically connected to the display screen, a spectroscope arranged above the display screen, a concave mirror arranged on one side of the spectroscope, and an observation window arranged on the other side of the spectroscope, and the interactive control system also includes a touch panel for receiving a user's touch input operation and an interactive control device connected to the touch panel and the terminal device. A first communication module for communicating with the terminal device is provided on the circuit board, and the circuit board obtains display content from the terminal device through the first communication module and provides it to the display screen. Furthermore, a second communication module for communicating with the terminal device is provided on the touch panel, and after the first communication module and the second communication module establish a communication connection, the terminal device receives the touch operation on the touch panel through the second communication module, and controls the display content provided to the circuit board in response to the touch operation.

[0258] Exemplarily, the first communication module and the second communication module can be wireless communication modules such as Wi-Fi or Bluetooth, or wired communication modules connected by wired communication through PS / 2 interface, USB interface, etc. The touch panel is connected to the terminal device by wire or wireless means, and the user can input touch operations to the terminal device by holding the touch panel to control the display content on the remote imaging display. In the technical solutions of some embodiments of the present invention, the interactive control device is a control chip arranged on the circuit board of the remote imaging display, and the control chip is connected to the touch panel through the driving circuit of the touch panel to obtain the user's interactive operation from the touch panel. In the technical solutions of other embodiments of the present invention, the processor of the terminal device can be reused as the interactive control device. Similarly, the touch panel is connected to the terminal device through the driving circuit so that the terminal device can obtain the user's interactive operation from the touch panel.

[0259] Furthermore, the touch panel includes a plurality of capacitive sensors distributed on the touch panel, the touch panel is composed of two layers of ITO (Indium Tin Oxide) electrodes arranged vertically and staggered with each other, the ITO electrodes are so-called capacitive sensors, and the scanning circuit extracts touch information by scanning the coupling capacitance between each ITO electrode and the ground.

[0260] In the above interactive control system for a remote imaging display, the interactive control device is configured as follows:

[0261] Scanning the touch panel based on a preconfigured scanning frequency to obtain a capacitance image of the touch panel, wherein the capacitance image is a two-dimensional capacitance value image generated by mapping the coupling capacitance between each capacitive sensor on the touch panel and the ground to a standard pixel value interval;

[0262] Generating a touch operation image corresponding to the capacitive image;

[0263] Recognizing a touch operation gesture input by a user from the touch operation image;

[0264] Execute the interactive control instruction corresponding to the touch operation gesture.

[0265] Specifically, the standard pixel value interval is a pre-configured standard interval for converting the ground coupling capacitance of the capacitive sensor of the touch panel into the pixel value of the capacitive image, which has an upper limit p of the pixel value interval. b And the upper bound of the pixel value interval p t , exemplarily, the upper bound of the pixel value interval p b =0, the upper limit of the pixel value interval p t =255. By converting the ground coupling capacitance of the capacitive sensor of the touch panel into a standard interval of pixel values ​​of a capacitive image, the capacitive image can be converted into a grayscale image for visual display when processing or testing the capacitive image. The two-dimensional capacitance value image is a grayscale image generated after the ground coupling capacitance of the capacitive sensor is mapped to the standard pixel value interval.

[0266] Further, in the step of scanning the touch panel based on a preconfigured scanning frequency to acquire a capacitive image of the touch panel, the interactive control device is configured as follows:

[0267] Sequentially read the coupling capacitance C of each capacitive sensor on the touch panel to the ground o ;

[0268] The coupling capacitor C o Mapping to the standard pixel value interval to obtain the pixel value p of the current capacitance value of the capacitive sensor on the capacitive image s , the current capacitance value is the coupling capacitance C of the capacitive sensor to ground o ;

[0269] The pixel value p s The capacitive image filled into the current frame corresponds to the pixel position of the capacitive sensor.

[0270] In the technical solution of the above implementation, in the step of mapping the ground coupling capacitance to a standard pixel value interval to obtain a standard capacitance of the capacitive sensor, the interactive control device is configured as follows:

[0271] Get the capacitance lower bound C of the touch panel b And the upper limit of capacitance value C t ;

[0272] Calculate the pixel value of the current capacitance value of the capacitive sensor on the capacitive image:

[0273]

[0274] Due to differences in hardware parameters, different touch panels often have different capacitance ranges, so the lower limit of the capacitance value of the touch panel is C b And the upper limit of capacitance value C t Need to be obtained through regular scanning tests.

[0275] Further, in the step of scanning the touch panel based on a preconfigured scanning frequency to acquire a capacitive image of the touch panel, the interactive control device is configured as follows:

[0276] Sequentially read the coupling capacitance C of each capacitive sensor on the touch panel to the ground o ;

[0277] The coupling capacitor C o Mapping to the standard pixel value interval to obtain the pixel value p of the current capacitance value of the capacitive sensor on the capacitive image s , the current capacitance value is the coupling capacitance C of the capacitive sensor to ground o ;

[0278] The pixel value p s The capacitive image filled into the current frame corresponds to the pixel position of the capacitive sensor.

[0279] In the technical solution of the above implementation, in the step of mapping the ground coupling capacitance to a standard pixel value interval to obtain a standard capacitance of the capacitive sensor, the interactive control device is configured as follows:

[0280] Get the capacitance lower bound C of the touch panel b And the upper limit of capacitance value C t ;

[0281] Calculate the pixel value of the current capacitance value of the capacitive sensor on the capacitive image:

[0282]

[0283] Due to differences in hardware parameters, different touch panels often have different capacitance ranges, so the lower limit of the capacitance value of the touch panel is C b And the upper limit of capacitance value C t Need to be obtained through regular scanning tests.

[0284] Furthermore, in the step of identifying a touch operation gesture input by a user from the touch operation image, the interactive control device is configured to:

[0285] Identifying a touch operation point on the touch operation image, wherein the touch operation point is a coordinate point of a capacitive sensor on the touch panel where a change in coupling capacitance to ground is greater than a preset change threshold when a user approaches or touches the touch panel with a finger or a touch tool;

[0286] Analyzing the position change and timing change of the touch operation points on the touch panel in the continuous multiple-frame touch operation images;

[0287] A touch operation gesture corresponding to the touch operation point is determined according to a position change and a time sequence change of the touch operation point on the touch panel, and the touch operation gesture includes a click operation, a long press operation, and a slide operation.

[0288] Specifically, the user can operate on the touch panel directly with a finger, or can operate on the touch panel through a touch tool such as a stylus. Preferably, the touch panel is a self-capacitive projection touch panel, and when a finger or a stylus is close to any capacitive sensor on the touch panel, the coupling capacitance of the corresponding capacitive sensor to the ground will change. Furthermore, the touch operation gestures also include multi-finger click operation, multi-finger sliding operation, multi-finger pinching operation, multi-finger spreading operation, etc.

[0289] Furthermore, in the step of identifying the touch operation point on the touch operation image, the interactive control device is configured to:

[0290] generating a no-operation image of the touch panel, wherein the no-operation image is a capacitive image generated when the touch panel is powered on and there is no external operation;

[0291] Performing calibration processing on the touch operation image based on the no-operation image to generate a target calibration image;

[0292] Extracting extreme points from the target calibration image;

[0293] The extreme point is determined as a touch operation point on the touch operation image.

[0294] Specifically, when the touch panel is powered on, in the absence of external operation, that is, when no external conductor is close, each capacitive sensor, that is, the ITO electrode, has a basic coupling capacitance C to ground. p When the user's finger or other touch tool approaches or touches the touch panel, the ground coupling capacitance C of the capacitive sensor it is close to is p A coupling capacitor C is superimposed on the h , so that the coupling capacitance of the capacitive sensor to ground becomes C p +C h Due to hardware differences and manufacturing errors, the basic coupling capacitance C of each capacitive sensor to ground is p They will not be completely consistent. In order to improve the accuracy of touch operation detection, it is necessary to generate the no-operation image as a reference image when the touch panel is in a state without external operation, so as to calibrate the touch operation image of the touch panel when receiving the user's touch operation.

[0295] Further, in the step of performing calibration processing on the touch operation image based on the no-operation image to generate a target calibration image, the interactive control device is configured to:

[0296] Subtract the pixel value of the corresponding coordinate in the no-operation image from the pixel value of each pixel in the touch operation image to generate a first calibration image;

[0297] Eliminating random noise in the first calibration image whose pixel value is less than a preset noise threshold value to generate a second calibration image;

[0298] The second calibration image is determined as the target calibration image.

[0299] In the technical solution of the above-mentioned implementation mode, when a finger or a stylus pen approaches the touch panel, the coupling capacitance to ground of the capacitive sensors at the position where the finger or the stylus pen approaches and in its surroundings will change, which will be reflected in the touch operation image as a grayscale area covering multiple capacitive sensors. It is necessary to take the extreme value in the grayscale area to determine the position of the capacitive sensor closest to the user's finger or the stylus pen, and determine it as the operation point.

[0300] Furthermore, the touch panel is a self-capacitive projection touch panel, and before the step of identifying a touch operation gesture input by a user from the touch operation image, the interactive control device is configured as follows:

[0301] Obtain pre-configured icon display distance interval and touch operation distance interval;

[0302] Calculating a real-time distance between an operating body and the touch panel according to the size of the extreme point, wherein the operating body includes a user's finger or a stylus;

[0303] When the real-time distance falls within the icon display distance interval, displaying an operation icon at a corresponding position on the display screen of the long-distance imaging display;

[0304] When the real-time distance falls within the touch operation distance interval, the steps of determining a touch operation gesture corresponding to the touch operation point according to a position change and a timing change of the touch operation point on the touch panel and executing an interactive control instruction corresponding to the touch operation gesture are performed.

[0305] Specifically, within the icon display distance interval, the operation icon moves as the user's finger moves over the touch panel, so that the user can intuitively understand the position where the finger's touch point is mapped to the display screen, thereby avoiding erroneous operations caused by optical path calculation errors or calculation delays.

[0306] Furthermore, in the step of generating the no-operation image of the touch panel, the interactive control device is configured to:

[0307] Get the capacitance image P(t i ), where t i ∈(t b ,t t ), i∈[1,n t ], t b is the starting point of the sampling period, t t is the end point of the sampling period, t i t b to t The i-th sampling time point between t t b to t The number of sampling points between

[0308] Calculate each frame of capacitance image P(t i ) of the capacitance fluctuation amplitude pr(t i ), the capacitance fluctuation amplitude pr(t i ) is the i-th frame capacitive image P(t i ) the capacitance fluctuation amplitude of the pixel position with the largest capacitance fluctuation amplitude;

[0309] Based on the capacitance fluctuation amplitude pr(t i ) constructs the sampling time period (t b ,t t ) is the capacitance fluctuation amplitude variation curve f(t);

[0310] Determine the stable interval (tstable) on the capacitance fluctuation amplitude change curve f(t) b ,tstable t );

[0311] Based on the stable interval (tstable b ,tstable t ) to generate a no-operation capacitive image.

[0312] In the technical solution of the above-mentioned embodiment, a sampling point in the sampling time period is a time point for acquiring a capacitive image, and the system generates a capacitive image at a time interval of, that is, the generation frame rate of the capacitive image is

[0313] Further, based on the capacitance fluctuation amplitude pr(t i ) constructs the sampling time period (t b ,t t ), the interactive control device is configured as follows:

[0314] Get the sampling time period (t b ,t t ) is the discrete sequence of capacitance fluctuation amplitude within:

[0315]

[0316] The discrete sequence of capacitance fluctuation amplitude is fitted into the capacitance fluctuation amplitude variation curve f(t) using a curve fitting algorithm, and the curve fitting algorithm can be any one of a polynomial fitting algorithm, a least squares fitting algorithm, a linear interpolation algorithm or a spline interpolation algorithm.

[0317] Furthermore, when calculating each frame of the capacitance image P(t i ) of the capacitance fluctuation amplitude pr(t i ), the interactive control device is configured as follows:

[0318] Get the sampling time period (t b ,t t ) in each frame of the capacitance image P(t i ) with coordinates x and y in the pixel value p[x,y](t i );

[0319] Calculate the position x, y of each pixel in the sampling time period (t b ,t t ) is the mean of the first pixel in:

[0320]

[0321] Calculate each frame of capacitance image P(t i ) is the relative pixel value of the pixel with coordinates x, y:

[0322]

[0323] Each frame of capacitance image P(t i ) is determined as the capacitance fluctuation amplitude:

[0324]

[0325] Where m s is the maximum number of columns of the capacitive image, n s is the maximum number of rows of the capacitive image.

[0326] Specifically, the capacitance image includes m s ×n s For example, the touch panel has m pixels. s ×n s capacitive sensor. In this case, for any t i The capacitance image P(t i ), satisfying 1≤x≤m s , 1≤y≤n s Similarly, when calculating the position x, y of each pixel point in the sampling time period (t b ,t t ) In the steps, 1≤x≤m s , 1≤y≤n s .

[0327] Furthermore, a stable interval (tstable) is determined on the capacitance fluctuation amplitude variation curve f(t). b ,tstable t ) specifically include:

[0328] Get the preset noise threshold p0;

[0329] Obtain a peak point peak whose amplitude is greater than the noise threshold p0 on the capacitance fluctuation amplitude change curve f(t) j , where j∈[1,n peak ],n peak is the number of peak points on the capacitance fluctuation amplitude variation curve f(t) whose amplitude is greater than the noise threshold p0;

[0330] Calculate the two adjacent peak points peak on the capacitance fluctuation amplitude change curve f(t) j The time interval between:

[0331] Δt_peak j =t(peak j+1 )-t(peak j );

[0332] Determine two adjacent peak points t(peak j0+1 ) and t(peak j0 ) to satisfy:

[0333]

[0334] Where j0 is [1,n peak -1] any integer in the range;

[0335] t(peak j0 ) is determined as the lower bound of the stable interval tstale b , t(peak j0+1 ) is determined as the upper bound of the stable interval tstable t .

[0336] Specifically, t(peak j+1 ) is the peak point on the capacitance fluctuation amplitude variation curve f(t). j+1 ) corresponding to the time point. Similarly, t(peak j ) is the peak point on the capacitance fluctuation amplitude variation curve f(t). j ) corresponding to the time point.

[0337] Further, based on the stable interval (tstable b ,tstable t The steps of generating a no-operation capacitive image from a capacitive image of the image ) specifically include:

[0338] Read the stable interval (tstable b ,tstable t ) in each frame of the capacitance image P(t k ), where t k ∈(tstable b ,tstable t ), k∈[1,n stable ],n stable is the stable interval (tstable b ,tstable t ) within the capacitive image frame number;

[0339] Calculate the x and y positions of each pixel in the stable interval (tstable b,tstable t ) within the second pixel mean:

[0340]

[0341] Set each pixel position x, y in the stable interval (tstable b ,tstable t ) The pixel value of the non-operation capacitive image at the pixel position x, y is determined.

[0342] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the statement "comprise a ..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0343] According to the embodiments of the present invention as described above, these embodiments do not describe all the details in detail, nor do they limit the invention to the specific embodiments described. Obviously, many modifications and changes can be made based on the above description. This specification selects and specifically describes these embodiments in order to better explain the principles and practical applications of the present invention, so that those skilled in the art can make good use of the present invention and the modified use based on the present invention. The present invention is limited only by the claims and their full scope and equivalents.

Claims

1. An interactive control system for a remote imaging display, characterized in that: The invention comprises a long-distance imaging display for performing long-distance magnified imaging of display content and a terminal device for providing display content, wherein the long-distance imaging display comprises a display screen arranged at the bottom of the long-distance imaging display with its front side facing upward, a circuit board electrically connected to the display screen, a spectroscope arranged above the display screen, a concave mirror arranged on one side of the spectroscope, and an observation window arranged on the other side of the spectroscope, wherein a communication module for communicating with the terminal device is arranged on the circuit board, and the circuit board obtains display content from the terminal device through the communication module and provides it to the display screen, and the interactive control system further comprises a touch panel arranged on the observation window and an interactive control device connected to the touch panel and the terminal device, wherein the interactive control device is configured as follows: Scanning the touch panel based on a preconfigured scanning frequency to obtain a capacitance image of the touch panel, wherein the capacitance image is a two-dimensional capacitance value image generated by mapping the coupling capacitance between each capacitive sensor on the touch panel and the ground to a standard pixel value interval, and the two-dimensional capacitance value image is a grayscale image generated after the coupling capacitance of the capacitive sensor to the ground is mapped to the standard pixel value interval; Determine a display projection area on an observation window of the long-distance imaging display, wherein the display projection area is a projection area on the observation window where a display image on the display screen of the long-distance imaging display viewed by a user through the observation window falls; Cutting the capacitive image according to the shape and position of the display projection area to generate a touch operation image; Identifying a touch operation gesture input by a user from the touch operation image; Execute the interactive control instruction corresponding to the touch operation gesture.

2. An interactive control method for a long-distance imaging display, characterized in that: include: Scanning the touch panel based on a preconfigured scanning frequency to obtain a capacitance image of the touch panel, wherein the capacitance image is a two-dimensional capacitance value image generated by mapping the coupling capacitance between each capacitive sensor on the touch panel and the ground to a standard pixel value interval, and the two-dimensional capacitance value image is a grayscale image generated after the coupling capacitance of the capacitive sensor to the ground is mapped to the standard pixel value interval; Determine a display projection area on an observation window of the long-distance imaging display, wherein the display projection area is a projection area on the observation window where a display image on the display screen of the long-distance imaging display viewed by a user through the observation window falls; Cutting the capacitive image according to the shape and position of the display projection area to generate a touch operation image; Identifying a touch operation gesture input by a user from the touch operation image; Execute the interactive control instruction corresponding to the touch operation gesture.

3. The interactive control method for a long-distance imaging display according to claim 2, characterized in that: The step of identifying the touch operation gesture input by the user from the touch operation image specifically includes: Identifying a touch operation point on the touch operation image, where the touch operation point is a coordinate point of a capacitive sensor on the touch panel where a change in coupling capacitance to ground is greater than a preset change threshold when a user approaches or touches the touch panel with a finger or a touch tool; Analyzing the position change and timing change of the touch operation points on the touch panel in the continuous multiple-frame touch operation images; A touch operation gesture corresponding to the touch operation point is determined according to a position change and a time sequence change of the touch operation point on the touch panel, and the touch operation gesture includes a click operation, a long press operation, and a slide operation.

4. The interactive control method for a long-distance imaging display according to claim 3, characterized in that: The step of identifying the touch operation point on the touch operation image specifically includes: generating a no-operation image of the touch panel, wherein the no-operation image is a capacitive image generated when the touch panel is powered on and there is no external operation; Performing calibration processing on the touch operation image based on the no-operation image to generate a target calibration image; Extracting extreme points from the target calibration image; The extreme point is determined as a touch operation point on the touch operation image.

5. The interactive control method for a long-distance imaging display according to claim 4, characterized in that: The touch panel is a self-capacitive projection touch panel, and before the step of identifying a touch operation gesture input by a user from the touch operation image, the step further includes: Obtain pre-configured icon display distance interval and touch operation distance interval; Calculating a real-time distance between an operating body and the touch panel according to the size of the extreme point, wherein the operating body includes a user's finger or a stylus; When the real-time distance falls within the icon display distance interval, displaying an operation icon at a corresponding position on the display screen of the long-distance imaging display; When the real-time distance falls within the touch operation distance interval, the steps of determining a touch operation gesture corresponding to the touch operation point according to a position change and a timing change of the touch operation point on the touch panel and executing an interactive control instruction corresponding to the touch operation gesture are performed.

6. The interactive control method for a long-distance imaging display according to claim 4, characterized in that: The step of generating the no-operation image of the touch panel specifically includes: Get the capacitance image P(t i ), where t i ∈(t b ,t t ), i∈[1,n t ], t b is the starting point of the sampling period, t t is the end point of the sampling period, t i t b to t The i-th sampling time point between t t b to t The number of sampling points between Calculate each frame of capacitance image P(t i ) of the capacitance fluctuation amplitude pr(t i ), the capacitance fluctuation amplitude pr(t i ) is the i-th frame capacitive image P(t i ) the capacitance fluctuation amplitude of the pixel position with the largest capacitance fluctuation amplitude; Based on the capacitance fluctuation amplitude pr(t i ) constructs the sampling time period (t b , t t ) is the capacitance fluctuation amplitude variation curve f(t); Determine the stable interval (tstable) on the capacitance fluctuation amplitude change curve f(t) b , tstable t ); Based on the stable interval (tstable b , tstable t ) to generate a no-operation capacitive image.

7. The interactive control method for a long-distance imaging display according to claim 6, characterized in that: Calculate each frame of capacitance image P(t i ) of the capacitance fluctuation amplitude pr(t i ) specifically include: Get the sampling time period (t b , t t ) in each frame of the capacitance image P(t i ) with coordinates x, y in the pixel value p[x, y](t i ); Calculate the position x, y of each pixel in the sampling time period (t b , t t ) is the mean of the first pixel in: Calculate each frame of capacitance image P(t i ) is the relative pixel value of the pixel with coordinates x, y: Each frame of capacitance image P(t i ) is determined as the capacitance fluctuation amplitude: Where m s is the maximum number of columns of the capacitive image, n s is the maximum number of rows of the capacitive image.

8. The interactive control method for a long-distance imaging display according to claim 6, characterized in that: Determine the stable interval (tstable) on the capacitance fluctuation amplitude change curve f(t) b , tstable t ) specifically include: Get the preset noise threshold p0; Obtain a peak point peak whose amplitude is greater than the noise threshold p0 on the capacitance fluctuation amplitude change curve f(t) j , where j∈[1,n peak ],n peak is the number of peak points on the capacitance fluctuation amplitude variation curve f(t) whose amplitude is greater than the noise threshold p0; Calculate the two adjacent peak points peak on the capacitance fluctuation amplitude change curve f(t) j The time interval between: Δt_peak j =t(peak j+1 )-t(peak j ); Determine two adjacent peak points t(peak j0+1 ) and t(peak j0 ) to satisfy: where j0 is [1, n peak -1] any integer in the range; t(peak j0 ) is determined as the lower bound of the stable interval tstable b , t(peak j0+1 ) is determined as the upper bound of the stable interval tstable t .

9. The interactive control method for a long-distance imaging display according to claim 3, characterized in that: The step of determining the display projection area on the observation window of the long-distance imaging display specifically includes: Get the real-time position of the user's two eyes; The midpoint of the line connecting the real-time positions of the two eyes of the user is determined as the observation point; Calculating four first optical paths between the observation point and four inner corners of the display screen of the long-distance imaging display; Determine the four inner angle intersection points of the four optical paths and the plane where the observation window is located; An area surrounded by the lines connecting the four intersection points is determined as the display projection area.

10. The interactive control method for a long-distance imaging display according to claim 9, characterized in that: The step of determining the touch operation gesture corresponding to the touch operation point according to the position change and the time sequence change of the touch operation point on the touch panel specifically includes: Determining a second optical path corresponding to a line connecting the touch operation point and the observation point according to the position of the observation point; Determine an intersection point of the second optical path and the display screen as a mapping point of the touch operation point on the display screen; The touch operation gesture corresponding to the mapping point is determined according to the position change and the time sequence change of the mapping point on the display screen.

Images