A display cabinet glass interactive display method based on touch recognition
By embedding display modules and photoelectric sensing modules in the transparent light-guiding layer, and adopting sub-periodic pulse control and spectral separation technology to build independent input and output channels, the problems of reduced touch accuracy and system instability caused by signal interference from photoelectric touch recognition components in the smart display cabinet system are solved, and efficient touch recognition and image rendering collaboration are achieved.
Patent Information
- Application Number
- CN202511021044.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2025-07-24
- Publication Date
- 2025-09-16
- Estimated Expiration
- 2045-07-24
AI Technical Summary
In smart display cabinet systems, the photoelectric touch recognition components experience signal interference due to the overlap between the display light source and the photosensitive unit, resulting in reduced touch recognition accuracy and system instability, especially severe touch failure and false response during high-brightness dynamic displays.
By embedding display modules and photoelectric sensing modules in the transparent light-guiding layer, adopting sub-periodic pulse control and spectral separation technology, constructing independent input and output channels, and performing infrared sampling in non-luminous windows, using spectral guiding films and phase polarization structures to separate spectral responses, a dual-channel structure of asynchronous analysis and parallel processing is constructed.
It effectively avoids the interference of display light source on the infrared sensing path, improves touch recognition accuracy and system stability, eliminates false touch and delay problems, and achieves the coordinated efficiency of image rendering and touch recognition.
Smart Images

Figure CN120523360B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of photoelectric data interactive conversion of display case glass, and more specifically, to a display case glass interactive display method based on touch recognition. Background Art
[0002] In current smart showcase systems designed for integrated display and interaction, embedded displays are widely integrated into glass panels to enhance the immersiveness and visual aesthetics of displayed content. At the same time, to achieve interactivity, the system typically also requires integrating photoelectric touch recognition components into the glass structure, such as touch input units based on infrared interception, grating tracking, or reflective imaging. In this integrated architecture, the display output path (outward emission of the light source) and the touch input path (user touch point occlusion or reflection sampling) must simultaneously transmit different types of optical signals through the same light guide or transparent medium.
[0003] However, the biggest problem with this common path superposition is that the bright pixels of the displayed image directly create strong light interference, entering the sensing path of the photoelectric input system. This is especially true when displaying large, bright backgrounds, dynamic content, or high-color-temperature images. Part of the touch recognition channel will be obscured by the combined interference of display light spill and reflection, resulting in a significant decrease in perception accuracy, causing the sensor to misjudge the touch area or even fail completely.
[0004] Even with traditional optical filtering and light-shielding channel designs, it's impossible to fundamentally avoid interference coupling between input and output at the physical spatial level. In actual applications, when the display content is refreshed at high frequencies and pixel brightness constantly transitions, the input signal channel is continuously disturbed in the temporal dimension, leading to frequent input data loss, jumps, or delays. This ultimately manifests as serious system instability, including touch failure, erroneous responses, and display flicker.
[0005] Therefore, the core problem of this type of system is that when the input and output systems share a transparent optical transmission channel, due to the high overlap of the light-emitting unit and the photosensitive unit in the spatial structure, the photoelectric signal interference inevitably suppresses the touch recognition function in the high-brightness dynamic display state, resulting in the physical coupling collapse between the input and output systems, thereby severely limiting the performance ceiling and expansion space of the showcase glass interactive system at the structural design level. Summary of the Invention
[0006] In order to overcome the above-mentioned defects of the prior art, an embodiment of the present invention provides a showcase glass interactive display method based on touch recognition, which solves the problems raised in the above-mentioned background technology by constructing input and output channels with timing control and spectrum separation capabilities.
[0007] To achieve the above-mentioned object, the present invention provides the following technical solutions: a display case glass interactive display method based on touch recognition, comprising a display case device and a glass panel structure mounted on each other, wherein a transparent light guide layer is provided in the glass panel structure;
[0008] S1. Embedding a display module for outputting images and a photoelectric sensing module for receiving reflected signals in the transparent light guide layer, constructing input and output channels sharing a light transmission path, and setting a unified timing control interface;
[0009] S2. Divide the refresh frame period of the display module into a light-emitting window and a non-light-emitting window using sub-periodic pulse control, set the duration of the non-light-emitting window to a time scale below a preset threshold, and calibrate the position of each non-light-emitting window in the global timing index to form a periodic touch sampling time window;
[0010] S3. During the corresponding time period of each non-luminous window, the infrared sampling process of the photoelectric sensing module is started, an infrared pulse signal within the infrared sampling frequency domain is output, and reflection data is collected during the output period;
[0011] S4. Setting a spectral guiding film and a phase polarization structure in the transparent light guide layer to separate the infrared pulse and the spectrum response of the display module output light, eliminate the light interference component in the sampling process, and extract the touch input data;
[0012] S5. Demodulate the touch input data in the infrared sampling frequency domain, calibrate the time position according to the timing index of the non-luminous window, build independent data channels for touch input and display output, and set a buffer path to form asynchronous analysis and parallel processing.
[0013] In a preferred embodiment, S3 further includes: synchronously calling the display refresh index corresponding to the photoelectric sensing module as a modulation frequency reference to establish an index mapping relationship between the reflection data and the time period;
[0014] In the infrared sampling process, a modulation frequency sequence is generated based on the display refresh index, and the infrared pulse signal emission is triggered in the order of the modulation frequency sequence. The index position of each non-luminous window in the global timing is located, and the reflection data in the corresponding time period is extracted and written into the buffer. The written data is annotated with an index tag to form a data sampling sequence arranged in frame order.
[0015] In a preferred embodiment, S4 further includes: providing a spectral guiding film in the transparent light guiding layer, wherein the spectral guiding film includes a spectroscopic composite film and a multilayer refractive filter structure, wherein the spectroscopic composite film is used to extract the infrared band and the visible light band according to a preset spectrum distribution, and the multilayer refractive filter structure is used to perform path deflection processing on the separated light beams of different wavelength bands to form a non-collinear propagation path;
[0016] A phase polarization structure is provided at the optical path exit of the spectral guiding film. The phase polarization structure comprises a multi-axis orthogonally arranged phase delay film group and a polarization direction control layer, which together constitute a control component for modulating the phase relationship between infrared band and visible light band signals;
[0017] The infrared pulse signal emitted by the photoelectric sensing module and the visible light signal output by the display module are separated according to the spectrum through the spectral guiding film, and the separated light beams are refraction tracks separated from each other on the spatial path;
[0018] Through the phase polarization structure, interferometric modulation processing is performed on the phase difference between the separated infrared pulse signal and the visible light residual signal, thereby reducing the superposition interference of the visible light residual on the infrared reflection data during the touch data sampling period corresponding to the non-luminous window;
[0019] Based on the interferometric modulation processing results, the target data matching the reflection path is extracted from the infrared reflection signal, and the data components determined to be visible light coupling components after phase interference analysis are eliminated to form a touch input data block with demodulation properties;
[0020] The touch input data block is written into the touch input data channel constructed in S5, and the corresponding non-luminous window index and global timestamp are marked in the touch input data channel to generate structured data with frame sequence index and sampling integrity as touch input data.
[0021] In a preferred embodiment, S5 further includes:
[0022] S501. Perform frequency domain filtering and demodulation on the reflection data collected by the photoelectric sensing module according to a preset infrared sampling frequency domain, deconstructing the periodic infrared pulse signal in the target frequency band into reflection waveforms corresponding to each non-luminous window period, and performing envelope extraction on each reflection waveform to generate original touch input data with frame sequence correlation characteristics.
[0023] S502: Perform position mapping and time calibration on the original touch input data generated in S501 according to the index position of each non-luminous window in the global refresh frame timing structure, establish its intra-frame time period position label within the current frame segment, and write the label into the index field of the corresponding data block;
[0024] S503: Construct a dual-channel structure including a channel for image output data and a channel for touch input data, load the display module output image data generated in steps S1 to S4 and the touch input data processed in step S502 respectively, and construct a data flow path that does not interfere with each other based on the difference in sampling frequency and execution period between the channels;
[0025] S504: In each channel structure of the dual-channel structure, at least one buffer path segment with a time window constraint is set. After each data block is written, it resides in the buffer path segment until the parsed signal arrives. The buffer path segment performs dynamic queue depth adjustment based on the sampling frequency domain and channel type, and records the enqueue and dequeue timestamps for subsequent intra-frame synchronization determination.
[0026] S505: Construct a scheduling index mapping matrix in the control processing module, arrange the display refresh frame sequence and the non-luminous window period sequence according to the inter-frame interleaving principle, and establish index projection relationships with the channels of image output data and touch input data, respectively, to generate an interleaved scheduling structure with a sampling timing locking function;
[0027] S506. Call the interleaved scheduling structure generated in step S505, activate the instruction set in chronological order, perform instruction binding reading and parsing on the image output data channel and the touch input data channel respectively, perform bidirectional data asynchronous loading and synchronous parsing tasks according to the constructed channel separation path, and complete independent interpretation and dual-channel interleaved scheduling of structured data blocks in each frame segment.
[0028] In a preferred embodiment, in S504, the dynamic queue depth adjustment includes setting initial buffer path segment depth parameters for the channel for touch input data and the channel for image output data, respectively; in each non-luminous window period, the control processing module calculates the target buffer path segment depth required for the channel in the current period based on the enqueue rate of data blocks written in the current channel, the dequeue rate of data completed by the channel parsing logic, and the real-time residence time of the data blocks in the buffer path segment; when the enqueue rate is greater than the dequeue rate and the continuous rise time of the data block residence time distribution is greater than a preset residence time threshold, the buffer path segment capacity of the channel is expanded;
[0029] When it is detected that the standard deviation of the data block residence time distribution is lower than the preset threshold and the queuing and dequeuing rates of the data blocks in the channel are within the preset threshold range, the contraction instruction of the buffer path segment is triggered and the queue capacity is adjusted to maintain the synchronization relationship between the parsing instruction and the data block.
[0030] In a preferred embodiment, the process further includes S6: constructing a control processing module in a global timing structure formed based on the non-luminous windows calibrated in S2 and the reflection data collected in S3, performing frame-level mapping of the touch input data and the corresponding time periods of the image output data by the control processing module, establishing a timing mapping table with the non-luminous windows as index units, and loading the timing mapping table into a scheduling index structure of the control processing module;
[0031] The control processing module performs sequential statistics of time periods on the loaded scheduling index structure, and generates an interleaved execution sequence for image output and touch input data based on the order of the frame segments in which each non-luminous window is located. In the interleaved execution sequence, an index mapping relationship is established between the time period corresponding to each non-luminous window and the processing instructions for image output data and the processing instructions for touch input data, respectively, to form an instruction scheduling structure based on the time sequence frame segments.
[0032] The control processing module calls the corresponding structured data blocks from the touch input data channel and the image output data channel constructed in S5 according to the processing flow definition corresponding to each frame segment in the interleaved execution sequence, reads the respective data sampling units in sequence, allocates processing paths according to the preset channel separation structure, and executes bidirectional data parallel scheduling and synchronous analysis processes.
[0033] Technical effects and advantages of the present invention:
[0034] The present invention sets an invisible, non-luminous window in the display frame period and strictly limits infrared sampling to this window, thereby avoiding the problem of display pixel highlight interference superimposed on the infrared sensing path. It also cuts off the overlap of input and output signals from a physical timing perspective, solving the problems of reduced touch accuracy and failure in common-channel structures.
[0035] The present invention uses a spectral guiding film and a phase polarization structure to construct a frequency band separation mechanism, decoupling the infrared signal from the display output in frequency and phase, further reducing the interference of the display light source on the infrared channel from an optical dimension;
[0036] The present invention constructs an independent data channel structure for display output and touch input, supplemented by a buffer path and scheduling index mapping matrix based on time window constraints, to achieve asynchronous loading and synchronous parsing of bidirectional data, improve the collaborative efficiency of touch recognition and image rendering, and eliminate the problems of false touch and delay caused by rhythm mismatch between channels. BRIEF DESCRIPTION OF THE DRAWINGS
[0037] Figure 1 The figure is a flow chart of the method steps of the present invention. DETAILED DESCRIPTION
[0038] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention.
[0039] Refer to the instruction manual Figure 1, an embodiment of the present invention provides a display cabinet glass interactive display method based on touch recognition, comprising a display cabinet device and a glass panel structure mounted on each other, wherein a transparent light guide layer is provided in the glass panel structure;
[0040] S1. A display module for outputting images and a photoelectric sensing module for receiving reflected signals are embedded in the transparent light-guiding layer to construct input and output channels of a shared light transmission path, and a unified timing control interface is set to realize input and output scheduling of the display module and the photoelectric sensing module; wherein the input and output channels of the shared light transmission path refer to the image light signal emitted by the display module and the reflected light signal received by the photoelectric sensing module sharing a physical transmission path in the same transparent light-guiding layer, so as to realize bidirectional transmission of light signals of image output and touch input at the structural level; the unified timing control interface refers to a control mechanism for coordinating the display module and the photoelectric sensing module to work alternately on the same time axis, and by managing their respective working timings, ensures that image output and touch sampling do not conflict with each other in time and are executed interleaved; the photoelectric sensing module refers to a photoelectric conversion component for emitting light signals of a specific wavelength band and receiving reflected or blocked light signals generated by user touch to realize touch position perception and behavior sampling;
[0041] S2. Refresh frame period segmentation is performed on the display module, and each frame period is divided into a luminous window and a non-luminous window by using a sub-periodic pulse control method, and the duration of the non-luminous window is set to a time scale lower than the preset display response threshold lower limit to avoid visual flickering, and at the same time, the position of each non-luminous window in the global timing index is calibrated to form a periodic touch sampling time window; wherein the refresh frame period segmentation refers to dividing each complete image refresh period of the display module into a luminous segment and a non-luminous window, which is used to provide an independent sampling time slot for photoelectric perception while maintaining continuous image display, thereby avoiding image Luminescence interferes with touch recognition; sub-periodic pulse control refers to embedding multiple microsecond short-term control pulses in each complete refresh cycle of the display module to manage the start and stop of the luminescence and sampling periods, and realize input-output separation control under sub-level time resolution; the position of each non-luminous window in the global timing index refers to assigning a unique timing number or positioning identifier to each non-luminous time period on the time axis of the continuous operation of the entire display system. The periodic touch sampling time window refers to a time window dedicated to touch sampling by the photoelectric sensing module that appears in a fixed rhythm within the display cycle based on these calibration positions;
[0042] S3. During the corresponding time period of each non-luminous window, the infrared sampling process of the photoelectric sensing module is initiated, an infrared pulse signal within the infrared sampling frequency domain is output, and reflection data is collected during the output period. The infrared sampling process refers to the photoelectric sensing module performing the operation of emitting an infrared pulse signal and synchronously collecting reflection data within a specific time period. The infrared pulse signal within the infrared sampling frequency domain refers to a periodic narrow pulse light signal output by the photoelectric sensing module during the sampling process, wherein the frequency of the periodic narrow pulse light signal is within a preset infrared sampling frequency domain range and is used to illuminate the touch area and stimulate surface reflection, thereby generating reflection data that can be received and demodulated.
[0043] S4. Setting a spectral guiding film and a phase polarization structure in the transparent light guide layer to separate the infrared pulse and the spectrum response of the display module output light, eliminate the light interference component in the sampling process, and extract the touch input data;
[0044] S5. Demodulate the touch input data in the infrared sampling frequency domain, calibrate the time position according to the timing index of the non-luminous window, build independent data channels for touch input and display output, and set a buffer path to form asynchronous analysis and parallel processing.
[0045] S3 also includes: synchronously calling the display refresh index corresponding to the photoelectric sensing module as a modulation frequency reference, and establishing an index mapping relationship between the reflection data and the time period; wherein the display refresh index refers to the timing number assigned to each frame refresh cycle when the display module continuously outputs an image, which is used to identify the position of the image frame on the global time axis; the modulation frequency reference refers to the modulation frequency reference parameter set for the infrared pulse signal, and the modulation frequency reference parameter is consistent with the display refresh index, so that the touch sampling process forms a temporal correspondence with the image output; the index mapping relationship between the reflection data and the time period refers to binding each set of reflection data collected by the photoelectric sensing module to the time period of its corresponding non-luminous window one by one, so as to construct a touch input data structure with time traceability;
[0046] In the infrared sampling process, a modulation frequency sequence is generated based on the display refresh index, and the infrared pulse signal emission is triggered in the order of the modulation frequency sequence. The index position of each non-luminous window in the global timing is located, and the reflection data in the corresponding time period is extracted and written into the buffer. The written data is annotated with an index tag to form a data sampling sequence arranged in frame order.
[0047] S4 further includes: providing a spectrum guiding film in the transparent light guiding layer, the spectrum guiding film including a spectroscopic composite film and a multilayer refractive filter structure, the spectroscopic composite film being used to extract infrared frequency bands and visible frequency bands according to a preset spectrum distribution, and the multilayer refractive filter structure being used to perform path deflection processing on the separated light beams of different wavelength bands to form non-collinear propagation paths;
[0048] A phase polarization structure is provided at the optical path exit of the spectral guiding film. The phase polarization structure comprises a multi-axis orthogonally arranged phase delay film group and a polarization direction control layer, which together constitute a control component for modulating the phase relationship between infrared band and visible light band signals;
[0049] The infrared pulse signal emitted by the photoelectric sensing module and the visible light signal output by the display module are separated according to the spectrum through the spectral guiding film, and the separated light beams are refraction tracks separated from each other on the spatial path;
[0050] The phase polarization structure performs interferometric modulation processing on the phase difference between the separated infrared pulse signal and the visible light residual signal, thereby reducing the superimposed interference of the visible light residual on the infrared reflection data during the touch data sampling period corresponding to the non-luminous window. The visible light residual signal refers to the optical interference component of the visible light signal previously output by the display module that persists in the light guide path during the non-luminous window due to scattering, reflection, or material retention effects that have not been completely dissipated.
[0051] Based on the interferometric modulation processing results, the target valid data matching the reflection path is extracted from the infrared reflection signal, and the data components determined to be visible light coupling components after phase interference analysis are eliminated to form a touch input data block with demodulation properties;
[0052] The touch input data block is written into the channel of the touch input data constructed in S5, and the corresponding non-luminous window index and global timestamp are marked in the channel of the touch input data to generate structured data with frame sequence index and sampling integrity as touch input data. The touch input data is used for subsequent synchronous analysis and bidirectional scheduling.
[0053] Also included in the S5:
[0054] S501. For the reflection data collected by the photoelectric sensing module, frequency domain filtering and demodulation operations are performed according to the preset infrared sampling frequency domain, and the periodic infrared pulse signal in the target frequency band is deconstructed into a reflection waveform corresponding to each non-luminous window period. By performing envelope extraction operations on each reflection waveform, original touch input data with frame sequence correlation characteristics is generated; it should be noted that in the original reflection data collected by the photoelectric sensing module, according to the set infrared sampling frequency domain parameters, a fast Fourier transform is first performed on the data sequence to obtain a spectrum distribution structure, and then a bandpass filter is constructed according to the upper and lower limits of the target frequency band to retain the effective spectrum components in the infrared sampling frequency band, while suppressing the interference frequency band overlapping with the display module luminous period, thereby completing the frequency domain filtering process; secondly, for the filtered frequency domain data, according to the preset pulse modulation function, envelope demodulation or phase demodulation is used to reconstruct the time domain change information of the pulse signal, wherein the envelope demodulation is performed by analyzing the signal. The signal amplitude changes with time to obtain the envelope trajectory of the pulse intensity, and phase demodulation is used to identify the potential time delay and path change characteristics in the high-frequency signal, thereby converting the frequency domain energy into time domain data that can be processed in frames; in the signal sequence after demodulation, according to the marked position of the non-luminous window in the global time series index, the reflection data fragments in their respective corresponding time periods are extracted; the continuous sampling results in each window segment are constructed into an independent reflection waveform to ensure that each waveform sequence only contains the round-trip reflection response of a complete pulse, thereby realizing the deconstruction and conversion of the pulse signal to the frame sequence waveform; when performing the envelope extraction operation, for the reflection waveform corresponding to each non-luminous window, a sliding window function is used to construct a local extreme value sequence, and then combined with the Hilbert transform or envelope fitting method, the envelope curve of the reflection signal in the time domain is extracted; the envelope curve is used to characterize the degree of influence of the touch event on the pulse reflection intensity, and finally the original touch input data with a frame segment mapping relationship is formed;
[0055] S502: Perform position mapping and time calibration on the original touch input data generated in S501 according to the index position of each non-luminous window in the global refresh frame timing structure, establish its intra-frame time period position label within the current frame segment, and write the label into the index field of the corresponding data block;
[0056] S503: Construct a dual-channel structure including a channel for image output data and a channel for touch input data, load the display module output image data generated in steps S1 to S4 and the touch input data processed in step S502 respectively, and construct a data flow path that does not interfere with each other based on the difference in sampling frequency and execution period between the channels;
[0057] S504. At least one buffer path segment with a time window constraint is set in each channel structure of the dual-channel structure. After each data block is written, it resides in the buffer path segment until the arrival of the parsing signal. The buffer path segment performs dynamic queue depth adjustment according to the sampling frequency domain and the channel type, and records the queue entry and dequeue timestamps for subsequent intra-frame synchronization judgment. It should be noted that the buffer path segment with a time window constraint refers to a path area preset in the channel structure for temporarily storing data blocks. The path defines the minimum and maximum time intervals for the data block to reside therein, so that it remains in a stable state while waiting for the arrival of the corresponding parsing signal, and triggers dequeue processing after the time constraint condition is met. The reason for setting it to "until The reason for "less one" is that in different channel structures, it may be necessary to establish multiple buffer path segments with different time constraint strategies according to the parsing rhythm, channel type or frame segment division of the data stream to ensure the timing scheduling accuracy and channel data decoupling capability under the asynchronous processing structure; in addition, each data block is written and resides in the buffer path segment until the parsing signal arrives to ensure that the data block will not be processed or discarded in advance before the matching or scheduling is completed, thereby ensuring the timing integrity of the data for the parsing logic; this mechanism allows the precise control of the processing trigger point by recording the enqueue and dequeue timestamps in the asynchronous parsing scenario, ensuring the parsing synchronization and scheduling consistency of the touch input data and display output data in the channel structure;
[0058] S505. Construct a scheduling index mapping matrix in the control processing module, arrange the display refresh frame sequence and the non-luminous window period sequence according to the inter-frame interleaving principle, and establish index projection relationships with the image output data channel and the touch input data channel respectively, to generate an interleaved scheduling structure with a sampling timing locking function; wherein the scheduling index mapping matrix refers to a two-dimensional mapping structure established in the control processing module, which is used to arrange the display refresh frame sequence and the non-luminous window period sequence according to the preset inter-frame interleaving rule, and respectively perform one-to-one corresponding projection association with the frame index in the image output data channel and the touch input data channel, thereby realizing the control of each data processing flow. The interlaced scheduling structure is a scheduling control structure that indexes and binds the display refresh frame sequence and the non-luminous window period sequence according to the interlaced relationship between the frames, and establishes a mapping with each data channel, thereby ensuring that the touch input and image output are staggered on the frame-level time axis.
[0059] S506: Call the interleaved scheduling structure generated in step S505, activate the instruction set in chronological order, execute instruction binding reading and parsing for the image output data channel and the touch input data channel respectively, and perform bidirectional data asynchronous loading and synchronous parsing tasks according to the constructed channel separation path, thereby completing independent interpretation of structured data blocks and dual-channel interleaved scheduling within each frame segment;
[0060] It should be noted that the activation instruction set refers to the set of data processing operations predefined in each frame segment by the control processing module in step S505 based on the index relationship constructed by the interleaved scheduling structure; this data processing operation set includes instructions for calling, parsing, routing, and parsing status feedback for structured data blocks in the channels of touch input data and image output data, which are loaded and activated in the order of frame timestamps to drive the execution starting point of data scheduling;
[0061] Instruction binding reading and parsing means that in the activated instruction set, each instruction is explicitly bound to a data channel (the channel for touch input data and the channel for image output data) and its corresponding structured data block index. During execution, the target data block is called according to the channel type, and the deconstruction, timing alignment and validity analysis processes are performed according to the channel configuration structure. This ensures that the data reading and parsing process is unique, timing consistent, and isolated.
[0062] The channel separation path refers to the physical or logical isolation channel structure between the touch input data channel and the image output data channel established in step S5, which is delineated based on function type, data flow direction, and sampling timing. This path ensures that the two types of data do not interfere with each other during processing, and has independent buffering, scheduling, and status marking mechanisms, so that the two channels can execute their respective data loading and processing tasks simultaneously during scheduling.
[0063] In addition, bidirectional data asynchronous loading means that the control processing module executes parallel calls on the data blocks of the touch channel and display channel respectively according to the activation instruction, allowing the data to be loaded independently in their respective buffer paths. The synchronous parsing task means that after the data loading is completed, the time tags in the scheduling index are aligned so that the data blocks in the two channels enter the parsing process simultaneously within the same frame segment, ensuring that the output and input are completed synchronously in terms of timing logic and avoiding processing offset.
[0064] In step S506, independent interpretation of the structured data blocks means that the control processing module calls data blocks with complete frame sequence labels and timestamps from the touch input data channel and the image output data channel according to the index instructions configured for each frame segment in the interleaved scheduling structure, and performs independent content parsing and feature extraction operations on each data block according to the preset parsing logic of each channel, without data interference or content interleaving between channels, ensuring that each data block is completely and independently interpreted within its own channel.
[0065] Dual-channel interleaved scheduling means that in the scheduling index mapping matrix, the display refresh frame sequence and the non-luminous window period sequence are mapped to two data channels in an interleaved manner between frames, and a scheduling index is generated for each frame segment. The control processing module alternately activates the parsing instructions of the image output data channel and the touch input data channel in adjacent frame segments according to this structure, so that the reading and processing processes of the two channels are staggered in time sequence, thereby ensuring the staggered allocation of data processing tasks and the coordinated advancement of the parsing rhythm within the same system cycle, forming a dynamic dual-channel interleaved scheduling process.
[0066] In S504, the dynamic queue depth adjustment includes setting initial buffer path segment depth parameters for the channel for touch input data and the channel for image output data respectively; in each non-luminous window period, the control processing module calculates the target buffer path segment depth required for the channel in the current period based on the enqueue rate of data blocks written in the current channel, the dequeue rate of data completed by the channel parsing logic, and the real-time residence time of the data blocks in the buffer path segment; when the enqueue rate is greater than the dequeue rate and the continuous rise time of the data block residence time distribution is greater than the preset residence time threshold, the buffer path segment capacity of the channel is expanded;
[0067] When it is detected that the standard deviation of the data block residence time distribution is lower than the preset threshold and the queuing and dequeuing rates of the data blocks in the channel are within the preset threshold range, the contraction instruction of the buffer path segment is triggered and the queue capacity is adjusted to maintain the synchronization relationship between the parsing instruction and the data block.
[0068] The method further includes S6: constructing a control processing module in a global timing structure formed based on the non-luminous empty window calibrated in S2 and the reflection data collected in S3, performing frame-level mapping of the touch input data and the corresponding time periods of the image output data by the control processing module, establishing a timing mapping table with the non-luminous empty window as an index unit, and loading the timing mapping table into a scheduling index structure of the control processing module;
[0069] The control processing module performs sequential statistics of time periods on the loaded scheduling index structure, and generates an interleaved execution sequence for image output and touch input data based on the order of the frame segments in which each non-luminous window is located. In the interleaved execution sequence, an index mapping relationship is established between the time period corresponding to each non-luminous window and the processing instructions for image output data and the processing instructions for touch input data, respectively, to form an instruction scheduling structure based on the time sequence frame segments.
[0070] The control processing module calls the corresponding structured data blocks from the channels of touch input data and image output data constructed in S5 according to the processing flow definition corresponding to each frame segment in the interleaved execution sequence, reads the respective data sampling units in sequence, allocates processing paths according to the preset channel separation structure, and executes the bidirectional data parallel scheduling and synchronous parsing process; wherein according to the preset channel separation structure means that the channels of touch input data and image output data constructed in S5 are clearly divided into independent data processing paths; allocating processing paths means that the control processing module maps the touch input data to the input parsing path and the image output data to the output rendering path according to the type of each channel and its corresponding data structure; executing the bidirectional data parallel scheduling and synchronous parsing process means that under the guidance of the time index of the interleaved execution sequence, the control processing module simultaneously schedules the data blocks of the two channels, completes the corresponding data decoding, index matching and synchronous output according to the frame timing, thereby realizing real-time coordinated processing of input and output.
[0071] It should be noted that the development of this solution stems from a systematic analysis of the core flaws in existing showcase display and touch interaction systems in terms of structural integration, signal scheduling, and response timing. This led to the proposal of a touch recognition-based interactive display method for showcase glass.
[0072] The construction concept is based on the basic principles of unified optical path, separate channels and staggered scheduling. The goal is to achieve bidirectional transmission of optical signals for image output and touch input in the same transparent light-guiding structure, solving the spatial redundancy, reflection interference and scheduling conflicts caused by the independent layout of modules in traditional solutions. In terms of structural design, this method embeds the display module and the photoelectric sensing module in the same transparent light-guiding layer, so that they share a physical optical signal path, and uses a unified timing control interface to synchronize and coordinate input and output behaviors, ensuring that the system achieves a dynamic balance between visual continuity and touch response. The structural layout is defined in detail in S1, and the input and output channels of the shared light transmission path are clearly defined as the carriers of bidirectional transmission. At the same time, a unified timing control interface is introduced to constrain the working order and rhythm of the modules to ensure stable hardware collaboration.
[0073] On the basis of this structure, in order to achieve interference-free signal decoupling and sampling, the solution adopts refresh frame cycle segmentation and sub-cycle pulse control technology in S2, which subdivides each display refresh cycle into a luminous window and a non-luminous window, so as to complete the acquisition preparation of the touch signal in the gap that is not perceptible at the visual level, avoiding the interference of the display signal on infrared perception; the index calibration of the non-luminous window on the time axis provides the basis for the frame segment binding in the subsequent infrared sampling process; in addition, S3 further clarifies that the photoelectric sensing module will start the infrared sampling process in the non-luminous window, output infrared pulses and collect reflection data, and at the same time establish a modulation frequency reference consistent with the display refresh index to achieve a one-to-one mapping of reflection data and time period; the spectral guiding film and phase polarization structure introduced in S4 ensure the physical separation of the infrared band and the visible light band, and eliminate the residual interference of visible light through phase regulation, thereby ensuring the purity of the touch signal in the optical channel;
[0074] The key technological breakthrough of the solution lies in the independent data channel structure and scheduling mechanism constructed by S5. In this step, the raw touch input data is converted into structured data blocks with frame sequence characteristics through frequency domain filtering and envelope extraction. Time-stamping is performed based on the calibrated position of the non-luminous window in the global timing index. Then, by constructing a dual-channel structure for touch input and image output, independent logical paths are assigned to the data. Buffer path segments with time window constraints are set within each channel to manage data retention and dequeueing, alleviating rhythm differences between parsing processes. In addition, the control processing module arranges the display refresh frame and the non-luminous window according to the inter-frame interleaving principle, constructs a scheduling index mapping matrix, and generates an interleaved scheduling structure with sampling timing locking function. This structure ensures the alternating execution and parsing consistency of the two types of data in the time dimension. By activating a preset instruction set, the parsing of touch input data and the synchronous rendering of image output data are achieved, thus completing the coordinated processing of input and output within the same frame segment.
[0075] S6 is used to further consolidate this scheduling system. By constructing a frame-level mapping table and loading it as a scheduling index structure, it has the ability to globally control the execution sequence between non-luminous windows and image output frame segments. On this basis, the control processing module can call various structured data blocks in the aforementioned channel structure to complete the parallel scheduling and synchronous analysis of bidirectional data according to the preset channel separation path. It should be noted that the entire solution is highly adaptable to confined space scenarios such as display cabinets in actual applications, which not only improves screen utilization, but also effectively reduces the number of components and wiring complexity.
[0076] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.
Claims
1. A method for interactive display of display cabinet glass based on touch recognition, comprising a display cabinet device and a glass panel structure mounted on each other, with a transparent light guide layer disposed within the glass panel structure, characterized in that: S1. Embedding a display module for outputting images and a photoelectric sensing module for receiving reflected signals in the transparent light guide layer, constructing input and output channels sharing a light transmission path, and setting a unified timing control interface; S2. Divide the refresh frame period of the display module into a light-emitting window and a non-light-emitting window using sub-periodic pulse control, set the duration of the non-light-emitting window to a time scale below a preset threshold, and calibrate the position of each non-light-emitting window in the global timing index to form a periodic touch sampling time window; S3. During the corresponding time period of each non-luminous window, the infrared sampling process of the photoelectric sensing module is started, an infrared pulse signal within the infrared sampling frequency domain is output, and reflection data is collected during the output period; S4. Setting a spectral guiding film and a phase polarization structure in the transparent light guide layer to separate the infrared pulse and the spectrum response of the display module output light, eliminate the light interference component in the sampling process, and extract the touch input data; S5. Demodulate the touch input data in the infrared sampling frequency domain, calibrate the time position according to the timing index of the non-luminous window, build independent data channels for touch input and display output, and set a buffer path to form asynchronous analysis and parallel processing.
2. The interactive display method for display cabinet glass based on touch recognition according to claim 1, characterized in that: S3 also includes: synchronously calling the display refresh index corresponding to the photoelectric sensing module as a modulation frequency reference, and establishing an index mapping relationship between the reflection data and the time period; In the infrared sampling process, a modulation frequency sequence is generated based on the display refresh index, and the infrared pulse signal emission is triggered in the order of the modulation frequency sequence. The index position of each non-luminous window in the global timing is located, and the reflection data in the corresponding time period is extracted and written into the buffer. The written data is annotated with an index tag to form a data sampling sequence arranged in frame order.
3. The interactive display method for display cabinet glass based on touch recognition according to claim 2, characterized in that: S4 further includes: providing a spectrum guiding film in the transparent light guiding layer, the spectrum guiding film including a spectroscopic composite film and a multilayer refractive filter structure, the spectroscopic composite film being used to extract infrared frequency bands and visible frequency bands according to a preset spectrum distribution, and the multilayer refractive filter structure being used to perform path deflection processing on the separated light beams of different wavelength bands to form non-collinear propagation paths; A phase polarization structure is provided at the optical path exit of the spectral guiding film. The phase polarization structure comprises a multi-axis orthogonally arranged phase delay film group and a polarization direction control layer, which together constitute a control component for modulating the phase relationship between infrared band and visible light band signals; The infrared pulse signal emitted by the photoelectric sensing module and the visible light signal output by the display module are separated according to the spectrum through the spectral guiding film, and the separated light beams are refraction tracks separated from each other on the spatial path; Through the phase polarization structure, interferometric modulation processing is performed on the phase difference between the separated infrared pulse signal and the visible light residual signal, thereby reducing the superposition interference of the visible light residual on the infrared reflection data during the touch data sampling period corresponding to the non-luminous window; Based on the interferometric modulation processing results, the target data matching the reflection path is extracted from the infrared reflection signal, and the data components determined to be visible light coupling components after phase interference analysis are eliminated to form a touch input data block with demodulation properties; The touch input data block is written into the touch input data channel constructed in S5, and the corresponding non-luminous window index and global timestamp are marked in the touch input data channel to generate structured data with frame sequence index and sampling integrity as touch input data.
4. The interactive display method for display cabinet glass based on touch recognition according to claim 3, characterized in that: Also included in the S5: S501. Perform frequency domain filtering and demodulation on the reflection data collected by the photoelectric sensing module according to a preset infrared sampling frequency domain, deconstructing the periodic infrared pulse signal in the target frequency band into reflection waveforms corresponding to each non-luminous window period, and performing envelope extraction on each reflection waveform to generate original touch input data with frame sequence correlation characteristics. S502: Perform position mapping and time calibration on the original touch input data generated in S501 according to the index position of each non-luminous window in the global refresh frame timing structure, establish its intra-frame time period position label within the current frame segment, and write the label into the index field of the corresponding data block; S503: Construct a dual-channel structure including a channel for image output data and a channel for touch input data, load the display module output image data generated in steps S1 to S4 and the touch input data processed in step S502 respectively, and construct a data flow path that does not interfere with each other based on the difference in sampling frequency and execution period between the channels; S504: In each channel structure of the dual-channel structure, at least one buffer path segment with a time window constraint is set. After each data block is written, it resides in the buffer path segment until the parsed signal arrives. The buffer path segment performs dynamic queue depth adjustment based on the sampling frequency domain and channel type, and records the enqueue and dequeue timestamps for subsequent intra-frame synchronization determination. S505: Construct a scheduling index mapping matrix in the control processing module, arrange the display refresh frame sequence and the non-luminous window period sequence according to the inter-frame interleaving principle, and establish index projection relationships with the channels of image output data and touch input data, respectively, to generate an interleaved scheduling structure with a sampling timing locking function; S506. Call the interleaved scheduling structure generated in step S505, activate the instruction set in chronological order, perform instruction binding reading and parsing on the image output data channel and the touch input data channel respectively, perform bidirectional data asynchronous loading and synchronous parsing tasks according to the constructed channel separation path, and complete independent interpretation and dual-channel interleaved scheduling of structured data blocks in each frame segment.
5. The interactive display method for display cabinet glass based on touch recognition according to claim 4, characterized in that: In S504, the dynamic queue depth adjustment includes setting initial buffer path segment depth parameters for the channel for touch input data and the channel for image output data respectively; in each non-luminous window period, the control processing module calculates the target buffer path segment depth required for the channel in the current period based on the enqueue rate of data blocks written in the current channel, the dequeue rate of data completed by the channel parsing logic, and the real-time residence time of the data blocks in the buffer path segment; when the enqueue rate is greater than the dequeue rate and the continuous rise time of the data block residence time distribution is greater than the preset residence time threshold, the buffer path segment capacity of the channel is expanded; When it is detected that the standard deviation of the data block residence time distribution is lower than the preset threshold and the queuing and dequeuing rates of the data blocks in the channel are within the preset threshold range, the contraction instruction of the buffer path segment is triggered and the queue capacity is adjusted to maintain the synchronization relationship between the parsing instruction and the data block.
6. The interactive display method for display cabinet glass based on touch recognition according to claim 5, characterized in that: The method further includes S6: constructing a control processing module in a global timing structure formed based on the non-luminous empty window calibrated in S2 and the reflection data collected in S3, performing frame-level mapping of the touch input data and the corresponding time periods of the image output data by the control processing module, establishing a timing mapping table with the non-luminous empty window as an index unit, and loading the timing mapping table into a scheduling index structure of the control processing module; The control processing module performs sequential statistics of time periods on the loaded scheduling index structure, and generates an interleaved execution sequence for image output and touch input data based on the order of the frame segments in which each non-luminous window is located. In the interleaved execution sequence, an index mapping relationship is established between the time period corresponding to each non-luminous window and the processing instructions for image output data and the processing instructions for touch input data, respectively, to form an instruction scheduling structure based on the time sequence frame segments. The control processing module calls the corresponding structured data blocks from the touch input data channel and the image output data channel constructed in S5 according to the processing flow definition corresponding to each frame segment in the interleaved execution sequence, reads the respective data sampling units in sequence, allocates processing paths according to the preset channel separation structure, and executes bidirectional data parallel scheduling and synchronous analysis processes.
Citation Information
Patent Citations
Virtual and augmented reality systems and methods
CN105934902A
Control device for an electroluminescent touch-control display panel, touch screen and display device
US20170357363A1