Multimodal man-machine interaction instruction priority scheduling method and system

Through the priority scheduling method of multimodal human-computer interactive instructions, combined with capacitive touch detection and PWM pulse technology, the problems of touch button mistouch and light interference are solved, high-precision and stable interaction are achieved, and user experience and equipment efficiency are optimized.

CN120386597APending Publication Date: 2025-07-29ZHEJIANG CANGTIAN INTELLIGENT INFORMATION TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202510472641.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-04-16
Publication Date
2025-07-29

AI Technical Summary

Technical Problem

In the prior art, the touch button error rate is high and is susceptible to external light interference, resulting in low interaction accuracy and poor operation experience, especially in multi-task processing, which cannot effectively distinguish task priorities, affecting equipment efficiency.

Method used

The priority scheduling method of multimodal human-computer interaction instructions is adopted, and the capacitive touch button detection is carried out by building a control unit, combining PWM pulse technology to control the brightness of the LED digital tube and LED lamp, and dynamic display and decontamination processing is performed, and data interaction is performed with the priority scheduling strategy.

Benefits of technology

Improve the accuracy and stability of touch detection, optimize the user experience, ensure that high-priority tasks are responded in a timely manner, and improve the overall operation efficiency of the equipment.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120386597A_ABST
    Figure CN120386597A_ABST
Patent Text Reader

Abstract

The invention provides a priority scheduling method and system for a multi-mode man-machine interaction instruction, and relates to the technical field of man-machine interaction. Capacitance touch key detection is carried out based on the control unit, and an input key is determined; the brightness of an LED nixie tube and an LED lamp is controlled by adopting a PWM pulse technology, and dynamic display shadow elimination processing is carried out to obtain a display effect; and based on the priority scheduling strategy, performing data interaction with the display effect through keys to obtain an updated display effect. The technical problems that in the prior art, due to the fact that the touch key is high in mistaken touch rate and prone to being interfered by external light, the interaction accuracy is low, and the operation experience is poor are solved, and the technical effects of improving the touch detection accuracy, enhancing the interaction stability and optimizing the user experience are achieved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of human-computer interaction technology, and specifically relates to a method and system for priority scheduling of multi-modal human-computer interaction instructions. Background Art

[0002] With the development of intelligent devices, touch buttons have gradually become the mainstream interaction method in the field of human-computer interaction, capable of providing a more intuitive and concise operation experience. The existing touch button interaction methods are mainly based on resistive or capacitive touch detection. Among them, resistive touch buttons require a large pressure to trigger, which may cause operation fatigue after long-term use, and at the same time, it is easy to reduce the sensitivity due to panel wear. Although capacitive touch buttons have high sensitivity, they also have problems such as high false touch rate and serious environmental light interference in actual applications. Especially in devices such as printers, users need to accurately input operation instructions. If the touch buttons are frequently mis-touched or the sensitivity is affected by changes in ambient light, it will lead to an increase in wrong operations, affecting the execution efficiency of tasks and the user experience. In addition, when multitasking, traditional human-computer interaction systems cannot effectively distinguish task priorities, resulting in important tasks being delayed, seriously affecting the overall work efficiency. Summary of the Invention

[0003] This application provides a method and system for priority scheduling of multi-modal human-computer interaction instructions, which solves the technical problems of low interaction accuracy and poor operation experience in the prior art due to the high false touch rate of touch buttons and susceptibility to external light interference, and achieves the technical effects of improving the accuracy of touch detection, enhancing interaction stability, and optimizing the user experience.

[0004] In view of the above problems, on the one hand, this application provides a method for priority scheduling of multi-modal human-computer interaction instructions, and the method includes: building a control unit; performing capacitive touch button detection based on the control unit to determine the input button; using PWM pulse technology to control the brightness of LED digital tubes and LED lights, and performing dynamic display blanking processing to obtain a display effect; based on a priority scheduling strategy, performing data interaction through the button and the display effect to obtain an updated display effect.

[0005] Preferably, the control unit includes plexiglass, a plastic light-shielding plate, a printed circuit board, and a spring; the plexiglass is used as an operation panel for touch interaction; the plastic light-shielding plate is used to block external light interference; the printed circuit board is a circuit component; the spring is used to control the physical distance between the plexiglass and the printed circuit board.

[0006] Preferably, the spring is used to control the physical distance between the plexiglass and the printed circuit board, including: fixing the spring on multiple support points of the printed circuit board and connecting it to the plexiglass; obtaining the static height and spring constant of the spring, as well as the thickness of the plexiglass to calculate the original height of the connecting member; comparing the restored height after multiple pressure presses with the original height, and if the comparison result is unqualified, repairing the spring and the plexiglass, and if the comparison result is qualified, completing the physical distance control.

[0007] Preferably, based on the control unit, capacitance touch button detection is performed to determine the input button, including: based on the control unit, the charge and discharge processes of resistance and capacitance are performed in a relaxation oscillation manner; capacitance touch detection is performed by measuring the frequency pulse change during the charge and discharge process within a preset time to obtain a touch event determination result; if it is determined based on the touch event determination result that a touch event has occurred, the pressed button is determined based on multi-channel scanning.

[0008] Preferably, obtaining the touch event determination result includes: based on a window of preset time, using a counter to calculate the number of oscillation pulses; if the count value is lower than the preset threshold, it is determined that a touch event has occurred; if the count value is higher than or equal to the preset threshold, it is determined that no touch event has occurred.

[0009] Preferably, determining the pressed button based on multi-channel scanning includes: using a decoder to sequentially select the signals of the buttons for detection; recording the oscillation frequency of each channel through a counter and comparing it with a preset threshold; identifying the channel with a decreased oscillation frequency based on the comparison to determine the pressed button.

[0010] Preferably, based on the priority scheduling strategy, data interaction is performed between the button and the display effect to obtain an updated display effect, including: reading the input button from the control unit; based on the button, the printer returns status information after executing a task, where the returned status information includes the priority scheduling strategies of high-priority tasks, medium-priority tasks, and low-priority tasks; parsing the returned status information and updating the display of the control unit to obtain the updated display effect.

[0011] On the other hand, the present application also provides a priority scheduling system for multi-modal human-computer interaction instructions. The system includes: a first module for building a control unit; a button detection module for performing capacitance touch button detection based on the control unit to determine the input button; a display control module for controlling the brightness of LED digital tubes and LED lights using PWM pulse technology and performing dynamic display blanking processing to obtain a display effect; an updated display module for performing data interaction between the button and the display effect based on the priority scheduling strategy to obtain an updated display effect.

[0012] One or more technical solutions provided in this application have at least the following beneficial effects:

[0013] By integrating plexiglass, plastic light baffle, printed circuit board and spring, a control unit is built to provide physical support for touch detection and task scheduling. The relaxation oscillation method is used for capacitor charge and discharge detection, and the occurrence of touch events is judged by measuring the change of charge and discharge frequency pulses, thereby improving the accuracy of key detection. The brightness of LED digital tubes and LED lights is controlled by PWM pulse technology, and dynamic blanking processing is performed to ensure that the displayed content is clear without afterimages, improving the user's visual experience. The status information of the device is obtained through button input, and scheduling is performed according to the task priorities (high, medium, low) to ensure that high-priority tasks are processed first, improving the task processing efficiency. The task status information is parsed and the displayed content is dynamically updated, enabling users to view the task execution status in real time and optimizing the interaction experience.

[0014] In summary, by constructing an optimized touch detection system, combining improved physical structures and algorithms, this application greatly improves the accuracy and stability of touch buttons, effectively solving the problems of accidental touch, false judgment of high sensitivity, and external light interference. At the same time, the display effect of the device is optimized through PWM dynamic display technology, ensuring that users can clearly and intuitively obtain interaction information. In addition, combined with the priority scheduling strategy, task management becomes more intelligent, ensuring that high-priority tasks are promptly responded to and improving the overall operation efficiency of the device. Overall, this solution improves the accuracy and stability of human-computer interaction, enhances the intelligence of task scheduling, and optimizes the user's operation experience and the working efficiency of the device.

[0015] The above description is only an overview of the technical solution of this application. In order to be able to understand the technical means of this application more clearly, it can be implemented according to the content of the specification. And in order to make the above and other purposes, features and advantages of this application more obvious and understandable, the following specific embodiments of this application are specifically given. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 It is a schematic flow chart of a priority scheduling method for multi-modal human-computer interaction instructions provided by an embodiment of this application.

[0017] Figure 2 It is a schematic structural diagram of a priority scheduling system for multi-modal human-computer interaction instructions provided by an embodiment of this application.

[0018] Description of the reference numerals: The first module 10, the key detection module 20, the display control module 30, the updated display module 40. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0019] Embodiments of the present application provide a method and system for priority scheduling of multimodal human-computer interaction instructions, which solve the technical problems in the prior art that due to the high mis-touch rate of touch buttons and susceptibility to external light interference, the interaction accuracy is low and the operation experience is poor, and achieve the technical effects of improving the accuracy of touch detection, enhancing the interaction stability and optimizing the user experience.

[0020] Embodiment 1, as Figure 1 shown, embodiments of the present application provide a method for priority scheduling of multimodal human-computer interaction instructions, and the method includes:

[0021] Step S1: Build a control unit.

[0022] Specifically, the control unit is composed of various components and is responsible for controlling and coordinating various input and output devices. By combining components such as plexiglass, plastic light-shielding plates, printed circuit boards, and springs to build the control unit, a stable hardware foundation is provided for the entire multimodal human-computer interaction system, enabling subsequent operations such as touch button detection and display control to proceed orderly, and through the setting of components such as light-shielding plates, a preliminary guarantee is provided for improving the accuracy of touch buttons and the display effect.

[0023] Step S2: Based on the control unit, perform capacitance touch button detection to determine the input button.

[0024] Specifically, capacitance touch button detection is a technology that identifies user touch operations by detecting capacitance changes. When the user's finger touches the touch button area, the capacitance value of that area will change. After the control unit is built, the control unit is used to detect capacitance changes, determine whether a touch operation has occurred, and the specific area where the touch operation occurs, and then identify the specific button touched by the user. Through capacitance touch button detection, the input of the user to the capacitance touch button can be accurately identified, improving the accuracy of touch detection, ensuring the accuracy of user input, and thus providing a prerequisite for correctly executing operation instructions subsequently.

[0025] Step S3: Use PWM pulse technology to control the brightness of LED digital tubes and LED lights, and perform dynamic display blanking processing to obtain a display effect.

[0026] Specifically, the PWM pulse technology (Pulse-Width Modulation), that is, the pulse width modulation technology, is a technology that controls the average voltage of a signal by changing the width of a pulse signal. In terms of controlling the brightness of an LED, the average current of the LED is changed by adjusting the duty cycle of the PWM signal (that is, the proportion of the high-level time in one cycle), thereby controlling the brightness of the LED. An LED digital tube is a display device composed of multiple light-emitting diodes, used to display information such as numbers and letters, and has advantages such as high brightness, fast response speed, and low energy consumption. An LED lamp, that is, a light-emitting diode, is an efficient lighting device, with characteristics such as long life, energy saving, and small size, and is widely used in display and indication aspects.

[0027] The microcontroller is used to generate a PWM signal, and the brightness of the LED digital tube and the LED lamp is controlled by adjusting the duty cycle of the PWM signal. The PWM signal is connected to the driving circuit of the LED. When the duty cycle increases, the average current of the LED increases and the brightness increases; conversely, when the duty cycle decreases, the brightness decreases. In order to implement dynamic display blanking processing, reasonable settings need to be made according to the visual persistence characteristics of the human eye and the display refresh rate of the LED. By programming the microcontroller, the display timing and refresh frequency of the LED are controlled so that a complete display update is completed within the visual persistence time of the human eye, thereby eliminating the phenomena of flicker and afterimage, and improving the clarity and stability of the display effect. Exemplarily, on the control panel of a printer, an LED digital tube is used to display the current printing task progress and status information, such as "Ready", "Printing", "Error", etc. Through the PWM pulse technology, the brightness of the LED digital tube can be automatically adjusted according to different operation scenarios and ambient light. For example, in a bright office environment, the brightness is increased so that users can clearly see the display content; in a darker environment, the brightness is reduced to reduce the impact of light on users. At the same time, through dynamic display blanking processing, it is ensured that there will be no obvious flicker or afterimage when the display content is switched or updated, making the display effect smoother and more natural.

[0028] Using the PWM pulse technology to control the brightness of the LED digital tube and the LED lamp can achieve precise adjustment of the display brightness, improving the adaptability and comfort of the display effect. The dynamic display blanking processing makes the display effect clearer, more stable and more beautiful, enhancing the visual feedback effect in human-computer interaction.

[0029] Step S4: Based on the priority scheduling strategy, data interaction is performed between the key and the display effect to obtain an updated display effect.

[0030] Specifically, first, the key inputs are read from the control unit, and these key inputs represent the user's operation instructions. Then, according to the preset priority scheduling strategy, the tasks are classified and sorted. For example, an urgent printing task is set to a high priority, a general setting operation is set to a medium priority, and operations such as querying the history are set to a low priority. These tasks are processed according to the priority order, and data interaction is performed between the processing results and the display effects to update the display content and effects of the LED digital tube and the LED lights, such as displaying the progress of the task, status prompts, etc. Exemplarily, in a multi-task processing scenario of a printer, when the user simultaneously presses the keys to start a printing task and query the ink cartridge remaining amount, according to the pre-set priority scheduling strategy, the start printing task is determined to be a high priority, and the printing operation is immediately executed, and a prompt message "Printing task has been started, please wait" is displayed on the LED digital tube. At the same time, the operation of querying the ink cartridge remaining amount is determined to be a medium priority, and it is processed during the gap or after the execution of the printing task, and the display effect is updated to display the current remaining amount of the ink cartridge. This can ensure that important printing tasks can be promptly responded to and executed, improving work efficiency.

[0031] The above steps achieve the integration of multi-modal interaction, organically combine the user's key inputs with the display effects of the device, and perform reasonable scheduling according to the task priorities, which helps to improve the operation efficiency of the device, reduce the delayed processing of important tasks, optimize the human-computer interaction experience, and enable the user to more intuitively understand the execution status and priority of the tasks.

[0032] Further, the control unit described in step S1 of the embodiment of the present application includes plexiglass, a plastic light shield, a printed circuit board, and a spring; the plexiglass is used as an operation panel for touch interaction; the plastic light shield is used to block external light interference; the printed circuit board is a circuit component; the spring is used to control the physical distance between the plexiglass and the printed circuit board.

[0033] Specifically, the plexiglass has good optical transparency and is used as an operation panel, which is convenient for users to directly touch and operate and display information. The plastic light shield is used to block external light interference, prevent external light from affecting the normal operation of internal components, and ensure the accuracy of touch detection. The printed circuit board (PCB) is a carrier for electronic components, used to install and connect various electronic components to realize the functions of the circuit. The spring provides mechanical support and physical feedback, and is used to control the physical distance between the plexiglass and the printed circuit board. By its elastic force, it maintains an appropriate distance between the two, thereby changing the sensitivity of capacitive touch.

[0034] First, according to the appearance design and operation requirements of the device, select plexiglass with appropriate size and transparency as the operation panel, and fix it on the device housing. To prevent external light interference from affecting capacitive touch detection, add a plastic light shield under the panel, which can be connected by bonding, snap-fastening, etc. Then, install a printed circuit board (PCB) under the plexiglass. This circuit board integrates a touch detection circuit, an LED control circuit, and a microprocessor. To ensure a reasonable physical distance between the plexiglass and the PCB while having a certain elastic feedback, fix springs on multiple support points of the printed circuit board and connect them to the plexiglass. By adjusting the number, position, and elasticity of the springs, control the physical distance between the plexiglass and the printed circuit board to achieve the best capacitive touch effect.

[0035] Through the reasonable combination and design of components such as plexiglass, plastic light shield, printed circuit board, and springs, a complete control unit is built, providing a hardware foundation for subsequent touch detection, LED display control, and priority scheduling, enhancing the stability of the touch panel, and improving the interaction experience at the same time.

[0036] Furthermore, the spring is used to control the physical distance between the plexiglass and the printed circuit board, including:

[0037] Step S11: Fix the spring on multiple support points of the printed circuit board and connect it to the plexiglass.

[0038] Step S12: Obtain the static height and spring constant of the spring, and calculate the original height of the connecting member based on the thickness of the plexiglass.

[0039] Step S13: Compare the restored height after multiple pressure presses with the original height. If the comparison result is unqualified, repair the spring and the plexiglass. If the comparison result is qualified, complete the physical distance control.

[0040] Specifically, fix multiple springs evenly on the support points of the printed circuit board, which can be fixed by soldering (if the support points have a suitable connection structure) or using specific fixing parts (such as snap-fasteners, etc.), and then connect the other end of the spring to the plexiglass. When installing the springs, it is necessary to ensure that the springs are evenly stressed to avoid excessive or insufficient pressing force in local areas, which may affect the touch sensitivity.

[0041] Measure the static height of the spring, that is, the natural height of the spring when it is not subject to external force, and use Hooke's law to obtain the spring constant (k). Subsequently, measure the thickness of the plexiglass, and then calculate the original height of the connecting member (here referring to the connection structure composed of plexiglass, spring, and printed circuit board), that is, the distance between the plexiglass and the PCB in the non-pressed state.

[0042] Apply multiple different pressures to the plexiglass to simulate different pressing situations in actual use, and then measure the recovery height of the spring after the pressure disappears. Compare the original height with the recovery height after pressing. If the deviation between the recovery height and the original height is too large, that is, an unqualified comparison result is obtained, it indicates that the spring elasticity decays, which will lead to a decrease in touch sensitivity or frequent accidental touches. At this time, repairs are required, such as replacing the spring, adjusting the spring fixing position, or replacing the plexiglass material. If the recovery height is within a reasonable range, that is, a qualified comparison result is obtained, it indicates that the physical distance control is normal, and the entire physical distance control process is completed.

[0043] The above steps make the plexiglass evenly stressed by reasonably arranging the spring support points, reducing the occurrence of accidental touches. Subsequently, calculate the static height of the spring, the spring constant, and the thickness of the plexiglass to ensure the best feedback distance of the touch button. Finally, monitor the stability of the touch panel by comparing the recovery height after pressing, and make adjustments or repairs when necessary to ensure the reliability of long-term use.

[0044] Furthermore, step S2 of the embodiment of the present application includes:

[0045] Step S21: Based on the control unit, the charging and discharging processes of the resistor and capacitor are carried out in a relaxation oscillation mode.

[0046] Step S22: Perform capacitive touch detection by measuring the frequency pulse change during the charging and discharging process within a preset time to obtain a touch event determination result.

[0047] Step S23: If it is determined based on the touch event determination result that a touch event has occurred, determine the pressed button based on multi-channel scanning.

[0048] Specifically, the relaxation oscillation mode is a simple working mode of an oscillation circuit. An oscillation signal is generated through the charging and discharging processes of the resistor and capacitor, and its frequency is related to the parameters of the resistor and capacitor. After the control unit is built, the capacitive touch detection circuit in the control unit is used, and this circuit works based on the relaxation oscillation mode. First, connect the power supply to one end of the capacitor through a resistor, and the other end of the capacitor is grounded to form a basic charging and discharging loop. When the user's finger approaches or touches the touch button area, the capacitance of the human body will form an equivalent capacitance change with the capacitance in the circuit, resulting in a change in the charging and discharging time constant of the capacitor, and further affecting the frequency of the oscillation circuit.

[0049] In a relaxation oscillation circuit, the charging and discharging process of the capacitor will cause the circuit to generate periodic pulse signals. The frequency of these signals is related to factors such as the capacitance value and the resistance value. When the capacitance changes, the frequency will also change accordingly. By detecting the change in the frequency pulse within a preset time window, the capacitance touch situation can be judged, and whether a touch event occurs can be detected to obtain a touch event determination result, that is, to determine whether the user has pressed a certain button.

[0050] When it is determined that a touch event has occurred, a multi-channel scanning method is adopted to determine which specific button has been pressed. The multi-channel scanning uses a decoder to sequentially select the signal channels corresponding to different buttons for detection, records the oscillation frequency of each channel through a counter, and compares it with a preset threshold to identify the specific button that has been pressed.

[0051] Through the capacitance touch button detection technology, accurate identification of the user's touch operation can be achieved, improving the sensitivity and accuracy of the interaction. Compared with traditional physical buttons, capacitance touch buttons have the advantages of no mechanical wear, long service life, and beautiful appearance. At the same time, by adopting the relaxation oscillation method and multi-channel scanning technology, the false touch rate is reduced, and the reliability and stability of touch detection are improved, making it better able to adapt to different operating environments and user needs.

[0052] Furthermore, step S22 includes:

[0053] Step S221: Based on the window of the preset time, use a counter to calculate the number of oscillation pulses.

[0054] Step S222: If the count value is lower than the preset threshold, it is determined that a touch event has occurred.

[0055] Step S223: If the count value is higher than or equal to the preset threshold, it is determined that no touch event has occurred.

[0056] Specifically, the window of the preset time refers to a fixed time period set during the detection process for counting and analyzing the oscillation pulses. First, determine the window of the preset time, and the size of this window is preset according to the requirements of capacitance touch button detection and system performance. Then, within this time window, use a counter to count the oscillation pulses generated by the relaxation oscillation. For example, if the preset time window is 5 milliseconds, within these 5 milliseconds, the counter starts to accumulate and count each oscillation pulse.

[0057] Compare the count value obtained by the counter with a preset threshold. According to the principle of capacitive touch button detection, touching changes the capacitance, which in turn affects the oscillation frequency, and further reduces the number of pulses within a preset time window. If the count value is lower than the preset threshold, it means that the capacitance value has changed, and a touch event is determined to have occurred. If the count value is higher than or equal to the preset threshold, it indicates that the capacitance value has not changed significantly (normal situation when not touched), and it is determined that no touch event has occurred.

[0058] Exemplarily, start the counter within a set time window and measure the number of pulses generated by the oscillation circuit. Normal state (not touched): within a 1ms time window, the circuit operates normally, and the measured number of oscillation pulses is 1000 times. Touch state (user touches the button): when the user's finger approaches the touch button, the capacitance increases, resulting in a decrease in the oscillation frequency. For example, the number of oscillation pulses within 1ms becomes 700 times. Strong touch (deep touch): when the user's finger completely covers the touch button, the capacitance changes even more, and the oscillation frequency further decreases. For example, the number of oscillation pulses within 1ms becomes 500 times.

[0059] Through the above steps, a complete touch event detection mechanism is formed, ensuring that the device can stably respond to user operations, improving the accuracy and reliability of touch detection, and enhancing the user experience.

[0060] Further, step S23 includes:

[0061] Step S231: Use a decoder to sequentially select the signals of the buttons for detection.

[0062] Step S232: Record the oscillation frequency of each channel through a counter and compare it with a preset threshold.

[0063] Step S233: Based on the comparison, identify the channels with a decreased oscillation frequency and determine the pressed button.

[0064] Specifically, a decoder is a digital circuit device that can convert the input encoded signal into a corresponding output signal. In this solution, it is used to sequentially select different button signal channels for detection. First, determine the total number of button signals to be detected and their corresponding encoding methods (such as binary encoding). Then connect the decoder to the corresponding circuit. In the pre-determined order, the decoder outputs one signal each time to select the signal of one button for detection. For example, if there are 8 buttons and a 3-8 decoder is used, the decoder will sequentially output 8 different signals, and each signal corresponds to the detection channel of one button.

[0065] When each key signal is selected by the decoder for detection, the oscillation frequency of the channel is recorded by a counter. The counter counts the number of oscillation signal periods within a certain time, and then calculates the oscillation frequency based on the time and the number of periods. For example, within a detection time of 1 millisecond, if the counter counts 100 periods, then the oscillation frequency is 100 kilohertz. Then, the calculated oscillation frequency is compared with a preset threshold.

[0066] When it is found that the oscillation frequency of a certain channel decreases and is lower than the preset threshold, according to the principle of capacitive touch keys, the key corresponding to this channel is considered to be the pressed key. By comparing and identifying the channel with the decreased oscillation frequency, the pressed key can be determined. Exemplarily, in a control panel with six keys, after detection, it is found that the oscillation frequencies of channel 2 and channel 5 decrease, and the count values are lower than the preset threshold. By querying the correspondence between the channels and the keys, it is determined that the user has pressed the keys connected to channel 2 and channel 5, namely the "Print" and "Settings" keys.

[0067] Based on comparing and identifying the channel with the decreased oscillation frequency and determining the pressed key, it is possible to achieve simultaneous detection and accurate identification of multiple keys, improve the efficiency and convenience of human-computer interaction, and facilitate the user to quickly operate multiple keys to complete different tasks. At the same time, through precise channel identification and key determination, the possibility of misoperation is reduced, and the reliability of the device and the user experience are enhanced.

[0068] Further, step S4 of the embodiment of the present application includes:

[0069] Step S41: Read the input key from the control unit.

[0070] Step S42: Based on the key, after the printer executes the task, return status information, where the returned status information includes the priority scheduling policies of high-priority tasks, medium-priority tasks, and low-priority tasks.

[0071] Step S43: Analyze the returned status information and update the display of the control unit to obtain the updated display effect.

[0072] Specifically, in an embodiment of the human-computer interaction of a printer, obtain the key information input by the user from the control unit to accurately obtain the user's operation intention. The printer executes corresponding tasks according to the key input read from the control unit. For example, if the key input of "Print a color document" is read, the printer will start the color printing process. During the execution of the task, the software and hardware systems inside the printer determine the priority of the task according to the nature of the task (such as the urgency of the printing task, the size of the printed document, etc.), and return the status information including the priority scheduling policies of high, medium, and low-priority tasks.

[0073] After the control unit receives the status information returned by the printer, it parses the information. The parsing process includes identifying the relevant identifiers and information of high, medium, and low priority tasks. Then, the control unit updates its display according to this information. For example, if a high-priority task is being executed, the control unit will display "High-priority task in progress" on the display panel and show the relevant task progress information. By parsing the status information and updating the display, it is convenient for users to intuitively understand the execution status and priority of tasks, improving the efficiency of human-computer interaction and the user experience.

[0074] This dynamic display update mechanism improves the friendliness and practicality of human-computer interaction. Users can intuitively understand the operation status and operation results of the device. At the same time, through the update of the display effect, it can also guide users to perform the next operation, enhancing the intelligence level of the device and the user experience.

[0075] In summary, the priority scheduling method for multi-modal human-computer interaction instructions provided by the embodiments of the present application has the following beneficial effects:

[0076] By integrating plexiglass, plastic light baffle, printed circuit board and spring, a control unit is built to provide physical support for touch detection and task scheduling. The relaxation oscillation method is used for capacitor charge and discharge detection. By measuring the change of charge and discharge frequency pulses, the occurrence of touch events is judged, thereby improving the accuracy of key detection. The brightness of the LED digital tube and LED lights is controlled by PWM pulse technology, and dynamic blanking processing is performed to ensure that the displayed content is clear without afterimages, improving the user's visual experience. The status information of the device is obtained through key input, and scheduling is performed according to the task priority (high, medium, low) to ensure that high-priority tasks are processed first, improving the task processing efficiency. The task status information is parsed and the display content is dynamically updated, enabling users to view the task execution status in real time and optimizing the interaction experience.

[0077] Overall, the embodiments of the present application build an optimized touch detection system, combined with improved physical structures and algorithms, greatly improving the accuracy and stability of touch keys, effectively solving the problems of accidental touch, high-sensitivity misjudgment, and external light interference. At the same time, the display effect of the device is optimized through PWM dynamic display technology to ensure that users can clearly and intuitively obtain interaction information. In addition, combined with the priority scheduling strategy, task management becomes more intelligent, ensuring that high-priority tasks are responded to in a timely manner and improving the overall operation efficiency of the device. All in all, the embodiments of the present application improve the accuracy and stability of human-computer interaction, enhance the intelligence of task scheduling, and optimize the user's operation experience and the working efficiency of the device.

[0078] Embodiment 2, as Figure 2As shown in the figure, based on the same inventive concept as the foregoing Embodiment 1, the embodiment of the present application provides a priority scheduling system for multi-modal human-computer interaction instructions. The system includes:

[0079] A first module 10 for building a control unit.

[0080] A key detection module 20 for detecting a capacitive touch key based on the control unit to determine the input key.

[0081] A display control module 30 for controlling the brightness of an LED digital tube and an LED lamp using PWM pulse technology and performing dynamic display blanking processing to obtain a display effect.

[0082] An updated display module 40 for performing data interaction between the key and the display effect based on a priority scheduling strategy to obtain an updated display effect.

[0083] Furthermore, the control unit includes plexiglass, a plastic light-shielding plate, a printed circuit board, and a spring. The plexiglass serves as an operation panel for touch interaction. The plastic light-shielding plate is used to block external light interference. The printed circuit board is a component of the circuit. The spring is used to control the physical distance between the plexiglass and the printed circuit board.

[0084] Furthermore, the first module 10 of the embodiment of the present application is further configured to perform the following steps:

[0085] Fix the spring on multiple support points of the printed circuit board and connect it to the plexiglass. Obtain the static height and elastic coefficient of the spring, and calculate the original height of the connecting member based on the thickness of the plexiglass. Compare the restored height after multiple pressure presses with the original height. If the comparison result is unqualified, repair the spring and the plexiglass. If the comparison result is qualified, complete the physical distance control.

[0086] Furthermore, the key detection module 20 of the embodiment of the present application is further configured to perform the following steps:

[0087] Based on the control unit, use the relaxation oscillation method to perform the charge and discharge process of resistors and capacitors. Detect capacitive touch by measuring the frequency pulse change during the charge and discharge process within a preset time to obtain a touch event determination result. If it is determined based on the touch event determination result that a touch event has occurred, determine the pressed key based on multi-channel scanning.

[0088] Furthermore, the key detection module 20 of the embodiment of the present application is further configured to perform the following steps:

[0089] Based on a window of a preset time, use a counter to calculate the number of oscillation pulses; if the count value is lower than a preset threshold, it is determined that a touch event has occurred; if the count value is higher than or equal to the preset threshold, it is determined that no touch event has occurred.

[0090] Further, the key detection module 20 in the embodiment of the present application is further configured to perform the following steps:

[0091] Use a decoder to sequentially select the signals of the keys for detection; record the oscillation frequency of each channel through a counter and compare it with a preset threshold; based on the comparison, identify the channel with a decreasing oscillation frequency to determine the pressed key.

[0092] Further, the update display module 40 in the embodiment of the present application is further configured to perform the following steps:

[0093] Read the input key from the control unit; based on the key, after the printer executes the task, return the status information, where the returned status information includes the priority scheduling policies of high-priority tasks, medium-priority tasks, and low-priority tasks; analyze the returned status information and update the display of the control unit to obtain the updated display effect.

[0094] Through the foregoing detailed description of the priority scheduling method for multi-modal human-computer interaction instructions in this specification, those skilled in the art can clearly know the priority scheduling system for multi-modal human-computer interaction instructions in this embodiment. For the system disclosed in Embodiment 2, since it corresponds to the method disclosed in Embodiment 1, it has corresponding functional modules and beneficial effects. For the relevant parts, refer to the description in the method part.

[0095] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present application. Various modifications to these embodiments will be obvious to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for priority scheduling of multimodal human-computer interaction instructions, characterized in that Including: Build a control unit; Based on the control unit, perform capacitance touch button detection to determine the input button; Use PWM pulse technology to control the brightness of LED digital tubes and LED lights, and perform dynamic display blanking processing to obtain a display effect; Based on a priority scheduling strategy, perform data interaction between the button and the display effect to obtain an updated display effect.

2. The priority scheduling method for multi-modal human-computer interaction instructions according to claim 1, characterized in that, The control unit includes plexiglass, a plastic light shield, a printed circuit board, and a spring; Use the plexiglass as an operation panel for touch interaction; The plastic light shield is used to block external light interference; The printed circuit board is a circuit component; The spring is used to control the physical distance between the plexiglass and the printed circuit board.

3. The priority scheduling method for multimodal human-computer interaction instructions according to claim 2, characterized in that The spring is used to control the physical distance between the plexiglass and the printed circuit board, including: Fix the spring on multiple support points of the printed circuit board and connect it to the plexiglass; Obtain the static height and spring constant of the spring, and calculate the original height of the connecting member based on the thickness of the plexiglass; Based on the original height, compare the restored height after multiple pressure presses. If the comparison result is unqualified, repair the spring and the plexiglass. If the comparison result is qualified, complete the physical distance control.

4. The priority scheduling method for multimodal human-computer interaction instructions according to claim 1, characterized in that, Based on the control unit, perform capacitance touch button detection to determine the input button, including: Based on the control unit, use the relaxation oscillation method to charge and discharge the resistor and capacitor; Perform capacitance touch detection by measuring the frequency pulse change during the charge and discharge process within a preset time to obtain a touch event determination result; If it is determined based on the touch event determination result that a touch event has occurred, determine the pressed button based on multi-channel scanning.

5. The priority scheduling method for multi-modal human-computer interaction instructions according to claim 4, characterized in that, Obtain the touch event determination result, including: Based on a window of preset time, use a counter to calculate the number of oscillation pulses; If the count value is lower than the preset threshold, it is determined that a touch event has occurred; If the count value is higher than or equal to the preset threshold, it is determined that no touch event has occurred.

6. The priority scheduling method for multimodal human-computer interaction instructions according to claim 4, wherein Based on multi-channel scanning to determine the pressed button, including: Use a decoder to sequentially select the signals of the buttons for detection; Record the oscillation frequency of each channel through a counter and compare it with the preset threshold; Based on the comparison, identify the channel with a decreasing oscillation frequency to determine the pressed button.

7. The priority scheduling method for multimodal human-computer interaction instructions according to claim 1, wherein Based on a priority scheduling strategy, perform data interaction between the button and the display effect to obtain an updated display effect, including: Read the input button from the control unit; Based on the button, after the printer executes a task, return status information, where the returned status information includes the priority scheduling strategies of high-priority tasks, medium-priority tasks, and low-priority tasks; Parse the returned status information and update the display of the control unit to obtain the updated display effect.

8. A priority scheduling system for multi-modal human-computer interaction instructions, characterized in that, The system is used to execute the priority scheduling method of the multi-modal human-computer interaction instruction according to any one of claims 1-7, including: A first module for building a control unit; A button detection module for performing capacitance touch button detection based on the control unit to determine the input button; A display control module, which is used to control the brightness of LED digital tubes and LED lights by using PWM pulse technology and perform dynamic display blanking processing to obtain a display effect; An updated display module, which is used to perform data interaction between the keys and the display effect based on a priority scheduling strategy to obtain an updated display effect.