Human-machine interaction system and method

Abstract

The application relates to a human-computer interaction system and method. The system comprises a working device and a human-computer interaction component, the working device is connected with the human-computer interaction component, the working device is arranged in a cabinet, and the human-computer interaction component is installed on a panel of the cabinet facing an operator; wherein the human-computer interaction component is used for displaying operation information of the working device on a display screen in the human-computer interaction component before the working device is powered on; in the process of powering on the working device, initial states of various components in the working device are acquired, and the initial states of the various components are displayed on the display screen in the human-computer interaction component; in the process of normal operation of the working device, working conditions of the working device are acquired, and the working conditions are displayed on the display screen in the human-computer interaction component. The system makes the operation of the operator during the whole working process of the working device guided and monitored, and greatly guarantees the safe usability of the working device.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of information technology, in particular to a human-computer interaction system and method. BACKGROUND

[0002] With various standard / non-standard equipment applied in various fields, the safe use of standard / non-standard equipment has become a technical problem to be solved in the current equipment management.

[0003] At present, the use of cabinets to carry standard / non-standard equipment is generally used to ensure the use environment and safety of standard / non-standard equipment. Specifically, a nameplate can be provided on the cabinet to prompt the name, manufacturer, function and other related information of the equipment carried in the cabinet; or the operation information of the carried equipment can be pasted or mounted on the corresponding position of the cabinet, so that the equipment operator can perform the pre-startup connection or installation operation of the equipment by checking the operation information before starting the equipment, to ensure the normal and safe startup of the equipment.

[0004] However, the current cabinet function is single, resulting in low safety of the cabinet carrying equipment. SUMMARY

[0005] Therefore, it is necessary to provide a human-computer interaction system and method capable of improving the safety of cabinet carrying equipment in view of the above technical problems.

[0006] In a first aspect, the present application provides a human-computer interaction system. The system comprises: a working device and a human-computer interaction component, the working device is connected with the human-computer interaction component, the working device is arranged in the cabinet, and the human-computer interaction component is installed on the panel of the cabinet facing the operator;

[0007] The human-computer interaction component is used to display the operation information of the working device on the display screen in the human-computer interaction component before the working device is powered on, to instruct the operator to perform the related operation of connecting and starting the working device according to the operation information;

[0008] The human-computer interaction component is used to acquire the initial state of each component in the working device during the process of powering on the working device, and display the initial state of each component on the display screen in the human-computer interaction component;

[0009] The human-computer interaction component is used to acquire the working condition of the working device during the process of normal operation of the working device, and display the working condition on the display screen in the human-computer interaction component.

[0010] In one of the embodiments, the image acquisition device, the output module, the control module and the display screen; the control module is connected with the image acquisition device, the output module and the display screen respectively; the image acquisition device includes a camera or a camera.

[0011] In one of the embodiments, the human-computer interaction component is further used to move the image acquisition device to the visual angle area range of monitoring the operator operating the work equipment before the work equipment is powered on, to instruct the image acquisition device to collect image or video data when the operator operates according to the operation information displayed on the display screen, and to identify the collected image or video data through the control module to determine whether the operator operates normally, and to output alarm information through the output module when the operator does not operate normally, and to display the operation information of the next step on the display screen or output the voice operation information of the next step through the output module when the operator operates normally.

[0012] In one of the embodiments, the human-computer interaction component is used to obtain the initial state of each component in the work equipment during the process of powering on the work equipment, including:

[0013] During the process of powering on the work equipment, the control module sends power-on instructions of each component to the work equipment in a preset priority order, instructs the components to power on in the priority order, reads the self-check results and related parameters of the components after self-checking, and determines the initial state of each component according to the self-check results and related parameters of the components; the related parameters include the voltage and / or current of each component.

[0014] In one of the embodiments, the control module is further used to calculate the metering period of each component, display the components that are due for metering on the display screen, and cut off the power supply of the components that are due for metering.

[0015] In one of the embodiments, the human-computer interaction component is further used to calculate the power-off sequence of each component by the control module using a preset priority power-off strategy when the work equipment abnormally or stops working, and sends power-off instructions of each component to the work equipment in the power-off sequence to instruct the components to perform power-off operation after receiving the power-off instructions.

[0016] In one of the embodiments, the human-computer interaction component further includes a touch key; the touch key is used to display an information interaction page on the display screen when triggered by the operator.

[0017] In one of the embodiments, the system further comprises at least one of a temperature sensor, an air path sensor, and a liquid path sensor.

[0018] In one of the embodiments, the display screen in the human-machine interaction component is further used to display the name, manufacturer, and related information of the working equipment.

[0019] In a second aspect, the present application further provides a human-machine interaction method. The method is applied to the system in the first aspect, and the method comprises:

[0020] Before the working equipment is powered on, the human-machine interaction component displays the operation information of the working equipment on the display screen in the human-machine interaction component, so as to instruct the operator to perform the related operation of connecting and starting the working equipment according to the operation information;

[0021] During the powering-on process of the working equipment, the human-machine interaction component acquires the initial state of each component in the working equipment, and displays the initial state of each component on the display screen in the human-machine interaction component;

[0022] During the normal operation process of the working equipment, the human-machine interaction component acquires the working condition of the working equipment, and displays the working condition on the display screen in the human-machine interaction component.

[0023] The human-machine interaction system provided in the above embodiments not only makes the single cabinet intelligent, but also makes the operation of the operator during the entire working process (including before powering on, during powering on, and after powering on) guided and monitorable, greatly ensuring the safe use of the working equipment. Moreover, the initial state and working condition of the working equipment can be displayed to the operator in any case of the working equipment, which can improve the efficiency of the operator in maintaining the working equipment. BRIEF DESCRIPTION OF DRAWINGS

[0024] Figure 1 FIG. 1 is a structural schematic diagram of the human-machine interaction system in one of the embodiments;

[0025] Figure 2 FIG. 2 is a structural schematic diagram of the human-machine interaction component in one of the embodiments;

[0026] Figure 3 FIG. 3 is a flow schematic diagram of the human-machine interaction method in one of the embodiments;

[0027] Figure 4 FIG. 4 is an internal structural diagram of the computer device in one of the embodiments;

[0028] Working equipment 10, human-machine interaction component 11;

[0029] The cabinet 12, the display screen 110;

[0030] The image acquisition device 111, the output module 112;

[0031] The control module 113, the connecting rod or the boom 1110;

[0032] The camera or the camera 1111. DETAILED DESCRIPTION

[0033] In order to make the purpose, technical scheme and advantages of the present application more clear, the present application is further described in detail below in combination with the drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application, and are not used to limit the present application.

[0034] The terms "first", "second", "third", and "fourth" and the like in the description and claims of the present application and the accompanying drawings are used to distinguish different objects, and are not used to describe a particular order. In addition, the terms "comprise" and "have" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but can optionally include steps or units not listed, or can optionally include other steps or units inherent to the process, method, product or device.

[0035] Reference herein to "embodiments" means that the particular features, structures, or characteristics described in connection with the embodiments can be included in at least one embodiment of the present application. The appearance of the phrase in various places in the specification does not necessarily all refer to the same embodiment, nor is it necessarily mutually exclusive of other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.

[0036] Referring to Figure 1 The man-machine interaction system shown, the system comprises: working equipment 10 and man-machine interaction component 11, working equipment 10 and man-machine interaction component 11 are connected ( Figure 1The working device 10 is arranged inside the cabinet 12, and the human-computer interaction assembly 11 is arranged on a panel of the cabinet 12 facing the operator; wherein the human-computer interaction assembly 11 is configured to display operation information of the working device 10 on a display screen 110 in the human-computer interaction assembly 11 before the working device 10 is powered on, so as to instruct the operator to perform relevant operations of connecting or detecting the working device 10 according to the operation information; the human-computer interaction assembly 11 is configured to acquire initial states of each component in the working device 10 during the process that the working device 10 is powered on, and display the initial states of each component on the display screen 110 in the human-computer interaction assembly 11; and the human-computer interaction assembly 11 is configured to acquire working conditions of the working device 10 during the process that the working device 10 is normally running, and display the working conditions on the display screen 110 in the human-computer interaction assembly 11.

[0037] The working device 11 is a device carried by the cabinet 12, and in actual application, the working device 11 can be an industrial computer or a PC, etc. Each component in the working device 11, such as a detection device and a detection instrument, can perform information interaction.

[0038] The cabinet 12 is a carrier of various standard / non-standard devices, and is a carrier of the working device 11 in the embodiment. The human-computer interaction assembly 11 can be arranged on a movable panel or a baffle of the cabinet 12, and the human-computer interaction assembly 11 can be connected with the working device 11 and perform information interaction through a corresponding communication interface. In actual application, the cabinet 12 can be a standard cabinet, such as a 19-inch standard cabinet, and a standard panel size of the standard cabinet can be: a width of 48.26 cm = 19 inches, and a height (the height is in units of U, IU = 4.445 cm, and the height is a multiple of 4.445 cm). The cabinet 12 adopts a rack mounting mode. It can be understood that the movable panel or the baffle provided with the human-computer interaction assembly 11 can be a movable panel or a baffle at the top of the cabinet 12, so as to facilitate the operator to perform human-computer interaction operation with the human-computer interaction assembly 11.

[0039] The man-machine interaction assembly 11 has a display function, and can display operation information of the working device 10 on the display screen 110 in the man-machine interaction assembly 11 before the working device 10 is powered on. The operation information can include the content of the electronic dictionary or the electronic manual of the working device 10, and is used to indicate the operation method of connecting the working device 10 or detecting the working device 10 (such as connecting the cable, connecting the instrument device, configuring the switch, recording the information, etc.) before the working device 10 is used by the operator. The operator can connect or detect the related components or lines of the working device according to the indication process of the operation information, for example, each step of the operation information displayed on the display screen 110 guides the operator to strictly operate according to each step to complete the connection of the working device or the detection of the working device. The display screen 110 is installed on the panel of the cabinet 12 facing the operator, which is convenient for the operator to view. The man-machine interaction assembly 11 is installed on the panel of the cabinet 12 facing the operator, and the panel can be a baffle of the cabinet, which can be flexibly detached for upgrading and maintenance of the man-machine interaction assembly, such as Figure 1 A measurement baffle is installed on the upper part of the cabinet. The baffle is installed on the rack of the cabinet by screws or other fasteners.

[0040] In the embodiment, when the working device 10 in the cabinet 12 needs to be started, the operator needs to correctly connect or detect each component in the working device 10 or correctly connect the working device 10 with other components to be detected before the working device 10 is powered on. In this case, the display screen 110 of the man-machine interaction assembly 11 on the cabinet 12 can automatically display operation information, so that the operator can view the operation information on the display screen and perform the operation of connecting the device according to the process indicated by the operation information. Alternatively, the man-machine interaction assembly 11 on the cabinet 12 can also broadcast the operation information of the working device through voice broadcast to indicate the operator to perform the operation of connecting the device according to the process indicated by the broadcast operation information, for example, the man-machine interaction assembly 11 divides the operation information into three operation processes, and then broadcasts the three operation processes in turn to indicate the operator to perform the operation according to the three operation processes.

[0041] The man-machine interaction assembly 11 can also obtain the self-checking results of each component in the working device 10 during the power-on process of the working device 10, determine the initial state of each component, and display the initial state of each component on the display screen 110 to show the initial state of each component during the power-on process of the working device 10 to the operator. The initial state of each component can include normal, non-fault, abnormal, fault, etc.

[0042] In the embodiment, when the working equipment 10 in the cabinet 12 starts to power on, each component in the working equipment 10 performs self-checking, and after the self-checking of each component in the working equipment 10 is completed, the self-checking results are collected to the central control module or central control center of the working equipment 10, for example, the main control computer of the working equipment, so that the central control module or central control center of the working equipment 10 can monitor the self-checking conditions of each component, obtain the self-checking results of each component, determine the initial states of each component according to the self-checking results, and then transmit the initial states of each component to the human-computer interaction assembly 11 connected thereto, so that the human-computer interaction assembly 11 can obtain the initial states of each component, and the purpose of real-time monitoring of the initial states of the working equipment 10 is achieved.

[0043] The human-computer interaction assembly 11 can also monitor the working conditions of each component in the working equipment 10 in real time during the normal operation of the working equipment 10, and display the working conditions on the display screen 110 in real time.

[0044] In the embodiment, when the working equipment 10 in the cabinet 12 is normally operated, each component in the working equipment 10 can collect the related parameters of the components in the running process of the components to the central control module or central control center of the working equipment 10, for example, the main control computer of the working equipment, so that the central control module or central control center of the working equipment 10 can monitor the working conditions of each component, for example, the working current, working voltage, working progress and the like of each component, and transmit the working conditions of each component to the human-computer interaction assembly 11 connected thereto, so that the human-computer interaction assembly 11 can obtain the working conditions of each component, and the purpose of real-time monitoring of the working conditions of the working equipment 10 is achieved.

[0045] The human-computer interaction system provided in the above embodiment not only makes the single cabinet intelligent, but also makes the operation of the operator of the working equipment in the whole working process (including before power on, during power on, and after power on) guided and monitorable, which greatly guarantees the safe use of the working equipment. Moreover, the initial states and working conditions of the working equipment and the like can be displayed to the operator in any case of the working equipment, and the efficiency of the operator in maintaining the working equipment can be improved.

[0046] Based on the above application, referring to Figure 2 the structural schematic view of the human-computer interaction assembly Figure 2 the back view of the human-computer interaction assembly on the panel), the human-computer interaction assembly 11 comprises an image acquisition device 111, an output module 112, a control module 113 and a display screen 110; the control module 113 is connected with the image acquisition device 111, the output module 112 and the display screen 110 respectively.

[0047] The image acquisition device 111 includes at least one camera 1111 (four cameras are shown in the figure only as an example), which can realize image acquisition from multiple directions. The image acquisition device 111 is arranged on the panel of the cabinet 12 facing the operator through a connecting rod or a boom 1110. One end of the connecting rod or the boom 1110 can be fixed to the panel through a rotating table (see the structure in Figure 1 The connecting rod or the boom 1110 can drive the image acquisition device 111 to rotate in the horizontal plane, so that the image acquisition device 111 can capture the operation picture (or video) of the operator or the picture (or video) in the front area of the panel of the cabinet facing the operator. The connecting rod or the boom 1110 can also be telescopic, so that the image acquisition device 111 can capture images (or videos) in different areas. One end of the connecting rod or the boom 1110 connected to the image acquisition device 111 can also be provided with a rotating table, so that the image acquisition device 111 is fixed to the rotating table, and the image acquisition device 111 can capture images or videos in different areas by rotating.

[0048] The control module 113 can be used to control the telescopic movement and horizontal rotation of the connecting rod or the boom 1110, and when the image acquisition device 111 reaches the preset position driven by the connecting rod or the boom 1110, the image acquisition device 111 is started to acquire image or video data. The control module 113 is also used to analyze the acquired image or video data by using an image processing algorithm to obtain a captured image or a captured video, and to identify the image or video by using an image recognition algorithm to identify whether the operation process of the operator is correct. When it is identified that the operation process of the operator is incorrect or abnormal, the output module 112 is used to broadcast to inform the operator. Optionally, the output module 112 can be a speaker, an LED light, and the like. When it is detected that the operator operates abnormally, the output module 112 can alarm. It should be noted that the control module 113 is equivalent to an embedded computer in the human-computer interaction component, which has computing and processing functions. For example, the control module 113 can run an image processing algorithm, which is stored in the control module 113 by software (software code storage) and / or hardware (logic solidification). The image or video data acquired by the image acquisition device 111 is sent to the storage unit of the control module under the control of the control module, and is processed by the control module.

[0049] Optionally, the human-computer interaction component 11 can further include a storage module Figure 2The operation information of the operator is stored in the storage module, such as the content of the electronic dictionary and the electronic manual, and the control module 113 can obtain the operation information of the operator from the storage module before the work equipment 10 is powered on, and display the operation information on the display screen 110. Correspondingly, the control module 113 can also convert the operation information into voice information, and send the converted voice information to the output module 112, and play the operation information through the output module 112. Since the operation information includes the operation process of the operator, the operation process of the operator is played through the output module 112, directly instructing the operator to operate according to the operation process played by the output module 112, and then correctly and safely connecting the work equipment 10.

[0050] In actual application, for the operation of the work equipment 10, the paper operation manual of the work equipment 10 is extremely inconvenient to use, and the manual of the complex work equipment 10 is dozens of pages or even thousands of pages, which is very inconvenient for the operator to carry and use. When using the electronic dictionary / electronic manual in the PC or industrial computer embedded in the work equipment 10, it is easy to conflict with the program running on the PC or industrial computer, and the use is also not convenient. Moreover, when using the electronic dictionary / electronic manual, the work equipment 10 must be powered on as a whole, and after the operating system running in the PC or industrial computer works, the electronic dictionary / electronic manual can be used. Generally, before the work equipment 10 is powered on, there are many operations (such as connecting cables, instrument equipment connection, configuration switch, recording information, etc.) that need to be guided. Once these work processes go wrong, the operator also needs to know how to handle it immediately. Usually, for the operation of complex work equipment 10, old employees teach new employees manually, which is very low in efficiency. After the new employees complete the training and independently operate the work equipment 10, there is generally a lack of sufficient supervision of the whole operation. Based on this, before the work equipment 10 is powered on, the man-machine interaction assembly 11 provided by the application can realize the permission management of the operator through the input password or the image acquisition device, and the operation information can be obtained by the operator with permission and displayed to the operator.

[0051] Optionally, the man-machine interaction assembly 11 further comprises a touch button. The touch button is used to indicate the information interaction page displayed on the display screen 110 when triggered by the operator. The touch button can be a touch button on the display screen 110, or can be a separate touch button. The operator can input a password by triggering the touch button, and the control module 113 in the man-machine interaction assembly 11 verifies the password input by the operator, that is, verifies the identity of the operator. If the verification is passed, it is determined that the operator has the right to operate the working device 10 in the cabinet 12. If the verification is not passed, it is determined that the operator does not have the right to operate the working device 10 in the cabinet 12. The operator cannot operate the working device 10, thereby improving the security of the working device 10. Optionally, the image acquisition device 111 in the man-machine interaction assembly 11 can acquire the face image of the operator, and the control module 113 can use an image processing algorithm or an image recognition algorithm to perform face recognition on the face image of the operator to verify the identity of the operator. Optionally, the information interaction page displayed on the display screen 110 can also facilitate the operator to input information on the information interaction page, such as the above-mentioned password, query information for querying an electronic dictionary or an electronic manual, or query information for querying the working condition or initial state of a component, etc.

[0052] Optionally, before the working device 10 is powered on, specifically, the image acquisition device 110 is moved to a visual angle area range for monitoring the operator operating the working device 10, so as to indicate the image acquisition device 10 to acquire image or video data when the operator operates according to the operation information displayed on the display screen 110, and the control module 113 identifies the acquired image or video data to determine whether the operator operates normally. When the operator does not operate normally, the output module 112 outputs a voice alarm information, and when the operator operates normally, the display screen 110 displays the operation information of the next step or the output module 112 outputs the voice operation information of the next step.

[0053] In the embodiment, before the work equipment 10 is powered on, when the operator needs to perform the related operation before the work equipment 10 is powered on, after the identity verification is passed, the man-machine interaction assembly 11 can be started, the control module 113 in the man-machine interaction assembly 11 controls the connecting rod 1110 to drive the image acquisition device 110 to move to the visual angle area range of monitoring the operator operating the work equipment 10, and the control module 13 displays the operation information of the operator on the display screen 110, and the operator can operate according to the operation process indicated by the operation information (such as connecting the cable, connecting the instrument equipment, configuring the switch, recording which information, etc.). At this time, the image acquisition device 110 can acquire the operation picture data or image data of the operator, and then transmit the acquired operation picture data or image data to the control module 13. The control module 13 uses an image recognition algorithm to recognize the operation of the operator in the operation picture based on the operation picture data or image data, and obtains a recognition result. If the recognition result is that the operator is operating correctly and safely, the control module 13 informs the operator that the operation is successful through the output module 112, and can display the next process to be processed on the display screen 110 to instruct the operator to perform the next process. If the recognition result is that the operator is not operating correctly and safely, the control module 13 informs the operator that the operation fails or stops operating through the output module 112, or displays error information on the display screen 110, or sends an alarm through a sound and light alarm prompt device, indicating that the operator is currently performing illegal or unsafe operation. The above embodiment realizes that the work equipment is powered on before the man-machine interaction assembly is used to realize the man-machine interaction with the operator, provides the initial operation method and other information of the work equipment for the operator, and can also judge whether the operation of the operator is correct, which greatly improves the use safety of the work equipment.

[0054] Optionally, during the power-on process of the work equipment 10, specifically, the man-machine interaction assembly 11 sends power-on instructions of each component to the work equipment 10 in a preset priority order through the control module 13, instructs each component to be powered on in the priority order, reads the self-checking results and related parameters of each component after self-checking, and determines the initial state of each component according to the self-checking results and related parameters of each component. The related parameters include the voltage and / or current of each component. The preset priority order can be determined by the control module 13 according to the optimization requirements of component power-on in advance.

[0055] In the embodiment, during the power-on process of the working device 10, since the working device 10 includes multiple components or the working device 10 is connected with multiple components to implement the test on the test piece and the like, all the components can be started simultaneously or sequentially during the start of the working device 10. In order to safely start each component, the components are optimally started sequentially. Therefore, during the power-on process of the working device 10, the control module 13 in the human-computer interaction assembly 11 can sequentially send power-on instructions of each component to the working device 10 according to a preset priority order. When each component in the working device 10 receives the power-on instruction thereof, the component can be powered on according to the order of receiving the power-on instruction, and perform a self-checking operation after being powered on to obtain a self-checking result and related parameters such as voltage and current of each component during the power-on and self-checking process. Then, the control module or the control center in the working device 10 analyzes the self-checking result and the related parameters after reading the self-checking result and the related parameters of each component, determines an initial state of each component, and transmits the initial state of each component to the control module 13. The control module 13 displays the initial state of each component on the display screen 110 to inform an operator of the initial state of the working device during the power-on process. If each component is normal or healthy, the working device can continue to normally operate to perform a corresponding operation. If each component is abnormal or unhealthy, the working device can be instructed to stop working or the operator can be informed to perform maintenance. Optionally, when the control module or the control center transmits the initial state of each component to the control module 13, if an abnormal component exists, the control module or the control center can also transmit a corresponding maintenance strategy to the control module 13, such as turning off the power supply of the abnormal component, prompting to perform maintenance on the component, and the like. Then, the control module 13 displays the indication information on the display screen 110 according to the indication of the maintenance strategy to remind the operator to perform maintenance on the corresponding component according to the indication. The above embodiment realizes the power-on of each component according to the optimal order during the power-on process of the working device, implements the power consumption management of the working device, and optimizes the energy of the working device.

[0056] Optionally, the control module 13 in the human-computer interaction assembly 11 is also used to calculate a metering period of each component, display an expired component on the display screen 110, and cut off the power supply of the expired component. In the embodiment, the human-computer interaction assembly 11 can automatically calculate the metering period of each component in the working device 10, and perform an expired metering prompt on the component to be metered. If the metering operation is not performed, the device is prohibited to be used (for example, the power supply of the component is turned off).

[0057] Optionally, during normal operation of the working device 10, specifically, the man-machine interaction component 11 is further configured to calculate a power-off sequence of each component of the working device 10 by the control module 13 using the preset priority power-off strategy when the working device 10 abnormally operates or stops operating, and send power-off instructions of each component to the working device 10 in the power-off sequence to instruct each component to perform power-off operation after receiving the power-off instructions.

[0058] In this embodiment, during normal operation of the working device 10, the components in the working device 10 can abnormally operate or stop operating due to faults. At this time, the central control center or the control module in the working device 10 can transmit the detected results to the control module 13 in the man-machine interaction component 11 when detecting that a component abnormally operates or stops operating. The control module 13 can calculate a power-off sequence of each component using the preset priority power-off strategy when determining that a component in the working device abnormally operates or stops operating, or first calculate a safety factor of each component using the preset priority power-off strategy, then determine a power-off sequence of each component according to the safety factor of each component, and send the power-off sequence of each component to the working device 10. The working device 10 can send power-off instructions to each component in the power-off sequence. Each component performs power-off operation in the power-off sequence after receiving the power-off instructions. The above embodiment realizes that when the working device abnormally operates or stops operating during operation and needs to be urgently powered off, the above system powers off each component in the optimal sequence, i.e., gradually powers off the power supply of each component using the dynamic priority power-off strategy. Compared with the simple one-time simultaneous power-off method, the above system avoids damaging the equipment due to current impact caused by one-time instantaneous power-off, maximally reduces the damage of power-off to each component, and improves the use safety of each component.

[0059] It should be noted that the man-machine interaction system provided in the present application can automatically identify the operating state of the working device. When the working device normally operates, the control module in the man-machine interaction component can automatically become a slave system of the master control center or the central control module in the working device, provide auxiliary information display function or calculation function (for example, issuing an alarm or displaying abnormal information when the working device abnormally operates) for the master control center or the central control module, and feedback the operation state (correct or abnormal) information of the operator to the master control center or the central control module to assist the master control center or the central control module in fault diagnosis.

[0060] Optionally, during normal operation of the working device, the operator also needs to operate the working device. At this time, the central control center or the central control module of the working device can obtain the working condition of the working device, start the image acquisition device in the man-machine interaction component, acquire the operation condition of the operator, and then realize power consumption management of the working device in combination with the working condition of the working device and the operation condition of the operator.

[0061] Optionally, Figure 1 The human-computer interaction system further comprises at least one of a temperature sensor, an air path sensor, and a liquid path sensor, so as to monitor the temperature, air path, liquid path, and other components in the system.

[0062] Optionally, the display screen 110 in the human-computer interaction assembly 11 is further used to display the name, manufacturer, and related information of the working device 10, such as the calibration time and maintenance time of the working device. The human-computer interaction assembly can replace the original components such as the equipment label, equipment key, and sound-light alarm in the traditional cabinet, thereby saving the equipment control and simplifying the use and maintenance work of the operator.

[0063] In an embodiment, the human-computer interaction assembly 11 can display all important information, including the operation information before the working device is powered on, the initial state during the power-on process of the working device, and the working condition during the running process of the working device. Based on this, the operator can also query any of the above information by interacting with the human-computer interaction assembly 11. Therefore, the human-computer interaction assembly 11 can further comprise a touch key (which can be the same key as the touch key in the foregoing embodiments or a different key, which is not limited here). The touch key is used to indicate the display screen 110 to display an information interaction page when triggered by the operator. Specifically, when the operator wants to query related information, the operator can click the touch key, and the display screen 110 can display the information interaction page. Then, the operator can input the information to be queried on the information interaction page, and the display screen can display the related information. For example, before the working device is started, the operator needs to query the operation information of the working device, and can input the operation manual on the information interaction page. The control module can read the operation information from the storage module and display it on the display screen.

[0064] Optionally, the human-computer interaction assembly 11 in any of the foregoing embodiments further comprises a communication interface (such as a network port, RS232 / 422, USB, etc.), which is used to communicate with the host computer in the main control center of the working device 10. The control module 113 in the human-computer interaction assembly 11 can send and receive data and control instructions through the communication interface, and perform data interaction with the host computer in the main control center of the working device.

[0065] Optionally, the human-computer interaction component 11 in the above embodiments further comprises a remote communication module for communicating with a server or other terminal, wherein the server or other terminal can be arranged in any area outside the area where the cabinet is located, such as a control center hall. In actual application, the server or other terminal can interact information with the human-computer interaction components 11 of multiple cabinets through wireless or wired network. For example, when the human-computer interaction component 11 of each cabinet obtains the operation process information (operation picture or operation video) of the operating personnel connecting or detecting the operating process of the working equipment before the working equipment is powered on, the human-computer interaction component 11 can upload the operation process information to the server or other terminal; when the human-computer interaction component 11 of each cabinet obtains the initial state of each component of the working equipment in the process of powering on the working equipment, the human-computer interaction component 11 can upload the initial state of each component to the server or other terminal; when the human-computer interaction component 11 of each cabinet obtains the working condition of the working equipment in the process of normal operation of the working equipment, the human-computer interaction component 11 can upload the working condition of the working equipment to the server or other terminal. When the human-computer interaction component 11 uploads the related information of each cabinet to the server or other terminal, the server or other terminal can display the received related information on the display screen for non-site users to view, and can further analyze the related information to determine whether the working equipment in each cabinet is abnormal. Correspondingly, the server or other terminal can also send a control command to the human-computer interaction component 11 through wired or wireless network according to the analysis result, and the human-computer interaction component 11 can perform corresponding operation on the working equipment in the cabinet according to the indication of the control command after receiving the control command, so as to realize remote management and control of the working equipment in the cabinet.

[0066] Optionally, the human-computer interaction component 11 in any of the above embodiments further comprises a battery module, which provides power for each component contained in the human-computer interaction component 11, and is different from the power supply component in the working equipment, and separately provides power for the human-computer interaction component 11.

[0067] According to the human-computer interaction system described in any of the above embodiments, the application also provides a corresponding human-computer interaction method, as shown in the following Figure 3 The method comprises:

[0068] S101, the human-computer interaction component displays the operation information of the working equipment on the display screen in the human-computer interaction component before the working equipment is powered on.

[0069] S102, the human-computer interaction component obtains the initial state of each component in the working equipment in the process of powering on the working equipment, and displays the initial state of each component on the display screen in the human-computer interaction component.

[0070] S103, the man-machine interaction component acquires the working condition of the working equipment during normal operation of the working equipment, and displays the working condition on the display screen in the man-machine interaction component.

[0071] Specifically,

[0072] Firstly, when each working equipment in the cabinet is on standby, the display screen in the man-machine interaction component can display the name and state information of the working equipment, such as the calibration time, maintenance condition, health condition, etc.

[0073] Secondly, before the working equipment is powered on, the display screen in the man-machine interaction component displays operation information and interacts with the device operator (such as gestures or keys) to guide the device operator to complete the work before the working equipment is powered on, such as connecting cables, instrument equipment connection, switch configuration, recording information, etc.

[0074] Thirdly, during the operation of the working equipment by the device operator, the image acquisition device acquires the operation image or video of the device operator in real time, and the image recognition algorithm identifies whether the operation action of the device operator is correct. If it is incorrect, the display screen displays error information or starts the sound and light alarm device to alarm to alert the device operator of the incorrect operation; if it is correct, the display screen displays the operation information required for the next step to guide the operator to perform the next operation action, and guides the device operator to complete the connection or detection work before the device is powered on.

[0075] Fourthly, after the working equipment is powered on, the control module (such as an embedded computer) in the man-machine interaction component interacts with the main control computer (PC or industrial computer) in the working equipment, which can be a slave system of the main control computer, receives the control of the main control computer, and displays information, sounds, etc. For example, the display screen in the man-machine interaction component can be an auxiliary display screen of the main control computer, and can also be a sound and light alarm device of the working equipment when the working equipment is abnormal. At the same time, the image acquisition device in the man-machine interaction component can also monitor whether the operation of the operator operating the working equipment is qualified in real time. The control module in the man-machine interaction component can also acquire the working condition or working state of the working equipment from the main control computer to realize the health management or state monitoring of the working equipment. The storage module in the man-machine interaction component can also store the information of the working equipment, and display it to the operator for viewing through the display screen when the operator queries, and correspondingly, the information of the working equipment can also be sent to a remote terminal through the remote communication module to enable a remote operator to view the working condition or state of the working equipment.

[0076] The above steps are described in the foregoing system description, and the details are described in the foregoing description, which will not be repeated here.

[0077] In summary, the human-computer interaction method provided by the present application has the following advantages: ① The cabinet with a single function in the prior art becomes intelligent. ② The operator's work in the whole working process of the working device (preparation work before power-on, use process after power-on, etc.) becomes guided and monitorable, and the safety of the device and the personnel is ensured. ③ Important state information (such as maintenance information, device metering state, device initial state, etc.) can be displayed in any case of the working device (including when the power is not turned on). ④ The cabinet adopts a mounting mode of a standard panel / baffle, and the human-computer interaction component is mounted on the panel / baffle, so that the upgrading and maintenance of the human-computer interaction component become very convenient. ⑤ The human-computer interaction component can replace the original components such as the audible and visual alarm, the device label and the device key, thereby saving the device space and simplifying the use and maintenance work.

[0078] It should be understood that, although each step in the flowchart involved in each embodiment as described above is shown in sequence according to the arrow, these steps are not necessarily executed in sequence according to the arrow. Unless explicitly stated herein, the execution of these steps is not strictly limited in sequence, and these steps can be executed in other sequences. Moreover, at least part of the steps in the flowchart involved in each embodiment as described above can include multiple steps or multiple stages, which are not necessarily executed at the same time, but can be executed at different times, and the execution sequence of these steps or stages is not necessarily sequential, but can be executed in rotation or alternation with at least part of other steps or steps or stages in other steps.

[0079] In one embodiment, a computer device, which can be a terminal, has an internal structure diagram as shown in Figure 4 The computer device includes a processor, a memory, a communication interface, a display screen and an input device connected through a system bus. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operating system and the computer program in the non-volatile storage medium to run. The communication interface of the computer device is used to communicate with external terminals in a wired or wireless manner. The wireless manner can be achieved through WIFI, mobile cellular network, NFC (near field communication) or other technologies. The computer program is executed by the processor to implement a human-computer interaction method. The display screen of the computer device can be a liquid crystal display screen or an electronic ink display screen. The input device of the computer device can be a touch layer overlaid on the display screen, or a key, trackball or touchpad arranged on the shell of the computer device, or an external keyboard, touchpad or mouse, etc.

[0080] Those skilled in the art can understand that,Figure 4 The structure shown in the figure is only a block diagram of part of the structure related to the scheme of the present application, and does not constitute a limitation on the computer device to which the scheme of the present application is applied. The specific computer device can include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0081] In one embodiment, a computer device is provided, comprising a memory and a processor, the memory storing a computer program, and the processor implementing the following steps when executing the computer program:

[0082] Before the working device is powered on, operation information of the working device is displayed on the display screen;

[0083] During the process of powering on the working device, initial states of each component in the working device are acquired, and the initial states of the each component are displayed on the display screen;

[0084] During the process of normal operation of the working device, working conditions of the working device are acquired, and the working conditions are displayed on the display screen.

[0085] In one embodiment, a computer readable storage medium is provided, storing a computer program, and the computer program is executed by a processor to implement the following steps:

[0086] Before the working device is powered on, operation information of the working device is displayed on the display screen;

[0087] During the process of powering on the working device, initial states of each component in the working device are acquired, and the initial states of the each component are displayed on the display screen;

[0088] During the process of normal operation of the working device, working conditions of the working device are acquired, and the working conditions are displayed on the display screen.

[0089] In one embodiment, a computer program product is provided, comprising a computer program, and the computer program is executed by a processor to implement the following steps:

[0090] Before the working device is powered on, operation information of the working device is displayed on the display screen;

[0091] During the process of powering on the working device, initial states of each component in the working device are acquired, and the initial states of the each component are displayed on the display screen;

[0092] During the process of normal operation of the working device, working conditions of the working device are acquired, and the working conditions are displayed on the display screen.

[0093] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a non-volatile computer readable storage medium, and when executed, can include the processes of the above-mentioned embodiment methods. Any reference to memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical storage, high-density embedded non-volatile memory, resistive memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration but not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc. The database involved in the embodiments provided in the present application can include at least one of a relational database and a non-relational database. The non-relational database can include a distributed database based on a block chain, etc., without being limited thereto. The processor involved in the embodiments provided in the present application can be a general-purpose processor, a central processing unit, a graphics processing unit, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., without being limited thereto.

[0094] Any combination of the technical features of the above embodiments can be made. In order to make the description simple, all possible combinations of the technical features in the above embodiments are not described, however, as long as the combination of the technical features does not exist, it should be considered as the scope of the present application.

[0095] The above embodiments only express several implementation manners of the present application, and the description is more specific and detailed, but it should not be understood as a limitation on the scope of the patent of the present application. It should be pointed out that for ordinary skilled in the art, without departing from the concept of the present application, a number of modifications and improvements can be made, which are within the scope of protection of the present application. Therefore, the protection scope of the present application should be subject to the appended claims.

Claims

1. A human-computer interaction system, characterized in that, The system includes: a working device and a human-machine interface component. The working device is connected to the human-machine interface component and is housed inside a cabinet. The human-machine interface component is mounted on a panel of the cabinet facing the operator. The human-machine interface component includes: an image acquisition device, an output module, a control module, and a display screen. The control module is connected to the image acquisition device, the output module, and the display screen. The image acquisition device includes a camera or a webcam. The human-machine interaction component is used to move the image acquisition device to the field of view area of ​​the operator operating the work equipment before the work equipment is powered on and / or during normal operation after power-on, so as to instruct the image acquisition device to acquire image or video data when the operator operates according to the operation information displayed on the screen, and to identify the acquired image or video data through the control module to determine whether the operator is operating normally. If the operator is not operating normally, the output module outputs alarm information. When the operator is operating normally, the next step operation information is displayed on the screen or the next step voice operation information is output through the output module. The operation information of the work equipment is displayed on the screen of the human-machine interaction component to instruct the operator to perform relevant operations to connect to or detect the work equipment according to the operation information. The human-computer interaction component is used to acquire the initial state of each component in the working device during the power-on process, and to display the initial state of each component on the display screen of the human-computer interaction component. The human-computer interaction component is used to acquire the working status of the working equipment during normal operation and display the working status on the display screen in the human-computer interaction component.

2. The system according to claim 1, characterized in that, The human-computer interaction component is used to acquire the initial state of each component in the working device during the power-on process, including: During the power-on process of the working device, the control module sends power-on commands to each component of the working device in a preset priority order, instructing each component to be powered on in the order of priority, and reads the self-test results and related parameters of each component after self-test, and determines the initial state of each component based on the self-test results and related parameters of each component; the related parameters include the voltage and / or current of each component.

3. The system according to claim 2, characterized in that, The control module is also used to calculate the metering cycle of each component, display the components that have reached their metering deadline on the display screen, and cut off the power supply to the components that have reached their metering deadline.

4. The system according to claim 1, characterized in that, The human-machine interaction component is also used to calculate the power cut-off sequence of each component through the control module using a preset priority power cut-off strategy when the working equipment malfunctions or stops working, and send power cut-off commands to each component to the working equipment in the order of the power cut-off sequence, so as to instruct each component to perform a power cut-off operation after receiving the power cut-off command.

5. The system according to claim 1, characterized in that, The human-computer interaction component further includes: a touch button; the touch button is used to instruct the display screen to display an information interaction page when triggered by the operator.

6. The system according to claim 1, characterized in that, The system also includes at least one of a temperature sensor, a gas path sensor, and a liquid path sensor.

7. The system according to claim 1, characterized in that, The display screen in the human-computer interaction component is also used to display the name, manufacturer, and related information of the working device.

8. A human-computer interaction method, characterized in that, The method is applied to the system as described in any one of claims 1-7, and the method includes: Before the working device is powered on, the human-machine interaction component displays the operation information of the working device on the display screen in the human-machine interaction component, so as to instruct the operator to perform relevant operations to connect to and start the working device according to the operation information; During the power-on process of the working device, the human-computer interaction component acquires the initial state of each component in the working device and displays the initial state of each component on the display screen of the human-computer interaction component. During the normal operation of the working equipment, the human-computer interaction component acquires the working status of the working equipment and displays the working status on the display screen of the human-computer interaction component.

Images