Instruction identification method and system of experimental instrument, electronic equipment and storage medium

Abstract

The invention provides an instruction identification method and system of an experimental instrument, electronic equipment and a storage medium. The instruction identification method comprises the steps of obtaining an input signal monitored by the experimental instrument within a preset duration; the input signal comprises at least one of an audio signal, an image signal and an external terminal signal; determining a target instruction according to the input signal in response to the fact that the number of the input signal is one; when the number of the input signals is more than two, determining a target instruction according to all the input signals; the target instruction is used for controlling the experimental instrument. According to the method and the device, an operator does not need to touch the experimental instrument in the whole instruction recognition process, the situation that the experimental instrument is contaminated by a biological experimental material or a chemical reagent due to contact operation of the experimental instrument can be effectively avoided, and cross contamination between operators is further avoided.

Description

Technical Field

[0001] The present disclosure relates to the field of experimental instrument control, and in particular to an instruction recognition method, system, electronic device and storage medium for an experimental instrument. Background Art

[0002] With the advancement of science and technology, the instruments used in laboratories have realized intelligent operation, especially electronic experimental instruments, whose operation methods are basically inseparable from the manual operation of the operator, for example, through the keyboard, mouse or control panel. However, for some biological or chemical laboratories, this contact operation will undoubtedly cause the biological experimental materials or chemical reagents to contaminate the experimental instruments, and further cause cross-contamination between experimental personnel. This will have an adverse impact on the quality of the experiment and the equipment / personnel. Summary of the invention

[0003] The problem to be solved by the present disclosure is to overcome the defect of cross contamination caused during the operation of experimental instruments in the prior art, and to provide a system, electronic equipment and storage medium.

[0004] The present invention solves the above technical problems through the following technical solutions:

[0005] The present disclosure provides a method for identifying an instruction of an experimental instrument, the method comprising:

[0006] Acquire an input signal detected by the experimental instrument within a preset time period; the input signal includes at least one of the following: an audio signal, an image signal, and an external terminal signal;

[0007] In response to the number of the input signal being one, determining a target instruction according to the input signal;

[0008] In response to the number of the input signals being more than two, determining a target instruction according to all the input signals;

[0009] The target instruction is used to control the experimental instrument.

[0010] Preferably, the step of obtaining the input signal monitored by the experimental instrument within a preset time period includes at least one of the following:

[0011] The experimental instrument comprises an image acquisition unit; acquiring the image signal in the image acquisition area corresponding to the image acquisition unit;

[0012] The experimental instrument comprises an audio acquisition unit; acquiring an audio signal collected by the audio acquisition unit;

[0013] The experimental instrument comprises an external terminal; and an external terminal signal acquired by the external terminal is acquired.

[0014] Preferably, in response to the number of the input signal being one, determining the target instruction according to the input signal comprises:

[0015] Determine a target operation object for the operation interface of the experimental instrument according to the input signal;

[0016] Determining a target execution action for the target operation object according to the input signal;

[0017] A target instruction for the operation interface of the experimental instrument is determined according to the target operation object and the target execution action.

[0018] Preferably, in response to the number of the input signals being more than two, determining the target instruction according to all the input signals comprises:

[0019] Determine all target operation objects of the operation interface of the experimental instrument one by one according to the input signal;

[0020] Determining all target execution actions for the target operation objects one by one according to the input signals;

[0021] In response to all the target operation objects being consistent and all the target execution actions being consistent, a target instruction for the operation interface of the experimental instrument is determined according to the target operation objects and the target execution actions.

[0022] Preferably, in response to the number of the input signals being more than two, determining the target instruction according to all the input signals comprises:

[0023] Determine all target operation objects of the operation interface of the experimental instrument one by one according to the input signal;

[0024] Determining all target execution actions for the target operation objects one by one according to the input signals;

[0025] In response to the fact that there are more than two target operation objects and / or more than two target execution actions, the target instruction cannot be recognized.

[0026] Preferably, in response to the number of the input signals being more than two, determining the target instruction according to all the input signals comprises:

[0027] Determine all target operation objects of the operation interface of the experimental instrument one by one according to the input signal;

[0028] Determining all target execution actions for the target operation objects one by one according to the input signals;

[0029] In response to the inconsistency of all the target operation objects and / or the inconsistency of all the target execution actions, the target operation objects whose number is greater than a first quantity threshold among the various target operation objects are taken as target target operation objects, and the target execution actions whose number is greater than a second quantity threshold among the various target execution actions are taken as target target execution actions, and the target instructions for the operating interface of the experimental instrument are determined based on the target target operation objects and the target target execution actions.

[0030] The present disclosure also provides an instruction recognition system for an experimental instrument, the instruction recognition system comprising:

[0031] An acquisition module, used to acquire an input signal detected by the experimental instrument within a preset time period; the input signal includes at least one of the following: an audio signal, an image signal, and an external terminal signal;

[0032] A response module, configured to determine a target instruction according to the input signal in response to the number of the input signal being one;

[0033] The response module is further configured to determine the target instruction according to all the input signals in response to the number of the input signals being more than two;

[0034] The target instruction is used to control the experimental instrument.

[0035] Preferably, the acquisition module is specifically configured to include at least one of the following:

[0036] The experimental instrument comprises an image acquisition unit; acquiring the image signal in the image acquisition area corresponding to the image acquisition unit;

[0037] The experimental instrument comprises an audio acquisition unit; acquiring an audio signal collected by the audio acquisition unit;

[0038] The experimental instrument comprises an external terminal; and an external terminal signal acquired by the external terminal is acquired.

[0039] Preferably, the response module is specifically configured to include:

[0040] Determine a target operation object for the operation interface of the experimental instrument according to the input signal;

[0041] Determining a target execution action for the target operation object according to the input signal;

[0042] A target instruction for the operation interface of the experimental instrument is determined according to the target operation object and the target execution action.

[0043] Preferably, the response module is specifically configured to include:

[0044] Determine all target operation objects of the operation interface of the experimental instrument one by one according to the input signal;

[0045] Determining all target execution actions for the target operation objects one by one according to the input signals;

[0046] In response to all the target operation objects being consistent and all the target execution actions being consistent, a target instruction for the operation interface of the experimental instrument is determined according to the target operation objects and the target execution actions.

[0047] Preferably, the response module is specifically configured to include:

[0048] Determine all target operation objects of the operation interface of the experimental instrument one by one according to the input signal;

[0049] Determining all target execution actions for the target operation objects one by one according to the input signals;

[0050] In response to the fact that there are more than two target operation objects and / or more than two target execution actions, the target instruction cannot be recognized.

[0051] Preferably, the response module is specifically configured to include:

[0052] Determine all target operation objects of the operation interface of the experimental instrument one by one according to the input signal;

[0053] Determining all target execution actions for the target operation objects one by one according to the input signals;

[0054] In response to the inconsistency of all the target operation objects and / or the inconsistency of all the target execution actions, the target operation objects whose number is greater than a first quantity threshold among the various target operation objects are taken as target target operation objects, and the target execution actions whose number is greater than a second quantity threshold among the various target execution actions are taken as target target execution actions, and the target instructions for the operating interface of the experimental instrument are determined based on the target target operation objects and the target target execution actions.

[0055] The present disclosure also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and used to run on the processor, and the processor implements the aforementioned instruction recognition method of the experimental instrument when executing the computer program.

[0056] The present disclosure also provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the instruction recognition method of the aforementioned experimental instrument is implemented.

[0057] On the basis of being in accordance with the common sense in the art, the above-mentioned preferred conditions can be arbitrarily combined to obtain the preferred embodiments of the present disclosure.

[0058] The positive and progressive effect of the present disclosure is that: by acquiring the input signal monitored by the experimental instrument within a preset time, the target instruction is determined based on the number of input signals and according to the input signal. The entire instruction recognition process does not require the operator to touch the experimental instrument, which can effectively avoid the contamination of the experimental instrument by biological experimental materials or chemical reagents caused by contact operation of the experimental instrument, and further avoid cross contamination between operators. BRIEF DESCRIPTION OF THE DRAWINGS

[0059] Figure 1 A schematic diagram of an integrated chemiluminescent imager provided as an exemplary embodiment of the present disclosure.

[0060] Figure 2 The present invention provides a flowchart of a method for identifying instructions of an experimental instrument according to an exemplary embodiment of the present invention.

[0061] Figure 3 A flowchart of step 102 is provided for an exemplary embodiment of the present disclosure.

[0062] Figure 4 An operating interface of an experimental instrument is provided as an exemplary embodiment of the present disclosure.

[0063] Figure 5 A schematic diagram of a module of a non-contact operating system of an experimental instrument provided by an exemplary embodiment of the present disclosure.

[0064] Figure 6 The present invention provides a schematic structural diagram of an electronic device according to an exemplary embodiment of the present invention. DETAILED DESCRIPTION

[0065] The present disclosure is further described below by way of examples, but the present disclosure is not limited to the scope of the examples.

[0066] The present disclosure is dedicated to providing a method, system, electronic device and storage medium for instruction recognition of a contactless experimental instrument. It should be understood that the contactless type involved in the present disclosure does not mean that the operator (the operator in the present disclosure is the user who operates the experimental instrument) absolutely does not touch the experimental instrument, but rather that the contactless type is achieved to the greatest extent possible. At least in actual application scenarios, the operator can achieve contactless operation in a certain stage of the process. For example, referring to Figure 1A schematic diagram of an integrated chemiluminescent imager is provided as an exemplary embodiment, and the integrated chemiluminescent imager includes: a sample tray 11, a display screen 12, a signal acquisition module 13 and a compartment door 14. During use, the operator can use the scheme of the present disclosure to open the compartment door 14 of the instrument and extend the sample tray 11 through a non-contact operation mode, and then put the sample into the sample tray 11, and then close the compartment door 14 of the instrument and retract the sample tray 11 through a non-contact operation mode. During the test, the non-contact operation presented by the scheme of the present disclosure is used to operate the operation interface displayed on the display screen 12 of the instrument. It should be understood that the non-contact operation has the same effect as the touch operation, and is an alternative to the touch operation. Some embodiments are provided below.

[0067] Example 1

[0068] Figure 2 A flowchart of a method for identifying an instruction of an experimental instrument provided by an exemplary embodiment of the present disclosure, the method for identifying an instruction of an experimental instrument comprising the following steps:

[0069] Step 101: Acquire an input signal detected by an experimental instrument within a preset time period; the input signal includes at least one of the following: an audio signal, an image signal, and an external terminal signal.

[0070] In this step, the experimental instrument can optionally obtain an input signal through a signal acquisition module. In order to make the acquisition of the input signal more standardized and accurate, the input signal is limited to a preset time. The preset time can be set according to actual needs. Generally, the preset time is the standard time for the operator to issue a complete instruction, which can ensure that the operator issues a complete instruction.

[0071] In a specific embodiment, the signal acquisition module will switch to standby mode when it is idle. If the signal acquisition module is in standby mode, the operator issues a command, which triggers the signal acquisition module to collect an input signal. The signal acquisition module starts timing from the receipt of the input signal until the timing reaches a preset time, and the input signal received during the preset time is used as the object of subsequent analysis for the target instruction. For example, the preset time is 15 seconds, and the timing starts when the signal acquisition module collects the first input signal. The input signal collected within 15 seconds will be used as the final input signal obtained as the basis for judging the final target instruction.

[0072] It should be understood that the input signal is not limited to audio signals, image signals, and external terminal signals. Any input signal that can be implemented in a non-contact manner can be used in the technical solution of the present disclosure.

[0073] Optionally, step 101 includes at least one of the following:

[0074] First, when the experimental instrument includes an image acquisition unit, an image signal in an image acquisition area corresponding to the image acquisition unit is acquired. The image acquisition unit is a part of the signal acquisition module.

[0075] The image acquisition unit is a device with an image acquisition function, including but not limited to a camera. As a physical hardware, the image acquisition unit corresponds to different image acquisition areas according to different image acquisition units. Moreover, only the images acquired in the appropriate image acquisition area are valid. It should be understood that the image acquisition unit is generally arranged in front of the experimental instrument, and the position and angle of the image acquisition unit can be set according to actual needs to facilitate the acquisition of image signals in the image acquisition area. Optionally, the number of image acquisition units is at least one. In order to capture images more comprehensively and accurately, image acquisition units can be set in different directions according to actual needs. Optionally, the image acquisition unit may have a tracking function, and the position and angle of the image acquisition unit itself can be changed according to the operator's dynamics to capture image signals more accurately. In addition, the correspondence between the image signal and the target instruction can be set in advance or customized edited / added according to actual needs.

[0076] Second, when the experimental instrument includes an audio acquisition unit, the audio signal collected by the audio acquisition unit is obtained. The audio acquisition unit is a part of the signal acquisition module.

[0077] The audio acquisition unit is a device with an audio acquisition function, including but not limited to a microphone. As a physical hardware, the audio acquisition unit corresponds to different audio acquisition areas according to different audio acquisition units. The audio collected in a suitable audio acquisition area is effective. It should be understood that the audio acquisition unit is generally arranged in front of the experimental instrument, and the position and angle of the audio acquisition unit can be set according to actual needs to facilitate the collection of audio signals in the audio acquisition area. Optionally, the number of audio acquisition units is at least one. In order to collect audio more comprehensively and accurately, audio acquisition units can be set in different directions according to actual needs. Optionally, the audio acquisition unit can have a directional tracking function, and the position and angle of the audio acquisition unit itself can be changed according to the operator's dynamics to capture audio signals more accurately.

[0078] Optionally, the audio signal is a voice command issued by the operator, such as "open warehouse", "enter warehouse", "shoot", and "zoom in / out", etc. Optionally, the audio signal can also be a sound issued by the operator, such as clapping once, clapping twice, or the sound of fingers tapping an object, etc. The corresponding relationship between the audio signal and the target command can be pre-set or customized edited / added according to actual needs.

[0079] Optionally, the audio acquisition unit can be configured as wireless hardware, such as a wireless microphone, which is mounted on the operator (such as the operator's collar), and can also receive audio signals from the operator.

[0080] Third, when the experimental instrument includes an external terminal, an external terminal signal acquired by the external terminal is acquired. The external terminal is a part of the signal acquisition module.

[0081] The correspondence between the external terminal signal and the target instruction can be set in advance or customized according to actual needs. It should be understood that the external signal can be a preset external physical button or physical control. For example: a number of physical buttons are set on the ground, and the physical buttons are connected to the main body of the experimental instrument (wirelessly and / or wired), and the operator can send the corresponding external terminal signal by stepping on the physical buttons with his feet. For example, in the case of only two physical buttons A and B, optionally, if the control method for the direction can be: stepping on button A once is to move to the left by a preset amplitude, stepping on button B once is to move to the right by a preset amplitude, stepping on button A twice in a row is to move up by a preset amplitude, and stepping on button B twice in a row is to move down by a preset amplitude. It should be understood that the number, arrangement and combination of physical buttons or physical controls can be adjusted according to actual needs.

[0082] Step 102: In response to the number of input signals being one, determine a target instruction according to the input signal.

[0083] In this step, if the number of input signals obtained in step 101 is one, the target instruction is determined according to the input signal. It should be understood that the one described in this step can be understood as the signal acquisition module only receiving one input signal. In addition, the target instruction in this step is used to control the experimental instrument.

[0084] Alternatively, see Figure 3 It can be seen that step 102 includes:

[0085] Step 1021: Determine a target operation object of an operation interface of the experimental instrument according to an input signal.

[0086] Step 1022: Determine a target execution action for the target operation object according to the input signal.

[0087] Step 1023: Determine a target instruction for the operation interface of the experimental instrument according to the target operation object and the target execution action.

[0088] It should be understood that the above-mentioned target operation object includes the display area of ​​the operation interface and the controls contained in the display area.

[0089] Step 103: In response to the number of input signals being more than two, determine a target instruction according to all input signals.

[0090] In this step, if the number of input signals obtained in step 101 is more than two, the target instruction is determined based on all the input signals. It should be understood that the number of input signals expressed in this step is more than two, which can be understood as the signal acquisition module receiving more than two input signals, and the types of all input signals are the same, for example, they all belong to audio signals, image signals or external terminal signals. The number of input signals expressed in this step is more than two, which can also be understood as the signal acquisition module receiving more than two input signals, and the types of all input signals are not exactly the same, for example, the signal acquisition module receives 3 input signals, one of which belongs to an audio signal and the other two belong to image signals. In addition, the target instruction in this step is used to control the experimental instrument.

[0091] In one embodiment, optionally, step 103 includes the following steps: determining all target operation objects of the operating interface for the experimental instrument one by one according to the input signal; determining all target execution actions for the target operation objects one by one according to the input signal; in response to all target operation objects being consistent and all target execution actions being consistent, determining the target instructions for the operating interface for the experimental instrument according to the target operation objects and the target execution actions.

[0092] In one embodiment, optionally, step 103 includes the following steps: determining all target operation objects of the operation interface for the experimental instrument one by one according to the input signal; determining all target execution actions for the target operation objects one by one according to the input signal; in response to all target operation objects being more than two, and / or all target execution actions being more than two, the target instruction cannot be recognized.

[0093] In one embodiment, optionally, step 103 includes the following steps: determining all target operation objects of the operating interface for the experimental instrument one by one according to the input signal; determining all target execution actions for the target operation objects one by one according to the input signal; in response to inconsistency among all target operation objects, and / or inconsistency among all target execution actions, taking target operation objects whose number among various target operation objects is greater than a first quantity threshold as target target operation objects, taking target execution actions whose number among various target execution actions is greater than a second quantity threshold as target target execution actions, and determining the target instructions for the operating interface for the experimental instrument according to the target target operation objects and the target target execution actions.

[0094] In addition, for more information about the operation interface, see Figure 4 An operating interface of an experimental instrument is provided for an exemplary embodiment of the present disclosure. The operating interface divides the entire display area into two main areas, the left area is the display area, and the right area is the control area, wherein the display area is used to display the imaging results of the experimental instrument, and is also used to display the real-time reflection of the input process of the input signal. For example, when the operator uses gestures to issue instructions to the experimental instrument, the display area will display the gesture video image collected by the image acquisition unit in real time. Optionally, the display area will display the recognition results to prompt the user of the currently recognized instruction content. In the control area, controls for controlling the experimental instrument are displayed. When the instruction is successfully recognized, the corresponding controls will perform the corresponding execution actions, which is equivalent to directly manipulating the corresponding controls by hand.

[0095] To further understand the above steps, an integrated chemiluminescence imager is taken as an example. Optionally, the model of the integrated chemiluminescence imager is ChemiScope S6. Several specific examples are given using this model of experimental instrument:

[0096] Example 1: The operator taps twice in succession at the center of the display area of ​​the operation interface, and at the same time issues a voice command of "exit". The experimental instrument executes the automatic exit command, which is specifically manifested in the rotation of the motor gear of the experimental instrument and rolling on the rack, driving the sample tray fixed on the guide rail slider to move outward along the linear guide rail and push open the door. The magnetic induction switch detects that the door is open and feeds back to the system software. The operation interface displays the exit accordingly.

[0097] The tapping action is merely an air-tapping action, and is not a tapping action on the operation interface. The operator does not touch the operation interface while performing the action.

[0098] Example 2: The center of the display area of ​​the operation interface is tapped twice in succession, and at the same time the operator issues a voice command of "enter the chamber and take pictures"; the experimental instrument executes the automatic enter the chamber and take pictures command, which is specifically manifested in the rotation of the motor gear of the experimental instrument, driving the sample tray to move inward into the darkroom, and the chamber door gradually flips back with the sample tray under the action of the spring tension, closing the darkroom, and the magnetic induction switch simultaneously detects that the chamber door is closed; the operation interface makes corresponding displays of entering the chamber and extracting and analyzing biochemical samples.

[0099] Example 3: The right side of the display area of ​​the operation interface slides downward, and the operator issues a voice command of "swipe right"; the operation interface performs an operation of reducing the HIGH value of the biochemical sample image.

[0100] Example 4: The right side of the display area of ​​the operation interface slides upward, and the operator issues a voice command of "swipe up on the right side"; the operation interface performs an operation of increasing the HIGH value of the execution image.

[0101] Example 5: The left side of the display area of ​​the operation interface slides upward, and the operator issues a voice command of "swipe up on the left side"; the operation interface performs an operation to increase the LOW value of the execution image.

[0102] Example 6: The left side of the display area of ​​the operation interface slides downward, and the operator issues a voice command of "swipe left"; the operation interface performs an operation to reduce the LOW value of the execution image.

[0103] Example 7: The user moves two fingers outward in the display area of ​​the operation interface, and at the same time the operator issues a voice command of "enlarge the image"; the operation interface performs the operation of enlarging the image.

[0104] Example 8: The operator moves two fingers inward in the display area of ​​the operation interface, and at the same time, the operator issues a voice command of "zoom out the picture"; the operation interface performs the operation of zooming out the picture.

[0105] In addition, in the process of identifying the input signal as the corresponding instruction action in all the instruction recognition methods involved in this embodiment, the image recognition algorithm and speech recognition algorithm of the artificial intelligence technology in the prior art can be used to implement the corresponding recognition process.

[0106] The above instruction recognition method does not require the operator to touch the experimental instrument during the entire instruction recognition process, which can effectively avoid the contamination of the experimental instrument by biological experimental materials or chemical reagents caused by contact operation of the experimental instrument, and further avoid cross contamination between operators.

[0107] Example 2

[0108] Reference Figure 5, is a module diagram of a non-contact operating system of an experimental instrument provided by an exemplary embodiment of the present disclosure, and the non-contact operating system of the experimental instrument corresponds to the instruction recognition method of the experimental instrument. The instruction recognition system includes:

[0109] The acquisition module 21 is used to acquire the input signal detected by the experimental instrument within a preset time period; the input signal includes at least one of the following: an audio signal, an image signal, and an external terminal signal;

[0110] A response module 22, configured to determine a target instruction according to the input signal in response to the number of the input signal being one;

[0111] The response module 22 is further configured to determine the target instruction according to all the input signals in response to the number of the input signals being more than two;

[0112] Target instructions are used to control experimental instruments.

[0113] Optionally, the acquisition module 21 is specifically configured to include at least one of the following:

[0114] The experimental instrument includes an image acquisition unit; acquiring an image signal in an image acquisition area corresponding to the image acquisition unit;

[0115] The experimental instrument includes an audio acquisition unit; obtaining the audio signal collected by the audio acquisition unit;

[0116] The experimental instrument includes an external terminal; and an external terminal signal obtained by the external terminal.

[0117] Optionally, the response module 22 is specifically configured to include:

[0118] Determine a target operation object for the operation interface of the experimental instrument according to the input signal;

[0119] Determine a target execution action for a target operation object according to an input signal;

[0120] The target instructions for the operation interface of the experimental instrument are determined according to the target operation object and the target execution action.

[0121] Optionally, the response module 22 is specifically configured to include:

[0122] Determine the target operation objects of all operation interfaces for the experimental instruments one by one according to the input signals;

[0123] Determine all target execution actions for the target operation objects one by one according to the input signals;

[0124] In response to all target operation objects being consistent and all target execution actions being consistent, a target instruction for the operation interface of the experimental instrument is determined according to the target operation objects and the target execution actions.

[0125] Optionally, the response module 22 is specifically configured to include:

[0126] Determine the target operation objects of all operation interfaces for the experimental instruments one by one according to the input signals;

[0127] Determine all target execution actions for the target operation objects one by one according to the input signals;

[0128] In response to the fact that there are more than two target operation objects and / or more than two target execution actions, the target instruction cannot be recognized.

[0129] Optionally, the response module 22 is specifically configured to include:

[0130] Determine the target operation objects of all operation interfaces for the experimental instruments one by one according to the input signals;

[0131] Determine all target execution actions for the target operation objects one by one according to the input signals;

[0132] In response to the inconsistency of all target operation objects and / or the inconsistency of all target execution actions, the target operation objects among various target operation objects whose number is greater than a first quantity threshold are taken as target target operation objects, and the target execution actions among various target execution actions whose number is greater than a second quantity threshold are taken as target target execution actions, and the target instructions for the operating interface of the experimental instrument are determined based on the target target operation objects and the target target execution actions.

[0133] The command recognition system does not require the operator to touch the experimental instrument during the entire command recognition process, which can effectively avoid the contamination of the experimental instrument by biological experimental materials or chemical reagents caused by contact operation of the experimental instrument, and further avoid cross contamination between operators.

[0134] Example 3

[0135] Figure 6 The schematic diagram of the structure of an electronic device provided in this embodiment includes a memory, a processor, and a computer program stored in the memory and used to run on the processor, and the processor implements the instruction recognition method of the experimental instrument provided in any of the above embodiments when executing the program. Figure 6 The electronic device 300 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0136] Reference Figure 6The electronic device 300 may be in the form of a general-purpose computing device, for example, it may be a server device. The components of the electronic device 300 may include, but are not limited to: at least one processor 301, at least one memory 302, and a bus 303 connecting different system components (including the memory 302 and the processor 301).

[0137] The bus 303 includes a data bus, an address bus, and a control bus.

[0138] The memory 302 may include a volatile memory, such as a random access memory (RAM) 321 and / or a cache memory 322 , and may further include a read-only memory (ROM) 323 .

[0139] Memory 302 may also include a program / utility 325 having a set (at least one) of program modules 324, such program modules 324 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment.

[0140] The processor 301 executes various functional applications and data processing by running the computer program stored in the memory 302, such as the instruction recognition method of the experimental instrument of the embodiment of the present disclosure.

[0141] The electronic device 300 may also communicate with one or more external devices 304 (e.g., keyboards, pointing devices, etc.). Such communication may be performed via an input / output (I / O) interface 305. Furthermore, the model-generated device 300 may also communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) via a network adapter 306. As shown, the network adapter 306 communicates with other modules of the model-generated device 300 via a bus 303. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with the model-generated device 300, including but not limited to: microcode, device drivers, redundant processors, external disk drive arrays, RAID (RAID) systems, tape drives, and data backup storage systems, etc.

[0142] It should be noted that although several units / modules or sub-units / modules of the electronic device are mentioned in the above detailed description, this division is merely exemplary and not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of two or more units / modules described above can be embodied in one unit / module. Conversely, the features and functions of one unit / module described above can be further divided into multiple units / modules to be embodied.

[0143] Example 4

[0144] This embodiment further provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the instruction recognition method of the experimental instrument provided in any of the above embodiments is implemented.

[0145] The readable storage medium may include but is not limited to: a portable disk, a hard disk, a random access memory, a read-only memory, an erasable programmable read-only memory, an optical storage device, a magnetic storage device or any suitable combination of the above.

[0146] In a possible implementation, the present disclosure may also be implemented in the form of a program product, which includes a program code. When the program product is run on a terminal device, the program code is used to enable the terminal device to execute the instruction recognition method of the experimental instrument provided in any of the above embodiments.

[0147] Among them, the program code for executing the present disclosure can be written in any combination of one or more programming languages, and the program code can be executed completely on the user device, partially on the user device, as an independent software package, partially on the user device and partially on a remote device, or completely on the remote device.

[0148] Although the specific embodiments of the present disclosure are described above, those skilled in the art should understand that this is only an example, and the protection scope of the present disclosure is defined by the appended claims. Those skilled in the art may make various changes or modifications to these embodiments without departing from the principles and essence of the present disclosure, but these changes and modifications all fall within the protection scope of the present disclosure.

Claims

1. A method for identifying instructions of an experimental instrument, characterized in that: The instruction recognition method comprises: Acquire an input signal detected by the experimental instrument within a preset time period; the input signal includes at least one of the following: an audio signal, an image signal, and an external terminal signal; In response to the number of the input signal being one, determining a target instruction according to the input signal; In response to the number of the input signals being more than two, determining a target instruction according to all the input signals; The target instruction is used to control the experimental instrument.

2. The instruction recognition method of the experimental instrument according to claim 1, characterized in that: The step of obtaining the input signal monitored by the experimental instrument within a preset time period includes at least one of the following: The experimental instrument comprises an image acquisition unit; acquiring the image signal in the image acquisition area corresponding to the image acquisition unit; The experimental instrument comprises an audio acquisition unit; acquiring an audio signal collected by the audio acquisition unit; The experimental instrument comprises an external terminal; and an external terminal signal acquired by the external terminal is acquired.

3. The instruction recognition method of the experimental instrument according to claim 2, characterized in that: In response to the number of the input signal being one, determining the target instruction according to the input signal includes: Determine a target operation object for the operation interface of the experimental instrument according to the input signal; Determining a target execution action for the target operation object according to the input signal; A target instruction for the operation interface of the experimental instrument is determined according to the target operation object and the target execution action.

4. The instruction recognition method of the experimental instrument according to claim 2, characterized in that: In response to the number of the input signals being more than two, determining the target instruction according to all the input signals includes: Determine all target operation objects of the operation interface of the experimental instrument one by one according to the input signal; Determining all target execution actions for the target operation objects one by one according to the input signals; In response to all the target operation objects being consistent and all the target execution actions being consistent, a target instruction for the operation interface of the experimental instrument is determined according to the target operation objects and the target execution actions.

5. The instruction recognition method of the experimental instrument according to claim 2, characterized in that: In response to the number of the input signals being more than two, determining the target instruction according to all the input signals includes: Determine all target operation objects of the operation interface of the experimental instrument one by one according to the input signal; Determining all target execution actions for the target operation objects one by one according to the input signals; In response to the fact that there are more than two target operation objects and / or more than two target execution actions, the target instruction cannot be recognized.

6. The instruction recognition method of the experimental instrument according to claim 2, characterized in that: In response to the number of the input signals being more than two, determining the target instruction according to all the input signals includes: Determine all target operation objects of the operation interface of the experimental instrument one by one according to the input signal; Determining all target execution actions for the target operation objects one by one according to the input signals; In response to the inconsistency of all the target operation objects and / or the inconsistency of all the target execution actions, the target operation objects whose number is greater than a first quantity threshold among the various target operation objects are taken as target target operation objects, and the target execution actions whose number is greater than a second quantity threshold among the various target execution actions are taken as target target execution actions, and the target instructions for the operating interface of the experimental instrument are determined based on the target target operation objects and the target target execution actions.

7. An instruction recognition system for an experimental instrument, characterized in that: The instruction recognition system comprises: An acquisition module, used to acquire an input signal detected by the experimental instrument within a preset time period; the input signal includes at least one of the following: an audio signal, an image signal, and an external terminal signal; A response module, configured to determine a target instruction according to the input signal in response to the number of the input signal being one; The response module is further configured to determine the target instruction according to all the input signals in response to the number of the input signals being more than two; The target instruction is used to control the experimental instrument.

8. An electronic device comprising a memory, a processor, and a computer program stored in the memory and used to run on the processor, characterized in that: When the processor executes the computer program, the instruction recognition method of the experimental instrument according to any one of claims 1 to 6 is implemented.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the instruction recognition method of the experimental instrument according to any one of claims 1 to 6 is implemented.

Images