Control method, device, electronic device and storage medium

Abstract

The embodiment of the present invention discloses a control method, device, electronic device and storage medium. The method comprises: monitoring a trigger signal sent to an operating component on an operating device; wherein the trigger signal is generated when the operating component is operated, and includes a trigger type and a trigger parameter; generating a corresponding operation signal based on the trigger type and trigger parameter in the trigger signal, wherein the operation signal includes an operation object control signal and an object switching signal, the object switching signal is used to control the display device to switch the information display interface, and trigger the operation object corresponding to the information display interface, and the operation object control signal is used to control the state of the corresponding operation object; the operation signal is sent to the corresponding device so that the device executes the operation signal. Through the technical solution disclosed in the embodiment of the present invention, it is achieved to increase the operating convenience of the operating device and improve the efficiency of task operation.

Description

Technical Field

[0001] Embodiments of the present invention relate to the field of medical device control technology, and in particular, to a control method, device, electronic device, and storage medium. Background Art

[0002] The existing technical solution for surgical robots allows users to remotely control the robot to perform surgical operations through a doctor's operating system, where the doctor's operating system includes a 3D surgical interface, a 2D configuration interface, and multiple devices such as handles and foot pedals.

[0003] Under the current system settings, when the doctor needs to set relevant settings of the doctor operating system during the operation, he needs to leave the 3D field of view and the surgical operating system operating device, and use his fingers to make relevant settings on the 2D touch screen. After the settings are completed, he needs to re-enter the 3D field of view and put the glove into the operating handle to continue the operation.

[0004] Existing operating devices can only control the operation through handles and foot pedals. The control of the comparison configuration interface requires the configuration of a separate control device; therefore, the separate settings of the operation and configuration will increase the complexity and tediousness of the operation during the operation and affect the smoothness of the operation. Summary of the invention

[0005] The present invention provides a control method, an apparatus, an electronic device and a storage medium, so as to increase the operating convenience of an operating device and improve the efficiency of task operation.

[0006] In a first aspect, an embodiment of the present invention provides a control method, which is applied to an operating device, and the method includes:

[0007] Monitoring a trigger signal sent to an operating component on an operating device; wherein the trigger signal is generated when the operating component is operated, and includes a trigger type and a trigger parameter;

[0008] Generate a corresponding operation signal based on the trigger type and trigger parameters in the trigger signal, wherein the operation signal includes an operation object control signal and an object switching signal, the object switching signal is used to control the display device to switch the information display interface, and trigger the operation object corresponding to the information display interface, and the operation object control signal is used to control the state of the corresponding operation object;

[0009] The operation signal is sent to a corresponding device so that the device executes the operation signal, wherein the device includes a display device and a task execution device.

[0010] Optionally, the operating device includes two operating areas, each of which is provided with a plurality of operating components.

[0011] The generating a corresponding operation signal based on the trigger type and the trigger parameter in the trigger signal includes:

[0012] A corresponding operation signal is generated based on a first trigger signal sent by an operating component in the first operation area and / or a second trigger signal sent by an operating component in the second operation area.

[0013] Optionally, the generating a corresponding operation signal based on a first trigger signal sent by an operating component in the first operation area and / or a second trigger signal sent by an operating component in the second operation area includes:

[0014] If the second trigger signal is received within a preset time interval after the first trigger signal is received, or if the first trigger signal is received within a preset time interval after the second trigger signal is received, a corresponding operation signal is determined based on the first trigger signal, the second trigger signal and a preset operation signal library.

[0015] Optionally, the determining a corresponding operation signal based on the first trigger signal, the second trigger signal, and a preset operation signal library includes:

[0016] If a combined operation signal of the first trigger signal and the second trigger signal is matched in the preset operation signal library, the combined operation signal is determined as the corresponding operation signal;

[0017] If the combined operation signal of the first trigger signal and the second trigger signal is not matched in the preset operation signal library, the first trigger signal and the second trigger signal are respectively determined as the operation signals corresponding to the first operation area and the second operation area.

[0018] Optionally, the operating device includes at least two sub-devices, each of which is provided with a plurality of operating components, and the sub-device generates an operating signal based on a trigger signal sent by the operating component, and independently sends the operating signal to the corresponding device.

[0019] Optionally, the operating device includes a master device and at least one slave device, each of the master device and the slave device is respectively provided with multiple operating components, the slave device sends a trigger signal to the master device, and the master device is used to generate an operating signal based on the trigger signals sent by each slave device and the trigger signal sent by its own operating components.

[0020] Optionally, the information display interface includes a 2D display interface and a 3D display interface, wherein the operation object corresponding to the 2D display interface includes each content object in the display interface, and the operation object corresponding to the 3D display interface is a task execution device.

[0021] Optionally, the 2D display interface includes a configuration interface.

[0022] In a second aspect, an embodiment of the present invention further provides a control method, which is applied to a display device, and the method includes:

[0023] Receive operation signals sent by various operating devices;

[0024] Determine an operation signal sent by any operation device as a target operation signal, or determine the target operation signal based on operation signals sent by at least two operation devices;

[0025] Execute the target operation signal; wherein, the target operation signal includes an operation object control signal and an object switching signal, the object switching signal is used to control the switching of the information display interface, and trigger the operation object corresponding to the information display interface, and the operation object control signal is used to control the state of the operation object in the information display interface.

[0026] Optionally, there are at least two operating devices;

[0027] The step of determining a target operation signal based on operation signals sent by at least two operation devices comprises:

[0028] If a fourth operation signal sent by the second operation device is received within a preset time interval after the third operation signal sent by the first operation device is received, or if the third operation signal is received within a preset time interval after the fourth operation signal is received, the target operation signal is determined based on the third operation signal, the fourth operation signal and the preset operation signal library.

[0029] Optionally, determining the target operation signal based on the third operation signal, the fourth operation signal, and a preset operation signal library includes:

[0030] If a combined operation signal of the third operation signal and the fourth operation signal is matched in the preset operation signal library, the combined operation signal is determined as a target operation signal;

[0031] If the combined operation signal of the third operation signal and the fourth operation signal is not matched in the preset operation signal library, the third operation signal and the fourth operation signal are respectively determined as the target operation signals corresponding to the first operation area or the first device, and the second operation area or the second device.

[0032] Optionally, if the target operation signal includes an object switching signal;

[0033] Accordingly, the executing the target operation signal includes:

[0034] Switching the information display interface between a 2D display interface and a 3D display interface based on the object switching signal; or,

[0035] Based on the object switching signal, the 2D display interface is additionally displayed on the basis of the 3D display interface, or a hybrid interface of the 2D display interface and the 3D display interface is switched to the 3D display interface.

[0036] Optionally, the executing the target operation signal further includes:

[0037] The switch states of at least two channels are controlled based on the object switching signal, wherein the at least two channels are used to transmit the 2D display interface and the 3D display interface, respectively.

[0038] Optionally, the hybrid interface of the 2D display interface and the 3D display interface includes: a hybrid interface formed by superimposing the 2D display interface and the 3D display interface, or a hybrid interface formed by combining the 2D display interface and the 3D display interface in a display interface.

[0039] In a third aspect, an embodiment of the present invention further provides a control device, which is applied to an operating device, and the device includes:

[0040] A trigger signal monitoring module, used to monitor a trigger signal sent to an operating component on an operating device; wherein the trigger signal is generated when the operating component is operated, and includes a trigger type and a trigger parameter;

[0041] an operation signal generating module, configured to generate a corresponding operation signal based on a trigger type and a trigger parameter in the trigger signal, wherein the operation signal includes an operation object control signal and an object switching signal, the object switching signal is used to control the display device to switch the information display interface, and trigger the operation object corresponding to the information display interface, and the operation object control signal is used to control the state of the corresponding operation object;

[0042] The operation object sending module is used to send the operation signal to the corresponding device so that the device executes the operation signal, wherein the device includes a display device and a task execution device.

[0043] In a fourth aspect, an embodiment of the present invention further provides a control device, applied to a display device, the device comprising:

[0044] An operation signal receiving module, used for receiving operation signals sent by various operation devices;

[0045] a target operation signal generating module, configured to determine the operation signal sent by the device as the target operation signal, or to determine the target operation signal based on the operation signals sent by at least two operation devices;

[0046] A target operation signal execution module is used to execute the target operation signal; wherein the target operation signal includes an operation object control signal and an object switching signal, the object switching signal is used to control the switching of the information display interface and trigger the operation object corresponding to the information display interface, and the operation object control signal is used to control the state of the operation object in the information display interface.

[0047] In a fifth aspect, an embodiment of the present invention further provides an electronic device, the electronic device comprising:

[0048] one or more processors;

[0049] a storage device for storing one or more programs,

[0050] When the one or more programs are executed by the one or more processors, the one or more processors implement the control method provided by any embodiment of the present invention.

[0051] In a sixth aspect, an embodiment of the present invention further provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the control method provided by any embodiment of the present invention.

[0052] The technical solution of the embodiment of the present invention specifically includes: monitoring the trigger signal sent to the operating component on the operating device, so that the corresponding operation signal is subsequently generated based on the trigger signal, wherein the trigger signal is generated when the operating component is operated, and the specific trigger signal includes a trigger type and a trigger parameter; further generating a corresponding operation signal based on the trigger type and the trigger parameter in the trigger signal, wherein the operation signal includes an operation object control signal and an object switching signal, the object switching signal is used to control the display device to switch the information display interface, and trigger the operation object corresponding to the information display interface, and the operation object control signal is used to control the state of the corresponding operation object; and further sending the operation signal to the corresponding device, so that the device executes the operation signal, wherein the device includes a display device and a task execution device. The technical solution of the embodiment of the present invention generates a corresponding operation signal by monitoring the operation action of the operating component, so as to realize the interface switching of the information display interface and control the operation object corresponding to the switched interface, so as to realize the switching of the interface based on the operating device and the operation of the operation objects under different interfaces, thereby increasing the operation convenience of the operating device and improving the efficiency of task operation. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] In order to more clearly illustrate the technical solutions of the exemplary embodiments of the present invention, the following briefly introduces the drawings required to describe the embodiments. Obviously, the drawings introduced are only drawings of a part of the embodiments to be described in the present invention, rather than all the drawings. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0054] Figure 1 is a flow chart of a control method provided in Embodiment 1 of the present invention;

[0055] Figure 2 is a schematic diagram of a configuration interface involved in Embodiment 1 of the present invention;

[0056] Figure 3 is a flow chart of a control method provided in Embodiment 2 of the present invention;

[0057] Figure 4 is a flow chart of a control method provided in Embodiment 3 of the present invention;

[0058] Figure 5 is a schematic diagram of the structure of a control device provided in Embodiment 4 of the present invention;

[0059] Figure 6 is a schematic diagram of the structure of a control device provided in Embodiment 5 of the present invention;

[0060] Figure 7 This is a schematic diagram of the structure of an electronic device provided in Embodiment 6 of the present invention. DETAILED DESCRIPTION

[0061] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the present invention, rather than to limit the present invention. It should also be noted that, for ease of description, only parts related to the present invention, rather than all structures, are shown in the accompanying drawings.

[0062] Embodiment 1

[0063] Figure 1 This is a flowchart of a control method provided in Embodiment 1 of the present invention, which is applied to an operating device. This embodiment can be applied to the case of operating an operating device, and more specifically, to the case of detecting an operating action on an operating component in the operating device and generating an operating signal corresponding to the operating component. The method can be executed by a control device, which can be implemented by software and / or hardware.

[0064] Before introducing the technical solution of this embodiment, the application scenarios of this embodiment are first introduced exemplarily. Of course, the following application scenarios are only optional application scenarios. The technical solution of this embodiment can also be applied to other application scenarios, and this embodiment does not limit this. Specifically, the application scenarios introduced exemplarily include:

[0065] The existing technical solution of surgical robots allows users to remotely control the robot to perform surgical operations through a doctor's operating system. The doctor's operating system includes a display device and a series of operating input devices such as handles, pedals, etc. Among them, the display device includes a 3D view and an independent touch screen. The 3D view is used to display the doctor's 3D images and related instrument information during the operation. The user obtains surgical process information by observing the image of the 3D view, so that the instrument can be remotely operated to perform the operation. The independent touch screen displays and sets the doctor's operating system settings related to the doctor through the configuration interface, such as the motion scaling ratio, the 3D view display angle, the height of the arm bracket, the front and rear position of the pedal, etc., so that the parameters of the operating system (height, etc.) are ergonomic.

[0066] Under the current system settings, when the doctor needs to set the doctor operating system related settings during the operation, he needs to leave the 3D view and take his hands off the surgical operation handle to make related settings on the touch screen. After the settings are completed, he needs to re-enter the 3D view and put his hands back into the operation handle to continue the operation. Therefore, the operation during the operation will be more complicated and cumbersome, affecting the safety of the operation.

[0067] In order to solve the above technical problems, before executing the technical solution of the embodiment of the present invention, an operating system for executing the technical solution of the embodiment of the present invention is first built, which specifically includes an operating device and a display device. Based on the above operating system, the technical solution of this embodiment provides a control method for an operating device, which specifically includes: monitoring a trigger signal sent to an operating component on the operating device, so that a corresponding operation signal is subsequently generated based on the trigger signal, wherein the trigger signal is generated when the operating component is operated, and the specific trigger signal includes a trigger type and a trigger parameter; further generating a corresponding operation signal based on the trigger type and trigger parameter in the trigger signal, wherein the operation signal includes an operation object control signal and an object switching signal, the object switching signal is used to control the display device to switch the information display interface, and the operation object corresponding to the trigger information display interface, and the operation object control signal is used to control the state of the corresponding operation object; and further sending the operation signal to the corresponding device so that the device executes the operation signal, wherein the device includes a display device and a task execution device. The technical solution of the embodiment of the present invention generates corresponding operation signals by monitoring the operation actions of the operating components to realize the interface switching of the information display interface and control the operation objects corresponding to the switched interface, thereby realizing both the switching of interfaces and the operation of operation objects under different interfaces based on the operating device, increasing the operating convenience of the operating device and improving the efficiency of task operations, thereby improving the operating efficiency of the operating user.

[0068] like Figure 1 As shown, the technical solution of this embodiment specifically includes the following steps:

[0069] S110, monitoring a trigger signal sent to an operating component on an operating device; wherein the trigger signal is generated when the operating component is operated, and includes a trigger type and a trigger parameter.

[0070] In this embodiment, the operating device may be a device used by an operating user to perform an operation. Specifically, the operating device may be at least one operating handle. The operating component includes a component provided on the surface of the operating device or the entire operating device as a component. The number of operating components is at least one. The types of operating components include an operation switching component and an operation object control component, which are respectively used to realize the switching of the information display interface and control the operation object corresponding to the switched information display interface. Specifically, when any operating component is operated, a corresponding trigger signal will be generated according to the operating action; wherein the trigger signal includes a trigger type and a trigger parameter. Trigger types include types such as moving, pressing or rotating, and trigger parameters include parameters such as distance and angle.

[0071] Specifically, the operation of the operating component may include but is not limited to pressing the operating component, moving or rotating the operating component. Optionally, if the operating component is an operating button set on the surface of the operating device, a corresponding trigger signal is generated when the operating button is pressed or moved; if the operating component is the entire operating device, a corresponding trigger signal is generated when the entire operating device is pressed or moved. Take the operating component as the entire operating device as an example to introduce monitoring the trigger signal sent to the operating component on the operating device: Specifically, the operating action of the operating device includes six degrees of freedom, namely, translation of the X, Y, and Z axes and rotation of the X, Y, and Z axes; illustratively, if the operating device is moved K millimeters in the positive direction of the Y axis, the trigger signal monitored at this time includes a trigger type of movement in the positive direction of the Y axis and a trigger parameter of K millimeters. Of course, the above embodiment is only an optional embodiment, and the trigger signal of the operating component can also be obtained based on other methods, which is not limited in this embodiment.

[0072] S120: Generate a corresponding operation signal based on the trigger type and trigger parameters in the trigger signal.

[0073] In this embodiment, the operation signal includes an operation object control signal and an object switching signal. The object switching signal is used to control the display device to switch the information display interface and trigger the operation object corresponding to the information display interface. The operation object control signal is used to control the state of the corresponding operation object.

[0074] Optionally, generating a corresponding operation signal based on a trigger signal may include generating a corresponding operation signal based on the trigger signal of any operating component, i.e., generating a corresponding operation signal based on the trigger type and trigger parameters of the trigger signal of any operating component; generating a corresponding operation signal based on a trigger signal may also include generating a corresponding operation signal based on the trigger signals of multiple operating components, i.e., generating a corresponding combined operation signal based on the trigger type and trigger parameters corresponding to each trigger signal.

[0075] For example, if the operating device is an operating handle, a corresponding operating signal can be generated based on a trigger signal sent by a single handle that is monitored; a corresponding combined operating signal can also be generated based on trigger signals sent by multiple (e.g., two) handles that are monitored. Specifically, the corresponding combined operating signal can be determined based on the time difference between the multiple trigger signals that are monitored and a preset operating signal library.

[0076] S130: Send the operation signal to the corresponding device so that the device executes the operation signal, wherein the device includes a display device and a task execution device.

[0077] In an embodiment of the present invention, the operation signal may only include an operation switching signal, and accordingly, the operation switching signal is sent to a corresponding device, that is, to a display device, so that the display device executes switching of an information display interface; specifically, the information display interface includes a 2D display interface and a 3D display interface, and accordingly, the display device executes switching from a 2D display interface to a 3D display interface, or from a 3D display interface to a 2D display interface.

[0078] Optionally, the operation signal may also only include an operation object control signal, and accordingly, an operation object control signal of an operation object corresponding to the information display interface is generated according to the currently displayed information display interface, and the operation object control signal is sent to the corresponding device. Specifically, the operation object corresponding to the 2D display interface includes each content object in the display interface, and the operation object corresponding to the 3D display interface is a task execution device.

[0079] Optionally, if the currently displayed information display interface is a 2D display interface, and accordingly, the operation object corresponding to the current interface includes various content objects in the display interface, the operation object control signal is sent to the display device so that the display device controls various content objects in the current information display interface. Various content objects in this embodiment include, but are not limited to, cursors, text, pictures, interfaces and other content objects.

[0080] Optionally, if the currently displayed information display interface is a 3D display interface, and accordingly, the operation object corresponding to the current interface is each device in the task execution device, then the operation object control signal is sent to the task execution device so that each device in the execution device can operate the task object. The task execution device in this embodiment can be a device for performing endoscopic surgery and a device for performing fine engraving.

[0081] In some embodiments, the 2D display interface includes a configuration interface, such as Figure 2 The configuration interface shown specifically includes, but is not limited to, configuration interfaces corresponding to configuration of user data, parameter configuration of operating devices, and parameter configuration of display devices.

[0082] The technical solution of the embodiment of the present invention specifically includes: monitoring the trigger signal sent to the operating component on the operating device, so that the corresponding operation signal is subsequently generated based on the trigger signal, wherein the trigger signal is generated when the operating component is operated, and the specific trigger signal includes a trigger type and a trigger parameter; further generating a corresponding operation signal based on the trigger type and the trigger parameter in the trigger signal, wherein the operation signal includes an operation object control signal and an object switching signal, the object switching signal is used to control the display device to switch the information display interface, and trigger the operation object corresponding to the information display interface, and the operation object control signal is used to control the state of the corresponding operation object; and further sending the operation signal to the corresponding device, so that the device executes the operation signal, wherein the device includes a display device and a task execution device. The technical solution of the embodiment of the present invention generates a corresponding operation signal by monitoring the operation action of the operating component, so as to realize the interface switching of the information display interface and control the operation object corresponding to the switched interface, so as to realize the switching of the interface based on the operating device and the operation of the operation objects under different interfaces, thereby increasing the operation convenience of the operating device and improving the efficiency of task operation.

[0083] Embodiment 2

[0084] Figure 3 This is a flow chart of a control method provided in the second embodiment of the present invention. Based on the above embodiments, the step of "generating a corresponding operation signal based on the trigger type and trigger parameters in the trigger signal" is refined into "generating a corresponding operation signal based on the trigger type and trigger parameters in the trigger signal; wherein the operation device includes two operation areas, and each operation area is provided with a plurality of operation components." The explanations of the terms that are the same or corresponding to the above embodiments are not repeated here. Figure 3 , the control method provided in this embodiment includes:

[0085] S210, monitoring a trigger signal sent to an operating component on an operating device; wherein the trigger signal is generated when the operating component is operated, and includes a trigger type and a trigger parameter.

[0086] S220, generating a corresponding operation signal based on the trigger type and trigger parameters in the trigger signal; wherein the operation device includes two operation areas, and each operation area is provided with a plurality of operation components.

[0087] In this embodiment, the operating device includes two operating areas. Taking the operating device as an operating handle as an example, in order to facilitate the user to operate with one hand, the operating areas can be respectively set at the top of the handle and the side of the handle. Of course, they can also be respectively located in the left and right areas of the operating handle, so that the user can operate the operating handle with both hands at the same time. Of course, they can also be set in other multiple areas of the operating handle. This embodiment does not limit the number and position of the operating areas on the operating device.

[0088] Optionally, in this embodiment, when a trigger signal sent to an operating component in different operating areas of the operating device is monitored, a corresponding operating signal is generated based on a first trigger signal sent by the operating component in the first operating area and / or a second trigger signal sent by the operating component in the second operating area. In other words, a corresponding operating signal may be generated based only on a first trigger signal sent by the operating component in the first operating area of ​​the first area; a corresponding operating signal may also be generated based only on a second trigger signal sent by the operating component in the second operating area; of course, a corresponding operating signal may also be generated based on both a first trigger signal sent by the operating component in the first operating area and a second trigger signal sent by the operating component in the second operating area. It can also be explained that the corresponding operating signal generated based on the first trigger signal of the first operating area and the second trigger signal of the second operating area may be a single operating signal or a combined operating signal.

[0089] Specifically, the method for determining whether the corresponding operation signal generated based on the first trigger signal of the first operation area and the second trigger signal of the second operation area is a single operation signal or a combined operation signal can be determined based on the time difference between the timestamp corresponding to the monitored first trigger signal and the timestamp corresponding to the monitored second trigger signal.

[0090] Optionally, the determination method specifically includes if a second trigger signal is received within a preset time interval after a first trigger signal is received, or if a first trigger signal is received within a preset time interval after a second trigger signal is received, then determining a corresponding operation signal based on the first trigger signal, the second trigger signal and a preset operation signal library.

[0091] Optionally, the method for determining the corresponding operation signal based on the first trigger signal, the second trigger signal and a preset operation signal library specifically includes: if a combined operation signal of the first trigger signal and the second trigger signal is matched in the preset operation signal library, the combined operation signal is determined as the corresponding operation signal.

[0092] Of course, in some embodiments, if the combined operation signal of the first trigger signal and the second trigger signal is not matched in the preset operation signal library, the first trigger signal and the second trigger signal are respectively determined as the operation signals corresponding to the first operation area and the second operation area.

[0093] In some other embodiments, the operating device also includes a master device and at least one slave device, each of the master device and the slave device is respectively provided with multiple operating components, the slave device sends a trigger signal to the master device, and the master device is used to generate an operating signal based on the trigger signals sent by each slave device and the trigger signal sent by its own operating components.

[0094] In this embodiment, the master device uses the trigger signal sent by its own operating component as the first trigger signal, and uses the trigger signal sent by each slave device as the second trigger signal according to the number of each slave device, and the third trigger signal is sequentially arranged according to the number of slave devices. Further, the corresponding operation signal is determined for each trigger signal in the master device according to the above method of determining the corresponding operation signal by determining the trigger signal sent by different operation areas, and the specific determination method is not described in detail in this embodiment.

[0095] In some other embodiments, the operating device also includes at least two sub-devices, each of which is provided with multiple operating components. The sub-device generates an operating signal based on a trigger signal sent by the operating component, and independently sends the operating signal to the corresponding device so that the corresponding device executes the received operating signal.

[0096] S230: Send the operation signal to the corresponding device so that the device executes the operation signal, wherein the device includes a display device and a task execution device.

[0097] The technical solution of the embodiment of the present invention generates corresponding operation signals by monitoring the operation actions of the operating components to realize the interface switching of the information display interface and control the operation objects corresponding to the switched interface. It realizes both the switching of the interface and the operation of the operation objects in different interfaces based on the operating device, increases the operating convenience of the operating device and improves the efficiency of task operations.

[0098] On the basis of the above embodiments, the embodiment of the present invention also provides a preferred embodiment. When the current information display interface is a 2D display interface, that is, a configuration interface: take the operation of the handle to realize the up, down, left and right movement of the screen cursor as an example: specifically, the control handle is rotated counterclockwise to the X axis by X degrees to realize the cursor moving up; the control handle is rotated clockwise to the Y axis by X degrees to realize the cursor moving down; the control handle is rotated counterclockwise to the Z axis by X degrees to realize the left movement of the handle. The control handle is rotated clockwise to the Z axis by X degrees to realize the right movement of the cursor. Of course, this embodiment also includes the control of the operation object such as confirming the selection, canceling the selection, and dragging based on other operations on the operation handle. Specifically, the control handle is moved to the square of the Z axis by Xmm to realize the confirmation of the selection; the control handle is moved to the negative square of the Z axis by Xmm to realize the cancellation of the selection; of course, after the selection is confirmed, the operation handle can be moved in the corresponding direction to realize the dragging. Of course, the input of text and the import of images can also be performed based on the operation handle, and this embodiment is not limited here.

[0099] On the basis of the above-mentioned embodiments, the embodiment of the present invention also provides another preferred embodiment, that is, in order to facilitate user operation, the technical solution of this embodiment can also use two-handed control of the operating handle to realize the control of the operation object corresponding to the current information display interface. Similarly, when the current information display interface is a 2D display interface, that is, a configuration interface: take the operation of the handle to realize the up, down, left and right movement of the screen cursor as an example: specifically, to realize the upward movement of the cursor, control the left operating handle to move Xmm in the Y-axis square. To realize the upward movement of the cursor, control the left operating handle to move Xmm in the negative direction of the Y-axis. To realize the downward movement of the cursor, control the left operating handle to move Xmm in the negative direction of the X-axis. To realize the left movement of the cursor, control the left operating handle to move Xmm in the positive direction of the X-axis. To realize the right movement of the cursor, control the right operating handle to move Xmm in the positive direction of the X-axis. Similarly, this embodiment also includes the control of the operation object such as confirming the selection, canceling the selection, and dragging based on other operations on different operating handles. Specifically, to confirm the selection, press the right handle button A; to cancel the selection, press the right handle button B; to drag: after selecting, move the handle in the corresponding direction; to zoom in and out of an image, interface or text: after selecting, press the left and right handle buttons B at the same time, and move Xmm relative or oppositely. Of course, the above preferred embodiments are only optional embodiments of the embodiments in this application. The technical solution of this application can also cite other preferred embodiments, which are not listed one by one in this embodiment.

[0100] Embodiment 3

[0101] Figure 4This is a flowchart of a control method provided in Embodiment 3 of the present invention, which is applied to a display device. This embodiment is applicable to the case of operating an operating device, and more specifically, to the case of displaying a received operating signal. The method can be executed by a control device, which can be implemented by software and / or hardware. Figure 4 As shown, the method specifically comprises the following steps:

[0102] S310: Receive operation signals sent by each operation device.

[0103] In this embodiment, the operation signal includes an operation switching signal and an operation object control signal.

[0104] Specifically, the operation signal sent by each operation device may include a single operation signal generated by an operation action of a single operation component; or may be a combined operation signal generated based on the operation actions of multiple operation components, which is not limited in this embodiment.

[0105] S320: Determine an operation signal sent by any operation device as a target operation signal, or determine a target operation signal based on operation signals sent by at least two operation devices.

[0106] In this embodiment, if the number of operating devices is one, an operating signal sent by any operating device is received, and the operating signal is used as the target signal. If the number of operating devices is multiple, the timestamp corresponding to the received operating signal is obtained, and the target operating signal is determined according to each timestamp. Optionally, the method for determining the target operating signal based on each timestamp includes: if a fourth operating signal sent by a second operating device is received within a preset time interval after a third operating signal sent by a first operating device is received, or if a third operating signal is received within a preset time interval after a fourth operating signal is received, the target operating signal is determined based on the third operating signal, the fourth operating signal, and a preset operating signal library.

[0107] Optionally, the method for determining the target operation signal based on the third operation signal, the fourth operation signal and a preset operation signal library includes: if a combined operation signal of the third operation signal and the fourth operation signal is matched in the preset operation signal library, determining the combined operation signal as the target operation signal.

[0108] In some other embodiments, if the combined operation signal of the third operation signal and the fourth operation signal is not matched in the preset operation signal library, the third operation signal and the fourth operation signal are respectively determined as the target operation signals corresponding to the first operation area or the first device, and the second operation area or the second device.

[0109] S330: Execute the target operation signal.

[0110] In an embodiment of the present invention, the target operation signal includes an operation object control signal and an object switching signal. The object switching signal is used to control the switching of the information display interface and trigger the operation object corresponding to the information display interface. The operation object control signal is used to control the state of the operation object in the information display interface.

[0111] Specifically, a corresponding operation is performed according to the type of the target operation signal. Specifically, when the target operation signal is an operation object control signal, the operation object corresponding to the interface is determined according to the current display interface, and the operation object control signal is executed on the operation object.

[0112] Specifically, when the target operation object includes a switching signal, the information display interface is switched between the 2D display interface and the 3D display interface based on the object switching signal; or, based on the object switching signal, the 2D display interface is displayed on the basis of the 3D display interface, or, the hybrid interface of the 2D display interface and the 3D display interface is switched to the 3D display interface. In this embodiment, the hybrid interface of the 2D display interface and the 3D display interface includes: a hybrid interface formed by the superposition display of the 2D display interface and the 3D display interface, or a hybrid interface formed by the combination display of the 2D display interface and the 3D display interface in the display interface. The 2D display interface includes a configuration interface, and the 3D display interface includes a task execution interface.

[0113] In some embodiments, when the information display interface is switched, the switch states of at least two channels are also controlled based on the object switching signal, wherein the at least two channels are used to transmit the 2D display interface and the 3D display interface, respectively.

[0114] Specifically, the first channel corresponding to the 2D display interface and the second channel corresponding to the 3D display interface are determined respectively, and the corresponding information display interface is further determined according to the operation switching signal, and the switch state of each channel is further controlled. Exemplarily, when the information display interface includes a 2D display interface, the first channel is controlled to be in an open state and the second channel is controlled to be in a closed state, so that the operating user can perform configuration operations on the configuration interface corresponding to the 2D display interface. Of course, when the information display interface is a 3D display interface, the second channel is controlled to be in an open state and the first channel is controlled to be in a closed state, so that the operating user can perform task operations on the task screen display interface corresponding to the 2D display interface.

[0115] In some embodiments, when the channel corresponding to the information display interface is in a closed state, the operation object corresponding to the information display interface is also in an inoperable state to avoid safety issues caused by misoperation of the operation object of the task screen display interface.

[0116] The technical solution of the embodiment of the present invention specifically includes: receiving the operation signal of each operation device, and determining the operation signal sent by any operation device as the target operation signal, obtaining the operation signal sent by at least two operation devices as the target signal, and further executing the target operation signal; wherein the target operation signal includes an operation object control signal and an object switching signal, the object switching signal is used to control the switching of the information display interface, and trigger the operation object corresponding to the information display interface, and the operation object control signal is used to control the state of the operation object in the information display interface. The technical solution of the embodiment of the present invention receives each operation signal and determines the signal type of each operation signal, that is, based on executing the target operation signal, the interface switching of the information display interface and the control of the operation object corresponding to the switched interface are realized, which realizes the switching of the interface based on the operation device and the operation of the operation objects under different interfaces, thereby increasing the operation convenience of the operation device and improving the efficiency of task operation.

[0117] The following is an embodiment of a control device provided in an embodiment of the present invention. The device and the control methods of the above embodiments belong to the same inventive concept. For details not described in detail in the embodiment of the control device, reference can be made to the embodiments of the above control methods.

[0118] Embodiment 4

[0119] Figure 5 This is a schematic diagram of the structure of the control device provided in the fourth embodiment of the present invention, which is applied to the operating device. This embodiment can be applied to the case of operating the operating device, and more specifically, to the case of detecting the operation action of the operating component in the operating device and generating the operation signal corresponding to the operating component. The specific structure of the control device includes: a trigger signal monitoring module 410, an operation signal generating module 420 and an operation object sending module 430; wherein,

[0120] A trigger signal monitoring module 410 is used to monitor a trigger signal sent to an operating component on an operating device; wherein the trigger signal is generated when the operating component is operated, and includes a trigger type and a trigger parameter;

[0121] An operation signal generating module 420, configured to generate a corresponding operation signal based on a trigger type and a trigger parameter in the trigger signal, wherein the operation signal includes an operation object control signal and an object switching signal, wherein the object switching signal is used to control the display device to switch the information display interface and trigger the operation object corresponding to the information display interface, and the operation object control signal is used to control the state of the corresponding operation object;

[0122] The operation object sending module 430 is used to send the operation signal to the corresponding device so that the device executes the operation signal, wherein the device includes a display device and a task execution device.

[0123] The technical solution of the embodiment of the present invention specifically includes: monitoring the trigger signal sent to the operating component on the operating device, so that the corresponding operation signal is subsequently generated based on the trigger signal, wherein the trigger signal is generated when the operating component is operated, and the specific trigger signal includes a trigger type and a trigger parameter; further generating a corresponding operation signal based on the trigger type and the trigger parameter in the trigger signal, wherein the operation signal includes an operation object control signal and an object switching signal, wherein the object switching signal is used to control the display device to switch the information display interface, and trigger the operation object corresponding to the information display interface, and the operation object control signal is used to control the state of the corresponding operation object; and further sending the operation signal to the corresponding device, so that the device executes the operation signal, wherein the device includes a display device and a task execution device. The technical solution of the embodiment of the present invention generates a corresponding operation signal by monitoring the operation action of the operating component, so as to realize the interface switching of the information display interface and control the operation object corresponding to the switched interface, so as to realize the switching of the interface and the operation of the operation objects under different interfaces based on a single operating device, thereby increasing the operation convenience of the operating device and improving the efficiency of task operation.

[0124] On the basis of the above technical solution, the operating device includes two operating areas, each of which is provided with a plurality of operating components.

[0125] The operation signal generating module 420 includes:

[0126] The operation signal generation submodule is used to generate a corresponding operation signal based on a first trigger signal sent by the operating component in the first operation area and / or a second trigger signal sent by the operating component in the second operation area.

[0127] Based on the above technical solution, the operation signal generation submodule includes:

[0128] An operation signal generating unit is used to determine a corresponding operation signal based on the first trigger signal, the second trigger signal and a preset operation signal library if the second trigger signal is received within a preset time interval after the first trigger signal is received, or if the first trigger signal is received within a preset time interval after the second trigger signal is received.

[0129] On the basis of the above technical solution, the operation signal generating unit includes:

[0130] A first operation signal generating subunit is configured to determine the combined operation signal as a corresponding operation signal if a combined operation signal of the first trigger signal and the second trigger signal is matched in the preset operation signal library;

[0131] The second operation signal generating subunit is used to determine the first trigger signal and the second trigger signal as the operation signals corresponding to the first operation area and the second operation area respectively if the combined operation signal of the first trigger signal and the second trigger signal is not matched in the preset operation signal library.

[0132] On the basis of the above technical solution, the operating device includes at least two sub-devices, each of which is provided with a plurality of operating components, and the sub-device generates an operating signal based on a trigger signal sent by the operating component, and sends the operating signal to the corresponding device independently. On the basis of the above technical solution, it includes:

[0133] Based on the above technical solution, the operating device includes a master device and at least one slave device, each of the master device and the slave device is respectively provided with multiple operating components, the slave device sends a trigger signal to the master device, and the master device is used to generate an operating signal based on the trigger signals sent by each slave device and the trigger signal sent by its own operating components.

[0134] Based on the above technical solution, the information display interface includes a 2D display interface and a 3D display interface, wherein the operation object corresponding to the 2D display interface includes each content object in the display interface, and the operation object corresponding to the 3D display interface is a task execution device.

[0135] Based on the above technical solution, the 2D display interface includes a configuration interface.

[0136] The control device provided in the embodiment of the present invention can execute the control method applied to the operating device provided in any embodiment of the present invention, and has the functional modules and beneficial effects corresponding to the execution method.

[0137] Embodiment 5

[0138] Figure 6 This is a schematic diagram of the structure of the control device provided in the fifth embodiment of the present invention, which is applied to a display device. This embodiment can be applied to the case of operating an operating device, and more specifically, to the case of displaying a received operating signal. The specific structure of the control device includes: an operating signal receiving module 510, a target operating signal generating module 520 and a target operating signal executing module 530; wherein,

[0139] An operation signal receiving module 510 is used to receive an operation signal sent by each operation device;

[0140] A target operation signal generating module 520, configured to determine the operation signal sent by the device as the target operation signal, or to determine the target operation signal based on the operation signals sent by at least two operation devices;

[0141] The target operation signal execution module 530 is used to execute the target operation signal; wherein the target operation signal includes an operation object control signal and an object switching signal, the object switching signal is used to control the switching of the information display interface, and trigger the operation object corresponding to the information display interface, and the operation object control signal is used to control the state of the operation object in the information display interface.

[0142] The technical solution of the embodiment of the present invention specifically includes: receiving the operation signal of each operation device, and determining the operation signal sent by any operation device as the target operation signal, obtaining the operation signal sent by at least two operation devices as the target signal, and further executing the target operation signal; wherein the target operation signal includes an operation object control signal and an object switching signal, the object switching signal is used to control the switching of the information display interface, and trigger the operation object corresponding to the information display interface, and the operation object control signal is used to control the state of the operation object in the information display interface. The technical solution of the embodiment of the present invention receives each operation signal and determines the signal type of each operation signal, that is, based on executing the target operation signal, the interface switching of the information display interface and the control of the operation object corresponding to the switched interface are realized, which realizes the switching of the interface based on the operation device and the operation of the operation objects under different interfaces, thereby increasing the operation convenience of the operation device and improving the efficiency of task operation.

[0143] Based on the above technical solution, there are at least two operating devices;

[0144] The target operation signal generating module 620 includes:

[0145] A target operation signal generating unit is used to determine a target operation signal based on the third operation signal, the fourth operation signal and a preset operation signal library if a fourth operation signal sent by the second operation device is received within a preset time interval after the third operation signal sent by the first operation device is received, or if the third operation signal is received within a preset time interval after the fourth operation signal is received.

[0146] On the basis of the above technical solution, the target operation signal generating unit includes:

[0147] a first target operation signal generating subunit, configured to determine the combined operation signal as a target operation signal if a combined operation signal of the third operation signal and the fourth operation signal is matched in the preset operation signal library;

[0148] The second target operation signal generating subunit is used to determine the third operation signal and the fourth operation signal as the target operation signals corresponding to the first operation area or the first device, and the second operation area or the second device respectively if the combined operation signal of the third operation signal and the fourth operation signal is not matched in the preset operation signal library.

[0149] On the basis of the above technical solution, if the target operation signal includes an object switching signal;

[0150] Accordingly, the target operation signal execution module 630 includes:

[0151] A first target operation signal execution unit is configured to switch the information display interface between a 2D display interface and a 3D display interface based on the object switching signal; or

[0152] The second target operation signal execution unit is used to display the 2D display interface in addition to the 3D display interface based on the object switching signal, or to switch from a mixed interface of the 2D display interface and the 3D display interface to the 3D display interface.

[0153] Based on the above technical solution, the target operation signal execution module 630 includes:

[0154] A channel switch state control unit is used to control the switch states of at least two channels based on the object switching signal, wherein the at least two channels are used to transmit the 2D display interface and the 3D display interface respectively.

[0155] On the basis of the above technical solution, the hybrid interface of the 2D display interface and the 3D display interface includes: a hybrid interface formed by superimposed display of the 2D display interface and the 3D display interface, or a hybrid interface formed by combined display of the 2D display interface and the 3D display interface in a display interface.

[0156] The control device provided in the embodiment of the present invention can execute the control method applied to the display device provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0157] It is worth noting that in the embodiment of the above-mentioned control device, the various units and modules included are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of the present invention.

[0158] Embodiment 6

[0159] Figure 7 A schematic diagram of the structure of an electronic device provided in Embodiment 4 of the present invention. Figure 7 A block diagram of an exemplary electronic device 12 suitable for use in implementing embodiments of the present invention is shown. Figure 7 The electronic device 12 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0160] like Figure 7 As shown, the electronic device 12 is in the form of a general purpose computing electronic device. The components of the electronic device 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, and a bus 18 connecting various system components (including the system memory 28 and the processing unit 16).

[0161] Bus 18 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor or a local bus using any of a variety of bus architectures. By way of example, these architectures include, but are not limited to, an Industry Standard Architecture (ISA) bus, a Micro Channel Architecture (MAC) bus, an Enhanced ISA bus, a Video Electronics Standards Association (VESA) local bus, and a Peripheral Component Interconnect (PCI) bus.

[0162] The electronic device 12 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by the electronic device 12, including volatile and non-volatile media, removable and non-removable media.

[0163] The system memory 28 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 30 and / or cache memory 32. The electronic device 12 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, the storage system 34 may be used to read and write non-removable, non-volatile magnetic media ( Figure 7 not shown, usually called a "hard drive"). Although Figure 7Not shown in the figure, a disk drive for reading and writing to a removable non-volatile disk (e.g., a "floppy disk"), and an optical disk drive for reading and writing to a removable non-volatile optical disk (e.g., a CD-ROM, a DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to the bus 18 via one or more data medium interfaces. The system memory 28 may include at least one program product having a set (e.g., at least one) of program modules that are configured to perform the functions of the various embodiments of the present invention.

[0164] A program / utility 40 having a set (at least one) of program modules 42 may be stored, for example, in system memory 28, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment. Program modules 42 generally perform the functions and / or methods of the embodiments described herein.

[0165] The electronic device 12 may also communicate with one or more external devices 14 (e.g., keyboards, pointing devices, displays 24, etc.), one or more devices that enable a user to interact with the electronic device 12, and / or any device that enables the electronic device 12 to communicate with one or more other computing devices (e.g., network cards, modems, etc.). Such communication may be performed through an input / output (I / O) interface 22. Furthermore, the electronic device 12 may also communicate with one or more networks (e.g., local area networks (LANs), wide area networks (WANs), and / or public networks, such as the Internet) through a network adapter 20. Figure 7 As shown, the network adapter 20 communicates with other modules of the electronic device 12 via the bus 18. It should be understood that although Figure 7 Not shown, other hardware and / or software modules may be used in conjunction with the electronic device 12, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0166] The processing unit 16 executes various functional applications and sample data acquisition by running the program stored in the system memory 28, for example, implementing a control method step provided by the embodiment of the present invention, specifically:

[0167] Control methods applied to operating equipment include:

[0168] Monitoring a trigger signal sent to an operating component on an operating device; wherein the trigger signal is generated when the operating component is operated, and includes a trigger type and a trigger parameter;

[0169] Generate a corresponding operation signal based on the trigger type and trigger parameters in the trigger signal, wherein the operation signal includes an operation object control signal and an object switching signal, the object switching signal is used to control the display device to switch the information display interface, and trigger the operation object corresponding to the information display interface, and the operation object control signal is used to control the state of the corresponding operation object;

[0170] The operation signal is sent to a corresponding device so that the device executes the operation signal, wherein the device includes a display device and a task execution device.

[0171] The method applied to the display device includes:

[0172] Receiving operation signals sent by various operation devices;

[0173] Determine an operation signal sent by any operation device as a target operation signal, or determine the target operation signal based on operation signals sent by at least two operation devices;

[0174] Execute the target operation signal; wherein, the target operation signal includes an operation object control signal and an object switching signal, the object switching signal is used to control the switching of the information display interface, and trigger the operation object corresponding to the information display interface, and the operation object control signal is used to control the state of the operation object in the information display interface.

[0175] Of course, those skilled in the art can understand that the processor can also implement the technical solution of the sample data acquisition method provided by any embodiment of the present invention.

[0176] Embodiment 7

[0177] This embodiment 7 provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, for example, a control method step provided in this embodiment is implemented, specifically:

[0178] Control methods applied to operating equipment include:

[0179] Monitoring a trigger signal sent to an operating component on an operating device; wherein the trigger signal is generated when the operating component is operated, and includes a trigger type and a trigger parameter;

[0180] Generate a corresponding operation signal based on the trigger type and trigger parameters in the trigger signal, wherein the operation signal includes an operation object control signal and an object switching signal, the object switching signal is used to control the display device to switch the information display interface, and trigger the operation object corresponding to the information display interface, and the operation object control signal is used to control the state of the corresponding operation object;

[0181] The operation signal is sent to a corresponding device so that the device executes the operation signal, wherein the device includes a display device and a task execution device.

[0182] The method applied to the display device includes:

[0183] Receive operation signals sent by various operating devices;

[0184] Determine an operation signal sent by any operation device as a target operation signal, or determine the target operation signal based on operation signals sent by at least two operation devices;

[0185] Execute the target operation signal; wherein, the target operation signal includes an operation object control signal and an object switching signal, the object switching signal is used to control the switching of the information display interface, and trigger the operation object corresponding to the information display interface, and the operation object control signal is used to control the state of the operation object in the information display interface.

[0186] The computer storage medium of the embodiment of the present invention can adopt any combination of one or more computer-readable media. The computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. The computer-readable storage medium can be, for example, but not limited to: an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples (non-exhaustive list) of computer-readable storage media include: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this document, a computer-readable storage medium can be any tangible medium containing or storing a program, which can be used by an instruction execution system, device or device or used in combination with it.

[0187] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, which carry computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0188] The program code embodied on the computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

[0189] Computer program code for performing the operations of the present invention may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0190] It should be understood by those skilled in the art that the modules or steps of the present invention described above can be implemented by a general-purpose computing device, they can be concentrated on a single computing device, or distributed on a network composed of multiple computing devices, optionally, they can be implemented by a program code executable by a computer device, so that they can be stored in a storage device and executed by the computing device, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. Thus, the present invention is not limited to any specific combination of hardware and software.

[0191] Note that the above are only preferred embodiments of the present invention and the technical principles used. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in more detail through the above embodiments, the present invention is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims

1. A control method, applied to an operating device, characterized in that: include: Monitoring a trigger signal sent to an operating component on an operating device; wherein the trigger signal is generated when the operating component is operated, and includes a trigger type and a trigger parameter; Generate a corresponding operation signal based on the trigger type and trigger parameters in the trigger signal, wherein the operation signal includes an operation object control signal and an object switching signal, the object switching signal is used to control the display device to switch the information display interface, and trigger the operation object corresponding to the information display interface, and the operation object control signal is used to control the state of the corresponding operation object; The operation signal is sent to a corresponding device so that the device executes the operation signal, wherein the device includes a display device and a task execution device.

2. The method according to claim 1, characterized in that The operating device includes two operating areas, each of which is provided with a plurality of operating components. The generating a corresponding operation signal based on the trigger type and the trigger parameter in the trigger signal includes: A corresponding operation signal is generated based on a first trigger signal sent by an operating component in the first operation area and / or a second trigger signal sent by an operating component in the second operation area.

3. The method according to claim 2, characterized in that The generating a corresponding operation signal based on a first trigger signal sent by an operating component in a first operation area and / or a second trigger signal sent by an operating component in a second operation area includes: If the second trigger signal is received within a preset time interval after the first trigger signal is received, or if the first trigger signal is received within a preset time interval after the second trigger signal is received, a corresponding operation signal is determined based on the first trigger signal, the second trigger signal and a preset operation signal library.

4. The method according to claim 3, characterized in that The determining the corresponding operation signal based on the first trigger signal, the second trigger signal and a preset operation signal library includes: If a combined operation signal of the first trigger signal and the second trigger signal is matched in the preset operation signal library, the combined operation signal is determined as the corresponding operation signal; If the combined operation signal of the first trigger signal and the second trigger signal is not matched in the preset operation signal library, the first trigger signal and the second trigger signal are respectively determined as the operation signals corresponding to the first operation area and the second operation area.

5. The method according to claim 1, characterized in that The operating device includes at least two sub-devices, each of which is provided with a plurality of operating components. The sub-device generates an operating signal based on a trigger signal sent by the operating component, and independently sends the operating signal to the corresponding device.

6. The method according to claim 1, characterized in that The operating device includes a master device and at least one slave device, each of the master device and the slave device is respectively provided with a plurality of operating components, the slave device sends a trigger signal to the master device, and the master device is used to generate an operating signal based on the trigger signals sent by each slave device and the trigger signal sent by its own operating components.

7. The method according to claim 1, characterized in that The information display interface includes a 2D display interface and a 3D display interface, wherein the operation object corresponding to the 2D display interface includes each content object in the display interface, and the operation object corresponding to the 3D display interface is a task execution device.

8. The method according to claim 7, characterized in that The 2D display interface includes a configuration interface.

9. A display device control method, applied to a display device, characterized in that: include: Receiving operation signals sent by various operation devices; Determine an operation signal sent by any operation device as a target operation signal, or determine the target operation signal based on operation signals sent by at least two operation devices; Execute the target operation signal; wherein, the target operation signal includes an operation object control signal and an object switching signal, the object switching signal is used to control the switching of the information display interface, and trigger the operation object corresponding to the information display interface, and the operation object control signal is used to control the state of the operation object in the information display interface.

10. The method according to claim 9, characterized in that There are at least two operating devices; The determining of the target operation signal based on the operation signals sent by at least two operation devices comprises: If a fourth operation signal sent by the second operation device is received within a preset time interval after the third operation signal sent by the first operation device is received, or if the third operation signal is received within a preset time interval after the fourth operation signal is received, the target operation signal is determined based on the third operation signal, the fourth operation signal and the preset operation signal library.

11. The method according to claim 10, characterized in that The determining the target operation signal based on the third operation signal, the fourth operation signal and a preset operation signal library includes: If a combined operation signal of the third operation signal and the fourth operation signal is matched in the preset operation signal library, the combined operation signal is determined as a target operation signal; If the combined operation signal of the third operation signal and the fourth operation signal is not matched in the preset operation signal library, the third operation signal and the fourth operation signal are respectively determined as the target operation signals corresponding to the first operation area or the first device, and the second operation area or the second device.

12. The method according to claim 9, characterized in that If the target operation signal includes an object switching signal; Accordingly, the executing the target operation signal includes: Switching the information display interface between a 2D display interface and a 3D display interface based on the object switching signal; or, Based on the object switching signal, the 2D display interface is additionally displayed on the basis of the 3D display interface, or a hybrid interface of the 2D display interface and the 3D display interface is switched to the 3D display interface.

13. The method according to claim 12, characterized in that The executing the target operation signal further includes: The switch states of at least two channels are controlled based on the object switching signal, wherein the at least two channels are used to transmit the 2D display interface and the 3D display interface, respectively.

14. The method according to claim 13, characterized in that The hybrid interface of the 2D display interface and the 3D display interface includes: a hybrid interface formed by superimposing the 2D display interface and the 3D display interface, or a hybrid interface formed by combining the 2D display interface and the 3D display interface in a display interface.

15. An operating device control device, characterized in that: include: A trigger signal monitoring module, used to monitor a trigger signal sent to an operating component on an operating device; wherein the trigger signal is generated when the operating component is operated, and includes a trigger type and a trigger parameter; an operation signal generating module, configured to generate a corresponding operation signal based on a trigger type and a trigger parameter in the trigger signal, wherein the operation signal includes an operation object control signal and an object switching signal, the object switching signal is used to control the display device to switch the information display interface, and trigger the operation object corresponding to the information display interface, and the operation object control signal is used to control the state of the corresponding operation object; The operation object sending module is used to send the operation signal to the corresponding device so that the device executes the operation signal, wherein the device includes a display device and a task execution device.

16. A display device control device, characterized in that: include: An operation signal receiving module, used for receiving operation signals sent by various operation devices; a target operation signal generating module, configured to determine the operation signal sent by the device as the target operation signal, or to determine the target operation signal based on the operation signals sent by at least two operation devices; A target operation signal execution module is used to execute the target operation signal; wherein the target operation signal includes an operation object control signal and an object switching signal, the object switching signal is used to control the switching of the information display interface and trigger the operation object corresponding to the information display interface, and the operation object control signal is used to control the state of the operation object in the information display interface.

17. An electronic device, characterized in that: include: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the control method as described in any one of claims 1-14.

18. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the control method as described in any one of claims 1 to 14 is implemented.

Images