Control method, device, equipment and medium of target device based on machine vision
Through machine vision technology, the working status of ship equipment is monitored and controlled in real time, and the problems of untimely and inefficient equipment control in the existing technology are solved, and accurate and efficient control of ship equipment is achieved.
Patent Information
- Application Number
- CN202310866487.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-07-14
- Publication Date
- 2024-12-06
- Estimated Expiration
- 2043-07-14
AI Technical Summary
In the prior art, the control of ship equipment is not timely enough, the control efficiency is low, and manual operation is dependent on, resulting in low efficiency in monitoring and regulating equipment operating status.
Using a control method based on machine vision, the working status data of the ship equipment is obtained through the camera, and whether the current status matches the target status is also generated, and control instructions are generated to achieve the target status, real-time monitoring and control are achieved.
It improves the timeliness and efficiency of equipment control, reduces the dependence on manual operations, and realizes precise control of ship equipment.
Smart Images

Figure CN116661400B_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the technical field of control or regulation systems, and specifically relates to a control method, device, equipment and medium for a target device based on machine vision. Background Art
[0002] With the continuous development of the intelligent logistics equipment industry, ships, as carriers and means of transportation for cargo, have become a focus of attention in the field in terms of their control and regulation. In order to enable ship equipment to achieve the best operating state and improve the transportation efficiency and safety of ships, it is very important to control the operating state of ship equipment.
[0003] In the prior art, the ship's crew is mainly responsible for checking the status of the equipment control panel and the equipment status, judging the current operating status of the equipment, and then determining the proper operating status of each device according to the current operating status of the ship, recording the equipment that does not meet the proper operating status, and adjusting the operating status of the recorded equipment to control the equipment to reach the proper operating status.
[0004] Due to the limited human resources, the existing technology cannot monitor and control the current operating status of the equipment in real time, and there is a problem of insufficient equipment control. At the same time, since the equipment control steps in the existing technology are relatively cumbersome, there is a problem of low control efficiency when using manual control of ship equipment. Therefore, how to use a new control or regulation system to control the ship has become a technical problem that needs to be solved urgently in this field. Summary of the invention
[0005] The purpose of the embodiments of the present application is to provide a control method, device, equipment and medium for a target device based on machine vision, which solves the problems of insufficient timeliness and low control efficiency of the target device in the prior art, by obtaining the working status data and the target working status of the target device, identifying whether the working status data is consistent with the target working status, and generating a control instruction to control the target device in the event of mismatch, so as to achieve the target working status. The working status of the target device can be monitored in real time through the control or adjustment system, which solves the problem that the current control or adjustment system relies on manual implementation, improves the timeliness and efficiency of the control of the target device, and achieves the purpose of precise control of the target device.
[0006] In a first aspect, an embodiment of the present application provides a method for controlling a target device based on machine vision, the method comprising:
[0007] Acquiring working status data of the target device through a camera pre-set in front of a control panel of the target device;
[0008] Obtaining the target working state of the target equipment under the current operating state of the ship;
[0009] Identifying whether the working state data is consistent with the target working state;
[0010] If they do not match, a control instruction is generated to control the target device to achieve the target working state.
[0011] Furthermore, the working status data of the target device is obtained through a camera pre-set in front of the control panel of the target device, including:
[0012] Acquire image data of at least one instrument panel in the control panel of the target device through a camera;
[0013] determining a reading parameter of the instrument panel according to the image data;
[0014] Accordingly, obtaining the target working state of the target device in the current operating state of the ship includes:
[0015] Obtain the expected reading of the instrument panel of the target equipment under the current operating state of the ship.
[0016] Furthermore, the working status data of the target device is obtained through a camera pre-set in front of the control panel of the target device, including:
[0017] Acquire image data of at least one switch button in the control panel of the target device through a camera;
[0018] Determine a switch parameter of the switch button according to the image data;
[0019] Accordingly, obtaining the target working state of the target device in the current operating state of the ship includes:
[0020] Obtain the proper switch status of the switch button of the target device in the current operating state of the ship.
[0021] Furthermore, the working status data of the target device is obtained through a camera pre-set in front of the control panel of the target device, including:
[0022] Acquire image data of at least one working status indicator light in the control panel of the target device through a camera;
[0023] Determine the real-time indication status indicated by the working status indicator light according to the image data;
[0024] Accordingly, obtaining the target working state of the target device in the current operating state of the ship includes:
[0025] Obtain the expected indication status of the working status indicator light of the target equipment under the current operating state of the ship.
[0026] Further, determining the real-time indication status indicated by the working status indicator light according to the image data includes:
[0027] Determine the current light and dark state and / or current color of the working status indicator light according to the image data;
[0028] According to the current light and dark state and / or the current color and a pre-acquired identification table of the working status indicator light, the real-time indication state indicated by the working status indicator light is identified.
[0029] Furthermore, before generating a control instruction to control the target device, the method further includes:
[0030] Identify whether the target device supports command control;
[0031] If supported, executing: generating a control instruction to control the target device;
[0032] If not supported, a notification message for manually controlling the target device is generated.
[0033] Furthermore, before obtaining the target working state of the target device in the current operating state of the ship, the method further includes:
[0034] Acquire the current image of the target device through a camera pre-set in front of the target device;
[0035] Determining a current operating state of the target device according to the current image;
[0036] After obtaining the target working state of the target equipment in the current operating state of the ship, the method further includes:
[0037] Identifying whether the current operating state matches the target operating state;
[0038] If they do not match, a control instruction is generated to control the target device to achieve the target working state.
[0039] In a second aspect, an embodiment of the present application provides a control device for a target device based on machine vision, the device comprising:
[0040] A working status data acquisition module, used to acquire working status data of a target device through a camera pre-set in front of a control panel of the target device;
[0041] A target working state acquisition module is used to acquire the target working state of the target equipment under the current operating state of the ship;
[0042] A working state identification module, used to identify whether the working state data is consistent with the target working state;
[0043] The target device control module is used to generate a control instruction to control the target device to achieve the target working state when the working state data does not match the target working state.
[0044] Furthermore, the working status data acquisition module includes:
[0045] A dashboard image data acquisition unit, used to acquire image data of at least one dashboard in a control panel of a target device through a camera;
[0046] a reading parameter determination unit, configured to determine a reading parameter of the instrument panel according to the image data;
[0047] Accordingly, the target working state acquisition module is specifically used for:
[0048] Obtain the expected reading of the instrument panel of the target equipment under the current operating state of the ship.
[0049] Furthermore, the working status data acquisition module includes:
[0050] A switch button image data acquisition unit, used to acquire image data of at least one switch button in a control panel of a target device through a camera;
[0051] A switch parameter determination unit, configured to determine a switch parameter of the switch button according to the image data;
[0052] Accordingly, the target working state acquisition module is specifically used for:
[0053] Obtain the proper switch status of the switch button of the target device in the current operating state of the ship.
[0054] Furthermore, the working status data acquisition module includes:
[0055] An indicator light image data acquisition unit, used to acquire image data of at least one working status indicator light in a control panel of a target device through a camera;
[0056] A real-time indication status determination unit, used to determine the real-time indication status indicated by the working status indicator light according to the image data;
[0057] Accordingly, the target working state acquisition module is specifically used for:
[0058] Obtain the expected indication status of the working status indicator light of the target equipment under the current operating state of the ship.
[0059] Furthermore, the real-time indication status determination unit is specifically used to:
[0060] Determine the current light and dark state and / or current color of the working status indicator light according to the image data;
[0061] According to the current light and dark state and / or the current color and a pre-acquired identification table of the working status indicator light, the real-time indication state indicated by the working status indicator light is identified.
[0062] Furthermore, the target device control module is specifically used to:
[0063] Identify whether the target device supports command control;
[0064] If supported, executing: generating a control instruction to control the target device;
[0065] If not supported, a notification message for manually controlling the target device is generated.
[0066] Furthermore, the target working state acquisition module is also used for:
[0067] Acquire the current image of the target device through a camera pre-set in front of the target device;
[0068] A current operating state of the target device is determined according to the current image.
[0069] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the method described in the first aspect.
[0070] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.
[0071] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.
[0072] In an embodiment of the present application, the working status data of the target device is obtained by a camera pre-set in front of the control panel of the target device; the target working status of the target device under the current operating state of the ship is obtained; it is identified whether the working status data is consistent with the target working status; if not, a control instruction is generated to control the target device to achieve the target working status. The above-mentioned control method of the target device based on machine vision solves the problem of insufficient timeliness and low control efficiency of the target device in the prior art. By obtaining the working status data and the target working status of the target device, it is identified whether the working status data is consistent with the target working status, and a control instruction is generated to control the target device in the case of inconsistency to achieve the target working status. The working status of the target device can be monitored in real time by the control or adjustment system, which solves the problem that the current control or adjustment system relies on manual implementation, improves the timeliness and efficiency of the control of the target device, and achieves the purpose of precise control of the target device. BRIEF DESCRIPTION OF THE DRAWINGS
[0073] Figure 1 It is a flowchart of a method for controlling a target device based on machine vision provided in Example 1 of the present application;
[0074] Figure 2 It is a flowchart of a method for controlling a target device based on machine vision provided in Embodiment 2 of the present application;
[0075] Figure 3 is a schematic diagram of the structure of a control device for a target device based on machine vision provided in Embodiment 3 of the present application;
[0076] Figure 4 It is a schematic diagram of the structure of the electronic device provided in Example 4 of the present application. DETAILED DESCRIPTION
[0077] In order to make the purpose, technical scheme and advantages of the present application clearer, the specific embodiments of the present application are further described in detail below in conjunction with the accompanying drawings. It is understood that the specific embodiments described herein are only used to explain the present application, rather than to limit the present application. It should also be noted that, for the convenience of description, only part of the present application is shown in the accompanying drawings, but not all of the content. Before discussing the exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flow charts. Although the flow chart describes each operation (or step) as a sequential process, many of the operations therein can be implemented in parallel, concurrently or simultaneously. In addition, the order of the operations can be rearranged. The process can be terminated when its operation is completed, but it can also have additional steps not included in the accompanying drawings. The process can correspond to a method, a function, a procedure, a subroutine, a subprogram, etc.
[0078] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.
[0079] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.
[0080] In conjunction with the accompanying drawings, the control method, device, equipment and medium of the target device based on machine vision provided by the embodiments of the present application are described in detail through specific embodiments and their application scenarios.
[0081] Embodiment 1
[0082] Figure 1 1 is a flow chart of a method for controlling a target device based on machine vision provided in the first embodiment of the present application. Figure 1 As shown, the specific steps include:
[0083] 1. A control method for a target device based on machine vision, characterized in that the method comprises:
[0084] S101, obtaining working status data of the target device through a camera pre-set in front of a control panel of the target device;
[0085] First, the use scenario of this solution can be to control the operating state of the target device so that the operating state of the target device reaches the target operating state. The target device can be a device on a ship. The working state data of the device and the target working state are obtained through a camera, and it is identified whether the working state data is consistent with the target working state. If they are not consistent, a control instruction is generated to control the target device to achieve the target working state. This can achieve the effect of real-time monitoring of the working state of the target device, and improve the timeliness and efficiency of the control of the target device.
[0086] Based on the above usage scenarios, it can be understood that the executor of this solution can be software or system platforms with image processing, data processing and encoding control capabilities installed on smart terminals such as mobile phones, computers and tablets, etc., and no excessive restrictions are made here.
[0087] The target device may be a device installed on a ship, and the operating status data of the device may be displayed or controlled by a ship control panel. The control panel may be a panel installed in a ship control room for displaying and controlling the operating status of the ship equipment. The operating status data may be the current actual operating status data of the target device, such as operating speed, operating power, and whether the operation is started. The operating status data may be displayed by the control panel.
[0088] In one embodiment, a camera may be pre-set in front of the control panel of the target device, and the current image of the control panel may be acquired through the camera, and then image analysis may be performed on the current image to acquire the working status data displayed on the control panel of the target device. Specifically, the control terminals of multiple different target devices may be integrated on the same or different control panels, and therefore, different cameras may be set for different control panels according to the image acquisition capability of the camera. The image acquisition capability of the camera may include an image acquisition range, etc.
[0089] S102, obtaining a target working state of the target equipment in the current operating state of the ship;
[0090] The target working state may be working state data that the target equipment should have under the current operating state of the ship.
[0091] In one embodiment, a comparison table of the ship's operating state and the target working state of each target device can be pre-built and stored in the ship control system. The comparison table is read by coding to obtain the target working state of the target device in the current operating state of the ship.
[0092] Based on the above embodiment, optionally, obtaining the working status data of the target device through a camera pre-set in front of the control panel of the target device includes:
[0093] Acquire image data of at least one instrument panel in the control panel of the target device through a camera;
[0094] determining a reading parameter of the instrument panel according to the image data;
[0095] Accordingly, obtaining the target working state of the target device in the current operating state of the ship includes:
[0096] Obtain the expected reading of the instrument panel of the target equipment under the current operating state of the ship.
[0097] The instrument panel may be an instrument for displaying the current operating status of the ship and the current working status data of a target device on the ship. The read parameters may be parameters displayed on the instrument panel, such as ship heading, rudder angle, and turning rate.
[0098] In one embodiment, the image data of at least one instrument panel in the control panel of the target device can be obtained through a camera, and then the display data of the instrument panel in the image data can be obtained by using image recognition technologies such as feature extraction and neural networks, that is, reading parameters. The reading parameters are the working status data of the target device corresponding to the instrument panel. According to the reading parameters, the current operating status of the target device can be determined. When the image data obtained by the camera contains only one instrument panel, the instrument panel should be a instrument panel that displays the working status of a certain target device.
[0099] In one embodiment, the current operating state of the ship can be obtained through the ship automatic identification system, and then the expected reading of the instrument panel of the target device of the ship in the current operating state can be obtained according to the comparison table of the operating state of the ship and the target working state of each target device. The expected operating state of the target device can be determined according to the expected reading.
[0100] In this solution, image data of at least one instrument panel in the control panel of the target device is obtained through a camera, and then the reading parameters of the instrument panel are determined according to the image data to obtain the working status data of the target device, and the target working status of the target device in the current operating state of the ship is obtained by obtaining the expected reading of the instrument panel of the target device in the current operating state of the ship. This can improve the intuitiveness and simplicity of obtaining the current working status data of the target device, and at the same time, improve the reliability and timeliness of obtaining the target working status.
[0101] Based on the above embodiment, optionally, obtaining the working status data of the target device through a camera pre-set in front of the control panel of the target device includes:
[0102] Acquire image data of at least one switch button in the control panel of the target device through a camera;
[0103] Determine a switch parameter of the switch button according to the image data;
[0104] Accordingly, obtaining the target working state of the target device in the current operating state of the ship includes:
[0105] Obtain the proper switch status of the switch button of the target device in the current operating state of the ship.
[0106] The switch button may be a button for controlling the target device to be turned on or started, or turned off or stopped, such as a ship generator switch, etc. The switch parameter may be a current working state parameter of the switch button, such as an open or closed state parameter.
[0107] In one embodiment, the image data of at least one switch button in the control panel of the target device can be obtained through a camera, and then the switch parameters of the switch button in the image data can be obtained by using image recognition technologies such as feature extraction and neural networks, for example, identifying the toggle position or open / closed state of the switch button. The switch state is the working state data of the target device corresponding to the switch button. According to the switch state, it can be determined whether the target device is currently connected or started.
[0108] In one embodiment, the current operating state of the ship can be obtained through the ship automatic identification system, and then the expected switch state of the switch button of the target device in the current operating state of the ship can be obtained according to the comparison table of the operating state of the ship and the target working state of each target device. According to the expected switch state, the current connection or startup state of the target device can be determined.
[0109] In this scheme, image data of at least one switch button in the control panel of the target device is obtained through a camera, and then the switch parameters of the switch button are determined according to the image data to obtain the working status data of the target device, and the target working status of the target device is obtained by obtaining the expected switch status of the switch button of the target device under the current operating state of the ship, thereby improving the efficiency and reliability of obtaining the current working status of the target device and the target working status.
[0110] Based on the above embodiment, optionally, obtaining the working status data of the target device through a camera pre-set in front of the control panel of the target device includes:
[0111] Acquire image data of at least one working status indicator light in the control panel of the target device through a camera;
[0112] Determine the real-time indication status indicated by the working status indicator light according to the image data;
[0113] Accordingly, obtaining the target working state of the target device in the current operating state of the ship includes:
[0114] Obtain the expected indication status of the working status indicator light of the target equipment under the current operating state of the ship.
[0115] The working status indicator light may be an indicator light for indicating the current working status of the target device. The working status indicator light may be used to indicate whether the target device is currently operating normally, and may also be used to indicate whether the target device is currently connected or started, etc., which are not limited here. The real-time indication status may be the current working status data of the target device corresponding to the working status indicator light, for example: whether the target device is currently operating normally, etc.
[0116] In one embodiment, the image data of at least one working status indicator light in the control panel of the target device can be obtained through a camera, and then the color, brightness, grayscale value, etc. of the working status indicator light in the image data can be obtained by using image recognition technologies such as feature extraction and neural networks, and then the real-time indication state indicated by the working status indicator light can be determined based on the recognition result of the image data. The real-time indication state is the working status data of the target device corresponding to the working status indicator light. According to the real-time indication state, it can be determined whether the target device is currently operating normally.
[0117] In one embodiment, the current operating state of the ship can be obtained through the ship automatic identification system, and then the expected indication state of the working state indicator of the target device of the ship under the current operating state can be obtained according to the comparison table of the operating state of the ship and the target working state of each target device. According to the expected indication state, it can be determined whether the target device must be connected at present.
[0118] In this solution, image data of at least one working status indicator light in the control panel of the target device is obtained through a camera, and then the real-time indication status indicated by the working status indicator light is determined based on the image data to obtain the working status data of the target device. By obtaining the expected indication status of the working status indicator light of the target device in the current operating state of the ship, the target working state of the target device in the current operating state of the ship is obtained, which can improve the timeliness and reliability of monitoring the current working state of the target device, and at the same time, improve the reliability of obtaining the target working state of the target device.
[0119] Based on the above embodiment, optionally, determining the real-time indication state indicated by the working status indicator light according to the image data includes:
[0120] Determine the current light and dark state and / or current color of the working status indicator light according to the image data;
[0121] According to the current light and dark state and / or the current color and a pre-acquired identification table of the working status indicator light, the real-time indication state indicated by the working status indicator light is identified.
[0122] The current light and dark state of the working status indicator light may be a state where the indicator light is on or off, or a state where the indicator light alternates between on and off at a certain frequency.
[0123] In one embodiment, the working status indicator light can indicate the working status of the target device in a light or dark state, or in different colors. The color image data of the working status indicator light can be obtained by the camera, and then the current light or dark state and / or current color of the working status indicator light can be determined according to the color image data; the grayscale image data of the working status indicator light can also be obtained by the camera, and then the current light or dark state of the working status indicator light can be determined according to the grayscale image data. According to the current light or dark state and / or current color and the identification table of the working status indicator light obtained in advance, the real-time indication state indicated by the working status indicator light can be identified. Specifically, according to the corresponding relationship between the light or dark state and / or color of the working status indicator light and the operating state of the target device, the identification table of the working status indicator light can be constructed, and the identification table can be stored in the ship control system, and then according to the current light or dark state and / or current color of the working status indicator light, the real-time indication state indicated by the working status indicator light can be identified.
[0124] This solution determines the current light and dark state and / or current color of the working status indicator light based on the image data, and then identifies the real-time indication state indicated by the working status indicator light based on the current light and dark state and / or current color and a pre-acquired identification table of the working status indicator light, thereby improving the efficiency and reliability of obtaining the real-time indication state.
[0125] S103, identifying whether the working status data is consistent with the target working status;
[0126] In one embodiment, the working status data of the target device can be written into a pre-constructed comparison table of the ship's operating status and the target working status of each target device based on the number or identity information of the target device, and then the working status data can be compared with the target working status based on the comparison table to identify whether the working status data is consistent with the target working status.
[0127] S104: If not, generate a control instruction to control the target device to achieve the target working state.
[0128] In one embodiment, if it is identified that the working status data does not match the target working status, a control instruction is generated for the target device according to the working parameters and status of the target device corresponding to the target working status, and the target device is controlled according to the parameters in the control instruction to change the working status of the target device so that the working status data reaches the target working status.
[0129] Based on the above embodiment, optionally, before generating a control instruction to control the target device, the method further includes:
[0130] Identify whether the target device supports command control;
[0131] If supported, executing: generating a control instruction to control the target device;
[0132] If not supported, a notification message for manually controlling the target device is generated.
[0133] In one embodiment, it is possible to identify whether the target device supports command control based on the location, configuration, characteristics, and overall advancement of the target device, and it is also possible to identify whether the target device supports command control based on whether the identity information of the target device is written into the communication control system. For example, if the target device is an air-conditioning refrigeration device, which is installed inside the cabin, and the switch control of the device is connected to the ship control system, then the target device supports command control. If the target device supports command control, the operation of generating a control command and controlling the target device is executed; if the target device does not support command control, notification information for manually controlling the target device is generated based on the target working state.
[0134] This solution, before generating a control instruction to control the target device, identifies whether the target device supports instruction control. If it does, it generates a control instruction to control the target device. If it does not, it generates notification information for manual control of the target device, which can improve the accuracy and reliability of the control of the target device.
[0135] The technical solution provided in the embodiment of the present application obtains the working status data of the target device through a camera pre-set in front of the control panel of the target device; obtains the target working status of the target device under the current operating state of the ship; identifies whether the working status data matches the target working status; if not, generates a control instruction to control the target device to achieve the target working status. The above-mentioned control method of the target device based on machine vision solves the problems of insufficient timeliness and low control efficiency of the target device in the prior art. By obtaining the working status data and the target working status of the target device, identifying whether the working status data matches the target working status, and generating a control instruction to control the target device in the case of mismatch, the target working status can be achieved. The working status of the target device can be monitored in real time through the control or regulation system, solving the problem that the current control or regulation system relies on manual implementation, improving the timeliness and efficiency of the control of the target device, and achieving the purpose of precise control of the target device.
[0136] Embodiment 2
[0137] Figure 2 : is a flow chart of a method for controlling a target device based on machine vision provided in the second embodiment of the present application. Figure 2 As shown, the specific steps include:
[0138] S201, acquiring a current image of the target device through a camera pre-set in front of the target device;
[0139] The current image may be an actual image of the target device, such as an image of a ship's shutters.
[0140] In one embodiment, when the operating status of the target device cannot be displayed or controlled through the ship control panel, a camera can be pre-set in front of the target device, and the current image of the target device can be directly acquired through the camera.
[0141] S202, determining a current operating state of the target device according to the current image;
[0142] The current operating state may be the current state of the target device, such as the open state or closed state of a blind.
[0143] In one embodiment, the current image may be recognized using image recognition technology to obtain the current operating status of the target device.
[0144] S203, obtaining the target working state of the target equipment in the current operating state of the ship;
[0145] In one embodiment, a comparison table between the ship's operating state and the target working state of each target device can be pre-constructed, and the comparison table can be stored in the ship control system. The target working state can be the state that the target device should be in, and the target working state can be expressed in the form of text, numbers or codes. The comparison table is read through the code to obtain the target working state of the target device in the current operating state of the ship.
[0146] S204, identifying whether the current operating state is consistent with the target operating state;
[0147] In one embodiment, after determining the current operating status of the target device, the current operating status can be reported to the control system of the ship in a form consistent with the target working status or written into the comparison table to compare the current operating status of the target device with the target working status, thereby determining whether the current operating status is consistent with the target working status.
[0148] S205: If not, generate a control instruction to control the target device to achieve the target working state.
[0149] In one embodiment, if the current operating state does not match the target working state, a control instruction for controlling the target device is generated according to the target working state, and the working state of the target device is changed using the control instruction so that the current operating state reaches the target working state.
[0150] The technical solution provided in the embodiment of the present application obtains the current image of the target device through a camera pre-set in front of the target device; determines the current operating state of the target device based on the current image; obtains the target working state of the target device when the ship is in the current operating state; identifies whether the current operating state matches the target working state; if not, generates a control instruction to control the target device to achieve the target working state. The above-mentioned machine vision-based target device control method can achieve the purpose of real-time monitoring and operating state control of target devices that cannot be displayed or controlled by the control panel, expands the scope of application of target device operating state control, and further improves the timeliness and reliability of target device monitoring and control.
[0151] Embodiment 3
[0152] Figure 3 Schematic diagram of the structure of the control device of the target device based on machine vision provided in the third embodiment of the present application. Figure 3 As shown, specifically including the following:
[0153] A working status data acquisition module 301 is used to acquire working status data of a target device through a camera pre-set in front of a control panel of the target device;
[0154] The target working state acquisition module 302 is used to acquire the target working state of the target equipment in the current operating state of the ship;
[0155] A working state identification module 303 is used to identify whether the working state data is consistent with the target working state;
[0156] The target device control module 304 is used to generate a control instruction to control the target device to achieve the target working state when the working state data does not match the target working state.
[0157] Furthermore, the working status data acquisition module 301 includes:
[0158] A dashboard image data acquisition unit, used to acquire image data of at least one dashboard in a control panel of a target device through a camera;
[0159] a reading parameter determination unit, configured to determine a reading parameter of the instrument panel according to the image data;
[0160] Accordingly, the target working state acquisition module 302 is specifically used for:
[0161] Obtain the expected reading of the instrument panel of the target equipment under the current operating state of the ship.
[0162] Furthermore, the working status data acquisition module 301 includes:
[0163] A switch button image data acquisition unit, used to acquire image data of at least one switch button in a control panel of a target device through a camera;
[0164] A switch parameter determination unit, configured to determine a switch parameter of the switch button according to the image data;
[0165] Accordingly, the target working state acquisition module 302 is specifically used for:
[0166] Obtain the proper switch status of the switch button of the target device in the current operating state of the ship.
[0167] Furthermore, the working status data acquisition module 301 includes:
[0168] An indicator light image data acquisition unit, used to acquire image data of at least one working status indicator light in a control panel of a target device through a camera;
[0169] A real-time indication status determination unit, used to determine the real-time indication status indicated by the working status indicator light according to the image data;
[0170] Accordingly, the target working state acquisition module 302 is specifically used for:
[0171] Obtain the expected indication status of the working status indicator light of the target equipment under the current operating state of the ship.
[0172] Furthermore, the real-time indication status determination unit is specifically used to:
[0173] Determine the current light and dark state and / or current color of the working status indicator light according to the image data;
[0174] According to the current light and dark state and / or the current color and a pre-acquired identification table of the working status indicator light, the real-time indication state indicated by the working status indicator light is identified.
[0175] Furthermore, the target device control module 304 is specifically used to:
[0176] Identify whether the target device supports command control;
[0177] If supported, executing: generating a control instruction to control the target device;
[0178] If not supported, a notification message for manually controlling the target device is generated.
[0179] Furthermore, the target working state acquisition module 302 is also used for:
[0180] Acquire the current image of the target device through a camera pre-set in front of the target device;
[0181] A current operating state of the target device is determined according to the current image.
[0182] The technical solution provided in the embodiment of the present application includes a working state data acquisition module, which is used to acquire the working state data of the target device through a camera pre-set in front of the control panel of the target device; a target working state acquisition module, which is used to acquire the target working state of the target device under the current operating state of the ship; a working state identification module, which is used to identify whether the working state data is consistent with the target working state; and a target device control module, which is used to generate a control instruction to control the target device to achieve the target working state when the working state data is inconsistent with the target working state. Through the above-mentioned control method of the target device based on machine vision, the problem of insufficient timeliness and low control efficiency of the target device in the prior art is solved. By acquiring the working state data and the target working state of the target device, it is identified whether the working state data is consistent with the target working state, and when it is inconsistent, a control instruction is generated to control the target device to achieve the target working state. The effect of real-time monitoring of the working state of the target device can be achieved through the control or regulation system, which solves the problem that the current control or regulation system relies on manual implementation, improves the timeliness and efficiency of the control of the target device, and achieves the purpose of precise control of the target device.
[0183] The control device of the target device based on machine vision in the embodiment of the present application can be a device, or a component, integrated circuit, or chip in a terminal. The device can be a mobile electronic device or a non-mobile electronic device. Exemplarily, the mobile electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc. The non-mobile electronic device can be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.
[0184] The control device of the target device based on machine vision in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.
[0185] The control device of the target device based on machine vision provided in the embodiment of the present application can implement each process implemented in the above-mentioned method embodiments, and will not be described again here to avoid repetition.
[0186] Embodiment 4
[0187] like Figure 4 As shown, an embodiment of the present application also provides an electronic device 400, including a processor 401, a memory 402, and a program or instruction stored in the memory 402 and executable on the processor 401. When the program or instruction is executed by the processor 401, each process of the control device embodiment of the above-mentioned machine vision-based target device is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0188] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.
[0189] Embodiment 5
[0190] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned control device embodiment of the target device based on machine vision is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0191] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.
[0192] Embodiment 6
[0193] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned control device embodiment of the target device based on machine vision, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0194] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.
[0195] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.
[0196] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for enabling a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.
[0197] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.
[0198] The above are only preferred embodiments of the present application and the technical principles used. The present application is not limited to the specific embodiments described herein, and various obvious changes, readjustments and substitutions that can be made by those skilled in the art will not deviate from the scope of protection of the present application. Therefore, although the present application is described in more detail through the above embodiments, the present application is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present application, and the scope of the present application is determined by the scope of the claims.
Claims
1. A control method for a target device based on machine vision, characterized in that: The method comprises: Acquiring working status data of the target device through a camera pre-set in front of a control panel of the target device, wherein the working status data is displayed through the control panel; Obtaining the target working state of the target device in the current operating state of the ship, which includes: reading a pre-constructed comparison table of the operating state of the ship and the target working state of the target device, and obtaining the target working state of the target device in the current operating state of the ship based on the comparison table; Identifying whether the working state data is consistent with the target working state; If not, identify whether the target device supports command control. If so, generate a control command to control the target device. If not, generate notification information for manual control of the target device to achieve the target working state.
2. The control method of the target device based on machine vision according to claim 1, characterized in that: The working status data of the target device is obtained through a camera pre-set in front of the control panel of the target device, including: Acquire image data of at least one instrument panel in the control panel of the target device through a camera; determining a reading parameter of the instrument panel according to the image data; Accordingly, obtaining the target working state of the target device in the current operating state of the ship includes: Obtain the expected reading of the instrument panel of the target equipment under the current operating state of the ship.
3. The control method of the target device based on machine vision according to claim 1, characterized in that: The working status data of the target device is obtained through a camera pre-set in front of the control panel of the target device, including: Acquire image data of at least one switch button in the control panel of the target device through a camera; Determine a switch parameter of the switch button according to the image data; Accordingly, obtaining the target working state of the target device in the current operating state of the ship includes: Obtain the proper switch status of the switch button of the target device in the current operating state of the ship.
4. The control method of the target device based on machine vision according to claim 1, characterized in that: The working status data of the target device is obtained through a camera pre-set in front of the control panel of the target device, including: Acquire image data of at least one working status indicator light in the control panel of the target device through a camera; Determine the real-time indication status indicated by the working status indicator light according to the image data; Accordingly, obtaining the target working state of the target device in the current operating state of the ship includes: Obtain the expected indication status of the working status indicator light of the target equipment under the current operating state of the ship.
5. The control method of the target device based on machine vision according to claim 4, characterized in that: Determining the real-time indication status indicated by the working status indicator light according to the image data includes: Determine the current light and dark state and / or current color of the working status indicator light according to the image data; According to the current light and dark state and / or the current color and a pre-acquired identification table of the working status indicator light, the real-time indication state indicated by the working status indicator light is identified.
6. The control method of the target device based on machine vision according to claim 1, characterized in that: Before obtaining the target working state of the target equipment in the current operating state of the ship, the method further includes: Acquire the current image of the target device through a camera pre-set in front of the target device; Determining a current operating state of the target device according to the current image; After obtaining the target working state of the target equipment in the current operating state of the ship, the method further includes: Identifying whether the current operating state is consistent with the target operating state; If they do not match, a control instruction is generated to control the target device to achieve the target working state.
7. A control device for a target device based on machine vision, characterized in that: The device comprises: A working status data acquisition module, used to acquire working status data of a target device through a camera pre-set in front of a control panel of the target device, wherein the working status data is displayed through the control panel; The target working state acquisition module is used to acquire the target working state of the target device in the current operating state of the ship, which includes: reading a pre-constructed comparison table of the operating state of the ship and the target working state of the target device, and acquiring the target working state of the target device in the current operating state of the ship based on the comparison table; A working state identification module, used to identify whether the working state data is consistent with the target working state; The target device control module is used to identify whether the target device supports instruction control when the working status data does not match the target working status. If it does, it executes: generating a control instruction to control the target device; if it does not, it generates notification information for manual control of the target device to achieve the target working status.
8. An electronic device, characterized in that: It includes a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein when the program or instruction is executed by the processor, the steps of the control method of a target device based on machine vision as described in any one of claims 1 to 6 are implemented.
9. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by the processor, the steps of the control method of the target device based on machine vision as described in any one of claims 1 to 6 are implemented.
