Guidance operation control method and system, computer equipment and storage medium

Abstract

The invention discloses a guide operation control method and system, computer equipment and a storage medium, and relates to the field of production operation, and the method comprises the steps: obtaining the path information of a to-be-processed action according to the to-be-processed action of a to-be-processed product; making a light spot playing program based on the path information, so as to lighten the current operation position of the to-be-processed product according to the position coordinates in the path information through the light spot playing program; extracting an operation image of the current operation step of the to-be-processed product, and performing feature comparison on the operation image and a preset image; and in response to the condition that a feature comparison result meets a preset condition, obtaining a next operation step in the path information, and lightening an operation position of the next operation step through a light spot playing program. According to the method, the operation steps in the production line are controlled through strict control logic, so that the problem of misjudgment caused by human visual judgment is solved, and the timeliness and accuracy of the control method are improved.

Description

Technical Field

[0001] The present application relates to the technical field of production operations, and specifically to a method, system, computer equipment and storage medium for guiding operation control. Background Art

[0002] At present, in order to improve their customized production and efficiency advantages in the production and manufacturing process, enterprises usually adopt the Cell production model in factories. A Cell production line produces a large number of product types, so the skill requirements for operators on the Cell production line are high. It takes more than three months of skill training and practice to obtain qualified assembly operators.

[0003] In the process of production using the above production line, the production process is observed and controlled by operators. However, during the manual control process, operating steps or operating standards may be forgotten, so operations may be missed, affecting product quality. In addition, the production process of the above production line may be misjudged due to human observation through manual control. Summary of the invention

[0004] In order to solve at least one of the problems mentioned in the above background technology, the present application provides a guiding operation control method, system, computer equipment and storage medium. The control method in the present application reduces the possible operation omissions caused by human operation, thereby improving the quality of the produced products. The operation steps in the production line are controlled through strict control logic to solve the problem of misjudgment caused by human visual judgment, thereby improving the timeliness and accuracy of the control method in the present application.

[0005] The specific technical solutions provided by the embodiments of this application are as follows:

[0006] In a first aspect, a guidance operation control method is provided, the method comprising:

[0007] According to the to-be-processed action performed by the to-be-processed product, path information of the to-be-processed action is obtained;

[0008] Creating a light spot playback program based on the path information, so as to illuminate the current working position of the product to be processed according to the position coordinates in the path information through the light spot playback program;

[0009] Extracting a working image of a current working step of the product to be processed, and setting the working image to perform feature comparison with a preset image;

[0010] In response to the feature comparison result satisfying the preset condition, the next operation step in the path information is obtained, and the operation position of the next operation step is illuminated by a light spot playback program.

[0011] In a specific embodiment, the action to be processed includes one or more sub-actions, and the method further includes:

[0012] All sub-actions in the to-be-processed action are obtained, and the operation position coordinates of all the sub-actions are obtained, and the operation position coordinates are arranged in operation order to form path information.

[0013] In a specific embodiment, it also includes an automatic processing component;

[0014] In response to the current working position of the product to be processed being illuminated, the automatic processing component is moved to the current working position according to the coordinates of the current working position; so as to realize the screwing operation on the current working position of the product to be processed by the automatic processing component.

[0015] In a specific embodiment, the method also includes: in response to starting a job, lighting up the initial working position of the product to be processed through a light spot player program; determining whether there is a screwing and attaching operation in the path information of the product to be processed; if there is a screwing and attaching operation, performing feature comparison and screwing and attaching operation detection in combination with the job image and a preset image; or, if there is no screwing and attaching operation, performing feature comparison between the job image and the preset image.

[0016] In a specific embodiment, the setting of the feature comparison between the operation image and the preset image specifically includes: regularly intercepting the operation image of the current operation step of the product to be processed according to the operation sequence; forming an image array with the intercepted operation images of the current operation step of the product to be processed, and extracting feature points of the image array; obtaining preset feature points of the preset image, and performing similarity comparison between the feature points of the image array and the preset feature points; in response to the similarity between the feature points of the image array and the preset feature points being not less than a preset threshold, confirming that the feature comparison result meets the preset condition;

[0017] Executing the screwing and attaching operation detection specifically includes: confirming that the screwing and attaching operation of the automatic processing component on the current working position of the product to be processed is completed, and sending a passing signal to the light spot playback program;

[0018] In response to confirming that the feature comparison result meets the preset condition and / or receiving the pass signal, the light spot playback program lights up the operation position of the next operation step.

[0019] In a specific embodiment, confirming that the screwing and attaching operation of the automatic processing component on the current working position of the product to be processed is completed specifically includes: detecting the actual position coordinates and actual torque of the automatic processing component when performing the screwing and attaching operation; analyzing the actual position coordinates with the preset coordinates, and comparing the actual torque with the preset torque; if the difference between the actual position coordinates and the preset coordinates satisfies the first preset difference, and the difference between the actual torque and the preset torque satisfies the second preset difference, confirming that the screwing and attaching operation of the current working position is completed.

[0020] In a specific embodiment, after obtaining all the sub-actions in the action to be processed, the method further includes: obtaining the screwing and attaching action in the sub-action, and arranging the screwing and attaching actions according to the operation sequence in the path information to make an action program; in response to the current operation position of the product to be processed being lit up, controlling the automatic processing component to perform the screwing and attaching operation on the product to be processed through the action program.

[0021] In a second aspect, a guidance operation control system is provided, for implementing the guidance operation control method as described above, the system comprising:

[0022] An acquisition unit, configured to acquire path information of a processing action of the product to be processed according to a processing action performed on the product to be processed;

[0023] A first execution unit is used to create a light spot playback program based on the path information, so as to illuminate the current operation position of the product to be processed according to the position coordinates in the path information through the light spot playback program;

[0024] An analysis unit, used for extracting a working image of a current working step of the product to be processed, and setting the working image to perform feature comparison with a preset image;

[0025] The second execution unit is used for obtaining the next operation step in the path information in response to the feature comparison result satisfying the preset condition, and lighting up the operation position of the next operation step through the light spot playback program.

[0026] In a third aspect, a computer device is provided, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the following steps are implemented:

[0027] Step A: acquiring path information of the to-be-processed action according to the to-be-processed action performed by the to-be-processed product;

[0028] Step B: creating a light spot playback program based on the path information, so as to illuminate the current working position of the product to be processed according to the position coordinates in the path information through the light spot playback program;

[0029] Step C: extracting the operation image of the current operation step of the product to be processed, and setting the operation image to perform feature comparison with a preset image;

[0030] Step D: In response to the feature comparison result satisfying the preset condition, the next operation step in the path information is obtained, and the operation position of the next operation step is illuminated by the light spot playback program.

[0031] In a fourth aspect, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:

[0032] Step A: acquiring path information of the to-be-processed action according to the to-be-processed action performed by the to-be-processed product;

[0033] Step B: creating a light spot playback program based on the path information, so as to illuminate the current working position of the product to be processed according to the position coordinates in the path information through the light spot playback program;

[0034] Step C: extracting the operation image of the current operation step of the product to be processed, and setting the operation image to perform feature comparison with a preset image;

[0035] Step D: In response to the feature comparison result satisfying the preset condition, the next operation step in the path information is obtained, and the operation position of the next operation step is illuminated by the light spot playback program.

[0036] The embodiments of the present application have the following beneficial effects:

[0037] 1. The solution provided in the embodiment of the present application first obtains the path information of the product to be processed, wherein the path information includes the position coordinates of the processing action on the product to be processed. When the product to be processed is processed, the current working position of the product to be processed is illuminated according to the position coordinates in the path information through the light spot playback program, the working image of the current working step of the product to be processed is extracted, the working image features are compared with the preset image, and it is confirmed that the feature comparison result meets the preset conditions, and the next working step in the path information is obtained to light up the working position of the next working step through the light spot playback program. The control method in this embodiment reduces the possible omission of operations caused by human operations, thereby improving the quality of the products produced, and controls the working steps in the production line through strict control logic to solve the problem of misjudgment in human visual judgment, thereby improving the timeliness and accuracy of the control method in this application. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0039] Figure 1 A schematic diagram showing an application architecture according to the present application;

[0040] Figure 2 A schematic diagram showing a method for controlling a guided operation according to the present application;

[0041] Figure 3 A schematic diagram showing a specific process after the startup operation according to the present application;

[0042] Figure 4 A schematic diagram showing a guidance operation control system according to the present application;

[0043] Figure 5 A schematic diagram showing a computer device according to the present application. DETAILED DESCRIPTION

[0044] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0045] The guidance operation control method provided in this application can be applied to Figure 1 In the application environment shown. Among them, the terminal 102 communicates with the server 104 through the network. The server obtains the path information of the to-be-processed action according to the to-be-processed action of the to-be-processed product, and the terminal sequentially lights up the current operation position of the to-be-processed product according to the path information, compares the characteristics of the operation image of the current operation with the preset image to confirm that the current operation step is completed, and lights up the operation position of the next operation step through the light spot player. Among them, the terminal 102 can be but not limited to various personal computers, laptops, smart phones, tablet computers and portable wearable devices, and the server 104 can be implemented by an independent server or a server cluster composed of multiple servers.

[0046] In one embodiment, Figure 2 As shown, a method for guiding operation control is provided, which is applied to Figure 1 The terminal in is used as an example to illustrate, including the following steps:

[0047] Step 101: Acquire path information of the processing action according to the processing action of the product to be processed.

[0048] It should be noted that the action to be processed includes one or more sub-tasks, all sub-tasks in the action to be processed for the product to be processed are obtained, and the operation position coordinates of all sub-tasks are obtained, and the operation position coordinates are arranged in the operation sequence to form path information. The corresponding coordinates and positions in the operation steps for the product to be processed are obtained, and the coordinates and positions therein are recorded, and the path information is formed in the operation sequence.

[0049] Furthermore, it also includes establishing an operation instruction book, wherein the content of the operation instruction book is derived from a paper operation instruction book, and the paper operation instruction book is constructed into an animated operation instruction book, wherein the operation instruction book includes the operation points and operation standards of each sub-action, and the sub-actions are arranged in sequence according to the operation sequence to form an operation instruction book, and the operation instruction book can be presented in a visual position for the staff, so that the staff can judge whether the operation steps for the product to be processed are completed according to the operation points and operation standards in the operation instruction book.

[0050] Step 102: Create a light spot playback program based on the path information, so as to illuminate the current working position of the product to be processed according to the position coordinates in the path information through the light spot playback program.

[0051] The path information includes the working coordinates and the moving path. The coordinates of the working position are obtained to generate a guiding light spot path array. A light spot playback program of the projector is made according to the path array. When the product to be processed is processed, the current working position of the product to be processed is illuminated by the light spot playback program according to the position coordinates in the path information.

[0052] This embodiment includes a visual inspection component, a micro-projector and a host computer, wherein the visual inspection component is used to record the operation process of the product to be processed for visual inspection; by setting up a micro-projector above the work station, the micro-projector is communicated with the host computer, and the micro-projector is communicated with the light spot player program to send signals to the host computer through the micro-projector.

[0053] In a specific embodiment, it also includes an automatic processing component, which is specifically configured as an electric screwdriver, wherein the electric screwdriver is configured to be connected to a force arm to drive the electric screwdriver to move to a corresponding position through the force arm, and in response to the current working position of the product to be processed being lit up, the automatic processing component is moved to the current working position according to the coordinates of the current working position; so as to realize the screwing operation on the current working position of the product to be processed by the automatic processing component.

[0054] While the current working position of the product to be processed is lit up, the host computer sends a control signal to the work instruction to control the work instruction to switch to the guidance animation page of the current working position, and presents the guidance animation page of the current working position to the staff, so as to realize isomorphic manual detection of the working status of the product to be processed.

[0055] Step 103: extracting the operation image of the current operation step of the product to be processed, and setting the operation image to perform feature comparison with a preset image.

[0056] Step 104 , in response to the feature comparison result satisfying a preset condition, obtaining the next operation step in the path information, and lighting up the operation position of the next operation step through a light spot player program.

[0057] like Figure 3 As shown, it also includes responding to the start-up operation, lighting up the initial operation position of the product to be processed through a light spot player program; judging whether there is a screwing operation in the path information of the product to be processed; if there is a screwing operation, combining the operation image with the preset image to perform feature comparison and screwing operation detection; or, if there is no screwing operation, performing feature comparison between the operation image and the preset image.

[0058] The step of setting the operation image to perform feature comparison with a preset image specifically includes:

[0059] The operating images of the current operating step of the product to be processed are captured periodically according to the operating sequence; the captured operating images of the current operating step of the product to be processed are combined into an image array, and feature points of the image array are extracted; the preset feature points of the preset image are acquired, and the feature points of the image array are compared with the preset feature points for similarity; in response to the similarity between the feature points of the image array and the preset feature points being not less than a preset threshold, it is confirmed that the feature comparison result meets the preset condition.

[0060] In the actual inspection process, the visual inspection component takes a photo of the processing action of the product to be processed, and then compares the photographed photo with the preset image for feature points. For example, the feature points to be compared are set to 3, the preset threshold is set to 90%, and the intercepted image is compared with the preset image for similarity. The similarity of the comparison result is 95%, which is greater than the preset threshold. Therefore, it is confirmed that the feature comparison result meets the preset conditions. In order to further improve the monitoring accuracy of the operation process, when the operation action includes the screwing action, the screwing operation is detected to confirm whether to proceed to the next operation.

[0061] Executing the screwing and attaching operation detection specifically includes: confirming that the screwing and attaching operation of the automatic processing component on the current working position of the product to be processed is completed, and sending a pass signal to the light spot player program; in response to confirming that the feature comparison result meets the preset conditions, and / or receiving the pass signal, the light spot player program lights up the working position of the next working step.

[0062] It should be noted that after obtaining all the sub-actions in the action to be processed, the screwing and attaching action in the sub-action is obtained, and the screwing and attaching actions are arranged according to the operation sequence in the path information to make an action program; in response to the current operation position of the product to be processed being lit up, the automatic processing component is controlled by the action program to perform the screwing and attaching operation on the product to be processed.

[0063] In a specific embodiment, confirming that the screwing and attaching operation of the automatic processing component on the current working position of the product to be processed is completed specifically includes: detecting the actual position coordinates and actual torque of the automatic processing component when performing the screwing and attaching operation; analyzing the actual position coordinates with the preset coordinates, and comparing the actual torque with the preset torque; if the difference between the actual position coordinates and the preset coordinates satisfies the first preset difference, and the difference between the actual torque and the preset torque satisfies the second preset difference, confirming that the screwing and attaching operation of the current working position is completed.

[0064] If only visual inspection exists in the current operation step, whether to proceed to the next step is determined only by setting the operation image to perform feature comparison with the preset image. When it is confirmed that the feature comparison result meets the preset conditions, the visual inspection pass signal is sent to the host computer, and the signal is transmitted to the operation instruction through the host computer, and the operation instruction is controlled to switch to the guidance animation page corresponding to the next operation step.

[0065] It should be noted that if the feature comparison result between the operation image and the preset image fails, that is, the feature comparison result does not meet the preset conditions, the staff will determine that the guidance animation page of the operation instruction has been completed, and adjust the locking button of the electric screwdriver for more than 1S, and detect that the actual torque of the electric screwdriver is equal to the preset torque. At this time, the electric screwdriver sends a signal to the host computer, so that the host computer transmits the signal to the operation instruction and the micro projector to switch the next operation signal.

[0066] For example, if it is determined that the instruction animation page of the operating instruction is not completed, the staff adjusts the button of the electric screwdriver to the exit position and presses it for more than 1 second. When it is detected that the torque of the electric screwdriver is equal to the exit initial gear, the electric screwdriver sends a signal to the host computer, which sends the signal to the operating instruction and the micro projector through the host computer to switch the next operation signal.

[0067] If both visual inspection and screwing operation inspection are present in this embodiment, it is necessary to further confirm whether to proceed to the next operation step based on the combined inspection results of the two. Exemplarily, the actual coordinate position of the automatic processing component when performing the screwing operation is obtained as "X, Y, Z", and it is confirmed that the coordinate value X satisfies "98% X≤X≤102% X", the coordinate value Y satisfies "98% Y≤Y≤102% Y", and the coordinate value Z satisfies "98% Z≤Z≤102% Z", and the actual torque of the current operation position is obtained, which satisfies "standard torque 95%≤actual torque≤standard torque 105%", and it is confirmed that the similarity of the three feature points is greater than 50%, thereby confirming that the screwing operation of the current operation position is completed.

[0068] The control method in this application can reduce possible omissions in operations caused by human operations, thereby improving the quality of produced products. The operating steps in the production line are controlled through strict control logic to solve the problem of misjudgment caused by human visual judgment, thereby improving the timeliness and accuracy of the control method in this application.

[0069] It should be understood that although Figure 2 and Figure 3 The steps in the flowchart are shown in sequence as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified in this document, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. Moreover, Figure 2 and Figure 3 At least part of the steps may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed in turn or alternately with other steps or at least part of the sub-steps or stages of other steps.

[0070] In one embodiment, Figure 4 As shown, a guidance operation control system is provided, which is used to implement the guidance operation control method as described above, and the system includes:

[0071] An acquisition unit, configured to acquire path information of a processing action of the product to be processed according to a processing action performed on the product to be processed;

[0072] A first execution unit is used to create a light spot playback program based on the path information, so as to illuminate the current operation position of the product to be processed according to the position coordinates in the path information through the light spot playback program;

[0073] An analysis unit, used for extracting an operation image of a current operation step of the product to be processed, and performing feature comparison between the operation image and a preset image;

[0074] The second execution unit is used for obtaining the next operation step in the path information in response to the feature comparison result satisfying the preset condition, and lighting up the operation position of the next operation step through the light spot playback program.

[0075] In a specific embodiment, the action to be processed includes one or more sub-actions, and the acquisition unit is also used to acquire all sub-actions in the action to be processed, and acquire the work position coordinates of all the sub-actions, and arrange the work position coordinates in the work order to form path information.

[0076] In a specific embodiment, the first execution unit is also used to move the automatic processing component to the current working position according to the coordinates of the current working position in response to the current working position of the product to be processed being lit up; so as to realize the screwing operation of the current working position of the product to be processed by the automatic processing component.

[0077] In a specific embodiment, the analysis unit is used to respond to the start of the operation, illuminate the initial operation position of the product to be processed through a light spot player program; determine whether there is a screwing and attaching operation in the path information of the product to be processed; if there is a screwing and attaching operation, perform feature comparison and screwing and attaching operation detection in combination with the operation image and a preset image; or, if there is no screwing and attaching operation, perform feature comparison between the operation image and the preset image.

[0078] In a specific embodiment, the analysis unit is also used to periodically capture the operating images of the current operating step of the product to be processed according to the operating sequence; organize the captured operating images of the current operating step of the product to be processed into an image array, and extract the feature points of the image array; obtain the preset feature points of the preset image, and compare the feature points of the image array with the preset feature points for similarity; in response to the similarity between the feature points of the image array and the preset feature points being not less than a preset threshold, confirm that the feature comparison result meets the preset conditions.

[0079] In a specific embodiment, the analysis unit is also used to confirm that the screwing and attaching operation of the automatic processing component to the current working position of the product to be processed is completed, and send a pass signal to the light spot player program; in response to confirming that the feature comparison result meets the preset conditions, and / or receiving the pass signal, the light spot player program lights up the working position of the next working step.

[0080] In a specific embodiment, the analysis unit is also used to detect the actual position coordinates and actual torque when the automatic processing component performs the screwing operation; the actual position coordinates are analyzed with the preset coordinates, and the actual torque is compared with the preset torque; if the difference between the actual position coordinates and the preset coordinates satisfies the first preset difference, and the difference between the actual torque and the preset torque satisfies the second preset difference, it is confirmed that the screwing operation at the current working position is completed.

[0081] In a specific embodiment, it also includes a third execution unit, which is used to obtain all the sub-actions in the action to be processed, then obtain the screwing and attaching action in the sub-action, and arrange the screwing and attaching actions according to the operation sequence in the path information to make an action program; in response to the current operation position of the product to be processed being lit up, the automatic processing component is controlled by the action program to perform the screwing and attaching operation on the product to be processed.

[0082] For the specific definition of the guided operation control system, please refer to the definition of the guided operation control method above, which will not be repeated here. Each module in the above-mentioned guided operation control system can be implemented in whole or in part by software, hardware and their combination. The above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.

[0083] In one embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as follows: Figure 5 As shown. The computer device includes a processor, a memory, a network interface and a database connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store feature data in a preset image. The network interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a method for guiding job control is implemented.

[0084] Those skilled in the art will understand that Figure 5 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0085] In one embodiment, a computer device is provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the following steps when executing the computer program:

[0086] Step 201, obtaining path information of the to-be-processed action according to the to-be-processed action performed by the to-be-processed product;

[0087] Step 202: creating a light spot playback program based on the path information, so as to illuminate the current working position of the product to be processed according to the position coordinates in the path information through the light spot playback program;

[0088] Step 203: extracting the operation image of the current operation step of the product to be processed, and setting the operation image to perform feature comparison with a preset image;

[0089] Step 204 , in response to the feature comparison result satisfying a preset condition, obtaining the next operation step in the path information, and lighting up the operation position of the next operation step through a light spot player program.

[0090] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0091] All sub-actions in the to-be-processed action are obtained, and the operation position coordinates of all the sub-actions are obtained, and the operation position coordinates are arranged in operation order to form path information.

[0092] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0093] It also includes an automatic processing component; in response to the current working position of the product to be processed being lit up, the automatic processing component is moved to the current working position according to the coordinates of the current working position; so as to realize the screwing operation on the current working position of the product to be processed by the automatic processing component.

[0094] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0095] In response to starting the operation, the initial operation position of the product to be processed is illuminated by a light spot player program; it is determined whether there is a screwing operation in the path information of the product to be processed; if there is a screwing operation, feature comparison and screwing operation detection are performed in combination with the operation image and a preset image; or, if there is no screwing operation, feature comparison is performed between the operation image and the preset image.

[0096] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0097] Intercepting the operation images of the current operation step of the product to be processed at regular intervals according to the operation sequence; composing the intercepted operation images of the current operation step of the product to be processed into an image array, and extracting the feature points of the image array; obtaining the preset feature points of the preset image, and performing a similarity comparison between the feature points of the image array and the preset feature points; in response to the similarity between the feature points of the image array and the preset feature points being not less than a preset threshold, confirming that the feature comparison result meets the preset condition;

[0098] Executing the screwing and attaching operation detection specifically includes: confirming that the screwing and attaching operation of the automatic processing component on the current working position of the product to be processed is completed, and sending a pass signal to the light spot player program; in response to confirming that the feature comparison result meets the preset conditions, and / or receiving the pass signal, the light spot player program lights up the working position of the next working step.

[0099] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0100] Detect the actual position coordinates and actual torque when the automatic processing component performs the screwing operation; analyze the actual position coordinates and the preset coordinates, and compare the actual torque with the preset torque; if the difference between the actual position coordinates and the preset coordinates meets the first preset difference, and the difference between the actual torque and the preset torque meets the second preset difference, confirm that the screwing operation at the current working position is completed.

[0101] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0102] The screwing and attaching actions in the sub-actions are obtained, and the screwing and attaching actions are arranged according to the operation sequence in the path information to form an action program; in response to the current operation position of the product to be processed being lit up, the automatic processing component is controlled by the action program to perform screwing and attaching operations on the product to be processed.

[0103] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:

[0104] Step 301, obtaining path information of the to-be-processed action according to the to-be-processed action performed by the to-be-processed product;

[0105] Step 302: Create a light spot playback program based on the path information, so as to illuminate the current working position of the product to be processed according to the position coordinates in the path information through the light spot playback program;

[0106] Step 303: extracting the operation image of the current operation step of the product to be processed, and setting the operation image to perform feature comparison with a preset image;

[0107] Step 304: In response to the feature comparison result satisfying the preset condition, the next operation step in the path information is obtained, and the operation position of the next operation step is illuminated by a light spot player.

[0108] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0109] All sub-actions in the to-be-processed action are obtained, and the operation position coordinates of all the sub-actions are obtained, and the operation position coordinates are arranged in operation order to form path information.

[0110] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0111] In response to the current working position of the product to be processed being illuminated, the automatic processing component is moved to the current working position according to the coordinates of the current working position; so as to realize the screwing and attaching operation of the current working position of the product to be processed by the automatic processing component. In one embodiment, when the computer program is executed by the processor, the following steps are also implemented:

[0112] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0113] In response to starting the operation, the initial operation position of the product to be processed is illuminated by a light spot player program; it is determined whether there is a screwing operation in the path information of the product to be processed; if there is a screwing operation, feature comparison and screwing operation detection are performed in combination with the operation image and a preset image; or, if there is no screwing operation, feature comparison is performed between the operation image and the preset image.

[0114] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0115] Intercepting the operation images of the current operation step of the product to be processed at regular intervals according to the operation sequence; composing the intercepted operation images of the current operation step of the product to be processed into an image array, and extracting the feature points of the image array; obtaining the preset feature points of the preset image, and performing a similarity comparison between the feature points of the image array and the preset feature points; in response to the similarity between the feature points of the image array and the preset feature points being not less than a preset threshold, confirming that the feature comparison result meets the preset condition;

[0116] Executing the screwing and attaching operation detection specifically includes: confirming that the screwing and attaching operation of the automatic processing component on the current working position of the product to be processed is completed, and sending a pass signal to the light spot player program; in response to confirming that the feature comparison result meets the preset conditions, and / or receiving the pass signal, the light spot player program lights up the working position of the next working step.

[0117] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0118] Detect the actual position coordinates and actual torque when the automatic processing component performs the screwing operation; analyze the actual position coordinates and the preset coordinates, and compare the actual torque with the preset torque; if the difference between the actual position coordinates and the preset coordinates meets the first preset difference, and the difference between the actual torque and the preset torque meets the second preset difference, confirm that the screwing operation at the current working position is completed.

[0119] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0120] The screwing and attaching actions in the sub-actions are obtained, and the screwing and attaching actions are arranged according to the operation sequence in the path information to form an action program; in response to the current operation position of the product to be processed being lit up, the automatic processing component is controlled by the action program to perform screwing and attaching operations on the product to be processed.

[0121] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

[0122] The technical features of the above embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0123] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the attached claims.

Claims

1. A guidance operation control method, characterized in that: The method comprises: According to the to-be-processed action performed by the to-be-processed product, path information of the to-be-processed action is obtained; Creating a light spot playback program based on the path information, so as to illuminate the current working position of the product to be processed according to the position coordinates in the path information through the light spot playback program; Extracting a working image of a current working step of the product to be processed, and setting the working image to perform feature comparison with a preset image; In response to the feature comparison result satisfying the preset condition, the next operation step in the path information is obtained, and the operation position of the next operation step is illuminated by a light spot playback program.

2. The guidance operation control method according to claim 1, characterized in that: The action to be processed includes one or more sub-actions, and the method further includes: All sub-actions in the to-be-processed action are obtained, and the operation position coordinates of all the sub-actions are obtained, and the operation position coordinates are arranged in operation order to form path information.

3. The guidance operation control method according to claim 2, characterized in that: Also included are automated machining components; In response to the current working position of the product to be processed being illuminated, moving the automatic processing component to the current working position according to the coordinates of the current working position; This enables the automatic processing component to perform a screwing operation on the current working position of the product to be processed.

4. The guidance operation control method according to claim 3, characterized in that: The method further comprises: In response to the start-up operation, an initial operation position of the product to be processed is illuminated by a light spot playing program; Determining whether there is a twisting operation in the path information of the product to be processed; If a twisting and attaching operation is present, feature comparison and twisting and attaching operation detection are performed in combination with the operation image and a preset image; Alternatively, if there is no screwing operation, a feature comparison is performed between the operation image and a preset image.

5. The guidance operation control method according to claim 4, characterized in that: The setting of performing feature comparison between the operation image and the preset image specifically includes: Regularly capture the operation image of the current operation step of the product to be processed according to the operation sequence; Combining the intercepted operation images of the current operation step of the product to be processed into an image array, and extracting feature points of the image array; Acquire preset feature points of the preset image, and compare the feature points of the image array with the preset feature points for similarity; In response to the similarity between the feature point of the image array and the preset feature point being not less than a preset threshold, confirming that the feature comparison result satisfies a preset condition; Executing the twisting and attaching operation detection specifically includes: Confirming that the screwing and attaching operation of the automatic processing component to the current working position of the product to be processed is completed, and sending a passing signal to the light spot playback program; In response to confirming that the feature comparison result meets the preset condition and / or receiving the pass signal, the light spot playback program lights up the operation position of the next operation step.

6. The guidance operation control method according to claim 5, characterized in that: Confirming that the screwing and attaching operation of the automatic processing component to the current working position of the product to be processed is completed specifically includes: Detecting the actual position coordinates and actual torque of the automatic processing component when performing the screwing operation; Analyzing the actual position coordinates with the preset coordinates, and comparing the actual torque with the preset torque; If the difference between the actual position coordinates and the preset coordinates satisfies a first preset difference, and the difference between the actual torque and the preset torque satisfies a second preset difference, it is confirmed that the screwing operation at the current working position is completed.

7. The guidance operation control method according to claim 3, characterized in that: After obtaining all sub-actions in the action to be processed, the method further includes: Acquire the screwing and attaching actions in the sub-actions, and arrange the screwing and attaching actions according to the operation sequence in the path information to make an action program; In response to the current working position of the product to be processed being illuminated, the automatic processing component is controlled by the action program to perform a screwing operation on the product to be processed.

8. A guidance operation control system, used to implement the guidance operation control method according to any one of claims 1 to 7, characterized in that: The system comprises: An acquisition unit, configured to acquire path information of a processing action of the product to be processed according to a processing action performed on the product to be processed; A first execution unit is used to create a light spot playback program based on the path information, so as to illuminate the current operation position of the product to be processed according to the position coordinates in the path information through the light spot playback program; An analysis unit, used for extracting a working image of a current working step of the product to be processed, and performing feature comparison between the working image and a preset image; The second execution unit is used for obtaining the next operation step in the path information in response to the feature comparison result satisfying the preset condition, and lighting up the operation position of the next operation step through the light spot playback program.

9. A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images