Electronic component positioning method and system based on machine vision

Abstract

The present application is applicable to the field of electronic component positioning technology, and in particular, to a method and system for positioning electronic components based on machine vision, the method comprising: acquiring image information of the electronic component; monitoring a first operation; detecting the placement of the electronic component; and based on the image information, the first operation and the placement, the electronic component positioning device performs positioning services. The method for positioning electronic components based on machine vision provided in the present application can solve the problem that the traditional electronic component positioning process usually relies on manual inspection and positioning, and manual positioning is prone to misjudgment, resulting in placement errors or inaccurate positioning, which in turn leads to reduced positioning efficiency.

Description

Technical Field

[0001] The present application belongs to the technical field of electronic component positioning, and in particular, relates to a method and system for positioning an electronic component based on machine vision. Background Art

[0002] Electronic components are the basic components of electronic circuits. They are responsible for processing, controlling and transmitting electrical energy or signals. For example, electronic components can be resistors, capacitors, transistors, inductors and other components. Electronic component positioning refers to the accurate identification and arrangement of the positions of various electronic components on the circuit board during the circuit design and manufacturing process.

[0003] The traditional electronic component positioning process usually relies on manual inspection and positioning, but manual positioning is prone to misjudgment, resulting in placement errors or inaccurate positioning, which in turn leads to reduced positioning efficiency. Summary of the invention

[0004] The embodiments of the present application provide a method and system for positioning electronic components based on machine vision, which can solve the problem that the traditional electronic component positioning process usually relies on manual inspection and positioning, and manual positioning is prone to misjudgment and causes placement errors or inaccurate positioning, which in turn leads to reduced positioning efficiency.

[0005] In a first aspect, an embodiment of the present application provides an electronic component positioning method based on machine vision, which is applied to an electronic component positioning device, and the method includes:

[0006] Acquire image information of the electronic component; wherein the image information is used to reflect the type of the electronic component;

[0007] Monitoring a first operation; wherein the first operation is used to start a positioning action for an electronic component;

[0008] Detecting the placement of electronic components; wherein the placement is used to reflect whether the electronic components are located in the positioning area of ​​the electronic component positioning device;

[0009] Based on the image information, the first operation and the placement situation, the electronic component positioning device performs a positioning service.

[0010] The above technical solutions in the embodiments of the present application have at least the following technical effects:

[0011] The electronic component positioning method based on machine vision provided by the present application can realize automated electronic component detection by acquiring image information reflecting the type of electronic components, so as to accurately find the required electronic components, reduce manual intervention, reduce the risk of human error, and provide data support for the subsequent positioning of electronic components. Secondly, by monitoring the first operation used to start the positioning action of the electronic component, the user can directly start the positioning activity through a simple operation to respond quickly, thereby effectively reducing the positioning delay and helping to improve the positioning efficiency of the subsequent positioning process. Thirdly, by detecting the placement of the electronic component, it can be confirmed whether the electronic component is correctly placed in the positioning area of ​​the electronic component positioning device, thereby ensuring that the positioning action is performed only when the conditions are met, reducing invalid work, and helping to improve the work efficiency of the subsequent entire positioning process. Then, based on the image information, the first operation and the placement situation, the electronic component positioning device performs the positioning service, which can be able to understand the current situation more comprehensively, for example, whether the model of the electronic component is correct, whether the electronic component to be positioned is placed in the positioning area of ​​the electronic component positioning device, etc., and realize automatic positioning by combining multiple information sources, reducing the dependence on manual operation and improving the work efficiency of the positioning operation.

[0012] In a second aspect, an embodiment of the present application provides an electronic component positioning system based on machine vision, which is applied to an electronic component positioning device and is used to implement the electronic component positioning method based on machine vision described in any one of the first aspects above, and the electronic component positioning system based on machine vision includes:

[0013] An acquisition unit, used to acquire image information of the electronic component; wherein the image information is used to reflect the type of the electronic component;

[0014] A monitoring unit, configured to monitor a first operation; wherein the first operation is configured to start a positioning operation on an electronic component;

[0015] A detection unit, used to detect the placement of the electronic component; wherein the placement is used to reflect whether the electronic component is located in the positioning area of ​​the electronic component positioning device;

[0016] An analysis unit is used for enabling the electronic component positioning device to perform positioning services based on the image information, the first operation and the placement situation.

[0017] In a third aspect, an embodiment of the present application provides an electronic component positioning device, comprising a positioning device and a control device electrically connected to the positioning device, the control device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the electronic component positioning method based on machine vision described in any one of the first aspects above is implemented.

[0018] It can be understood that the beneficial effects of the second to third aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0020] Figure 1 It is a flowchart of a method for locating an electronic component based on machine vision provided in one embodiment of the present application;

[0021] Figure 2 This is a schematic diagram of the implementation process of the positioning service in the electronic component positioning method based on machine vision provided in an embodiment of the present application;

[0022] Figure 3 It is a schematic diagram of an implementation flow of determining whether a positioning adjustment signal is feasible in a method for positioning an electronic component based on machine vision provided in an embodiment of the present application;

[0023] Figure 4 is a structural schematic diagram of an electronic component positioning system based on machine vision provided in an embodiment of the present application;

[0024] Figure 5 It is a structural schematic diagram of a control device of an electronic component positioning device based on machine vision provided in an embodiment of the present application. DETAILED DESCRIPTION

[0025] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.

[0026] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.

[0027] It should also be understood that the term “and / or” used in the specification and appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0028] As used in the specification and appended claims of this application, the term "if" can be interpreted as "when" or "uponce" or "in response to determining" or "in response to detecting" depending on the context. Similarly, the phrase "if it is determined" or "if the described condition or event is detected" can be interpreted as meaning "uponce determined" or "in response to determining" or "uponce the described condition or event is detected" or "in response to detecting the described condition or event" depending on the context.

[0029] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0030] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0031] In the related technology, electronic components are the basic components of electronic circuits. They are responsible for processing, controlling and transmitting electrical energy or signals. For example, electronic components can be resistors, capacitors, transistors, inductors and other components. Electronic component positioning refers to the accurate identification and arrangement of the positions of various electronic components on the circuit board during the circuit design and manufacturing process.

[0032] The traditional electronic component positioning process usually relies on manual inspection and positioning, but manual positioning is prone to misjudgment, resulting in placement errors or inaccurate positioning, which in turn leads to reduced positioning efficiency.

[0033] To solve the above problems, the embodiments of the present application provide a method and system for positioning electronic components based on machine vision.

[0034] In the method, by acquiring image information reflecting the type of electronic components, automated electronic component detection can be achieved to accurately find the required electronic components, reduce manual intervention, reduce the risk of human error, and provide data support for the subsequent positioning of electronic components. Secondly, by monitoring the first operation used to start the positioning action of the electronic component, the user can directly start the positioning activity through a simple operation to respond quickly, thereby effectively reducing the positioning delay and helping to improve the positioning efficiency of the subsequent positioning process. Thirdly, by detecting the placement of the electronic components, it can be confirmed whether the electronic components are correctly placed in the positioning area of ​​the electronic component positioning device, thereby ensuring that the positioning action is performed only when the conditions are met, reducing invalid work, and helping to improve the work efficiency of the subsequent entire positioning process. Then, based on the image information, the first operation and the placement situation, the electronic component positioning device performs the positioning service, which can be able to more comprehensively understand the current situation, for example, whether the model of the electronic component is correct, whether the electronic component to be positioned is placed in the positioning area of ​​the electronic component positioning device, etc., by combining multiple information sources to achieve automatic positioning, reduce the dependence on manual operation, and improve the work efficiency of the positioning operation.

[0035] The electronic component positioning method based on machine vision provided in the embodiment of the present application can be applied to an electronic component positioning device. In this case, the electronic component positioning device is the executor of the electronic component positioning method based on machine vision provided in the embodiment of the present application. The embodiment of the present application does not impose any restrictions on the specific type of the electronic component device.

[0036] For example, the electronic component positioning device may include a positioning device and a control device electrically connected to the positioning device. The positioning device may include a camera, a mechanical positioning device (such as a device composed of a guide rail, a mechanical arm and a servo motor), a sensor (such as a laser sensor or an ultrasonic sensor), etc. The camera is used to capture the image of the electronic component to obtain its appearance characteristics and model information. The mechanical positioning device is used to support, move and position the electronic component. The sensor is used to accurately measure the distance and position between the electronic component and the electronic product (such as a circuit board, a printed circuit board, etc.) on which the electronic component is to be positioned and installed to detect whether the component is in the correct position. The control device can determine whether the electronic component is the electronic component to be positioned by the image of the electronic component obtained by the camera. In the case of determining that it is the electronic component to be positioned, the positioning posture of the electronic component can be controlled by the sensor and the mechanical positioning device so that the electronic component is placed in the correct area of ​​the electronic product.

[0037] For example, the control device can be a mobile phone, tablet computer, notebook computer, ultra-mobile personal computer (UMPC), netbook, desktop computer, computing device or computer connected to a wireless modem, laptop computer, handheld communication device, handheld computing device, etc.

[0038] In order to better understand the electronic component positioning method based on machine vision provided in the embodiment of the present application, the specific implementation process of the electronic component positioning method based on machine vision provided in the embodiment of the present application is exemplarily introduced below.

[0039] Figure 1 A schematic flow chart of an electronic component positioning method based on machine vision provided in an embodiment of the present application is shown. The electronic component positioning method based on machine vision includes:

[0040] S100, obtaining image information of an electronic component, wherein the image information is used to reflect the type of the electronic component.

[0041] It can be understood that the image information can be information about the electronic component model, specification information of the electronic component model, etc.

[0042] For example, the camera can capture the details of the electronic component, such as size, logo, color, shape, etc., to obtain image information reflecting the type of the electronic component. The camera can also capture the image of the electronic component, and for the text or model logo on the image of the electronic component, the OCR technology can be used to recognize the text in the image as editable text to obtain image information reflecting the type of the electronic component.

[0043] Such a setting can reduce manual intervention, lower the risk of human error, and provide data support for the subsequent positioning of electronic components.

[0044] S200, monitoring a first operation, wherein the first operation is used to start a positioning operation for an electronic component.

[0045] It can be understood that the first operation can be an operation of clicking or touching a physical button or switch, or an operation of clicking or touching an interactive interface (such as a touch screen). When the operator presses a button or touches the interactive interface, a signal is triggered to start the positioning action of the electronic component. When the first operation is monitored, the feedback information of the image of the current electronic component (such as the position and direction of the electronic component) is calculated in real time through the built-in positioning algorithm or positioning rule, and then the required moving coordinates, positioning direction and other information can be generated.

[0046] For example, the first operation can be monitored by a photoelectric sensor, and the photoelectric sensor is set near the physical button or switch. For example, when the user clicks or touches the physical button or switch, the state of the photoelectric sensor can be used to monitor that the user has clicked or touched the physical button or switch. For another example, when the user has not clicked or touched the physical button or switch, the state of the photoelectric sensor can be used to monitor that the user has not clicked or touched the physical button or switch.

[0047] With such a setting, by monitoring the first operation, the user can directly start the positioning activity through a simple operation to respond quickly, thereby effectively reducing the positioning delay and helping to improve the positioning efficiency of the subsequent positioning process.

[0048] S300, detecting the placement of the electronic component, wherein the placement is used to reflect whether the electronic component is located in the positioning area of ​​the electronic component positioning device.

[0049] It can be understood that the positioning area can be an area where the mechanical positioning device can perform positioning activities, so as to facilitate the subsequent mechanical positioning device to support, move and position the electronic component. For example, the positioning area can be the area where the positioning platform of the electronic component positioning equipment is located, the area where the mechanical positioning device can move, etc.

[0050] For example, a camera (such as an industrial camera) can be used to capture the positioning area, and the image can be analyzed by an image processing algorithm (such as OpenCV) to identify whether it is located in the positioning area of ​​the electronic component positioning device. Alternatively, an acoustic wave sensor or an infrared sensor installed in the positioning area can be used to detect the distance between the electronic component and the sensor to determine whether the electronic component is located in the positioning area of ​​the electronic component positioning device.

[0051] Such a setting can ensure that positioning actions are performed only when the conditions are met, reduce invalid work, and help improve the work efficiency of the entire subsequent positioning process.

[0052] S400: Based on the image information, the first operation and the placement situation, the electronic component positioning device performs a positioning service.

[0053] It can be understood that the positioning service may be a service of positioning electronic components on electronic products where the electronic components are to be positioned and installed.

[0054] For example, a specific image processing algorithm (such as edge detection, contour recognition, etc.) can be used to extract features of image information. In the case of monitoring the first operation, the image feedback information of the current electronic component (such as the position and direction of the electronic component) is calculated in real time through the built-in positioning algorithm or positioning rule, and the required moving coordinates, positioning direction and other information can be generated. In the case of determining that the electronic component is located in the positioning area of ​​the electronic component positioning device, the image processing result of the image feedback information of the current electronic component is coordinated with the positioning action of the mechanical positioning device (for example, according to the image feedback information, such as the position and direction of the component, the action of the mechanical arm is adjusted in real time), and a closed-loop control system is formulated to accurately place the electronic component.

[0055] For example, the image information can be analyzed to determine whether the current model of the electronic component is the electronic component required for positioning. When it is determined that the current model of the electronic component is the electronic component required for positioning, the first operation is monitored to determine whether to start the positioning action for the electronic component, that is, whether the user currently has a positioning demand; when the first operation is monitored, the placement of the electronic component is detected to determine whether the electronic component is located in the positioning area of ​​the electronic component positioning device, that is, whether the positioning activity can be performed at present. When it is determined that the electronic component is located in the positioning area of ​​the electronic component positioning device, the electronic component positioning device can be started to perform the positioning service.

[0056] With such a setting, the electronic component positioning device performs positioning services based on the image information, the first operation and the placement situation, and can have a more comprehensive understanding of the current situation, for example, whether the model of the electronic component is correct, whether the electronic component to be positioned is placed within the positioning area of ​​the electronic component positioning device, etc. By combining multiple information sources to achieve automatic positioning, it reduces dependence on manual operation and improves the work efficiency of positioning operations.

[0057] In one possible implementation, see Figure 2 , S400, based on the image information, the first operation and the placement situation, the electronic component positioning device performs a positioning service, including:

[0058] S410: When the control device obtains image information that matches a preset image library and detects a first operation, the placement of the electronic components is detected.

[0059] It can be understood that the preset image library may include multiple images of electronic components to be located and features (such as size, shape, etc.) corresponding to the multiple electronic components, and there is a mapping relationship between the images and features of the electronic components to be located. The preset image library may be obtained by the user inputting the image information of the electronic components to be located collected in advance into the library.

[0060] For example, features in the acquired image information are compared with features in a preset image library, and a matching algorithm (such as extracting feature points and matching using descriptors) can be used to determine whether the type of the current electronic component matches the type of the electronic component to be located.

[0061] For example, the template image in the preset image library can also be compared pixel by pixel with the currently acquired image information to calculate the correlation score and the similarity between the image area in the image information and the template. If the similarity is high, it means a match; otherwise, it means a mismatch.

[0062] For example, when the control device obtains image information that matches the preset image library, it means that the current type of electronic component is the type of electronic component that needs to be positioned, so the first operation can be monitored to determine whether there is a positioning requirement at present. When the first operation is monitored, it can be determined whether the electronic component is located in the positioning area of ​​the electronic component positioning device, that is, whether the positioning activity can be performed at present, that is, the placement of the electronic component can be detected.

[0063] With such a configuration, when the control device obtains image information that matches the preset image library, if the first operation is monitored, the placement of the electronic components is detected, and the type of the current electronic components can be accurately confirmed, so that subsequent operations (such as positioning or assembly) are based on the correct component type, avoiding losses caused by erroneous operations, thereby improving subsequent positioning efficiency.

[0064] S420: When the placement situation indicates that the electronic component is located in a positioning area of ​​a positioning device of the electronic component positioning equipment, the control device controls the positioning device to perform a positioning service.

[0065] It can be understood that when the placement situation reflects that the electronic component is located in the positioning area of ​​the positioning device of the electronic component positioning equipment, it means that the positioning activity can be performed currently, so the control device can control the positioning device to perform the positioning service.

[0066] With such a configuration, when the placement situation reflects that the electronic component is located in the positioning area of ​​the positioning device of the electronic component positioning equipment, the control device controls the positioning device to perform positioning services, and automatic positioning can be achieved by combining multiple information sources, thereby reducing dependence on manual operation and improving the work efficiency of the positioning operation.

[0067] In a possible implementation, in step S400, before the electronic component positioning device performs a positioning service based on the image information, the first operation and the placement situation, the electronic component positioning method based on machine vision further includes:

[0068] S401: Send positioning information to a positioning device based on a positioning service.

[0069] It can be understood that the positioning information may be information required in the positioning process, for example, information on the moving direction and arrangement orientation of the electronic component, information on the arrangement position of the electronic component, and the like.

[0070] For example, the control device may send positioning information to the positioning device in response to the positioning service to control the positioning device to perform the positioning service. When the control device determines that the positioning service can be performed at present, the control device may send the currently calculated required moving coordinates, positioning direction and other information to the positioning device through an electrical connection (such as wires, cables, etc.) to control the positioning device to perform the positioning service.

[0071] Such an arrangement sends positioning information to the positioning device based on the positioning service, which reduces the necessity of human intervention, thereby reducing problems caused by human errors, such as incorrect placement of components or inaccurate positions, and thus can improve the accuracy of positioning.

[0072] S402: Detecting the operation information of the positioning service, wherein the operation information is used to reflect the operation status of the positioning service.

[0073] It can be understood that the operation information can be used to indicate the operation status of the current positioning process, for example, the positioning service is ready to run, the positioning service is running, an abnormal failure occurs in the positioning service, and the operator controls the positioning service to be temporarily stopped through the control device.

[0074] For example, the displacement, speed, direction and other parameters can be monitored in real time by sensors to detect the operation information of the current positioning service. During the execution of the positioning service, the log information of the positioning operation can be recorded, and the operation information of the positioning service can be detected by querying the system log.

[0075] With such a setting, by detecting the operation information of the positioning service, it is possible to understand the current operation status of the positioning service, provide data support for subsequent decision-making, help optimize the positioning service process, and improve the overall positioning efficiency.

[0076] S403, when the operation information reflects that the positioning service is temporarily stopped, the label of the positioning service is updated to the first label, and a first instruction corresponding to the positioning service is generated. When the action of the control device continuing to send positioning information to the positioning device is monitored within the first time period, the first instruction is deleted, and the positioning information is continued to be sent to the positioning device based on the positioning service. Among them, the first label is the execution level of the first form of service, the execution level of the first form of service exceeds the execution level of the second form of service, and the control device releases the positioning information of each service whose execution level does not exceed the execution level of the second form of service. The first instruction is used to indicate that the label of the positioning service is updated to the second label after the first time period, and the second label does not exceed the execution level of the second form of service.

[0077] For example, in order to prevent the control device from blocking the entire positioning process due to an abnormality or stop of a certain service, that is, to prevent the occurrence of a deadlock phenomenon, the control device will determine the positioning service as a second-form service (that is, a service whose execution level does not exceed the execution level of the second-form service), and the control device will release the positioning information of each service whose execution level does not exceed the execution level of the second-form service. For example, when the control device determines that the service is a second-form service, the service will be stored in a service discard list, that is, a list of positioning information corresponding to the second-form service that can be discarded, to prevent the positioning information of the second-form service from blocking the entire positioning process. Among them, the first-form service can be a control service to be performed by the control device, and the second-form service is a control service that can be discarded by the control device.

[0078] For example, when executing a positioning service (at this time, it is a first-form service), the operator controls the positioning service to stop positioning for safety reasons (such as personnel entering a dangerous area, etc.). In this scenario, the positioning service will be determined as a second-form service. When the personnel are away from the dangerous area, the operator wants to control the positioning service to continue positioning, but at this time the positioning service is determined as a second-form service and is discarded. Therefore, the positioning service cannot continue to perform positioning, resulting in low positioning efficiency.

[0079] For example, when executing a positioning service, the device stops abnormally due to resource limitations (such as power or computing power). In this scenario, the positioning service will be determined as a second-form service. After resources are obtained, the positioning service is controlled to continue positioning, but the positioning service is determined to be a second-form service and is discarded. Therefore, the positioning service cannot continue to perform positioning, resulting in low positioning efficiency.

[0080] For example, the first duration may be the duration for handling a safety incident (such as a person entering a dangerous area, etc.), for example, 1 minute, 2 minutes, 3 minutes, etc.

[0081] For example, when the operation information reflects that the positioning service is temporarily stopped, it means that the operator wants to continue the positioning service later. In order to prevent the positioning service from being discarded when it is determined to be a second-form service, the label of the positioning service can be updated to the first label (i.e., the execution level of the first-form service). Because the execution level of the first-form service exceeds the execution level of the second-form service, it will not be discarded. In order to avoid the blocking of the entire positioning process due to the long stop time of the positioning service, the label of the positioning service can be updated to the second label, i.e., the first instruction, after the first time period. If the action of the control device continuing to send positioning information to the positioning device is monitored within the first time period, it means that the positioning service is controlled to continue positioning, so the first instruction can be deleted. In this way, when the positioning service is determined to be a second-form service, the positioning service can be controlled to continue positioning later, that is, the positioning information is continued to be sent to the positioning device based on the positioning service. Among them, the action of monitoring the control device to continue to send positioning information to the positioning device can be achieved by querying the system log or sensor.

[0082] In this way, when the operation information reflects that the positioning service is temporarily stopped, the label of the positioning service is updated to the first label, and the first instruction corresponding to the positioning service is generated. When the action of the control device continuing to send positioning information to the positioning device is monitored within the first time period, the first instruction is deleted, and the positioning information is continued to be sent to the positioning device based on the positioning service, which can reduce the risk of being discarded due to being determined as a second form of service, thereby improving the efficiency of subsequent continued positioning.

[0083] S404: When the operation information reflects that the positioning service is abnormally stopped, the label of the positioning service is updated to the first label, and a second instruction corresponding to the positioning service is generated. When the acquisition action of acquiring the image information of the electronic component is again monitored within the second time period, the second instruction is deleted, and the positioning information is continued to be sent to the positioning device based on the positioning service. The second instruction is used to instruct that the label of the positioning service is updated to the second label after the second time period.

[0084] It can be understood that when the operation information reflects that the positioning service is abnormally stopped, it means that although the current device is abnormally stopped due to resource limitations (such as power or computing power), there are resources to meet the normal operation of the current positioning service. In order to prevent the positioning service from being discarded when it is determined to be a second form of service, the label of the positioning service can be updated to the first label (i.e., the execution level of the first form of service). In order to avoid the blocking of the entire positioning process due to the long stop time of the positioning service, the label of the positioning service can be updated to the second label, i.e., the second instruction, after the second time period. If the acquisition action of acquiring the image information of the electronic component is monitored within the second time period, it means that there are resources that can meet the normal operation of the current positioning service, i.e., the positioning service can continue to be positioned normally, so the second instruction can be deleted, so that when the positioning service is determined to be a second form of service, the positioning service can be controlled to continue to be positioned, i.e., continue to send positioning information to the positioning device based on the positioning service. Among them, the acquisition action of monitoring the acquisition of the image information of the electronic component can be achieved by detecting the working changes of the camera or querying the log to determine whether the image information is acquired.

[0085] In this way, when the operation information reflects that the positioning service is abnormally stopped, the label of the positioning service is updated to the first label, and a second instruction corresponding to the positioning service is generated. When the acquisition action of acquiring the image information of the electronic component is monitored again within the second time period, the second instruction is deleted, and the positioning information is continued to be sent to the positioning device based on the positioning service, which can reduce the risk of being discarded due to being determined as a second form of service, thereby improving the efficiency of subsequent continued positioning.

[0086] In a possible implementation, the operation information reflects that the positioning service is temporarily stopped, indicating that the form of the positioning service is the second form of service, and the control device and the positioning device maintain a positioning control channel, and the control device suspends the activity of sending positioning information to the positioning device. The operation information reflects that the positioning service is abnormally stopped, indicating that the form of the positioning service is the second form of service, and the control device and the positioning device do not maintain a positioning control channel, and the control device suspends the activity of sending positioning information to the positioning device.

[0087] It can be understood that the positioning control channel can be a channel electrically connected between the control device and the positioning device, such as a digital signal channel, an electrical signal channel, etc., which is used to transmit instructions to the positioning device to achieve the purpose of controlling the positioning device to perform positioning services.

[0088] For example, when the positioning service is judged to be temporarily stopped, the form of the positioning service will be determined as the second form of service. At the same time, the temporary stop of the positioning service indicates that the control device and the positioning device maintain a positioning control channel, and the control device suspends the activity of sending positioning information to the positioning device, that is, the positioning service may be stopped for a short time, and it is not inoperable due to a device failure.

[0089] For example, when the positioning service is judged to have stopped abnormally, the form of the positioning service will be determined as the second form of service. At the same time, the abnormal stop of the positioning service indicates that the control device and the positioning device have not maintained the positioning control channel (that is, the current power or computing power cannot meet the positioning service, so the positioning control channel cannot be maintained), and the control device suspends the activity of sending positioning information to the positioning device, that is, the positioning service may be abnormally stopped for a short time, and it is not inoperable due to a device failure.

[0090] Such a setting helps to quickly identify the status of the business during operation, making it easier to make corresponding judgments and decisions later.

[0091] In a possible implementation, the electronic component positioning method based on machine vision also includes:

[0092] S405: When the control device continues to send positioning information to the positioning device within the first time period, the first instruction is deleted, and the positioning information is continued to be sent to the positioning device based on the positioning service, and the operation information of the positioning service is continued to be detected.

[0093] It can be understood that when the control device continues to send positioning information to the positioning device within the first time period, it means that it wants to control the positioning service to continue positioning, so the first instruction can be deleted. Therefore, the positioning information can continue to be sent to the positioning device based on the positioning service. At the same time, in order to avoid temporary suspension of the positioning service, the operation information of the positioning service can continue to be detected, so as to facilitate the label update operation when the positioning service is temporarily stopped.

[0094] With such a setting, when the control device is monitored to continue sending positioning information to the positioning device within the first time period, the first instruction is deleted, and the positioning information continues to be sent to the positioning device based on the positioning service, and the operating information of the positioning service continues to be detected. This allows a quick response to the positioning service and timely execution of necessary operations, thereby reducing the positioning downtime.

[0095] S406: When the first signal is monitored within the first time period, or after the first time period has expired, the control device continues to send positioning information to the positioning device, and the tag of the positioning service is updated to a second tag. The first signal is used to indicate that the current positioning service is not to be executed.

[0096] It can be understood that the first signal can be a digital signal or an electrical signal. For example, the first signal can be a signal sent by an operator to the control device, such as when a more serious safety incident (such as a production accident) needs to be handled instead of executing the current positioning service.

[0097] For example, when the first signal is monitored within the first time period, or when the action of the control device continuing to send positioning information to the positioning device is not heard after the first time period ends, it means that you do not want to control the positioning service to continue positioning. In order to avoid the stopping of the positioning service causing the entire positioning process to be blocked, the label of the positioning service can be updated to the second label, so that the positioning service is discarded.

[0098] With such a setting, when the first signal is monitored within the first time period, or after the first time period has passed, the control device is still not heard to continue sending positioning information to the positioning device, the label of the positioning service will be updated to the second label. The label of the positioning service can be flexibly adjusted according to the specific situation to ensure the overall smoothness and work efficiency of the positioning process.

[0099] In a possible implementation, the electronic component positioning method based on machine vision also includes:

[0100] S407: when the acquisition action of acquiring the image information of the electronic component is monitored again within the second time period, the second instruction is deleted, and the positioning information is continued to be sent to the positioning device based on the positioning service, and the operation information of the positioning service is continued to be detected.

[0101] It can be understood that when the action of acquiring the image information of the electronic component is monitored within the second time period, it means that there are resources that can meet the normal operation of the current positioning service, that is, the positioning service can continue to perform positioning normally, so the second instruction can be deleted. Therefore, the positioning information can continue to be sent to the positioning device based on the positioning service. At the same time, in order to avoid the abnormal stop of the positioning service, the operation information of the positioning service can continue to be detected, so as to facilitate the label update operation when the positioning service is abnormally stopped.

[0102] With such a setting, when the action of acquiring the image information of the electronic component is listened to again within the second time period, the second instruction is deleted, and the positioning information continues to be sent to the positioning device based on the positioning service, and the operation information of the positioning service continues to be detected. The positioning service can be responded to quickly and necessary operations can be performed in time, thereby reducing the positioning downtime.

[0103] S408: When the action of acquiring the image information of the electronic component is not monitored again after the second time period ends, the tag of the positioning service is updated to the second tag.

[0104] It can be understood that when the action of acquiring the image information of the electronic component is not listened to again after the second time period, it means that you do not want to control the positioning service to continue positioning (for example, the positioning computing power required by the positioning service is large, and there is no need to continue the positioning service). In order to avoid the cessation of the positioning service causing the entire positioning process to be blocked, the label of the positioning service can be updated to the second label, so that the positioning service is discarded.

[0105] With such a configuration, when the second period of time has passed and no acquisition action of acquiring the image information of the electronic component is monitored again, the label of the positioning service is updated to the second label. The label of the positioning service can be flexibly adjusted according to the specific situation to ensure the overall smoothness and work efficiency of the positioning process.

[0106] In a possible implementation, after detecting the operation information of the positioning service in step S402, the electronic component positioning method based on machine vision further includes:

[0107] S430: When the operation information shows that the positioning service is being executed, the tag of the positioning service is updated to the first tag, wherein the tag of the positioning service is updated to the first tag to indicate that the form of the positioning service is the first form of service, and the control device maintains the activity of sending positioning information to the positioning device.

[0108] It can be understood that when the operation information reflects that the positioning service is being executed, it means that the current positioning service wants to continue or the current positioning service is being executed. Therefore, in order to avoid the positioning information corresponding to the current positioning service from being released, the label of the positioning service can be updated to the first label. Even if the operation information reflects that the positioning service has changed from being temporarily stopped to being executed (for example, the operation information reflects that the positioning service is temporarily stopped, and the system will automatically update the label of the positioning service to the second label in order to avoid congestion, resulting in the release of the positioning information corresponding to the current positioning service), the label of the positioning service can be updated to the first label in time to avoid the release of the positioning information corresponding to the current positioning service.

[0109] With such a configuration, when the operation information reflects that the positioning service is being executed, the tag of the positioning service is updated to the first tag, which can avoid releasing the positioning information unnecessarily, thereby ensuring the effectiveness and continuity of the positioning activity.

[0110] S440, when the operation information reflects that the positioning service is actively stopped, update the label of the positioning service to the second label. The operation information reflects that the positioning service is actively stopped to indicate that when the remaining number of repositioning times is equal to zero and the positioning service is still not completed, the form of the positioning service is the second form of service, and the control device and the positioning device do not maintain a positioning control channel, and the control device suspends the activity of sending positioning information to the positioning device.

[0111] It can be understood that the remaining number of repositioning times can be the remaining number of allowed repositioning attempts, for example, 1 time, 2 times, 3 times, etc.

[0112] For example, when the remaining number of repositioning times is equal to zero and the positioning service has not been completed, it means that the current positioning task cannot continue to run (for example, the positioning service cannot be completed due to a defect in an electronic component). That is, in order to avoid unlimited attempts to perform the positioning service, the current positioning task can be stopped when the remaining number of repositioning times is equal to zero and the positioning service has not been completed. That is, the control device and the positioning device do not maintain a positioning control channel, and the control device suspends the activity of sending positioning information to the positioning device. At the same time, in order to avoid the current positioning service blocking the entire positioning process, the label of the positioning service can be updated to the second label, so that the positioning information corresponding to the current positioning service will be released.

[0113] With such configuration, when the operation information reflects that the positioning service is actively stopped, the label of the positioning service is updated to the second label, and the positioning strategy can be dynamically adjusted to adapt to different tasks and environments.

[0114] In one possible implementation, see Figure 3 , the electronic component positioning method based on machine vision also includes:

[0115] S500, when the timestamp when the positioning device is ready to position the new electronic component is reached, a positioning adjustment signal is sent to the positioning device. The positioning adjustment signal carries the timestamp of starting positioning and the time difference of the transmission of the new positioning information. The time difference of the transmission of the positioning information is the time difference when the control device sends the new positioning information to the positioning device.

[0116] It can be understood that the start positioning timestamp can be the time when positioning is started, such as 7:00, 8:00, etc. The new positioning information transmission time difference can be that the control device sends positioning information to the positioning device every x seconds, and the value of x can be 1, 2, 3, etc. The smaller the value of x in the positioning information transmission time difference, the better the accuracy or response speed in the positioning process.

[0117] For example, when the timestamp at which the positioning device is ready to position a new electronic component arrives, it indicates that the new electronic component is to be positioned, and the old positioning information may not be applicable to the new electronic component (for example, different electronic components have different requirements for accuracy or response speed during the positioning process; for another example, the timestamp for starting positioning in the old positioning information is not applicable to the new electronic component). Therefore, in order to meet the requirements of the new electronic component for accuracy or response speed, a positioning adjustment signal can be sent to the positioning device.

[0118] With such an arrangement, when the time stamp at which the positioning device is ready to position a new electronic component is reached, a positioning adjustment signal is sent to the positioning device, and corresponding adjustments can be made according to the characteristics of the new electronic component, thereby improving the accuracy of positioning.

[0119] S600: When signal rejection data fed back by the positioning device is obtained before the positioning timestamp is started, the signal rejection data is analyzed to obtain a rejected signal.

[0120] It can be understood that the signal rejection data may be data for rejecting the resolution adjustment of the image of the electronic component, data for rejecting the adjustment of a certain function (such as laser irradiation, light source adjustment, etc.), data for rejecting the adjustment of old positioning information, etc.

[0121] For example, after the control device sends a positioning adjustment signal to the positioning device, it obtains signal rejection data sent by the positioning device. The control device may not adjust the positioning information transmission time difference, or may not adjust the start positioning timestamp. However, the signal rejection data may not be sent in response to the positioning adjustment signal. Such an operation will cause the positioning service to start at an incorrect timestamp, or to perform the positioning service with an incorrect positioning information transmission time difference, which will fail to meet the requirements for accuracy or response speed in the positioning process, resulting in low positioning efficiency.

[0122] For example, when signal rejection data is obtained from the positioning device before the positioning timestamp is started, it may mean that the adjustment of the old positioning information is rejected because the old positioning information can meet the requirements of accuracy or response speed in the current positioning process. It may also mean that only the adjustment of the resolution of the image of the electronic component is rejected. Therefore, in order to avoid the problems in the above scenarios, the signal rejection data can be analyzed to determine what data is rejected (for example, a detailed analysis of the data format and content to clarify which signals are rejected, such as whether it is image resolution, laser irradiation, light source adjustment or adjustment of old positioning information, etc.), that is, the signal rejection data is analyzed to obtain the rejected signal.

[0123] With this arrangement, when signal rejection data fed back by the positioning device is obtained before the start of the positioning timestamp, the signal rejection data is analyzed to obtain the rejected signal, which is beneficial for using the latest and valid data when starting positioning later, thereby improving the accuracy of position calculation.

[0124] S700: When the rejected signal does not match the positioning adjustment signal, determine that the positioning adjustment signal is feasible.

[0125] It can be understood that when the rejected signal does not match the positioning adjustment signal, it means that the signal rejection data is not sent in response to the positioning adjustment signal. Therefore, it is necessary to adjust the start positioning timestamp and the positioning information transmission time difference to meet the accuracy or response speed requirements in the current positioning process, that is, to execute the positioning adjustment signal, that is, to determine that the positioning adjustment signal is feasible.

[0126] For example, the matching method of the rejected signal and the positioning adjustment signal can be achieved by parameter matching or content matching. For example, the parameters in the rejected signal can be analyzed. If the parameters in the rejected signal are parameters of image resolution, it means that the rejected signal and the positioning adjustment signal do not match; otherwise, it means that they match. For another example, the content in the rejected signal can be analyzed. If the content in the rejected signal is content related to the image, it means that the rejected signal and the positioning adjustment signal do not match; otherwise, it means that they match.

[0127] With such a setting, when the rejected signal and the positioning adjustment signal do not match, the positioning adjustment signal is determined to be feasible, which can avoid the problem of misunderstanding that the old positioning information does not need to be adjusted, resulting in the inability to meet the requirements of accuracy or response speed in the current positioning process, and help improve the accuracy and efficiency of subsequent positioning.

[0128] In a possible implementation, in step S700, when the rejected signal does not match the positioning adjustment signal, after determining that the positioning adjustment signal is feasible, the electronic component positioning method based on machine vision further includes:

[0129] When the positioning start timestamp is reached, the positioning information is sent to the positioning device according to the time difference between the positioning service and the transmission time of the new positioning information.

[0130] It can be understood that a program is set to monitor the start timestamp of the positioning service, and a condition is set to trigger the next operation when this time is reached, that is, sending positioning information to the positioning device according to the transmission time difference between the positioning service and the new positioning information.

[0131] With this arrangement, when the positioning start timestamp is reached, positioning information is sent to the positioning device according to the time difference between the positioning service and the new positioning information transmission. This can standardize the positioning service process, avoid sending positioning information at inappropriate time points, and help improve the accuracy and efficiency of subsequent positioning.

[0132] S800: When the rejected signal matches the positioning adjustment signal, determine that the positioning adjustment signal is not feasible.

[0133] It can be understood that when the rejected signal matches the positioning adjustment signal, it means that the signal rejection data is sent in response to the positioning adjustment signal. Therefore, there is no need to adjust the start positioning timestamp and the positioning information transmission time difference, which means that the previous old positioning information can meet the requirements of accuracy or response speed in the current positioning process, that is, the positioning adjustment signal is not executed, which means that the positioning adjustment signal is determined to be not feasible.

[0134] With this arrangement, when the rejected signal matches the positioning adjustment signal, the positioning adjustment signal is determined to be infeasible and can be dynamically adjusted according to the specific situation, reducing the need for frequent adjustments and updates, making the positioning process simpler and helping to improve the accuracy and efficiency of subsequent positioning.

[0135] In a possible implementation, the electronic component positioning method based on machine vision also includes:

[0136] S801, obtaining first data corresponding to a rejected signal carried in signal rejection data, wherein the first data is used to reflect a rejection reason corresponding to the rejected signal.

[0137] It can be understood that the first data can be used to indicate that the problem of not being able to meet the requirements of accuracy or response speed in the positioning process has been solved, and can also be used to indicate that the current positioning adjustment signal cannot be processed. For example, the rejected signal is a positioning adjustment signal, and the corresponding rejection reason is that the problem of not being able to meet the requirements of accuracy or response speed in the positioning process has been solved, that is, there is no need to execute the positioning adjustment signal, so the position adjustment signal is not determined. For another example, the rejected signal is a positioning adjustment signal, and the corresponding rejection reason is that other operations of the positioning device are in progress, resulting in the positioning adjustment signal being unable to be processed, so the position adjustment signal is not determined.

[0138] For example, the first data corresponding to the rejected signal carried in the received signal rejection data may be captured from a message queue or a log file or may be extracted from the rejected signal carried in the acquired signal rejection data by a keyword (such as a reason).

[0139] With such a configuration, by obtaining the first data corresponding to the rejected signal carried in the signal rejection data, it can help it to adaptively adjust the working strategy to achieve intelligent operation of whether to send the rejected signal to the positioning device again in the future.

[0140] S802: Determine, based on the first data, whether it is possible to send a rejection signal to the positioning device again.

[0141] It can be understood that when the first data indicates that the problem that the accuracy or response speed requirement in the positioning process cannot be met has been solved, it is determined not to send the rejected signal to the positioning device again. When the first data indicates that the current positioning adjustment signal cannot be processed, it is determined that the rejected signal can be sent to the positioning device again.

[0142] With such an arrangement, it is determined whether a rejection signal can be sent to the positioning device again based on the first data, which can make the entire positioning process more intelligent and automated, and improve the accuracy of subsequent positioning processes.

[0143] S803: When it is determined that the rejection signal can be sent to the positioning device again, the rejection signal is sent to the positioning device again.

[0144] It can be understood that when it is determined that the rejected signal can be sent to the positioning device again, it means that the positioning adjustment signal is not currently processed. In order to meet the requirements of accuracy or response speed in the current positioning process, it is possible to wait for a period of time (for example, after other operations of the positioning device are completed, the positioning adjustment signal can be processed), and then send the rejected signal to the positioning device again to meet the requirements of accuracy or response speed in the current positioning process.

[0145] With such a setting, when it is determined that the rejected signal can be sent to the positioning device again, the rejected signal will be sent to the positioning device again. This can avoid the problem that the positioning adjustment signal is abnormally rejected and the requirements for accuracy or response speed cannot be met in the current positioning process, which is beneficial to improving subsequent positioning efficiency.

[0146] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0147] Corresponding to the electronic component positioning method based on machine vision described in the above embodiment, the embodiment of the present application also provides an electronic component positioning system based on machine vision, and each unit of the system can implement each step of the electronic component positioning method based on machine vision. Figure 4A structural block diagram of an electronic component positioning system based on machine vision provided in an embodiment of the present application is shown. For ease of explanation, only the parts related to the embodiment of the present application are shown.

[0148] Reference Figure 4 , the electronic component positioning system based on machine vision includes:

[0149] The acquisition unit is used to acquire image information of the electronic component, wherein the image information is used to reflect the type of the electronic component.

[0150] The monitoring unit is used to monitor a first operation, wherein the first operation is used to start a positioning action for the electronic component.

[0151] The detection unit is used to detect the placement of the electronic component, wherein the placement is used to reflect whether the electronic component is located in the positioning area of ​​the electronic component positioning device.

[0152] The analysis unit is used for the electronic component positioning device to perform positioning services based on the image information, the first operation and the placement situation.

[0153] It should be noted that the information interaction, execution process, etc. between the above-mentioned systems / units are based on the same concept as the method embodiment of the present application. Their specific functions and technical effects can be found in the method embodiment part and will not be repeated here.

[0154] Those skilled in the art can clearly understand that, for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned functions can be assigned to different functional units as needed, that is, the internal structure of the system can be divided into different functional units to complete all or part of the functions described above. The functional units in the embodiment can be integrated into a processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0155] The present application also provides an electronic component positioning device, Figure 5 This is a schematic diagram of the structure of a control device for an electronic component positioning device provided in one embodiment of the present application. Figure 5 As shown, the control device 6 of this embodiment includes: at least one processor 60 ( Figure 5 Only one is shown), at least one memory 61 ( Figure 5Only one is shown in the figure) and a computer program 62 stored in the at least one memory 61 and executable on the at least one processor 60. When the processor 60 executes the computer program 62, the control device 6 implements the steps in any of the above-mentioned electronic component positioning method embodiments based on machine vision, or implements the functions of the various units in the above-mentioned system embodiments.

[0156] Exemplarily, the computer program 62 may be divided into one or more units, which are stored in the memory 61 and executed by the processor 60 to complete the present application. The one or more units may be a series of computer program instruction segments capable of completing specific functions, which are used to describe the execution process of the computer program 62 in the control device 6.

[0157] The electronic component positioning device may include a positioning device and a control device 6 electrically connected to the positioning device. The positioning device may include a camera, a mechanical positioning device (such as a device composed of a guide rail, a mechanical arm and a servo motor), a sensor (such as a laser sensor or an ultrasonic sensor), etc. The camera is used to capture the image of the electronic component to obtain its appearance characteristics and model information. The mechanical positioning device is used to support, move and position the electronic component. The sensor is used to accurately measure the distance and position between the electronic component and the electronic product (such as a circuit board, a printed circuit board, etc.) on which the electronic component is to be positioned and installed, so as to detect whether the component is in the correct position. The control device 6 can determine whether the electronic component is the electronic component to be positioned by the image of the electronic component obtained by the camera. In the case of determining that it is the electronic component to be positioned, the positioning posture of the electronic component can be controlled by the sensor and the mechanical positioning device so that the electronic component is placed in the correct area of ​​the electronic product. The control device 6 may include, but is not limited to, a processor 60 and a memory 61. Those skilled in the art will understand that Figure 5 It is only an example of the control device 6 and does not constitute a limitation on the control device 6. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, it may also include input and output devices, network access devices, buses, etc.

[0158] The processor 60 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.

[0159] In some embodiments, the memory 61 may be an internal storage unit of the control device 6, such as a hard disk or memory of the control device 6. In other embodiments, the memory 61 may also be an external storage device of the control device 6, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the control device 6. Further, the memory 61 may also include both an internal storage unit and an external storage device of the control device 6. The memory 61 is used to store an operating system, an application program, a boot loader (BootLoader), data, and other programs, such as the program code of the computer program. The memory 61 may also be used to temporarily store data that has been output or is to be output.

[0160] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in any of the above method embodiments are implemented.

[0161] An embodiment of the present application provides a computer program product. When the computer program product is run on an electronic component positioning device, the electronic component positioning device is enabled to implement the steps in any of the above method embodiments.

[0162] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium. When the computer program is executed by the processor, the steps of the above-mentioned method embodiments can be implemented. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may at least include: any entity or device that can carry the computer program code to the electronic component positioning device, a recording medium, a computer memory, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), an electrical carrier signal, a telecommunication signal, and a software distribution medium. For example, a USB flash drive, a mobile hard disk, a disk or an optical disk.

[0163] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0164] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0165] In the embodiments provided in the present application, it should be understood that the disclosed electronic component positioning device, the electronic component positioning system based on machine vision, and the electronic component positioning method based on machine vision can be implemented in other ways. For example, the electronic component positioning device and the electronic component positioning system based on machine vision described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0166] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0167] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A method for locating electronic components based on machine vision, characterized in that: Applied to electronic component positioning equipment, the method comprises: Acquire image information of the electronic component; wherein the image information is used to reflect the type of the electronic component; Monitoring a first operation; wherein the first operation is used to start a positioning action for an electronic component; Detecting the placement of electronic components; wherein the placement is used to reflect whether the electronic components are located in the positioning area of ​​the electronic component positioning device; Based on the image information, the first operation and the placement situation, the electronic component positioning device performs a positioning service; The electronic component positioning device includes a control device and a positioning device, the control device and the positioning device are electrically connected, and based on the image information, the first operation and the placement situation, the electronic component positioning device performs a positioning service, including: In the case where the control device obtains that the image information matches the preset image library, if the first operation is monitored, the placement of the electronic component is detected; In the case where the placement situation reflects that the electronic component is located in the positioning area of ​​the positioning device of the electronic component positioning equipment, the control device controls the positioning device to perform a positioning service; Before the electronic component positioning device performs a positioning service based on the image information, the first operation and the placement situation, the method further includes: Sending positioning information to a positioning device based on the positioning service; Detecting the operation information of the positioning service; wherein the operation information is used to reflect the operation status of the positioning service; When the operation information reflects that the positioning service is temporarily stopped, the label of the positioning service is updated to a first label, and a first instruction corresponding to the positioning service is generated; when the action of the control device continuing to send positioning information to the positioning device is monitored within a first time period, the first instruction is deleted, and the positioning information is continued to be sent to the positioning device based on the positioning service; wherein the first label is the execution level of the first form of service, the execution level of the first form of service exceeds the execution level of the second form of service, and the control device releases the positioning information of each service whose execution level does not exceed the execution level of the second form of service; the first instruction is used to instruct that the label of the positioning service is updated to a second label after the first time period, and the second label does not exceed the execution level of the second form of service; When the operation information reflects that the positioning service is abnormally stopped, the label of the positioning service is updated to the first label, and a second instruction corresponding to the positioning service is generated; when the acquisition action of the image information of the electronic component is listened to again within the second time period, the second instruction is deleted, and the positioning information is continued to be sent to the positioning device based on the positioning service; wherein the second instruction is used to indicate that the label of the positioning service is updated to the second label after the second time period.

2. The method for locating electronic components based on machine vision according to claim 1, characterized in that: The operation information reflects that the positioning service is temporarily stopped, indicating that the form of the positioning service is the second form of service, and that the control device and the positioning device maintain a positioning control channel, and that the control device suspends the activity of sending the positioning information to the positioning device; the operation information reflects that the positioning service is abnormally stopped, indicating that the form of the positioning service is the second form of service, and that the control device and the positioning device do not maintain a positioning control channel, and that the control device suspends the activity of sending the positioning information to the positioning device.

3. The method for locating electronic components based on machine vision according to claim 1, characterized in that: The method further comprises: When the control device continues to send positioning information to the positioning device within the first time period, the first instruction is deleted, and the positioning information is continued to be sent to the positioning device based on the positioning service, and the operation information of the positioning service is continued to be detected; When the first signal is monitored within the first time period, or when the control device is not heard to continue sending positioning information to the positioning device after the first time period ends, the label of the positioning service is updated to the second label; wherein the first signal is used to indicate that the current positioning service is not to be executed.

4. The method for locating electronic components based on machine vision according to claim 1, characterized in that: The method further comprises: When the acquisition action of acquiring the image information of the electronic component is listened to again within the second time period, the second instruction is deleted, and the positioning information is continued to be sent to the positioning device based on the positioning service, and the operation information of the positioning service is continued to be detected; When the action of acquiring the image information of the electronic component is not monitored again after the second time period ends, the tag of the positioning service is updated to the second tag.

5. The method for locating electronic components based on machine vision according to claim 1, characterized in that: After detecting the operation information of the positioning service, the method further includes: When the operation information reflects that the positioning service is being executed, updating the label of the positioning service to the first label; wherein the label of the positioning service is updated to the first label to indicate that the form of the positioning service is the first form of service, and the control device maintains the activity of sending the positioning information to the positioning device; When the operation information reflects that the positioning service is actively stopped, the label of the positioning service is updated to the second label; wherein the operation information reflects that the positioning service is actively stopped to indicate that when the remaining number of repositioning times is equal to zero and the positioning service has not been completed, the form of the positioning service is the second form of service, and the control device and the positioning device do not maintain a positioning control channel, and the control device suspends the activity of sending the positioning information to the positioning device.

6. The method for locating electronic components based on machine vision according to claim 1, characterized in that: The method further comprises: When the timestamp when the positioning device is ready to position the new electronic component is reached, a positioning adjustment signal is sent to the positioning device; wherein the positioning adjustment signal carries the timestamp of starting positioning and the time difference of new positioning information transmission; the positioning information transmission time difference is the time difference of the control device sending the new positioning information to the positioning device most recently; In the case where signal rejection data fed back by the positioning device is obtained before the positioning start timestamp, analyzing the signal rejection data to obtain a rejected signal; In the case where the rejected signal does not match the positioning adjustment signal, determining that the positioning adjustment signal is feasible; In the event that the rejected signal matches the positioning adjustment signal, it is determined that the positioning adjustment signal is not feasible.

7. The method for locating electronic components based on machine vision as claimed in claim 6, characterized in that: In the case where the rejected signal does not match the positioning adjustment signal, after determining that the positioning adjustment signal is feasible, the method further includes: When the start positioning timestamp is reached, sending positioning information to the positioning device according to the transmission time difference between the positioning service and the new positioning information; Wherein, the method further comprises: Acquire first data corresponding to the rejected signal carried in the signal rejection data; wherein the first data is used to reflect the rejection reason corresponding to the rejected signal; determining, based on the first data, whether the rejected signal can be sent to the positioning device again; If it is determined that the rejected signal can be sent to the positioning device again, the rejected signal is sent to the positioning device again.

8. An electronic component positioning system based on machine vision, characterized in that: The electronic component positioning system based on machine vision is applied to electronic component positioning equipment, and the system includes: An acquisition unit, used to acquire image information of the electronic component; wherein the image information is used to reflect the type of the electronic component; A monitoring unit, configured to monitor a first operation; wherein the first operation is configured to start a positioning operation on an electronic component; A detection unit, used to detect the placement of the electronic component; wherein the placement is used to reflect whether the electronic component is located in the positioning area of ​​the electronic component positioning device; A control unit, configured to enable the electronic component positioning device to perform a positioning service based on the image information, the first operation and the placement condition; The electronic component positioning device includes a control device and a positioning device, the control device and the positioning device are electrically connected, and based on the image information, the first operation and the placement situation, the electronic component positioning device performs a positioning service, including: In the case where the control device obtains that the image information matches the preset image library, if the first operation is monitored, the placement of the electronic component is detected; In the case where the placement situation reflects that the electronic component is located in the positioning area of ​​the positioning device of the electronic component positioning equipment, the control device controls the positioning device to perform a positioning service; Before the electronic component positioning device performs a positioning service based on the image information, the first operation and the placement situation, the method further includes: Sending positioning information to a positioning device based on the positioning service; Detecting the operation information of the positioning service; wherein the operation information is used to reflect the operation status of the positioning service; When the operation information reflects that the positioning service is temporarily stopped, the label of the positioning service is updated to a first label, and a first instruction corresponding to the positioning service is generated; when the action of the control device continuing to send positioning information to the positioning device is monitored within a first time period, the first instruction is deleted, and the positioning information is continued to be sent to the positioning device based on the positioning service; wherein the first label is the execution level of the first form of service, the execution level of the first form of service exceeds the execution level of the second form of service, and the control device releases the positioning information of each service whose execution level does not exceed the execution level of the second form of service; the first instruction is used to instruct that the label of the positioning service is updated to a second label after the first time period, and the second label does not exceed the execution level of the second form of service; When the operation information reflects that the positioning service is abnormally stopped, the label of the positioning service is updated to the first label, and a second instruction corresponding to the positioning service is generated; when the acquisition action of the image information of the electronic component is listened to again within the second time period, the second instruction is deleted, and the positioning information is continued to be sent to the positioning device based on the positioning service; wherein the second instruction is used to indicate that the label of the positioning service is updated to the second label after the second time period.

Images