Electronic component positioning method and system based on machine vision

Abstract

The invention is suitable for the technical field of electronic component positioning, and particularly relates to an electronic component positioning method and system based on machine vision, and the method comprises the steps: obtaining the image information of an electronic component; monitoring a first operation; detecting the placement condition of the electronic component; and based on the image information, the first operation and the placement condition, the electronic component positioning equipment performs a positioning service. According to the electronic component positioning method based on machine vision provided by the invention, the problem that a traditional electronic component positioning process usually depends on manual inspection and positioning, and the problem of placement error or inaccurate positioning caused by judgment errors easily occurring in manual positioning is solved, so that the positioning efficiency is reduced.

Description

Technical Field

[0001] The present application belongs to the technical field of electronic component positioning, and in particular relates to a method and system for positioning an electronic component based on machine vision. Background Art

[0002] Electronic components are fundamental building blocks of electronic circuits, responsible for processing, controlling, and transmitting electrical energy or signals. Examples of these components include resistors, capacitors, transistors, and inductors. Electronic component positioning refers to the precise identification and placement of various electronic components on circuit boards during circuit design and manufacturing.

[0003] The traditional electronic component positioning process usually relies on manual inspection and positioning, but manual positioning is prone to misjudgment, resulting in placement errors or inaccurate positioning, which in turn leads to reduced positioning efficiency. Summary of the Invention

[0004] The embodiments of the present application provide a method and system for positioning electronic components based on machine vision, which can solve the problem that the traditional electronic component positioning process usually relies on manual inspection and positioning, and manual positioning is prone to misjudgment resulting in placement errors or inaccurate positioning, which in turn leads to reduced positioning efficiency.

[0005] In a first aspect, an embodiment of the present application provides a method for locating an electronic component based on machine vision, which is applied to an electronic component positioning device. The method includes: Acquire image information of the electronic component; wherein the image information is used to reflect the type of the electronic component; Monitoring a first operation; wherein the first operation is used to initiate a positioning action on the electronic component; Detecting the placement of electronic components; wherein the placement is used to reflect whether the electronic components are located in the positioning area of ​​the electronic component positioning device; Based on the image information, the first operation and the placement situation, the electronic component positioning device performs a positioning service.

[0006] The above technical solutions in the embodiments of the present application have at least the following technical effects: The electronic component positioning method based on machine vision provided by the present application can realize automated electronic component detection by acquiring image information reflecting the type of electronic components, so as to accurately find the required electronic components, reduce manual intervention, reduce the risk of human error, and provide data support for the subsequent positioning of electronic components. Secondly, by monitoring the first operation used to start the positioning action of the electronic component, the user can directly start the positioning activity through a simple operation to respond quickly, thereby effectively reducing positioning delay and helping to improve the positioning efficiency of the subsequent positioning process. Thirdly, by detecting the placement of the electronic components, it can be confirmed whether the electronic components are correctly placed in the positioning area of ​​the electronic component positioning device, thereby ensuring that the positioning action is only performed when the conditions are met, reducing ineffective work and helping to improve the work efficiency of the entire subsequent positioning process. Then, based on the image information, the first operation and the placement situation, the electronic component positioning device performs positioning services, which can more comprehensively understand the current situation, for example, whether the model of the electronic component is correct, whether the electronic component to be positioned is placed in the positioning area of ​​the electronic component positioning device, etc. By combining multiple information sources to achieve automatic positioning, the dependence on manual operation is reduced and the work efficiency of the positioning operation is improved.

[0007] In a second aspect, an embodiment of the present application provides an electronic component positioning system based on machine vision, which is applied to an electronic component positioning device and is used to implement the electronic component positioning method based on machine vision described in any one of the first aspects above. The electronic component positioning system based on machine vision includes: an acquisition unit, configured to acquire image information of the electronic component; wherein the image information is used to reflect the type of the electronic component; A monitoring unit, configured to monitor a first operation, wherein the first operation is configured to initiate a positioning operation on the electronic component; A detection unit, configured to detect the placement of the electronic component; wherein the placement is used to reflect whether the electronic component is located in the positioning area of ​​the electronic component positioning device; An analysis unit is configured to enable the electronic component positioning device to perform positioning services based on the image information, the first operation, and the placement condition.

[0008] In a third aspect, an embodiment of the present application provides an electronic component positioning device, comprising a positioning device and a control device electrically connected to the positioning device, the control device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the electronic component positioning method based on machine vision described in any one of the first aspects above is implemented.

[0009] It can be understood that the beneficial effects of the second to third aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the embodiments or descriptions of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0011] Figure 1 This is a flow chart of a method for locating an electronic component based on machine vision provided by an embodiment of the present application; Figure 2 This is a schematic diagram of the implementation flow of the positioning service in the electronic component positioning method based on machine vision provided in one embodiment of the present application; Figure 3 This is a schematic diagram of an implementation flow of determining whether a positioning adjustment signal is feasible in a method for positioning an electronic component based on machine vision provided in one embodiment of the present application; Figure 4 1 is a schematic diagram of the structure of an electronic component positioning system based on machine vision provided in an embodiment of the present application; Figure 5 Schematic diagram of the structure of the control device of the electronic component positioning device based on machine vision provided in an embodiment of the present application. DETAILED DESCRIPTION

[0012] In the following description, specific details such as specific system structures and techniques are provided for purposes of illustration rather than limitation to facilitate a thorough understanding of the embodiments of the present application. However, it will be apparent to those skilled in the art that the present application may be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to avoid obscuring the description of the present application with unnecessary detail.

[0013] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and / or components, but does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or collections thereof.

[0014] It will also be understood that the term "and / or" used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

[0015] As used in this specification and the appended claims, the term "if" can be interpreted as "when" or "upon" or "in response to determining" or "in response to detecting," depending on the context. Similarly, the phrases "if it is determined" or "if the described condition or event is detected" can be interpreted as meaning "upon determination" or "in response to determining" or "upon detection of the described condition or event" or "in response to detecting the described condition or event," depending on the context.

[0016] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0017] References to "one embodiment" or "some embodiments" in this specification mean that a particular feature, structure, or characteristic described in conjunction with that embodiment is included in one or more embodiments of the present application. Thus, phrases such as "in one embodiment," "in some embodiments," "in other embodiments," and "in other embodiments" appearing in various places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more but not all embodiments," unless otherwise specifically emphasized. The terms "including," "comprising," "having," and variations thereof all mean "including but not limited to," unless otherwise specifically emphasized.

[0018] In related technologies, electronic components are fundamental components of electronic circuits, responsible for processing, controlling, and transmitting electrical energy or signals. For example, electronic components can be resistors, capacitors, transistors, and inductors. Electronic component positioning refers to the accurate identification and placement of various electronic components on circuit boards during circuit design and manufacturing.

[0019] The traditional electronic component positioning process usually relies on manual inspection and positioning, but manual positioning is prone to misjudgment, resulting in placement errors or inaccurate positioning, which in turn leads to reduced positioning efficiency.

[0020] To solve the above problems, the embodiments of the present application provide a method and system for electronic component positioning based on machine vision.

[0021] In this method, by acquiring image information reflecting the type of electronic components, automated electronic component detection can be achieved to accurately locate the required electronic components, reduce manual intervention, lower the risk of human error, and provide data support for subsequent electronic component positioning. Secondly, by monitoring the first operation used to initiate the positioning action of the electronic component, the user can directly initiate the positioning activity through a simple operation, thereby quickly responding, effectively reducing positioning delays and helping to improve the positioning efficiency of the subsequent positioning process. Thirdly, by detecting the placement of the electronic components, it can be confirmed whether the electronic components are correctly placed within the positioning area of ​​the electronic component positioning device, thereby ensuring that positioning actions are only performed when conditions are met, reducing ineffective work and helping to improve the efficiency of the entire subsequent positioning process. Then, based on the image information, the first operation, and the placement situation, the electronic component positioning device performs positioning operations, which can provide a more comprehensive understanding of the current situation, such as whether the electronic component model is correct and whether the electronic component to be positioned is placed within the positioning area of ​​the electronic component positioning device. By combining multiple information sources to achieve automatic positioning, it reduces reliance on manual operation and improves the efficiency of positioning operations.

[0022] The electronic component positioning method based on machine vision provided in the embodiment of the present application can be applied to an electronic component positioning device. In this case, the electronic component positioning device is the execution entity of the electronic component positioning method based on machine vision provided in the embodiment of the present application. The embodiment of the present application does not impose any restrictions on the specific type of electronic component device.

[0023] For example, electronic component positioning equipment may include a positioning device and a control device electrically connected to the positioning device. The positioning device may include a camera, a mechanical positioning device (such as a device consisting of a guide rail, a robotic arm, and a servo motor), a sensor (such as a laser sensor or an ultrasonic sensor), etc. The camera is used to capture an image of the electronic component to obtain its appearance characteristics and model information. The mechanical positioning device is used to support, move, and position the electronic component. The sensor is used to accurately measure the distance and position between the electronic component and the electronic product (such as a circuit board, printed circuit board, etc.) on which the electronic component is to be positioned and installed to detect whether the component is in the correct position. The control device can determine whether the electronic component is the electronic component to be positioned based on the image of the electronic component captured by the camera. If it is determined that the electronic component is the electronic component to be positioned, the positioning posture of the electronic component can be controlled by the sensor and the mechanical positioning device to place the electronic component in the correct area of ​​the electronic product.

[0024] For example, the control device can be a mobile phone, tablet computer, notebook computer, ultra-mobile personal computer (UMPC), netbook, desktop computer, computing device or computer connected to a wireless modem, laptop computer, handheld communication device, handheld computing device, etc.

[0025] In order to better understand the electronic component positioning method based on machine vision provided in the embodiment of the present application, the specific implementation process of the electronic component positioning method based on machine vision provided in the embodiment of the present application is exemplarily introduced below.

[0026] Figure 1 A schematic flow chart of a method for locating an electronic component based on machine vision provided in an embodiment of the present application is shown. The method for locating an electronic component based on machine vision includes: S100: Acquire image information of an electronic component, wherein the image information is used to reflect the type of the electronic component.

[0027] It can be understood that the image information may be information about the electronic component model, specification information of the electronic component model, etc.

[0028] For example, a camera can be used to capture details of an electronic component, such as size, logo, color, and shape, to obtain image information reflecting the type of the electronic component. Alternatively, a camera can be used to capture an image of the electronic component, and for text or model identification on the image of the electronic component, optical character recognition (OCR) technology can be used to recognize the text in the image as editable text to obtain image information reflecting the type of the electronic component.

[0029] Such a setting can reduce manual intervention, lower the risk of human error, and provide data support for the subsequent positioning of electronic components.

[0030] S200: monitoring a first operation, wherein the first operation is used to start a positioning operation on an electronic component.

[0031] It is understood that the first operation can be a click or touch of a physical button or switch, or a click or touch of an interactive interface (such as a touchscreen). When the operator presses the button or touches the interactive interface, a signal is triggered to initiate the positioning of the electronic component. When the first operation is detected, the built-in positioning algorithm or positioning rules are used to calculate in real time the feedback information from the current electronic component image (such as the electronic component's position and orientation), thereby generating the required movement coordinates, positioning direction, and other information.

[0032] For example, the first operation can be monitored by a photoelectric sensor. The photoelectric sensor is set near a physical button or switch. For example, if the user clicks or touches the physical button or switch, the state of the photoelectric sensor can be used to monitor that the user has clicked or touched the physical button or switch. For another example, if the user has not clicked or touched the physical button or switch, the state of the photoelectric sensor can be used to monitor that the user has not clicked or touched the physical button or switch.

[0033] With this setting, by monitoring the first operation, users can directly start the positioning activity through simple operations to respond quickly, thereby effectively reducing positioning delays and helping to improve the positioning efficiency of subsequent positioning processes.

[0034] S300: Detecting the placement of electronic components, wherein the placement is used to reflect whether the electronic components are located in the positioning area of ​​the electronic component positioning device.

[0035] It can be understood that the positioning area can be an area where the mechanical positioning device can perform positioning activities, so that the subsequent mechanical positioning device can support, move and position the electronic component. For example, the positioning area can be the area where the positioning platform of the electronic component positioning equipment is located, the area where the mechanical positioning device can move, etc.

[0036] For example, a camera (such as an industrial camera) can be used to capture the positioning area, and an image processing algorithm (such as OpenCV) can be used to analyze the image to determine whether the electronic component is within the positioning area of ​​the electronic component positioning device. Alternatively, an acoustic wave sensor or infrared sensor installed in the positioning area can detect the distance between the electronic component and the sensor to determine whether the electronic component is within the positioning area of ​​the electronic component positioning device.

[0037] This setting ensures that positioning is performed only when the conditions are met, reducing ineffective work and helping to improve the efficiency of the entire subsequent positioning process.

[0038] S400: Based on the image information, the first operation and the placement situation, the electronic component positioning device performs a positioning service.

[0039] It can be understood that the positioning service may be a service of positioning electronic components on electronic products where the electronic components are to be positioned and installed.

[0040] For example, specific image processing algorithms (such as edge detection and contour recognition) can be used to extract features of image information. While monitoring the first operation, the image feedback information of the current electronic component (such as the position and orientation of the electronic component) is calculated in real time using a built-in positioning algorithm or positioning rules, thereby generating the required movement coordinates, positioning direction, and other information. If it is determined that the electronic component is located in the positioning area of ​​the electronic component positioning device, the image processing results of the image feedback information of the current electronic component are coordinated with the positioning action of the mechanical positioning device (for example, the action of the robotic arm is adjusted in real time based on the image feedback information, such as the position and orientation of the component), and a closed-loop control system is established to accurately place the electronic component.

[0041] For example, image information can be analyzed to determine whether the current model of the electronic component is the one required for positioning. If it is determined that the current model of the electronic component is the one required for positioning, a first operation is monitored to determine whether to initiate positioning of the electronic component, that is, whether the user currently has a positioning requirement. If the first operation is monitored, the placement of the electronic component is detected to determine whether the electronic component is located in the positioning area of ​​the electronic component positioning device, that is, whether positioning can be performed at the moment. If it is determined that the electronic component is located in the positioning area of ​​the electronic component positioning device, the electronic component positioning device can be activated to perform positioning services.

[0042] With this setting, the electronic component positioning device performs positioning services based on image information, the first operation and the placement situation, and can understand the current situation more comprehensively, for example, whether the model of the electronic component is correct, whether the electronic component to be positioned is placed within the positioning area of ​​the electronic component positioning device, etc. By combining multiple information sources to achieve automatic positioning, it reduces dependence on manual operation and improves the work efficiency of the positioning operation.

[0043] In one possible implementation, see Figure 2 S400: Based on the image information, the first operation and the placement situation, the electronic component positioning device performs a positioning service, including: S410: When the control device obtains image information that matches a preset image library and detects a first operation, the control device detects the placement of the electronic components.

[0044] It will be appreciated that the preset image library may include multiple images of electronic components to be located and corresponding features (e.g., size, shape, etc.) of the electronic components, with a mapping relationship between the images and features of the electronic components to be located. The preset image library may be obtained by a user inputting previously collected image information of the electronic components to be located into the library.

[0045] For example, features in the acquired image information are compared with features in a preset image library, and a matching algorithm (such as extracting feature points and matching them using descriptors) can be used to determine whether the type of the current electronic component matches the type of the electronic component to be located.

[0046] For example, the template image in the preset image library can also be compared pixel by pixel with the currently acquired image information to calculate the correlation score and the similarity between the image area in the image information and the template. If the similarity is high, it means a match; otherwise, it means a mismatch.

[0047] For example, when the control device obtains image information that matches the preset image library, it indicates that the current type of electronic component is the type of electronic component that needs to be positioned, so the first operation can be monitored to determine whether there is a positioning requirement at present. When the first operation is monitored, it can be determined whether the electronic component is located in the positioning area of ​​the electronic component positioning device, that is, whether the positioning activity can be performed at present, that is, the placement of the electronic component can be detected.

[0048] With such a setting, when the control device obtains image information that matches the preset image library, if the first operation is monitored, the placement of the electronic components is detected, and the type of the current electronic components can be accurately confirmed, so that subsequent operations (such as positioning or assembly) are based on the correct component type, avoiding losses caused by erroneous operations, and thereby improving subsequent positioning efficiency.

[0049] S420: When the placement situation indicates that the electronic component is located in the positioning area of ​​the positioning device of the electronic component positioning equipment, the control device controls the positioning device to perform a positioning service.

[0050] It can be understood that when the placement situation reflects that the electronic component is located in the positioning area of ​​the positioning device of the electronic component positioning equipment, it means that the positioning activity can be performed currently, so the control device can control the positioning device to perform the positioning service.

[0051] With such a setting, when the placement situation reflects that the electronic component is located in the positioning area of ​​the positioning device of the electronic component positioning equipment, the control device controls the positioning device to perform positioning services, and can achieve automatic positioning by combining multiple information sources, reducing dependence on manual operation and improving the work efficiency of the positioning operation.

[0052] In one possible implementation, in step S400, before the electronic component positioning device performs a positioning service based on the image information, the first operation, and the placement status, the electronic component positioning method based on machine vision further includes: S401: Send positioning information to a positioning device based on a positioning service.

[0053] It can be understood that the positioning information may be information required in the positioning process, such as information on the moving direction and arrangement orientation of the electronic component, information on the arrangement position of the electronic component, etc.

[0054] For example, the control device can send positioning information to the positioning device in response to a positioning service to control the positioning device to perform the positioning service. If the control device determines that the positioning service can be performed, it can send the currently calculated required movement coordinates, positioning direction, and other information to the positioning device via an electrical connection (e.g., wires, cables, etc.) to control the positioning device to perform the positioning service.

[0055] This arrangement sends positioning information to the positioning device based on the positioning service, reducing the need for human intervention, thereby reducing problems caused by human errors, such as incorrect placement of components or inaccurate positions, and thus improving positioning accuracy.

[0056] S402: Detecting the operation information of the positioning service, wherein the operation information is used to reflect the operation status of the positioning service.

[0057] It can be understood that the operation information can be used to indicate the operation status of the current positioning process, for example, the positioning service is ready to run, the positioning service is running, the positioning service has an abnormal failure, the operator controls the positioning service temporarily to stop through the control device, and other information.

[0058] For example, the sensor can monitor the displacement, speed, direction and other parameters in real time to detect the operation information of the current positioning service. During the execution of the positioning service, the positioning operation log information can be recorded and the operation information of the positioning service can be detected by querying the system log.

[0059] With this setting, by detecting the operation information of the positioning service, we can understand the current operation status of the positioning service, provide data support for subsequent decision-making, help optimize the positioning service process, and improve the overall positioning efficiency.

[0060] S403, when the operation information reflects that the positioning service is temporarily stopped, the label of the positioning service is updated to the first label, and the first instruction corresponding to the positioning service is generated. When the action of the control device continuing to send positioning information to the positioning device is monitored within the first time period, the first instruction is deleted, and the positioning information is continued to be sent to the positioning device based on the positioning service. Among them, the first label is the execution level of the first form of service. The execution level of the first form of service exceeds the execution level of the second form of service. The control device releases the positioning information of each service whose execution level does not exceed the execution level of the second form of service. The first instruction is used to indicate that the label of the positioning service will be updated to the second label after the first time period, and the second label does not exceed the execution level of the second form of service.

[0061] For example, to prevent the control device from blocking the entire positioning process due to an abnormality or cessation of a certain service, that is, to prevent a deadlock, the control device will determine that the positioning service is a second-type service (i.e., a service whose execution level does not exceed the execution level of the second-type service), and the control device will release the positioning information of each service whose execution level does not exceed the execution level of the second-type service. For example, if the control device determines that the service is a second-type service, the service will be stored in a service discard list, i.e., a list of positioning information corresponding to second-type services that can be discarded, to prevent the positioning information of the second-type service from blocking the entire positioning process. The first-type service may be a control service to be performed by the control device, and the second-type service is a control service that can be discarded by the control device.

[0062] For example, when executing a positioning service (in this case, the first form of service), the operator controls the positioning service to stop positioning for safety reasons (such as when personnel enter a dangerous area, etc.). In this scenario, the positioning service will be judged as a second form of service. When the personnel are away from the dangerous area, the operator wants to control the positioning service to continue positioning, but at this time the positioning service is judged as a second form of service and is discarded, so the positioning service cannot continue to perform positioning, resulting in low positioning efficiency.

[0063] For example, when executing a positioning service, the device stops abnormally due to resource limitations (such as power or computing power). In this scenario, the positioning service will be determined as a second-type service. After the resources are obtained, when the device wants to control the positioning service to continue positioning, the positioning service is determined to be a second-type service and is discarded. Therefore, the positioning service cannot continue positioning, resulting in low positioning efficiency.

[0064] For example, the first duration may be the duration for handling a safety incident (such as a person entering a dangerous area, etc.), for example, 1 minute, 2 minutes, 3 minutes, etc.

[0065] For example, if the operation information indicates that the positioning service is temporarily suspended, it indicates that the operator wishes to continue the positioning service. To prevent the positioning service from being discarded if it is determined to be the second type of service, the label of the positioning service can be updated to the first label (i.e., the execution level of the first type of service). Because the execution level of the first type of service exceeds that of the second type of service, it will not be discarded. To prevent the positioning service from being suspended for too long, thereby blocking the entire positioning process, the label of the positioning service can be updated to the second label (i.e., the first instruction) after a first duration. If the control device continues to send positioning information to the positioning device within the first duration, indicating that the operator wishes to control the positioning service to continue positioning, the first instruction can be deleted. This allows the positioning service to continue to be controlled even if the positioning service is determined to be the second type of service, i.e., to continue sending positioning information to the positioning device based on the positioning service. Monitoring the control device's continued transmission of positioning information to the positioning device can be achieved by querying system logs or sensors.

[0066] With this configuration, if the operation information indicates that the positioning service is temporarily suspended, the tag of the positioning service is updated to the first tag, and a first instruction corresponding to the positioning service is generated. If the control device monitors the control device continuing to send positioning information to the positioning device within the first duration, the first instruction is deleted, and positioning information continues to be sent to the positioning device based on the positioning service. This can reduce the risk of discarding positioning information due to being determined as a second type of service, thereby improving the efficiency of subsequent positioning.

[0067] At step S404, if the operation information indicates that the positioning service has been abnormally stopped, the tag of the positioning service is updated to the first tag, and a second instruction corresponding to the positioning service is generated. If the acquisition action of the electronic component image information is again monitored within the second duration, the second instruction is deleted, and positioning information is continued to be sent to the positioning device based on the positioning service. The second instruction is used to instruct the tag of the positioning service to be updated to the second tag after the second duration.

[0068] It is understood that when the operation information indicates that the positioning service has abnormally stopped, this indicates that although the current device has abnormally stopped due to resource limitations (such as power or computing power), resources are available to meet the normal operation of the current positioning service. To prevent the positioning service from being discarded if it is determined to be a second-type service, the positioning service tag can be updated to the first tag (i.e., the execution level of the first-type service). To prevent the positioning service from being stopped for too long, thereby blocking the entire positioning process, the positioning service tag can be updated to the second tag, i.e., the second instruction, after a second duration. If the acquisition action of acquiring image information of the electronic component is monitored within the second duration, it indicates that resources are available to meet the normal operation of the current positioning service, i.e., the positioning service can continue to perform positioning normally. Therefore, the second instruction can be deleted. In this way, even if the positioning service is determined to be a second-type service, the positioning service can be controlled to continue positioning, i.e., continue to send positioning information to the positioning device based on the positioning service. Monitoring the acquisition action of acquiring image information of the electronic component can be achieved by detecting changes in camera operation or querying logs to determine whether image information has been acquired.

[0069] With this configuration, if the operation information indicates that the positioning service has been abnormally stopped, the label of the positioning service is updated to the first label, and a second instruction corresponding to the positioning service is generated. If the acquisition action of the electronic component image information is again monitored within the second time period, the second instruction is deleted, and the positioning information is continued to be sent to the positioning device based on the positioning service. This can reduce the risk of discarding the positioning information due to being judged as the second type of service, thereby improving the efficiency of subsequent positioning.

[0070] In one possible implementation, the operation information reflecting that the positioning service is temporarily suspended indicates that the positioning service is in the second form, that the control device maintains a positioning control channel with the positioning device, and that the control device suspends sending positioning information to the positioning device. The operation information reflecting that the positioning service is abnormally suspended indicates that the positioning service is in the second form, that the control device does not maintain a positioning control channel with the positioning device, and that the control device suspends sending positioning information to the positioning device.

[0071] It can be understood that the positioning control channel can be a channel electrically connected between the control device and the positioning device, such as a digital signal channel, an electrical signal channel, etc., which is used to transmit instructions to the positioning device to achieve the purpose of controlling the positioning device to perform positioning services.

[0072] For example, when the positioning service is judged to be temporarily stopped, the form of the positioning service will be determined as the second form of service. At the same time, the temporary stop of the positioning service indicates that the control device and the positioning device maintain a positioning control channel, and the control device suspends the activity of sending positioning information to the positioning device, that is, the positioning service may be stopped for a short time, and it is not due to the inability to operate due to device failure.

[0073] For example, when the positioning service is judged to be abnormally stopped, the form of the positioning service will be determined as the second form of service. At the same time, the abnormal stop of the positioning service indicates that the control device and the positioning device have not maintained the positioning control channel (that is, the current power or computing power cannot meet the positioning service, so the positioning control channel cannot be maintained), and the control device suspends the activity of sending positioning information to the positioning device, that is, the positioning service may be abnormally stopped in a short period of time, and is not unable to operate due to a device failure.

[0074] This setting helps to quickly identify the status of the business during operation, making it easier to make corresponding judgments and decisions later.

[0075] In one possible implementation, the electronic component positioning method based on machine vision further includes: S405: When the control device monitors the action of continuing to send positioning information to the positioning device within the first time period, the first instruction is deleted, and the positioning information is continued to be sent to the positioning device based on the positioning service, and the operation information of the positioning service is continued to be detected.

[0076] It can be understood that when the control device is monitored to continue sending positioning information to the positioning device within the first time period, it means that it wants to control the positioning service to continue positioning, so the first instruction can be deleted. Therefore, the positioning information can continue to be sent to the positioning device based on the positioning service. At the same time, in order to avoid the temporary suspension of the positioning service, the operation information of the positioning service can continue to be detected, so that the label update operation can be performed when the positioning service is temporarily stopped.

[0077] With such a setting, when the control device is monitored to continue sending positioning information to the positioning device within the first time period, the first instruction is deleted, and the positioning information continues to be sent to the positioning device based on the positioning service, and the operation information of the positioning service continues to be detected. This allows for a quick response to the positioning service and timely execution of necessary operations, thereby reducing positioning downtime.

[0078] S406: When the first signal is monitored within the first time period, or after the first time period has expired, the control device is still not monitored to continue sending positioning information to the positioning device, the tag of the positioning service is updated to a second tag.

[0079] It can be understood that the first signal can be a digital signal or an electrical signal. For example, the first signal can be a signal sent by an operator to the control device, such as when a more serious safety incident (such as a production accident) needs to be handled at present, and the current positioning service is not executed.

[0080] For example, when the first signal is monitored within the first time period, or after the first time period has ended, the control device is still not heard to continue sending positioning information to the positioning device, which means that the positioning service is not wanted to be controlled to continue positioning. In order to avoid the stopping of the positioning service causing the entire positioning process to be blocked, the label of the positioning service can be updated to the second label, so that the positioning service is discarded.

[0081] With this setting, when the first signal is monitored within the first time period, or after the first time period has passed, the control device is still not heard to continue sending positioning information to the positioning device, the label of the positioning service will be updated to the second label. The label of the positioning service can be flexibly adjusted according to the specific situation to ensure the overall smoothness and work efficiency of the positioning process.

[0082] In one possible implementation, the electronic component positioning method based on machine vision further includes: S407: When the acquisition action of acquiring the image information of the electronic component is monitored again within the second time period, the second instruction is deleted, and the positioning information is continued to be sent to the positioning device based on the positioning service, and the operation information of the positioning service is continued to be detected.

[0083] It can be understood that when the action of acquiring image information of electronic components is monitored within the second time period, it means that there are resources that can meet the normal operation of the current positioning service, that is, the positioning service can continue to perform positioning normally, so the second instruction can be deleted. Therefore, the positioning information can continue to be sent to the positioning device based on the positioning service. At the same time, in order to avoid the abnormal stop of the positioning service, the operation information of the positioning service can continue to be detected, so that the label update operation can be performed when the positioning service is abnormally stopped.

[0084] With such a setting, when the action of acquiring image information of electronic components is monitored again within the second time period, the second instruction is deleted, and the positioning information is continued to be sent to the positioning device based on the positioning service, and the operation information of the positioning service is continued to be detected. This allows for a quick response to the positioning service and timely execution of necessary operations, thereby reducing the positioning downtime.

[0085] S408: When the second time period ends and no action of acquiring the image information of the electronic component is detected again, the tag of the positioning service is updated to the second tag.

[0086] It can be understood that when the second time period ends, the acquisition action of acquiring the image information of the electronic component is not listened to again, which means that you do not want to control the positioning service to continue positioning (for example, the positioning computing power required by the positioning service is large, and there is no need to continue the positioning service). In order to avoid the stopping of the positioning service causing the entire positioning process to be blocked, the label of the positioning service can be updated to the second label, so that the positioning service is discarded.

[0087] With this setting, when the second period ends and no acquisition action of the image information of the electronic component is detected again, the label of the positioning service is updated to the second label. The label of the positioning service can be flexibly adjusted according to the specific situation to ensure the overall smoothness and work efficiency of the positioning process.

[0088] In a possible implementation, after detecting the operation information of the positioning service in step S402, the electronic component positioning method based on machine vision further includes: S430: If the operation information indicates that the positioning service is being executed, the tag of the positioning service is updated to a first tag, wherein the tag of the positioning service is updated to the first tag to indicate that the positioning service is in the first form, and the control device maintains the activity of sending positioning information to the positioning device.

[0089] It can be understood that when the operation information reflects that the positioning service is being executed, it means that the current positioning service wants to continue or the current positioning service is being executed. Therefore, in order to avoid the positioning information corresponding to the current positioning service from being released, the label of the positioning service can be updated to the first label. Even if the operation information reflects that the positioning service has changed from being temporarily stopped to being executed (for example, the operation information reflects that the positioning service is temporarily stopped, and the system will automatically update the label of the positioning service to the second label in order to avoid congestion, resulting in the positioning information corresponding to the current positioning service being released), the label of the positioning service can be updated to the first label in time to avoid the positioning information corresponding to the current positioning service from being released.

[0090] With this configuration, when the operation information reflects that the positioning service is being executed, the tag of the positioning service is updated to the first tag, which can avoid releasing positioning information unnecessarily, thereby ensuring the effectiveness and continuity of the positioning activity.

[0091] S440: If the operation information indicates that the positioning service is actively stopped, update the tag of the positioning service to a second tag. The operation information indicating that the positioning service is actively stopped indicates that, when the remaining number of repositioning times is zero and the positioning service has not yet been completed, the positioning service is in the second type, and the control device and the positioning device do not maintain a positioning control channel, and the control device has suspended sending positioning information to the positioning device.

[0092] It can be understood that the remaining number of repositioning times may be the remaining number of allowed repositioning attempts, for example, 1, 2, 3, etc.

[0093] For example, when the remaining number of repositioning times is equal to zero and the positioning service has not been completed, it means that the current positioning task cannot continue to run (for example, the positioning service cannot be completed due to a defect in an electronic component). That is, in order to avoid unlimited attempts to perform the positioning service, the current positioning task can be stopped when the remaining number of repositioning times is equal to zero and the positioning service has not been completed. That is, the control device and the positioning device do not maintain a positioning control channel, and the control device suspends the activity of sending positioning information to the positioning device. At the same time, in order to avoid the current positioning service blocking the entire positioning process, the label of the positioning service can be updated to the second label, so that the positioning information corresponding to the current positioning service will be released.

[0094] With this configuration, when the operation information indicates that the positioning service is actively stopped, the label of the positioning service is updated to the second label, and the positioning strategy can be dynamically adjusted to adapt to different tasks and environments.

[0095] In one possible implementation, see Figure 3 , the electronic component positioning method based on machine vision also includes: S500: When the time stamp at which the positioning device is ready to locate a new electronic component is reached, a positioning adjustment signal is sent to the positioning device. The positioning adjustment signal carries the positioning start time stamp and the new positioning information transmission time difference. The positioning information transmission time difference is the time difference between the last time the control device sent new positioning information to the positioning device.

[0096] It is understood that the start positioning timestamp can be the time when positioning is started, such as 7:00, 8:00, etc. The new positioning information transmission time difference can be that the control device sends positioning information to the positioning device every x seconds, and the value of x can be 1, 2, 3, etc. The smaller the value of x in the positioning information transmission time difference, the better the accuracy or response speed of the positioning process.

[0097] For example, when the timestamp at which the positioning device is ready to locate a new electronic component arrives, it indicates that the new electronic component is to be located, and the old positioning information may not be applicable to the new electronic component (for example, different electronic components have different requirements for accuracy or response speed during the positioning process, or for another example, the timestamp at which positioning starts in the old positioning information is not applicable to the new electronic component). Therefore, in order to meet the accuracy or response speed requirements of the new electronic component, a positioning adjustment signal can be sent to the positioning device.

[0098] With this arrangement, when the time stamp at which the positioning device is ready to position a new electronic component is reached, a positioning adjustment signal is sent to the positioning device, which can make corresponding adjustments based on the characteristics of the new electronic component, thereby improving positioning accuracy.

[0099] S600: When signal rejection data fed back by the positioning device is obtained before the positioning start timestamp, the signal rejection data is analyzed to obtain a rejected signal.

[0100] It can be understood that the signal rejection data can be data that rejects the resolution adjustment of the image of the electronic component, data that rejects the adjustment of a certain function (such as laser irradiation, light source adjustment, etc.), data that rejects the adjustment of old positioning information, etc.

[0101] For example, after the control device sends a positioning adjustment signal to the positioning device, it obtains signal rejection data sent by the positioning device. The control device may not adjust the positioning information transmission time difference, or may not adjust the start positioning timestamp. However, the signal rejection data may not be sent in response to the positioning adjustment signal. Such an operation will cause the positioning service to start at an incorrect timestamp, or to perform the positioning service with an incorrect positioning information transmission time difference, and will not meet the requirements for accuracy or response speed in the positioning process, resulting in low positioning efficiency.

[0102] For example, when signal rejection data is obtained from the positioning device before the positioning timestamp is started, it may mean that the adjustment of the old positioning information is rejected because the previous old positioning information can meet the accuracy or response speed requirements of the current positioning process. It may also mean that only the adjustment of the resolution of the image of the electronic component is rejected. Therefore, in order to avoid the problems in the above scenarios, the signal rejection data can be analyzed to determine what data is rejected (for example, a detailed analysis of the data format and content to clarify which signals are rejected, such as whether it is image resolution, laser irradiation, light source adjustment or adjustment of old positioning information, etc.), that is, the signal rejection data can be analyzed to obtain the rejected signal.

[0103] With this configuration, when signal rejection data fed back by the positioning device is obtained before the start of positioning timestamp, the signal rejection data is analyzed to obtain the rejected signal, which is conducive to using the latest and valid data when starting positioning later, thereby improving the accuracy of position calculation.

[0104] S700 : When the rejected signal does not match the positioning adjustment signal, determine that the positioning adjustment signal is feasible.

[0105] It can be understood that when the rejected signal does not match the positioning adjustment signal, it means that the signal rejection data is not sent for the positioning adjustment signal. Therefore, the start positioning timestamp and the positioning information transmission time difference need to be adjusted to meet the accuracy or response speed requirements in the current positioning process, that is, to execute the positioning adjustment signal, that is, to determine that the positioning adjustment signal is feasible.

[0106] For example, the rejected signal and the positioning adjustment signal can be matched through parameter matching or content matching. For example, the parameters in the rejected signal can be analyzed. If the parameters in the rejected signal are image resolution parameters, the rejected signal and the positioning adjustment signal do not match; otherwise, they match. For another example, the content of the rejected signal can be analyzed. If the content in the rejected signal is image-related, the rejected signal and the positioning adjustment signal do not match; otherwise, they match.

[0107] With this setting, when the rejected signal and the positioning adjustment signal do not match, it is determined that the positioning adjustment signal is feasible, which can avoid the problem of mistakenly believing that the old positioning information does not need to be adjusted, resulting in the inability to meet the accuracy or response speed requirements in the current positioning process, and help improve the accuracy and efficiency of subsequent positioning.

[0108] In a possible implementation, in step S700, when the rejected signal does not match the positioning adjustment signal, after determining that the positioning adjustment signal is feasible, the electronic component positioning method based on machine vision further includes: When the positioning start timestamp is reached, the positioning information is sent to the positioning device according to the time difference between the positioning service and the transmission time of the new positioning information.

[0109] It can be understood that a program is set to monitor the start timestamp of the positioning service and set a condition to trigger the next operation when this time is reached, that is, sending positioning information to the positioning device based on the time difference between the positioning service and the new positioning information transmission.

[0110] With this setting, when the positioning start timestamp is reached, positioning information is sent to the positioning device based on the time difference between the positioning service and the new positioning information transmission. This can standardize the positioning service process, avoid sending positioning information at inappropriate time points, and help improve the accuracy and efficiency of subsequent positioning.

[0111] S800: When the rejected signal matches the positioning adjustment signal, determine that the positioning adjustment signal is not feasible.

[0112] It can be understood that when the rejected signal matches the positioning adjustment signal, it means that the signal rejection data is sent in response to the positioning adjustment signal. Therefore, there is no need to adjust the start positioning timestamp and the positioning information transmission time difference, which means that the previous old positioning information can meet the accuracy or response speed requirements in the current positioning process, that is, the positioning adjustment signal is not executed, which means that the positioning adjustment signal is determined to be not feasible.

[0113] With this setting, when the rejected signal matches the positioning adjustment signal, the positioning adjustment signal is determined to be infeasible and can be dynamically adjusted according to the specific situation, reducing the need for frequent adjustments and updates, making the positioning process simpler, and helping to improve the accuracy and efficiency of subsequent positioning.

[0114] In one possible implementation, the electronic component positioning method based on machine vision further includes: S801: Acquire first data corresponding to a rejected signal carried in signal rejection data, wherein the first data is used to reflect a rejection reason corresponding to the rejected signal.

[0115] It is understood that the first data can be used to indicate that the problem of not being able to meet the accuracy or response speed requirements during the positioning process has been resolved, or it can be used to indicate that the current positioning adjustment signal cannot be processed. For example, if the rejected signal is a positioning adjustment signal, the corresponding rejection reason is that the problem of not being able to meet the accuracy or response speed requirements during the positioning process has been resolved, that is, there is no need to execute the positioning adjustment signal, so the positioning adjustment signal is rejected. For another example, if the rejected signal is a positioning adjustment signal, the corresponding rejection reason is that other operations of the positioning device are in progress, resulting in the positioning adjustment signal being unable to be processed, so the positioning adjustment signal is rejected.

[0116] For example, the first data corresponding to the rejected signal carried in the received signal rejection data can be captured from a message queue or a log file or can be extracted from the rejected signal carried in the received signal rejection data using a keyword (such as a reason).

[0117] With such a configuration, by obtaining the first data corresponding to the rejected signal carried in the signal rejection data, it can help it to adaptively adjust the working strategy to achieve intelligent operation of whether to send the rejected signal to the positioning device again in the future.

[0118] S802: Determine, based on the first data, whether it is possible to send a rejection signal to the positioning device again.

[0119] It is understood that if the first data indicates that the problem of not being able to meet the accuracy or response speed requirements during the positioning process has been resolved, it is determined not to send the rejection signal to the positioning device again. If the first data indicates that the current positioning adjustment signal cannot be processed, it is determined that the rejection signal can be sent to the positioning device again.

[0120] With such a configuration, determining whether a rejection signal can be sent to the positioning device again based on the first data can make the entire positioning process more intelligent and automated, thereby improving the accuracy of subsequent positioning processes.

[0121] S803: If it is determined that the rejection signal can be sent to the positioning device again, the rejection signal is sent to the positioning device again.

[0122] It can be understood that when it is determined that the rejection signal can be sent to the positioning device again, it means that the positioning adjustment signal is not currently processed. In order to meet the requirements of accuracy or response speed in the current positioning process, it is possible to wait for a period of time (for example, after other operations of the positioning device are completed, the positioning adjustment signal can be processed) and then send the rejection signal to the positioning device again to meet the requirements of accuracy or response speed in the current positioning process.

[0123] With such a setting, when it is determined that the rejection signal can be sent to the positioning device again, the rejection signal will be sent to the positioning device again. This can avoid the problem that the positioning adjustment signal is abnormally rejected and the requirements for accuracy or response speed in the current positioning process cannot be met, which is beneficial to improving subsequent positioning efficiency.

[0124] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0125] Corresponding to the electronic component positioning method based on machine vision described in the above embodiment, the embodiment of the present application also provides an electronic component positioning system based on machine vision, and each unit of the system can implement each step of the electronic component positioning method based on machine vision. Figure 4 A structural block diagram of an electronic component positioning system based on machine vision provided in an embodiment of the present application is shown. For ease of explanation, only the parts related to the embodiment of the present application are shown.

[0126] Reference Figure 4 , the electronic component positioning system based on machine vision includes: The acquisition unit is used to acquire image information of the electronic component, wherein the image information is used to reflect the type of the electronic component.

[0127] The monitoring unit is configured to monitor a first operation, wherein the first operation is configured to start a positioning operation on the electronic component.

[0128] The detection unit is used to detect the placement of the electronic component, wherein the placement is used to reflect whether the electronic component is located in the positioning area of ​​the electronic component positioning device.

[0129] The analysis unit is used for the electronic component positioning device to perform positioning services based on the image information, the first operation and the placement situation.

[0130] It should be noted that the information interaction, execution process, etc. between the above-mentioned systems / units are based on the same concept as the method embodiment of this application. Their specific functions and technical effects can be found in the method embodiment section and will not be repeated here.

[0131] Those skilled in the art can clearly understand that, for the convenience and brevity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In actual applications, the above-mentioned functions can be distributed and completed by different functional units as needed, that is, the internal structure of the system can be divided into different functional units to complete all or part of the functions described above. The functional units in the embodiment can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0132] The present application also provides an electronic component positioning device. Figure 5 This is a schematic diagram of the structure of the control device of the electronic component positioning device provided in one embodiment of the present application. Figure 5 As shown, the control device 6 of this embodiment includes: at least one processor 60 ( Figure 5 Only one is shown), at least one memory 61 ( Figure 5 Only one is shown in the figure) and a computer program 62 stored in the at least one memory 61 and executable on the at least one processor 60. When the processor 60 executes the computer program 62, the control device 6 implements the steps of any of the above-mentioned electronic component positioning method embodiments based on machine vision, or implements the functions of the various units in the above-mentioned system embodiments.

[0133] For example, the computer program 62 may be divided into one or more units, which are stored in the memory 61 and executed by the processor 60 to implement the present application. The one or more units may be a series of computer program instruction segments capable of implementing specific functions, and the instruction segments are used to describe the execution process of the computer program 62 in the control device 6.

[0134] The electronic component positioning device may include a positioning device and a control device 6 electrically connected to the positioning device. The positioning device may include a camera, a mechanical positioning device (such as a device composed of a guide rail, a robotic arm and a servo motor), a sensor (such as a laser sensor or an ultrasonic sensor), etc. The camera is used to capture the image of the electronic component to obtain its appearance characteristics and model information. The mechanical positioning device is used to support, move and position the electronic component. The sensor is used to accurately measure the distance and position between the electronic component and the electronic product (such as a circuit board, a printed circuit board, etc.) on which the electronic component is to be positioned and installed, so as to detect whether the component is in the correct position. The control device 6 can determine whether the electronic component is the electronic component to be positioned by the image of the electronic component obtained by the camera. In the case of determining that it is the electronic component to be positioned, the positioning posture of the electronic component can be controlled by the sensor and the mechanical positioning device so that the electronic component is placed in the correct area of ​​the electronic product. The control device 6 may include, but is not limited to, a processor 60 and a memory 61. Those skilled in the art will understand that Figure 5 This is merely an example of the control device 6 and does not constitute a limitation on the control device 6 . The control device 6 may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, it may also include input and output devices, network access devices, buses, etc.

[0135] The processor 60 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor.

[0136] In some embodiments, the memory 61 may be an internal storage unit of the control device 6, such as a hard drive or memory of the control device 6. In other embodiments, the memory 61 may also be an external storage device of the control device 6, such as a plug-in hard drive, a Smart Media Card (SMC), a Secure Digital (SD) card, a flash memory card, etc. equipped on the control device 6. Furthermore, the memory 61 may include both the internal storage unit of the control device 6 and an external storage device. The memory 61 is used to store an operating system, application programs, a boot loader, data, and other programs, such as the program code of the computer program. The memory 61 may also be used to temporarily store data that has been output or is about to be output.

[0137] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in any of the above method embodiments are implemented.

[0138] An embodiment of the present application provides a computer program product. When the computer program product is run on an electronic component positioning device, the electronic component positioning device is enabled to implement the steps of any of the above method embodiments.

[0139] If the integrated unit is implemented as a software functional unit and sold or used as a standalone product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the process steps in the above-mentioned method embodiments by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium. When executed by a processor, the computer program can implement the steps of each of the above-mentioned method embodiments. The computer program includes computer program code, which can be in source code form, object code form, executable file, or some intermediate form. The computer-readable medium can include at least: any entity or device capable of carrying the computer program code to the electronic component positioning device, a recording medium, computer memory, read-only memory (ROM), random access memory (RAM), an electrical carrier signal, a telecommunications signal, and a software distribution medium. Examples include a USB flash drive, a removable hard drive, a magnetic disk, or an optical disk.

[0140] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant description of other embodiments.

[0141] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0142] In the embodiments provided in the present application, it should be understood that the disclosed electronic component positioning device, the electronic component positioning system based on machine vision, and the electronic component positioning method based on machine vision can be implemented in other ways. For example, the electronic component positioning device and the electronic component positioning system based on machine vision described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0143] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of the solution of this embodiment according to actual needs.

[0144] The above-described embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present application, and should all be included in the scope of protection of the present application.

Claims

1. A method for locating electronic components based on machine vision, characterized in that: Applied to electronic component positioning equipment, the method comprises: Acquire image information of the electronic component; wherein the image information is used to reflect the type of the electronic component; Monitoring a first operation; wherein the first operation is used to start a positioning action for an electronic component; Detecting the placement of electronic components; wherein the placement is used to reflect whether the electronic components are located in the positioning area of ​​the electronic component positioning device; Based on the image information, the first operation and the placement situation, the electronic component positioning device performs a positioning service.

2. The method for locating electronic components based on machine vision according to claim 1, characterized in that: The electronic component positioning device includes a control device and a positioning device, the control device and the positioning device are electrically connected, and based on the image information, the first operation and the placement situation, the electronic component positioning device performs a positioning service, including: In the case where the control device obtains that the image information matches the preset image library, if the first operation is monitored, the placement of the electronic component is detected; In a case where the placement situation reflects that the electronic component is located in a positioning area of ​​the positioning device of the electronic component positioning equipment, the control device controls the positioning device to perform a positioning service.

3. The method for locating electronic components based on machine vision according to claim 1, characterized in that: Before the electronic component positioning device performs a positioning service based on the image information, the first operation and the placement situation, the method further includes: Sending positioning information to a positioning device based on the positioning service; Detecting the operation information of the positioning service; wherein the operation information is used to reflect the operation status of the positioning service; When the operation information reflects that the positioning service is temporarily stopped, the label of the positioning service is updated to a first label, and a first instruction corresponding to the positioning service is generated; when the action of the control device continuing to send positioning information to the positioning device is monitored within a first time period, the first instruction is deleted, and the positioning information is continued to be sent to the positioning device based on the positioning service; wherein the first label is the execution level of the first form of service, the execution level of the first form of service exceeds the execution level of the second form of service, and the control device releases the positioning information of each service whose execution level does not exceed the execution level of the second form of service; the first instruction is used to instruct that the label of the positioning service is updated to a second label after the first time period, and the second label does not exceed the execution level of the second form of service; When the operation information reflects that the positioning service is abnormally stopped, the label of the positioning service is updated to the first label, and a second instruction corresponding to the positioning service is generated; when the acquisition action of the image information of the electronic component is listened to again within the second time period, the second instruction is deleted, and the positioning information is continued to be sent to the positioning device based on the positioning service; wherein the second instruction is used to indicate that the label of the positioning service is updated to the second label after the second time period.

4. The method for locating electronic components based on machine vision as claimed in claim 3, characterized in that: The operation information reflects that the positioning service is temporarily stopped, indicating that the form of the positioning service is the second form of service, and that the control device and the positioning device maintain a positioning control channel, and that the control device suspends the activity of sending the positioning information to the positioning device; the operation information reflects that the positioning service is abnormally stopped, indicating that the form of the positioning service is the second form of service, and that the control device and the positioning device do not maintain a positioning control channel, and that the control device suspends the activity of sending the positioning information to the positioning device.

5. The method for locating electronic components based on machine vision as claimed in claim 3, characterized in that: The method further comprises: When the control device continues to send positioning information to the positioning device within the first time period, the first instruction is deleted, and the positioning information is continued to be sent to the positioning device based on the positioning service, and the operation information of the positioning service is continued to be detected; When the first signal is monitored within the first time period, or when the control device is not heard to continue sending positioning information to the positioning device after the first time period ends, the label of the positioning service is updated to the second label; wherein the first signal is used to indicate that the current positioning service is not to be executed.

6. The method for locating electronic components based on machine vision as claimed in claim 3, characterized in that: The method further comprises: When the acquisition action of acquiring the image information of the electronic component is listened to again within the second time period, the second instruction is deleted, and the positioning information is continued to be sent to the positioning device based on the positioning service, and the operation information of the positioning service is continued to be detected; When the action of acquiring the image information of the electronic component is not monitored again after the second time period ends, the tag of the positioning service is updated to the second tag.

7. The method for locating electronic components based on machine vision as claimed in claim 3, characterized in that: After detecting the operation information of the positioning service, the method further includes: When the operation information reflects that the positioning service is being executed, updating the label of the positioning service to the first label; wherein the label of the positioning service is updated to the first label to indicate that the form of the positioning service is the first form of service, and the control device maintains the activity of sending the positioning information to the positioning device; When the operation information reflects that the positioning service is actively stopped, the label of the positioning service is updated to the second label; wherein the operation information reflects that the positioning service is actively stopped to indicate that when the remaining number of repositioning times is equal to zero and the positioning service has not been completed, the form of the positioning service is the second form of service, and the control device and the positioning device do not maintain a positioning control channel, and the control device suspends the activity of sending the positioning information to the positioning device.

8. The method for locating electronic components based on machine vision as claimed in claim 3, characterized in that: The method further comprises: When the timestamp when the positioning device is ready to position the new electronic component is reached, a positioning adjustment signal is sent to the positioning device; wherein the positioning adjustment signal carries the timestamp of starting positioning and the time difference of new positioning information transmission; the positioning information transmission time difference is the time difference of the control device sending the new positioning information to the positioning device most recently; In the case where signal rejection data fed back by the positioning device is obtained before the positioning start timestamp, analyzing the signal rejection data to obtain a rejected signal; In a case where the rejected signal does not match the positioning adjustment signal, determining that the positioning adjustment signal is feasible; In the event that the rejected signal matches the positioning adjustment signal, it is determined that the positioning adjustment signal is not feasible.

9. The method for locating electronic components based on machine vision as claimed in claim 8, characterized in that: In the case where the rejected signal does not match the positioning adjustment signal, after determining that the positioning adjustment signal is feasible, the method further includes: When the positioning start timestamp is reached, sending positioning information to the positioning device according to the transmission time difference between the positioning service and the new positioning information; Wherein, the method further comprises: Acquire first data corresponding to the rejected signal carried in the signal rejection data; wherein the first data is used to reflect the rejection reason corresponding to the rejected signal; determining, based on the first data, whether the rejected signal can be sent to the positioning device again; If it is determined that the rejected signal can be sent to the positioning device again, the rejected signal is sent to the positioning device again.

10. An electronic component positioning system based on machine vision, characterized in that: The electronic component positioning system based on machine vision is applied to electronic component positioning equipment, and the system includes: An acquisition unit, used to acquire image information of the electronic component; wherein the image information is used to reflect the type of the electronic component; A monitoring unit, configured to monitor a first operation; wherein the first operation is configured to start a positioning operation on an electronic component; A detection unit, used to detect the placement of the electronic component; wherein the placement is used to reflect whether the electronic component is located in the positioning area of ​​the electronic component positioning device; A control unit is used for enabling the electronic component positioning device to perform positioning services based on the image information, the first operation and the placement situation.

Images