Component assembling control method, system and equipment

Abstract

The invention discloses a component assembly control method, system and equipment, and the method comprises the steps: obtaining a first scanning result of a material code of a first component in a target station, and comparing the first scanning result with pre-authorized assembly material information to obtain a material code verification result; under the condition that the material code checking result is that checking is passed, a component image after the first component is assembled is collected, and whether the assembling state of the first component meets the standard assembling state condition or not is detected according to the component image; and when it is detected that the assembly state of the first assembly meets the standard assembly state condition, it is determined that the first assembly is successfully assembled, and the assembly assembly record is updated according to the first scanning result. Therefore, the automatic quality control level and the overall assembly yield of the assembly line are remarkably improved.

Description

Technical Field

[0001] This application relates to the field of industrial automation testing technology, and in particular to a component assembly control method, system and equipment. Background Technology

[0002] In the electronics manufacturing industry, manual assembly remains the mainstream method for assembling precision components (such as mobile phone back covers, PCBAs, and device covers). Traditional quality control relies heavily on operator visual inspection and handheld barcode scanners, manually comparing material code information to confirm component models. However, visual inspection is susceptible to operator fatigue and experience differences, making it difficult to consistently detect micron-level assembly deviations. This leads to misassembly, omissions, and reverse assembly (referred to as "misassembly, omissions, and reverse assembly") flowing into subsequent processes. The rework rate caused by misassembly, omissions, and reverse assembly significantly increases production costs on consumer electronics assembly lines.

[0003] With the continuous improvement of automation and intelligence in the manufacturing industry, the component assembly process is gradually shifting from manual operation to automated or semi-automated control. The assembly process typically involves the sequential installation of multiple components, such as the base shell, printed circuit board assembly, and top cover. The accuracy of each assembly step directly affects the reliability and consistency of the final product. To improve assembly efficiency, some production lines have introduced barcode scanners or fixed barcode readers to verify whether the assembled materials match the work order information; however, the overall inspection process still relies heavily on manual judgment. After assembly, the component's assembly quality is usually confirmed through sampling or subsequent process inspection. However, this method suffers from problems such as inspection lag, low efficiency, and difficulty in quality traceability, making it difficult to detect abnormalities in the assembly process in a timely manner. Summary of the Invention

[0004] This application provides a component assembly control method, system, device, storage medium, and program product to at least solve one of the above-mentioned technical problems.

[0005] In a first aspect, embodiments of this application provide a component assembly control method, comprising: acquiring a first scan result of the material code of a first component in a target workstation, and comparing the first scan result with pre-authorized assembly material information to obtain a material code verification result; if the material code verification result is successful, acquiring a component image of the first component after assembly, and detecting whether the assembly state of the first component meets standard assembly state conditions based on the component image; the assembly state includes the component installation position and / or the component installation direction; if the assembly state of the first component is detected to meet the standard assembly state conditions, determining that the first component has been successfully assembled, and updating the component assembly record based on the first scan result.

[0006] Secondly, embodiments of this application provide a component assembly control system, including: an image acquisition device for scanning images of components within a target workstation; and a control device for executing the steps of the method described above in this application.

[0007] Thirdly, embodiments of this application provide a storage medium storing one or more programs including execution instructions, which can be read and executed by electronic devices (including but not limited to computers, servers, or network devices) to perform any of the component assembly control methods described above in this application.

[0008] Fourthly, a computer device is provided, comprising: at least one processor, and a memory communicatively connected to the at least one processor, wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform any of the component assembly control methods described above in this application.

[0009] Fifthly, embodiments of this application also provide a computer program product, the computer program product including a computer program stored on a storage medium, the computer program including program instructions, which, when executed by a computer, cause the computer to execute any of the above-described component assembly control methods.

[0010] The beneficial effects of the embodiments of this application are as follows: After the material code comparison is successful, the assembled components undergo image inspection to determine whether the component installation status meets the standards. The assembly record is updated when both inspections pass. This enables real-time, traceable quality control of the assembly process, allowing for the immediate identification and prevention of abnormal assembly at the workstation level. This ensures the consistency and quality of component assembly, achieving simultaneous verification of assembly correctness and quality, thereby significantly improving the level of automated quality control and overall assembly yield of the assembly production line. Attached Figure Description

[0011] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0012] Figure 1 A flowchart illustrating an example of a component assembly control method according to an embodiment of this application is shown; Figure 2 A flowchart illustrating an example of a component assembly control method according to an embodiment of this application is shown; Figure 3 A flowchart illustrating an example of detecting the assembly state of a first component based on a component image according to an embodiment of this application is shown. Figure 4 A structural block diagram of an example of a component assembly control system according to an embodiment of this application is shown; Figure 5 A schematic diagram of the architecture of an example component assembly control system according to an embodiment of this application is shown; Figure 6 A system operation signaling timing flowchart of an example of a component assembly control system according to an embodiment of this application is shown; Figure 7 This is a schematic diagram of the structure of an embodiment of the electronic device of this application. Detailed Implementation

[0013] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application. It should be noted that, unless otherwise specified, the embodiments and features in the embodiments of this application can be combined with each other.

[0014] It should also be noted that, in this document, the terms "comprising" or "including" include not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0015] It should be noted that, in the current related technologies, although some visual inspection equipment can recognize assembly images, they lack a linkage mechanism with the barcode scanning process and workstation instructions, resulting in inspection lag and feedback delay, making it difficult to form effective process control; operators usually lack standardized voice or image prompts, and are prone to affecting assembly consistency and yield rate due to operational errors or misunderstandings.

[0016] Furthermore, the verification mechanism based on simple barcode scanning only performs a single material information check, which is susceptible to human error, scanning errors, or system information delays. It cannot monitor the risk of material replacement during assembly, resulting in a mismatch between assembly materials and work order information. When an operator mistakenly uses a substitute component, the system cannot trace the original material record, leading to a gap between product serial numbers and component batch information.

[0017] It should be understood that the above description of the relevant technologies is intended only to help the public better understand the inventive spirit and motivation of this application, and is not intended to limit this application. Furthermore, the technical solutions described in the above-mentioned relevant technologies are not prior art, and may also be undisclosed technical solutions, such as those under research or in the laboratory stage.

[0018] The technical solutions in this application, including the collection, storage, use, processing, transmission, provision, and disclosure of users' personal information, comply with relevant laws and regulations and do not violate public order and good morals.

[0019] Figure 1 A flowchart illustrating an example of a component assembly control method according to an embodiment of this application is shown.

[0020] Regarding the execution subject of the method in the embodiments of this application, it can be any controller or processor with computing or processing capabilities. In some examples, the method in the embodiments of this application can be integrated and configured in an electronic device or terminal through software, hardware or a combination of software and hardware, and the type of terminal or electronic device can be diverse, such as mobile phone, tablet computer, desktop computer or vehicle terminal, etc.

[0021] For example, the execution subject of the method in this application embodiment can be a component assembly control platform, which forms a quality closed loop with digital verification and visual inspection as dual constraints at the manufacturing execution layer, so that abnormal parts can be intercepted at the workstation level in real time, thereby realizing automated control, real-time quality assurance and full-process traceability of the assembly process.

[0022] like Figure 1 As shown, in step S110, the first scan result of the material code of the first component in the target workstation is obtained, and the first scan result is compared with the pre-authorized assembly material information to obtain the material code verification result.

[0023] In some implementations, material identification information (such as QR code, barcode or RFID) of the component to be assembled is obtained by scanning a code, and this information is compared with the pre-set assembly bill of materials (BOM) and authorized configuration information in the system to determine whether the component belongs to the material range allowed to be used in the current workstation or current process, thereby realizing the authentication of the assembly permission of the input material.

[0024] More specifically, the target workstation can be scanned using a barcode scanner or visual recognition module, and the scanning results can be uploaded to the host computer system or component assembly control platform via Ethernet or bus. The material code can be a QR code with encrypted information, including the material number, supply batch, production date, version number, etc., to ensure uniqueness and traceability.

[0025] For example, material-level traceability can be supported by retrieving pre-authorized assembly material information for the current workstation, such as allowed component models, from the MES (Manufacturing Execution System) or a local database. Furthermore, during the comparison process, the assembly sequence of materials can be verified simultaneously (e.g., the first component must be installed before the second component) to prevent assembly logic errors and avoid assembly errors caused by operators mispicking or misinstalling materials.

[0026] In step S120, if the material code verification result is successful, the assembly image of the first component is acquired, and the assembly status of the first component is detected based on the component image to see if it meets the standard assembly status conditions. The assembly status includes the component installation position and / or the component installation direction.

[0027] During the assembly status inspection stage, image information of the assembled components is acquired through industrial cameras or machine vision systems, and image recognition algorithms are used to determine the installation position and / or installation direction of the components to determine whether the assembly result meets the standard assembly status conditions, thereby realizing automated quality inspection and error prevention mechanisms.

[0028] In some implementations, after an assembly completion signal is triggered, the image acquisition device is automatically controlled to take pictures. For example, the operator issues a trigger signal after completing the assembly of the first component, or the image acquisition device performs real-time monitoring and identification. The image acquisition device can be a fixedly installed industrial camera, a multi-angle camera array, or a mobile vision module in conjunction with a robotic arm. Preferably, the acquisition parameters of the image acquisition device (light source brightness, exposure time, focal length, etc.) can be automatically adjusted by software to adapt to the reflective characteristics of different components.

[0029] Regarding the details of image processing and assembly status detection, pre-trained image detection models, such as deep learning-based target localization algorithms (e.g., YOLO, CNN), can be invoked to identify target component regions in the acquired images to detect whether there are positional deviations, orientation deviations, or misassemblies in the component assembly status (i.e., error / omission detection). Specifically, in positional deviation detection, the offset between the component boundary and the standard installation reference point is calculated; in orientation angle detection, the correctness of the component's orientation, rotation angle, or insertion direction is identified; and in misassembly detection, whether a component is missing can be identified. The detection results are compared with standard assembly status conditions (e.g., component sample templates corresponding to standard assembly status), and the component assembly detection conclusion is output.

[0030] This enables real-time quality assessment and feedback of component assembly results, automates inspection, avoids human visual inspection errors, and significantly improves production efficiency.

[0031] In step S130, if the assembly state of the first component is detected to meet the standard assembly state conditions, it is determined that the first component has been successfully assembled, and the component assembly record is updated according to the first scan result.

[0032] Here, after the test results show that the assembly status meets the standard conditions, the system automatically confirms that the component is successfully assembled and updates the assembly database based on the aforementioned scan information, thereby completing a complete closed-loop registration of assembly information.

[0033] For example, the material code, assembly time, assembly station, operator number, and inspection results of the first component being assembled are written into the assembly record table. Furthermore, the assembly record table can be synchronously updated to the upper-level system database through the MES system, enabling real-time synchronization of assembly data across the enterprise's production chain. This achieves full traceability and digital archiving of the assembly process, improves production information transparency, and provides comprehensive data support for quality analysis and statistics.

[0034] It should be noted that in current technologies, visual inspection systems operate independently of the assembly process, lacking coordination with barcode scanning and voice recognition, resulting in delayed error correction and impacting production cycle time. Furthermore, current assembly stations lack standardized operator guidance, leading to a lack of real-time voice prompts during assembly, increasing the risk of errors due to operational mistakes and resulting in unstable yield rates.

[0035] In some examples of embodiments of this application, when it is detected that the assembly state of the first component does not meet the standard assembly state conditions, the detection result of the assembly state of the first component is output through the human-computer interaction module.

[0036] Here, when the system detects that the assembly status of the first component does not meet the standard assembly status conditions, it automatically enters the abnormal handling and information feedback stage, converts the image detection results into interactive information, and outputs the detection results of the current assembly status of the first component through the human-computer interaction module, so that the operator can quickly locate the assembly problem and perform corrective operations or apply for re-inspection according to the prompts.

[0037] For example, when the image detection module detects a deviation, it can automatically determine the type of abnormality based on the feature values ​​of the detection result (such as position offset, rotation angle, missing area, etc.). For example, the installation position deviation (e.g., the component is not fully attached to the reference surface or exceeds the installation tolerance), the installation direction is incorrect (e.g., the rotation angle is reversed, the insertion direction is incorrect), or the component is missing.

[0038] It should be understood that the human-computer interaction module can take various hardware forms, such as screen display, voice broadcast or sound and light signal prompts, to alert the operator to the abnormal assembly status of the corresponding components.

[0039] Figure 2 A flowchart illustrating an example of a component assembly control method according to an embodiment of this application is shown.

[0040] like Figure 2 As shown, in step S210, it is determined that the first component has been successfully assembled, and the component assembly record is updated according to the first material code scanning result.

[0041] In step S220, standardized operation instructions for subsequent processes are output through the human-machine interaction module; the standardized operation instructions are used to indicate the assembly operation instructions for the second component in the subsequent processes at the target workstation.

[0042] In continuous assembly of multiple components, after the successful assembly of the first component is confirmed, the process knowledge base can be automatically invoked to generate and output subsequent assembly guidance information corresponding to the current workstation. This allows operators to receive standardized assembly operation guidance for the second component in the next process at the correct time. The second component is the one that needs to be installed in conjunction with the first component; for example, the first component is the base shell, and the second component is the PCBA board to be installed inside the base shell, or the upper shell to be installed above the base shell. The assembly operation guidance content can be dynamically generated based on the product model of the second component, the current workstation number, and the production batch. This includes information such as the second component's name and material number, installation position and orientation, required assembly tools, torque parameters, or positioning fixtures. This dynamic guidance of the assembly process helps improve the standardization and consistency of assembly operations.

[0043] In step S230, the target workstation is scanned to obtain the second scan result of the material code of the second component.

[0044] Here, the triggering method for assembling components can be varied, such as manual triggering (operator clicks the HMI "Start Scan" button) or automatic triggering (automatic scanning starts after the component is detected placed at the workstation), triggering the scanning process of the second component material code. Through the secondary scanning verification mechanism, it is ensured that the identity of the component entering the next assembly process is consistent with the system's authorized material list, preventing incorrect, missing, or mixed materials.

[0045] In step S240, it is detected whether the assembly state of the second component meets the standard assembly state conditions.

[0046] For details regarding the detection operation of the assembly state of the second component in step S240, please refer to the description of the implementation method combined with the detection of the assembly state of the first component in step S120 above, which will not be repeated here.

[0047] In step S250, if the assembly state of the second component is detected to meet the standard assembly state conditions, it is determined that the second component has been successfully assembled, and the first scan result is associated with the second scan result to update the component assembly record.

[0048] Here, in the continuous assembly of multiple components, the component assembly record not only records the assembly results of a single component, but also links the assembly data of the first component with that of the second component, thus establishing a hierarchical data chain for the assembly of electronic products.

[0049] In some implementations, an assembly record for the second component is generated, including material code, assembly time, workstation number, and inspection status. Simultaneously, the assembly record information for the first component is accessed, and the two are bound together using an associated assembly ID. This allows the component assembly records to form a data structure similar to a "product assembly tree," recording the hierarchical assembly relationships between components of the electronic product. Furthermore, associated assembly information can be automatically uploaded to the MES (Manufacturing Execution System) to achieve synchronized updates of multi-component assembly data. This supports cross-component assembly traceability and hierarchical management, ensuring the integrity of production records.

[0050] As a preferred implementation of updating cross-component assembly records, if the assembly status of the second component in a subsequent process meets the standard assembly status conditions, the workstation area is re-scanned to identify whether the first component from the previous assembly process still exists in the currently assembled product, so as to determine whether the first component is replaced during the assembly process.

[0051] More specifically, the third scan result of the material code of the first component is obtained, and the consistency between the third scan result and the first scan result is checked. Therefore, after confirming that the second component is successfully assembled, a rescan of the target workstation area is automatically initiated to verify whether the previously assembled first component is still the original material.

[0052] On the one hand, if the third scan result is found to be consistent with the first scan result, the first scan result is associated with the second scan result to update the component assembly record.

[0053] Specifically, the material code information of the first component is extracted from the scanned image to form the third scan result; the scan parsing module compares the third scan result with the previously recorded first scan result at the string or byte level. For example, if a QR code is used, CRC (Cyclic Redundancy Check) or hash check comparison can be performed to ensure the uniqueness and anti-counterfeiting of the identification result.

[0054] If the third scan result is consistent with the first scan result, it indicates that no material replacement occurred during the assembly process for previously assembled parts. The scan information of the first component and the second component are then logically linked. This link may include the first component's material code, the second component's material code, the assembly station number, a timestamp, and the operator's number. This record can then be stored in the assembly database or synchronously uploaded to the MES system, forming a component-based traceability chain for the electronic product. By updating cross-component assembly records, vertical data flow between components is achieved, forming a product assembly tree structure.

[0055] On the other hand, if the third scan result is found to be inconsistent with the first scan result, a material change alarm operation is executed through the human-machine interaction module. The material change alarm operation is used to indicate that there is a risk of material change in the first component.

[0056] Here, if the third scan result is found to be inconsistent with the first scan result, a material change alarm message is immediately output through the human-machine interface module to execute the material change alarm operation. For example, the human-machine interface module can display or broadcast the risk of mid-process material change through the interactive interface. The alarm message could be "A risk of mid-process replacement of the first component has been detected. Please check the assembly parts," thereby dispatching quality inspectors or operators to conduct a re-inspection.

[0057] In this embodiment, by performing a third scan and comparing material codes at the target workstation, it is possible to accurately determine whether the first component in the preceding process has been replaced in subsequent assembly, fundamentally preventing the potential for material replacement midway. Through a consistency comparison and result binding mechanism, the unique and authentic identity of each assembly record is ensured, significantly improving the authenticity and traceability reliability of assembly data and strengthening the error-proofing and anti-mixing mechanism for assembled products.

[0058] Figure 3 A flowchart illustrating an example of detecting the assembly state of a first component based on a component image according to an embodiment of this application is shown.

[0059] like Figure 3 As shown, in step S310, the key features of the first component in the component image are detected.

[0060] In this embodiment, the assembly state also includes the detection results of key component features. Specifically, key component features can be significant visual features of the component's physical properties or assembly state, such as geometric contours, positioning holes, screws, markings, material code outlines, logo areas, or reflective points. By detecting key features, it is determined whether a target component exists in the image, and the assembly position and assembly direction of the component are identified.

[0061] In some examples, key component features include at least one of the following: component contour features, material code contour features, and local component detection features. Component contour features are used to identify the overall shape, boundary range, and spatial contour of the target component in the image, and are the main basis for determining whether the component exists and is in place. The shape and relative position of the component's material code are highly regular, and the contour features of the material code can be used as auxiliary identification features, which can both confirm the component's identity and serve as a positioning reference point. Key local components of the component (such as positioning holes, fixing screws, buckles, connecting terminals, marking lines, positioning pins, etc.) are also a direct reflection of the correctness of assembly. By detecting these local features, the assembly depth, direction, and integrity can be determined.

[0062] In step S321, if no key features of the component are detected, it is determined that the first component is at risk of being missing or incorrectly assembled.

[0063] It should be noted that when the preset key features of the component are not detected, it means that the target component may not be installed in the specified area, the installation position is incorrect, or the wrong material is loaded. It can be directly determined that there is a risk of "missing" or "incorrect" installation, thereby preventing the assembly error from entering the subsequent stage in advance.

[0064] For example, if no key features are detected in multiple scans or image frames (or the feature matching confidence is below the threshold), it can be marked as "no component detected"; or, if the detected features do not match the standard template (e.g., the shape or number of feature points are significantly different), it can be determined as "wrong component", thus realizing the immediate detection and blocking of serious assembly defects such as missing or incorrect components.

[0065] In step S323, if key features of the component are detected, the component coordinates and installation angle of the first component are determined based on the key features of the component.

[0066] Here, after detecting key features, the position coordinates and installation angle (or orientation) of the component are calculated based on the spatial distribution of the feature points to determine whether the component is accurately placed in the standard assembly position.

[0067] In some implementations, the center position of the component in the image coordinate system is calculated based on the center point or geometric contour of the key features. If a multi-camera system is used, three-dimensional coordinates can also be obtained through stereo vision or laser ranging modules, and the coordinate information is registered with the assembly reference point to form a pose data pair. In addition, if the component has directional features (such as screw slots, plug-in terminal directions, etc.), the rotation angle can be calculated through the principal axis direction of the key features.

[0068] In step S330, the component coordinates are compared with a preset position range to determine whether the installation position of the first component matches.

[0069] Here, based on the obtained component coordinate data, it is determined whether the actual installation position of the component in the current image falls within the preset standard position tolerance range. If the deviation exceeds the allowable range, it indicates that the component is at risk of displacement, installation deviation, or incomplete placement.

[0070] For example, during the product modeling phase, the process engineer sets the standard installation coordinate range for the components (e.g., X-axis deviation ≤ ±1.5mm, Y-axis deviation ≤ ±1.0mm), and the range can be stored as a rectangle or ellipse to describe the deviation domain. Then, the differences Δx and Δy between the detection coordinates and the standard center coordinates are calculated. If both are within the tolerance range, the position is determined to be matched; otherwise, a warning for position deviation is output.

[0071] In step S340, the installation angle is compared with the preset angle tolerance range to determine whether the first component is installed in the correct direction.

[0072] In some implementations, the process database stores the standard mounting angles (e.g., 0° or 90°) and tolerance ranges (±3°, etc.) of components; if the components have symmetrical features, the difference in characteristic vector direction can be used as the basis for angle matching. Furthermore, the difference Δ between the detection angle and the standard angle is calculated. θ If |Δ θ If the value is within the tolerance range, the orientation is considered correct; otherwise, a warning about incorrect installation orientation is output.

[0073] Through the embodiments of this application, high-precision visual detection and intelligent judgment of assembly status are achieved, supporting posture analysis and quality control of complex multi-component assembly, and significantly improving the reliability, traceability and process stability of automatic assembly detection.

[0074] Figure 4 A structural block diagram of an example of a component assembly control system according to an embodiment of this application is shown.

[0075] like Figure 4 As shown, the component assembly control system 400 includes an image acquisition device 410 and a control device 420. The image acquisition device 410 is used to scan the components within the target workstation, and the control device is used to execute the steps of any of the component assembly control methods described above.

[0076] Here, the image acquisition device 410 may include an industrial camera (monocular or binocular CCD camera), a light source module (ring light, strip light, or backlight), and an image transmission interface (such as GigE, USB 3.0, etc.). The industrial camera can be fixedly installed above or to the side of the target workstation, covering the component assembly area of ​​the target workstation. The control device 420 performs core calculations and decisions, processes and analyzes the acquired image data, and performs assembly status judgment, anomaly handling, human-machine interaction control, and assembly data updates based on the recognition results.

[0077] Figure 5 A schematic diagram of the architecture of an example component assembly control system according to an embodiment of this application is shown.

[0078] like Figure 5 As shown, the component assembly control system is based on a closed-loop control architecture of "scanning-detection-guidance". The system consists of two main parts: a hardware layer and a software layer. The parts work together to achieve automated control functions for assembly error prevention, assembly detection and data traceability.

[0079] In the system's hardware configuration, an AI-powered CCD camera is mounted above the workstation to capture high-resolution images of the component assembly area; a barcode scanning module scans the material codes of each component (bottom shell, PCBA, top cover) and reports them to the control system; an industrial computer runs the intelligent inspection software system, executing image recognition algorithms, barcode comparison, data analysis, and MES integration; and a voice broadcast and instruction module outputs standardized operation prompts or alarm voices to achieve human-machine interaction feedback. The camera, barcode scanning module, and voice equipment are all electrically connected to the industrial computer, forming a closed-loop data and control pathway.

[0080] The software layer consists of an intelligent inspection software system running on an industrial computer. This system includes the following main functional modules: a visual inspection module, a barcode verification module, a voice interaction module, and a data management module.

[0081] Specifically, the visual inspection module processes and analyzes the acquired component images based on image recognition algorithms (such as template matching, feature point analysis, or deep learning networks) to determine whether the component assembly status meets the standard assembly conditions.

[0082] In some implementations, the assembly is determined by identifying the QR code and key contour features of the housing. The assembly position is checked based on the contour center coordinates (X, Y), and the assembly direction is checked based on the contour angle. Missing contour features are considered as missing or incorrect assembly. For example, if the housing contour center coordinates are detected as (200, 200) and the angle is 1°, and this meets a preset threshold range (X±30, Y±30, angle ±3°), the assembly is considered correct; otherwise, it is considered reversed or not in place.

[0083] In PCBA inspection, the system identifies the PCBA's QR code and outline features. The center coordinates and angle of the QR code's border are used to determine if it is properly positioned or installed backwards. A missing QR code indicates an installation error. Similarly, in cover inspection, key outline features and QR codes are identified, and the center coordinates and angle are used to determine if the cover is correctly installed. Missing features indicate an installation error, and angle deviations indicate installation backwards. The inspection results are transmitted in real-time to the control module for automatic pass / fail determination.

[0084] The barcode verification module is used to scan and verify each assembly step to ensure that the assembled materials are consistent with the process requirements. In addition, it supports multi-step barcode binding logic. For example, after the bottom shell is scanned for the first time, the system generates a unique identifier; subsequent PCBA and Cover barcode information is bound to the bottom shell; at the end of assembly, a second barcode comparison is performed. If the bottom shell QR code is inconsistent with the initial barcode result, a material change alarm is triggered.

[0085] The voice interaction module dynamically generates voice prompts or alarm messages based on the detection status. It can broadcast standardized operating instructions (such as "Please install the bottom case" or "Please install the PCBA") and abnormal prompts (such as "The bottom case is installed backwards, please reinstall it"). The voice output device simultaneously broadcasts the detection results, allowing operators to receive real-time guidance without having to look at the screen.

[0086] The data management module records the inspection results, operation logs, and corresponding images for each step. It associates the inspection data with timestamps, operator IDs, and barcode scanning information to form a complete assembly report, which is periodically uploaded to the MES system, enabling full lifecycle traceability of product assembly information. The MES binding mechanism includes: using the bottom shell QR code as the main barcode; the PCBA QR code as sub-barcode 1; and the Cover QR code as sub-barcode 2; generating a one-to-many binding relationship in the MES system. After the product leaves the factory, the corresponding internal component batch can be traced back through the main barcode, ensuring the integrity of quality traceability.

[0087] By collecting assembly site data at the hardware layer and performing detection, verification, prompting, and data recording at the software layer, an automated closed-loop control process of "scanning → detection → guidance → traceability" is formed, realizing intelligent assembly and traceability.

[0088] Figure 6 A system operation signaling timing flowchart of an example of a component assembly control system according to an embodiment of this application is shown.

[0089] like Figure 6 As shown, the step-by-step control process of the component assembly control system includes bottom shell inspection, PCBA inspection, top cover inspection, re-inspection, and MES data upload.

[0090] First, a voice prompt is given and the bottom shell assembly test is performed.

[0091] For example, the system voice prompts "Please install the bottom shell", and the AI ​​camera starts pre-shooting; after the operator scans the bottom shell material code, the system verifies its legality and performs image detection to determine whether the bottom shell is installed backwards, missing, or not in place.

[0092] After the bottom shell passes the inspection, a voice prompt will indicate when to install the PCBA.

[0093] For example, the system will prompt "Please install PCBA" in voice. After the operator scans the PCBA QR code, the test will be performed. If the test is successful, the operator will proceed to the next step. Otherwise, the system will issue a voice alarm and prompt the operator to reinstall the PCBA.

[0094] After the PCBA test is passed, a voice prompt will guide you to install the top cover and perform the test.

[0095] For example, the system will prompt "Please install the top cover" and check the position, angle, and missing parts of the top cover; if it passes the check, the re-inspection process will continue.

[0096] Bottom shell re-inspection (i.e., anti-material replacement inspection).

[0097] After the top cover is installed, the system automatically performs a secondary recognition of the QR code on the bottom shell and compares it with the initial recognition result. If they match, it is determined that there is no risk of material replacement; if they do not match, a material replacement alarm is triggered, prompting "Bottom shell replacement risk, please verify materials," and the assembly line is paused.

[0098] Data records are linked to and uploaded to MES.

[0099] The QR code information of the bottom shell, PCBA, and cover is uniformly linked with the test results to generate a product assembly record. The bottom shell QR code serves as the main code, while the PCBA and Cover QR codes serve as sub-codes 1 and 2, respectively. These are all uploaded to the MES system to achieve the binding record of assembly batch and component traceability.

[0100] In this embodiment, a closed loop is formed through scanning, detection, guidance, re-inspection, and MES uploading to prevent human error and the risk of material replacement; the visual detection algorithm automatically identifies reversed, missing, and incorrectly assembled parts based on contour and QR code features; the voice prompt module synchronizes the assembly rhythm with the detection rhythm, reducing the complexity of manual operation; in addition, the MES binding mechanism ensures that the internal components corresponding to each product can be traced down to the individual material level, realizing the traceability integrity, accuracy, and reliability of various assembly components of electronic products.

[0101] In component assembly control systems, a closed-loop control architecture integrating barcode scanning verification, real-time visual inspection, and voice operation guidance has significantly improved the automated assembly process of electronic products. A step-by-step barcode scanning verification mechanism ensures the consistency of assembly materials and process sequence; combined with an image recognition-based error detection algorithm, it can determine the installation position, orientation, and integrity of components in real time; and a voice prompt module outputs standardized assembly instructions to the operator, thereby achieving dynamic guidance and error prevention control in the assembly process.

[0102] Compared to traditional methods relying on manual visual inspection and experience, the embodiments of this application significantly improve upon issues such as large errors in manual inspection, insufficient system linkage, inconsistent assembly instructions, and incomplete material traceability. Through automated identification and instruction linkage, the system not only improves assembly accuracy and production cycle consistency but also establishes a full-process traceability mechanism based on barcode scanning and inspection data, effectively preventing the risks of material changes and mixed materials during assembly.

[0103] Furthermore, the closed-loop control system of the component assembly control system possesses high versatility and scalability, adapting to the mixed-line assembly needs of multiple product models. Simultaneously, standardized voice guidance significantly lowers the operational threshold, enabling new personnel to complete assembly operations according to specifications within a short time, thereby reducing training costs and improving overall production efficiency. This achieves high-precision detection, end-to-end error prevention, and a closed-loop quality management system for the assembly process, providing reliable technical support for high-consistency and high-reliability electronic product assembly.

[0104] It should be noted that, for the sake of simplicity, the foregoing method embodiments are all described as a series of combined actions. However, those skilled in the art should understand that this application is not limited to the described order of actions, as some steps may be performed in other orders or simultaneously according to this application. Secondly, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions and modules involved are not necessarily essential to this application. In the above embodiments, the descriptions of each embodiment have their own emphasis; for parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0105] In some embodiments, this application also provides a computer program product, the computer program product including a computer program stored on a non-volatile computer-readable storage medium, the computer program including program instructions, which, when executed by a computer, cause the computer to perform any of the above-described component assembly control methods.

[0106] In some embodiments, this application also provides an electronic device, comprising: at least one processor, and a memory communicatively connected to the at least one processor, wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform a component assembly control method.

[0107] The apparatus described in the embodiments of this application can be used to execute the component assembly control method of the embodiments of this application, and accordingly achieve the technical effects achieved by the component assembly control method of the embodiments of this application, which will not be elaborated further here. In the embodiments of this application, the relevant functional modules can be implemented by a hardware processor.

[0108] Figure 7 This is a schematic diagram of the hardware structure of an electronic device for an execution component assembly control method provided in another embodiment of this application, as shown below. Figure 7 As shown, the device includes: One or more processors 710 and memory 720, Figure 7 Take the 710 processor as an example.

[0109] The device for performing the component assembly control method may further include an input device 730 and an output device 740.

[0110] The processor 710, memory 720, input device 730, and output device 740 can be connected via a bus or other means. Figure 7 Taking the example of a connection between China and Israel via a bus.

[0111] The memory 720, as a non-volatile computer-readable storage medium, can be used to store non-volatile software programs, non-volatile computer-executable programs, and modules, such as the program instructions / modules corresponding to the component assembly control method in the embodiments of this application. The processor 710 executes various functional applications and data processing of the server by running the non-volatile software programs, instructions, and modules stored in the memory 720, thereby implementing the component assembly control method of the above-described method embodiments.

[0112] The memory 720 may include a program storage area and a data storage area, wherein the program storage area may store the operating system and applications required for at least one function; the data storage area may store data created based on the use of the device, etc. Furthermore, the memory 720 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other non-volatile solid-state storage device. In some embodiments, the memory 720 may optionally include memory remotely located relative to the processor 710, and these remote memories may be connected to the device via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0113] Input device 730 can receive input digital or character information and generate signals related to user settings and function control of the device. Output device 740 may include display devices such as a display screen.

[0114] The one or more modules are stored in the memory 720, and when executed by the one or more processors 710, the component assembly control method in any of the above method embodiments is executed.

[0115] The above-described product can perform the methods provided in the embodiments of this application, and has the corresponding functional modules and beneficial effects for performing the methods. Technical details not described in detail in this embodiment can be found in the methods provided in the embodiments of this application.

[0116] The electronic devices in this application embodiments exist in various forms, including but not limited to: (1) Mobile communication devices: These devices are characterized by their mobile communication capabilities and primarily aim to provide voice and data communication. These terminals include: smartphones (e.g., iPhones), multimedia phones, feature phones, and low-end phones, etc.

[0117] (2) Ultra-mobile personal computer devices: These devices fall under the category of personal computers, possessing computing and processing capabilities, and generally also have mobile internet access features. These terminals include PDAs, MIDs, and UMPCs, such as the iPad.

[0118] (3) Portable entertainment devices: These devices can display and play multimedia content. This category includes audio and video players (such as iPods), handheld game consoles, e-book readers, as well as smart toys and portable car navigation devices.

[0119] (4) Server: A device that provides computing services. The components of a server include a processor, hard disk, memory, system bus, etc. Servers are similar to general computer architectures, but because they need to provide highly reliable services, they have higher requirements in terms of processing power, stability, reliability, security, scalability, and manageability.

[0120] (5) Other electronic devices with data interaction functions.

[0121] In some embodiments, this application also provides a mobile platform on which the computer device described in any embodiment of this application is installed. The mobile platform includes, but is not limited to, vehicles, tracked robots, bipedal robots, quadrupedal robots, etc., wherein the vehicle can be a passenger car, pickup truck, truck, etc. It should be noted that the above are merely examples, and this application does not limit the specific form of the mobile platform.

[0122] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs.

[0123] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented using software plus a general-purpose hardware platform, or of course, using hardware. Based on this understanding, the above technical solutions, in essence or the parts that contribute to the related technology, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.

[0124] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. A component assembly control method, comprising: Obtain the first scan result of the material code of the first component in the target workstation, and compare the first scan result with the pre-authorized assembly material information to obtain the material code verification result; If the material code verification result is successful, an image of the first component after assembly is acquired, and the assembly status of the first component is detected based on the component image to determine whether it meets the standard assembly status conditions. The assembly state includes the component installation position and / or the component installation orientation; If the assembly status of the first component is found to meet the standard assembly status conditions, it is determined that the first component has been successfully assembled, and the component assembly record is updated according to the first scan result.

2. The method according to claim 1, wherein, After detecting whether the assembly state of the first component meets the standard assembly state conditions based on the component image, the method further includes: If the assembly state of the first component does not meet the standard assembly state conditions, the detection result of the assembly state of the first component is output through the human-computer interaction module.

3. The method according to claim 1, wherein, After determining that the first component has been successfully assembled and updating the component assembly record based on the first scan result, the method further includes: The human-computer interaction module outputs standardized operation instructions for subsequent processes; the standardized operation instructions are used to indicate the assembly operation instructions for the second component in the subsequent processes at the target workstation. The target workstation is scanned to obtain a second scan result of the material code of the second component.

4. The method according to claim 3, wherein, After scanning the target workstation to obtain a second scan result of the material code of the second component, the method further includes: Check whether the assembly status of the second component meets the standard assembly status conditions; If the assembly status of the second component is found to meet the standard assembly status conditions, it is determined that the second component has been successfully assembled, and the first scan result is associated with the second scan result to update the component assembly record.

5. The method according to claim 4, wherein, The step of associating the first scan result with the second component scan result to update the component assembly record includes: Obtain the third scan result of the material code of the first component, and detect whether the third scan result is consistent with the first scan result; If the third scan result is found to be consistent with the first scan result, the first scan result is associated with the second scan result to update the component assembly record.

6. The method according to claim 5, wherein, After detecting whether the third scan result is consistent with the first scan result, the method further includes: If the third scan result is found to be inconsistent with the first scan result, a material change alarm operation is executed through the human-machine interaction module. The material change alarm operation is used to indicate that there is a risk of material change in the first component.

7. The method according to claim 1, wherein, The step of detecting whether the assembly state of the first component meets the standard assembly state conditions based on the component image includes: Detect the key features of the first component in the component image; If the key features of the component are not detected, it is determined that the first component is at risk of being missing or incorrectly installed; If the key features of the component are detected, the component coordinates and installation angle of the first component are determined based on the key features of the component. The component coordinates are compared with a preset position range to determine whether the first component is installed in a matching position. The installation angle is compared with the preset angle tolerance range to determine whether the first component is installed in the correct direction.

8. The method according to claim 7, wherein, The key features of the component include at least one of the following: component outline features, material code outline features, and local component detection features.

9. A component assembly control system, comprising: Image acquisition device, used to scan images of components within the target workstation; A control device for performing the steps of the method as described in any one of claims 1-8.

10. A computer device comprising a memory, a processor, and a computer program stored in the memory, wherein, The processor executes the computer program to implement the steps of the method according to any one of claims 1-8.

Images