A vehicle part size parameter detection method, device and storage medium
By using position detection and camera components to automatically detect the dimensional parameters of vehicle parts, the problems of low detection efficiency and insufficient accuracy have been solved. This has enabled efficient and accurate dimensional parameter detection and data recording, ensuring quality control of the vehicle production line.
Patent Information
- Application Number
- CN202310316336.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-03-28
- Publication Date
- 2026-01-23
- Estimated Expiration
- 2043-03-28
AI Technical Summary
In existing technologies, the efficiency of dimensional parameter detection for vehicle parts is low, manual inspection is labor-intensive and prone to errors, and data cannot be accurately recorded, leading to blind spots in the analysis of quality issues.
The vehicle's position information is obtained through a position detection component, and the detection image is acquired using a camera component. Pixel parameters are calculated and converted into size parameters, which are then compared with standard thresholds to automatically identify abnormal parts. Combining multiple camera components improves detection accuracy and efficiency.
It reduces labor costs, improves testing efficiency and accuracy, ensures that each unit is tested, provides data records, facilitates traceability of quality issues, and prevents abnormal parts from leaving the production line.
Smart Images

Figure CN116447972B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the field of automobile manufacturing, and in particular to a method and device for detecting size parameters of vehicle parts and a storage medium. BACKGROUND
[0002] With the continuous development of automobile manufacturing technology, the number and types of vehicle parts are increasing, and the size parameters of each part directly determine the performance of the automobile. Therefore, detecting the size parameters of vehicle parts has become an important issue in the field of automobile manufacturing.
[0003] In the vehicle production line, most vehicle parts are located inside the vehicle body. In the assembly line operation, the detection personnel needs to enter the vehicle interior within the time limit to complete the size parameter measurement, or the detection personnel needs to detect whether the size of the part meets the requirements through visual detection from outside the vehicle body.
[0004] However, the detection method of entering the vehicle body by the detection personnel has a large workload, and it is difficult to achieve precision measurement for each vehicle in practical production. Visual detection by the human eye will produce a large measurement error, which is prone to cause the flow of poor assembly. At the same time, the above detection method cannot obtain accurate data records and cannot trace the quality problems, which is prone to form a blind spot in quality problem analysis. SUMMARY
[0005] The present application provides a method and device for detecting size parameters of vehicle parts, an electronic device and a storage medium to solve the problem of low efficiency in detecting size parameters of vehicle parts.
[0006] According to an aspect of the present application, a method for detecting size parameters of vehicle parts is provided, comprising:
[0007] In response to obtaining the vehicle body position information sent by the position detection component, a first detection image is obtained by a first camera component matched with the position detection component;
[0008] The pixel parameters of at least one part in the first detection image are obtained, and the size parameters of the at least one part are obtained according to the pixel parameters of the at least one part and the parameter conversion coefficient;
[0009] The size parameters of the at least one part are compared with the matched standard size threshold;
[0010] If it is determined that there is an abnormal part whose size parameters do not meet the matched standard size threshold in the at least one part, a size abnormality prompt of the abnormal part is issued.
[0011] According to an aspect of the present application, a size parameter detection device for vehicle parts is provided, comprising:
[0012] A detection image acquisition module is configured to acquire a first detection image through a first camera assembly matched with the position detection assembly in response to acquiring the vehicle body position information sent by the position detection assembly;
[0013] A size parameter acquisition module is configured to acquire pixel parameters of at least one part in the first detection image, and acquire size parameters of the at least one part according to the pixel parameters of the at least one part and a parameter conversion coefficient;
[0014] A parameter comparison execution module is configured to compare the size parameters of the at least one part with a matched standard size threshold;
[0015] An abnormality prompt issuing module is configured to issue a size abnormality prompt of an abnormal part if it is determined that there is an abnormal part whose size parameter does not conform to the matched standard size threshold in the at least one part.
[0016] According to another aspect of the present application, an electronic device is provided, comprising at least one processor, and a memory connected with the at least one processor in communication; wherein the memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor to enable the at least one processor to execute the size parameter detection method for vehicle parts according to any one of the embodiments of the present application.
[0017] According to another aspect of the present application, a computer readable storage medium is provided, which stores computer instructions for enabling a processor to execute the size parameter detection method for vehicle parts according to any one of the embodiments of the present application.
[0018] The technical solution of the embodiments of the present application acquires a first detection image through a first camera assembly matched with a position detection assembly in response to acquiring vehicle body position information sent by the position detection assembly, and acquires size parameters of parts according to pixel parameters acquired in the first detection image and a parameter conversion coefficient, and then issues a size abnormality prompt of an abnormal part whose size parameter does not conform to a standard size threshold, thereby reducing the labor cost required for detecting size parameters of vehicle parts, improving the detection efficiency and accuracy of size parameters of parts, ensuring the detection of vehicles on a vehicle production line one by one, avoiding the flow of vehicles with abnormal parts out of the production line, and saving corresponding data records for each vehicle, providing a data basis for quality problem tracing, and facilitating the finding of blind spots for quality problem analysis.
[0019] It is to be understood that the details set forth herein do not limit the scope of the embodiments of the application to the specific embodiments described. Rather, the scope of the embodiments of the application is to be defined by the appended claims. BRIEF DESCRIPTION OF DRAWINGS
[0020] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings needed to be used in the embodiments description. Obviously, the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can also be obtained without creative labor.
[0021] Figure 1 is a flow chart of a size parameter detection method of a whole vehicle part according to the embodiment one of the present application;
[0022] Figure 2 is a flow chart of a size parameter detection method of a whole vehicle part according to the embodiment two of the present application;
[0023] Figure 3 is a flow chart of a size parameter detection method of a whole vehicle part according to the embodiment three of the present application;
[0024] Figure 4 is a structural schematic diagram of a size parameter detection device of a whole vehicle part according to the embodiment four of the present application;
[0025] Figure 5 is a structural schematic diagram of an electronic device for implementing the size parameter detection method of a whole vehicle part according to the present application. DETAILED DESCRIPTION
[0026] In order to make the technical personnel in the art better understand the present application scheme, the following will combine the drawings in the embodiments of the present application, and the technical solutions in the embodiments of the present application will be described clearly and completely. Obviously, the described embodiments are only some embodiments of the present application, not all. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor should belong to the scope of protection of the present application.
[0027] It should be noted that the terms "first", "second", and the like in the description and claims of the application and the above drawings are used to distinguish similar objects, and do not necessarily indicate a specific order or sequence. It should be understood that the data thus used can be interchanged under appropriate circumstances, so that the embodiments of the application described herein can be implemented in other than the order illustrated or described herein. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device that includes a list of steps or units does not necessarily limit those steps or units to the clearly listed ones, but can include other steps or units not clearly listed or inherent to such processes, methods, products or devices.
[0028] Embodiment one
[0029] Figure 1 A flow chart of a size parameter detection method of a whole vehicle part is provided for the embodiment one of the application, the embodiment can be applicable to detect the size parameter of a part on a whole vehicle, the method can be executed by the size parameter detection device of the whole vehicle part in the embodiment of the application, the size parameter detection device of the whole vehicle part can be realized in the form of hardware and / or software, and the size parameter detection device of the whole vehicle part can be configured in an electronic device in the form of an independent device, or can be configured in an existing detection device on a whole vehicle production line. As shown in the figure, the method comprises: Figure 1
[0030] S101, in response to obtaining the vehicle body position information sent by the position detection component, obtaining a first detection image through the first camera component matched with the position detection component.
[0031] The vehicle body moves along with the movement of the conveyor belt on the whole vehicle assembly line, the position detection component includes a detection device such as a photoelectric sensor, which is used to detect the position of the vehicle body, the position detection component is arranged in the detection workbench, when the position detection component detects a shielding signal, it indicates that the vehicle body has reached the detection workbench, at this time, the detection image (i.e. the first detection image) is obtained through the camera component (i.e. the first camera component) matched with the position detection component in the detection workbench; wherein the camera component can be located on both sides of the whole vehicle assembly line, or can be located on the top or bottom of the whole vehicle assembly line, each camera component shoots the detection image of the vehicle body direction in a fixed position and a fixed posture.
[0032] S102, obtaining the pixel parameter of at least one part in the first detection image, and obtaining the size parameter of the at least one part according to the pixel parameter of the at least one part and the parameter conversion coefficient.
[0033] Each camera assembly is used to detect the size parameter of one or more parts, that is, the detection image obtained by the camera assembly can only include the pixel parameter of one part, or can simultaneously include the pixel parameter of multiple parts. For example, the whole vehicle part in the embodiment of the application includes a brake light switch, which is located in the driver's seat inside the vehicle body and is used to control the lighting and extinguishing of the brake light, that is, when the driver steps on the brake pedal, the brake light is on, and when the driver releases the brake pedal, the brake light is off; the pixel parameter of the brake light switch can be obtained by the camera assembly arranged on the left or right side of the whole vehicle assembly line and facing the indoor direction of the vehicle; at the same time, the camera assembly can be used to obtain the detection image of the brake light switch, and can also be used to simultaneously obtain the detection image of other parts.
[0034] After obtaining the first detection image obtained by the first camera assembly, the object feature recognition algorithm can be used to combine the features of the measured part with the surrounding features of the measured part to lock the measured part, thereby realizing the detection and positioning of the measured part; then, after image recognition of the first detection image, the pixel parameter of the measured part is obtained; the pixel parameter can be the number of pixels in the horizontal direction and / or the vertical direction of the two-dimensional detection image, or the number of pixels in at least one direction of the horizontal direction, vertical direction and vertical direction of the three-dimensional detection image.
[0035] The parameter conversion coefficient is a conversion relationship between the pixel points and the length unit obtained based on the historical detection samples, for example, the parameter conversion coefficient can be 1 pixel point equal to 0.1 millimeter; specifically, the size parameters of the brake light switches in multiple vehicle bodies can be obtained by manual measurement in advance, and then the pixel parameters of each brake light switch can be obtained according to each detection image obtained by the camera assembly, and then the size parameters of the brake light switches obtained by manual measurement are compared with the pixel parameters obtained in the detection image, so as to determine the average value of the parameter conversion coefficient, which can be used as the obtained parameter conversion coefficient. A standard size reference can also be pasted to a position consistent with the distance of the measured part, and then the pixel parameter of the reference and the size parameter of the reference are used to determine the parameter conversion coefficient.
[0036] The size parameter can include one or more of the length, width and height of the part, for example, the pixel parameters of the part in the horizontal direction, vertical direction and vertical direction, which respectively reflect the length, width and height of the part, and the size parameter of the part can be determined according to the pixel parameter of the part and the parameter conversion coefficient.
[0037] Optionally, in the embodiment of the present application, the pixel parameters of the at least one component in the first detection image are obtained by: determining a corresponding number of associated detection regions in the first detection image according to the number of components detected by the first camera assembly; and obtaining the pixel parameters of the components in the associated detection regions. Specifically, since one camera assembly can be used to detect the size parameters of multiple components, and the shooting position and shooting posture of the camera assembly are fixed, the same component is located at the same position in different vehicle bodies of the same vehicle model, so the number of components in each detection image captured by one camera assembly is fixed, and each component is located in the same detection region. Therefore, the corresponding number of associated detection regions in the first detection image can be determined according to the number of components detected by the first camera assembly, and then the pixel parameters of each component in each associated detection region can be obtained, thereby improving the efficiency of obtaining the pixel parameters of the components in the detection image, and further improving the efficiency of comparing the size parameters of the components.
[0038] Optionally, in the embodiment of the present application, the size parameters of the at least one component are obtained according to the pixel parameters of the at least one component and the parameter conversion coefficients, by: obtaining the size parameters of the components in the associated detection regions according to the pixel parameters of the components in the associated detection regions and the parameter conversion coefficients corresponding to the associated detection regions. Specifically, if the current detection image includes multiple detection components, the associated detection regions where different components are located and the first camera assembly can have different interval distances. Therefore, after obtaining the size parameters of each component, the size parameters of each component are obtained according to the parameter conversion coefficients corresponding to different associated detection regions, respectively, thereby improving the accuracy of obtaining the size parameters of the components and improving the detection accuracy of abnormal components.
[0039] S103, comparing the size parameters of the at least one component with the matching standard size threshold.
[0040] The standard size threshold reflects the size requirements of each component in the vehicle, and can include a maximum size threshold and / or a minimum size threshold. Taking the above technical solution as an example, after the brake light switch is assembled into the vehicle, its corresponding size parameter needs to be kept in the range of greater than or equal to 0.5 mm and less than or equal to 3 mm. If the size parameter is too large or too small, it will affect the lighting and extinguishing of the brake light. Therefore, after obtaining the size parameters of each component, the size parameters are compared with the matching standard size threshold, respectively.
[0041] S104, if it is determined that there is an abnormal component whose size parameter does not conform to the matching standard size threshold in the at least one component, issuing a size abnormality prompt of the abnormal component.
[0042] If the size parameter of each component in the first detection image meets the corresponding standard size threshold, that is, there is no abnormal component in the first detection image, the components detected by the camera assembly in the current vehicle body can be considered as normal size parameters; if there is an abnormal component in the first detection image, that is, there is a component whose size parameter does not meet the corresponding standard size threshold, a prompt information of the abnormal component is sent to prompt the detection personnel to manually measure, and the detection personnel can be guided to perform an abnormal repair operation when the manual measurement is completed and the existence of the abnormal component is determined.
[0043] Optionally, in the embodiment of the present application, after comparing the size parameter of the at least one component with the matched standard size threshold, the method further comprises: if it is determined that the size parameter of the current component meets the corresponding standard size threshold, and the absolute value of the difference between the size parameter of the current component and the standard size threshold is less than or equal to a first preset threshold, it is determined whether there is a second camera assembly corresponding to the current component; if it is determined that there is a second camera assembly corresponding to the current component, the size parameter of the current component is continuously acquired through the second camera assembly, and the size parameter of the current component acquired again is compared with the matched standard size threshold; if it is determined that the size parameter of the current component does not meet the matched standard size threshold, a size abnormality prompt of the current component is sent.
[0044] Specifically, different camera assemblies can be arranged at different detection positions to detect the size parameters of different components respectively, and each camera assembly can correspond to the same or different position detection devices, that is, each camera assembly can acquire detection images of different components at the same or different shooting times; at the same time, different camera assemblies can also be used to acquire the same pixel parameters or different pixel parameters of the same component at the same or different shooting times.
[0045] For example, the standard size threshold of the brake light switch is 0.5-3 mm, and the size parameter of the brake switch of the current vehicle body is 0.51 mm determined by the first detection image. Although the value meets the standard size threshold, the value is actually closer to the minimum size threshold (i.e., 0.5 mm). The size parameter 0.51 mm calculated may be less than 0.5 mm due to calculation errors, resulting in false detection of the size parameter of the component. If the brake light switch has a corresponding second camera assembly, and the shooting time of the second camera assembly is after the first camera assembly, the size parameter of the brake light switch can be continuously obtained by the second camera assembly, and compared with the standard size threshold of the current position again. If the size parameter of the brake light switch obtained again meets the matched standard size threshold, it is determined that the size parameter of the brake light switch in the current vehicle body is normal, otherwise, it indicates that the size parameter of the brake light switch in the current vehicle body is abnormal. Thus, when the size parameter of the component obtained by the first camera assembly is close to the value of the standard size threshold, the size parameter of the component obtained by the second camera assembly is compared with the matched standard size threshold again, which improves the detection accuracy of the abnormal component and avoids false detection.
[0046] Optionally, in the embodiment of the application, when it is determined that there is an abnormal component in the at least one component, after issuing the size abnormality prompt of the abnormal component, it further includes: adjusting the moving speed of the vehicle assembly line where the abnormal component is located to a specified speed threshold according to the number and type of the abnormal component, so that the detection personnel enter the vehicle body to complete the size parameter measurement. Specifically, the more the number of abnormal components in the vehicle body, the longer the time required for the detection personnel to enter the vehicle body to perform size parameter measurement. In addition, different types of components use different detection tools and different detection methods, so the time required for manual measurement is also different. Therefore, the more the number of abnormal components, the more complex the measurement method of this type of abnormal component, and the longer the manual measurement time required. Accordingly, the moving speed of the vehicle assembly line needs to be adjusted to a slower value, thereby providing sufficient measurement time and abnormal repair time for the detection personnel, and ensuring high detection efficiency of the vehicle assembly line.
[0047] The technical scheme of the embodiment of the present application, when the vehicle body position information sent by the position detection component is acquired, a first detection image is acquired through the first camera component matched with the position detection component, and the size parameter of the part is acquired according to the pixel parameter acquired in the first detection image and the parameter conversion coefficient, and then a size abnormality prompt of an abnormal part whose size parameter does not conform to the standard size threshold is issued, thereby reducing the labor cost required for detecting the size parameter of the whole vehicle part, improving the detection efficiency and detection accuracy of the size parameter of the part, ensuring the detection of each vehicle on the whole vehicle production line, avoiding the vehicle with abnormal parts from flowing out of the production line, and meanwhile, the corresponding data record of each vehicle can be saved, providing a data basis for quality problem tracing, and facilitating the finding of blind spots in quality problem analysis.
[0048] Embodiment two
[0049] Figure 2 The flowchart of the size parameter detection method of the whole vehicle part provided in the second embodiment of the present application, in the embodiment of the present application, if it is determined that there is a second camera component corresponding to the current part, the current part is first added to the part set detected by the second camera component, and then the size parameter of the current part is continuously acquired through the second camera component. As shown in the figure, the method comprises: Figure 2
[0050] S201, in response to acquiring the vehicle body position information sent by the position detection component, a first detection image is acquired through the first camera component matched with the position detection component.
[0051] S202, the pixel parameter of at least one part in the first detection image is acquired, and the size parameter of the at least one part is acquired according to the pixel parameter of the at least one part and the parameter conversion coefficient.
[0052] S203, the size parameter of the at least one part is compared with the matched standard size threshold.
[0053] S204, if it is determined that there is an abnormal part whose size parameter does not conform to the matched standard size threshold in the at least one part, a size abnormality prompt of the abnormal part is issued.
[0054] S205, if it is determined that the size parameter of the current part conforms to the corresponding standard size threshold, and the absolute value of the difference between the size parameter of the current part and the standard size threshold is less than or equal to a first preset threshold, it is determined whether there is a second camera component corresponding to the current part.
[0055] S206, if it is determined that there is a second camera assembly corresponding to the current part, the current part is added to the part set detected by the second camera assembly, and the size parameter of the current part is continuously acquired by the second camera assembly.
[0056] S207, the size parameter of the current part acquired again is compared with the matched standard size threshold, and the current part is removed from the part set detected by the second camera assembly.
[0057] In order to improve the detection efficiency of the size parameter of the whole vehicle part, in the normal monitoring state, only one matched camera assembly can be configured for each part, that is, the detection image of each part is acquired only once. Taking the brake light switch as an example, in the normal operation process, whether the size parameter of the brake light switch is abnormal is judged only by the first detection image acquired by the first camera assembly. However, if the size parameter of the brake light switch meets the corresponding standard size threshold, but the numerical value of the size parameter and the standard size threshold is close, if the brake light switch has a corresponding second camera assembly, that is, the second camera assembly can also shoot the detection image of the brake light switch, and the shooting time of the second camera assembly is after the first camera assembly, then the brake light switch can be temporarily added to the part set detected by the second camera assembly, so that the brake light switch is also taken as the acquisition object of the size parameter in the second detection image acquired by the second camera assembly this time. After this acquisition is completed, the brake light switch is removed from the part set detected by the second camera assembly, that is, the brake light switch is no longer taken as the detection object in the second detection image acquired by the second camera assembly at other times. This not only ensures the accurate detection of the size parameter of the part close to the standard size threshold, but also avoids the redundant detection of the size parameter of the part, and improves the detection efficiency of the size parameter of the whole vehicle part.
[0058] S208, if it is determined that the size parameter of the current part does not meet the matched standard size threshold, a size abnormality prompt of the current part is issued.
[0059] The technical scheme of the embodiment of the application adds the current part to the part set detected by the second camera assembly after determining that there is a second camera assembly corresponding to the current part, and continues to compare the size parameter of the current part acquired by the second camera assembly with the matched standard size threshold. This not only ensures the accurate detection of the size parameter of the part close to the standard size threshold, but also avoids the redundant detection of the size parameter of the part, and improves the detection efficiency of the size parameter.
[0060] Embodiment three
[0061] Figure 3A flowchart of a size parameter detection method of a whole vehicle part provided for the third embodiment of the present application is shown in the figure. In the third embodiment of the present application, after the size abnormality prompt of the abnormal part is sent when it is determined that there is an abnormal part in the at least one part, the third camera assembly is started, and the second detection image is acquired in real time through the third camera assembly. As shown in Figure 3 The method comprises the following steps:
[0062] S301, in response to the acquisition of the vehicle body position information sent by the position detection assembly, the first detection image is acquired through the first camera assembly matched with the position detection assembly.
[0063] S302, the pixel parameters of the at least one part in the first detection image are acquired, and the size parameters of the at least one part are acquired according to the pixel parameters of the at least one part and the parameter conversion coefficient.
[0064] S303, the size parameters of the at least one part are compared with the matched standard size threshold.
[0065] S304, if it is determined that there is an abnormal part whose size parameters do not meet the matched standard size threshold in the at least one part, a size abnormality prompt of the abnormal part is sent.
[0066] S305, the third camera assembly is started, and the second detection image is acquired in real time through the third camera assembly.
[0067] S306, if it is determined that the abnormal repair gesture of the abnormal part is not acquired through the second detection image within the first preset time, the whole vehicle assembly line where the abnormal part is located is controlled to stop moving.
[0068] S307, if it is determined that the abnormal repair gesture of the abnormal part is acquired through the second detection image within the first preset time, the whole vehicle assembly line where the abnormal part is located is controlled to continue moving.
[0069] When the size abnormality prompt of the abnormal part is issued, the inspector enters the inside of the vehicle body, determines the specific size parameter of the abnormal part by a manual measurement method, and if it is determined that the size parameter is correct or that there is a size parameter error but the inspector can quickly repair it, then after it is determined that the size parameter is correct or the size parameter error is repaired, the inspector can display an abnormal repair gesture near the vehicle body, and if the abnormal repair gesture is acquired in the second detection image acquired by the third camera assembly within the first preset time, it is indicated that the size parameter is correct or the size parameter error has been repaired, at which time the vehicle assembly line is controlled to continue to move.
[0070] The technical scheme of the embodiment of the application, when it is determined that there is an abnormal part in the at least one part, after the size abnormality prompt of the abnormal part is issued, the third camera assembly is started and the second detection image is acquired in real time by the third camera assembly, if it is determined that the abnormal repair gesture of the abnormal part is not acquired in the second detection image within the first preset time, the vehicle assembly line where the abnormal part is located is controlled to stop moving, and if it is determined that the abnormal repair gesture of the abnormal part is acquired in the second detection image within the first preset time, the vehicle assembly line where the abnormal part is located is controlled to continue to move, thereby realizing the start-stop control of the vehicle assembly line, ensuring the manual measurement and abnormal repair of the abnormal part, and ensuring the high detection efficiency of the size parameter of the vehicle part.
[0071] Embodiment four
[0072] Figure 4 is a structural block diagram of a vehicle part size parameter detection device provided by the fourth embodiment of the application, and the vehicle part size parameter detection device specifically comprises:
[0073] The detection image acquisition module 401 is configured to acquire the first detection image by the first camera assembly matched with the position detection assembly in response to the vehicle body position information sent by the position detection assembly;
[0074] The size parameter acquisition module 402 is configured to acquire the pixel parameter of the at least one part in the first detection image, and acquire the size parameter of the at least one part according to the pixel parameter of the at least one part and the parameter conversion coefficient;
[0075] The parameter comparison execution module 403 is configured to compare the size parameter of the at least one part with the matched standard size threshold;
[0076] The abnormality prompting module 404 is used to issue a size abnormality prompt for the abnormal component if it is determined that there is an abnormal component whose size parameters do not meet the matching standard size threshold among the at least one component.
[0077] The technical solution of this invention, when obtaining vehicle position information sent by the position detection component, acquires a first detection image through a first camera component matched with the position detection component, and obtains the size parameters of the parts based on the pixel parameters and parameter conversion coefficients obtained in the first detection image. Then, it issues a size anomaly prompt for abnormal parts whose size parameters do not meet the standard size threshold. This reduces the labor cost required for detecting the size parameters of vehicle parts, improves the detection efficiency and accuracy of the size parameters of parts, ensures the inspection of each vehicle on the vehicle production line, and prevents vehicles with abnormal parts from leaving the production line. At the same time, each vehicle can save corresponding data records, providing a data foundation for tracing quality problems and facilitating the identification of blind spots in the analysis of quality problems.
[0078] Optionally, the size parameter acquisition module 402 is specifically used to determine a corresponding number of associated detection regions in the first detection image based on the number of parts detected by the first camera component; and to acquire the pixel parameters of the parts in the associated detection regions.
[0079] Optionally, the size parameter acquisition module 402 is specifically used to acquire the size parameters of the components in the associated detection area based on the pixel parameters of the components in the associated detection area and the parameter conversion coefficients corresponding to the associated detection area.
[0080] Optional, the dimensional parameter detection device for vehicle components also includes:
[0081] The camera component judgment module is used to determine whether a second camera component corresponding to the current component exists if it is determined that the size parameters of the current component meet the corresponding standard size threshold, and the absolute value of the difference between the size parameters of the current component and the standard size threshold is less than or equal to a first preset threshold; if it is determined that a second camera component corresponding to the current component exists, the size parameters of the current component are further acquired through the second camera component, and the size parameters of the current component acquired again are compared with the matching standard size threshold; if it is determined that the size parameters of the current component do not meet the matching standard size threshold, an abnormal size prompt for the current component is issued.
[0082] Optionally, the camera assembly judging module is specifically configured to add the current part into the part set detected by the second camera assembly, and continue to acquire the size parameter of the current part through the second camera assembly; and after comparing the size parameter of the current part acquired again with the matched standard size threshold, remove the current part from the part set detected by the second camera assembly.
[0083] Optionally, the size parameter detection device of the whole vehicle part further comprises:
[0084] The abnormality repair gesture detection module is configured to start the third camera assembly, and acquire a second detection image in real time through the third camera assembly; if it is determined that no abnormality repair gesture of the abnormal part is acquired through the second detection image within a first preset time, control the whole vehicle assembly line where the abnormal part is located to stop moving; if it is determined that the abnormality repair gesture of the abnormal part is acquired through the second detection image within the first preset time, control the whole vehicle assembly line where the abnormal part is located to continue moving.
[0085] Optionally, the size parameter detection device of the whole vehicle part further comprises:
[0086] The moving speed adjusting module is configured to adjust the moving speed of the whole vehicle assembly line where the abnormal part is located to a specified speed threshold according to the number and type of the abnormal part, so that the detection personnel enter the vehicle body to complete the size parameter measurement.
[0087] The size parameter detection device of the whole vehicle part provided by the application can execute the size parameter detection method of the whole vehicle part provided by any embodiment of the application, and has the corresponding function modules and beneficial effects of the execution method. Technical details not described in detail in the embodiment can be referred to the size parameter detection method of the whole vehicle part provided by any embodiment of the application.
[0088] Embodiment five
[0089] Figure 5 A structural schematic diagram of an electronic device 10 that can be used to implement embodiments of the application is shown. The electronic device is intended to represent various forms of digital computers, such as laptops, desktops, tablets, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device can also represent various forms of mobile devices such as personal digital assistants, cellular telephones, smartphones, wearable devices (e.g., headsets, glasses, watches, etc.), and other similar computing devices. The components shown here, their connections and relationships, and their functions, are meant to be examples only, and are not intended to limit the implementations of the applications described and / or claimed in this document.
[0090] As Figure 5As shown, the electronic device 10 includes at least one processor 11, and a memory, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., connected to the at least one processor 11 in communication. The memory stores a computer program executable by the at least one processor 11, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or loaded from the storage unit 18 into the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.
[0091] Various components in the electronic device 10 are connected to the I / O interface 15, including an input unit 16, such as a keyboard, a mouse, etc., an output unit 17, such as various types of displays, a speaker, etc., a storage unit 18, such as a magnetic disk, an optical disk, etc., and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices through a computer network, such as the Internet, and / or various telecommunication networks.
[0092] The processor 11 can be various general and / or special-purpose processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 performs various methods and processes described above, such as the size parameter detection method of the whole vehicle part.
[0093] In some embodiments, the size parameter detection method of the whole vehicle part can be implemented as a computer program tangibly embodied in a computer readable storage medium, such as the storage unit. In some embodiments, part or all of the computer program can be loaded and / or installed onto the heterogeneous hardware accelerator via the ROM and / or the communication unit. When the computer program is loaded into the RAM and executed by the processor, one or more steps of the size parameter detection method of the whole vehicle part described above can be performed. Alternatively, in other embodiments, the processor can be configured to perform the size parameter detection method of the whole vehicle part by any other appropriate means, such as by means of firmware.
[0094] The various embodiments of the systems and techniques described above can be implemented in digital electronic circuitry, integrated circuitry, a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on a chip (SOC), a load programmable logic device (CPLD), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include implementation in one or more computer programs that are executable and / or interpretable on a programmable system including at least one programmable processor, which can be special or general purpose, coupled to receive data and instructions from, and to transmit data and instructions to, a storage system, at least one input device, and at least one output device.
[0095] Computer programs used to implement the processes of the application can be written in any combination of one or more programming languages. These computer programs can be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the computer program, when executed, can cause instructions defined in the flow charts and / or block diagrams to be implemented. The computer program can be executed entirely on a machine, partially on a machine, partially on a machine as a standalone software package and partially on a remote machine or entirely on a remote machine or server.
[0096] In the context of the present application, a computer-readable storage medium can be a tangible medium that can contain or store computer programs for use by or in connection with an instruction execution system, apparatus, or device. Computer-readable storage media can include, but are not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium can be a machine-readable signal medium. More specific examples of the machine-readable storage medium will include one or more lines of electrical connections, portable computer disks, hard disk drives, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or Flash memory), optical fibers, portable compact disc read-only memories (CD-ROMs), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.
[0097] To provide for interaction with a user, the systems and techniques described here can be implemented on a heterogeneous hardware accelerator having a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user and a keyboard and a pointing device (e.g., a mouse or a trackball) by which the user can provide input to the heterogeneous hardware accelerator. Other kinds of devices can be used to provide for interaction with a user as well; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form, including acoustic, speech, or tactile input.
[0098] The systems and techniques described here can be implemented in a computing system that includes a back end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front end component (e.g., a user computer having a graphical user interface or a Web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back end, middleware, or front end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.
[0099] The computing system can include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. A server can be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system, to solve the defects of large management difficulty and weak business scalability in traditional physical host and VPS service.
[0100] It should be understood that the various forms of flow shown above can be re-ordered, added to, or deleted from without departing from the scope of the present disclosure. For example, the steps recited in the present disclosure can be executed in parallel, executed in sequence, or executed in a different order, as long as the desired results of the present disclosure are achieved, and the present disclosure is not limited herein.
[0101] The specific embodiments described above are not intended to be limiting, and persons skilled in the art will appreciate that various modifications, combinations, sub-combinations and alternatives can be made to the specific embodiments without departing from the spirit and principles of the disclosure. Accordingly, the disclosure is not limited to the specific embodiments described above, but only by the scope of the appended claims.
Claims
1. A method for detecting the dimensional parameters of vehicle components, characterized in that, include: In response to receiving vehicle position information sent by the position detection component, a first detection image is acquired through a first camera component matched with the position detection component; Obtain the pixel parameters of at least one component in the first detected image, and obtain the size parameters of the at least one component based on the pixel parameters of the at least one component and the parameter conversion coefficient; The dimensional parameters of at least one component are compared with a matching standard dimensional threshold. If it is determined that there is an abnormal component among the at least one component whose size parameters do not meet the matching standard size threshold, a size abnormality prompt for the abnormal component is issued; Based on the number and type of abnormal parts, the moving speed of the vehicle assembly line where the abnormal parts are located is adjusted to a specified speed threshold so that inspection personnel can enter the vehicle body to complete dimensional parameter measurements; wherein, the more abnormal parts there are or the more complex the measurement method for that type of abnormal part, the smaller the specified speed threshold. The third camera component is activated, and the second detection image is acquired in real time through the third camera component; If it is determined that no abnormal repair gesture of the abnormal part is obtained through the second detection image within the first preset time, the vehicle assembly line where the abnormal part is located is controlled to stop moving. If it is determined that an abnormal repair gesture of an abnormal component is obtained through the second detection image within a first preset time, the vehicle assembly line where the abnormal component is located is controlled to continue moving.
2. The method according to claim 1, characterized in that, The step of obtaining the pixel parameters of at least one component in the first detected image includes: Based on the number of components detected by the first camera component, a corresponding number of associated detection areas are determined in the first detection image; Obtain the pixel parameters of the components in the associated detection area.
3. The method according to claim 2, characterized in that, The step of obtaining the size parameters of the at least one component based on the pixel parameters and parameter conversion coefficients of the at least one component includes: Based on the pixel parameters of the components in the associated detection area and the parameter conversion coefficients corresponding to the associated detection area, the size parameters of the components in the associated detection area are obtained.
4. The method according to claim 1, characterized in that, After comparing the dimensional parameters of the at least one component with a matching standard dimensional threshold, the method further includes: If it is determined that the size parameters of the current component meet the corresponding standard size threshold, and the absolute value of the difference between the size parameters of the current component and the standard size threshold is less than or equal to the first preset threshold, then determine whether there is a second camera component corresponding to the current component; If it is determined that there is a second camera component corresponding to the current component, the size parameters of the current component are obtained through the second camera component, and the size parameters of the current component obtained again are compared with the matching standard size threshold. If it is determined that the current component's dimensional parameters do not meet the matching standard dimensional threshold, a dimensional anomaly warning for the current component will be issued.
5. The method according to claim 4, characterized in that, The step of continuing to acquire the current component's size parameters through the second camera component specifically includes: The current component is added to the component set detected by the second camera component, and the size parameters of the current component are further obtained through the second camera component; After comparing the newly acquired dimensional parameters of the current component with the matching standard dimensional threshold, the process also includes: Remove the current component from the set of components detected by the second camera component.
6. A device for detecting the dimensional parameters of vehicle parts, characterized in that, include: The detection image acquisition module is used to acquire a first detection image through a first camera component that matches the position detection component in response to receiving vehicle position information sent by the position detection component. The size parameter acquisition module is used to acquire the pixel parameters of at least one component in the first detection image, and to acquire the size parameters of the at least one component based on the pixel parameters of the at least one component and the parameter conversion coefficient. The parameter comparison execution module is used to compare the dimensional parameters of the at least one component with a matching standard dimensional threshold. An error prompting module is used to issue an error prompt for the abnormal component if it is determined that there is an abnormal component whose size parameters do not meet the matching standard size threshold among the at least one component. The moving speed adjustment module is used to adjust the moving speed of the vehicle assembly line where the abnormal parts are located to a specified speed threshold according to the number and type of abnormal parts, so that the inspection personnel can enter the vehicle body to complete the dimensional parameter measurement. An abnormal repair gesture detection module is used to activate a third camera component and acquire a second detection image in real time through the third camera component; if it is determined that no abnormal repair gesture of the abnormal part is acquired through the second detection image within a first preset time, the assembly line of the vehicle where the abnormal part is located is controlled to stop moving; if it is determined that an abnormal repair gesture of the abnormal part is acquired through the second detection image within the first preset time, the assembly line of the vehicle where the abnormal part is located is controlled to continue moving.
7. An electronic device, characterized in that, The electronic device includes: At least one processor; and A memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor, the computer program being executed by the at least one processor to enable the at least one processor to perform the method for detecting the dimensional parameters of vehicle parts according to any one of claims 1-5.
8. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions that, when executed by a processor, implement the method for detecting the dimensional parameters of vehicle components as described in any one of claims 1-5.
Citation Information
Patent Citations
Industrial part size detection method based on machine vision
CN111189387A
System and method for checking misloading and neglected loading of whole automobile assembly
CN115326411A
Visual inspection system for vehicle chassis
CN115379093A