Methods, devices, equipment and media for determining the assembly line of car doors
By acquiring images of car doors and identifying the color information of the car frame and door panel areas, a neural network model is used to determine the pipeline processing, which solves the problem of low efficiency in car door detection and debugging, and achieves efficient door panel recognition and assembly accuracy.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- CHINA FAW CO LTD
- Filing Date
- 2023-07-24
- Publication Date
- 2026-05-05
AI Technical Summary
Existing technologies for door inspection and debugging are inefficient, relying on manual inspection, which leads to low efficiency and low accuracy.
By acquiring images of the car door, identifying the color information of the car frame and door panel areas, using a neural network model for target detection, and determining the target pipeline for processing based on the color information.
It improves the efficiency of door panel color recognition and error/missing part detection, thereby increasing door processing efficiency and door panel assembly accuracy.
Smart Images

Figure CN116862890B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of vehicle assembly technology, and in particular to a method, apparatus, equipment and medium for determining the assembly line of a vehicle door. Background Technology
[0002] With the rapid development of the automotive industry, the variety of car models is constantly increasing, and the colors of interior door panels are also becoming more diverse.
[0003] In current automotive OEM assembly workshops, a large number of personnel still manually inspect and adjust the installed interior door panels, resulting in low efficiency in door inspection and adjustment. Summary of the Invention
[0004] This invention provides a method, apparatus, equipment, and medium for determining the assembly line of vehicle doors, so as to improve the efficiency of detecting misinstallation or omission of door panels, the efficiency of vehicle door processing, and the accuracy of door panel assembly.
[0005] In a first aspect, the present invention provides a method for determining the assembly line of a vehicle door, comprising:
[0006] Obtain the door image of the target car door;
[0007] The frame area and door panel area of the target door are determined from the door image, and the color information of the frame area and the door panel area are determined.
[0008] If the color information of the door panel area is different from the preset color information, the target assembly line of the target door is determined based on the color information of the vehicle frame area and the color information of the door panel area. The target assembly line is used to process the target door.
[0009] Secondly, the present invention also provides a vehicle door assembly line determination device, comprising:
[0010] The image acquisition module is used to acquire images of the target car door.
[0011] The color information determination module is used to determine the frame area and door panel area of the target door from the door image, and to determine the color information of the frame area and the color information of the door panel area.
[0012] The pipeline determination module is used to determine the target pipeline for the target door based on the color information of the vehicle frame area and the color information of the door panel area if the color information of the door panel area is different from the preset color information. The target pipeline is used to process the target door.
[0013] Thirdly, embodiments of the present invention also provide an electronic device, comprising:
[0014] At least one processor; and
[0015] A memory that is communicatively connected to at least one processor; wherein
[0016] The memory stores instructions that can be executed by at least one processor, which enables the at least one processor to perform the door assembly line determination method provided in any embodiment of the present invention.
[0017] Fourthly, embodiments of the present invention also provide a computer-readable storage medium storing computer instructions, which are used to cause a processor to execute the door assembly line determination method of any embodiment of the present invention.
[0018] This invention provides an embodiment of the invention that acquires an image of a target car door; determines the frame area and door panel area of the target car door from the image, and determines the color information of the frame area and the door panel area; if the color information of the door panel area differs from preset color information, a target production line for the target car door is determined based on the color information of the frame area and the door panel area, and the target production line is used to process the target car door. This technical solution can determine the color information of the frame area and the door area from the car door image, improving the efficiency of door panel color recognition compared to the existing method of manually identifying door panel colors; furthermore, it detects whether door panels are incorrectly or missing based on the identified door panel colors, improving the efficiency of incorrect or missing door panel detection; and it determines a target production line based on the color information of the frame area and the door panel area, so that the correct door panels are assembled on the car door through the target production line. Compared to the existing method of manually processing doors with incorrectly or missing door panels, this improves the processing efficiency of the car door and the assembly accuracy of the door panel.
[0019] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of the present invention, nor is it intended to limit the scope of the invention. Other features of the invention will become readily apparent from the following description. Attached Figure Description
[0020] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0021] Figure 1 This is a flowchart of a method for determining the assembly line of a car door according to Embodiment 1 of the present invention;
[0022] Figure 2This is a flowchart of a method for determining the assembly line of a car door according to Embodiment 2 of the present invention;
[0023] Figure 3 This is a flowchart of a method for determining the assembly line of a car door according to Embodiment 3 of the present invention;
[0024] Figure 4 This is a schematic diagram of the structure of a vehicle door assembly line determining device according to Embodiment 4 of the present invention;
[0025] Figure 5 This is a schematic diagram of the structure of an electronic device that implements the assembly line determination method for car doors according to an embodiment of the present invention. Detailed Implementation
[0026] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.
[0027] It should be noted that the terms "first" and "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.
[0028] The acquisition, storage, and application of vehicle door images and other related data in the technical solutions of this invention comply with relevant laws and regulations and do not violate public order and good morals.
[0029] Example 1
[0030] Figure 1 This is a flowchart of a method for determining the assembly line of a car door according to Embodiment 1 of the present invention. This embodiment can be applied to the situation of determining the assembly line of a car door. The method can be executed by a car door assembly line determination device, which can be implemented in hardware and / or software and specifically configured in an electronic device, such as a server.
[0031] See Figure 1 The method for determining the assembly line for the shown car doors includes:
[0032] S101. Obtain the door image of the target door.
[0033] In this embodiment, the target vehicle door can be the door of the target production line to be determined. The door image can be an image of the target vehicle door. In one specific embodiment, the target vehicle door can be photographed using an industrial camera to obtain an image of the target vehicle door. In another specific embodiment, the target vehicle door can be recorded as a video using an industrial camera, and the target vehicle door image can be extracted from the video.
[0034] S102. Determine the frame area and door panel area of the target door from the door image, and determine the color information of the frame area and the color information of the door panel area.
[0035] In this embodiment, the vehicle frame area can be the area where the frame of the target vehicle door is located in the vehicle door image. The door panel area can be the area where the door panel is located in the door panel image. Color information is the information used to represent color. In one optional embodiment, color information can be represented in the form of color levels, where each color level represents a different color, and the association between the color level and the corresponding color can be set by the technician. In another optional embodiment, color information can be represented in the form of pixel values, where the number of dimensions of the pixel values is the same as the number of color channels in the vehicle door image; for example, if the vehicle door image is a three-dimensional color image, that is, the number of color channels in the vehicle door image is 3, then the color information can be in the form of (A, B, C), where A represents the pixel value of the first color channel, B represents the pixel value of the second color channel, and C represents the pixel value of the third color channel.
[0036] Specifically, a neural network model is used to perform target detection on the car door image, identifying the frame region and door panel region of the target car door from the image, and employing a specific algorithm to determine the color information of the frame region and the door panel region. In one specific implementation, a YOLOv5 network model with ResNet (Residual Network) as the backbone is used to perform target detection on the car door image, thereby reducing the computational load required for target detection on the car door image and improving the recognition efficiency of the frame region and door panel region.
[0037] Optionally, determining the color information of the vehicle frame area includes: obtaining the pixel value of each pixel within the vehicle frame area; counting the number of pixels with the same pixel value; and determining the color information of the vehicle frame area based on the number of pixels with each pixel value.
[0038] Specifically, for each color channel within the vehicle frame area, the pixel value of each pixel within the vehicle frame area in that color channel is acquired; the number of pixels with the same pixel value in that color channel is counted; the ratio between the number of pixels with each pixel value in that color channel and the total number of pixels in the vehicle frame area is determined; the difference between the ratio of the pixel value with the largest ratio and the ratio of the pixel value with the second largest ratio in that color channel is determined; if this difference is less than a preset difference, the pixel value with the largest ratio and the pixel value with the second largest ratio are used as the color information of the vehicle frame area in that color channel; if this difference is greater than or equal to the preset difference, the pixel value with the largest ratio in that color channel is used as the color information of the vehicle frame area in that color channel. The pixel value with the second largest ratio can be a pixel value whose ratio is only less than the largest ratio. The preset difference can be set by technicians based on actual needs or practical experience.
[0039] Understandably, by adopting the above technical solution, the proportion of each pixel value in the vehicle frame area can be determined based on the number of pixels for each pixel value, thereby determining whether the color of the vehicle frame area is a single color or a combination of colors; furthermore, the color information of the vehicle frame area can be determined based on the number of pixels for each pixel value, overcoming the deficiency of existing technologies that can only identify a single color and improving the accuracy of the color information of the vehicle frame area.
[0040] Optionally, determining the color information of the door panel area includes: for each color channel of the door panel area, determining the average pixel value of each pixel in that color channel; and using the average pixel value as the color information of the door panel image in that color channel.
[0041] S103. If the color information of the door panel area is different from the preset color information, the target assembly line of the target door is determined based on the color information of the vehicle frame area and the color information of the door panel area. The target assembly line is used to process the target door.
[0042] In this embodiment, the preset color information can be set independently by technicians based on actual needs or practical experience; this invention does not impose any limitations on this. The target assembly line is the assembly line that will process the target car door.
[0043] Specifically, if the color information of the door panel area is different from the preset color information, a certain algorithm is used to determine the target assembly line of the target door based on the color information of the vehicle frame area and the color information of the door panel area, so as to transfer the target door to the target assembly line for processing.
[0044] In one optional embodiment, the target door moves on its own assembly line, and the door image is the image of the target car on its own assembly line; if the color information of the door panel area is the same as the preset color information, then the assembly line where the target door is located is taken as the target assembly line of the target door, that is, the target door is kept on its own assembly line and is not transferred to other assembly lines.
[0045] This invention provides an embodiment of the invention that acquires an image of a target car door; determines the frame area and door panel area of the target car door from the image, and determines the color information of the frame area and the door panel area; if the color information of the door panel area differs from preset color information, a target production line for the target car door is determined based on the color information of the frame area and the door panel area, and the target production line is used to process the target car door. This invention's technical solution can determine the color information of the frame area and the door area from the car door image, improving the efficiency of door panel color recognition compared to the prior art's method of manually identifying door panel colors; furthermore, it detects whether door panels are incorrectly or missing based on the identified door panel colors, improving the efficiency of incorrect or missing door panel detection; and it determines a target production line based on the color information of the frame area and the door panel area, so that the correct door panel is assembled on the car door through the target production line. Compared to the prior art's method of manually processing doors with incorrectly or missing door panels, this improves the processing efficiency of the car door and the assembly accuracy of the door panel.
[0046] Example 2
[0047] Figure 2 This is a flowchart of a method for determining the assembly line of a car door according to Embodiment 2 of the present invention. Based on the technical solution of the above embodiments, the present invention optimizes and improves the operation of determining the target assembly line.
[0048] Furthermore, the step of "determining the target assembly line of the target door based on the color information of the vehicle frame area and the door panel area" is refined to "if the color information of the vehicle frame area is the same as the color information of the door panel area, then the door panel installation assembly line is determined as the target assembly line of the target door; if the color information of the vehicle frame area is different from the color information of the door panel area, the target color difference between the color information of the vehicle frame area and the color information of the door panel area is determined; based on the comparison result between the target color difference and the preset color difference, the target assembly line of the target door is determined," in order to improve the operation of determining the target assembly line.
[0049] It should be noted that for any parts not described in detail in the embodiments of the present invention, please refer to the description in the foregoing embodiments.
[0050] See Figure 2 The method for determining the assembly line for the shown car doors includes:
[0051] S201. Obtain the door image of the target door.
[0052] S202. Determine the frame area and door panel area of the target door from the door image, and determine the color information of the frame area and the color information of the door panel area.
[0053] S203. If the color information of the door panel area is different from the preset color information, and the color information of the vehicle frame area is the same as the color information of the door panel area, then the door panel installation line is determined as the target line of the target door.
[0054] In this embodiment, the door panel installation line can be a line for installing door panels on a target vehicle door. Specifically, if the color information of the vehicle frame area is the same as the color information of the door panel area, it can be used to indicate that a door panel is missing from the target vehicle door, and the door panel installation line is then identified as the target line for the target vehicle door.
[0055] S204. If the color information of the door panel area is different from the preset color information, and the color information of the vehicle frame area is different from the color information of the door panel area, determine the target color difference between the color information of the vehicle frame area and the color information of the door panel area.
[0056] In this embodiment, the target color difference is the difference between the color information of the vehicle frame area and the color information of the door panel area. In an optional embodiment, the color information is represented in the form of color grades, and the target color difference can be the grade difference between the color grades of the vehicle frame area and the door panel area. In another optional embodiment, the color information is represented in the form of pixel values, and the target color difference can be the difference between the pixel values of the vehicle frame area and the door panel area.
[0057] S205. Based on the comparison results between the target color difference and the preset color difference, determine the target assembly line of the target door.
[0058] In this embodiment, the preset color difference can be set independently by technicians based on actual needs or practical experience, and the present invention does not limit this.
[0059] Optionally, the target production line for the target door is determined based on the comparison between the color difference and the preset color difference, including: if the target color difference is less than or equal to the preset color difference, the door panel painting production line is determined as the target production line for the target door; if the target color difference is greater than the preset color difference, the door panel disassembly production line is determined as the target production line for the target door.
[0060] The door panel painting production line can be a production line that paints the door panels on the target vehicle door. The door panel removal production line can be a production line that removes the door panels on the target vehicle door.
[0061] Understandably, by adopting the above technical solution, different target production lines can be determined for the target car door based on the magnitude of the difference between the target color and the preset color, so as to determine whether to perform painting or disassembly operations on the door panel in the target car door. Compared with the existing technical solution that only disassembles and reassembles the incorrectly installed door panel, the flexibility of handling the target car door is improved.
[0062] In this embodiment of the invention, when the color information of the door panel area differs from the preset color information, if the color information of the frame area is the same as that of the door panel area, then the door panel installation line is determined as the target line for the target car door; if the color information of the frame area is different from that of the door panel area, a target color difference between the color information of the frame area and the door panel area is determined; based on the comparison result between the target color difference and the preset color difference, the target line for the target car door is determined. The technical solution implemented by this invention, based on the comparison result between the color information of the frame area and the door panel area, and the comparison result between the target color difference and the preset color difference, determines different target lines for the target car door, improving the flexibility of determining the target line; and based on the color information and color difference, determining the target line for the target car door improves the detection efficiency of the door panel and the processing efficiency of the car door compared to the prior art's technical solution of manually inspecting the door panel and processing the car door.
[0063] Example 3
[0064] Figure 3 This is a flowchart of a method for determining a car door assembly line according to Embodiment 3 of the present invention. Based on the technical solution of the above embodiments, the present invention optimizes and improves the determination operation of the car door image.
[0065] Furthermore, the process of "acquiring the door image of the target door" is refined to "acquiring the original image of the target door and determining the ambient light intensity of the door panel detection line; and performing color correction on the original image based on the ambient light intensity to obtain the door image", in order to improve the door image acquisition operation.
[0066] It should be noted that for any parts not described in detail in the embodiments of the present invention, please refer to the description in the foregoing embodiments.
[0067] See Figure 3 The method for determining the assembly line for the shown car doors includes:
[0068] S301. Acquire the original image of the target door and determine the ambient light intensity of the door panel detection line.
[0069] In this example, the original image can be an RGB format image directly acquired from the target vehicle door. The door panel detection pipeline can be a pipeline that performs door panel detection on the target vehicle door. The target vehicle door is located on the door panel detection pipeline, meaning the original image is the image of the target vehicle door located on the door panel detection pipeline. The ambient light intensity is the light intensity in the environment where the door panel detection pipeline is located.
[0070] S302. Based on the ambient light intensity, the original image is color corrected to obtain the car door image.
[0071] Specifically, a certain algorithm is used to correct the original image to obtain the car door image.
[0072] Optionally, the original image is color-corrected based on the ambient light intensity to obtain a car door image, including: converting the color format of the original image to HSL (Hue-Saturation-Lightness) format; correcting the L channel color component in the format-converted original image based on the ambient light intensity; and determining the car door image based on the H channel color component, S channel color component, and corrected L channel color component in the format-converted original image.
[0073] Among them, the color component can be the pixel value of a pixel in the corresponding channel; the L channel color component is the pixel value of a pixel in the L channel; the H channel color component is the pixel value of a pixel in the H channel; and the S channel color component is the pixel value of a pixel in the S channel.
[0074] Specifically, a certain algorithm is used to convert the original RGB format image into an original HSL format image; the pixel values of each pixel in the L color channel of the original HSL format image are corrected according to the ambient light intensity to obtain the corrected L channel color components; the image composed of the H channel color components, S channel color components and the corrected L channel color components is determined as the car door image.
[0075] It is understandable that by adopting the above technical solution, the L-channel color component representing the brightness of the image in the original image is corrected according to the ambient light intensity to obtain the car door image. This can reduce the influence of ambient light on the color brightness in the image, thereby improving the color accuracy of the car door image and further improving the accuracy of the color information in the car frame area and the door panel area.
[0076] Optionally, the L-channel color component in the original image after format conversion is corrected according to the ambient light intensity, including: determining the light intensity ratio between the ambient light intensity and the preset light intensity; and determining the corrected L-channel color component based on the light intensity ratio and the L-channel color component in the original image after format conversion.
[0077] The preset illumination intensity can be set by technicians based on actual needs or practical experience. Specifically, the ratio between the L channel color component and the illumination intensity in the original image after format conversion is determined as the corrected L channel color component.
[0078] Understandably, by adopting the above technical solution, if the ambient light intensity is greater than the preset light intensity, the L channel color component is corrected according to the light intensity ratio, which can increase the L channel color component; if the ambient light intensity is less than the preset light intensity, the L channel color component is corrected according to the light intensity ratio, which can decrease the L channel color component. By correcting the L channel color component according to the light intensity ratio, the influence of ambient light on the L channel color component is reduced, thereby obtaining accurate L channel color components and thus obtaining a color-accurate car door image.
[0079] S303. Determine the frame area and door panel area of the target door from the door image, and determine the color information of the frame area and the color information of the door panel area.
[0080] S304. If the color information of the door panel area is different from the preset color information, the target assembly line of the target door is determined based on the color information of the vehicle frame area and the color information of the door panel area. The target assembly line is used to process the target door.
[0081] This invention acquires the original image of the target vehicle door and determines the ambient light intensity of the door panel detection line. Based on the ambient light intensity, the original image is color-corrected to obtain the vehicle door image. The technical solution of this invention reduces the impact of ambient light on image brightness, thereby obtaining accurate image colors, improving the color accuracy of the vehicle door image, and further improving the accuracy of the color information of the vehicle frame area and the door panel area determined from the vehicle door image.
[0082] Example 4
[0083] Figure 4 This is a schematic diagram of a vehicle door assembly line determination device according to Embodiment 4 of the present invention. This embodiment of the present invention is applicable to situations requiring the determination of a vehicle door assembly line. The device can execute a vehicle door assembly line determination method and can be implemented in hardware and / or software. The device can be configured in an electronic device, such as a server.
[0084] See Figure 4 The illustrated assembly line determination device for a car door includes an image acquisition module 401, a color information determination module 402, and an assembly line determination module 403, wherein...
[0085] Image acquisition module 401 is used to acquire a door image of the target door;
[0086] The color information determination module 402 is used to determine the frame area and door panel area of the target door from the door image, and to determine the color information of the frame image and the color information of the door panel area.
[0087] The pipeline determination module 403 is used to determine the target pipeline of the target door based on the color information of the vehicle frame area and the color information of the door panel area if the color information of the door panel area is different from the preset color information. The target pipeline is used to process the target door.
[0088] In this embodiment of the invention, an image acquisition module acquires an image of the target car door; a color information determination module determines the frame area and door panel area of the target car door from the car door image, and determines the color information of the frame image and the color information of the door panel area; a pipeline determination module determines the target pipeline for the target car door based on the color information of the frame area and the color information of the door panel area if the color information of the door panel area is different from the preset color information. The target pipeline is used to process the target car door. The technical solution of this invention can determine the color information of the vehicle frame area and the vehicle door area from the vehicle door image, which improves the recognition efficiency of the door panel color compared with the existing technology of manually identifying the door panel color. Furthermore, it can detect whether the door panel is incorrectly or missing based on the identified door panel color, thus improving the detection efficiency of incorrect or missing door panel installation. Based on the color information of the vehicle frame area and the color information of the door panel area, a target production line is determined so that the correct door panel can be assembled on the vehicle door through the target production line. Compared with the existing technology of manually handling vehicles with incorrectly or missing door panels, this improves the processing efficiency of the vehicle door and the assembly accuracy of the door panel.
[0089] Optionally, the pipeline determination module 403 includes:
[0090] The first production line determination unit is used to determine the door panel installation production line as the target production line of the target door if the color information of the vehicle frame area is the same as the color information of the door panel area.
[0091] The color difference determination unit is used to determine the target color difference between the color information of the vehicle frame area and the color information of the door panel area if the color information of the vehicle frame area is different from the color information of the door panel area.
[0092] The second production line determination unit is used to determine the target production line of the target door based on the comparison result between the target color difference and the preset color difference.
[0093] Optionally, the second pipeline determination unit is specifically used for:
[0094] If the target color difference is less than or equal to the preset color difference, then the door panel painting production line is determined as the target production line for the target door.
[0095] If the target color difference is greater than the preset color difference, then the door panel disassembly line will be designated as the target line for the target door.
[0096] Optionally, the image acquisition module 401 includes:
[0097] The illumination intensity determination unit is used to acquire the original image of the target door and determine the ambient illumination intensity of the door panel detection line;
[0098] The image acquisition unit is used to perform color correction on the original image based on the ambient light intensity to obtain the car door image.
[0099] Optionally, the image acquisition unit includes:
[0100] The format conversion subunit is used to convert the color format of the original image to HSL format;
[0101] The color correction subunit is used to correct the L channel color components in the original image after format conversion based on the ambient light intensity.
[0102] The image acquisition subunit is used to determine the door image based on the H channel color components, S channel color components, and corrected L channel color components in the original image after format conversion.
[0103] Optional, color correction subunit, specifically used for:
[0104] Determine the ratio of ambient light intensity to preset light intensity;
[0105] The corrected L-channel color components are determined based on the light intensity ratio and the L-channel color components in the original image after format conversion.
[0106] Optionally, the color information determination module 402 includes:
[0107] The pixel acquisition unit is used to acquire the pixel value of each pixel within the vehicle frame area;
[0108] The quantity counting unit is used to count the number of pixels with the same pixel value.
[0109] The color information determination unit is used to determine the color information of the vehicle frame area based on the number of pixels for each pixel value.
[0110] The door assembly line determination device provided in this embodiment of the invention can execute the door assembly line determination method provided in any embodiment of the invention, and has the corresponding functional modules and beneficial effects of executing the door assembly line determination method.
[0111] Example 5
[0112] Figure 5 A schematic diagram of an electronic device 500 that can be used to implement embodiments of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the invention described and / or claimed herein.
[0113] like Figure 5 As shown, the electronic device 500 includes at least one processor 501 and a memory, such as a read-only memory (ROM) 502 or a random access memory (RAM) 503, communicatively connected to the at least one processor 501. The memory stores computer programs executable by the at least one processor. The processor 501 can perform various appropriate actions and processes based on the computer program stored in the ROM 502 or loaded into the RAM 503 from storage unit 508. The RAM 503 can also store various programs and data required for the operation of the electronic device 500. The processor 501, ROM 502, and RAM 503 are interconnected via a bus 504. An input / output (I / O) interface 505 is also connected to the bus 504.
[0114] Multiple components in electronic device 500 are connected to I / O interface 505, including: input unit 506, such as keyboard, mouse, etc.; output unit 507, such as various types of monitors, speakers, etc.; storage unit 508, such as disk, optical disk, etc.; and communication unit 509, such as network card, modem, wireless transceiver, etc. Communication unit 509 allows electronic device 500 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.
[0115] Processor 501 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processor 501 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. Processor 501 performs the various methods and processes described above, such as the assembly line determination method for car doors.
[0116] In some embodiments, the door assembly line determination method may be implemented as a computer program tangibly contained in a computer-readable storage medium, such as storage unit 508. In some embodiments, part or all of the computer program may be loaded into and / or installed on electronic device 500 via ROM 502 and / or communication unit 509. When the computer program is loaded into RAM 503 and executed by processor 501, one or more steps of the door assembly line determination method described above may be performed. Alternatively, in other embodiments, processor 501 may be configured to perform the door assembly line determination method by any other suitable means (e.g., by means of firmware).
[0117] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.
[0118] Computer programs used to implement the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when executed by the processor, the computer programs cause the functions / operations specified in the flowcharts and / or block diagrams to be performed. The computer programs may be executed entirely on a machine, partially on a machine, or as a standalone software package, partially on a machine and partially on a remote machine, or entirely on a remote machine or server.
[0119] In the context of this invention, a computer-readable storage medium can be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, apparatus, or device. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination thereof. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.
[0120] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).
[0121] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as data servers), or computing systems that include middleware components (e.g., application servers), or computing systems that include frontend components (e.g., user computers with graphical user interfaces or web browsers through which users can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., communication networks). Examples of communication networks include local area networks (LANs), wide area networks (WANs), blockchain networks, and the Internet.
[0122] A computing system can include clients and servers. Clients and servers are generally geographically separated and typically interact via communication networks. The client-server relationship is created by computer programs running on the respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or cloud host, which is a hosting product within the cloud computing service system. It addresses the shortcomings of traditional physical hosts and VPS (Virtual Private Server) services, such as high management difficulty and weak business scalability.
[0123] It should be understood that the various forms of processes shown above can be used, with steps reordered, added, or deleted. For example, the steps described in this invention can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this invention can be achieved, and this is not limited herein.
[0124] The specific embodiments described above do not constitute a limitation on the scope of protection of this invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this invention should be included within the scope of protection of this invention.
Claims
1. A method for determining the assembly line of a car door, characterized in that, The method includes: Obtain the door image of the target car door; The frame area and door panel area of the target door are determined from the door image, and the color information of the frame area and the color information of the door panel area are determined. If the color information of the door panel area is different from the preset color information, then the target assembly line of the target door is determined according to the color information of the vehicle frame area and the color information of the door panel area. The target assembly line is used to process the target door. The step of determining the target assembly line of the target vehicle door based on the color information of the vehicle frame area and the color information of the door panel area includes: If the color information of the vehicle frame area is the same as the color information of the door panel area, then the door panel installation line is determined as the target production line of the target door. If the color information of the vehicle frame area is different from the color information of the door panel area, determine the target color difference between the color information of the vehicle frame area and the color information of the door panel area; Determining the target assembly line for the target door based on a comparison between the target color difference and a preset color difference includes: If the target color difference is less than or equal to the preset color difference, then the door panel painting production line is determined as the target production line of the target door. If the target color difference is greater than the preset color difference, then the door panel disassembly line is determined as the target assembly line for the target door.
2. The method according to claim 1, characterized in that, The process of acquiring the door image of the target door includes: Acquire the original image of the door panel of the target vehicle door and determine the ambient light intensity of the door panel detection line; Based on the ambient light intensity, the original image is color-corrected to obtain the car door image.
3. The method according to claim 2, characterized in that, The step of color correction of the original image based on the ambient light intensity to obtain the car door image includes: Convert the original image's color format to HSL format; The L channel color component in the original image after format conversion is corrected according to the ambient light intensity. The car door image is determined based on the H channel color components, S channel color components, and corrected L channel color components in the original image after format conversion.
4. The method according to claim 3, characterized in that, The step of correcting the L-channel color component in the original image after format conversion based on the ambient light intensity includes: Determine the light intensity ratio between the ambient light intensity and the preset light intensity; The corrected L-channel color components are determined based on the light intensity ratio and the L-channel color components in the original image after format conversion.
5. The method according to claim 1, characterized in that, Determining the color information of the vehicle frame area includes: Obtain the pixel value of each pixel within the vehicle frame area; Count the number of pixels with the same pixel value; The color information of the vehicle frame area is determined based on the number of pixels for each pixel value.
6. A vehicle door assembly line determining device, characterized in that, The device includes: The image acquisition module is used to acquire images of the target car door. The color information determination module is used to determine the frame area and door panel area of the target door from the door image, and to determine the color information of the frame area and the color information of the door panel area. The assembly line determination module is used to determine the target assembly line of the target vehicle door based on the color information of the vehicle frame area and the color information of the door panel area if the color information of the door panel area is different from the preset color information. The target assembly line is used to process the target vehicle door. The pipeline verification module includes: The first production line determination unit is used to determine the door panel installation production line as the target production line of the target door if the color information of the vehicle frame area is the same as the color information of the door panel area. The color difference determination unit is used to determine the target color difference between the color information of the vehicle frame area and the color information of the door panel area if the color information of the vehicle frame area is different from the color information of the door panel area. The second production line determination unit is used to determine the target production line of the target door based on the comparison result between the target color difference and the preset color difference. The second pipeline determination unit is specifically used for: If the target color difference is less than or equal to the preset color difference, then the door panel painting production line is determined as the target production line for the target door. If the target color difference is greater than the preset color difference, then the door panel disassembly line will be designated as the target line for the target door.
7. An electronic device, characterized in that, The electronic device includes: At least one processor; and A memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor, the computer program being executed by the at least one processor to enable the at least one processor to perform the assembly line determination method for the vehicle door according to any one of claims 1-5.
8. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions that, when executed by a processor, implement the assembly line determination method for the vehicle door as described in any one of claims 1-5.
Citation Information
Patent Citations
Vehicle beauty maintenance intelligent service platform based on big data machine vision
CN111915652A
Vehicle door sealing strip abnormal sound risk prediction method, storage medium, equipment and device
CN113343363A