Part assembly monitoring system, method, electronic device, and storage medium

Abstract

The application discloses a part assembly monitoring system, method, electronic equipment and storage medium. The part assembly monitoring system comprises an information acquisition module, an assembly monitoring module and an alarm execution module. The information acquisition module is used for acquiring target part information and part assembly information of a vehicle, and sending the target part information and the part assembly information to the assembly monitoring module. The assembly monitoring module is used for receiving the target part information and the part assembly information, and determining part information of an assembly part in the part assembly information. The assembly monitoring module is further used for determining whether assembly of the assembly part is accurate according to a consistency degree of the part information of the assembly part and the target part information of the vehicle, and sending alarm information to the alarm execution module when the assembly of the assembly part is inaccurate. The alarm execution module is used for alarming when the alarm information is received. The scheme of the application reduces the steps of manual operation and improves the accuracy of part assembly.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of vehicle manufacturing, and in particular to a part assembly monitoring system and method, an electronic device, and a storage medium. BACKGROUND

[0002] With the development of technology, the functions of vehicles are increasing, and the types of customized configurations of vehicles are increasing to meet the various needs of drivers and passengers. At present, the number of vehicle models produced on the same production line is as high as more than 10, and the types of configurations of the same vehicle model can reach more than 20. This makes the same vehicle model have multiple configuration parts, and the assembly operations of the parts are different.

[0003] The existing vehicle part assembly is mainly checked by workers after being installed manually to confirm the installation result, and the workers are trained for standard operation to ensure the installation accuracy. However, due to the multiple manual operation steps, it is easy to miss the installation steps in the operation process or the parts are not assembled in place. SUMMARY

[0004] The present application provides a part assembly monitoring system and method, an electronic device, and a storage medium to solve the problem that the existing vehicle part assembly process is prone to miss installation steps in the operation process or parts are not assembled in place due to multiple manual operation steps.

[0005] In a first aspect, the present application provides a part assembly monitoring system, which comprises an information acquisition module, an assembly monitoring module, and an alarm execution module; wherein the assembly monitoring module is connected with the information acquisition module and the alarm execution module respectively;

[0006] The information acquisition module is configured to acquire target part information of a vehicle and part assembly information, and send the target part information and the part assembly information to the assembly monitoring module; wherein the target part information is used to represent part information corresponding to the vehicle in a preset part information library, and the part assembly information is used to represent assembly process information of the vehicle when being assembled;

[0007] The assembly monitoring module is configured to receive the target part information and the part assembly information, and determine part information of an assembly part in the part assembly information; wherein the assembly part is a part actually assembled for the vehicle in the part assembly information;

[0008] The assembly monitoring module is further configured to determine whether the assembly of the assembly part is accurate according to the consistency degree of the part information of the assembly part and the target part information of the vehicle, and send alarm information to the alarm execution module when the assembly of the assembly part is inaccurate;

[0009] The alarm execution module is configured to alarm when the alarm information is received.

[0010] In a second aspect, the application provides a part assembly monitoring method, applied to an assembly monitoring module of a part assembly monitoring system as described in any of the embodiments of the application, and the method comprises:

[0011] receiving the target part information and the part assembly information sent by the information collection module, and determining the part information of an assembly part in the part assembly information; wherein the assembly part is a part of the vehicle that is actually assembled in the part assembly information;

[0012] determining whether the assembly of the assembly part is accurate according to the consistency degree of the part information of the assembly part and the target part information of the vehicle, and sending alarm information to the alarm execution module when the assembly of the assembly part is not accurate.

[0013] In a third aspect, the application provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the part assembly monitoring method as described in any of the embodiments of the application.

[0014] In a fourth aspect, the application provides a computer-readable storage medium having a computer program stored thereon, wherein the program is executed by a processor to implement the part assembly monitoring method as described in any of the embodiments of the application.

[0015] The scheme of the present application, the part assembly monitoring system comprises an information acquisition module, an assembly monitoring module and an alarm execution module; wherein the assembly monitoring module is connected with the information acquisition module and the alarm execution module respectively; the information acquisition module is used for acquiring target part information and part assembly information of the vehicle, and sending the target part information and the part assembly information to the assembly monitoring module; wherein the target part information is used to represent the part information corresponding to the vehicle in the preset part information library, and the part assembly information is used to represent the assembly process information when the vehicle is assembled with parts; the assembly monitoring module is used to receive the target part information and the part assembly information, and determine the part information of the assembled part in the part assembly information; wherein the assembled part is the part actually assembled in the vehicle in the part assembly information; the assembly monitoring module is also used to determine whether the assembly of the assembled part is accurate according to the consistency degree of the part information of the assembled part and the target part information of the vehicle, and send alarm information to the alarm execution module when the assembly of the assembled part is not accurate; the alarm execution module is used to alarm when receiving the alarm information. That is, the scheme of the present application, on the one hand, the information acquisition module acquires the target part information and the part assembly information, avoids the process of manually determining the target part information and the part assembly information, reduces the steps of manual operation, and improves the accuracy of part information acquisition. On the other hand, the assembly monitoring module determines whether the part assembly is accurate according to the consistency degree of the part information of the assembled part and the target part information of the vehicle, avoids manual reinspection, reduces the workload of workers, thereby further reducing the steps of manual operation, reducing the possibility of part assembly error, and improving the accuracy of part assembly. BRIEF DESCRIPTION OF DRAWINGS

[0016] In order to more clearly illustrate the technical solutions of the present application, the following will briefly introduce the drawings needed to be used in the embodiments. It should be understood that the following drawings only show some embodiments of the present application, and therefore should not be regarded as a limitation on the scope. For those skilled in the art, other related drawings can also be obtained without creative labor.

[0017] Figure 1 is a structural schematic diagram of the part assembly monitoring system provided by the present application;

[0018] Figure 2a is another structural schematic diagram of the part assembly monitoring system provided by the present application;

[0019] Figure 2b is another structural schematic diagram of the part assembly monitoring system provided by the present application;

[0020] Figure 2c is another structural schematic diagram of the part assembly monitoring system provided by the present application;

[0021] Figure 3 is a flowchart of a part assembly monitoring method provided by the present application;

[0022] Figure 4 is a structural diagram of an electronic device provided by the present application. DETAILED DESCRIPTION

[0023] In order to enable persons skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by persons skilled in the art without creative labor should fall within the scope of protection of the present application.

[0024] It should be noted that the terms "first", "second", and the like in the specification and claims of the present application and the above-described drawings are used to distinguish similar objects, and do not necessarily indicate a specific order or a chronological sequence. It should be understood that the data thus used can be interchanged under appropriate circumstances, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion, for example, a process, method, system, product, or device that includes a series of steps or units does not necessarily have to be limited to only those steps or units clearly listed, but can include other steps or units that are not clearly listed or inherent to the process, method, product, or device.

[0025] Figure 1 is a structural diagram of a part assembly monitoring system 01 provided by the present application, which can be applied to monitor the assembly of parts of a vehicle in the scenario of vehicle part assembly. As shown in Figure 1 , the part assembly monitoring system 01 includes an information acquisition module 02, an assembly monitoring module 03, and an alarm execution module 04.

[0026] The assembly monitoring module 03 is connected to the information acquisition module 02 and the alarm execution module 04, respectively.

[0027] The information acquisition module 02 is configured to acquire target part information and part assembly information of the vehicle, and send the target part information and the part assembly information to the assembly monitoring module 03.

[0028] The target part information is used to represent the part information corresponding to the vehicle in the preset part information library, and the part assembly information is used to represent the assembly process information when the vehicle is assembled.

[0029] The assembly monitoring module 03 is configured to receive the target part information and the part assembly information, and determine the part information of the assembly part in the part assembly information.

[0030] The assembly part is a part of the vehicle actually assembled in the part assembly information.

[0031] The assembly monitoring module 03 is further configured to determine whether the assembly of the assembly part is accurate according to the consistency degree of the part information of the assembly part and the target part information of the vehicle, and send an alarm information to the alarm execution module 04 when the assembly of the assembly part is inaccurate.

[0032] The alarm execution module 04 is configured to alarm when receiving the alarm information.

[0033] Specifically, the preset part information library includes a plurality of part information, and each part information includes attribute information of the part and dynamic information of the part. For example, the attribute information of the part includes the model of the part, the identification of the part, or the type of the part, etc. The dynamic information of the part includes the trajectory information during the installation of the part and the position information after the installation of the part, etc. The target part information is used to represent the part information in the preset part information library corresponding to the vehicle currently being assembled. In one possible implementation, the information collection module 02 obtains the target part information of the vehicle through a manufacturing operation management system or a manufacturing execution system connected with the information collection module 02. The manufacturing operation management system or the manufacturing execution system is a system for managing information in factory production. In another possible implementation, the target part information is uploaded to the information collection module 02 by the staff, and the information collection module 02 receives the target part information.

[0034] The part assembly information is used to represent the assembly process information when the vehicle is assembled with the parts. For example, the part assembly information can be the video information during the assembly of the parts. The part assembly information includes the part information of the assembly part during the assembly process. In one possible implementation, the information collection module 02 collects the part assembly information by controlling the sensor connected with the information collection module 02. In another possible implementation, the sensor connected with the information collection module 02 collects the part assembly information and sends it to the information collection module 02, and the information collection module 02 receives the part assembly information.

[0035] The information collection module 02 sends the target part information and the part assembly information to the assembly monitoring module 03. The assembly monitoring module 03 receives the target part information and the part assembly information, and determines the part information of the assembly part in the part assembly information. The part information of the assembly part can include the attribute information and the dynamic information of the assembly part. For example, the assembly monitoring module 03 determines the attribute information of the assembly part in the part assembly information through target recognition.

[0036] The consistency degree of the part information of the assembly part with the target part information of the vehicle can be represented by a percentage of the consistency degree, for example, when the part information of the assembly part is completely consistent with the target part information of the vehicle, the percentage of the consistency degree of the part information of the assembly part with the target part information of the vehicle is 100%. When the part information of the assembly part is completely consistent with the target part information of the vehicle, it indicates that the attribute information of the assembly part is correct and completely installed in place, and it is determined that the assembly of the assembly part is accurate. Therefore, the assembly monitoring module 03 determines whether the assembly of the assembly part is accurate by the consistency degree of the part information of the assembly part with the target part information of the vehicle. For example, when the percentage of the consistency degree of the part information of the assembly part with the target part information of the vehicle is 100%, the assembly monitoring module 03 determines that the assembly of the assembly part is accurate.

[0037] When it is determined that the assembly of the assembly part is not accurate, it indicates that the installation fails and needs to be handled by the staff, for example, re-inspection or re-installation. At this time, the alarm execution module 04 is sent alarm information to make the alarm execution module 04 alarm.

[0038] The alarm execution module 04 is used to alarm when receiving the alarm information. The alarm execution module 04 can be a module that is also connected with a plurality of alarm devices and can control the plurality of alarm devices to work. For example, the alarm execution module 04 is also connected with a buzzer and a three-color lamp with red, yellow and green colors, and when receiving the alarm information, the alarm execution module 04 controls the buzzer to sound and controls the red light of the three-color lamp to be always on to warn the staff. The alarm execution module 04 can also be a module capable of alarming. For example, the alarm execution module 04 is a three-color lamp with red, yellow and green colors, and when receiving the alarm information, the red light of the three-color lamp is always on to warn the staff. The alarm execution module 04 can also be a screen for displaying alarm information on the screen for the staff to check.

[0039] When it is determined that the assembly of the assembly part is accurate, it indicates that the vehicle has completed the installation. At this time, the assembly monitoring module 03 can also send installation completion information to the alarm execution module 04 to make the alarm execution module 04 inform the staff that the installation is completed. For example, the alarm execution module 04 is a three-color lamp with red, yellow and green colors, and when receiving the installation completion information, the green light of the three-color lamp is on for 5s to inform the staff that the installation is completed.

[0040] Optionally, the target part information includes a target part type, the part information of the assembly part includes an assembly part type, and the assembly monitoring module 03 includes a data labeling unit 031 and a part recognition unit 032.

[0041] The data labeling unit 031 is used to label the assembly part in the part assembly information.

[0042] The part recognition unit 032 is configured to recognize the assembly part type of the assembly part in the part assembly information after the assembly part is labeled, and determine whether the assembly of the assembly part is accurate according to the consistency degree of the assembly part type and the target part type.

[0043] Specifically, the part assembly information includes a plurality of objects, such as an installer, a vehicle to be installed, an assembly part, and other parts. Figure 2b FIG. 1 is another structural schematic diagram of the part assembly monitoring system 01 provided by the present application. Figure 2b As shown in the figure, the assembly monitoring module 03 includes a data labeling unit 031 and a part recognition unit 032. The data labeling unit 031 labels the assembly part in the part assembly information, which can be labeling the assembly part in the part assembly information through target recognition technology, or labeling the assembly part in the part assembly information through the labeling information input by the staff. For example, the part assembly information after labeling the assembly part can be the video information of the part assembly process after the assembly part is framed.

[0044] The part recognition unit 032 is configured to recognize the assembly part type of the assembly part in the part assembly information after the assembly part is labeled, which can be recognizing the assembly part type of the assembly part through the shape of the assembly part or through recognizing the identification number on the assembly part. And according to the consistency degree of the assembly part type and the target part type, it is determined whether the assembly of the assembly part is accurate. For example, when the consistency degree of the assembly part type and the target part type is completely consistent, it is determined that the assembly of the assembly part is accurate.

[0045] Optionally, the target part information further includes a target part path, and the part information of the assembly part further includes an assembly part path.

[0046] Specifically, the target part path is the predicted assembly path of the target part in the process of being assembled to the vehicle. The assembly part path is the assembly path of the assembly part in the process of being assembled to the vehicle. The consistency degree of the assembly part path and the target part path can be obtained by the coincidence degree of the assembly part path and the target part path, for example, when the assembly part path and the target part path completely coincide, it is determined that the consistency degree of the assembly part path and the target part path is completely consistent. The part recognition unit 032 is further configured to determine whether the assembly of the assembly part is accurate according to the consistency degree of the assembly part path and the target part path. For example, when the consistency degree of the assembly part path and the target part path is completely consistent, it is determined that the assembly of the assembly part is accurate.

[0047] The data labeling unit 031 is further configured to label a plurality of position information of the assembly part in the part assembly information after labeling the assembly part.

[0048] The part recognition unit 032 is further configured to recognize the assembly part path of the assembly part according to the plurality of position information of the assembly part.

[0049] The part recognition unit 032 is configured to determine whether the assembly of the assembly part is accurate according to the consistency degree of the assembly part type and the target part type, and the consistency degree of the assembly part path and the target part path.

[0050] Specifically, the data labeling unit 031 labels the plurality of position information of the assembly part in the part assembly information after labeling the assembly part. For example, in the part assembly information after labeling the assembly part, the position information of the assembly part labeled by the data labeling unit 031 is position A, position B, position C and position D. The part recognition unit 032 is further configured to recognize the assembly part path of the assembly part according to the plurality of position information of the assembly part, for example, sequentially connecting the positions corresponding to the plurality of position information to obtain the assembly part path. Alternatively, the part recognition model can also obtain the assembly part path according to the position information collected by the information collection module 02 in real time. The part recognition unit 032 determines whether the assembly of the assembly part is accurate according to the consistency degree of the assembly part type and the target part type, and the consistency degree of the assembly part path and the target part path. For example, when the consistency degree of the assembly part type and the target part type is 100% consistent, and the consistency degree of the assembly part path and the target part path is 90% consistent, the part recognition unit 032 determines that the assembly of the assembly part is accurate.

[0051] Optionally, Figure 2c is another structural schematic diagram of the part assembly monitoring system 01 provided by the present application. As shown in Figure 2c The part recognition unit 032 includes a part type recognition unit 0321, a path recognition model 0322 and an inference unit 0323.

[0052] The part type recognition unit 0321 is configured to recognize the assembly part type of the assembly part in the part assembly information after labeling the assembly part.

[0053] The path recognition model 0322 is configured to obtain the assembly part path according to the plurality of position information of the assembly part.

[0054] The path recognition model 0322 is a model trained according to the plurality of historical position information of the historical part and the historical part path.

[0055] The inference unit 0323 is configured to determine whether the assembly of the assembly part is accurate according to the consistency degree of the assembly part type and the target part type, and the consistency degree of the assembly part path and the target part path.

[0056] Specifically, the historical part is a part with the same part attribute as the assembly part, and the training process of the path recognition model 0322 is a model trained according to the plurality of historical position information of the historical part and the historical part path. The path recognition model 0322 after training can obtain the assembly part path according to the plurality of position information of the assembly part. For example, the path recognition model 0322 can be an artificial intelligence (AI) model, which is a model that can determine the assembly part path according to the plurality of position information of the assembly part after being trained according to the plurality of historical position information of the historical part and the historical part path.

[0057] When it is necessary to enable the path recognition model 0322 to recognize the path of other parts, the plurality of historical position information of other historical parts with the same part attribute as the other parts and the historical part path of the other historical parts are selected to train the path recognition model 0322, so that the application range of the part assembly monitoring system 01 is improved.

[0058] For example, the part type recognition unit 0321 recognizes the assembly part type of the assembly part in the part assembly information after labeling the assembly part. The path recognition model 0322 obtains the assembly part path according to the plurality of position information of the assembly part. The reasoning unit 0323 determines that the assembly of the assembly part is accurate according to the consistency of the assembly part type and the target part type, and the consistency degree of the assembly part path and the target part path is 90%. If it is determined that the assembly of the assembly part is not accurate, the reasoning unit 0323 can also rejudge the assembly result. If the number of continuous inaccurate judgments reaches the preset judgment number, it is determined that the assembly of the assembly part is not accurate.

[0059] The part assembly monitoring system provided in the application comprises an information acquisition module, an assembly monitoring module and an alarm execution module. The assembly monitoring module is connected with the information acquisition module and the alarm execution module. The information acquisition module is used to acquire target part information and part assembly information of a vehicle and send the target part information and the part assembly information to the assembly monitoring module. The target part information is used to represent part information corresponding to the vehicle in a preset part information library, and the part assembly information is used to represent assembly process information of the vehicle when the vehicle is assembled. The assembly monitoring module is used to receive the target part information and the part assembly information and determine part information of an assembly part in the part assembly information. The assembly part is a part actually assembled in the vehicle in the part assembly information. The assembly monitoring module is also used to determine whether assembly of the assembly part is accurate according to a consistency degree of the part information of the assembly part and the target part information of the vehicle and send alarm information to the alarm execution module when the assembly of the assembly part is inaccurate. The alarm execution module is used to alarm when the alarm information is received. In the application, the information acquisition module acquires the target part information and the part assembly information, which avoids the process of manually determining the target part information and the part assembly information, reduces the manual operation steps and improves the accuracy of part information acquisition. In addition, the assembly monitoring module determines whether the part assembly is accurate according to the consistency degree of the part information of the assembly part and the target part information of the vehicle, which avoids manual re-inspection, reduces the workload of workers, further reduces the manual operation steps, reduces the possibility of part assembly errors and improves the accuracy of part assembly.

[0060] Figure 2a FIG. 1 is another structural schematic diagram of the part assembly monitoring system 01 provided in the application. On the basis of the above embodiment, a plurality of acquisition devices are added in the part assembly monitoring system 01, and the information acquisition module 02 is described in detail.

[0061] Optionally, the part assembly monitoring system 01 further comprises a plurality of acquisition devices, and the information acquisition module 02 is further connected with the plurality of acquisition devices. The information acquisition module 02 is used to control the plurality of acquisition devices to acquire vehicle information and part assembly information of a vehicle.

[0062] The information acquisition module 02 is used to determine target part information corresponding to the vehicle information according to the vehicle information of the vehicle.

[0063] Specifically, the vehicle information is information capable of indicating characteristics of the vehicle, such as identification information or model information of the vehicle, and the like. The plurality of collection devices are devices capable of collecting information, and can be installed in a production plant of vehicle part assembly. The information collection module 02 is connected with the plurality of collection devices, and controls the plurality of collection devices to collect vehicle information and part assembly information of the vehicle. The information collection module 02 determines target part information corresponding to the vehicle information according to the vehicle information of the vehicle, such as determining target part information corresponding to the vehicle of the model according to the model information of the vehicle. Since the positions of the plurality of collection devices are adjustable, the plurality of collection devices can be installed at a position closer to the vehicle, further improving the accuracy of part information acquisition.

[0064] For example, the plurality of collection devices include a photographing device and a video shooting device. The information collection module 02 controls the photographing device to collect model information of the vehicle, and determines target part information corresponding to the vehicle of the model according to the model information. The information collection module 02 controls the video shooting device to collect part assembly information.

[0065] Optionally, the plurality of collection devices include a first collection device 05.

[0066] The vehicle information of the vehicle includes identification information of the vehicle.

[0067] The information collection module 02 is also connected with the alarm execution module 04.

[0068] The first collection device 05 is used to collect identification information of the vehicle under the control of the information collection module 02, and send the identification information of the vehicle to the information collection module 02.

[0069] The information collection module 02 is used to determine target part information of the vehicle according to the identification information and current process indication information of the vehicle when it is determined that the vehicle has monitoring demand according to the identification information and preset monitoring vehicle information.

[0070] The preset monitoring vehicle information includes a plurality of vehicle identification information that needs to be monitored in part assembly.

[0071] The information collection module 02 is also used to control the alarm execution module 04 to alarm when the vehicle does not have monitoring demand.

[0072] Specifically, the first collection device 05 is a collection device capable of collecting identification information of the vehicle. For example, the first collection device 05 can be a code scanner, and the identification information of the vehicle can be a vehicle identification number (VIN) code. The first collection device 05 collects identification information of the vehicle under the control of the information collection module 02, and sends the identification information of the vehicle to the information collection module 02.

[0073] The information collection module 02 determines whether the vehicle has a monitoring requirement according to the identification information and the preset monitoring vehicle information. For example, if the identification information is not included in the preset monitoring vehicle information, it is determined that the vehicle does not have a monitoring requirement. When the vehicle does not have a monitoring requirement, the information collection module 02 controls the alarm execution module 04 to alarm. For example, when the alarm execution module 04 is a three-color lamp with red, yellow and green colors, the information collection module 02 controls the yellow light of the three-color lamp to flash for 5 seconds and then turn off, to inform the staff that the vehicle does not have a monitoring requirement. When the vehicle has a monitoring requirement, the information collection module 02 controls the alarm execution module 04 to inform the staff that the vehicle needs to be monitored. For example, when the alarm execution module 04 is a three-color lamp with red, yellow and green colors, the information collection module 02 controls the yellow light of the three-color lamp to always be on, to inform the staff that the vehicle has a monitoring requirement.

[0074] The current process indication information is information capable of indicating the current process in which the vehicle is located, for example, the current process indication information is that the vehicle needs to be assembled with part A. The current process indication information can be information input by a user. The information collection module 02 can further include an interaction unit, and the information input by the user is obtained through the interaction unit. For example, the information collection module 02 is connected with an application in a terminal of the user, and the information input by the user can be obtained through the application. The current process indication information can also be the collection times of the identification information, that is, the collection times of the identification information are different, the corresponding current process indication information is different, and the corresponding target part information is also different. The current process indication information can also be information collected by the information collection module 02 by controlling other collection devices, for example, the current image of the vehicle is collected by the information collection module 02 by controlling a photographing device, and the current process indication information is determined according to the assembled parts and the unassembled parts in the current image. When the information collection module 02 determines that the vehicle has a monitoring requirement according to the identification information and the preset monitoring vehicle information, that is, when the identification information is included in the preset monitoring vehicle information, the target part information of the vehicle is determined according to the identification information and the current process indication information of the vehicle.

[0075] Optionally, the plurality of collection devices further include a second collection device 06 and a third collection device 07.

[0076] The second collection device 06 is used to collect the position information of the vehicle under the control of the information collection module 02, and send the position information of the vehicle to the information collection module 02.

[0077] The information collection module 02 is further used to control the third collection device 07 to collect the part assembly information of the vehicle when the position information of the vehicle is consistent with the preset position information.

[0078] The preset position information is a position of the vehicle at which part assembly is performed.

[0079] The third acquisition device 07 is configured to acquire the part assembly information of the vehicle under the control of the information acquisition module 02, and send the part assembly information to the information acquisition module 02.

[0080] Specifically, the position information of the vehicle is the position of the vehicle in the part assembly production plant, and the preset position information is the position of the vehicle to be assembled parts. The second acquisition device 06 can acquire the position information of the vehicle. For example, the second acquisition device 06 can be an industrial camera or an infrared sensing device. The second acquisition device 06 acquires the position information of the vehicle under the control of the information acquisition module 02, and sends the position information of the vehicle to the information acquisition module 02. When the position information of the vehicle is consistent with the preset position information, that is, when the vehicle reaches the preset position of the vehicle to be assembled parts, the information acquisition module 02 controls the third acquisition device 07 to acquire the part assembly information of the vehicle. The third acquisition device 07 acquires the part assembly information of the vehicle under the control of the information acquisition module 02, and sends the part assembly information to the information acquisition module 02. For example, the third acquisition device 07 can be a video camera, which can record the part assembly process and complete the acquisition of the part assembly information.

[0081] For example, the second acquisition device 06 is an industrial camera, and the information acquisition module 02 controls the industrial camera to take a picture every preset time interval to obtain the position information of the vehicle. For example, the preset time interval can be 52 seconds. When the picture is successfully taken, the taken picture is sent to the information acquisition module 02. If the continuous shooting fails and the number of shooting failures reaches the preset number of shooting failures, the industrial camera may be malfunctioning, and the information acquisition module 02 controls the alarm execution module 04 to alarm. The third acquisition device 07 is a video camera, and the information acquisition module 02 controls the video camera to start shooting video when the position information of the vehicle is consistent with the preset position information, to acquire the part assembly information. When the acquisition time reaches the preset acquisition time, the information acquisition module 02 controls the video camera to stop shooting.

[0082] The system of the present application also includes a plurality of acquisition devices, and the information acquisition module is further connected with the plurality of acquisition devices and controls the plurality of acquisition devices to acquire the vehicle information and the part assembly information of the vehicle. By dispersing the acquisition information function to the plurality of acquisition devices, the control difficulty of the information acquisition module is reduced, and since the positions of the acquisition devices can be adjusted, they can be installed closer to the vehicle, further improving the accuracy of the part information acquisition.

[0083] Figure 3is a flowchart of a part assembly monitoring method provided by the present application. The method can be executed by a device integrated with an assembly monitoring module of a part assembly monitoring system provided by the present application. The device can be implemented in software and / or hardware. In a specific embodiment, the device can be integrated in an electronic device. For example, the electronic device can be a computer. The following embodiments will be described with the system integrated in an electronic device as an example. Referring to Figure 3 The method can specifically include the following steps:

[0084] In step 301, the target part information and the part assembly information sent by the information collection module are received, and the part information of the assembly part is determined in the part assembly information.

[0085] The assembly part is a part actually assembled by the vehicle in the part assembly information.

[0086] The specific implementation process and optional implementation mode of this step have been described in the description of the assembly monitoring module in the above embodiments, which will not be described here.

[0087] In step 302, it is determined whether the assembly of the assembly part is accurate according to the consistency degree of the part information of the assembly part and the target part information of the vehicle, and the alarm information is sent to the alarm execution module when the assembly of the assembly part is inaccurate.

[0088] The specific implementation process and optional implementation mode of this step have been described in the description of the assembly monitoring module in the above embodiments, which will not be described here.

[0089] The scheme of the present application is applied to the assembly monitoring module of the part assembly monitoring system provided by any of the embodiments of the present application. The target part information and the part assembly information sent by the information collection module are received, and the part information of the assembly part is determined in the part assembly information. The assembly part is a part actually assembled by the vehicle in the part assembly information. It is determined whether the assembly of the assembly part is accurate according to the consistency degree of the part information of the assembly part and the target part information of the vehicle, and the alarm information is sent to the alarm execution module when the assembly of the assembly part is inaccurate. That is, according to the consistency degree of the part information of the assembly part and the target part information of the vehicle, it is determined whether the part assembly is accurate, which avoids manual re-inspection, reduces the workload of workers, thereby further reducing the steps of manual operation, reducing the possibility of part assembly error, and improving the accuracy of part assembly.

[0090] The present application also provides an electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the program, the part assembly monitoring method provided by any of the above embodiments is implemented.

[0091] This application also provides a computer-readable medium having a computer program stored thereon, which, when executed by a processor, implements the part assembly monitoring method provided in any of the above embodiments.

[0092] The following is for reference. Figure 4 It shows a schematic diagram of the structure of an electronic device 400 suitable for implementing the present application. Figure 4 The electronic device shown is merely an example and should not impose any limitations on the functionality and scope of this application.

[0093] like Figure 4 As shown, the electronic device 400 includes a central processing unit (CPU) 401, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 402 or a program loaded from a storage section 408 into a random access memory (RAM) 403. The RAM 403 also stores various programs and data required for the operation of the electronic device 400. The CPU 401, ROM 402, and RAM 403 are interconnected via a bus 404. An input / output (I / O) interface 405 is also connected to the bus 404.

[0094] The following components are connected to I / O interface 405: an input section 406 including a keyboard, mouse, etc.; an output section 407 including a cathode ray tube (CRT), liquid crystal display (LCD), etc., and speakers, etc.; a storage section 408 including a hard disk, etc.; and a communication section 409 including a network interface card such as a LAN card, modem, etc. The communication section 409 performs communication processing via a network such as the Internet. A drive 410 is also connected to I / O interface 405 as needed. A removable medium 411, such as a disk, optical disk, magneto-optical disk, semiconductor memory, etc., is installed on drive 410 as needed so that computer programs read from it can be installed into storage section 408 as needed.

[0095] Specifically, according to the embodiments disclosed in this application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments disclosed in this application include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication section 409, and / or installed from removable medium 411. When the computer program is executed by central processing unit (CPU) 401, it performs the functions defined above in the system of this application.

[0096] It should be noted that the computer-readable medium shown in the application can be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or component, or any combination of the above. More specific examples of computer-readable storage media can include, but are not limited to, an electrical connection with one or more conductive wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this application, the computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, device or component. In this application, the computer-readable signal medium can include a data signal carried in a baseband or as a carrier wave part of a carrier wave, which carries computer-readable program code. Such a propagated data signal can take many forms, including but not limited to electromagnetic signals, optical signals or any suitable combination thereof. The computer-readable signal medium can also be any computer-readable medium other than the computer-readable storage medium, which can send, propagate or transmit programs for use by or in conjunction with an instruction execution system, device or component. The program code contained on the computer-readable medium can be transmitted by any suitable medium, including but not limited to wireless, wire, optical cable, RF, etc., or any suitable combination thereof.

[0097] The flowcharts and block diagrams in the drawings illustrate the possible implementation architectures, functions and operations of the systems, methods and computer program products according to various embodiments of the application. In this regard, each block in the flowchart or block diagram can represent a module, a program segment, or a portion of code that contains one or more executable instructions for implementing the specified logical functions. It should also be noted that in some alternative implementations, the functions noted in the blocks can occur in different orders than that shown in the figure. For example, two blocks that are shown in succession can actually be executed substantially concurrently, or they can sometimes be executed in reverse order, depending on the involved functions. It should also be noted that each block in the block diagram or flowchart, and the combination of blocks in the block diagram or flowchart, can be implemented by a dedicated hardware-based system that performs the specified functions or operations, or can be implemented by a combination of dedicated hardware and computer instructions.

[0098] The modules and / or units involved in the present application can be implemented by software or hardware. The described modules and / or units can also be arranged in a processor.

[0099] As another aspect, the present application also provides a computer readable medium, which can be included in the device described in the above embodiments, or can exist independently without being assembled into the device. The computer readable medium carries one or more programs, which, when executed by the device, cause the device to include:

[0100] The target part information and the part assembly information sent by the information collection module are received, and the part information of the assembly part is determined in the part assembly information; wherein the assembly part is the part of the vehicle actually assembled in the part assembly information; whether the assembly of the assembly part is accurate is determined according to the consistency degree of the part information of the assembly part and the target part information of the vehicle, and when the assembly of the assembly part is not accurate, the alarm information is sent to the alarm execution module.

[0101] According to the technical scheme of the present application, the target part information and the part assembly information sent by the information collection module are received, and the part information of the assembly part is determined in the part assembly information; wherein the assembly part is the part of the vehicle actually assembled in the part assembly information; whether the assembly of the assembly part is accurate is determined according to the consistency degree of the part information of the assembly part and the target part information of the vehicle, and when the assembly of the assembly part is not accurate, the alarm information is sent to the alarm execution module. That is, according to the consistency degree of the part information of the assembly part and the target part information of the vehicle, the present application determines whether the part assembly is accurate, avoids manual reinspection, reduces the workload of workers, thereby further reducing the steps of manual operation, reducing the possibility of part assembly error, and improving the accuracy of part assembly.

[0102] It should be understood that the steps shown above can be reordered, added or deleted. For example, the steps described in the present application can be executed in parallel, in sequence or in different order, as long as the desired results of the technical scheme of the present application can be achieved, which is not limited herein.

[0103] The technical scheme of the present application conforms to the relevant provisions of national laws and regulations in data acquisition, storage, use and processing. The above specific embodiments do not constitute a limitation on the protection scope of the present application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made depending on design requirements and other factors. Any modification, equivalent replacement and improvement within the spirit and principles of the present application shall be included in the protection scope of the present application.

Claims

1. A part assembly monitoring system, characterized by, The system comprises an information acquisition module, an assembly monitoring module and an alarm execution module; wherein the assembly monitoring module is connected with the information acquisition module and the alarm execution module respectively; The information acquisition module is used for acquiring target part information and part assembly information of a vehicle, and sending the target part information and the part assembly information to the assembly monitoring module; wherein the target part information is used for representing part information corresponding to the vehicle in a preset part information library, and the part assembly information is used for representing assembly process information of the vehicle when being assembled; The assembly monitoring module is used for receiving the target part information and the part assembly information, and determining part information of an assembly part in the part assembly information; wherein the assembly part is a part actually assembled for the vehicle in the part assembly information; The target part information comprises a target part type and a target part path, the part information of the assembly part comprises an assembly part type and an assembly part path, and the assembly monitoring module comprises a data labeling unit and a part recognition unit; The data labeling unit is used for labeling the assembly part in the part assembly information; The data labeling unit is also used for labeling a plurality of position information of the assembly part in the part assembly information after labeling the assembly part; The part recognition unit is used for recognizing the assembly part type of the assembly part in the part assembly information after labeling the assembly part; The part recognition unit is also used for recognizing the assembly part path of the assembly part according to the plurality of position information of the assembly part; The part recognition unit is used for determining whether the assembly of the assembly part is accurate according to a consistency degree of the assembly part type and the target part type, and a consistency degree of the assembly part path and the target part path; The assembly monitoring module is also used for sending alarm information to the alarm execution module when the assembly of the assembly part is not accurate; The alarm execution module is used for alarming when receiving the alarm information.

2. The part assembly monitoring system of claim 1, wherein The part assembly monitoring system further comprises a plurality of acquisition devices, and the information acquisition module is further connected with the plurality of acquisition devices respectively, and the information acquisition module is used for controlling the plurality of acquisition devices to acquire vehicle information and the part assembly information of a vehicle; The information acquisition module is used for determining target part information corresponding to the vehicle information according to the vehicle information of the vehicle.

3. The part assembly monitoring system of claim 2, wherein, The plurality of acquisition devices comprise a first acquisition device; the vehicle information of the vehicle comprises identification information of the vehicle; the information acquisition module is further connected with the alarm execution module; The first acquisition device is used for acquiring the identification information of the vehicle under the control of the information acquisition module, and sending the identification information of the vehicle to the information acquisition module; The information collection module is configured to determine target part information of the vehicle according to the identification information and current process indication information of the vehicle when it is determined that the vehicle has a monitoring demand according to the identification information and preset monitoring vehicle information, wherein the preset monitoring vehicle information includes a plurality of vehicle identification information that needs to be monitored in part assembly. The information collection module is further configured to control the alarm execution module to alarm when the vehicle does not have a monitoring demand.

4. The part assembly monitoring system of claim 3, wherein, The plurality of collection devices further include a second collection device and a third collection device. The second collection device is configured to collect position information of the vehicle under the control of the information collection module and send the position information of the vehicle to the information collection module. The information collection module is further configured to control the third collection device to collect part assembly information of the vehicle when the position information of the vehicle is consistent with preset position information, wherein the preset position information is a position of the vehicle for part assembly that is preset in advance. The third collection device is configured to collect part assembly information of the vehicle under the control of the information collection module and send the part assembly information to the information collection module.

5. The part assembly monitoring system of claim 1, wherein, The part identification unit includes a part type identification unit, a path identification model, and an inference unit. The part type identification unit is configured to identify an assembly part type of the assembly part in the part assembly information after the assembly part is labeled. The path identification model is configured to obtain an assembly part path according to a plurality of position information of the assembly part, wherein the path identification model is a model trained according to a plurality of historical position information of a historical part and a historical part path. The inference unit is configured to determine whether assembly of the assembly part is accurate according to a consistency degree of the assembly part type and the target part type and a consistency degree of the assembly part path and the target part path.

6. A method of monitoring assembly of a part, characterized by, The method is applied to an assembly monitoring module of the part assembly monitoring system of any one of claims 1 to 5, and the method includes: receiving target part information and part assembly information sent by the information collection module and determining part information of an assembly part in the part assembly information, wherein the assembly part is a part actually assembled by the vehicle in the part assembly information, the target part information includes a target part type and a target part path, and the part information of the assembly part includes an assembly part type and an assembly part path; labeling the assembly part in the part assembly information; labeling a plurality of position information of the assembly part in the part assembly information after the assembly part is labeled; identifying an assembly part type of the assembly part in the part assembly information after the assembly part is labeled; identifying an assembly part path of the assembly part according to a plurality of position information of the assembly part; determining whether assembly of the assembly part is accurate according to a consistency degree of the assembly part type and the target part type and a consistency degree of the assembly part path and the target part path. When the assembling of the assembling parts is not accurate, alarm information is sent to an alarm execution module.

7. An electronic device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that, The processor executes the program to implement the part assembling monitoring method in claim 6.

8. A computer-readable storage medium having stored thereon a computer program, characterized in that, The program is executed by the processor to implement the part assembling monitoring method in claim 6.

Images