Product interior parts inspection system

Abstract

An embodiment of the present invention relates to a product interior decoration detection system, specifically to the field of lean production technology, including a code reading module, a shooting module, and a compliance judgment module; the code reading module is used to read the product code of the product when the product is conveyed to a first predetermined position through a conveyor belt, and transmit the product code to the shooting module; the shooting module is used to photograph the interior of the product when the product is conveyed to a second predetermined position through the conveyor belt to obtain at least one interior decoration photo of the product, and send the at least one interior decoration photo carrying the product code to the compliance judgment module; the compliance judgment module is used to query the interior characteristics of the product according to the product code after receiving the at least one interior decoration photo and the product code, and judge whether the interior of the product matches the interior characteristics according to the at least one interior decoration photo, so as to improve the degree of industrial automation and intelligence.

Description

Technical Field

[0001] The embodiments of the present invention relate to the technical field of lean production, and in particular to a product interior decoration detection system. Background Art

[0002] At present, in the production process of industrial products such as refrigerators, it is necessary to inspect the internal decoration of the product. Only qualified products can be packed and put on the market. For example, the inspection of the internal decoration of refrigerators includes the inspection of VC cover, air duct cover, bottle holder, drawer, shelf and other interior decoration parts. It is necessary to inspect whether the words, colors and / or patterns of each interior decoration part are missing. The number, color and model of interior decoration parts of different product models may be different.

[0003] Currently, the inspection of refrigerator internal accessories is based on manual inspection of missing / wrong installation of refrigerator internal accessories, and the employees manually fill in the inspection results.

[0004] On the one hand, this method requires professional staff to check and confirm. Due to the large number of product models, there is a risk that employees rely on memory storage to verify the quantity of interior parts. On the other hand, due to the use of paper documents to report verification results, the test results cannot be digitized, making data traceability difficult. Summary of the invention

[0005] In view of this, an embodiment of the present invention provides a product interior decoration parts detection system to improve the degree of industrial automation and intelligence.

[0006] Other features and advantages of the embodiments of the present invention will become apparent from the following detailed description, or may be learned in part by the practice of the embodiments of the present invention.

[0007] The embodiment of the present invention provides a product interior decoration detection system, including: a code reading module, a shooting module, and a compliance judgment module;

[0008] The code reading module is used to read the product code of the product when the product is conveyed to the first predetermined position by the conveyor belt, and transmit the product code to the shooting module;

[0009] The photographing module is used to receive the product code read by the code reading module, photograph the interior of the product to obtain at least one interior photo of the product when the product is conveyed to the second predetermined position by the conveyor belt, and send the at least one interior photo carrying the product code to the compliance judgment module;

[0010] The compliance judgment module is used to query the interior features of the product according to the product code after receiving the at least one interior photo and the product code, and judge whether the interior of the product matches the interior features according to the at least one interior photo.

[0011] In one embodiment, the product interior decoration detection system further includes a control device; the control device is used to control the movement of the conveyor belt according to the position of the product on the conveyor belt.

[0012] In one embodiment, the motion control of the conveyor belt includes:

[0013] When the product is conveyed to the first predetermined position by the conveyor belt, controlling the conveyor belt to be stationary for a first predetermined time period;

[0014] When the product is conveyed to the second predetermined position by the conveyor belt, the conveyor belt is controlled to remain stationary for a second predetermined period of time.

[0015] In one embodiment, the motion control of the conveyor belt also includes: while the product is being conveyed from the first predetermined position to the second predetermined position through the conveyor belt, controlling the conveyor belt to first perform accelerated motion at a first predetermined acceleration for a third predetermined time period, and then maintaining uniform motion until the product reaches the second predetermined position.

[0016] In one embodiment, the shooting module includes at least one camera, and the product interior parts detection system also includes a positioning module; the positioning module is used to adjust the position of the product when the product is conveyed to the second predetermined position through the conveyor belt so that the distance between the product and the at least one camera meets the predetermined requirements.

[0017] In one embodiment, the alignment module is a roller-type alignment module or a cylinder-type alignment module.

[0018] In one embodiment, the product interior parts detection system also includes a door opening and closing device; the door opening and closing device is used to control the door of the product to open after the product is conveyed to the second predetermined position of the conveyor belt, and to control the door of the product to close after the shooting module takes the at least one interior photo.

[0019] In one embodiment, the door opening and closing device includes a switch command module, a motion module and a large suction cup, and the large suction cup is located at one end of the motion module;

[0020] The switch command module is used to send a door opening command to the motion module when the product is conveyed to the second predetermined position of the conveyor belt, so as to control the motion module to drive the large suction cup to move toward the door of the product until the large suction cup sucks the door of the product, and then drive the large suction cup to drive the door of the product to open;

[0021] The switch instruction module is also used to send a door closing instruction to the motion module after the shooting module finishes taking pictures, so as to control the motion module to drive the large-suction suction cup to drive the door of the product to close.

[0022] In one embodiment, the product interior parts detection system also includes an alarm module; the alarm module is used to receive the detection results of the compliance judgment module, and if it is determined that the detection fails based on the detection results, an audible and visual alarm prompt is performed at the gate and / or on site.

[0023] In one embodiment, the sound and light alarm prompts at the gate and / or on-site include: connecting to the manufacturing enterprise's production process execution management system MES based on the product code of the product to control the manufacturing enterprise's production process execution management system to perform sound and light alarm prompts at the gate and / or on-site.

[0024] In one embodiment, the product interior parts detection system is used to detect refrigerators;

[0025] The compliance judgment module is used to judge whether the interior of the product matches the interior feature based on the at least one interior photo, including: judging whether at least one of the following interiors of the product matches the interior feature based on the at least one interior photo: VC cover, air duct cover, bottle holder, drawer, and shelf.

[0026] In one embodiment, the interior features include at least one of the following: interior quantity, interior color, interior model, and interior pattern.

[0027] In one embodiment, the product is a cuboid; the shooting module is used to shoot the interior of the product, including: being used to shoot five surfaces of the product except the bottom surface.

[0028] The beneficial technical effects of the technical solution proposed in the embodiment of the present invention are:

[0029] The embodiment of the present invention discloses a product interior decoration detection system, including a code reading module, a shooting module, and a compliance judgment module, which can improve the degree of industrial automation and intelligence. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments of the present invention. Obviously, the drawings described below are only part of the embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the contents of the embodiments of the present invention and these drawings without paying any creative work.

[0031] Figure 1is a structural schematic diagram of a product interior decoration detection system provided according to an embodiment of the present invention;

[0032] Figure 2 is a schematic diagram of the overall architecture of another technical solution of a product interior decoration detection system provided according to an embodiment of the present invention;

[0033] Figure 3 It is a schematic diagram of a product circulation process corresponding to a technical solution of a product interior decoration part detection system provided in an embodiment of the present invention;

[0034] Figure 4 is a schematic diagram of the design of a door opening and closing device according to a technical solution of a product interior decoration detection system provided in an embodiment of the present invention;

[0035] Figure 5 It is a three-dimensional effect diagram of a shooting scheme of a technical scheme of a product interior decoration part detection system provided in an embodiment of the present invention;

[0036] Figure 6 This is a rendering of the approximate location of shooting of a technical solution of a product interior decoration detection system provided according to an embodiment of the present invention. DETAILED DESCRIPTION

[0037] In order to make the technical problems solved by the embodiments of the present invention, the technical solutions adopted and the technical effects achieved more clearly, the technical solutions of the embodiments of the present invention will be further described in detail below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments in the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the embodiments of the present invention.

[0038] It should be noted that the terms "system" and "network" in the embodiments of the present invention are often used interchangeably herein. The "and / or" mentioned in the embodiments of the present invention refers to any and all combinations including one or more of the related listed items. The terms "first", "second", etc. in the specification, claims and drawings of the present disclosure are used to distinguish different objects, rather than to limit a specific order.

[0039] It should also be noted that the following embodiments of the present invention may be executed separately or in combination with each other, and the present invention does not impose any specific restrictions on this.

[0040] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0041] The technical solution of the embodiment of the present invention is further explained below with reference to the accompanying drawings and through specific implementation methods.

[0042] Figure 1 FIG. 1 shows a schematic diagram of a product interior decoration detection system provided by an embodiment of the present invention. This embodiment can be used to detect whether the product interior decoration is wrongly installed or not, such as Figure 1 As shown, the product interior decoration detection system described in this embodiment includes: a code reading module 110, a shooting module 120, and a compliance judgment module 130.

[0043] The code reading module 110 is used to read the product code of the product when the product is conveyed to the first predetermined position by the conveyor belt, and transmit the product code to the shooting module.

[0044] The shooting module 120 is used to receive the product code read by the code reading module, and when the product is conveyed to the second predetermined position through the conveyor belt, shoot the interior of the product to obtain at least one interior photo of the product, and send the at least one interior photo carrying the product code to the compliance judgment module.

[0045] The compliance judgment module 130 is used to query the interior features of the product according to the product code after receiving the at least one interior photo and the product code, and judge whether the interior of the product matches the interior features according to the at least one interior photo.

[0046] Taking a refrigerator as an example, it can be determined based on the at least one interior photo whether the refrigerator's VC cover, air duct cover, bottle holder, drawer, shelf and other interiors are incorrectly installed or missing, including but not limited to determining whether the number of interiors, interior colors, interior models, and interior patterns contained in the refrigerator are consistent with the interiors that should be included in its corresponding model.

[0047] According to one or more embodiments of the present disclosure, the product interior decoration detection system may further include a control device ( Figure 1 The control device may be used to control the movement of the conveyor belt according to the position of the product on the conveyor belt.

[0048] Among them, the motion control of the conveyor belt can be carried out in a variety of ways. For example, when the product is conveyed to the first predetermined position by the conveyor belt, the conveyor belt can be controlled to be stationary for a first predetermined time; when the product is conveyed to the second predetermined position by the conveyor belt, the conveyor belt can be controlled to be stationary for a second predetermined time.

[0049] For another example, while the product is being conveyed from the first predetermined position to the second predetermined position by the conveyor belt, the conveyor belt may be controlled to first perform accelerated motion at a first predetermined acceleration for a third predetermined time period, and then maintain uniform motion until the product reaches the second predetermined position.

[0050] According to one or more embodiments of the present disclosure, the shooting module may further include at least one camera, and the product interior decoration detection system may further include a positioning module ( Figure 1 The alignment module may be used to adjust the position of the product when the product is conveyed to the second predetermined position by the conveyor belt so that the distance between the product and the at least one camera meets a predetermined requirement, for example, to make the distance between the feature plane to be detected of the product and each camera equal to a preset distance, so that the distance is the same when the same camera shoots the same product, so as to improve the judgment speed when judging whether the interior of the product is compliant based on the interior photo.

[0051] The alignment module may be in various forms, including but not limited to a roller-type alignment module, a cylinder-type alignment module, and the like.

[0052] According to one or more embodiments of the present disclosure, the product interior decoration detection system may further include a door opening and closing device ( Figure 1 The door opening and closing device may be used to control the door of the product to open after the product is conveyed to the second predetermined position of the conveyor belt, and to control the door of the product to close after the shooting module has taken the at least one interior photo.

[0053] Furthermore, the door opening and closing device may also include a switch command module ( Figure 1 Not shown), motion module ( Figure 1 Not shown, for example, a robot) and a large suction cup ( Figure 1 The switch command module can be used to send a door opening command to the motion module when the product is conveyed to the second predetermined position of the conveyor belt, so as to control the motion module to drive the large suction cup to move toward the door of the product until the large suction cup sucks the door of the product, and then drive the large suction cup to drive the door of the product to open. The switch command module can also be used to send a door closing command to the motion module after the shooting module finishes taking pictures, so as to control the motion module to drive the large suction cup to drive the door of the product to close.

[0054] According to one or more embodiments of the present disclosure, the product interior decoration detection system further includes an alarm module ( Figure 1The alarm module may be used to receive the detection result of the compliance judgment module, and if the detection is determined to be unsuccessful according to the detection result, an audible and visual alarm may be performed at the gate and / or on site.

[0055] There are many ways to perform sound and light alarm prompts at the gate and / or on-site. For example, the product code of the product can be used to connect to the manufacturing enterprise's production process execution management system MES to control the manufacturing enterprise's production process execution management system to perform sound and light alarm prompts at the gate and / or on-site.

[0056] According to one or more embodiments of the present disclosure, in order to obtain more detailed inspection results of the product, the product can be photographed in all directions for all-round inspection and judgment of the product. Taking the product as a rectangular parallelepiped as an example, the shooting module can be used to photograph the other five sides of the product except the bottom surface.

[0057] This embodiment discloses a product interior decoration detection system including a code reading module, a shooting module, and a compliance judgment module, which is used to judge whether the interior decoration of products on the assembly line is compliant, thereby improving the degree of industrial automation and intelligence.

[0058] Figure 2 1 is a schematic diagram of the overall structure of another technical solution of a product interior parts detection system provided according to an embodiment of the present invention. This embodiment is based on the above-mentioned embodiment and has been improved and optimized. Figure 2 As shown, this embodiment takes refrigerator detection as an example to illustrate the technical solution of this embodiment.

[0059] Since refrigerators vary in size, this embodiment requires that the product position has been unified when entering the following process. This part can be ensured by a product alignment mechanism such as a roller alignment system or a cylinder alignment system to ensure that the distance between the product feature plane to be inspected and the camera plane is consistent. This part will not be described here, as there are many mature solutions. According to the problem description, the solution design mainly includes four components: a code reading module, a door opening and closing device, a shooting module, and a compliance judgment module. The four components are introduced below:

[0060] (1) Code reading module.

[0061] Since there are multiple models of refrigerators in mixed production, when the product moves to this station on the production line, the position sensor (photoelectric sensor) automatically senses the arrival of the product, and based on the visual code reader or industrial camera with a one-dimensional code recognition algorithm, the product code is recognized by taking a photo and the product "ID" is identified. After the refrigerator enters the inspection station, the visual system switches to the corresponding software engineering according to the current refrigerator model.

[0062] (2) Door opening and closing device.

[0063] The switch command module, motion module and high-suction suction cup can be used to realize the automatic opening and closing of the refrigerator door. The motion module drives the high-suction suction cup to open and close the refrigerator door. After the refrigerator door is opened, the industrial camera takes pictures. After the pictures are taken, the motion module drives the high-suction suction cup to close the refrigerator door. Figure 4 It is a design schematic diagram of a door opening and closing device according to a technical solution of a product interior decoration detection system provided in an embodiment of the present invention.

[0064] Through the product code in step 1, the system matches the type, color, quantity and other information of the interior parts, and analyzes and verifies based on the online photo taking by the visual camera. During the visual inspection, the refrigerator remains stationary. For visual front interior parts inspection, it is necessary to detect whether the drawer has the + character correctly, and whether the characters on the refrigerator cover are correct. A large depth of field lens is required to be compatible with different refrigerator depths. For example, for the recognition of characters on the fresh-keeping box, the contour matching function can be used to realize the recognition of characters on the surface of the fresh-keeping box.

[0065] (3) Shooting module.

[0066] Based on multiple cameras, the remaining 5 sides of the box except the bottom are photographed, and the associated product code is archived. Multiple industrial cameras are used to take photos and collect pictures from the 5 sides respectively. Figure 5 It is a three-dimensional effect diagram of a shooting scheme of a technical solution of a product interior decoration detection system provided according to an embodiment of the present invention. Figure 6 This is a rendering of the approximate position of the shooting of a technical solution of a product interior decoration detection system provided by an embodiment of the present invention. The approximate position of the camera for taking photos and saving files can be as follows: Figure 6 Deployed in the locations shown.

[0067] On both sides of the flow direction of the assembly line, due to the problem of space between refrigerators, the camera in the shooting module can be installed and driven by a cylinder telescopic method. For example, the front detection camera is fixedly installed. The back camera can be used for archiving, and it can be fixed or movable according to the depth of field conditions of the camera.

[0068] (4) Compliance judgment module.

[0069] After receiving the at least one interior photo and the product code, the compliance judgment module may query the interior features of the product according to the product code, and judge whether the interior of the product matches the interior features according to the at least one interior photo.

[0070] Furthermore, the product code ID can be associated with the MES system to achieve data interconnection.

[0071] Data storage (data includes visual data & visual recognition images) requires storage space. For example, it can be estimated as follows: Data storage server disk size (MB) = (annual output * number of images) * 2MB * number of years of storage. For visual data storage, the refrigerator number can be used as the search primary key, and the image storage is named using the refrigerator number.

[0072] Local data storage and query, you can enter the product code (number) to query the corresponding monitoring data, support fuzzy query, enter part of the product number to query, can support the queried data to export CSV format data, open with a table.

[0073] Figure 3 is a schematic diagram of a product flow process corresponding to a technical solution of a product interior decoration detection system provided in an embodiment of the present invention, such as Figure 3 As shown in the figure, the product flow process includes:

[0074] After the system is started, step 310 is executed to determine whether the product has reached the first predetermined position. If so, step 320 is executed; otherwise, step 380 is executed.

[0075] Step 320 , read the product code of the product, and execute step 330 .

[0076] Step 330 , determine whether the product has reached the second predetermined position, if so, execute 340 , otherwise execute 390 .

[0077] Step 340 , obtain the product model according to the product code, switch to different visual inspection programs, take photos of the interior, and enter step 350 .

[0078] Step 350 , determine whether there is any interior decoration error or omission through visual inspection, if so, execute 360 ​​, otherwise execute 370 .

[0079] Step 360: Alarm the need for replacement through the sound and light alarm device.

[0080] Step 370: The product flows to the next station and ends.

[0081] Step 380 , control the product to continue to flow, and return to step 310 .

[0082] Step 390 , control the product to continue to flow, and return to step 330 .

[0083] This embodiment takes the detection of refrigerator interior as an example, and discloses a product interior detection system including a code reading module, a door opening and closing device, a shooting module, and a compliance judgment module, which is used to judge whether the interior of the refrigerator on the assembly line is compliant, thereby improving the degree of industrial automation and intelligence. It can realize automatic verification of interior parts, digitize the verification results, interconnect with MES system data, improve product production data, and facilitate product data traceability and application.

[0084] Computer program code for performing the operations of embodiments of the present invention may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0085] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present invention. In this regard, each box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0086] The units involved in the embodiments of the present invention may be implemented by software or hardware. The name of a unit does not limit the unit itself in some cases. For example, the first acquisition unit may also be described as a "unit for acquiring at least two Internet Protocol addresses".

[0087] The above description is only a preferred embodiment of the present invention and an explanation of the technical principles used. Those skilled in the art should understand that the disclosure scope involved in the embodiments of the present invention is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with (but not limited to) technical features with similar functions disclosed in the embodiments of the present invention.

Claims

1. A product interior parts detection system for detecting refrigerators, characterized in that: include: Code reading module, camera module, door opening and closing device, compliance judgment module, alarm module; The code reading module is used to read the product code of the product when the product is conveyed to the first predetermined position by the conveyor belt, and transmit the product code to the shooting module; The photographing module is used to receive the product code read by the code reading module, photograph the interior of the product to obtain at least one interior photo of the product when the product is conveyed to the second predetermined position by the conveyor belt, and send the at least one interior photo carrying the product code to the compliance judgment module; The door opening and closing device is used to control the door of the product to open after the product is conveyed to the second predetermined position of the conveyor belt, and to control the door of the product to close after the shooting module takes the at least one interior photo; The compliance judgment module is configured to, after receiving the at least one interior photo and the product code, query the interior features of the product according to the product code, and judge whether the interior of the product matches the interior features according to the at least one interior photo; The compliance judgment module is used to judge whether at least one of the following interior decorations of the product matches the interior decoration feature according to the at least one interior decoration photo: VC cover plate, air duct cover plate, bottle holder, drawer, and shelf; The alarm module is used to receive the test result of the compliance judgment module, and if it is determined that the test fails according to the test result, an audible and visual alarm prompt is issued at the gate and / or on site; Among them, the product code is associated with the MES system, which is used for local data storage and query. The product code or part of the product code is input to query the corresponding monitoring data and export the data in CSV format.

2. The product interior parts detection system according to claim 1, characterized in that: The product interior decoration parts detection system also includes a control device; The control device is used to control the movement of the conveyor belt according to the position of the product on the conveyor belt.

3. The product interior parts detection system according to claim 2, characterized in that: The motion control of the conveyor belt comprises: When the product is conveyed to the first predetermined position by the conveyor belt, controlling the conveyor belt to be stationary for a first predetermined time period; When the product is conveyed to the second predetermined position by the conveyor belt, the conveyor belt is controlled to remain stationary for a second predetermined period of time.

4. The product interior decoration detection system according to claim 3, characterized in that: The motion control of the conveyor belt further comprises: While the product is being conveyed from the first predetermined position to the second predetermined position by the conveyor belt, the conveyor belt is controlled to first perform accelerated motion at a first predetermined acceleration for a third predetermined time period, and then maintain uniform motion until the product reaches the second predetermined position.

5. The product interior decoration detection system according to claim 1, characterized in that: The shooting module includes at least one camera, and the product interior decoration detection system also includes a positioning module; The alignment module is used to adjust the position of the product when the product is conveyed to the second predetermined position by the conveyor belt so that the distance between the product and the at least one camera meets a predetermined requirement.

6. The product interior decoration detection system according to claim 5, characterized in that: The alignment module is a roller-type alignment module or a cylinder-type alignment module.

7. The product interior decoration detection system according to claim 1, characterized in that: The door opening and closing device comprises a switch command module, a motion module and a large suction cup, wherein the large suction cup is located at one end of the motion module; The switch command module is used to send a door opening command to the motion module when the product is conveyed to the second predetermined position of the conveyor belt, so as to control the motion module to drive the large suction cup to move toward the door of the product until the large suction cup sucks the door of the product, and then drive the large suction cup to drive the door of the product to open; The switch instruction module is also used to send a door closing instruction to the motion module after the shooting module finishes taking pictures, so as to control the motion module to drive the large-suction suction cup to drive the door of the product to close.

8. The product interior decoration detection system according to claim 1, characterized in that: The sound and light alarm prompt at the gate and / or on site includes: The product code of the product is connected to the manufacturing enterprise production process execution management system MES of the enterprise to control the manufacturing enterprise production process execution management system to give sound and light alarm prompts at the gate and / or on site.

9. The product interior decoration detection system according to claim 1, characterized in that: The interior features include at least one of the following: interior quantity, interior color, interior model, and interior pattern.

10. The product interior decoration detection system according to claim 1, characterized in that: The product is a cuboid; The shooting module is used to shoot the inside of the product, including: being used to shoot five surfaces of the product except the bottom surface.

Images