Article identification device, article identification system, and article identification method

Abstract

To efficiently perform determinations on various articles to suppress false assembling.SOLUTION: An article determination apparatus includes: an article information acquisition unit which acquires article information from a reader which reads article information including information on an article which is to be assembled to an object; an image acquisition unit which acquires an image from an imaging apparatus that images the object rotating on a rotating table; an article identifying unit which identifies an article assembled on the object on the basis of the image; and a determination unit which collates the article information with the identified article, and determines whether the article assembled on the object matches the article information.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present disclosure relates to an article determination device, an article determination system, and an article determination method.

Background Art

[0002] In the shipping inspection of an object such as a vehicle to which various articles are assembled, an operator may visually check whether the types of optional articles and the like match the contents of the specification.

[0003] For example, there is a technique for performing a surface inspection of a mass-produced casting by placing the mass-produced casting used for a vehicle or the like on a turntable and rotating it, and imaging the mass-produced casting with an imaging device arranged around the turntable (see, for example, Patent Document 1). According to this technique, a speedy inspection using a turntable can be performed on mass-produced products.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, in the shipping inspection of a vehicle or the like, there may be a wide variety of optional articles for one vehicle type. When applying the technique of Patent Document 1 targeting mass-produced products to this, operations such as recombining the program for each specification of the object become necessary. Therefore, it is difficult to apply the technique of Patent Document 1 above to the inspection of various articles. In addition, visual inspection by an operator requires a great deal of labor and may also overlook incorrect assembly.

[0006] This disclosure aims to provide an article identification device, an article identification system, and an article identification method that can efficiently identify various articles and suppress misassembly. [Means for solving the problem]

[0007] The article determination device according to this disclosure includes: an article information acquisition unit that acquires article information from a reading device that reads article information including information about an article to be assembled to an object; an image acquisition unit that acquires an image from an imaging device that images the object rotating on a turntable; an article identification unit that identifies an article assembled to the object based on the image; and a determination unit that compares the article information with the identified article and determines whether the article assembled to the object matches the article information. A command unit that controls the rotating platform and the imaging device, Equipped with, After the verification is complete, the command unit terminates the rotation of the object and the imaging of the object rotating on the turntable. . [Effects of the Invention]

[0008] According to the article identification device, article identification system, and article identification method described herein, it is possible to efficiently identify a variety of articles and suppress misassembly. [Brief explanation of the drawing]

[0009] [Figure 1] Figure 1 is a schematic diagram showing an example of the configuration of an item determination system according to an embodiment. [Figure 2] Figure 2 shows an example of the hardware configuration of the item determination system according to the embodiment. [Figure 3] Figure 3 is a block diagram showing an example of the functional configuration of an article determination device according to an embodiment. [Figure 4] Figure 4 is a schematic diagram illustrating the process of item determination by the item determination system according to the embodiment. [Figure 5] Figure 5 is a schematic diagram illustrating the process of item determination by the item determination system according to the embodiment. [Figure 6]Figure 6 is a schematic diagram illustrating the process of item determination by the item determination system according to the embodiment. [Figure 7] Figure 7 is a schematic diagram illustrating the process of item determination by the item determination system according to the embodiment. [Figure 8] Figure 8 is a flowchart showing an example of the procedure for item determination processing by the item determination system according to the embodiment. [Figure 9] Figure 9 is a flowchart showing an example of the procedure for item matching processing by the item determination device according to the embodiment. [Modes for carrying out the invention]

[0010] Hereinafter, embodiments of the article determination device, article determination system, and article determination method according to this disclosure will be described with reference to the drawings.

[0011] (Example of an item identification system configuration) Figure 1 is a schematic diagram showing an example of the configuration of an item determination system 1 according to an embodiment. As shown in Figure 1, the item determination system 1 comprises an item determination device 10, a reading device 20, an imaging device 30, and a rotating table 40.

[0012] The item determination device 10 is configured as a computer equipped with, for example, a CPU (Central Processing Unit), as described later, and determines the item installed on the vehicle VH based on information from the reading device 20 and images from the imaging device 30.

[0013] The reading device 20 is a reader equipped with a scanning function such as a camera or laser sensor, and reads the item information of the vehicle VH to be judged.

[0014] The item information for a vehicle VH includes information described in documents SP such as the vehicle VH's specifications, procedures, or instructions, and includes information about the items to be installed in the vehicle VH being assessed.

[0015] The articles assembled to the vehicle VH include standard articles that are commonly used for one vehicle model and optional articles for which multiple types may exist for one vehicle model. The optional articles can be customized in a variety of ways according to the customer's order, such as being able to select whether assembly is required or being able to select one from multiple types of shapes, colors, and other forms. In the document SR, for each individual vehicle VH, information on the articles to be assembled to that vehicle VH is described among these articles.

[0016] In the document SR, the article information of the vehicle VH includes a code CR represented in a form readable by a reading device 20, such as a two-dimensional code like a QR (Quick Response) code (registered trademark) or a one-dimensional code like a barcode. In the document SR, the article information of the vehicle VH may be written together with character information along with the code CR.

[0017] The imaging device 30 is a digital camera or the like incorporating an imaging element such as a CCD (Charge Coupled Device) or a CIS (CMOS Image Sensor). The imaging device 30 can generate an image of a moving image or a still image including a plurality of frame images taken at a predetermined frame rate, and for example, images the vehicle VH rotating on the turntable 40.

[0018] The turntable 40 is a turntable or the like configured to be able to mount the vehicle VH to be determined and rotate. When the turntable 40 rotates in the circumferential direction, the orientation of the vehicle VH on the turntable 40 with respect to the imaging device 30 changes. Thereby, images of the vehicle VH taken at various angles by the imaging device 30 can be obtained.

[0019] Next, the hardware configuration of the article determination system 1 will be described using FIG. 2.

[0020] Figure 2 shows an example of the hardware configuration of the item determination system 1 according to the embodiment. As shown in Figure 2, the item determination device 10 of the item determination system 1 is configured as a computer equipped with a CPU 16, RAM (Random Access Memory) 11, ROM (Read Only Memory) 12, etc., and is connected to a reading device 20, an imaging device 30, and a rotating table 40.

[0021] More specifically, the item determination device 10 comprises a CPU 16, RAM 11, ROM 12, interface (I / F) 15, input device 17, output device 18, and auxiliary storage device 19. The CPU 16, RAM 11, ROM 12, I / F 15, input device 17, output device 18, and auxiliary storage device 19 are connected to each other by an internal bus.

[0022] The CPU 16 is an arithmetic unit that controls the operation of the entire item determination device 10. The RAM 11 is a volatile memory device used as the work area of ​​the CPU 16. The ROM 12 is a non-volatile memory device that stores programs and other data that enable various processes performed by the CPU 16.

[0023] The CPU 16, RAM 11, and ROM 12 may be configured as a System on a Chip (SoC), for example, mounted on a single circuit board.

[0024] The I / F15 is connected to the reading device 20, the imaging device 30, and the turntable 40 via a bus, and is configured to allow the exchange of various signals between the item determination device 10 and the reading device 20, imaging device 30, and turntable 40.

[0025] Signals transmitted from the item determination device 10 to the reading device 20, imaging device 30, and turntable 40 include, for example, control signals that control the operation of the reading device 20, imaging device 30, and turntable 40.

[0026] The signals that the item determination device 10 receives from the reading device 20 include, for example, a signal containing information about code CR read by the reading device 20 from document SP. The signals that the item determination device 10 receives from the imaging device 30 include, for example, a signal containing information about multiple images of vehicle VH taken by the imaging device 30 at different angles. The signals that the item determination device 10 receives from the turntable 40 include, for example, a signal containing information about the rotation angle, rotation speed, and rotation position of the turntable 40.

[0027] The auxiliary storage device 19 is an HDD (Hard Disk Drive), SSD (Solid State Drive), eMMC (embedded Multi Media Card), or microSD card, and stores various types of data.

[0028] The input device 17 includes a keyboard, mouse, etc., and is configured to allow workers involved in the item determination process to input various instructions to the item determination device 10.

[0029] The output device 18 includes a display device such as a liquid crystal display (LCD) or an organic electro-luminescence (OLED) display, a printer, etc., and is configured to output the results of the vehicle VH's item determination. The output device 18 may also include other components such as a speaker or a light.

[0030] The input device 17 and the output device 18 may be integrated, such as in a touch panel. Alternatively, the input device 17 and the output device 18 may be connected as external devices to an item determination device 10, such as a computer.

[0031] On the other hand, at least one of the reading device 20 and the imaging device 30 may be built into the item determination device 10 and configured integrally with the item determination device 10.

[0032] Next, the functional configuration of the item determination device 10 will be explained using Figure 3.

[0033] Figure 3 is a block diagram showing an example of the functional configuration of an item determination device 10 according to an embodiment. As shown in Figure 3, the item determination device 10 includes, as functional units, an item information acquisition unit 101, an item information conversion unit 102, an image acquisition unit 103, an item identification unit 104, a command unit 105, a determination unit 106, an input unit 107, and an output unit 108.

[0034] These functional units are implemented in the item determination device 10 when, for example, a program stored in ROM 12 is loaded into RAM 11, and then executed by CPU 16.

[0035] The item information acquisition unit 101 acquires code CR information representing item information read by the reading device 20 from the reading device 20. The item information acquisition unit 101 is implemented, for example, by an I / F 15 that operates under the control of the CPU 16 described above.

[0036] The item information conversion unit 102 refers to the code conversion information 111 stored in the storage unit 109 and converts the code CR information read by the reading device 20 into item information in a format that the determination unit 106 can use for determination, such as character information. The item information conversion unit 102 is realized, for example, by the execution of a program by the CPU 16 described above.

[0037] The image acquisition unit 103 acquires information from multiple images taken by the imaging device 30 of the vehicle VH at different angles. The image acquisition unit 103 is implemented, for example, by an I / F 15 that operates under the control of the CPU 16 described above.

[0038] The item identification unit 104 analyzes the image captured by the imaging device 30 and identifies the vehicle VH items included in the captured image by referring to the form / item correspondence information 112 stored in the storage unit 109. The item identification unit 104 is implemented, for example, by the execution of a program by the CPU 16 described above.

[0039] The command unit 105 controls the reading of code CR by the reading device 20. When the reading device 20 starts reading code CR, the command unit 105 activates the imaging device 30 to start imaging of vehicle VH, and also activates the turntable 40 to start rotating the turntable 40 on which vehicle VH is mounted. When the object determination device 10 finishes determining the object, the command unit 105 stops imaging by the imaging device 30 and the rotation of the turntable 40.

[0040] The command unit 105 is realized, for example, by the execution of a program by the CPU 16 described above, and by the I / F 15 operating under the control of the CPU 16.

[0041] The determination unit 106 compares the item information converted by the item information conversion unit 102 with the items identified by the item identification unit 104 to determine whether the various items actually possessed by the vehicle VH match the item information on the specification sheet or other document SP. If, as a result of comparing the item information with the identified items, the determination unit 106 finds that any of the items assembled to the vehicle VH does not match the item information, it adds warning information to the determination result for that item.

[0042] The determination unit 106 is implemented, for example, by the execution of a program by the CPU 16 described above.

[0043] The input unit 107 receives various instructions from the operator to the item determination device 10. The input unit 107 is implemented, for example, by an input device 17 that operates under the control of the CPU 16 described above. The output unit 108 outputs the determination results of various items assembled on the vehicle VH. The output unit 108 is implemented, for example, by an output device 18 that operates under the control of the CPU 16 described above.

[0044] The memory unit 109 stores code conversion information 111 and form / item correspondence information 112.

[0045] In code conversion information 111, each of the multiple code CRs written on document SP is associated with the item information that the code CR represents.

[0046] In the form / item correspondence information 112, for each type of item, image data of that item taken at a specific angle is linked to information that identifies that item. The image data may include only one image of the item taken at one angle, or it may include multiple image data of the item taken at multiple angles. The information that identifies the item may be expressed in the same content and format as the item information described in document SP, for example.

[0047] The memory unit 109 is implemented, for example, by an auxiliary storage device 19 that operates under the control of the CPU 16 described above.

[0048] (Examples of functions in the item identification system) Next, the details of the function of the item determination system 1 will be explained using Figures 4 to 7. Figures 4 to 7 are schematic diagrams illustrating the process of item determination by the item determination system 1 according to the embodiment. Item determination by the item determination system 1 is performed on finished vehicle VHs in the vehicle VH manufacturing line, for example, as part of a shipping inspection.

[0049] As shown in Figure 4, for example, a vehicle VH that has completed all processes on the manufacturing line is placed on a turntable 40. Along with the vehicle VH, documents SP such as the vehicle VH's specifications are sent to the item determination system 1.

[0050] The command unit 105 of the item determination device 10 instructs the reading device 20 to read the code CR written on the document SP. When the reading device 20 starts reading the code CR, the command unit 105 instructs the imaging device 30 to start imaging the vehicle VH and also starts rotating the turntable 40.

[0051] The item information acquisition unit 101 of the item determination device 10 acquires code CR information from the reading device 20. The item information conversion unit 102 converts the code CR read by the reading device 20 into the item information PID that the code CR represents.

[0052] More specifically, the item information conversion unit 102 refers to the code conversion information 111 stored in the storage unit 109 and extracts item information such as character information associated with the code CR read by the reading device 20. As a result, the code CD read by the reading device 20 is converted into item information PID in a format that can be determined by the determination unit 106.

[0053] In the example in Figure 4, the item information PIF converted by the item information conversion unit 102 includes information such as "body color" and "wheel cover" as items. The item information PIF also includes information such as "No. 3" as the model number indicating the body color and "Type 5" as the model number indicating the wheel cover.

[0054] The image acquisition unit 103 of the item determination device 10 acquires an image of the vehicle VH captured by the imaging device 30. The item identification unit 104 identifies the items included in the image of the vehicle VH. In the example in Figure 4, the vehicle VH is facing sideways to the imaging device 30, and in this case, the items to be identified are mainly those mounted on the side of the vehicle VH.

[0055] More specifically, the item identification unit 104 refers to the form / item correspondence information 112 stored in the memory unit 109 to extract image data that matches the form of the item contained in the image of the vehicle VH, and extracts identification information that identifies that item, which is linked to the image data. In this way, the item contained in the captured image is identified from the image.

[0056] In the example shown in Figure 4, the item identification information SIF identified by the item identification unit 104 includes information such as "body color: No. 3" and "wheel cover: Type 5".

[0057] The determination unit 106 compares the information contained in the item information PIF with the information contained in the specific information SIF for each item and determines whether they match.

[0058] In the example in Figure 4, the body color included in the item information PIF and the body color included in the specific information SIF are both "No. 3," which matches. Therefore, it can be seen that the correct body color is applied to this vehicle VH. Also, the wheel cover model included in the item information PIF and the wheel cover model included in the specific information SIF are both "Type 5," which matches. Therefore, it can be seen that the correct wheel cover is installed on this vehicle VH.

[0059] As shown in Figure 5, the rotation of the vehicle VH by the turntable 40 and the imaging of the vehicle VH by the imaging device 30 continue.

[0060] Furthermore, image acquisition by the image acquisition unit 103 and identification of items by the item identification unit 104 continue. In the example shown in Figure 5, the vehicle VH is facing the imaging device 30, and in this case, the items to be identified are mainly those mounted on the front of the vehicle VH.

[0061] More specifically, in the example shown in Figure 5, the item identification information SIF identified by the item identification unit 104 includes information such as "Door mirror color: No. 9", "Emblem type: No. 1", and "Front spoiler: Type 6".

[0062] In the example shown in Figure 5, the item information PIF converted by the item information conversion unit 102 also includes information such as "door mirror color," "emblem type," and "front spoiler" as items. Furthermore, the item information PIF includes information such as "No. 8" as the model number indicating the door mirror color, "No. 1" as the model number indicating the emblem type, and "Type 6" as the model number indicating the front spoiler.

[0063] The determination unit 106 compares the information contained in the item information PIF with the information contained in the specific information SIF for each item and determines whether they match.

[0064] In the example in Figure 5, the type of emblem included in the item information PIF and the type of emblem included in the specific information SIF are both "No. 1," which matches. Therefore, it can be concluded that the correct emblem is installed on this vehicle VH. Also, the model number of the front spoiler included in the item information PIF and the model number of the front spoiler included in the specific information SIF are both "Type 6," which matches. Therefore, it can be concluded that the correct front spoiler is installed on this vehicle VH.

[0065] On the other hand, the door mirror color listed in the item information PIF is "number 8," while the door mirror color listed in the specific information SIF is "number 9," and these do not match. Therefore, it can be concluded that this vehicle VH has door mirrors of the wrong color installed.

[0066] The determination unit 106 adds warning information to the door mirror item in the determination result for vehicle VH. The warning information from the determination unit 106 may be, for example, coloring the door mirror item in the item information PIF, or placing a check mark on the door mirror item in the specific information SIF.

[0067] As shown in Figure 6, the rotation of the vehicle VH by the turntable 40 and the imaging of the vehicle VH by the imaging device 30 continue.

[0068] Furthermore, image acquisition by the image acquisition unit 103 and identification of items by the item identification unit 104 continue. In the example shown in Figure 6, the vehicle VH is facing the other side of the imaging device 30, and in this case, the items to be identified are mainly those mounted on the other side of the vehicle VH.

[0069] More specifically, in the example in Figure 6, the item identification information SIF identified by the item identification unit 104 includes information such as "body color: No. 3" and "wheel cover: Type 5". In this way, the same type of item as shown in Figure 4 may be identified on the other side of the vehicle VH.

[0070] The determination unit 106 compares the information contained in the item information PIF with the information contained in the specific information SIF for each item and determines whether they match.

[0071] In the example in Figure 6, as in the example in Figure 4, the body color included in the item information PIF and the body color included in the specific information SIF are both "No. 3," which matches. Therefore, it can be seen that the correct body color is applied to this vehicle VH. Also, the wheel cover model included in the item information PIF and the wheel cover model included in the specific information SIF are both "Type 5," which matches. Therefore, it can be seen that the correct wheel cover is installed on this vehicle VH.

[0072] In this way, the accuracy of item identification can be improved by performing the same item identification on both the left and right sides of the vehicle VH. However, different items may be identified on the left and right sides of the vehicle VH.

[0073] As shown in Figure 7, the rotation of the vehicle VH by the turntable 40 and the imaging of the vehicle VH by the imaging device 30 continue.

[0074] Furthermore, image acquisition by the image acquisition unit 103 and identification of items by the item identification unit 104 continue. In the example in Figure 7, the vehicle VH is facing its rear toward the imaging device 30, and in this case, the items to be identified are mainly those mounted on the rear of the vehicle VH.

[0075] More specifically, in the example in Figure 7, the item identification information SIF identified by the item identification unit 104 includes information such as "rear spoiler: type 6", "rear wing: none", and "rear wiper: none". Here, for example, the rear wing and rear wiper are optional items that the customer can choose whether or not to install, and in vehicle VH in Figure 7, the rear wing and rear wiper are not installed.

[0076] In the example shown in Figure 7, the item information PIF converted by the item information conversion unit 102 also includes information such as "rear spoiler," "rear wing," and "rear wiper" as items. The item information PIF also includes "No. 6" as the model number for the rear spoiler. The model numbers for the rear wing and rear wiper are listed as "None," indicating that the customer of this vehicle VH did not wish to have the rear wing and rear wiper installed.

[0077] The determination unit 106 compares the information contained in the item information PIF with the information contained in the specific information SIF for each item and determines whether they match.

[0078] In the example in Figure 7, the model number of the rear spoiler included in the item information PIF and the model number of the rear spoiler included in the specific information SIF are both "Type 6," which matches. Therefore, it can be concluded that the correct rear spoiler is installed on this vehicle VH.

[0079] Furthermore, the model numbers for the rear wing and rear wiper included in the item information PIF, and the model numbers for the rear wing and rear wiper included in the specific information SIF, are both "none," which matches. Therefore, it can be concluded that the rear wing and rear wiper were not installed on this vehicle VH, as requested by the customer.

[0080] Subsequently, for example, when the turntable 40 completes one rotation and the vehicle VH returns to its original position, the command unit 105 terminates the rotation by the turntable 40 and the imaging by the imaging device 30. The determination unit 106 also terminates the item determination when it has completed the determination for all items on the vehicle VH.

[0081] The output unit 108 of the item determination device 10 outputs the determination result of the item determination of vehicle VH by the determination unit 106. The determination result may be displayed on a monitor or the like that which constitutes the output unit 108, or it may be printed out by a printer or the like that which constitutes the output unit 108.

[0082] In this case, for items that were actually installed in the vehicle VH but did not match the item information described in the specification document SP, the judgment result may be output in the form of item information PIF, with the items related to that item highlighted in color, as shown in the example in Figure 5. Alternatively, the judgment result may be output in the form of specific information SIF, with a check mark next to the items related to that item.

[0083] However, the means and form of outputting the judgment result by the output unit 108 are not limited to the above examples. The output unit 108 may output the judgment result as a warning sound or voice via a speaker, for example, or it may output the judgment result by turning on or flashing a light.

[0084] Furthermore, items related to the overall specifications of the vehicle VH, such as the color of the vehicle body, may be determined based on multiple images taken during one rotation of the vehicle VH, that is, during a 360° rotation of the vehicle VH, as described above.

[0085] Furthermore, even items that are attached only to a part of the vehicle's VH, such as emblems and front / rear spoilers, may be determined based on images from multiple angles that may include such items.

[0086] Furthermore, while Figures 4 to 7 show an example in which the vehicle VH is rotated clockwise by the turntable 40, the turntable 40 may also be configured to rotate the vehicle VH counterclockwise.

[0087] (Example of processing by an item identification system) Next, an example of the article determination process by the article determination system 1 of the embodiment will be described using Figures 8 and 9. Figure 8 is a flowchart showing an example of the procedure for article determination processing by the article determination system 1 according to the embodiment.

[0088] As shown in Figure 8, the item determination system 1 waits until the reader 20 starts reading the document SP (Step S101: No). When the document SP is sent to the item determination process in the manufacturing line along with the vehicle VH to be determined, the reader 20 starts reading the code CR written on the document SP as indicating item information (Step S101: Yes).

[0089] The command unit 105 of the item determination device 10 starts imaging of the vehicle VH placed on the turntable 40 using the imaging device 30 (step S102). The command unit 105 also starts rotating the vehicle VH on the turntable 40 (step S103).

[0090] Furthermore, the processes in steps S102 and S103 may be started, for example, in parallel, or more specifically, simultaneously. Also, imaging by the imaging device 30 and rotation of the turntable 40 will continue, for example, until the item determination process by the item determination system 1 is completed.

[0091] The item information acquisition unit 101 of the item determination device 10 acquires the code CR that indicates the item information read by the reading device 20 (step S104). The item information conversion unit 102 refers to the code conversion information 111 stored in the storage unit 109, extracts the item information that matches the code CR read by the reading device 20, and converts the information represented by code CR into item information in a format that can be verified by the determination unit 106 (step S105).

[0092] Furthermore, the processing in steps S104 and S105 may be carried out in parallel with, for example, the processing in steps S102 and S103. More specifically, the processing in step S104 may be started simultaneously with, for example, the processing in steps S102 and S103.

[0093] Furthermore, the processes in steps S104 and S105 may be carried out in part in parallel with the article matching process in step S106, which will be described later. However, it is preferable that the processes in steps S104 and S105 are completed before the article matching process in step S106 is started.

[0094] The item determination device 10 compares the item information converted from the code CR by the item information conversion unit 102 and the image of the vehicle VH captured by the imaging device 30 with the item information (step S106). Details of the process in step S106 will be described later.

[0095] Once the matching of the specified items is complete, the item determination device 10 determines whether the matching of all target items has been completed (step S107). If there are any unmatched items remaining (step S107: No), the item determination device 10 repeats the process in step S106.

[0096] If the matching of all items has been completed (Step S107: Yes), the command unit 105 of the item determination device 10 terminates the imaging of the vehicle VH by the imaging device 30 (Step S108). The command unit 105 also terminates the rotation of the vehicle VH by the turntable 40 (Step S109).

[0097] Furthermore, the processes in steps S108 and S109 may be performed in parallel, or more specifically, simultaneously. Also, the processes in steps S108 and S109, in other words, the imaging by the imaging device 30 and the rotation of the turntable 40, may be terminated when the turntable 40 has completed one rotation, that is, a 360° rotation.

[0098] The output unit 108 of the item determination device 10 outputs the determination result of the item assembled to the vehicle VH (step S110). Note that the processing in step S110 may be performed before, after, or in parallel with the processing in steps S108 and S109. More specifically, the processing in steps S108 to S110 may be performed simultaneously.

[0099] With the above steps completed, the article determination process by the article determination system 1 of the embodiment is finished.

[0100] Figure 9 is a flowchart showing an example of the procedure for item matching processing by the item determination device 10 according to the embodiment. The process in Figure 9 corresponds to the details of the process in step S106 of Figure 8, and shows the matching process for any one item among a plurality of items assembled on the vehicle VH.

[0101] As shown in Figure 9, the image acquisition unit 103 of the item determination device 10 acquires an image of the vehicle VH captured by the imaging device 30 (step S111). The item identification unit 104 refers to the form / item correspondence information 112 stored in the storage unit 109, extracts image data that matches the shape of the item contained in the image captured by the imaging device 30, and identifies the item contained in the image based on the identification information linked to that image data (step S112).

[0102] The determination unit 106 of the item determination device 10 compares the item information obtained in step S105 of Figure 8 with the item identified by the identification information obtained in step S112 (step S113). The determination unit 106 also determines whether the item information and the item indicated by the identification information match (step S114).

[0103] If the item information and the item do not match (step S114: No), the determination unit 106 adds warning information to the determination result for that item (step S115). If the item information and the item do match (step S114: Yes), the determination unit 106 terminates the matching process for that item without performing the process in step S115.

[0104] With the above steps completed, the article matching process by the article determination device 10 of the embodiment is finished.

[0105] (Overview) For example, vehicles, which are assembled from multiple parts, often have a large number of optional parts available, allowing for various customizations for each customer. On the other hand, this creates a risk of incorrect assembly during the manufacturing process. Therefore, on the manufacturing line, workers visually inspect the actual vehicle based on the part information described in the specifications, etc., to determine whether the correct parts have been assembled.

[0106] However, such visual inspections require a great deal of effort. Furthermore, visual inspections can be subject to variations among workers and may result in errors such as overlooking incorrect assembly.

[0107] According to the embodiment of the article determination system 1, the system comprises a reading device 20 for reading article information, a rotating platform 40 on which a vehicle VH can be placed and rotated, an imaging device 30 for imaging the vehicle VH, and an article determination device 10 that determines the article attached to the vehicle VH based on the article information read by the reading device 20 and the image captured by the imaging device.

[0108] This eliminates the need for visual inspection by workers and enables efficient identification of various items. Furthermore, by adding a reading device 20 to an existing computer, for example, and giving it functions such as generating control signals to an imaging device 30, a system can be easily and inexpensively constructed using a turntable or other rotating platform 40.

[0109] The item determination device 10 of this embodiment includes a determination unit 106 that compares the item information read by the reading device 20 with the item identified by the item identification unit 104 based on the image, and determines whether the item assembled to the vehicle VH matches the item information. This eliminates the need for visual inspection by the worker and helps to suppress incorrect assembly.

[0110] According to the embodiment of the item determination device 10, when the reading device 20 starts reading item information, a command unit 105 is provided to start the rotation of the turntable 40 and the imaging device 30 to start imaging. This allows the turntable 40 and imaging device 30 to be operated only when necessary, thereby reducing power consumption and the cost of item determination.

[0111] According to the article identification device 10 of this embodiment, the article identification unit 104 identifies a predetermined article attached to the vehicle VH from a predetermined image among a plurality of images of the vehicle VH rotating on the turntable 40 at different angles, and identifies other articles attached to the vehicle VH from other images.

[0112] This allows for the acquisition of multiple images while rotating the vehicle VH on the turntable 40, enabling the comprehensive identification and determination of various items assembled to the vehicle VH. Therefore, it is possible to efficiently identify diverse items and suppress misassembly.

[0113] According to the article identification device 10 of this embodiment, the article identification unit 104 identifies one article attached to the vehicle VH from multiple images of the vehicle VH rotating on the turntable 40, taken at different angles.

[0114] In this way, since the item is identified based on multiple images of the vehicle VH taken from various angles in accordance with the rotation of the turntable 40, more accurate identification becomes possible, and misassembly can be further suppressed.

[0115] In the above embodiment, for example, the completed vehicle VH is subjected to item determination by the item determination system 1 during the final shipment inspection of the manufacturing line, but this is not limited to this. Item determination by the item determination system 1 can be performed at various stages of the manufacturing line on the vehicle VH in the process of being manufactured, or on assemblies that constitute the vehicle VH.

[0116] Furthermore, in the above-described embodiment, the exterior of the vehicle VH was imaged to primarily determine the exterior articles, but the interior articles of the vehicle VH may also be determined using the article determination system 1. In this case, at intermediate stages of the manufacturing line, for example, the interior images of the vehicle body before it is attached to the chassis can be captured, or for the completed vehicle VH, the interior can be imaged from the window area to determine the interior articles of the vehicle VH.

[0117] Furthermore, in the above-described embodiment, the determination of an item attached to a vehicle VH is performed. In this case, the vehicle VH may be an automobile, motorcycle, train, small boat, small airplane, etc., and in addition, various objects can be determined as long as they can be placed on the turntable 40 and rotated. [Explanation of symbols]

[0118] 1. Item Identification System 10 Article determination device 20 Reading device 30 Imaging device 40 Turntables 101 Product Information Acquisition Department 102 Item Information Conversion Unit 103 Image acquisition unit 104 Article Specification Department 105 Command Department 106 Judgment section 107 Input section 108 Output section 109 Storage section 111 Code Conversion Information 112. Form / Item Correspondence Information CR code PIF product information SIF Specific Information SP Documents VH Vehicle

Claims

1. An item information acquisition unit that acquires item information from a reading device that reads item information including information about items to be assembled to an object, An image acquisition unit that acquires an image from an imaging device that images the object rotating on a rotating platform, An article identification unit that identifies an article attached to the object based on the aforementioned image, A determination unit that compares the item information with the identified item and determines whether the item assembled to the object matches the item information, The system comprises a control unit for controlling the rotating platform and the imaging device, The command unit, After the matching is completed, the rotation of the object and the imaging of the object rotating on the turntable are terminated. Article determination device.

2. The command unit is: When the reading device starts reading the article information, it starts rotating the turntable and taking images with the imaging device. The article determination device according to claim 1.

3. The image acquisition unit, The imaging device acquires first and second images of the object rotating on the turntable at different angles. The article determination device according to claim 1 or claim 2.

4. The command unit is The judgment results matched for all of the aforementioned articles, or The matching process is considered complete when either of the following matching processes is completed: the determination unit assigns warning information based on the determination result not matching for at least some of the aforementioned articles; or the matching process is completed. The article determination device according to any one of claims 1 to 3.

5. A reading device that reads item information, including information about items to be assembled to the target object, A rotating platform on which the aforementioned object can be placed and rotated, An imaging device for imaging the object rotating on the aforementioned rotating platform, The device comprises an article determination device that determines the article attached to the object based on the article information read by the reading device and the image captured by the imaging device, The article determination device is An article identification unit that identifies the article assembled to the object based on the aforementioned image, A determination unit that compares the item information with the identified item and determines whether the item assembled to the object matches the item information, It comprises a control unit for controlling the rotating platform and the imaging device, The command unit, After the matching is completed, the rotation of the object and the imaging of the object rotating on the turntable are terminated. Item identification system.

6. The item information, which includes information about the items to be assembled to the object, is read. The object is placed on a rotating platform and rotated. The object rotating on the aforementioned rotating platform is imaged, Based on the image of the object, the article attached to the object is identified. The read item information is compared with the identified item, and it is determined whether the item assembled to the object matches the item information. After the matching is completed, the rotation of the object and the imaging of the object rotating on the turntable are terminated. Article judgment method.

Images