Information processing system and information processing method

Abstract

To provide an information processing system and an information processing method which can reduce cost and man-hour to grasp completion of a taking-out work of an operator taking out components from a truck and improve correctness.SOLUTION: An information processing system 1 comprises: a truck whose roof includes a first identification code to supply a production line with components; and a truck storage space in the production line with a second identification code different from the first identification code on a floor. An imaging part 20 of the information processing system 1 images an image within a specified range of the truck storage space in a ceiling direction. A determination part 12 determines whether an operator completes a taking-out work taking out components from the truck or not in the truck storage space based on the first identification code and the second identification code of the imaged image.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present invention relates to an information processing system and an information processing method.

Background Art

[0002] In the technology of Patent Document 1, a progress observation mark is attached to a self-propelled cart carrying a product that travels on the floor in a certain direction at a certain speed. Also, progress confirmation marks at equal intervals in a certain direction are attached to the floor surface so as to correspond to positions where parts to be installed on the product are located. And in the technology of Patent Document 1, the positional relationship between the progress confirmation mark and the progress observation mark, that is, the current position of the self-propelled cart is used by the person in charge to grasp the state of work in the mixed-flow production line.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] As component supply to a production line such as a prototype vehicle, components are set on a dedicated cart and supplied. Workers take out the necessary components from the cart one by one and assemble them onto the body. In order to supply components in a timely manner, it is necessary to grasp that the operation of taking out components from the cart by the worker has been completed.

[0005] In the background art according to Patent Document 1, the system detected that the operation of taking out parts from the operator's cart was completed, for example, by (1) a button switch method or (2) an image determination method using AI. In the (1) button switch method, after the parts are taken out, the operator operates the device to detect the completion of the operation. In the (2) image determination method using AI, the completion of the operation is detected by the operator's actions. Here, in the (1) button switch method, when the button switch is wired, it requires cost and time to relocate the device. Also, when the button switch is wireless, there is a problem that regular battery replacement is required. In the (2) image determination method using AI, there are problems such as difficulty in determining the completion of the operation and the huge cost and time for improving accuracy. That is, in the technology according to Cited Document 1, there was a problem in terms of cost, man-hours, accuracy, etc. when grasping the state of the operation of taking out parts from the cart.

[0006] In view of such problems, an object of the present disclosure is to provide an information processing system and an information processing method that can reduce the cost and man-hours and improve the accuracy when grasping that the operation of taking out parts from the operator's cart is completed.

Means for Solving the Problems

[0007] The information processing system of the present disclosure includes a cart for supplying parts to a production line, with a first identification code attached to the ceiling, a placement area for the cart on the production line, with a second identification code different from the first identification code attached to the floor surface, a photographing unit that photographs an image within a predetermined range from the placement area in the direction of the ceiling, a determination unit that determines whether or not the operation of taking out parts from the cart by an operator in the placement area is completed based on the appearance of the first identification code and the second identification code in the photographed image.

[0008] The information processing method of the present disclosure A cart for supplying parts to a production line, with a first identification code attached to the ceiling, and a storage location for the cart on the production line, with a second identification code different from the first identification code attached to the floor surface, and a computer takes a picture of an image within a predetermined range from the storage location in the direction of the ceiling, and determines whether the operation of removing parts from the cart by the operator at the storage location has been completed based on the appearance of the first identification code and the second identification code in the captured image.

Advantages of the Invention

[0009] The present disclosure can provide an information processing system and an information processing method that can reduce the cost and man-hours for grasping that the operation of removing parts from the cart by the operator has been completed, and can improve the accuracy.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Modes for Carrying Out the Invention

[0011] (First Embodiment) First, with reference to FIGS. 1 to 4, the configuration of the information processing system 1 according to the first embodiment will be described.

[0012] The information processing system 1 is applied to the prototype vehicle production line. In the prototype vehicle production line, a trolley 100 for supplying parts to the prototype vehicle production line as shown in FIG. 1 is used. FIG. 1 is a diagram showing an example of the trolley 100 for supplying parts to the prototype vehicle production line according to the first embodiment. The trolley 100 can carry parts and can travel on the floor surface by being transported by a transporting operator. Also, in the prototype vehicle production line to which parts are supplied, one or a plurality of storage locations 200 (storage locations 200a to 200n) of the trolley 100 as shown in FIG. 2 are arranged. FIG. 2 is a diagram showing an example of the prototype vehicle production line according to the first embodiment and one or a plurality of storage locations 200 of the trolley 100. Each storage location 200 is also a place where an assembly operator takes out parts from the trolley 100 and assembles the parts to the body of the prototype vehicle.

[0013] In the information processing system 1, as shown in FIG. 1, an identification code (first identification code) C1 is attached to the ceiling of the trolley 100. The identification code C1 is a readable code such as a QR code (registered trademark), an AR code, or a barcode. The identification code C1 includes information on "the name of the storage location". The name of the storage location is the name of the storage location 200 that is the parts supply destination of the trolley 100 to which the identification code C1 is attached. Note that the identification code C1 may include information on the name of the vehicle to which the parts of the trolley 100 to which the identification code C1 is attached are to be assembled. On the other hand, as shown in FIG. 2, a different identification code (second identification code) C2 from the identification code C1 is attached to the floor surface of each storage location 200. The identification code C2 is a readable code such as a QR code (registered trademark), an AR code, or a barcode. The identification code C2 includes information on "the name of the storage location". The name of the storage location is the name of the storage location 200 to which the identification code C2 is attached.

[0014] Also, as shown in FIG. 3, the information processing system 1 includes a trolley supply device 10, a photographing device 20, a PDA device 30, and a production management device 40. FIG. 3 is a block diagram showing an example of the configuration of the information processing system 1 according to the first embodiment.

[0015] The cart supply device 10 is a device such as a server. The cart supply device 10 manages the supply of carts 100 to the storage area 200 of the prototype vehicle production line. The cart supply device 10 communicates wirelessly or by wire with the imaging device 20, the PDA device 30, and the production management device 40 via a network. The network includes the Internet, a local area network (LAN), a wide area network (WAN), and the like.

[0016] The imaging device 20 is a device that captures an image (hereinafter, a captured image) such as a camera. The image includes a still image or a plurality of time-series images (video). There is one or more imaging devices 20, and each is installed at each storage area 200 provided on the prototype vehicle production line shown in FIG. 2. The imaging device 20 is set to have an angle of view such that each storage area 200 can be imaged from the ceiling direction and an area within a predetermined range from each storage area 200 can be imaged. Note that the imaging device 20 may be installed so as to image a plurality of storage areas 200 with a single device.

[0017] The PDA device 30 is, for example, a dedicated terminal. There are one or more PDA devices 30, which are arranged at various locations on the prototype vehicle production line. The PDA device 30 acquires various instructions from the cart supply device 10 and transmits the instructions to each operator. The production management device 40 is a device such as a server. The production management device 40 manages the production plan of the prototype vehicle and supplies the production plan to the cart supply device 10.

[0018] Further, the cart supply device 10 of the information processing system 1 includes a cart transportation management unit 11 and a determination unit 12. The cart transportation management unit 11 acquires the production plan of the prototype vehicle from the production management device 40. The production plan of the prototype vehicle includes information such as the input time / completion scheduled time information, vehicle number information, and process information. The cart transportation management unit 11 performs transportation management of the cart 100 based on the production plan of the prototype vehicle and supplies a cart transportation instruction to the PDA device 30. The cart transportation instruction is an instruction for the transportation operator to transport the cart 100 to a predetermined storage location 200. The transportation management of the cart 100 includes management of the information of the storage location 200×process, management of the information of the cart 100×storage location 200, link management of the vehicle number×cart 100, and management of the production time×vehicle number.

[0019] The determination unit 12 acquires a photographed image of a predetermined storage location 200 from the photographing device 20. The determination unit 12 determines the state of the operation in which the operator takes out parts from the cart 100 based on the way the identification code C1 on the ceiling of the cart 100 and the identification code C2 on the floor of the storage location 200 appear in the photographed image.

[0020] Specifically, the determination unit 12 determines the state of the operation in which the operator takes out parts from the cart 100 according to the patterns (i) to (iV) shown in FIG. 4 and Table 1 below. FIG. 4 shows an example of a pattern for determining the state of the operation in which the operator takes out parts from the cart 100 in the information processing system 1 according to the first embodiment. Hereinafter, after the cart 100 is transported to the storage location 200, when the assembly operator completes the operation of taking out parts from the cart 100 at the storage location 200, the identification code C1 attached to the ceiling of the cart 100 is made invisible from the ceiling direction. For example, the assembly operator covers the identification code C1 with an empty box, uses a blindfold cover as the identification code C1, and so on.

[0021] (i) When the identification code C1 on the ceiling of the cart 100 appears in the photographed image and the identification code C2 on the floor of the storage location 200 does not appear, the determination unit 12 determines that the operation of the operator taking out parts from the cart 100 is incomplete. (ii) When neither the identification code C1 on the ceiling of the cart 100 nor the identification code C2 on the floor of the storage location 200 appears in the photographed image, the determination unit 12 determines that the operation of the operator taking out parts from the cart 100 is complete. (iii) When the identification code C1 of the ceiling of the cart 100 does not appear in the captured image and the identification code C2 of the floor of the storage area 200 appears in the captured image, the determination unit 12 determines that the cart 100 is waiting to be supplied to the storage area 200. (iV) When the identification code C1 of the cart 100 appears in the image and the identification code C2 of the storage area 200 changes from a situation where it did not appear within a predetermined time to a situation where it appears, the determination unit 12 determines whether the name of the storage area of the component supply destination included in the identification code C1 matches the name of the storage area included in the identification code C2, and determines whether the cart 100 has been transported to the correct storage area 200 based on the determination result.

[0022] Note that the cart transportation management unit 11 performs the following actions after determining the working state in the patterns (i) to (iV) shown in FIG. 4 and Table 1. (i) The cart transportation management unit 11 supplies a control instruction to the PDA device 30 and waits for the operator to wait for the next cart 100 to supply parts to the storage area 200. (ii) The cart transportation management unit 11 supplies a control instruction to the PDA device 30 and causes the operator to replace the cart 100. (iii) The cart transportation management unit 11 verifies the name of the storage area 200 when supplying the cart 100 to the storage area 200. (iV) When it is determined that the cart 100 has not been transported to the correct storage area 200, the cart transportation management unit 11 supplies a control instruction to the PDA device 30 and causes the operator to be notified that the cart 100 has not been transported to the correct storage area 200.

[0023]

Table 1

[0024] Subsequently, with reference to FIG. 5, the operation of the information processing system 1 according to the first embodiment will be described. FIG. 5 is a flowchart showing an example of the operation of the information processing system 1 according to the first embodiment.

[0025] As shown in FIG. 5, first, in step S101, the cart transportation management unit 11 of the cart supply device 10 of the information processing system 1 supplies a cart transportation instruction to the PDA device 30. Next, in step S102, after the transportation worker receives the cart transportation instruction on the PDA device 30, the worker transports the cart 100 loaded with parts to the vicinity of a predetermined storage location 200. At the storage location 200, the assembly worker is waiting for the supply of the cart 100.

[0026] Next, in step S103, the determination unit 12 determines whether or not the identification code C2 of the floor of the storage location 200 appears in the captured image captured by the imaging device 20 installed at the storage location 200. If it is determined that the identification code C2 of the floor of the storage location 200 does not appear in the captured image (NO in step S103), the process proceeds to step S104. If it is determined that the identification code C2 of the floor of the storage location 200 appears in the captured image (YES in step S103), the process proceeds to step S105.

[0027] In step S104, by supplying an instruction from the cart transportation management unit 11 to the PDA device 30, the assembly worker takes out the existing empty cart 100 at the storage location 200 and shows the identification code C2 of the floor of the storage location 200. Then, the process proceeds to step S105.

[0028] Next, in step S105, the determination unit 12 determines whether or not the name of the storage location included in the identification code C2 of the floor of the storage location 200 shown in the captured image matches the identification code C1 of the ceiling of the cart 100. If it is determined that the name of the storage location does not match (NO in step S105), the process proceeds to step S106. On the other hand, if it is determined that the name of the storage location matches (YES in step S105), the process proceeds to step S107.

[0029] In step S106, the cart transportation management unit 11 reconfirms the storage location 200 as the supply destination of the cart 100. Then, the process returns to step S102. In step S107, by supplying an instruction from the cart transportation management unit 11 to the PDA device 30, the transportation worker arranges the cart 100 at the storage location 200. Then, the process proceeds to step S108. In step S108, the cart transportation management unit 11 records the completion of the collection and replacement of the empty cart 100.

[0030] Next, in step S109, the determination unit 12 monitors the states of the identification code C1 on the ceiling of the cart 100 and the identification code C2 on the floor of the storage location 200 in the captured image. Here, when the assembly worker finishes the operation of taking out parts from the cart 100 at the storage location 200, the identification code C1 on the ceiling of the cart 100 is made invisible from the ceiling direction. Next, in step S110, the determination unit 12 determines whether the identification code C1 on the ceiling of the cart 100 appears in the captured image. If it is determined that the identification code C1 on the ceiling of the cart 100 appears in the captured image (YES in step S110), it is considered that the operation of the assembly worker taking out parts from the cart 100 is incomplete, and the process returns to step S109. On the other hand, if it is determined that the identification code C1 on the ceiling of the cart 100 does not appear in the captured image (NO in step S110), the process proceeds to step S111.

[0031] Next, in step S111, the determination unit 12 determines whether the identification code C2 on the floor of the storage location 200 appears in the captured image. If it is determined that the identification code C2 on the floor of the storage location 200 does not appear in the captured image (NO in step S111), the process proceeds to step S112. On the other hand, if it is determined that the identification code C2 on the floor of the storage location 200 appears in the captured image (YES in step S111), the process proceeds to step S113. In step S112, the determination unit 12 supplies an instruction to replace the cart 100 to the PDA device 30 on the assumption that the operation of the assembly worker taking out parts from the cart 100 is completed. By doing so, the transportation worker replaces the cart 100 with another cart 100. Then, the process proceeds to step S114.

[0032] In step S113, the determination unit 12 determines whether a carriage replacement instruction has been supplied. If it is determined that the carriage replacement instruction has not been supplied (NO in step S113), the process proceeds to step S114. On the other hand, if it is determined that the carriage replacement instruction has been supplied (YES in step S113), the process proceeds to step S115. In step S115, the determination unit 12 waits for the completion of the carriage replacement operation. Then, the process returns to step S109. In step S114, the determination unit 12 determines whether there is any remaining scheduled carriage replacement work for the day. If there is remaining scheduled carriage replacement work for the day (YES in step S114), the process returns to step S101. On the other hand, if there is no remaining scheduled carriage replacement work for the day (NO in step S114), the process ends.

[0033] The configuration and operation of the information processing system 1 according to the first embodiment have been described above. In the prototype vehicle production line to which the information processing system 1 according to the first embodiment is applied, in order to supply parts in a timely manner, it is necessary to grasp that the operation of taking out parts from the operator's carriage has been completed. The information processing system 1 determines whether the operation of taking out parts from the carriage 100 by the operator in the storage area 200 has been completed based on the appearance of the identification code C1 on the ceiling of the carriage 100 and the identification code C2 on the floor of the storage area 200 in the captured image taken in the storage area 200. That is, the information processing system 1 does not need to use means such as (1) the button-switch method or (2) the image determination method by AI. By doing so, the information processing system 1 can reduce the cost and man-hours when grasping that the operation of taking out parts from the carriage 100 by the operator has been completed, and can improve the accuracy.

[0034] Also, in the prototype production line, with the diversification of vehicle models, changes occur in the prototype line layout (that is, the allocation of processes and operations). The information processing system 1 can improve the degree of freedom of the layout by reducing the cost and man-hours when grasping that the operation of taking out parts has been completed and improving the accuracy.

[0035] Further, in the background art related to Patent Document 1, in order to determine the position of the mark attached to the self-propelled cart and the position of the mark attached to the floor, the current position of the self-propelled cart is known, but there is a problem that only the person in charge can determine whether the self-propelled cart is in the correct placement. The information processing system 1 automatically determines whether the name of the placement included in the identification code C1 on the ceiling of the cart 100 matches the name of the placement included in the identification code C2 on the floor of each placement 200. By doing so, the information processing system 1 can determine whether the cart 100 is in the correct placement.

[0036] Each component of the information processing system 1 in the above-described embodiment is configured by hardware or software, or both, and may be configured by one piece of hardware or software, or may be configured by a plurality of pieces of hardware or software. Specifically, each component of the cart supply device 10 in the above-described embodiment is configured by a computer including a processor and a memory. The processor may be, for example, a microprocessor, an MPU (Micro Processing Unit), or a CPU (Central Processing Unit). The processor may include a plurality of processors. The memory is configured by a combination of a volatile memory and a non-volatile memory. The memory may include a storage arranged separately from the processor. In this case, the processor may access the memory via an I / O interface (not shown). The processor executes one or a plurality of programs including an instruction group for causing the computer to perform the algorithms described with reference to the drawings.

[0037] When the program is loaded into a computer, it includes a set of instructions (or software code) for causing the computer to perform one or more of the functions described in the embodiments. The program may be stored in a non-transitory computer-readable medium or a tangible storage medium. By way of example and not limitation, the computer-readable medium or tangible storage medium includes random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD), or other memory technologies, CD-ROM, digital versatile disc (DVD), Blu-ray (registered trademark) disc, or other optical disc storage, magnetic cassette, magnetic tape, magnetic disk storage, or other magnetic storage devices. The program may be transmitted on a transitory computer-readable medium or a communication medium. By way of example and not limitation, the transitory computer-readable medium or communication medium includes electrical, optical, acoustic, or other forms of propagated signals.

[0038] Note that the present invention is not limited to the above-described embodiments, and can be appropriately modified without departing from the spirit thereof. The operations performed by workers such as carriers and assemblers in the above embodiments may be executed by a robot such as an autonomous mobile robot (AMR). In that case, the above-mentioned "worker" is read as "robot". For example, in the above embodiment, after the cart 100 is transported to the storage area 200, when the assembler finishes the operation of taking out parts from the cart 100 in the storage area 200, the identification code C1 attached to the ceiling of the cart 100 is made invisible from the ceiling direction. In other embodiments, the robot may perform the operation of making the identification code C1 of the assembler invisible. Further, in other embodiments, the cart 100 may be a self-propelled cart 100 that is controlled by the cart supply device 10 or the like and travels autonomously.

Explanation of Reference Numerals

[0039] 1 Information processing system, 10 Cart supply device, 11 Cart transportation management unit, 12 Judgment unit, 20 Photographing device (photographing unit), 30 PDA device, 40 Production management device, 100 Carts, 200 Storage locations

Claims

1. A cart for supplying parts to a production line, with a first identification code attached to the ceiling, A storage location for the cart on the production line, with a second identification code different from the first identification code attached to the floor surface, An imaging unit that captures an image within a predetermined range from the storage location in the direction of the ceiling, A determination unit that determines whether the operation of removing parts from the cart by an operator at the storage location is completed based on the appearance of the first identification code and the second identification code in the captured image. The information processing system includes: An information processing system.

2. When the operator removes parts from the cart, the first identification code is hidden so as not to be visible from the ceiling direction. The determination unit: When the first identification code appears in the captured image but the second identification code does not appear, determines that the operation of removing parts by the operator at the storage location is incomplete. When neither the first identification code nor the second identification code appears in the captured image, determines that the operation of removing parts by the operator at the storage location is completed. When the first identification code does not appear in the captured image but the second identification code appears, determines that the cart is waiting to be supplied. The information processing system according to claim 1.

3. The first identification code includes the name of the storage location of the parts supply destination of the cart to which the first identification code is attached. The second identification code includes the name of the storage location to which the second identification code is attached. The determination unit: When the first identification code appears in the captured image and the second identification code changes from a situation where it does not appear within a predetermined time to a situation where it appears, determines whether the name of the storage location of the parts supply destination included in the first identification code matches the name of the storage location included in the second identification code, and determines whether the cart has been transported to the correct storage location based on the determination result. The information processing system according to claim 1 or 2.

4. The production line is a production line for prototype vehicles. The information processing system according to claim 1.

5. A cart for supplying parts to a production line, with a first identification code attached to the ceiling, and a storage location for the cart on the production line, with a second identification code different from the first identification code attached to the floor surface. A computer: Captures an image within a predetermined range from the storage location in the direction of the ceiling. ​ ​ ​ ​ ​ ​ ​ ​ ​ Based on the way the first identification code and the second identification code appear in the captured image, determine whether the operation of taking out parts from the cart by the operator in the storage location has been completed. An information processing method.

Images