Information processing system and information processing method

Abstract

To provide an information processing system and an information processing method which can reduce cost and man-hour to grasp completion of a taking-out work of an operator taking out components from a truck and improve correctness.SOLUTION: An information processing system 1 comprises: a truck whose roof includes a first identification code to supply a production line with components; and a truck storage space in the production line with a second identification code different from the first identification code on a floor. An imaging part 20 of the information processing system 1 images an image within a specified range of the truck storage space in a ceiling direction. A determination part 12 determines whether an operator completes a taking-out work taking out components from the truck or not in the truck storage space based on the first identification code and the second identification code of the imaged image.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to an information processing system and an information processing method. [Background Art]

[0002] In the technology of Patent Document 1, a progress observation mark is attached to a self-propelled carriage carrying a product that travels on the floor in a fixed direction at a fixed speed, and progress confirmation marks are attached to the floor surface at equal intervals in a fixed direction so as to correspond to positions where parts to be installed on the product are located. Then, in the technology of Patent Document 1, a person in charge grasps the work status on a mixed-flow production line from the positional relationship between the progress confirmation mark and the progress observation mark, that is, the current position of the self-propelled carriage. [Prior Art Literature] [Patent Literature]

[0003] [Patent Document 1] Japanese Unexamined Patent Application Publication No. 2003-001533 [Summary of the Invention] [Problem to be Solved by the Invention]

[0004] For supplying parts to a production line for prototype vehicles and the like, parts are set on a dedicated carriage for supply, and an operator takes out necessary parts from the carriage each time and assembles them to a vehicle body. In order to supply parts in a timely manner, it is necessary to grasp that the work of taking out parts from the carriage by the operator has been completed.

[0005] In the background technology described in Patent Document 1, the system detected when the worker had finished removing parts from the cart, for example, by (1) a button / switch method or (2) an AI-based image recognition method. In (1) the button / switch method, completion of the work is detected when the worker operates the equipment after the parts have been removed. In (2) the AI-based image recognition method, completion of the work is detected by the worker's actions. However, in (1) the button / switch method, if the button / switch is wired, relocating the equipment requires cost and time. Also, if the button / switch is wireless, there is the problem of needing periodic battery replacement, etc. Furthermore, in (2) the AI-based image recognition method, there is the problem that it is difficult to determine when the work is complete, and the cost and time required to improve accuracy are enormous. In other words, the technology described in Patent Document 1 had problems with cost, man-hours, and accuracy when it came to understanding the status of the work of removing parts from the cart.

[0006] This disclosure aims to provide an information processing system and information processing method that can reduce the cost and man-hours and improve accuracy in determining when an operator has completed the task of removing parts from a trolley, in light of such challenges. [Means for solving the problem]

[0007] The information processing system disclosed herein includes a trolley for supplying parts to a production line, having a first identification code attached to the ceiling; a storage area for the trolley on the production line, having a second identification code different from the first identification code attached to the floor; a shooting unit that captures images from the ceiling direction within a predetermined range from the storage area; and based on how the first identification code and the second identification code appear in the captured images, The aforementioned The system includes a determination unit that determines whether or not the worker has completed the task of removing the parts from the trolley in the storage area.

[0008] The information processing method disclosed herein is: A trolley for supplying parts to the production line, with a first identification code attached to the ceiling, The production line includes a storage area for the trolley, on which a second identification code different from the first identification code is attached to the floor surface, Computers Images within a predetermined range from the aforementioned storage area are taken from the ceiling direction. Based on how the first identification code and the second identification code appear in the captured image, it is determined whether or not the worker in the storage area has completed the task of removing the parts from the trolley. [Effects of the Invention]

[0009] This disclosure provides an information processing system and information processing method that can reduce the cost and man-hours and improve accuracy when determining when a worker has completed the task of removing parts from a trolley. [Brief explanation of the drawing]

[0010] [Figure 1] This figure shows an example of a trolley for supplying parts to a prototype vehicle production line according to the first embodiment. [Figure 2] This figure shows an example of a prototype vehicle production line and one or more storage areas for trolleys according to the first embodiment. [Figure 3] This is a block diagram showing an example of the configuration of an information processing system according to the first embodiment. [Figure 4] An example of a pattern for determining the status of the operation in which an operator removes parts from a cart in the information processing system 1 according to the first embodiment is shown. [Figure 5] This flowchart shows an example of the operation of the information processing system according to the first embodiment. [Modes for carrying out the invention]

[0011] (First Embodiment) First, the configuration of the information processing system 1 according to the first embodiment will be explained using Figures 1 to 4.

[0012] Information processing system 1 is applied to a prototype vehicle production line. In this prototype vehicle production line, a trolley 100 is used to supply parts to the prototype vehicle production line, as shown in Figure 1. Figure 1 is a diagram showing an example of a trolley 100 for supplying parts to a prototype vehicle production line according to the first embodiment. The trolley 100 is capable of loading parts and can travel on the floor by being carried by a transport worker. In addition, one or more storage areas 200 (storage areas 200a to 200n) for the trolley 100 are arranged in the prototype vehicle production line to which the parts are supplied, as shown in Figure 2. Figure 2 is a diagram showing an example of a prototype vehicle production line and one or more storage areas 200 for the trolley 100 according to the first embodiment. Each storage area 200 is also a place where assembly workers take parts from the trolley 100 and assemble the parts to the body of the prototype vehicle.

[0013] In the information processing system 1, as shown in Figure 1, the trolley 100 has an identification code (first identification code) C1 attached to its ceiling. Identification code C1 is a readable code such as a QR code (registered trademark), AR code, or barcode. Identification code C1 includes information about the "name of the storage area." The name of the storage area is the name of the storage area 200 to which the trolley 100 with identification code C1 is supplied with parts. Identification code C1 may also include information about the name of the vehicle to which the parts of the trolley 100 with identification code C1 are assembled. On the other hand, as shown in Figure 2, each storage area 200 has an identification code (second identification code) C2 attached to its floor, which is different from identification code C1. Identification code C2 is a readable code such as a QR code (registered trademark), AR code, or barcode. Identification code C2 includes information about the "name of the storage area." The name of the storage area is the name of the storage area 200 to which identification code C2 is attached.

[0014] Furthermore, as shown in Figure 3, the information processing system 1 includes a trolley supply device 10, a camera 20, a PDA device 30, and a production management device 40. Figure 3 is a block diagram showing an example of the configuration of the information processing system 1 according to the first embodiment.

[0015] The cart supply device 10 is, for example, a device such as a server. The cart supply device 10 manages the supply of carts 100 to the storage area 200 of the prototype vehicle production line. The cart supply device 10 communicates with the imaging device 20, the PDA device 30, and the production control device 40 wirelessly or by wire via a network. The network includes the Internet, a local area network (LAN), a wide area network (WAN), and the like.

[0016] The imaging device 20 is a device that captures an image (hereinafter referred to as a captured image) such as a camera. The image includes still images and a plurality of time-series images (moving images). One or a plurality of imaging devices 20 are provided, and each is installed in each storage area 200 provided on the prototype vehicle production line shown in FIG. 2. The angle of view of the imaging device 20 is set so that each storage area 200 can be imaged from the ceiling direction, and the area within a predetermined range from each storage area 200 can be imaged. Note that the imaging device 20 may be installed as a single device to image a plurality of storage areas 200.

[0017] The PDA device 30 is, for example, a dedicated terminal. One or a plurality of PDA devices 30 are provided and arranged at various locations on the prototype vehicle production line. The PDA device 30 acquires various instructions from the cart supply device 10 and transmits the instructions to each worker. The production control device 40 is, for example, a device such as a server. The production control device 40 manages the production plan for the prototype vehicle and supplies the production plan to the cart supply device 10.

[0018] In addition, the cart supply device 10 of the information processing system 1 includes a cart transportation management unit 11 and a determination unit 12. The carriage conveyance management unit 11 acquires a production plan for a prototype vehicle from the production control device 40. The production plan for a prototype vehicle includes input time / scheduled completion time information, vehicle number information, and process information. The carriage conveyance management unit 11 performs conveyance management of the carriage 100 based on the production plan for the prototype vehicle, and supplies a carriage conveyance instruction to the PDA device 30. The carriage conveyance instruction is an instruction for causing a conveyance worker to convey the carriage 100 to a predetermined storage location 200. The conveyance management of the carriage 100 includes management of storage location 200×process information, management of carriage 100×storage location 200 information, association management of vehicle number×carriage 100, and management of production time×vehicle number.

[0019] The determination unit 12 acquires a captured image of the predetermined storage location 200 from the imaging device 20. The determination unit 12 determines the state of a work in which a worker at the storage location 200 takes out components from the carriage 100 based on how the identification code C1 on the ceiling of the carriage 100 and the identification code C2 on the floor surface of the storage location 200 appear in the captured image.

[0020] Specifically, the determination unit 12 determines the state of the work in which the worker takes out components from the carriage 100 according to the patterns (i) to (iV) shown in the following Fig. 4 and Table 1. Fig. 4 shows an example of a pattern for determining the state of the work in which the worker takes out components from the carriage 100 in the information processing system 1 according to the first embodiment. Hereinafter, after the carriage 100 is conveyed to the storage location 200, an assembly worker makes the identification code C1 attached to the ceiling of the carriage 100 invisible from the ceiling direction when completing the work of taking out components from the carriage 100 at the storage location 200. For example, the assembly worker covers the identification code C1 with an empty box, or puts a blindfold cover over the identification code C1.

[0021] (i) The determination unit 12 determines that the worker's work of taking out components from the carriage 100 is not completed when the identification code C1 on the ceiling of the carriage 100 is captured in the captured image but the identification code C2 on the floor surface of the storage location 200 is not captured. (ii) The determination unit 12 determines that the worker's work of taking out components from the carriage 100 is completed when neither the identification code C1 on the ceiling of the carriage 100 nor the identification code C2 on the floor surface of the storage location 200 is captured in the captured image. (iii) The determination unit 12 determines that the trolley 100 is waiting to be supplied to the storage area 200 if the identification code C1 on the ceiling of the trolley 100 is not visible in the captured image, but the identification code C2 on the floor of the storage area 200 is visible. (iV) The determination unit 12, when the situation changes in the captured image from when the identification code C1 of the trolley 100 is visible and the identification code C2 of the storage area 200 is not visible within a predetermined time, determines whether the name of the storage area of ​​the parts supplier included in the identification code C1 matches the name of the storage area included in the identification code C2, and determines whether the trolley 100 has been transported to the correct storage area 200 based on the determination result.

[0022] Furthermore, the trolley transport management unit 11 performs the following actions after determining the status of the work, in the patterns (i) to (iV) shown in Figure 4 and Table 1. (i) The trolley transport management unit 11 supplies control instructions to the PDA device 30, causing the worker to wait for the next trolley 100 to supply parts to the storage area 200. (ii) The trolley transport management unit 11 supplies control instructions to the PDA device 30, causing the worker to replace the trolley 100. (iii) The trolley transport management unit 11 verifies the name of the storage area 200 when supplying the trolley 100 to the storage area 200. (iV) If the trolley transport management unit 11 determines that the trolley 100 has not been transported to the correct storage area 200, it supplies a control instruction to the PDA device 30 to notify the worker that the trolley 100 has not been transported to the correct storage area 200.

[0023] [Table 1]

[0024] Next, the operation of the information processing system 1 according to the first embodiment will be explained using Figure 5. Figure 5 is a flowchart showing an example of the operation of the information processing system 1 according to the first embodiment.

[0025] As shown in Figure 5, first, in step S101, the trolley transport management unit 11 of the trolley supply device 10 of the information processing system 1 supplies a trolley transport instruction to the PDA device 30. Next, in step S102, the transport worker receives a trolley transport instruction on the PDA device 30 and then transports the trolley 100 loaded with parts to the vicinity of the designated storage area 200. At the storage area 200, the assembly worker is waiting for the trolley 100 to be supplied.

[0026] Next, in step S103, the determination unit 12 determines whether or not the identification code C2 of the floor surface of the storage area 200 is visible in the image captured by the imaging device 20 installed in the storage area 200. If it is determined that the identification code C2 of the floor surface of the storage area 200 is not visible in the image (NO in step S103), the process proceeds to step S104. If it is determined that the identification code C2 of the floor surface of the storage area 200 is visible in the image (YES in step S103), the process proceeds to step S105.

[0027] In step S104, the trolley transport management unit 11 supplies instructions to the PDA device 30, causing the assembly worker to retrieve an existing empty trolley 100 from the storage area 200 and show the identification code C2 on the floor of the storage area 200. Then, the process proceeds to step S105.

[0028] Next, in step S105, the determination unit 12 determines whether the names of the storage areas included in the identification code C2 of the floor surface of the storage area 200 and the identification code C1 of the ceiling of the trolley 100, as captured in the image, match. If it is determined that the names of the storage areas do not match (NO in step S105), the process proceeds to step S106. On the other hand, if it is determined that the names of the storage areas do match (YES in step S105), the process proceeds to step S107.

[0029] In step S106, the trolley transport management unit 11 reconfirms the destination storage location 200 for the trolley 100. Then, the process returns to step S102. In step S107, the transport worker places the trolley 100 in the storage area 200 by supplying instructions from the trolley transport management unit 11 to the PDA device 30. Then the process proceeds to step S108. In step S108, the trolley transport management unit 11 records the completion of the collection and replacement of the empty trolley 100.

[0030] Next, in step S109, the determination unit 12 monitors the status of the identification code C1 on the ceiling of the trolley 100 and the identification code C2 on the floor of the storage area 200 in the captured image. Here, the assembly worker makes sure that the identification code C1 on the ceiling of the trolley 100 is not visible from the ceiling when the work of removing parts from the trolley 100 in the storage area 200 is completed. Next, in step S110, the determination unit 12 determines whether or not the identification code C1 of the trolley 100 ceiling is visible in the captured image. If it is determined that the identification code C1 of the trolley 100 ceiling is visible in the captured image (YES in step S110), the assembly worker's task of removing parts from the trolley 100 is considered incomplete, and the process returns to step S109. On the other hand, if it is determined that the identification code C1 of the trolley 100 ceiling is not visible in the captured image (NO in step S110), the process proceeds to step S111.

[0031] Next, in step S111, the determination unit 12 determines whether or not the identification code C2 of the floor surface of the storage area 200 is visible in the captured image. If it is determined that the identification code C2 of the floor surface of the storage area 200 is not visible in the captured image (NO in step S111), the process proceeds to step S112. On the other hand, if it is determined that the identification code C2 of the floor surface of the storage area 200 is visible in the captured image (YES in step S111), the process proceeds to step S113. In step S112, the determination unit 12 determines that the assembly worker has completed the task of removing parts from the cart 100 and supplies a cart replacement instruction to the PDA device 30. As a result, the transport worker replaces cart 100 with another cart 100. Then the process proceeds to step S114.

[0032] In step S113, the determination unit 12 determines whether or not a bogie swap instruction has been issued. If it is determined that a bogie swap instruction has not been issued (NO in step S113), the process proceeds to step S114. On the other hand, if it is determined that a bogie swap instruction has been issued (YES in step S113), the process proceeds to step S115. In step S115, the determination unit 12 waits for the completion of the trolley replacement operation. Then, the process returns to step S109. In step S114, the determination unit 12 determines whether there are any remaining scheduled trolley replacement operations for the day. If there are remaining scheduled trolley replacement operations for the day (YES in step S114), the process returns to step S101. On the other hand, if there are no remaining scheduled trolley replacement operations for the day (NO in step S114), the process ends.

[0033] The configuration and operation of the information processing system 1 according to the first embodiment have been described above. In a prototype vehicle production line to which the information processing system 1 according to the first embodiment is applied, it is necessary to know when the worker has finished removing parts from the cart in order to supply parts in a timely manner. The information processing system 1 determines whether or not the worker has finished removing parts from the cart 100 in the storage area 200 based on how the identification code C1 on the ceiling of the cart 100 and the identification code C2 on the floor of the storage area 200 are captured in the image taken in the storage area 200. In other words, the information processing system 1 does not need to use means such as (1) a button / switch method or (2) an AI-based image judgment method. By doing so, the information processing system 1 can reduce the cost and man-hours required to know when the worker has finished removing parts from the cart 100, and improve accuracy.

[0034] Furthermore, in prototype production lines, changes to the prototype line layout (i.e., the allocation of processes and tasks) occur as vehicle diversification progresses. Information processing system 1 can improve the flexibility of the layout by reducing the cost and man-hours required to recognize when a part removal operation is complete and by improving accuracy.

[0035] Furthermore, in the background technology described in Patent Document 1, while the current position of the self-propelled trolley can be determined by comparing the position of the mark on the self-propelled trolley with the position of the mark on the floor, there was a problem in that only the person in charge could determine whether the self-propelled trolley was in the correct location. The information processing system 1 automatically determines whether the name of the location included in the identification code C1 on the ceiling of the trolley 100 matches the name of the location included in the identification code C2 on the floor surface of each location 200. By doing so, the information processing system 1 can determine whether the trolley 100 is in the correct location.

[0036] Each component of the information processing system 1 in the above-described embodiment is composed of hardware, software, or both, and may consist of one piece of hardware or software, or multiple pieces of hardware or software. Specifically, each component of the trolley supply device 10 in the above-described embodiment is composed of a computer comprising a processor and memory. The processor may be, for example, a microprocessor, an MPU (Micro Processing Unit), or a CPU (Central Processing Unit). The processor may include multiple processors. The memory is composed of a combination of volatile memory and non-volatile memory. The memory may include storage located away from the processor. In this case, the processor may access the memory via an I / O interface not shown. The processor executes one or more programs, which include a set of instructions for causing the computer to perform the algorithm described with reference to the drawings.

[0037] The program, when loaded into a computer, includes a set of instructions (or software code) for causing the computer to perform one or more of the functions described in the embodiments. The program may be stored on a non-temporary computer-readable medium or a physical storage medium. Examples, but not limited to, include random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technologies, CD-ROM, digital versatile disc (DVD), Blu-ray® disc or other optical disc storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage devices. The program may be transmitted over a temporary computer-readable medium or a communication medium. Examples, but not limited to, include temporary computer-readable medium or a communication medium that includes electrically, optically, acoustically or otherwise propagating signals.

[0038] It should be noted that the present invention is not limited to the embodiments described above, and can be modified as appropriate without departing from the spirit of the invention. In the above embodiment, the actions performed by workers such as transporters and assembly workers may be performed by robots such as automated guided vehicles (AMRs). In that case, "workers" should be read as "robots." For example, in the above embodiment, after the trolley 100 is transported to the storage area 200, the assembly worker, upon completion of the task of removing parts from the trolley 100 in the storage area 200, makes the identification code C1 attached to the ceiling of the trolley 100 invisible from the ceiling. In another embodiment, the robot may perform the action of making the assembly worker's identification code C1 invisible. In yet another embodiment, the trolley 100 may be a self-propelled trolley 100 that moves under the control of a trolley supply device 10 or the like. [Explanation of Symbols]

[0039] 1 Information processing system, 10 Trolley supply device, 11 Trolley transport management unit, 12 Judgment unit, 20 Imaging device (imaging unit), 30 PDA device, 40 Production management device, 100 Trolleys, 200 Storage area

Claims

1. A trolley for supplying parts to the production line, with a first identification code attached to the ceiling, A second identification code, different from the first identification code, is attached to the floor surface of the trolley storage area in the production line, A camera unit that photographs a predetermined area from the storage area from the ceiling direction, The system includes a determination unit that determines whether or not the work of removing parts from the trolley by a worker in the storage area has been completed, based on whether or not the first identification code and the second identification code are visible in the image captured by the imaging unit. Information processing system.

2. The first identification code is hidden so that it is not visible from the ceiling when the worker removes the part from the trolley. The determination unit, If the first identification code is visible in the aforementioned captured image but the second identification code is not, it is determined that the worker's work of retrieving the parts in the storage area is incomplete. If neither the first identification code nor the second identification code is visible in the captured image, it is determined that the worker has completed the task of removing the parts in the storage area. If the first identification code is not visible in the captured image but the second identification code is visible, it is determined that the trolley is awaiting supply. The information processing system according to claim 1.

3. The first identification code includes the name of the storage location of the parts supplier for the trolley to which the first identification code is attached. The second identification code includes the name of the storage location to which the second identification code is attached. The determination unit, If the captured image shows the first identification code, and the situation changes within a predetermined time to show the second identification code, it is determined whether the name of the storage location of the parts supplier included in the first identification code matches the name of the storage location included in the second identification code, and based on the result of this determination, it is determined whether the trolley was transported to the correct storage location. The information processing system according to claim 1 or 2.

4. The information processing system according to claim 1, wherein the production line is a production line for prototype vehicles.

5. A trolley for supplying parts to the production line, with a first identification code attached to the ceiling, The production line includes a place for the trolley, on the floor surface, where a second identification code different from the first identification code is attached, Computers Images within a predetermined range from the aforementioned storage area are taken from the ceiling direction. Based on whether the first identification code and the second identification code are visible in the captured image, it is determined whether the worker in the storage area has completed the task of removing the parts from the trolley. Information processing methods.

Images