Processing device, processing method, and processing system

Abstract

To provide a technique capable of acquiring start and completion information corresponding to work that includes various movements of an operator and movement of work locations and preventing failure to detect start and completion or occurrence of multiple detection.SOLUTION: A processor which detects start and completion of a series of production operations forming production processes includes: a plurality of recognition parts which recognize a state of a detection target from sensing data inputted from an outside; and a control part which receives the state of the detection target from the plurality of recognition parts, determines start and completion, and outputs determined start and completion information as start information and completion information. The plurality of recognition parts are configured to include at least two of: an operation recognition part which outputs an operation state of an operator; a tool recognition part which outputs a work state of a tool; a facility recognition part which outputs a work state of a facility; and a component recognition part which outputs a stock state of components.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to a processing device, a processing method, and a processing system for managing the progress of a product production process. [Background technology]

[0002] In production lines in the production process, it is desirable for production to proceed according to schedule, but this does not always happen. If the actual production process deviates from the schedule, it is desirable to quickly reschedule, but it is not easy to quickly recognize whether the schedule has deviated, and there are also issues such as workers forgetting to enter information manually.

[0003] A prior art document in this technical field is Patent Document 1. Patent Document 1 discloses a process control device that includes a detection unit that detects when an object to be processed enters a predetermined range near equipment where a process is carried out, a process start determination unit that sets the time when the detection unit detects that the object to be processed has entered the predetermined range as the process start time, and a process completion determination unit that sets the time when the detection unit detects that the object to be processed has left the predetermined range as the process completion time. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent Publication No. 2021-189607 Summary of the Invention [Problem to be solved by the invention]

[0005] In Patent Document 1, the start and end times of work can be determined without the need for input processing by a person such as a process manager, thereby preventing inability to determine the start and end times due to input omissions, etc. However, the technology described in Patent Document 1 detects whether a worker has arrived or finished work using a single trigger, such as input and output within a specified range, so there is room for improvement in accuracy. In other words, it does not take into consideration the acquisition of arrival and completion information for work that includes various worker actions or corresponds to changes in work location. Furthermore, it does not take into consideration the possibility of missed or multiple detections of arrival and completion due to errors such as multiple counts or missed counts.

[0006] In view of the above-mentioned problems, the object of the present invention is to provide a processing device, processing method, and processing system that can acquire arrival / completion information corresponding to work that includes various actions of workers and movements of work locations, and that can prevent missed arrival / completion detections and multiple detections. [Means for solving the problem]

[0007] To give one example, the present invention is a processing device that detects the start and completion of a series of production tasks that make up a production process, and is equipped with multiple recognition units that recognize the state of the detection object from sensing data input from the outside, and a control unit that receives the state of the detection object from the multiple recognition units, determines whether it has arrived or not, and outputs the determined arrival / completion information as arrival information and completion information, and the multiple recognition units are configured to include at least two of a work recognition unit that outputs the work state of a worker, a tool recognition unit that outputs the operating state of a tool, an equipment recognition unit that outputs the operating state of equipment, and a parts recognition unit that outputs the inventory status of parts. [Effects of the Invention]

[0008] According to the present invention, it is possible to provide a processing device, processing method, and processing system that can obtain arrival / completion information corresponding to work that includes various actions of workers and movements of work locations, and that can prevent missed arrival / completion detection and multiple detections. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a configuration block diagram of a process control device according to a first embodiment. [Figure 2] 1 is a detailed configuration block diagram of a process control device in Example 1, and a configuration block diagram of a processing system showing a detection unit and a detection target outside the process control device, a distributed control system, and other process control devices. FIG. [Figure 3] 3 is a schematic diagram showing a timing chart of arrival / completion information obtained from each recognition unit of the process control device in Example 1. FIG. [Figure 4] 10 is a flowchart showing a process for determining whether a finish has been completed in the first embodiment. [Figure 5] 10 is a detailed flowchart of a complementation process according to the first embodiment. [Figure 6] 10 is a detailed flowchart of a correction process in the first embodiment. [Figure 7] 10 is a timing chart for determining that the incoming call information is the first incoming call information in the first embodiment. [Figure 8] 10 is a timing chart for determining that the incoming call information is the first incoming call information in the first embodiment. [Figure 9] 10 is a timing chart for determining that the incoming call information is the second incoming call information in the first embodiment. [Figure 10] 10 is a timing chart for determining that the incoming call information is the second incoming call information in the first embodiment. [Figure 11] 10 is a timing chart for determining that the incoming call information is the third incoming call in the first embodiment. [Figure 12] 10 is a timing chart showing a case where the third incoming call information cannot be determined in the first embodiment. [Figure 13] 10 is a timing chart for determining two sets of incoming call information and completion information in the first embodiment. [Figure 14] 10 is a timing chart for determining two sets of incoming call information and completion information in the first embodiment. [Figure 15] 10 is a timing chart for determining two sets of incoming call information and completion information in the first embodiment. [Figure 16]10 is a timing chart showing an assumed range for receiving a second recognition result in the first embodiment. [Figure 17] 10 is a timing chart showing the result of determining whether arrival is complete when the first arrival information is received in the first embodiment. [Figure 18] 10 is a timing chart showing the result of arrival completion determination when two pieces of arrival information are received in the first embodiment. [Figure 19] 10 is a timing chart showing the result of arrival completion determination when two pieces of arrival information are received in the first embodiment. [Figure 20] 10 is a timing chart showing the result of determining whether or not a call has been received when one piece of arrival information and one piece of completion information are received in the first embodiment. [Figure 21] 10 is a timing chart showing the result of determining whether or not a call has been received when one piece of arrival information and one piece of completion information are received in the first embodiment. [Figure 22] 10 is a timing chart showing the result of determining whether or not a call has been received when one piece of arrival information is received but the second piece of arrival information is not received within the expected range in the first embodiment. [Figure 23] This is a timing chart showing the results of determining whether a delivery is complete when one arrival information and one completion information are received in Example 1 and the completion information is received outside the second expected range. [Figure 24] 10 is a timing chart showing the result of determining whether or not a call has arrived when two pieces of arrival information are received and the second piece of arrival information is received outside the second expected range in Example 1. [Figure 25] 10 is a timing chart showing the result of determining whether a call has arrived when two pieces of arrival information are received and the second piece of arrival information is received within the expected range of the third piece of arrival information in Example 1. [Figure 26] 10 is a timing chart showing the result of determining whether or not a delivery has been completed when one piece of arrival information is received and the third piece of arrival information is not received within the expected range in the first embodiment. [Figure 27] This is a timing chart showing the results of determining whether a delivery is complete when one arrival information and one completion information are received in Example 1 and the third completion information is received outside the expected range. [Figure 28] 10 is a timing chart showing a determination by interpolation from the time at the center of the assumed range in the first embodiment. [Figure 29] 10 is a timing chart showing an interpolation determination from a time going back a certain time in the first embodiment. [Figure 30] 10 is a timing chart showing interpolation determination from a time shifted later by a certain time in the first embodiment. [Figure 31] 10 is a timing chart for determining by interpolation from a ratio based on the central time of three consecutive assumed ranges in the first embodiment. [Figure 32] 10 is a timing chart of an extraction process that employs the first received time in the first embodiment. [Figure 33] 10 is a timing chart of an extraction process that employs an average time of two pieces of incoming call information in the first embodiment. [Figure 34] 10 is a timing chart of an extraction process for determining the time to adopt two pieces of incoming call information in consideration of their levels in the first embodiment. [Figure 35] 10 is a timing chart of an extraction process that employs the last received time in the first embodiment. [Figure 36] 10 is a flowchart showing a process for determining whether a parcel has arrived at its destination in a modified example of the first embodiment. [Figure 37] FIG. 10 is a configuration block diagram of a process control device according to a second embodiment. [Figure 38] 10 is a detailed configuration block diagram of a process control device in Example 2, and a configuration block diagram of a processing system showing a detection unit and a detection target outside the process control device, a distributed control system, and other process control devices. FIG. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, an embodiment will be described with reference to the drawings. [Example]

[0011] 1 is a block diagram of a process control device, which is a processing device for controlling the progress of a product production process in this embodiment. In FIG. 1, the process control device 10 is composed of recognition units 100 and 101, a control unit 120, a UI (User Interface) unit 102, and an IF (Interface) unit 103.

[0012] The recognition units 100 and 101 recognize multiple pieces of recognition information from externally input sensing data, and the control unit 120 compares the arrival / completion determination information stored internally with the recognition information input from the recognition units 100 and 101 to determine whether the item has arrived or not. The UI unit 102 displays the arrival / completion information determined by the control unit 120. The IF unit 103 outputs the arrival / completion information determined by the control unit 120. Here, arrival / completion refers to the start and completion of a series of production tasks that make up the production process. In terms of hardware, the recognition unit and control unit are composed of a CPU and a storage unit, which are general information processing units, and are realized by software processing as the CPU interprets and executes operating programs that realize their respective functions.

[0013] 2 is a detailed configuration block diagram of the process control device in this embodiment, and a configuration block diagram of a process control system that is a processing system showing a detection unit and detection target external to the process control device, a distributed control system, and other process control devices. In FIG. 2, the process control device 10 comprises a task recognition unit 130, a tool recognition unit 140, an equipment recognition unit 150, a part recognition unit 160, a control unit 120 having a completion / completion determination unit 121 and a clock unit 122, a display unit 180, and a communication unit 190.

[0014] By determining arrival information and completion information from work information, worker status, worker location, work team allocation, tool information, operation information, equipment information, equipment operation information, parts information, and parts inventory information, the effects described below can be obtained simultaneously.

[0015] The work recognition unit 130 receives work information, status information, and team structure information input from the outside, and recognizes the work, status, and progress from the received information. but , is information generated based on work information detected from the worker 5, worker status, worker location, and work team allocation.

[0016] For example, the work information of a worker is work actions such as production work on a production line or cell production site, assembling parts, operating manufacturing equipment, etc. Work actions include movement actions by a worker arriving at or leaving an operating position or a predetermined position, pointing and inspection actions, equipment inspection actions, and warm-up exercises such as standing in a circle or stretching that are required to be performed at the start or end of work, transport actions by a worker carrying parts in a case or carrier, actions of removing parts from a parts shelf or tray, actions of assembling parts by pressing them together, actions of grasping and assembling parts in a predetermined position, actions of pressing, pulling, turning, tilting, grasping, releasing, and placing switches on production equipment or tools, actions of stepping on a foot switch, actions of touching a tablet device or touch panel display with a finger or actions of making touch gestures, actions of operating a keyboard or mouse on a terminal console or edge server, actions of operating a wearable device such as a wristwatch device, or a portable device such as a smartphone or remote control switch, etc.

[0017] The work movements of these workers can be obtained by detecting using sensing means the spatial coordinates and planar coordinates of the worker's head and torso, the relative positions and angles of body parts such as arms, hands and feet, and basic elemental movements (kinetic elements), postures and actions such as standing, sitting, bending, crouching, stretching hands, raising hands, waving hands, pointing, raising feet, spreading legs, walking, running, stopping, pushing, holding, releasing, pulling, turning, kicking, hitting, pulling, pushing, supporting and gathering.

[0018] These sensing methods include recognition methods using image recognition engines that estimate a person's posture and movements from images taken with visible image cameras or infrared cameras using RGB sensors, such as surveillance cameras or head-mounted cameras; posture and movement recognition methods using ranging devices such as LIDAR (Light Detection and Ranging) or TOF (Time of Flight) sensors that can measure a worker's external shape and posture as a 3D shape; wearable devices such as clothing-type sensors and wristwatch-type sensors that detect the shape of clothing, the angle of bending, and the acceleration of movement; and glove-type sensors that incorporate pressure sensors that detect the pressure between an object pressed or gripped by a finger, and microphone devices that detect the mating sounds generated when mating connector parts and the operating sounds generated when using tools.

[0019] For example, worker status information may include the worker's health status, such as fever or physical condition, the wearing of prescribed safety clothing such as a work cap, armband, chest badge, correct work clothes, safety shoes, earthing straps, helmet, protective cap, whether their chin straps are tight, dust mask, protective clothing, protective glasses, protective gloves, rolled-up sleeves, untucked shirt cuffs, the prohibition of sweaters to prevent static electricity, whether or not there is mud on shoes when entering a clean room, restrictions on bringing in communication devices for information management, and restrictions on bringing in raw food for hygiene management. This worker status information can be obtained by detecting the worker's physical condition and blood flow status estimated using images from surveillance cameras, RGB cameras such as facial recognition cameras, and thermography cameras, detecting belongings and clothing, and checking belongings using X-rays and metal detectors.

[0020] Additionally, for example, worker location information includes where and in which area a worker is staying within a premises or factory, which building, production line, or work area they are in, and whether they are on break or working. This worker location information can be obtained by tracking people using distance sensors and surveillance cameras, and by checking entry and exit to specific areas such as clean rooms and server rooms through entrance and exit management flap gates or security lock doors using RFID (Radio Frequency Identification) tags, wireless tags, or biometric authentication such as face recognition and fingerprint authentication.

[0021] Furthermore, for example, worker team structure information includes personnel allocation plans, work plans, shift schedules, and break allocation information. This team structure information can be obtained from planning tables output by production planning and personnel allocation planning systems, information for each worker checked by a team leader, and a worker resource management system for sharing information between team leaders.

[0022] The tool recognition unit 140 receives tool operation information input from the outside and recognizes the operating status of the tool from the received information. The input information is information generated by the tool detection unit 40, which is external to the process control device 10, based on the tool information and operation information detected from the tool 4.

[0023] For example, tool operation information includes the power on / off status and power consumption of large manufacturing equipment and processing robots, operation status such as operating / idle / pause / stopped / unlocked, position information of workpieces and actuators, power on / off status and operation switch press status of medium-sized and small tools directly operated by workers, safety lock status, and rotation speed and power consumption of electric drills, lathes, grinders, mixers, rollers, etc. This operation information can be obtained from information from management systems such as MES (Manufacturing Execution Systems) used to control manufacturing equipment and robots, output information from IoT (Internet of Things)-compatible tools that have built-in devices for measuring tool operation information, and current measurement devices, magnetic field measurement devices, vibration measurement devices, and sound frequency measurement devices that can be attached externally to tools without built-in measurement devices to sense the tool's operating status.

[0024] The equipment recognition unit 150 receives equipment information and equipment operation information input from the outside and recognizes the status and progress from the received information. The input information is information generated based on the equipment information and equipment operation information detected from the equipment 3 by the equipment detection unit 30, which is external to the process control device 10.

[0025] For example, equipment information includes the power on / off status of the equipment, the location of the production line, the operating location of mobile objects (robots and AGVs (Automated Guided Vehicles)), production capacity, and power consumption. Equipment operation information includes the operating time of the equipment, its status (idle / operating / suspended / stopped, etc.), the open / closed state of the workpiece insertion port, the display color of the three-color light indicating the operating status, the presence or absence of abnormalities (such as alarm sounds, strange noises, strange odors, abnormal currents, and heat), the operating status shown on the display panel, the production progress status, and the presence or absence of warning lights.

[0026] This equipment information and equipment operation information can be obtained from status reports and log information output by the equipment, information from management systems such as MES used to control manufacturing equipment and robots, surveillance cameras, color sensors, volume sensors, temperature sensors, thermography sensors, radiation thermometers, ammeters, voltmeters, power consumption meters, ranging devices, RFID tags, and wireless tags.

[0027] The component recognition unit 160 receives component information and component inventory information input from the outside and recognizes the status and progress from the received information. The input information is information generated by the component detection unit 20, which is external to the process control device 10, based on the component information and component inventory information detected from the materials and components 2.

[0028] For example, component information includes location, presence or absence of components and materials, product storage, status, component type, shape, weight, color, front and back of the board, assembly position and orientation, degree of polymerization, and finished appearance. For example, component inventory information includes the number of components, material weight and volume, and number, weight, and volume of products. This component information and component inventory information can be obtained using cameras, distance sensors, weight sensors, capacity sensors, transparency sensors, turbidity sensors, barcode readers, RFID tags, and wireless tags.

[0029] Display unit 180 corresponds to UI unit 102 in FIG. 1 and displays the arrival and completion information determined by arrival / completion determination unit 121, along with the arrival and completion times, using text, color, icon shape, etc. to indicate whether the item has arrived or completed. Display unit 180 can be implemented as a warning display device such as a rotating light, a status display device such as a three-color traffic light, a color lamp array, a 7-segment numeric display device, an LED display, an LCD display, a projection projector, a tablet terminal, a small smart device, a wristwatch-type display device, an eyeglass-type display device, a head-mounted display, or a drone-mounted display. Display unit 180 thus has the effect of enabling on-site workers, team leaders, and supervisors to quickly, accurately, and clearly communicate arrival / completion information.

[0030] Although not shown, the process control device 10 may have an operation unit corresponding to the UI unit 102 in Fig. 1. By having the operation unit, it is possible to perform operations such as turning the display on and off on the display unit 180, turning on and off the arrival / completion detection process, turning on and off the output from the communication unit 190, turning on and off the power to the process control device 10 or changing the settings, performing operations to check the arrival information and completion information displayed on the display unit 180, and turning on and off the work recognition unit 130 and the tool recognition unit 140 or switching whether they are in use. In this way, the operation unit has the effect of enabling control of the process control device on-site.

[0031] 1, and outputs the arrival information and completion information determined by the arrival / completion determination unit 121 to a distributed control system 1 connected to the outside of the process control device 10. Furthermore, the communication unit 190 may input updated determination information from outside the device in order to update the arrival / completion determination information stored therein.

[0032] The distributed control system 1 can be configured to connect multiple process control devices. For example, the distributed control system 1 can be connected to the process control device 10 and the process control device 11, and the process control devices 10 and 11 can be used simultaneously to measure the same work in a certain process separately. This has the effect of enabling more accurate arrival / completion information to be obtained than when measuring with a single process control device. Also, for example, the distributed control system 1 can be connected to the process control device 10 and the process control device 11, and a certain process can be measured with the process control device 10, and the next subsequent process can be measured with the process control device 11. This has the effect of enabling arrival / completion information to be obtained even when the process is long.

[0033] The recognition units of the work recognition unit 130, the tool recognition unit 140, the equipment recognition unit 150, and the part recognition unit 160 in FIG. 2 correspond to the recognition units 100 and 101 in FIG. 1, and it is sufficient to have at least two recognition units.

[0034] 2, the recognition unit may be configured with two units: a work recognition unit 130 and a tool recognition unit 140. In this case, the completion determination unit 121 determines completion by comparing the information on work, status, and progress output by the work recognition unit 130 and the tool recognition unit 140 with the completion determination information stored therein. The completion determination unit 121 also compares the detected time information accompanying the information on work, status, and progress output by the work recognition unit 130 and the tool recognition unit 140 with the time acquired from the clock unit 122, and assigns the completion time to the completion information, thereby generating arrival information or completion information.

[0035] By determining arrival and completion information from work information, worker status, worker location, and work team allocation, human movements and actions can be obtained as digital information, which has the effect of digitizing on-site work skills and utilizing them for new employee training and skill transfer. Furthermore, by enabling history management of deviations from standard operating procedures at each timing in the production process, product traceability and quality can be ensured. Furthermore, arrival and completion information at the timing of deploying human resources to the production site makes it possible to identify waste in the deployment and operation of human resources, thereby reducing waste and improving productivity and reducing human resource costs. Furthermore, the ability to digitize human resources makes it possible to create production plans in which humans and machines work together, contributing to the creation of production plans that maximize productivity with optimal workloads without placing excessive strain or strain on people. In addition, because people's condition, fatigue, and workload can be digitized, it is possible to ensure people's safety, prevent the spread of infectious diseases and the occurrence of clusters, prevent security incidents caused by carelessness or human error, prevent serious accidents such as fires and fatalities caused by production activities with low safety and disaster prevention awareness due to the assignment of non-regular staff, and prevent fraudulent work.

[0036] Furthermore, by determining arrival and completion information from tool information and operation information, highly sensitive sensors can detect minute changes in the tool condition that are difficult for humans to notice at the stage when they occur and obtain predictive information. This has the effect of preventing equipment breakdowns and personal injuries through predictive maintenance, and contributing to BCPs (Business Continuity Plans) by preventing large-scale business shutdowns through early abnormality detection.

[0037] 2, the recognition unit may be configured with two units: the task recognition unit 130 and the equipment recognition unit 150. In this case, the arrival completion determination unit 121 determines whether the item has arrived by comparing the task, status, and progress information output by the task recognition unit 130 and the equipment recognition unit 150 with the arrival completion determination information stored therein. The arrival completion determination unit 121 also compares the detected time information accompanying the task, status, and progress information output by the task recognition unit 130 and the equipment recognition unit 150 with the time acquired from the clock unit 122, and assigns the arrival completion time to the arrival completion information, thereby generating arrival information or completion information.

[0038] By determining arrival and completion information from equipment information and equipment operation information, it is possible to obtain status and progress information linked to the exact time without human intervention, which has the effect of contributing to improving the accuracy of arrival and completion times.

[0039] 2, the recognition unit may be configured with two units: a work recognition unit 130 and a part recognition unit 160. In this case, the arrival completion determination unit 121 determines whether a product has arrived by comparing the information on work, status, and progress output by the work recognition unit 130 and the part recognition unit 160 with the arrival completion determination information stored therein. The arrival completion determination unit 121 also compares the detection time information accompanying the information on work, status, and progress output by the work recognition unit 130 and the part recognition unit 160 with the time acquired from the clock unit 122, and assigns the arrival completion time to the arrival completion information, thereby generating arrival information or completion information.

[0040] By determining arrival and completion information from parts information and parts inventory information, it is possible to obtain accurate status and progress information based on accurate size, weight, and uniform appearance without human intervention, which has the effect of contributing to improved accuracy in determining arrival and completion status.The ability to obtain the accurate finish status, presence or absence of defects, inventory volume, and arrival timing of parts and materials has the effect of contributing to quality improvement, productivity improvement, first-run rate improvement, cost reduction, defect rate reduction, yield improvement, and optimization of unnecessary inventory.

[0041] 2 may include the tool recognition unit 140 and the equipment recognition unit 150, but not the work recognition unit 130. In this case, the arrival / completion determination unit 121 determines arrival information and completion information from the tool information, tool operation information, equipment information, and equipment operation information, thereby having the effect of detecting the behavior and work of the worker at the correct time even in a situation where the worker cannot be photographed by a monitoring camera or distance measurement sensor.

[0042] 2, the task recognition unit 130 and the equipment recognition unit 150 may be omitted. In this case, the arrival completion determination unit 121 inputs information on tools and parts, determines arrival completion information from the input information, displays the arrival information and completion information on the display unit, and outputs it from the communication unit. By determining the arrival information and completion information from tool information, tool operation information, part information, and part inventory information, it is possible to reduce costs by eliminating the recognition unit, while simultaneously obtaining the aforementioned effects obtained from the tool recognition unit 140 and the part recognition unit 160.

[0043] 2, the work recognition unit 130 and the tool recognition unit 140 may be omitted. In this case, the arrival completion determination unit 121 inputs information on the production equipment and parts, determines arrival completion information from this, displays the arrival information and completion information on the display unit, and outputs it from the communication unit. By determining the arrival information and completion information from equipment information, equipment operation information, part information, and part inventory information, it is possible to reduce costs by eliminating the recognition unit, while simultaneously obtaining the above-mentioned effects obtained from the equipment recognition unit 150 and the part recognition unit 160.

[0044] 2, the component recognition unit 160 may be omitted. In this case, the arrival / completion determination unit 121 inputs information on the worker, tool, and production equipment, determines arrival / completion information from the information, displays the arrival information and completion information on the display unit, and outputs it from the communication unit. By determining the arrival information and completion information from work information, worker status, worker location, work team allocation, tool information, operation information, equipment information, and equipment operation information, it is possible to reduce the recognition unit and cut costs while simultaneously obtaining the aforementioned effects obtained from the work recognition unit 130, tool recognition unit 140, and equipment recognition unit 150.

[0045] 2 may be configured without the equipment recognition unit 150. In this case, the arrival / completion determination unit 121 inputs information on workers, tools, and parts, determines arrival / completion information from the information, displays the arrival information and completion information on the display unit, and outputs it from the communication unit. By determining the arrival information and completion information from work information, worker status, worker location, work team allocation, tool information, operation information, part information, and part inventory information, it is possible to reduce the recognition unit and cut costs while simultaneously obtaining the above-mentioned effects obtained from the work recognition unit 130, tool recognition unit 140, and part recognition unit 160.

[0046] 2, the tool recognition unit 140 may be omitted. In this case, the arrival completion determination unit 121 inputs information on the worker, production equipment, and parts, determines arrival completion information from this, displays the arrival information and completion information on the display unit, and outputs it from the communication unit. By determining the arrival information and completion information from work information, worker status, worker location, work team allocation, equipment information, equipment operation information, part information, and part inventory information, it is possible to reduce the recognition unit and cut costs while simultaneously obtaining the above-mentioned effects obtained from the work recognition unit 130, equipment recognition unit 150, and part recognition unit 160.

[0047] 2, the work recognition unit 130 may be omitted. In this case, the arrival completion determination unit 121 inputs information on tools, production equipment, and parts, determines arrival completion information from the information, displays the arrival information and completion information on the display unit, and outputs it from the communication unit. By determining the arrival information and completion information from tool information, operation information, equipment information, equipment operation information, part information, and part inventory information, it is possible to reduce the recognition unit and cut costs while simultaneously obtaining the above-mentioned effects obtained from the tool recognition unit 140, equipment recognition unit 150, and part recognition unit 160.

[0048] FIG. 3 is a schematic diagram showing a timing chart of arrival / completion information obtained from the recognition information output by each recognition unit of the process control device in this embodiment and arrival / completion information and completion information determined by the arrival / completion determination unit.

[0049] 3, timing charts 200 to 600 corresponding to each recognition unit in this embodiment each indicate the time of arrival completion information. That is, timing chart 200 is a timing chart of arrival completion information determined by arrival completion determination unit 121 based on recognition information input to work recognition unit 130 from work detection unit 50. Arrival completion information 210 indicates a timestamp of time T20, arrival completion information 211 indicates a timestamp of time T21, arrival completion information 212 indicates a timestamp of time T22, and arrival completion information 213 indicates a timestamp of time T23.

[0050] Timing chart 300 is a timing chart of arrival completion information determined by arrival completion determination unit 121 based on recognition information input to work recognition unit 130 from work detection unit 51. Arrival completion information 310 indicates a timestamp of time T30, arrival completion information 311 indicates a timestamp of time T31, arrival completion information 312 indicates a timestamp of time T32, and arrival completion information 313 indicates a timestamp of time T33.

[0051] Timing chart 400 is a timing chart of arrival completion information determined by arrival completion determination unit 121 based on recognition information input from tool detection unit 40 to tool recognition unit 140. Arrival completion information 410 indicates a timestamp of time T40, arrival completion information 411 indicates a timestamp of time T41, arrival completion information 412 indicates a timestamp of time T42, and arrival completion information 413 indicates a timestamp of time T43.

[0052] Timing chart 500 is a timing chart of arrival completion information determined by arrival completion determination unit 121 based on recognition information input to equipment recognition unit 150 from equipment detection unit 30. Arrival completion information 510 indicates a timestamp of time T50, arrival completion information 511 indicates a timestamp of time T51, arrival completion information 512 indicates a timestamp of time T52, and arrival completion information 513 indicates a timestamp of time T53.

[0053] Timing chart 600 is a timing chart of arrival completion information determined by arrival completion determination unit 121 based on recognition information input to component recognition unit 160 from component detection unit 20. Arrival completion information 610 indicates a timestamp of time T60, arrival completion information 611 indicates a timestamp of time T61, arrival completion information 612 indicates a timestamp of time T62, and arrival completion information 613 indicates a timestamp of time T63.

[0054] Timing chart 700 is a timing chart of arrival information and completion information determined by arrival completion determination unit 121 based on the arrival completion information from timing charts 200 to 600. Arrival information 710 indicates a timestamp of time T70, completion information 711 indicates a timestamp of time T71, arrival information 712 indicates a timestamp of time T72, and completion information 713 indicates a timestamp of time T73.

[0055] The timing chart in Figure 3 shows a case where arrival / completion information is received at four different times, such as arrival → completion → arrival → completion. The first arrival and first completion are paired to indicate the first operation. The next arrival and next completion are paired to indicate the second operation. This shows an example where these two operations are paired to form one process. Arrival information and completion information are collectively called arrival / completion information.

[0056] In this embodiment, in the process of determining whether a parcel has arrived, a flag indicating the reliability of the estimation is assigned to the result of the determination of whether a parcel has arrived. The flag has four levels, with level 1 representing the highest reliability, level 2 representing a medium reliability, level 3 representing a low reliability, and level 4 representing an inference impossible.

[0057] FIG. 4 is a flowchart of the arrival completion determination process in this embodiment. In FIG. 4, when the arrival completion determination process is initiated (S2600), it is determined whether there is arrival completion information for the remaining timing in the process (S2601). If the determination result shows that there is no arrival completion process for the remaining timing, the arrival completion determination process is terminated (S2603). If there is arrival completion information for the remaining timing, it starts receiving recognition results for the arrival completion information for the most recent timing (S2602). After starting to receive the recognition results, it determines whether the recognition results are received or whether the timeout condition for waiting for reception is met (S2604). The timeout condition is a timeout period defined in advance for each recognition unit and stored in the arrival completion determination unit at system startup, etc. When the recognition results are received, a level 1 flag is attached and the received results are temporarily saved in memory (S2606). If the timeout condition is met, interpolation processing is performed, a level 2 or 4 flag is attached (S2605), and the received results are temporarily saved in memory (S2606).

[0058] If the condition that all recognition results for the most recent arrival completion information have been received or timed out is not met (S2607), reception of the remaining recognition results begins (S2601). If all recognition results for the most recent arrival completion information have been received or timed out (S2607), it is determined whether the reception results in memory are all Level 1 or not (S2608). If the determined reception results are normal (S2609), the determination result is output with a Level 1 flag attached (S2611). If the determined reception results are not normal (S2609), correction processing is performed, a Level 2 to 4 flag is attached (S2610), and the determination result is output (S2611). After the determination result is output (S2611), it is determined whether there is any remaining arrival completion information in the process (S2601).

[0059] FIG. 5 is a detailed flowchart of the complementation process in FIG. 4. In FIG. 5, when the complementation process starts (S2605), it is determined whether the arrival completion information is received within the expected timing range defined for each recognition unit (S2701). If it is within the range, it is determined whether there is multiple reception of the same type of arrival completion information consecutively (S2702). If it is outside the range, a level 4 flag is assigned (S2705) and the process ends (S2706). If there is multiple reception (S2702), the multiple received arrival completion information is rounded, a level 2 flag is assigned (S2703), and the process ends (S2706). If there is no multiple reception (S2702), a level 1 flag is assigned (S2704), and the process ends (S2706). The rounding process will be described later using FIG. 18 to FIG. 27. The expected reception timing range will be described later using FIG. 16 to FIG. 17.

[0060] FIG. 6 is a detailed flowchart of the correction process in FIG. 4. In FIG. 6, when the correction process starts (S2610), it is determined whether the arrival / completion information of the most recent timing includes a reception with a level 1 or level 2 flag (S2801). If not, a level 4 flag is assigned (S2805), and the process ends (S2806). If included, extraction process is performed using the level 1 and level 2 reception results, and a level 2 flag is assigned (S2802). Then, it is determined whether the arrival / completion information of the immediately previous timing is level 4 (S2803), and if not level 4, the process ends (S2806). If it is level 4, interpolation process is performed on the arrival / completion information of the immediately previous timing, and a level 3 flag is assigned (S2804), and the process ends (S2806). The extraction process will be described later using FIG. 32 to FIG. 35. The interpolation process will be described later using FIG. 28 to FIG. 31.

[0061] Hereinafter, the process of determining whether a part has been attached using the recognition results of the work recognition unit and the tool recognition unit in this embodiment will be described with reference to the timing charts of FIGS.

[0062] Figure 7 is a timing chart when the work recognition unit and tool recognition unit receive the first arrival completion information and the arrival completion determination unit determines that this is the first arrival information. In Figure 7, the time T20 of the arrival completion information 210 and the time T40 of the arrival completion information 410 are the same time, so the arrival information 710 is set to T70, which is the same time as T20 and T40, and because they are the same time, a level 1 flag is assigned.

[0063] Figure 8 is a timing chart for when the work recognition unit does not receive the first arrival completion information, the tool recognition unit receives the first arrival completion information, and the arrival completion determination unit determines that this is the first arrival information. In Figure 8, due to the time T40 of arrival completion information 410, arrival information 710 is set to T70, the same time as T40, and although two reception results should have been received, one was not received, so a level 2 flag is assigned.

[0064] Figure 9 is a timing chart following on from Figure 7, in which the work recognition unit and tool recognition unit receive second arrival completion information and the arrival completion determination unit determines this as the second arrival information. In Figure 9, since the time T21 of the arrival completion information 211 and the time T41 of the arrival completion information 411 are the same time, the completion information 711 is set to T71, which is the same time as T21 and T41, and since they are the same time, a level 1 flag is assigned.

[0065] Continuing from Fig. 7, Fig. 10 is a timing chart for when the work recognition unit does not receive the second arrival completion information, the tool recognition unit receives the second arrival completion information, and the arrival completion determination unit determines that this is the second arrival information. In Fig. 10, due to the time T41 of the arrival completion information 411, the completion information 711 is set to T71, the same time as T41, and although two reception results should have been received, one was not received, so a level 2 flag is assigned.

[0066] Continuing from Fig. 9, Fig. 11 is a timing chart showing a case where the work recognition unit does not receive the third arrival completion information, the tool recognition unit receives the third arrival completion information, and the arrival completion determination unit determines that this is the third arrival information. In Fig. 11, due to the time T42 of arrival completion information 412, arrival information 712 is set to T72, the same time as T42, and although two reception results should have been received, one was not received, so a level 2 flag is assigned.

[0067] Continuing from Figure 9, Figure 12 is a timing chart for when the work recognition unit and tool recognition unit do not receive the third arrival completion information and the arrival completion determination unit is unable to determine this as the third arrival information. In Figure 12, two reception results should have been received, but they were not, so a level 4 flag is assigned.

[0068] FIG. 13 is a timing chart showing a case where a first set of arrival-completion information and a second set of arrival-completion information are received using timing chart 200 of the work recognition unit based on the recognition results input from work detection unit 50 and timing chart 300 of the work recognition unit based on the recognition results input from work detection unit 51, respectively, and the arrival-completion determination unit determines that these are two sets of arrival information and completion information.

[0069] In FIG. 13, from time T20 in arrival / completion information 210, arrival information 710 is set to T70, the same time as T20, and a level 1 flag is assigned. Also, from time T21 in arrival / completion information 211, completion information 711 is set to T71, the same time as T21, and a level 1 flag is assigned. Also, from time T32 in arrival / completion information 312, arrival information 712 is set to T72, the same time as T32, and a level 1 flag is assigned. Furthermore, from time T33 in arrival / completion information 313, completion information 713 is set to T73, the same time as T33, and a level 1 flag is assigned.

[0070] FIG. 14 is a timing chart similar to FIG. 13, showing a case where determination is made using the timing charts 200 and 300 of the task recognition unit. In FIG. 14, from time T20 of arrival / completion information 210, arrival information 710 is set to T70, the same time as T20, and a level 1 flag is assigned. Since the next reception was not possible within the time range, a level 4 flag is assigned to completion information 711. From time T32 of arrival / completion information 312, arrival information 712 is set to T72, the same time as T32, and a level 1 flag is assigned. Here, completion information 711 can be generated by interpolation processing using arrival information 712, and a level 3 flag is assigned. The interpolation processing will be described later using FIG. 28 to FIG. 31. Furthermore, from time T33 of arrival / completion information 313, completion information 713 is set to T73, the same time as T33, and a level 1 flag is assigned.

[0071] FIG. 15 is a timing chart similar to FIG. 13, showing a case where determination is made using timing charts 200 and 300 of the task recognition unit. In FIG. 15, from time T20 of arrival / completion information 210, arrival information 710 is set to T70, the same time as T20, and a level 1 flag is assigned. Then, from time T21 of arrival / completion information 211, completion information 711 is set to T71, the same time as T21, and a level 1 flag is assigned. Since the next reception was not possible within the time range in which it should have been received, arrival information 712 is temporarily set to a level 4 flag. Then, from time T33 of arrival / completion information 313, completion information 713 is set to T73, the same time as T33, and a level 1 flag is assigned. Here, arrival information 712 can be generated by interpolation using completion information 713, and a level 3 flag is assigned. The interpolation process will be described later using FIG. 28 to FIG. 31.

[0072] Next, a method for determining the expected range of recognition result reception in this embodiment will be described with reference to the timing charts of FIGS.

[0073] FIG. 16 is a timing chart showing, as an example, the expected range for receiving a second recognition result when the task recognition unit receives the first recognition result as a base point. In FIG. 16, if the task recognition unit receives arrival / completion information 3100 at time T30a, the expected range for receiving the first recognition result is the range starting from T10, which is the same time as T30a, and ending at time T10a, a fixed time later. Furthermore, the expected range for receiving a second recognition result is the range from start point T11a to end point T11b, centered at time T11, a fixed time later than time T10. In other words, the first expected range is from arrival / completion information 110 to arrival / completion information 1100, and the second expected range is from arrival / completion information 1110 to arrival / completion information 1111.

[0074] The time from T11 to T11a and the time from T11 to T11b can be determined using a fixed ratio based on the standard work time for the task in the target process. For example, if a 10% margin is added to a standard work time of 10 seconds, the time from T11 to T11a and the time from T11 to T11b are each set to 5% of the standard work time for the process. Since variability is expected to decrease as work proficiency improves, it is possible to adjust and decrease the 10% margin according to proficiency to maintain a more consistent work time. Alternatively, the time range can be determined taking into account the time required for retrying the task. For example, if a maximum of one retry is allowed, the time required for one retry can be added to T10 to obtain T10a, and similarly added to T11 to obtain T11b. In this case, it is conceivable to set T11a to the same time as T11.

[0075] Fig. 17 is a timing chart showing the result of determining whether or not a package has arrived when the first arrival information is received based on the expected range 800 determined in Fig. 16. In Fig. 17, when the work recognition unit receives the first arrival information as arrival completion information 3100, it sets the same time as T30a as T70 and assigns a level 1 flag to the arrival information 710.

[0076] Next, the rounding process in this embodiment will be described using the timing charts of FIGS. 18 to 27. FIG. 18 is a timing chart showing the results of determining whether or not a delivery has been completed when two pieces of arrival information are received. In FIG. 18, when the work recognition unit receives the first piece of arrival information as arrival completion information 3100, it sets the same time as T30a as T70 and assigns a level 1 flag to arrival information 710. Next, when the second piece of arrival information is received as arrival completion information 3101, if time T30b is earlier than the end point T10a of the expected range, T30a is given priority and assigned as T70, and T30b is not adopted. However, a level 2 flag is assigned to arrival information 710.

[0077] Figure 19 is a timing chart showing the results of determining whether or not arrival has been completed when two pieces of arrival information have been received, similar to Figure 18. The difference from Figure 18 is that the second piece of arrival information, arrival completion information 3102, is received at T30c, which is a time later than the end point T10a.

[0078] In this case, T30c is ignored, and T30a is adopted as T70. Also, a level 1 flag is assigned to the incoming call information 710.

[0079] Figure 20 is a timing chart showing the results of determining whether a flight is complete when one arrival information and one completion information are received. The difference from Figure 19 is that the completion information is received at time T31a, which is after the end point T10a and before the start point T11a of the second expected range. In this case, T31a is ignored, and T30a is used as T70. Also, a level 1 flag is assigned to arrival information 710.

[0080] Like FIG. 20, FIG. 21 is a timing chart showing the results of determining whether a call is complete when one arrival information and one completion information are received. The difference from FIG. 20 is that the completion information is received at T31b, which is after the start point T11a of the second expected range and before the end point T11b. In this case, T30a is set to T70, and a level 1 flag is assigned to the arrival information 710. Furthermore, T31b is set to T71, and a level 1 flag is assigned to the completion information 711.

[0081] Figure 22 is a timing chart showing the results of determining whether a call has been completed when one piece of arrival information is received but not received within the second expected range. The difference from Figure 21 is that it was not received within the second expected range. In this case, T30a is set to T70, and a level 1 flag is assigned to arrival information 710. Additionally, a level 4 flag is assigned to the second piece of completion information that was expected to be received around T11.

[0082] Figure 23 is a timing chart showing the results of determining whether a package has arrived or not when one arrival information and one completion information are received, and the completion information is received outside the second expected range. The difference from Figure 22 is that the completion information was received after the second expected range. In this case, T30a is set to T70, and a level 1 flag is assigned to the arrival information 710. Furthermore, the completion information received as arrival / completion information 3112 is not adopted because it was outside the expected range, and a level 4 flag is assigned.

[0083] FIG. 24 is a timing chart showing the results of determining whether a shipment has arrived when two pieces of arrival information are received and the second piece of arrival information is received outside the second expected range. The difference from FIG. 23 is that both pieces of arrival information are arrival information, the second piece of arrival information is outside the second expected range, and the third piece of arrival information is outside the third expected range. In this case, T30a is set to T70, and a level 1 flag is assigned to arrival information 710. Furthermore, the arrival information received as arrival information 3113 is not adopted because it is outside the expected range, and a level 4 flag is assigned. The third expected range (start point T12a, end point T12b, center T12) is determined based on the ratio to the standard work time or the rework time, with T11, the center of the second expected range, as the base point.

[0084] FIG. 25 is a timing chart showing the results of determining whether a task is complete when two pieces of arrival information are received and the second piece of arrival information is received within the third expected range. The difference from FIG. 24 is that the second piece of arrival information received is within the third expected range. In this case, T30a is designated as T70, and a level 1 flag is assigned to arrival information 710. Furthermore, arrival information received as arrival completion information 3120 is designated as arrival information 712 at time T72, and a level 1 flag is assigned. Furthermore, completion information that was expected to be received as the first completion information but was not received can be generated as completion information 711 at the same time as T11, and a level 3 flag is assigned. This is because, since the second arrival information was received as arrival information 712, it can be assumed that the previous task has been completed.

[0085] 26 and 27 are equivalent to the processes in FIGS. 22 and 23, respectively, when the assumed range is shifted by one, and therefore a description thereof will be omitted.

[0086] Next, interpolation determination will be explained using Figures 28 to 31. Interpolation determination is a process for estimating the previous arrival / completion information, as explained in Figure 25. Figure 28 shows a method for determining the time using the same algorithm as Figure 25, and other variations of the algorithm will be explained using Figures 29 to 31. In all cases, a level 3 flag is assigned.

[0087] FIG. 28 is the same as the algorithm in FIG. 25, and is a method of using the time in the center of the expected range (T11 in this case).

[0088] 29 shows a method in which a time that is a fixed time period before time T72 is set to T71, and this fixed time period is, for example, T12-T11, which is the difference between the center times of adjacent assumed ranges.

[0089] Figure 30 shows a method in which time T71 is set to a time that is shifted a certain amount of time from time T70, and this certain amount of time is, for example, T11-T10. This is the difference in time between the centers of adjacent estimated ranges. The difference from Figure 29 is the starting time; in Figure 29, the center of the estimated range after the timing of interpolation is used as the base point, while in Figure 30, the center of the estimated range before the timing of interpolation is used as the base point.

[0090] 31 shows a method for determining time T71 by setting the ratio of time T71 between time T70 and time T72, i.e., (T71-T70):(T72-T71), to a predefined ratio. This constant ratio can be, for example, (T11-T10):(T12-T11). This ratio is based on the center times of three consecutive estimated ranges.

[0091] Next, a method for implementing extraction processing when the same type of arrival / completion information is received multiple times will be described with reference to FIGS.

[0092] FIG. 32 shows a method of adopting the smallest time, i.e., the first received time, when two pieces of arrival information are received as arrival completion information 3100 and 3101. In this case, time T30a of arrival completion information 3100 is adopted as time T70 of arrival information 710. This method has the advantage of being able to determine the judgment immediately after reception and minimizing delays. Furthermore, if arrival information is used, a wider range of arrival completion can be obtained, which has the advantage of avoiding the risk of underestimation.

[0093] Figure 33 shows a method of adopting the average time when two pieces of arrival information are received as arrival / completion information 3100 and 3101. In this case, the midpoint between time T30a of arrival / completion information 3100 and time T30b of arrival / completion information 3101 is adopted as time T70 of arrival information 710. This method has the effect of being able to estimate the most likely timing from the time alone.

[0094] Figure 34 shows a method for determining the time to be adopted by taking into consideration the level when two pieces of arrival information are received as arrival completion information 3100 and 3101. In other words, the time of the arrival information whose level is closest to 1 is adopted. In this case, if arrival completion information 3100 is level 1 and arrival completion information 3101 is level 2, arrival completion information 3100 is closest to level 1, so time T30a is adopted as time T70 of arrival information 710. This method has the effect of being able to estimate the most likely timing while eliminating the influence of data with low reliability.

[0095] FIG. 35 shows a method for using the maximum time, i.e., the time last received, when two pieces of arrival information are received as arrival / completion information 3100 and 3101. In this case, time T30b of arrival / completion information 3101 is used as time T70 of arrival information 710. This method has the advantage of assuming overlap due to redoing work and making it possible to obtain the timing when the work start or completion action is redone and completed. Furthermore, if the completion timing is used, a wider range of arrival / completion can be obtained, which has the advantage of avoiding the risk of underestimation. As described above, these methods have the advantage of making it possible to correct the expected range of the next notification.

[0096] Next, a modified example of the arrival completion determination in this embodiment will be explained. Figure 36 is a processing flowchart for the arrival completion determination in this modified example. In Figure 36, the same processes as in Figure 4 are assigned the same reference numerals, and their explanation will be omitted.

[0097] In FIG. 4, in S2607, it is determined whether all recognition results for the most recent arrival completion information have been received or have timed out. In contrast, in FIG. 36, instead of S2607, it is determined whether all have timed out (S2612). This is because, when applying the method of determining from multiple received information described in FIGS. 33 to 35, among the variations of extraction processing when the same type of arrival completion information is received multiple times as described using FIGS. 32 to 35, it is necessary to continue waiting for reception until the timeout time. Note that in FIG. 4, the method of adopting the first reception described in FIG. 32 is applied.

[0098] As described above, according to this embodiment, the status of multiple detection targets is recognized, arrival completion determination is performed based on the status of the multiple detection targets, and arrival completion information that includes a set of arrival information and completion information can be obtained. For example, if a missed or multiple detection of arrival completion information is detected during work status detection, a technology can be provided that prevents missed or multiple detection of arrival completion by performing a supplementary or extraction process so that the arrival information and completion information are paired and assigning a low reliability. In other words, according to this embodiment, a process control device and a processing system equipped with the same can be provided that can obtain arrival completion information that corresponds to work that includes various worker actions and changes in work location, preventing missed or multiple detection of arrival completion. [Example]

[0099] Figure 37 is a configuration block diagram of a process control device, which is a processing device that controls the progress of the product production process in this embodiment. In Figure 37, the same processes as in Figure 1 are assigned the same reference numerals, and their explanations will be omitted. Figure 37 differs from Figure 1 in that it includes a memory unit 170. The memory unit 170 stores arrival / completion information determined by the control unit 120.

[0100] Figure 38 is a detailed configuration block diagram of the process control device in this embodiment, and a configuration block diagram of a process control system that is a processing system showing a detection unit and detection target external to the process control device, a distributed control system, and other process control devices. In Figure 38, the same processes as in Figure 2 are assigned the same reference numerals, and their explanations will be omitted. Figure 38 differs from Figure 2 in that it includes a memory unit 170. The memory unit 170 stores judgment information 111 and arrival / completion information 112.

[0101] The arrival / completion determination unit 121 determines whether or not a package has arrived by comparing the determination information 111 read from the storage unit 170. The determination information 111 is data with a dictionary structure, table structure, or list structure that describes conditions for determining whether the information on the above-mentioned work, status, and progress is arrival information or completion information. The storage unit 170 also stores the arrival information and completion information determined by the arrival / completion determination unit 121 as arrival / completion information 112.

[0102] Display unit 180 in Fig. 38 corresponds to UI unit 102 in Fig. 37, but may have an operation unit corresponding to UI unit 102. By having the operation unit, in addition to the effects described in Fig. 2, it is possible to turn on / off the retention of arrival / completion information 112, retrieve arrival / completion information 112 retained in storage unit 170, output it to the outside of the device, back it up within the device, view arrival / completion information for a past period going back to the required period, and delete arrival / completion information 112 that is no longer needed.

[0103] The process control device in this embodiment can obtain the same effects as those shown in embodiment 1 by determining arrival information and completion information from work information, worker status, worker location, work team allocation, tool information, operation information, equipment information, equipment operation information, parts information, and parts inventory information.

[0104] As a modification of this embodiment, the display unit 180 may be omitted from the configuration shown in FIG. 38. In this case, information on the worker, tool, production equipment, and part is input, and arrival / completion information is determined from this information and stored in the memory unit as arrival information and completion information, which is then output from the communication unit. By determining arrival information and completion information from work information, worker status, worker location, work team allocation, tool information, operation information, equipment information, equipment operation information, part information, and part inventory information, the effects shown in Example 1 obtained from the memory unit 170 and communication unit 190 can be simultaneously obtained. If there is no person to notify of arrival / completion information by display near the installation location of the process control device, the display is unnecessary, which has the effect of reducing the display unit and reducing costs.

[0105] As another variation of this embodiment, the communication unit 190 may be omitted from the configuration shown in FIG. 38. In this case, information on the worker, tool, production equipment, and part is input, and arrival / completion information is determined from the information, stored in the memory unit as arrival information and completion information, and further displayed on the display unit. By determining arrival information and completion information from work information, worker status, worker location, work team allocation, tool information, operation information, equipment information, equipment operation information, part information, and part inventory information, the effects shown in Example 1 obtained from the memory unit 170 and display unit 180 can be obtained simultaneously. When the process control device is operated standalone, the communication unit is not necessary, which has the effect of reducing the communication unit and reducing costs.

[0106] Furthermore, as another variation of this embodiment, the display unit 180 and the communication unit 190 may be omitted from FIG. 38 . In this case, information on the worker, tool, production equipment, and part is input, and arrival / completion information is determined from this information and stored in the memory unit as arrival information and completion information. By determining arrival information and completion information from work information, worker status, worker location, work team allocation, tool information, operation information, equipment information, equipment operation information, part information, and part inventory information, the effects shown in the first embodiment obtained from the memory unit 170 can be obtained. If there is no person to notify of arrival / completion information by display near the installation of the process control device and the process control device is operated standalone, the display unit and communication unit are unnecessary, which has the effect of reducing the display unit and communication unit and reducing costs.

[0107] The present invention has been described above as an example of the present invention. Because the present invention can acquire arrival / completion information corresponding to the movement of work locations and tasks involving various worker actions, it is possible to identify waste in the allocation and operation of human resources, which has the effect of improving productivity and reducing labor costs by reducing waste. Therefore, the present invention contributes to achieving a high level of economic productivity through technological improvement and innovation in order to achieve the Sustainable Development Goals (SDGs), particularly in goal 8, "Decent Work and Economic Growth."

[0108] Furthermore, the present invention is not limited to the above-described embodiments and includes various modifications. For example, in the above-described embodiments, the processes in the process control device are described as being implemented by software processing. However, the present invention is not limited to this. Some or all of the processes may be implemented by hardware, for example, by designing an integrated circuit, or a combination of hardware and software. Furthermore, the above-described embodiments have been described in detail to clearly explain the present invention, and the present invention is not necessarily limited to those including all of the described components. Furthermore, it is possible to replace part of the configuration of one embodiment with the configuration of another embodiment, or to add the configuration of another embodiment to the configuration of one embodiment. Furthermore, it is also possible to add, delete, or replace part of the configuration of each embodiment with other configurations. [Explanation of symbols]

[0109] 10: Process control device, 102: UI section, 103: IF section, 100: Recognition section, 120: Control section, 130: Work recognition section, 140: Tool recognition section, 150: Equipment recognition section, 160: Part recognition section, 170: Memory section, 180: Display section, 190: Communication section, 111: Judgment information, 112: Arrival completion information, 121: Arrival completion judgment section, 122: Clock section

Claims

1. A processing device that detects the start and completion of a series of production operations that make up a production process, a plurality of recognition units that recognize the state of a detection target from sensing data input from an external device; a control unit that receives the state of the detection object from each of the plurality of recognition units, and determines whether the production work has started or been completed based on the state of the detection object received from each of the plurality of recognition units, thereby acquiring arrival / completion information indicating either the start of the production work or the completion of the production work for each of the recognition units, and outputs arrival information indicating the start of the production work and completion information indicating the completion of the production work based on the plurality of arrival / completion information acquired for each of the recognition units, A processing device characterized in that the multiple recognition units include at least two of a work recognition unit that outputs the work status of a worker, a tool recognition unit that outputs the operation status of a tool which is a first piece of equipment, an equipment recognition unit that outputs the operation status of a second piece of equipment different from the first piece of equipment, and a part recognition unit that outputs the inventory status of parts.

2. 2. The processing device according to claim 1, The processing device is characterized in that the control unit complements the arrival information and completion information so that the arrival information and completion information form a set when the multiple recognition units are unable to recognize the work status.

3. 2. The processing device according to claim 1, The processing device is characterized in that, when the plurality of recognition units recognize the work status in a multiple manner, the control unit extracts the arrival information and completion information so that the arrival information and completion information form a set.

4. 2. The processing device according to claim 1, The processing device is characterized in that the control unit assigns reliability to the arrival information and completion information.

5. 2. The processing device according to claim 1, A processing device comprising: a memory unit for storing determination information for comparing with the state of the detection object to determine whether the production work has started or has been completed.

6. A processing method for detecting the start and completion of a series of production operations that constitute a production process, comprising: Multiple recognition processes that recognize the state of the detection target from externally input sensing data; a completion / arrival determination process that receives the state of the detection object from each of the plurality of recognition units, determines whether the production work has started or been completed based on the state of the detection object received from each of the plurality of recognition units, acquires arrival / completion information indicating whether the production work has started or been completed for each of the recognition units, and outputs arrival information indicating the start of the production work and completion information indicating the completion of the production work based on the plurality of arrival / completion information acquired for each of the recognition units, A processing method characterized in that the multiple recognition processes include at least two of a work recognition process that outputs the work status of a worker, a tool recognition process that outputs the operating status of a tool that is a first piece of equipment, an equipment recognition process that outputs the operating status of a second piece of equipment that is different from the first piece of equipment, and a part recognition process that outputs the inventory status of parts.

7. 7. The method of claim 6, A processing method characterized in that, when the state of the detection object cannot be recognized, the arrival information and completion information are complemented so that the arrival information and completion information form a set.

8. 7. The method of claim 6, A processing method characterized in that, when the state of the detection object is recognized multiple times, the arrival information and completion information are extracted so as to form a set of the arrival information and completion information.

9. 7. The method of claim 6, A processing method characterized by assigning reliability to the arrival information and completion information.

10. 7. The method of claim 6, A processing method characterized by retaining judgment information for comparison with the state of the detection object to determine whether the production work has started or has been completed.

11. A processing system having a processing device and a host device that detect the start and completion of a series of production operations that make up a production process, The processing device includes a plurality of recognition units that recognize the state of a detection target from sensing data input from an external source, and a control unit that receives the state of the detection target from each of the plurality of recognition units, determines whether the production work has started or been completed based on the state of the detection target received from each of the plurality of recognition units, and acquires arrival / completion information indicating either the start of the production work or the completion of the production work for each recognition unit, and outputs arrival information indicating the start of the production work and completion information indicating the completion of the production work based on the plurality of arrival / completion information acquired for each recognition unit, and the plurality of recognition units include at least two of a work recognition unit that outputs the work state of a worker, a tool recognition unit that outputs the operating state of a tool that is first equipment, an equipment recognition unit that outputs the operating state of a second equipment different from the first equipment, and a parts recognition unit that outputs the inventory state of parts, The processing system is characterized in that the host device connects the processing device and other processing devices and controls the processing device and the other processing devices in a distributed manner.

12. 12. The processing system of claim 11, The processing system is characterized in that, when the multiple recognition units are unable to recognize the work status, the control unit complements the arrival information and completion information so that the arrival information and completion information form a set.

13. 12. The processing system of claim 11, The processing system is characterized in that, when the multiple recognition units recognize the work status multiple times, the control unit extracts the arrival information and completion information so that the arrival information and completion information form a pair.

14. 12. The processing system of claim 11, The processing system is characterized in that the control unit of the processing device assigns reliability to the arrival information and completion information.

15. 12. The processing system of claim 11, A processing system characterized in that the processing device has a memory unit that stores judgment information for comparing with the state of the detection object to determine whether the production work has started or been completed.

Images