Management system, management device, management method, and program

Abstract

To provide a management system which facilitates management of an object used in a facility.SOLUTION: A management system according to the present disclosure includes: means for acquiring image data indicating a predetermined area; means for specifying at least one person and at least one object included in the image data; means for analyzing a relationship between at least one person and at least one object; means for managing work information in which information related to a worker and information related to a work object are associated with each other when an analysis result is obtained that the image data includes the worker and the work object related to the work of the worker; and means for outputting the work information.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to a management system, a management device, a management method, and a program. [Background technology]

[0002] Pallets are often used to receive and ship cargo at logistics centers. When rental pallets are used for receiving and shipping cargo, the business that rents the pallets must accurately manage the number of pallets in order to return them.

[0003] Cited Document 1 discloses identifying an ID tag attached to a pallet. Furthermore, Cited Document 1 discloses that the ID information of the ID tag identified by the terminal is transmitted to an information management server, and the information management server manages the ID information. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 2019-101693 Summary of the Invention [Problem to be solved by the invention]

[0005] Pallets used in logistics centers are generally rented from multiple businesses. When managing pallets rented from multiple businesses using ID tags, managers at the logistics center must manage pallets with the same ID tag attachment locations and information set on the ID tags across the multiple businesses. Standardizing the ID tag attachment locations and information set on the ID tags for pallets from multiple businesses places a burden on the businesses that rent out the pallets, making it difficult for managers at the logistics center to manage pallets rented from various businesses.

[0006] An object of the present disclosure is to provide a management system, a management device, a management method, and a program that can facilitate the management of items used within a facility. [Means for solving the problem]

[0007] The management system according to the present disclosure includes a means for acquiring image data showing a predetermined area, a means for identifying at least one person and at least one object included in the image data, a means for analyzing the relationship between the at least one person and the at least one object, and, when an analysis result indicates that the image data includes a worker and a work object related to the worker's work, a means for managing work information that associates the worker with information related to the work object, and a means for outputting the work information.

[0008] The management device according to the present disclosure includes an identification unit that identifies at least one person and at least one object included in image data showing a specified area, an analysis unit that analyzes the relationship between the at least one person and the at least one object, a management unit that, when the analysis result indicates that the image data includes a worker and a work object related to the worker's work, manages work information that associates the worker with information related to the work object, and an output unit that outputs the work information.

[0009] The management method disclosed herein identifies at least one person and at least one object contained in image data showing a specified area, analyzes the relationship between the at least one person and the at least one object, and if the analysis result indicates that the image data includes a worker and a work object related to the worker's work, manages work information that associates the worker with information related to the work object and outputs the work information.

[0010] The program disclosed herein causes a computer to identify at least one person and at least one object contained in image data showing a specified area, analyze the relationship between the at least one person and the at least one object, and if the analysis result indicates that the image data includes a worker and a work object related to the worker's work, manage work information that associates the worker with information related to the work object and output the work information. [Effects of the Invention]

[0011] The present disclosure makes it possible to provide a management system, a management device, a management method, and a program that can easily manage items used within a facility. [Brief explanation of the drawings]

[0012] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of a management system. [Figure 2] FIG. 2 is a flowchart showing the flow of a management method executed in the management system. [Figure 3] Figure 3 shows a configuration diagram of the pallet management system. [Figure 4] FIG. 4 shows image data in which people and objects have been identified. [Figure 5] Figure 5 shows image data taken at the site where workers were retrieving pallets. [Figure 6] FIG. 6 is a table showing people and things identified by the identification means. [Figure 7]FIG. 7 shows a table in which management companies are associated with each identified pallet. [Figure 8] FIG. 8 shows work information that associates a person who is determined to be a worker who performed loading work in a work area with a pallet or the like that is determined to be a work target in the work area. [Figure 9] FIG. 9 shows information managed by the management means. [Figure 10] FIG. 10 shows a pallet slip that reflects the work information. [Figure 11] FIG. 11 is a block diagram showing an example of the configuration of a management system. DETAILED DESCRIPTION OF THE INVENTION

[0013] (Embodiment 1) FIG. 1 is a diagram showing an example of the configuration of a management system 10. The management system 10 may have at least one computer device. The computer device may be software or a module in which processing is performed by a processor executing a program stored in a memory. When the management system 10 has two or more computer devices, the respective computer devices may communicate with each other via a network. The management system 10 may be configured on the cloud. Alternatively, the management system 10 may be configured within a facility such as a logistics center.

[0014] The management system 10 has an acquisition means 11, an identification means 12, an analysis means 13, a management means 14, and an output means 15. The acquisition means 11, the identification means 12, the analysis means 13, the management means 14, and the output means 15 may be an acquisition unit, an identification unit, an analysis unit, a management unit, and an output unit, respectively. The acquisition unit, the identification unit, the analysis unit, the management unit, and the output unit may be software or modules whose processing is performed by a processor executing a program stored in memory. Alternatively, the acquisition unit, the identification unit, the analysis unit, the management unit, and the output unit may be hardware such as a circuit or a chip.

[0015] The acquisition means 11, the identification means 12, the analysis means 13, the management means 14, and the output means 15 may be provided in one computer device, or may be distributed across two or more computer devices.

[0016] The acquisition means 11 acquires image data indicating a predetermined area. The acquisition unit may be used as a means for acquiring image data indicating a predetermined area. The predetermined area may be an area imaged by an imaging device. The predetermined area may be, for example, an indoor area or an outdoor area. The indoor area may be a logistics center, a distribution center, a factory, etc. Furthermore, the predetermined area may be a mixed area of an outdoor area where delivery trucks, etc. are parked and an indoor area where packages are sorted, etc.

[0017] The image data is data generated by an imaging device and may be a two-dimensional image or a three-dimensional image. The acquisition means 11 may be, for example, an imaging device. Alternatively, the acquisition means 11 may be an acquisition unit that acquires image data from an imaging device. The acquisition means 11 may acquire image data from an imaging device via a network, or may acquire image data from an imaging device connected via a cable or the like.

[0018] The identification means 12 identifies at least one person and at least one object included in the image data. The identification unit may be used as a means for identifying at least one person and at least one object included in the image data.

[0019] For example, the identification means 12 may identify at least one person and at least one object using image analysis technology. The image analysis technology may be, for example, facial recognition technology, facial authentication technology, etc. In other words, the identification means 12 may identify a person by recognizing or authenticating the face of the person appearing in image data. The identification means 12 may also identify at least one person or at least one object using AI (Artificial Intelligence) technology. Specifically, the identification means 12 may use a trained model that has been trained using image data showing the characteristics of an object as training data. The trained model may be a learning model that takes image data as input and outputs the name of the object included in the image data.

[0020] Alternatively, the identification unit 12 may identify an object by performing semantic segmentation, which assigns a label of the identified object to each pixel included in the image data. The identification unit 12 may assign a label indicating the object to the pixels that make up the image data.

[0021] When identifying a person, the identification means 12 may identify the person's name, sex, age, etc. When identifying an object, the identification means 12 may identify the object's name, color, material, etc.

[0022] The analysis means 13 analyzes the relationship between at least one person and at least one object. The analysis unit may be used as a means for analyzing the relationship between at least one person and at least one object. Analyzing the relationship may be determining whether the person and the object are related to the same task. In other words, analyzing the relationship may be determining whether the person and the object are related to a worker and a work object related to the worker's task.

[0023] A worker may be, for example, a person engaged in work at a logistics center, a distribution center, a factory, etc. The work of a worker may be the work or task that the worker must perform at a logistics center, a distribution center, a factory, etc. The work of a worker may be, for example, sorting luggage, loading luggage onto a truck, unloading luggage from a truck, etc. The work of a worker includes various tasks and is not limited to sorting luggage, etc. The work object may be an object that is required when the worker performs the work. For example, the work object may be luggage, a pallet on which the luggage is placed, a cart for carrying the luggage, etc. However, the work object is not limited to these objects.

[0024] When the analysis result indicates that the image data includes a worker and a work object related to the worker's work, the management means 14 manages work information that associates information related to the worker and the work object. The management means may be used as a means for managing work information.

[0025] The information related to the work object may be, for example, the name of the work object, the size of the work object, the number of the work object, the management company of the work object, the material of the work object, etc. Associating may be rephrased as corresponding.

[0026] The output means 15 outputs the work information. The output unit may be used as a means for outputting the work information. Outputting the work information may mean, for example, outputting the work information to a display unit such as a display. Alternatively, the output means 15 may output paper on which the work information is printed. Alternatively, the output means 15 may transmit the work information to another computer device via a network. The work information may, for example, be in the form of a table showing workers and work objects related to the work object.

[0027] Next, the flow of the management method executed in the management system 10 will be described with reference to Fig. 2. Fig. 2 is a flowchart showing the flow of the management method executed in the management system 10.

[0028] First, the acquisition means 11 acquires image data showing a predetermined area (S11). Next, the identification means 12 identifies at least one person and at least one object included in the image data (S12). Next, the analysis means 13 analyzes the relationship between the at least one person and at least one object (S13). Next, if the analysis result indicates that the image data includes a worker and a work object related to the worker's work, the management means 14 manages work information that associates information related to the worker and the work object (S14). Next, the output means 15 outputs the work information (S15).

[0029] As described above, the management system 10 analyzes the relationships between people and objects contained in the image data. Furthermore, as a result of analyzing the relationships, the management system 10 manages work information that associates information related to workers and work objects related to the work of the workers.

[0030] In this way, by analyzing the image data, the management system 10 can easily manage work information that associates the workers included in the image data with the work objects related to the work of the workers. For example, the management system 10 can manage the number of work objects handled by the workers. Furthermore, even if the image data includes multiple work objects managed by different management companies, the management system 10 can manage the number of work objects for each management company by analyzing the image data.

[0031] (Embodiment 2) Next, a method and system for efficiently managing pallets will be described. Fig. 3 shows a configuration diagram of a pallet management system. The pallet management system includes a management device 20, a camera 30, and a network 40.

[0032] The management device 20 may be a computer device that operates when a processor executes a program stored in a memory. In FIG. 3, the camera 30 captures an image of the work area 50. The camera 30 transmits image data showing the work area 50 to the management device 20 via a network 40. The camera 30 may be mounted on a communication terminal such as a smartphone terminal. The network 40 may be an open network such as the Internet, or may be a closed network that is confined to a facility or the like that includes the work area 50. The network may be, for example, an IP network.

[0033] The management device 20 may be arranged on a cloud or in a cloud environment. Alternatively, the management device 20 may be arranged on a closed network that is closed to a facility or the like that includes the work area 50. The management device 20 arranged on a closed network that is closed to a facility or the like that includes the work area 50 may be referred to as an edge terminal, for example.

[0034] The work area 50 is used as a place where workers load cargo onto a truck. The worker loads cargo together with pallets onto the truck, for example, from the side of the truck bed or the back of the truck bed. Alternatively, the work area 50 may be used as a place where workers unload cargo together with pallets from a truck. Alternatively, the work area 50 may be used as a place where workers load only recovered pallets onto a truck. Alternatively, the work area 50 may be used as a place where workers unload pallets that do not have cargo on them from a truck. Alternatively, the work area 50 may be used as a place where workers load cargo into a container or unload cargo from a container.

[0035] The camera 30 may be connected to the network 40 via a wired line or a wireless line. The management device 20 may also be connected to the network 40 via a wired line or a wireless line.

[0036] The camera 30 may be a device used as the acquisition means 11 in FIG. 1. The management device 20 may be a device equipped with the functions realized by the identification means 12, analysis means 13, management means 14, and output means 15 in FIG. 1. In other words, the management device 20 may have an identification unit, an analysis unit, a management unit, and an output unit. Alternatively, the management device 20 may be a group of devices composed of multiple computer devices. In this case, the functions realized by the identification means 12, analysis means 13, management means 14, and output means 15 may be distributed and installed in multiple devices. The functions realized by the identification means 12, analysis means 13, management means 14, and output means 15 may be distributed and installed in computer devices and edge terminals arranged in a cloud environment.

[0037] The identification means 12 in the management device 20 receives image data transmitted from the camera 30. Furthermore, the identification means 12 identifies people and objects contained in the image data. The image data is data indicating the work area 50. Here, the person and object identification process executed by the identification means 12 will be described with reference to FIG. 4. FIG. 4 shows image data in which people and objects have been identified.

[0038] 4 may be a two-dimensional image, or may be frame images constituting video data obtained by photographing the working area 50.

[0039] The identification means 12 identifies the truck 61, the luggage 62, the pallet 63, the luggage 64, the pallet 65, the cart 66, the person 71, and the person 72 included in the image data 51. Identifying may be rephrased as identifying or recognizing.

[0040] The image data 51 is an image captured when the door of the loading platform of the truck 61 is open. Therefore, the image data 51 shows a package 62 and a pallet 63 loaded on the truck 61. In Fig. 4, the package 62 and the pallet 63 represent one package and one pallet, but all packages loaded on the truck 61 are referred to as package 62, and all pallets are referred to as pallets 63. The packages and pallets loaded on the truck may be referred to as packages 62_1 to n (n is a positive integer) and pallets 63_1 to n.

[0041] The identification means 12 analyzes the image data 51 using an image analysis technique. For example, the identification means 12 may recognize people and objects included in the image data 51 by extracting feature amounts of the people and objects included in the image data 51. For example, HOG (Histograms of Oriented Gradients) or SIFT (Scaled Invariance Feature Transform) may be used as the feature amount.

[0042] Furthermore, the identification means 12 may analyze the extracted feature amounts to identify the types or names of people and objects included in the image data 51. Analyzing the feature amounts may involve classifying the feature amounts according to the feature amount values or patterns indicated by the feature amount values. The example in Figure 4 shows that the identification means 12 has identified two people, a truck, multiple packages and pallets included in the truck, a dolly, and packages and pallets loaded on the dolly.

[0043] Alternatively, the identification unit 12 may identify a person by recognizing the person's face using facial recognition technology or facial authentication technology. In the facial recognition technology or facial authentication technology, for example, the identification unit 12 may extract facial features. Furthermore, the identification unit 12 may analyze the facial features to identify two faces. For example, when the facial features of person 71 and person 72 are registered in advance in the management device 20, the identification unit 12 may determine whether the person included in the image data 51 corresponds to person 71 or person 72.

[0044] Alternatively, the identification unit 12 may identify an object using identification information attached to or provided on the object. For example, the identification unit 12 may identify multiple objects by reading a two-dimensional code such as a barcode or a QR (Quick Response) code.

[0045] Alternatively, the identification means 12 may perform image analysis using AI technology. In image analysis using AI technology, images of the work area 50, images of vehicles, images of pallets, images of luggage, etc. may be used to extract features from each image, and a trained model that has learned to further analyze the features may be used. Alternatively, the identification means 12 may identify people and objects included in the image data 51 by performing semantic segmentation. Identifying people and objects included in the image data 51 may mean assigning a label indicating the name of the object to each pixel that makes up the image data 51.

[0046] So far, the operation or function of the identification means 12 has been described using image data 51 captured on camera of a scene where workers are loading luggage onto a truck. Here, we will describe image data 52 captured on camera of a scene where workers are retrieving a pallet. FIG. 5 shows image data captured on camera of a scene where workers are retrieving a pallet. The image data 52 shows a person 71 loading only the pallet onto a truck 61. The identification means 12 identifies people and objects contained in image data 52, similarly to the image data 51 captured on camera of a scene where workers are loading luggage onto a truck, for the image data 52 captured on camera of a scene where workers are retrieving a pallet.

[0047] When the identified items are pallets and packages, the identification means 12 may further identify the number of pallets and packages. The identification means 12 may also identify the type of pallet. Specifically, the identification means 12 may identify the management company of the pallet identified as the type of pallet. For example, the identification means 12 may identify the pallet and also the management company of the pallet by using a learning model that has learned images of pallets for each management company.

[0048] Alternatively, the identification means 12 may identify the management company of a pallet by determining predetermined reference values for the feature quantities of the pallet for each management company and comparing the feature quantities extracted from image data 51 with the predetermined reference values for the feature quantities. Alternatively, if different identification information is indicated on the pallet for each management company, the identification means 12 may identify the management company of the pallet by reading the identification information. Furthermore, if the color of the pallet differs for each management company, the identification means 12 may identify the management company of the pallet based on the color of the pallet. Alternatively, the identification means 12 may identify the management company of each pallet by determining whether the number of holes, the shape of the holes, etc. on the pallet match the number of holes and the shape of the holes on pallets of each management company registered in advance.

[0049] The identification means 12 may manage or organize the identified people and objects as shown in FIG. 6. FIG. 6 is a table showing people and objects identified by the identification means 12. The identification means 12 may generate data in the form of a table as shown in FIG. 6. The person column in FIG. 6 shows people 71 and people 72. The object column in FIG. 6 shows pallets, carts, and luggage. The management company column in FIG. 6 shows Company A and Company B as management companies for the pallets. For carts and luggage, information corresponding to the management company has not been identified, so no company information is shown. The number column in FIG. 6 shows the number of each object.

[0050] Alternatively, the identification means 12 may associate a management company with each pallet. Fig. 7 shows a table in which a management company is associated with each identified pallet. Pallets 63_1 to 63_6 indicate pallets 63 loaded onto a truck 61. Parcels 62_1 to 62_6 indicate parcels 62 loaded onto a truck 61.

[0051] The analysis means 13 analyzes the relationship between the person and the object identified by the identification means 12. Here, an example will be described in which the analysis means 13 determines whether the person and the object identified by the identification means 12 are related to the loading work being performed in the work area 50. For example, the analysis means 13 determines whether the person's movement corresponds to a movement that a worker may perform when performing work in the work area 50.

[0052] The analysis means 13 may perform analysis, for example, regarding the objects operated by the person 71 and the person 72, the movement directions of the person 71 and the person 72, etc. Specifically, the analysis means 13 may determine whether the person 71 and the person 72 are moving toward the truck 61, and further whether they are moving away from the truck 61.

[0053] The analysis means 13 may determine that the person 71 and the person 72 are moving toward the truck 61 when the direction of the person's face or the direction of the person's toes are facing toward the truck 61. Furthermore, the analysis means 13 may determine that the person 71 and the person 72 are moving away from the truck 61 when the direction of the person's face or the direction of the person's toes are facing away from the truck 61.

[0054] Furthermore, the analysis means 13 may determine that the person 71 and the person 72 are moving closer to the truck 61 when the positions of the heads of the person 71 and the person 72 are closer to the truck 61 than the positions of the centers of gravity of the person 71 and the person 72. Furthermore, the analysis means 13 may determine that the person 71 and the person 72 are moving away from the truck 61 when the positions of the centers of gravity of the person 71 and the person 72 are closer to the truck 61 than the positions of the heads of the person 71 and the person 72.

[0055] The analysis means 13 may determine that a person determined to be moving toward the truck 61 or a person determined to be moving away from the truck 61 is related to the loading of luggage being performed in the work area 50. In the example of FIG. 4, the analysis means 13 may determine that the person 71 is related to the loading of luggage being performed in the work area 50. On the other hand, the analysis means 13 may determine that the person 72 is not related to the loading of luggage being performed in the work area 50. The person 72 may be, for example, a security guard guarding the work area 50.

[0056] Furthermore, the analysis means 13 may determine that the cart 66 operated by the person 71, and further the luggage 64 and pallet 65 loaded on the cart 66, are also related to the luggage loading work being performed in the work area 50. The person 71 is a person who has already been determined to be related to the luggage loading work being performed in the work area 50.

[0057] Alternatively, the analysis means 13 may determine that the person 71 moving together with the dolly 66, or the person 71 moving together with the dolly 66 and the pallet 65, or the person 71 moving together with the dolly 66, the pallet 65, and the luggage 64, is related to the luggage loading operation. Furthermore, the analysis means 13 may determine that the dolly 66, the pallet 65, and the luggage 64 moving together with the person 71 are related to the luggage loading operation.

[0058] Furthermore, the analysis means 13 may determine that the luggage 62 and pallets 63 stored in the truck 61 are also related to the luggage loading work being performed in the work area 50. The luggage 62 and pallets 63 being stored in the truck 61 may mean that the area where the luggage 62 and pallets 63 exist overlaps with the area identified as the truck 61.

[0059] The analysis means 13 may use AI technology to analyze the relationship between people and objects. In the analysis using AI technology, a trained model that has trained images showing the workers performing work in the work area 50 and the work objects may be used. Learning images showing the workers may mean learning the movements of the workers, the direction of movement of the workers, etc.

[0060] The management means 14 associates the person 71, pallet, cart, and luggage determined to be involved in the loading of luggage as work information and manages them. Fig. 8 shows work information that associates the person 71 determined to be the worker who performed the loading of luggage in the work area 50 with the pallet, etc. determined to be the work object in the work area 50.

[0061] Furthermore, the management means 14 may manage the information shown in Fig. 9 in addition to the work information shown in Fig. 8. Fig. 9 shows information managed by the management means 14. Fig. 9 shows that a camera 30 is being used to photograph a work area 50. It also shows that a truck 61 is parked in the work area 50. Fig. 9 also shows that a camera 31 is being used to photograph a work area 80. It also shows that a vehicle 91 is parked in the work area 80. The work area 80 and the vehicle 91 are not shown in the figure.

[0062] The location where the camera 30 is installed is determined in advance. Therefore, the management means 14 may manage information relating the camera 30 to the work area 50 in advance, as shown in Fig. 9. Furthermore, the management means 14 may add the truck 61 identified by the identification means 12 using image data acquired from the camera 30 to the line of vehicles associated with the work area 50 shown in Fig. 9. Furthermore, if it is determined in advance that the vehicle parked in the work area 50 is a truck 61, the management means 14 may manage information relating to the camera, the work location, and the vehicle in advance.

[0063] The output means 15 outputs the work information in a predetermined format. Figure 10 shows a pallet slip that reflects the work information. The pallet slip in Figure 10 indicates the number of pallets handled by the worker 71 who performed the loading work in the work area 50, and the pallet management company.

[0064] The work location information shown in Fig. 9 is set in the work location field of the pallet slip. The vehicle information shown in Fig. 9 is set in the vehicle field of the pallet slip. The worker information shown in Fig. 8 is set in the worker field of the pallet slip. The management company and number information shown in Fig. 8 is set in the management company and number field of the pallet slip.

[0065] The output means 15 may output a pallet slip as a work report by the person 71 who has completed work in the work area 50. For example, the output means 15 may receive input of the person 71 and the work area 50, and generate a pallet slip that reflects the information in Fig. 8 associated with the person 71 and the information in Fig. 9 associated with the work area 50.

[0066] As described above, management device 20 manages the number of pallets handled by person 71 who worked in work area 50 as a worker. Furthermore, management device 20 outputs a pallet slip indicating the number of pallets handled by person 71. This makes it possible to accurately manage the number of pallets handled by person 71 compared to when person 71 self-reports the number of pallets handled by person 71. As a result, it becomes possible to prevent pallets from being lost. Furthermore, even if a pallet is lost, because the pallet is managed in association with the worker who handled the pallet, it is possible to clarify who is responsible for the loss of the pallet.

[0067] (Embodiment 3) Next, a process related to the evaluation of a worker will be described. The identification means 12 may identify the condition of the object when identifying the object. The condition of the object may be, for example, whether a pallet, luggage, cart, etc. is not damaged, or whether the pallet and luggage are neatly stored in the truck. "Neatly stored" may be rephrased as "arranged in an orderly manner." Alternatively, "neatly stored" may be rephrased as "stored within a specific area," or "there is no luggage protruding from a specific area," or the like.

[0068] The identification means 12 may identify the condition of an object using a trained model trained by inputting images showing an object in a damaged state and an object in an undamaged state. Alternatively, the identification means 12 may identify the condition of an object using a trained model trained by inputting images showing packages and pallets arranged in an orderly manner in a truck and images showing packages and pallets arranged in an orderly manner.

[0069] The analysis means 13 may analyze the number and degree of damage, etc., to evaluate the work content. The evaluation of the work content may be indicated, for example, using a score, or may be indicated using multiple levels, such as high and low ratings. The analysis means 13 may evaluate the work content using a learning model that inputs image data of work objects such as pallets, loading platforms, and carts, and outputs a score according to the number and degree of damage, etc. The management means 14 may manage the people 71 determined to be involved in the loading work of cargo performed in the work area 50 in association with the evaluation of the work content. Furthermore, the output means 15 may reflect the worker's evaluation of the work content in the slip when outputting a pallet slip or another slip, etc.

[0070] Furthermore, the image data on which the work content has been evaluated may be used as training data for a learning model for evaluating the work content. The learning model for evaluating the work content may be, for example, a learning model for determining a score for the work content.

[0071] As described above, the management device 20 performs a work evaluation of the worker contained in the image data. Information related to the work evaluation can be used for future assessments of the worker's training, salary, etc.

[0072] FIG. 11 is a block diagram showing an example of the configuration of the management system 10 and management device 20 (hereinafter referred to as the management system 10, etc.) described in the above-mentioned embodiment. Referring to FIG. 11, the management system 10, etc. includes a network interface 1201, a processor 1202, and a memory 1203. The network interface 1201 may be used to communicate with a network node. The network interface 1201 may include, for example, a network interface card (NIC) that complies with the IEEE 802.3 series. IEEE stands for Institute of Electrical and Electronics Engineers.

[0073] The processor 1202 reads and executes software (computer programs) from the memory 1203 to perform the processing of the management system 10 described using the flowcharts. The processor 1202 may be, for example, a microprocessor, an MPU, or a CPU. The processor 1202 may include multiple processors.

[0074] The memory 1203 is configured by a combination of volatile memory and non-volatile memory. The memory 1203 may include storage located remotely from the processor 1202. In this case, the processor 1202 may access the memory 1203 via an I / O (Input / Output) interface (not shown).

[0075] 11, the memory 1203 is used to store software modules. The processor 1202 reads and executes these software modules from the memory 1203, thereby performing the processing of the management system 10 and the like described in the above-described embodiment.

[0076] As explained using FIG. 11, each of the processors possessed by the management system 10 etc. in the above-described embodiment executes one or more programs including a group of instructions for causing a computer to perform the algorithm explained using the drawings.

[0077] In the above examples, the program includes instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more functions described in the embodiments. The program may be stored on a non-transitory computer-readable medium or a tangible storage medium. By way of example and not limitation, computer-readable media or tangible storage media include random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD), or other memory technologies. Furthermore, computer-readable media or tangible storage media include CD-ROMs, digital versatile discs (DVDs), Blu-ray discs, or other optical disk storage, magnetic cassettes, magnetic tapes, magnetic disk storage, or other magnetic storage devices. The program may also be transmitted on a transitory computer-readable medium or a communication medium. By way of example and not limitation, transitory computer-readable media or communication media include electrical, optical, acoustic, or other forms of propagated signals.

[0078] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0079] Each drawing is merely an example for describing one or more embodiments. Each drawing may relate not only to one particular embodiment, but also to one or more other embodiments. As will be understood by those skilled in the art, various features or steps described with reference to any one drawing can be combined with features or steps shown in one or more other drawings to create, for example, an embodiment not explicitly shown or described. Not all features or steps shown in any one drawing are necessary to describe an exemplary embodiment, and some features or steps may be omitted. The order of steps described in any drawing may be changed as appropriate.

[0080] A part or all of the above-described embodiments can be described as, but not limited to, the following supplementary notes. (Appendix 1) means for acquiring image data representing a predetermined area; means for identifying at least one person and at least one object included in the image data; means for analyzing a relationship between the at least one person and the at least one object; a means for managing work information that associates information related to the worker and the work object when an analysis result indicates that the image data includes a worker and a work object related to the worker's work; and means for outputting the work information. (Appendix 2) The work object is 10. The management system according to claim 1, which is a pallet used for transporting goods. (Appendix 3) The information relating to the work content by the worker is 3. The management system according to claim 1, wherein the information indicates at least one of the number and type of the work objects. (Appendix 4) The analyzing means includes: 4. The management system of any one of appendices 1 to 3, which determines whether the actions of the at least one person correspond to actions that the worker may perform when performing work. (Appendix 5) The actions that the worker may perform when performing the work include: The management system of Appendix 4 includes at least one of the following actions: moving away from a vehicle transporting the work object, moving toward the vehicle, and moving together with the work object. (Appendix 6) The work is 3. The management system of claim 2, including at least one of the following operations: storing the loaded pallet in a vehicle; unloading the loaded pallet from a vehicle; storing an unloaded pallet in a vehicle; and unloading an unloaded pallet from a vehicle. (Appendix 7) The analyzing means includes: 7. The management system of any one of appendices 1 to 6, which evaluates work performed by the worker. (Appendix 8) The analyzing means includes: The management system described in any one of appendix 1 to 7, which evaluates the work performed by the worker using a learning model that inputs the image data including the work object and outputs an evaluation of the work content performed by the worker. (Appendix 9) an identification unit that identifies at least one person and at least one object included in image data showing a predetermined area; an analysis unit that analyzes a relationship between the at least one person and the at least one object; a management unit that manages work information that associates information related to the worker and the work object when an analysis result indicates that the image data includes a worker and a work object related to the worker; an output unit that outputs the work information. (Appendix 10) Identifying at least one person and at least one object included in image data representing a predetermined area; analyzing a relationship between the at least one person and the at least one object; When an analysis result is obtained that the image data includes a worker and a work object related to the work of the worker, managing work information that associates information related to the worker and the work object; A management method that outputs the work information. (Appendix 11) Identifying at least one person and at least one object included in image data representing a predetermined area; analyzing a relationship between the at least one person and the at least one object; When an analysis result is obtained that the image data includes a worker and a work object related to the work of the worker, managing work information that associates information related to the worker and the work object; and outputting the work information.

[0081] Some or all of the elements (e.g., configurations and functions) described in Supplementary Notes 2 to 8 that are dependent on Supplementary Note 1 may also be dependent on Supplementary Notes 9 and 10 in the same dependency relationship as Supplementary Notes 2 to 8. Some or all of the elements described in any Supplementary Note may be applied to various hardware, software, recording means for recording software, systems, and methods. [Explanation of symbols]

[0082] 10 Management System 11 Acquisition method 12 Specific means 13 Analysis methods 14 Control measures 15 Output Method 20 Management device 30 Camera 40 Network 50 working areas 51 Image data 52 Image data 61 tracks 62 Luggage 63 palettes 64 Luggage 65 palettes 66 Cart 71 people 72 people

Claims

1. means for acquiring image data representing a predetermined area; means for identifying at least one person and at least one object included in the image data; means for analyzing a relationship between the at least one person and the at least one object; a means for managing work information that associates information related to the worker and the work object when an analysis result indicates that the image data includes a worker and a work object related to the worker's work; and means for outputting the work information.

2. The work object is The management system according to claim 1, wherein the object is a pallet used for transporting cargo.

3. The information relating to the work content by the worker is The management system according to claim 1 , wherein the information indicates at least one of the number and type of the work objects.

4. The analyzing means includes: The management system according to claim 1 or 2, further comprising: determining whether or not the motion of the at least one person corresponds to a motion that the worker is likely to perform when performing the work.

5. The actions that the worker may perform when performing the work include: The management system according to claim 4 , further comprising at least one of an action of moving away from a vehicle transporting the work object, an action of moving towards the vehicle, and an action of moving together with the work object.

6. The work is 3. The management system according to claim 2, comprising at least one of an operation of storing the pallet with cargo loaded in a vehicle, an operation of unloading the pallet with cargo loaded from a vehicle, an operation of storing a pallet without cargo loaded in a vehicle, and an operation of unloading a pallet without cargo loaded from a vehicle.

7. The analyzing means includes: The management system according to claim 1 or 2, wherein the work performed by the worker is evaluated.

8. an identification unit that identifies at least one person and at least one object included in image data showing a predetermined area; an analysis unit that analyzes a relationship between the at least one person and the at least one object; a management unit that manages work information that associates information related to the worker and the work object when an analysis result indicates that the image data includes a worker and a work object related to the worker; an output unit that outputs the work information.

9. Identifying at least one person and at least one object included in image data representing a predetermined area; analyzing a relationship between the at least one person and the at least one object; When an analysis result is obtained that the image data includes a worker and a work object related to the work of the worker, managing work information that associates the worker with information related to the work object; A management method that outputs the work information.

10. Identifying at least one person and at least one object included in image data representing a predetermined area; analyzing a relationship between the at least one person and the at least one object; When an analysis result is obtained that the image data includes a worker and a work object related to the work of the worker, managing work information that associates the worker with information related to the work object; and outputting the work information.

Images