Video providing system, video providing method and video providing program

Abstract

To provide a video providing system, a video providing method and a video providing program which can track a factor of erroneous shipment of a commodity in a physical distribution warehouse.SOLUTION: A video providing system is configured to: register identification information on an inspection terminal and identification information on a camera in association with each other; specify, when inspection processing is performed by the inspection terminal, a camera corresponding to the inspection terminal that has performed the inspection processing on the basis of a correspondence between the registered identification information on the inspection terminal and identification information on the camera; register inspection processing information on the inspection processing and video access information for accessing the video of the specified camera in association with each other; specify, when inspection processing of a commodity is confirmed by a user terminal, inspection processing to be confirmed from among a plurality of inspection processing on the basis of information on the commodity; and provide the user terminal with a video indicating the state of the specified inspection processing on the basis of a correspondence between the registered inspection processing information and video access information.SELECTED DRAWING: Figure 9

Description

[Technical field]

[0001] The present disclosure relates to a video providing system, a video providing method, and a video providing program. [Background technology]

[0002] In the logistics industry, erroneous shipment of goods has been a long-standing issue. Here, erroneous shipment of goods refers to the shipment of goods different from the shipment request or goods of a different type. Since erroneous shipment of goods directly leads to complaints from consumers and a decline in the trust of shippers, it is very important in the logistics industry to reduce the occurrence of erroneous shipments and quickly trace the cause of erroneous shipments. In addition, the cause of erroneous shipments often occurs in logistics warehouses. In particular, erroneous shipments often occur during the inspection process of goods, the picking process of goods, and the sorting process of goods in logistics warehouses. On the other hand, tracing the cause of erroneous shipments generally requires a lot of effort. In particular, it requires a lot of effort to extract video data showing the state of the inspection process of the erroneously shipped goods from the video data stored in the server.

[0003] In this regard, Patent Document 1 discloses a warehouse management system that makes it possible to relatively easily extract video data showing the state of inspection of erroneously shipped products. In this warehouse management system, a video data file captured by a camera installed in a logistics warehouse is associated with a location code that identifies a work location (e.g., an inspection processing location), and an identification code of the product and the location code are associated with each other and recorded in the management data. In this way, the warehouse management system disclosed in Patent Document 1 makes it possible to extract video data related to the identification code of a erroneously shipped product from the video data stored in the management server using the location code as a key. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2017-052647 A Summary of the Invention [Problem to be solved by the invention]

[0005] On the other hand, in the warehouse management system disclosed in Patent Document 1, it is necessary to add a location code as attribute data of the image data file of the camera through a location code setting screen, and to optically read a barcode indicating a location code attached to a work location using a handheld terminal before inspecting the product. Thus, in this warehouse management system, the work of associating a location code with each of the product's identification code and the video data file is time-consuming. From the above viewpoint, there is room to consider a new video providing system based on a different principle from the system disclosed in Patent Document 1. Furthermore, there is room to consider a video providing system that can extract video data related to a product that has been erroneously shipped without using data transmitted from an inspection terminal such as a handheld terminal.

[0006] In view of the above-mentioned viewpoints, the present disclosure aims to provide a video provision system, a video provision method, and a video provision program capable of tracing the cause of erroneous shipment of goods in a logistics warehouse. [Means for solving the problem]

[0007] A video providing system according to an aspect of the present disclosure provides a user terminal with a video captured by a camera installed in a logistics warehouse, showing the state of inspection processing of goods by an inspection terminal. The video providing system registers identification information of the inspection terminal and identification information of the camera in association with each other, and when performing inspection processing by the inspection terminal, identifies a camera corresponding to the inspection terminal that performed the inspection processing based on the correspondence between the registered identification information of the inspection terminal and the identification information of the camera, and registers inspection processing information related to the inspection processing and video access information for accessing the video of the identified camera in association with each other, and when checking the inspection processing of goods by the user terminal, identifies an inspection processing to be checked from among multiple inspection processing based on information about the goods, and provides the user terminal with a video showing the state of the identified inspection processing based on the correspondence between the registered inspection processing information and the video access information.

[0008] According to the above configuration, even if a product is shipped erroneously, the user can trace the cause of the product's erroneous shipment by checking the video showing the product's inspection process on the user terminal. In this way, a video providing system can be provided that can trace the cause of a product's erroneous shipment in a logistics warehouse through the video transmitted to the user terminal.

[0009] Moreover, the video access information may include identification information of the specified camera. In this manner, the video captured by the camera corresponding to the inspection terminal that performed the inspection process is provided to the user terminal.

[0010] The video access information may include time information indicating a time when the inspection process was performed. In this manner, at the time when the inspection process was performed, a video captured by a camera corresponding to the inspection terminal that performed the inspection process is provided to the user terminal.

[0011] The video access information may also include domain information indicating the address of a server on which the video is stored.

[0012] In this way, the video can be acquired from the user terminal by accessing the server where the video is stored. Therefore, by slightly improving an existing logistics management system that does not manage video, it is possible to build a video providing system that can track the status of product inspection processing in a logistics warehouse at a relatively low cost.

[0013] The video access information may be in the form of a URL. In this way, the video showing the inspection process of the product can be easily and quickly obtained through the video access information, which dramatically improves the usability of the video providing system.

[0014] In addition, the information regarding the product may include at least one of identification information of the product, identification information regarding an order for the product, information indicating the product name of the product, information indicating the product type of the product, information indicating the shipping destination of the product, information indicating the shipping date of the product, and information indicating the arrival date of the product.

[0015] According to the above configuration, a video showing the state of the inspection process of the product is provided to the user terminal based on at least one of the product identification information, order identification information, product name, product type, shipping destination, shipping date, and arrival date. Therefore, the user can track down the cause of the erroneous shipment of the product by checking the video.

[0016] The video providing system may set an inspection processing area where the inspection processing is to be performed. In this manner, it is possible to clearly identify the inspection processing area in the video where the inspection processing is to be performed.

[0017] The video providing system may also display the inspection processing area in an identifiable manner in the video. In this manner, a user can clearly understand the status of the inspection processing of the product through the identifiable displayed inspection processing area.

[0018] The video providing system may also enlarge and display the inspection processing area in the video. In this way, the user can more clearly grasp the state of the inspection processing of the product through the enlarged inspection processing area.

[0019] Furthermore, the video providing system may display only the inspection processing area in the video. In this manner, since only the inspection processing area is displayed, it is possible to preferably prevent an outsider who is not related to the logistics warehouse from seeing the surrounding environment of the logistics warehouse other than the inspection processing area (for example, a trade secret in the logistics warehouse from being known by an outsider).

[0020] A video providing system according to one aspect of the present disclosure provides a user terminal with a video showing a state of picking a commodity in a material handling device, which is taken by a camera installed in a logistics warehouse. The video providing system registers identification information of the material handling device and identification information of the camera in association with each other, and when performing material handling control for picking on the material handling device, identifies a camera corresponding to the material handling device that is the target of the material handling control based on the correspondence between the registered identification information of the material handling device and the identification information of the camera, and registers control information related to the material handling control and video access information for accessing the video of the identified camera in association with each other. When checking the picking of the commodity by the user terminal, the system identifies a material handling control corresponding to the picking to be checked from among multiple material handling controls based on information about the commodity, and provides the user terminal with a video showing a state of the picking work corresponding to the identified material handling control based on the correspondence between the registered control information and the video access information.

[0021] According to the above configuration, even if a product is erroneously shipped, the user can trace the cause of the erroneous shipment by checking the video showing the product picking operation in the material handling device on the user terminal. In this way, a video providing system can be provided that can trace the cause of a product erroneous shipment in a logistics warehouse through the video transmitted to the user terminal.

[0022] The video access information may include identification information of the specified camera. In this manner, the video captured by the camera corresponding to the material handling device that is the target of the material handling control is provided to the user terminal.

[0023] The image access information may include time information indicating a time when the picking of the commodity in the material handling device is performed. In this manner, an image showing the state of the material handling device that is the target of material handling control at the time when the commodity is picked in the material handling device is provided to the user terminal.

[0024] The video access information may also include domain information indicating the address of the server in which the video is stored. Therefore, by slightly improving an existing logistics management system in which video is not managed, it is possible to build a video providing system at a relatively low cost that can track the process of picking up products by a material handling device.

[0025] The video access information may be in the form of a URL. In this way, the video access information can be used to easily and quickly obtain a video showing the process of picking up a product by a material handling device, thereby dramatically improving the usability of the video providing system.

[0026] In addition, the information regarding the product may include at least one of identification information of the product, identification information regarding an order for the product, information indicating the product name of the product, information indicating the product type of the product, information indicating the shipping destination of the product, information indicating the shipping date of the product, and information indicating the arrival date of the product.

[0027] According to the above configuration, a video showing the state of the product picking operation in the material handling device is transmitted to the user terminal based on at least one of the product identification information, the order identification information, the product name, the product type, the shipping destination, the shipping date, and the arrival date. Therefore, the user can check the video to trace the cause of the erroneous shipment of the product.

[0028] The image providing system may set an area in which the material handling device is located. In this way, it is possible to clearly identify the area in which the material handling device is located in the image.

[0029] The image providing system may also display the placement area in an identifiable manner in the image. In this manner, a user can clearly understand the state of the product picking operation by the material handling device through the identifiable displayed placement area.

[0030] The image providing system may also enlarge and display the arrangement area in the image, so that the user can more clearly grasp the state of the product picking operation by the material handling device through the enlarged arrangement area.

[0031] The video providing system may display only the placement area in the video. In this manner, since only the placement area of ​​the material handling device is displayed, it is possible to preferably prevent an outsider who is not related to the logistics warehouse from seeing the surrounding environment of the logistics warehouse other than the placement area. Therefore, it is possible to preferably prevent, for example, trade secrets in the logistics warehouse from being unexpectedly discovered by an outsider.

[0032] A video providing system according to another aspect of the present disclosure provides a user terminal with a video captured by a camera installed in a logistics warehouse, showing a state of a predetermined processing of a product by a predetermined device. The video providing system registers identification information of the predetermined device and identification information of the camera in association with each other, and when a predetermined processing is performed by the predetermined device, identifies a camera corresponding to the predetermined device that performed the predetermined processing based on the correspondence between the registered identification information of the predetermined device and the identification information of the camera, and registers predetermined processing information related to the predetermined processing and video access information for accessing the video of the identified camera in association with each other, and when the user terminal checks the predetermined processing of the product, identifies a predetermined processing to be checked from among multiple predetermined processing based on information about the product, and provides the user terminal with a video showing the state of the identified predetermined processing based on the correspondence between the registered predetermined processing information and the video access information.

[0033] A video providing method according to one aspect of the present disclosure is executed by a computer, and provides a user terminal with a video captured by a camera installed in a logistics warehouse and showing a state of inspection processing of a commodity by an inspection terminal. The video providing method includes the steps of: registering identification information of the inspection terminal and identification information of the camera in association with each other; when performing an inspection processing by the inspection terminal, identifying a camera corresponding to the inspection terminal that performed the inspection processing based on the correspondence between the registered identification information of the inspection terminal and the identification information of the camera; registering inspection processing information related to the inspection processing and video access information for accessing the video of the identified camera in association with each other; when checking the inspection processing of the commodity by the user terminal, identifying an inspection processing to be confirmed from among a plurality of inspection processing based on information related to the commodity; and providing the user terminal with a video showing the state of the identified inspection processing based on the correspondence between the registered inspection processing information and the video access information.

[0034] A video providing method according to one aspect of the present disclosure is executed by a computer, and provides a user terminal with a video showing a state of picking a commodity in a material handling device, which is taken by a camera installed in a logistics warehouse. The video providing method includes a step of registering identification information of the material handling device and identification information of the camera in association with each other, a step of identifying a camera corresponding to a material handling device that is a target of the material handling control when performing material handling control for picking on the material handling device based on the correspondence between the identification information of the registered material handling device and the identification information of the camera, a step of registering control information related to the material handling control and video access information for accessing the video of the identified camera in association with each other, a step of identifying a material handling control corresponding to the picking to be confirmed from among a plurality of material handling controls based on information related to the commodity when confirming the picking of the commodity by the user terminal, and a step of providing the user terminal with a video showing a state of the picking work corresponding to the identified material handling control based on the correspondence between the registered control information and the video access information.

[0035] A video providing program for causing a computer to execute the video providing method may be provided. Effect of the Invention

[0036] According to the present disclosure, it is possible to provide a video provision system, a video provision method, and a video provision program capable of tracing the cause of a misshipment of a product in a logistics warehouse. [Brief description of the drawings]

[0037] [Figure 1] FIG. 1 is a diagram showing a video providing system according to a first embodiment of the present disclosure. [Diagram 2] FIG. 2 is a diagram illustrating an example of a hardware configuration of a camera. [Diagram 3] FIG. 2 illustrates an example of a hardware configuration of a management server. [Figure 4] FIG. 2 is a diagram illustrating an example of a hardware configuration of a video server. [Diagram 5] FIG. 2 is a diagram illustrating an example of a hardware configuration of an inspection terminal. [Figure 6] 10 is a flowchart for explaining the first half of the processing executed by the user terminal, the video server, the management server, and the inspection terminal of the video providing system according to the first embodiment. [Figure 7] FIG. 13 is a diagram showing an example of a camera setting screen. [Figure 8] 1A is a diagram showing an example of a camera correspondence table, and FIG. 1B is a diagram showing an example of a logistics management table. [Figure 9] 10 is a flowchart for explaining the latter half of the process executed by the user terminal, the video server, and the management server of the video providing system according to the first embodiment. [Figure 10] FIG. 4 is a diagram illustrating an example of a product management table. [Figure 11] FIG. 13 is a diagram showing an example of a search result screen for video access information. [Figure 12] FIG. 13 is a diagram showing an example of a video display screen on which video data showing an inspection process is displayed. [Figure 13] FIG. 11 is a diagram showing a video providing system according to a second embodiment of the present disclosure. [Figure 14] 1A is a diagram illustrating an example of a hardware configuration of a material handling device, and FIG. 1B is a diagram illustrating an example of a hardware configuration of a digital display provided in the material handling device. [Figure 15] 11 is a flowchart for explaining the first half of the processing executed by the user terminal, the video server, the management server, and the material handling device of the video providing system according to the second embodiment. [Figure 16] FIG. 13 is a diagram showing an example of a camera setting screen. [Figure 17] 1A is a diagram showing an example of a camera correspondence table, and FIG. 1B is a diagram showing an example of a product position management table. [Figure 18] FIG. 13 is a diagram illustrating an example of a logistics management table. [Figure 19]13 is a flowchart for explaining the latter half of the process executed by the user terminal, the video server, and the management server of the video providing system according to the second embodiment. [Figure 20] FIG. 4 is a diagram illustrating an example of a product management table. [Figure 21] FIG. 13 is a diagram showing an example of a search result screen for video access information. [Figure 22] 1 is a diagram showing an example of a video display screen on which video data showing the state of a material handling device is displayed. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0038] First embodiment Hereinafter, the video providing system 1 according to the first embodiment will be described with reference to the drawings. FIG. 1 is a diagram showing an example of the video providing system 1 according to the present embodiment. As shown in FIG. 1, the video providing system 1 includes a camera 2, a management server 3, a video server 4, an inspection terminal 5, and a user terminal 6. These are connected to a communication network 8. The camera 2 is communicatively connected to the video server 4 via the communication network 8. The management server 3 is communicatively connected to the video server 4, the inspection terminal 5, and the user terminal 6 via the communication network 8. The user terminal 6 is communicatively connected to the management server 3 and the video server 4 via the communication network 8. The communication network 8 is configured by at least one of a LAN (Local Area Network), a WAN (Wide Area Network), the Internet, and a wireless core network. In this regard, the video server 4 is configured as a cloud server, while the management server 3 may be constructed on-premise. Note that, although a plurality of cameras 2 and a plurality of inspection terminals 5 are provided in the video providing system 1 according to the present embodiment, for convenience of explanation, one camera 2 and one inspection terminal 5 are illustrated in FIG. 1.

[0039] (Camera 2 Configuration) Next, the hardware configuration of the camera 2 will be described below. FIG. 2 is a diagram showing an example of the hardware configuration of the camera 2. The camera 2 is installed in a logistics warehouse, and is configured to acquire video data through shooting. In this example, the camera 2 acquires video data showing the inspection process of the product W by the worker K (an example of a predetermined process for the product W) through shooting. A plurality of cameras 2 are installed in the logistics warehouse. Each camera 2 is fixedly installed in a corresponding one of a plurality of areas of the logistics warehouse, and is configured to capture video data showing its surrounding environment. In particular, each camera 2 captures the inspection process in each area.

[0040] 2, camera 2 includes control unit 20, storage device 21, position information acquisition unit 22, communication unit 24, input operation unit 25, imaging unit 26, and PZT mechanism 27, and these elements are connected to communication bus 28. Camera 2 may also include a built-in battery (not shown). Camera 2 may also include a microphone and a speaker.

[0041] The control unit 20 includes a memory and a processor. The memory is configured to store computer-readable instructions (programs). For example, the memory is configured from a ROM (Read Only Memory) in which various programs and the like are stored, and a RAM (Random Access Memory) having multiple work areas in which various programs and the like executed by the processor are stored. The processor is configured from at least one of a CPU (Central Processing Unit), an MPU (Micro Processing Unit), and a GPU (Graphics Processing Unit). The CPU may be configured from multiple CPU cores. The GPU may be configured from multiple GPU cores. The processor may be configured to load a program designated from various programs incorporated in the storage device 21 or the ROM onto the RAM and execute various processes in cooperation with the RAM.

[0042] The storage device 21 is, for example, a storage device (storage) such as a hard disk drive (HDD), a solid state drive (SSD), or a flash memory, and is configured to store programs and various data. The position information acquisition unit 22 is configured to acquire position information of the camera 2, and is, for example, a global positioning system (GPS) receiver. Note that the position information of the camera 2 referred to here may include information regarding the current position (longitude, latitude) of the camera 2.

[0043] The communication unit 24 is configured to connect the camera 2 to the communication network 8. The communication unit 24 includes a wireless communication module for wirelessly communicating with an external device such as a base station or a wireless LAN router. The wireless communication module includes a transmitting / receiving antenna and a signal processing circuit. The wireless communication module may be a wireless communication module compatible with a short-range wireless communication standard such as Wi-Fi (registered trademark) or Bluetooth (registered trademark), or may be a wireless communication module compatible with an X-generation mobile communication system (for example, a fourth-generation mobile communication system such as LTE) using a SIM (Subscriber Identity Module).

[0044] The input operation unit 25 is configured to receive an input operation by an operator and generate an operation signal according to the input operation by the operator. The imaging unit 26 is configured to capture an image of the surrounding environment of the camera 2. In particular, the imaging unit 26 is configured to generate a video signal indicating the surrounding environment of the camera 2, and includes an optical system, an image sensor, and an analog processing circuit. The optical system includes, for example, an optical lens and a color filter. The image sensor includes a CCD (Charge-Coupled Device) or a CMOS (Complementary MOS), etc. The analog processing circuit is configured to process a video signal (analog signal) photoelectrically converted by the image sensor, and includes, for example, an amplifier and an AD converter.

[0045] The PTZ mechanism 27 includes a pan mechanism, a tilt mechanism, and a zoom mechanism. The pan mechanism is configured to change the orientation of the camera 2 in the horizontal direction. The tilt mechanism is configured to change the orientation of the camera 2 in the vertical direction. The zoom mechanism is configured to enlarge (zoom in) or reduce (zoom out) an image showing an object to be captured by changing the angle of view of the camera 2. The zoom mechanism may optically change the angle of view of the camera 2 by changing the focal length of an optical lens included in the imaging unit 26, or may digitally change the angle of view of the camera 2. In this embodiment, in response to an input operation of the user U on the user terminal 6, an instruction signal instructing the camera 2 to pan, tilt, and / or tilt is transmitted from the user terminal 6 to the camera 2 via the video server 4. In this case, the control unit 20 drives the PTZ mechanism 27 in response to the received instruction signal, thereby realizing each function (PTZ function) of the camera 2, i.e., pan, tilt, and zoom, in real time. In this manner, the PTZ function of the camera 2 can be realized through remote control of the user terminal 6.

[0046] The camera 2 can transmit an image (image data stream) showing the surrounding environment of the camera 2 to the management server 3 via the communication network 8 in real time.

[0047] (Administration Server 3 Configuration) Next, the hardware configuration of the management server 3 will be described below. Fig. 3 is a diagram showing an example of the hardware configuration of the management server 3. The management server 3 is a management server for a inventory management system (WMS) for recording and updating logistics management data, and may be composed of multiple servers. In particular, the management server 3 is configured to generate and update an inspection management table for supporting inspection processing, a product management table, a logistics management table, and a camera association table. These table data will be described in detail later.

[0048] 3, the management server 3 includes a control unit 30, a storage device 31, an input / output interface 32, a communication unit 33, an input operation unit , and a display unit 35. These elements are connected to a communication bus .

[0049] The control unit 30 includes a memory and a processor. The memory is configured to store computer-readable instructions. In particular, the memory may store a program for causing the processor to execute a series of processes executed by the management server 3. The memory is configured with a ROM and a RAM. The processor is configured with at least one of a CPU, an MPU, and a GPU.

[0050] The storage device 31 is, for example, a storage device (storage) such as an HDD, SSD, flash memory, etc., and is configured to store programs and various data. The storage device 31 stores the above-mentioned inspection management table, product management table, logistics management table, and camera correspondence table.

[0051] The input / output interface 32 is an interface that enables a connection between an external device and the management server 3, and includes an interface conforming to a predetermined communication standard such as the USB standard or the HDMI (registered trademark) standard. The communication unit 33 may include various wired communication modules for communicating with an external terminal on the communication network 8. The input operation unit 34 is, for example, a touch panel, a mouse, and / or a keyboard, and is configured to receive an input operation by an operator and generate an operation signal according to the input operation by the operator. The display unit 35 is, for example, configured by an image display and an image display circuit.

[0052] (Video Server 4 Configuration) Next, the hardware configuration of the video server 4 will be described below. FIG. 4 is a diagram showing an example of the hardware configuration of the video server 4. The video server 4 is configured to receive video data from the camera 2 via the communication network 8 and transmit the video data to the user terminal 6 in response to a video transmission request from the user terminal 6. The video server 4 may be configured with a plurality of servers. The video server 4 functions as a WEB server configured to provide a cloud-type video distribution application as a WEB application. In this respect, the video server 4 is configured to transmit data (e.g., HTML files, CSS files, image / video files, program files, etc.) for displaying a video display screen 83 (see FIG. 12) on the WEB browser of the user terminal 6. In this way, the video server 4 functions as a server for providing SaaS (System as a Service). The video server 4 may be constructed on-premise or may be a cloud server.

[0053] 4, the video server 4 includes a control unit 40, a storage device 41, an input / output interface 42, a communication unit 43, an input operation unit 44, and a display unit 45. These elements are connected to a communication bus 46.

[0054] The control unit 40 includes a memory and a processor. The memory is configured to store computer-readable instructions. In particular, the memory may store a program for causing the processor to execute a series of processes executed by the video server 4. The memory is configured with a ROM and a RAM. The processor is configured with at least one of a CPU, an MPU, and a GPU.

[0055] The storage device 41 is, for example, a storage device such as an HDD, an SSD, or a flash memory, and is configured to store programs and various data. The storage device 41 stores a user management table, a camera management table, a video management table, and video data.

[0056] The input / output interface 42 is an interface that enables a connection between an external device and the video server 4. The communication unit 43 may include various wired communication modules for communicating with an external terminal on the communication network 8. The input operation unit 44 is, for example, a touch panel, a mouse, and / or a keyboard, and is configured to receive an input operation by an operator and generate an operation signal according to the input operation by the operator. The display unit 45 is, for example, configured by an image display and an image display circuit.

[0057] (Configuration of inspection terminal 5) Next, the configuration of the inspection terminal 5 (an example of a predetermined device used for a predetermined process on the product W) will be described below. FIG. 5 is a diagram showing an example of a hardware configuration of the inspection terminal 5. The inspection terminal 5 is a terminal used to execute the inspection process, and may be a handheld terminal dedicated to the inspection process, or may be a mobile terminal such as a smartphone or tablet terminal on which an application program for the inspection process is installed. As shown in FIG. 1, the inspection terminal 5 is carried by a worker K who performs the inspection process of the product W. Each of the multiple workers K may carry one inspection terminal 5. Each inspection terminal 5 is communicably connected to the management server 3 via a communication network 8. In this example, the inspection terminal 5 may be a stationary inspection terminal fixedly installed at a predetermined position (for example, a predetermined position on an inspection table).

[0058] 5, the inspection terminal 5 includes a control unit 50, a storage device 51, a code reading unit 52, a communication unit 53, an input operation unit 54, a display unit 55, and a speaker 56. These elements are connected to a communication bus 57.

[0059] The control unit 50 includes a memory and a processor. The memory is configured to store computer-readable instructions. In particular, the memory may store a program for causing the processor to execute a series of processes executed by the inspection terminal 5. The memory is configured of a ROM and a RAM. The processor is configured of at least one of a CPU, an MPU, and a GPU. The storage device 51 is, for example, a storage device such as an HDD, an SSD, or a flash memory, and is configured to store programs and various data.

[0060] The code reading unit 52 is configured to read information (e.g., product ID, order ID, etc.) indicated by a code portion (e.g., a barcode or two-dimensional code). The code reading unit 52 may have, for example, a light-emitting element (laser element or LED) that emits infrared light, and a light-receiving element (CMOS, CCD, etc.) that receives light reflected by the code portion. The code reading unit 52 may be configured as an imaging unit that captures image data indicating a code portion such as a two-dimensional code. The code portion indicating the product ID, which is identification information of the product, is attached, for example, to the surface of the product W. Also, the code portion indicating the order ID, which is identification information of the order, is attached, for example, to the shipping inspection list D.

[0061] The communication unit 53 is configured to connect the inspection terminal 5 to the communication network 8. The communication unit 53 includes, for example, a wireless communication module for wirelessly communicating with external devices such as a base station or a wireless LAN router. The input operation unit 54 is, for example, a touch panel, a mouse, and / or a keyboard arranged over the video display of the display unit 55, and is configured to receive an input operation of the worker K and generate an operation signal corresponding to the input operation. The display unit 55 is, for example, configured by a video display and a video display circuit that drives and controls the video display. The speaker 56 is configured to output sound to the outside when the code is read.

[0062] (Configuration of user terminal 6) The user terminal 6 may be, for example, a personal computer, a smartphone, a tablet, or a wearable device attached to the user U. The user terminal 6 has a web browser. The video distribution application provided by the video server 4 runs on the web browser of the user terminal 6. The user terminal 6 includes a control unit, a storage device, an input / output interface, a communication unit, an input operation unit, and a display unit. These elements are connected to a communication bus.

[0063] The control unit of the user terminal 6 includes a memory and a processor. The memory is configured to store computer-readable instructions (programs). For example, the memory includes a ROM and a RAM. The processor includes at least one of a CPU, an MPU, and a GPU. The storage device is, for example, a storage device such as an HDD, an SSD, or a flash memory, and is configured to store programs and various data. The input / output interface is an interface (for example, a USB or an HDMI) that enables a connection between an external device and the user terminal 6. The communication unit is configured to connect the user terminal 6 to the communication network 8, and includes a wireless communication module and / or a wired communication module. The input operation unit is, for example, a touch panel, a mouse, and / or a keyboard, and is configured to accept an input operation of the user U and generate an operation signal in response to the input operation of the user U. The display unit is, for example, configured by a video display and a video display circuit. In this embodiment, a search result screen 80 for video access information and a video display screen 83 are displayed on the display unit of the user terminal 6 (see FIG. 11 and FIG. 12).

[0064] (First half of the process executed by the video providing system 1) Next, the first half of the process executed by the video providing system 1 according to the first embodiment will be described below with reference to Fig. 6. Fig. 6 is a flowchart for explaining the first half of the process executed by the user terminal 6, video server 4, management server 3, and inspection terminal 5 of the video providing system 1 according to the first embodiment.

[0065] As shown in FIG. 6, in step S1, the video server 4 transmits data (such as an HTML file or a CSS file) for displaying a camera setting screen 70 (see FIG. 7) to the user terminal 6. Thereafter, the user terminal 6 displays the camera setting screen 70 on the display unit. As shown in FIG. 7, the camera setting screen 70 has a camera selection area 73 in which a camera ID, which is identification information of the camera 2, can be selected, and an inspection terminal selection area 72 in which an inspection terminal ID, which is identification information of the inspection terminal 5, can be selected. The user U selects one of the multiple camera IDs displayed in the camera selection area 73, and also selects one of the multiple inspection terminal IDs displayed in the inspection terminal selection area 72. Thereafter, the user U can link the selected camera ID and the selected inspection terminal ID to each other by pressing the decision button 75 with the camera ID and the inspection terminal ID selected.

[0066] When a predetermined camera 2 is installed in a logistics warehouse so as to capture the state of inspection processing using a predetermined inspection terminal 5, the predetermined camera 2 and the predetermined inspection terminal 5 need to be linked to each other. For example, when a camera 2 with a camera ID of "1a1a1a" is installed in a logistics warehouse so as to capture an inspection terminal 5 with an inspection terminal ID of "0013", when the camera ID "1a1a1a" is selected and the inspection terminal ID "0013" is selected and the decision button 75 is pressed, the camera ID "1a1a1a" and the inspection terminal ID "0013" are linked to each other. In this way, the user U can register multiple camera IDs and multiple inspection terminal IDs in association with each other through an input operation on the camera setting screen 70. It is also possible to register multiple inspection terminal IDs in association with one camera ID. In this case, the process of selecting one camera ID and selecting and determining one inspection terminal ID can be repeated multiple times, or one camera ID can be selected and then multiple inspection terminal IDs can be selected simultaneously.

[0067] The camera setting screen 70 also has an inspection processing area setting area 76 in which an inspection processing area 78 in which the inspection processing is performed can be set. As shown in FIG. 7, the inspection processing area setting area 76 displays video data captured by the camera 2 selected in the camera selection area 77. For example, when the camera ID "1a1a1a" is selected in the camera selection area 77, the video data captured by the camera 2 corresponding to the camera ID "1a1a1a" is displayed in the inspection processing area setting area 76. When the "setting of correspondence between the camera and the inspection terminal" and the "setting of the inspection processing area" are performed successively, the camera ID selected in the camera selection area 73 may be automatically set in the camera selection area 77, and the inspection terminal ID selected in the inspection terminal selection area 72 may be automatically set in the inspection terminal selection area 74. The user U can set the inspection processing area 78 in the video data by performing a predetermined input operation (for example, a drag and drop operation) on the video data displayed in the inspection processing area setting area 76. After that, the inspection processing area 78 is confirmed by operating the decision button 79. In this way, in the image of the camera selected in the camera selection area 77, the inspection processing area 78 is set as an area in which the inspection processing by the inspection terminal selected in the inspection terminal selection area 74 is captured. When multiple inspection terminals are associated with one camera, if it is desired to set a different inspection processing area for each inspection terminal, such setting may be performed for each inspection terminal. When multiple inspection terminals are associated with one camera, if it is desired to set a common inspection processing area for multiple inspection terminals, for example, multiple inspection terminal IDs may be simultaneously selected in the inspection terminal selection area 74. Also, it is possible to register the inspection processing area 78 without associating any inspection terminal with one camera. For example, in a situation in which the image of a certain camera captures the inspection processing by one inspection terminal, the setting of the inspection terminal ID can be simplified.

[0068] In this way, the user U can associate multiple camera IDs with multiple inspection terminal IDs through the camera setting screen 70 displayed on the user terminal 6, and can set an inspection processing area 78 within the video data captured by each camera 2.

[0069] Next, in step S2, the user terminal 6 transmits information indicating the correspondence between the inspection terminal ID and the camera ID, and information regarding the inspection processing area 78 to the video server 4 in response to an input operation of the user U on the camera setting screen 70. After receiving this information from the user terminal 6, the video server 4 associates and registers the information regarding the inspection processing area 78 included in the video data of each camera 2 with each camera 2 and each inspection terminal (step S3). Furthermore, the video server 4 transmits information indicating the correspondence between the inspection terminal ID and the camera ID to the management server 3 (step S4). Thereafter, the management server 3 generates a camera correspondence table (see FIG. 8(a)) by registering the inspection terminal ID and the camera ID in association with each other (step S5). The camera correspondence table indicates the correspondence between the inspection terminal ID and the camera ID.

[0070] Next, worker K uses the inspection terminal 5 to perform inspection processing (particularly, shipping inspection processing) of product W. Specifically, worker K uses the inspection terminal 5 to read the product ID indicated by the code portion of product W and the order ID indicated by the code portion of the shipping inspection list D (see FIG. 1). While worker K is performing the inspection processing, the camera 2 is assumed to be capturing video data showing the state in which worker K is performing the inspection processing. When performing the inspection processing, the inspection terminal 5 generates an inspection processing ID (an example of inspection processing information) which is an identification number of the inspection processing, and time information which indicates the time when the inspection processing was performed. After that, the inspection terminal 5 transmits the inspection processing ID, the inspection terminal ID, the order ID, the time information, and the product ID to the management server 3 (step S5).

[0071] After receiving these pieces of information from the inspection terminal 5, the management server 3 identifies the camera ID from the inspection terminal ID based on the camera correspondence table shown in FIG. 8(a) (step S7). The management server 3 may also update the inspection management table based on these pieces of information received from the inspection terminal 5. Next, the management server 3 acquires video access information based on the time information and the camera ID (step S8). As shown in FIG. 8(b), the video access information is composed of a URL (Uniform Resource Locator) including domain information indicating the address of the video server 4 on the communication network 8 (particularly, an IP network), a camera ID, and time information (UNIX (registered trademark) time). The domain information may include the domain name and directory name of the video server 4. For example, as shown in FIG. 8(b), if the camera ID is "1a1a1a" and the time information in UNIX time format is "1647583505000", the video access information is composed of a URL consisting of a domain name, a directory name, the camera ID "1a1a1a", and the time information "1647583505000".

[0072] Next, in step S8, the management server 3 updates the logistics management table shown in Fig. 8(b). In the logistics management table, an inspection process ID, an order ID, a camera ID, an inspection terminal ID, time information, and video access information are registered in association with each other. In the logistics management table, one record is generated for one inspection process ID. After acquiring the inspection process ID, the inspection terminal ID, the order ID, and the time information from the inspection terminal 5, the management server 3 identifies the camera ID associated with the inspection terminal ID and generates video access information. Then, the logistics management table is updated based on this information.

[0073] 6, the time information is generated by the inspection terminal 5 and then transmitted to the management server 3, but the time information may be generated by the management server 3. In this case, the management server 3 may generate time information indicating the time when information such as the inspection process ID was received from the inspection terminal 5 as the time information indicating the time when the inspection process was performed.

[0074] Furthermore, in this example, the camera correspondence table is generated by the management server 3, but the camera correspondence table may be generated by the video server 4. In this case, the video server 4 may, in response to a request from the management server 3, refer to the camera correspondence table stored in the storage device 41 to identify a camera ID from the inspection terminal ID, and then transmit information on the identified camera ID to the management server 3.

[0075] In addition, in the camera correspondence table, the inspection terminal ID and the camera ID are registered in association with each other, but the camera ID may be linked to identification information of the worker (worker ID) or identification information of the location where the camera is installed (location ID). In this case, in step S6, the inspection terminal 5 transmits the worker ID or the location ID to the management server 3 instead of or in addition to the inspection terminal ID. Also, the worker ID or the location ID may be registered in the logistics management table instead of or in addition to the inspection terminal ID.

[0076] (The latter half of the process is executed by the video providing system 1) Next, the latter half of the process executed by the video providing system 1 according to the first embodiment will be described below with reference to Fig. 9. Fig. 9 is a flowchart for explaining the latter half of the process executed by the user terminal 6, video server 4, and management server 3 of the video providing system 1 according to the first embodiment. In the example of the process shown in Fig. 9, it is assumed that the user U receives a report from the shipper regarding information about the product W that was erroneously shipped. The user U may be, for example, an employee of a company that operates and manages the logistics warehouse where the product W is stored, and may be a person in charge of responding to complaints from related customers.

[0077] 9, in step S10, the user terminal 6 transmits information about the product W to the management server 3 through an input operation of the user U on the user terminal 6. Here, the information about the product W (an example of a first product) may include at least one of an order ID which is identification information related to an order of the product W, a product ID which is identification information of the product W, information indicating the product name of the product W, information indicating the product type of the product W, information indicating the shipping destination of the product W, information indicating the shipping date of the product W, and information indicating the arrival date of the product W.

[0078] Next, the management server 3 identifies the inspection process ID (an example of first inspection process information) of the product W by referring to the product management table (see FIG. 10) (step S11). As shown in FIG. 10, in the product management table, the inspection process ID, the order ID, the product name or product ID, the product type, the shipping destination, the shipping date, and the arrival date are registered in association with each other. In the product management table, one record is generated for one inspection process ID. After receiving information about the product W from the user terminal 6, the management server 3 identifies the inspection process ID of the product W based on the information by referring to the product management table. Here, if the information about the product W transmitted from the user terminal 6 is not enough to uniquely identify the inspection process ID of the product W, the management server 3 may identify multiple candidates for the inspection process ID of the product W.

[0079] Next, in step S12, the management server 3 identifies the video access information (an example of the first video access information) corresponding to the inspection process ID of the product W by referring to the logistics management table (see FIG. 8(b)). After that, the management server 3 transmits data (e.g., an HTML file or a CSS file) for displaying a video access information search result screen 80 (see FIG. 11) including the identified video access information to the user terminal 6 (step S13). After that, the user terminal 6 receives the data for displaying the video access information search result screen 80, and displays the video access information search result screen 80 shown in FIG. 11 on the display unit. As shown in FIG. 11, the video access information search result screen 80 displays the inspection process ID, order ID, shipping destination, product name, product type, inspection time, button 82 with embedded video access information, shipping status, and remarks column of the product W in a mutually associated state. The button 82 has embedded therein the video access information of the product W (more specifically, URL information). When the button 82 is designated by an input operation of the user U, the user terminal 6 transmits a video transmission request including video access information to the video server 4 (step S14).

[0080] In step S15, the video server 4, in response to the video transmission request including the video access information, identifies video data captured by the camera 2 (an example of the first camera) of the camera ID associated with the inspection processing ID of the product W at the time t (an example of the first time) when the inspection processing of the product W was performed. In this example, the video server 4, in response to the video transmission request including the camera ID "1a1a1a" and the UNIX time "1647583505000" corresponding to 15:05:05 on March 18, 2022, identifies video data captured by the camera 2 of the camera ID "1a1a1a" (hereinafter referred to as the specific ID) at 15:05:05 on March 18, 2022 (hereinafter referred to as the specific time). After that, the video server 4 transmits the identified video data to the user terminal 6 (step S16). Note that the video server 4 may transmit video data in a time period before and after the specific time to the user terminal 6. Furthermore, the video server 4 may specify the inspection processing area 78 based on a specific ID (at least one of an inspection terminal ID and a camera ID) and include information about the inspection processing area 78 (see FIG. 12) in the video data. In particular, the information about the inspection processing area 78 may be determined based on the camera ID or the inspection terminal ID, or may be determined based on a combination of the camera ID and the inspection terminal ID. The information about the inspection processing area 78 may be information indicating an area in a coordinate space (e.g., an XY coordinate space) set in the video data.

[0081] In step S17, the user terminal 6 displays the video data associated with the specific ID at the specific time on the video display screen 83 (see FIG. 12). As shown in FIG. 12, the video display screen 83 has a video display area 84 in which the video data is displayed, a zoom operation area 86, a timeline 89 indicating the playback time zone, and a slider 85 that can slide on the timeline 89. In the example shown in FIG. 12, the inspection processing area 78 associated with the specific ID is displayed identifiable in the video data.

[0082] Furthermore, the user U can change the playback time of the video data by operating the slider 85 (more specifically, by moving the slider 85 on the timeline 89). For example, when the user U changes the position of the slider 85 to 15:00, the user terminal 6 transmits a video transmission request to the video server 4 to request transmission of video data for the time period before and after 15:00. In response to the video transmission request, the video server 4 transmits the video data for the time period before and after 15:00 to the user terminal 6. In this way, the video data for the time period before and after 15:00 is displayed in the video display area 84.

[0083] In this way, by operating the slider 85, the user U can check the state of the inspection process of the product W before and after a specific time through the video data.

[0084] According to this embodiment, the inspection process ID of the product W is identified based on information about the product W, and then the video data captured by the camera 2 with the camera ID associated with the identified inspection process ID is transmitted to the user terminal 6. In particular, the video data at the time when the inspection process of the product W is performed is transmitted to the user terminal 6. Therefore, even if the product W is erroneously shipped, the user U can trace the cause of the erroneous shipment of the product W by checking the video data showing the state of the inspection process of the product W on the user terminal 6. In this way, it is possible to provide a video providing system 1 that can trace the cause of the erroneous shipment of the product W in a logistics warehouse through the video data transmitted to the user terminal 6.

[0085] According to the present embodiment, the video access information, which is composed of a URL including the domain information of the video server 4, the camera ID, and the time information, is transmitted to the user terminal 6. In this way, the user U can obtain the video data of the inspection process of the product W from the video server 4 by operating the button 82 linked to the video access information. In this way, the video data related to the inspection process of the product W can be obtained easily and quickly through the video access information, so that the usability of the video providing system 1 is dramatically improved. Furthermore, the video providing system 1 is provided with a video server 4 that transmits the video data to the user terminal 6. In other words, the video providing system 1 is provided with a video server 4 constructed as a cloud server separately from the management server 3 constructed on-premise. Therefore, by slightly improving the existing logistics management system in which video data is not managed, the video providing system 1 that can track the inspection process of the product in the logistics warehouse can be constructed at a relatively low cost.

[0086] According to the present embodiment, the inspection processing area 78 is identifiably displayed in the video data displayed in the video display area 84, so that the user U can clearly grasp the state of the inspection processing of the product W through the identifiable inspection processing area 78. In the present embodiment, the inspection processing area 78 is displayed in the video data with an identifiable frame line, but the present embodiment is not limited to this. In this respect, video data in which the inspection processing area 78 is enlarged may be displayed in the video display area 84. In this case, the video server 4 may generate video data in which the inspection processing area 78 is enlarged based on information related to the inspection processing area 78, and then transmit the video data to the user terminal 6. The video server 4 may generate video data in which the inspection processing area 78 is enlarged through a digital zoom function. In this way, the user U can more clearly grasp the state of the inspection processing of the product W through the video data in which the inspection processing area 78 is enlarged.

[0087] Furthermore, while only the inspection processing area 78 is displayed, video data in which areas other than the inspection processing area 78 are not displayed may be displayed in the video display area 84. In this case, the video server 4 may perform digital image processing on the video data based on information on the inspection processing area 78 so that image data of only the inspection processing area 78 is displayed while image data of other areas is not displayed, and then transmit the video data after the digital image processing to the user terminal 6. Image data of areas other than the inspection processing area 78 may be trimmed, or mosaic processing or blurring processing may be performed on the image data of areas other than the inspection processing area 78. In this way, since only the inspection processing area 78 is displayed on the user terminal 6, it is possible to suitably prevent the surrounding environment of the logistics warehouse other than the inspection processing area 78 from being confirmed by an outsider who is not related to the logistics warehouse. In particular, it is possible to suitably prevent a situation in which trade secrets in the logistics warehouse are grasped by an outsider. This example is particularly useful when an outsider who is not related to the logistics warehouse confirms the video data.

[0088] Second Embodiment Hereinafter, the video providing system 1a according to the second embodiment will be described with reference to the drawings. FIG. 13 is a diagram showing an example of the video providing system 1a according to the present embodiment. As shown in FIG. 1, the video providing system 1a includes a camera 2a, a management server 3a, a video server 4a, a material handling device 9, and a user terminal 6a. These are connected to a communication network 8. The camera 2a is communicatively connected to the video server 4a via the communication network 8. The management server 3a is communicatively connected to the video server 4a, the material handling device 9, and the user terminal 6a via the communication network 8. The user terminal 6a is communicatively connected to the management server 3a and the video server 4a via the communication network 8. Note that, in the video providing system 1a according to the present embodiment, a plurality of cameras 2a and a plurality of material handling devices 9 are provided, but for convenience of explanation, one camera 2a and one material handling device 9 are illustrated in FIG. 1.

[0089] In this example, the camera 2a acquires video data showing the state of the material handling device 9 through photography. A plurality of cameras 2a are installed in the logistics warehouse. Each camera 2a is fixedly installed in a corresponding one of a plurality of areas of the logistics warehouse and configured to capture video data showing its surrounding environment. In particular, each camera 2a is assumed to be fixedly installed in the logistics warehouse so as to capture the state of one of the plurality of material handling devices 9.

[0090] The hardware configurations of the camera 2a, management server 3a, video server 4a, and user terminal 6a provided in the video providing system 1a are the same as those of the camera 2, management server 3, video server 4, and user terminal 6 provided in the video providing system 1 according to the first embodiment, and therefore, in this embodiment, these hardware configurations will not be particularly described. On the other hand, the management server 3a differs from the management server 3 in that the storage device 31 of the management server 3a stores a product position management table shown in Fig. 17(b).

[0091] (Configuration of material handling device 9) Next, the configuration of the material handling device 9 will be described below. FIG. 14(a) is a diagram showing an example of the hardware configuration of the material handling device 9. FIG. 14(b) is a diagram showing an example of the hardware configuration of a digital display 90 provided in the material handling device 9. The material handling device 9 is a material handling device, and is a device for supporting operations in a logistics warehouse. The material handling device 9 may be, for example, a sorting support device (also called a digital assert system: DAS) for supporting the sorting process of products, or a picking support device (also called a digital picking system: DPS) for supporting the picking process of products.

[0092] In the example shown in FIG. 13, the material handling device 9 is configured as a picking support device for supporting the picking of goods. The material handling device 9 has a plurality of zones Z (in this example, nine zones Z). Goods are stored in each zone Z. A digital display 90 is also provided in each zone Z. In this example, one digital display 90 is provided in each of the nine zones Z. The material handling device 9 is communicatively connected to the management server 3a via the communication network 8, and is controlled in response to a control signal from the management server 3a.

[0093] As shown in Fig. 14, the material handling device 9 includes a control unit 91, a communication unit 92, and a plurality of (nine in this example) digital display devices 90. The control unit 91 is configured to control the operation of the plurality of digital display devices 90, and includes a memory and a processor. The memory is configured to store computer-readable instructions. The communication unit 92 is configured to connect the material handling device 9 to the communication network 8. The communication unit 92 includes, for example, a wireless communication module and / or a wired communication module.

[0094] Each digital display 90 has an indicator 93, a display unit 95, and an operation button 94. The indicator 93 is configured to light up or flash, and includes a light-emitting element. The display unit 95 is configured to present information necessary for the picking process (e.g., the number of items picked, etc.). The operation button 94 is a button operated by the worker K. When the operation button 94 is pressed after the worker K completes the picking process of a specific item, the control unit 20 can determine that the picking process of the specific item has been completed.

[0095] The material handling device 9 may further be provided with a code reading unit. The code reading unit may be configured to read a code portion indicating the order ID of a product displayed on the product picking list. In this case, information on the order ID acquired through the code reading unit is transmitted from the material handling device 9 to the management server 3a. The management server 3a may identify information on the zone ID associated with the order ID, information on the number of products, etc., by referring to the product position management table shown in FIG. 17(b).

[0096] (First half of the process executed by the video providing system 1a) Next, the first half of the process executed by the video providing system 1a according to the second embodiment will be described below with reference to Fig. 15. Fig. 15 is a flowchart for explaining the first half of the process executed by the user terminal 6a, video server 4a, management server 3a, and material handling device 9 of the video providing system 1a according to the second embodiment.

[0097] As shown in FIG. 15, in step S20, the video server 4a transmits data (such as an HTML file or a CSS file) for displaying a camera setting screen 170 (see FIG. 16) to the user terminal 6a. After that, the user terminal 6a displays the camera setting screen 170 on the display unit. As shown in FIG. 16, the camera setting screen 170 has a camera selection area 173 in which a camera ID, which is identification information of the camera 2a, can be selected, and a material handling device selection area 172 in which a material handling device ID, which is identification information of the material handling device 9, can be selected. The user U selects one of the multiple camera IDs displayed in the camera selection area 173, and also selects one of the multiple material handling device IDs displayed in the material handling device selection area 172. After that, the user U can link the selected camera ID and the selected material handling device ID to each other by pressing the decision button 175 with the camera ID and the material handling device ID selected.

[0098] In the case where a specific camera 2a is installed in a logistics warehouse so as to capture the state of a specific material handling device 9, it is necessary to link the specific camera 2a and the specific material handling device 9 to each other. For example, in the case where a camera 2a with a camera ID of "2b1a1a" is installed in a logistics warehouse so as to capture a material handling device 9 with a material handling device ID of "0021", when the camera ID "2b1a1a" is selected and the material handling device ID "0021" is selected and the decision button 175 is pressed, the camera ID "2b1a1a" and the material handling device ID "0021" are linked to each other. In this way, the user U can register multiple camera IDs and multiple material handling device IDs in association with each other through an input operation on the camera setting screen 170. It is also possible to register multiple material handling device IDs in association with one camera ID. In this case, the process of selecting one camera ID and selecting and determining one material handling device ID can be repeated multiple times, or one camera ID can be selected and then multiple material handling device IDs can be selected simultaneously to determine them.

[0099] The camera setting screen 170 also has a placement area setting area 176 in which a placement area 178 in which the material handling device 9 is placed can be set. As shown in FIG. 16, the placement area setting area 176 displays video data captured by the camera 2a selected in the camera selection area 177. For example, when the camera ID "2b1a1a" is selected in the camera selection area 177, video data captured by the camera 2a corresponding to the camera ID "2b1a1a" is displayed in the placement area setting area 176. When the "setting of correspondence between the camera and the material handling device" and the "setting of the placement area" are performed successively, the camera ID selected in the camera selection area 173 may be automatically set in the camera selection area 177, and the material handling device ID selected in the material handling device selection area 172 may be automatically set in the material handling device selection area 174. The user U can set the placement area 178 in the video data by performing a predetermined input operation (for example, a drag and drop operation) on the video data displayed in the placement area setting area 176. Thereafter, the user U operates the decision button 179 to confirm the arrangement area 178. In this way, the arrangement area 178 is set as an area in which the material handling device selected in the material handling device selection area 174 is photographed in the image of the camera selected in the camera selection area 177. When multiple material handling devices 9 are associated with one camera, if it is desired to set a different arrangement area 178 for each material handling device 9, such a setting may be performed for each material handling device 9. When multiple material handling devices 9 are associated with one camera, if it is desired to set a common arrangement area 178 for multiple material handling devices 9, for example, multiple material handling device IDs may be simultaneously selected in the material handling device selection area 174. In addition, it is also possible to register the arrangement area 178 without associating any material handling device 9 with one camera. For example, in a situation in which the image of a certain camera photographs one material handling device 9, the setting of the material handling device ID can be simplified.

[0100] In this way, the user U can associate multiple camera IDs with multiple material handling device IDs through the camera setting screen 170 displayed on the user terminal 6a, and can set a placement area 178 within the video data captured by each camera 2a.

[0101] Next, in step S21, the user terminal 6a transmits information indicating the correspondence between the material handling device ID and the camera ID, and information regarding the placement area 178, to the video server 4a in response to an input operation by the user U on the camera setting screen 170. After receiving this information from the user terminal 6a, the video server 4a registers the information regarding the placement area 178 included in the video data of each camera 2a in association with each camera 2a (step S22). Furthermore, the video server 4a transmits information indicating the correspondence between the material handling device ID and the camera ID to the management server 3a (step S23). Thereafter, the management server 3a generates a camera correspondence table (see FIG. 17(a)) by registering the material handling device ID and the camera ID in association with each other (step S24). In the camera correspondence table, the correspondence between the material handling device ID and the camera ID is shown.

[0102] Next, the management server 3a transmits a control signal to the material handling device 9 by referring to the product position management table (see FIG. 17(b)) (step S25). As shown in FIG. 17(b), the product position management table registers a control ID (one example of control information), an order ID, a product name, the number of products, a material handling device ID, and a zone ID in association with each other. In the example shown in FIG. 17(b), the management server 3a identifies the material handling device ID associated with the order ID, and transmits a control signal including information on the number of products and information on the zone ID to the material handling device 9 associated with the identified material handling device ID. Also, while the material handling device 9 is operating, the camera 2a is assumed to be capturing video data showing the state of the material handling device 9. When transmitting the control signal to the material handling device 9, the management server 3a acquires time information indicating the time associated with the processing of the product using the material handling device 9 (in this example, picking processing) (step S27).

[0103] Moreover, the material handling device 9 receives a control signal from the management server 3a and executes an operation according to the control signal (step S26). In particular, the material handling device 9 turns on or blinks the indicator 93 of the digital display 90 associated with the zone ID based on information about the zone ID included in the control signal. Furthermore, the material handling device 9 displays information about the number of products on the display unit 95 of the digital display 90 associated with the zone ID based on information about the number of products included in the control signal as information about the number of picking products. For example, when the zone ID is 007, the indicator 93 of the digital display 90 installed in the seventh zone Z turns on or blinks. Also, when the number of products is 1, information indicating the number of products 1 is displayed on the display unit 95 of the digital display 90 installed in the seventh zone Z. The worker K can take out the products stored in the zone Z of the lit or blinking digital display 90 by the number of products indicated on the display unit 95.

[0104] In step S28, the management server 3a refers to the camera correspondence table to identify the camera ID corresponding to the material handling device ID recorded in the product position management table. For example, when the material handling device ID is "0021", the management server 3a refers to the camera correspondence table to identify the camera ID "2b1a1a" corresponding to the material handling device ID "0021". Next, the management server 3a acquires video access information based on the time information and camera ID acquired in step S27 (step S28). As shown in FIG. 18, the video access information is composed of a URL including domain information indicating the address of the video server 4a on the communication network 8 (particularly, the IP network), a camera ID, and time information (UNIX time). The domain information may include the domain name and directory name of the video server 4a. For example, as shown in FIG. 18, if the camera ID is "2b1a1a" and the time information in UNIX time format is "1647583105000", the video access information is composed of a URL consisting of a domain name, a directory name, the camera ID "2b1a1a", and the time information "1647583105000".

[0105] Next, in step S29, the management server 3a updates the logistics management table shown in FIG. 18. In the logistics management table, a control ID, an order ID, a camera ID, a material handling device ID, a zone ID, time information, and video access information are registered in association with each other. In the logistics management table, one record is generated for one control ID. The management server 3a acquires the time information, identifies the camera ID associated with the material handling device ID, and generates the video access information. Thereafter, the management server 3a updates the logistics management table based on this information.

[0106] 15, the time information is generated by the management server 3a, but the time information may be generated by the material handling device 9. In this case, when the worker K presses the operation button 94 of the digital display 90 after completing the picking work, the control unit 91 may transmit time information indicating the time when the operation button 94 is operated by the worker K to the management server 3a.

[0107] In this example, the camera correspondence table is generated by the management server 3a, but the camera correspondence table may be generated by the video server 4a. In this case, the video server 4a may refer to the camera correspondence table stored in the storage device 41 in response to a request from the management server 3a, identify a camera ID from a material handling device ID, and then transmit information about the identified camera ID to the management server 3a.

[0108] (The latter half of the process is executed by the video providing system 1a) Next, the latter half of the process executed by the video providing system 1a according to the second embodiment will be described below with reference to Fig. 19. Fig. 19 is a flowchart for explaining the latter half of the process executed by the user terminal 6a, video server 4a, and management server 3a of the video providing system 1a according to the second embodiment. In the example of the process shown in Fig. 19, it is assumed as a prerequisite that the user U has received a report on information regarding the erroneously shipped product W1 from the shipper or the like.

[0109] 19, in step S30, the user terminal 6a transmits information about the product W1 to the management server 3a through an input operation of the user U on the user terminal 6a. Here, the information about the product W1 (an example of a first product) may include at least one of an order ID which is identification information related to an order of the product W1, a product ID which is identification information of the product W1, information indicating the product name of the product W1, information indicating the product type of the product W1, information indicating the shipping destination of the product W1, information indicating the shipping date of the product W1, and information indicating the arrival date of the product W1.

[0110] Next, the management server 3a identifies the control ID associated with the product W1 by referring to the product management table (see FIG. 20) (step S31). As shown in FIG. 20, in the product management table, a control ID, an order ID, a product name or product ID, a product type, a shipping destination, a shipping date, and a delivery date are registered in association with each other. In the product management table, one record is generated for one control ID. After receiving information about the product W1 from the user terminal 6a, the management server 3a identifies the control ID associated with the product W1 based on the information by referring to the product management table. Here, if the information about the product W1 transmitted from the user terminal 6a is not enough to uniquely identify the control ID, the management server 3a may identify multiple candidates for the control ID associated with the product W1.

[0111] Next, in step S32, the management server 3a identifies the video access information (an example of the first video access information) corresponding to the control ID associated with the product W1 by referring to the logistics management table (see FIG. 18). After that, the management server 3a transmits data (for example, an HTML file or a CSS file) for displaying a video access information search result screen 180 (see FIG. 21) including the identified video access information to the user terminal 6a (step S33). After that, the user terminal 6a receives the data for displaying the video access information search result screen 180, and displays the video access information search result screen 180 shown in FIG. 21 on the display unit. As shown in FIG. 21, in the video access information search result screen 180, the control ID, order ID, shipping destination, product name, product type, inspection time, button 182 in which the video access information is embedded, shipping status, and remarks column of the product W1 are displayed in a mutually associated state. The button 182 has the video access information of the product W1 embedded therein (more specifically, URL information). When the button 182 is designated by an input operation of the user U, the user terminal 6 a transmits a video transmission request including video access information to the video server 4a (step S34).

[0112] In step S35, the video server 4a, in response to the video transmission request including the video access information, identifies the video data captured by the camera 2a (an example of the first camera) with the camera ID associated with the order ID of the product W1 at the time t (an example of the first time) associated with the picking process of the product W1 using the material handling device 9. In this example, the video server 4a, in response to the video transmission request including the camera ID "2b1a1a" and the UNIX time "1647583105000" corresponding to 15:01:05 on March 18, 2022, identifies the video data captured by the camera 2a with the camera ID "2b1a1a" (hereinafter referred to as the specific ID) at 15:01:05 on March 18, 2022 (hereinafter referred to as the specific time). After that, the video server 4a transmits the identified video data to the user terminal 6a (step S36). Note that the video server 4a may transmit video data in a time period before and after the specific time to the user terminal 6a. Furthermore, the video server 4a may specify the placement area 178 based on a specific ID (at least one of a material handling device ID and a camera ID) and include information about the placement area 178 (see FIG. 22) in the video data. In particular, the information about the placement area 178 may be determined based on a camera ID or a material handling device ID, or may be determined based on a combination of a camera ID and a material handling device ID. The information about the placement area 178 may be information indicating an area in a coordinate space (e.g., an XY coordinate space) set in the video data.

[0113] In step S37, the user terminal 6a displays the video data associated with the specific ID at the specific time on the video display screen 190 (see FIG. 22). As shown in FIG. 22, the video display screen 190 has a video display area 191 in which the video data is displayed, a zoom operation area 196, a timeline 195 indicating the playback time period, and a slider 192 that can slide on the timeline 195. In the example shown in FIG. 22, the placement area 178 associated with the specific ID is identifiably displayed in the video data.

[0114] Furthermore, the user U can change the playback time of the video data by operating the slider 192 (more specifically, by moving the slider 192 on the timeline 195). For example, when the user U changes the position of the slider 192 to 15:00, the user terminal 6a transmits a video transmission request to the video server 4a to request transmission of video data for the time period before and after 15:00. In response to the video transmission request, the video server 4a transmits the video data for the time period before and after 15:00 to the user terminal 6a. In this way, the video data for the time period before and after 15:00 is displayed in the video display area 191.

[0115] In this way, by operating the slider 192, the user U can check the state of the material handling device 9 (in particular, the state of the worker K picking up the product W1 using the material handling device 9) before and after a specific time through the video data.

[0116] According to this embodiment, the control ID associated with the product W1 is identified based on the information on the product W1, and then the video data captured by the camera 2a having the camera ID associated with the identified control ID is transmitted to the user terminal 6a. In particular, the video data at the time associated with the picking process of the product W1 using the material handling device 9 is transmitted to the user terminal 6a. Therefore, even if the product W1 is erroneously shipped, the user U can trace the cause of the erroneous shipment of the product W1 by checking the video data on the user terminal 6a. In this way, it is possible to provide the video providing system 1a capable of tracing the cause of the erroneous shipment of the product W1 in the logistics warehouse through the video data transmitted to the user terminal 6a.

[0117] According to the present embodiment, the video access information, which is composed of a URL including the domain information of the video server 4a, the camera ID, and the time information, is transmitted to the user terminal 6a. In this way, the user U can obtain from the video server 4a the video data of the worker K picking the product W1 using the material handling device 9 by operating the button 182 associated with the video access information. In this way, the video data showing the picking work of the product W1 can be easily and quickly obtained through the video access information, so that the usability of the video providing system 1a is dramatically improved. Furthermore, the video providing system 1a is provided with a video server 4a that transmits the video data to the user terminal 6a. In other words, the video providing system 1a is provided with a video server 4a constructed as a cloud server separately from the management server 3a constructed on-premise. For this reason, by slightly improving an existing logistics management system in which video data is not managed, the video providing system 1a capable of tracking the state of the picking work of the product W1 in the logistics warehouse can be constructed at a relatively low cost.

[0118] Further, according to the present embodiment, since the placement area 178 is identifiably displayed in the video data displayed in the video display area 191, the user U can clearly grasp the state of the picking operation of the product W1 through the identifiable placement area 178. Note that, in the present embodiment, the placement area 178 is displayed in the video data with an identifiable frame line, but the present embodiment is not limited to this. In this respect, video data in which the placement area 178 is enlarged may be displayed in the video display area 191. In this case, the video server 4a may generate video data in which the placement area 178 is enlarged based on information related to the placement area 178, and then transmit the video data to the user terminal 6a. The video server 4a may generate video data in which the placement area 178 is enlarged through a digital zoom function. In this way, the user U can more clearly grasp the state of the picking operation of the product W1 through the video data in which the placement area 178 is enlarged.

[0119] Furthermore, while only the placement area 178 is displayed, video data in which areas other than the placement area 178 are not displayed may be displayed in the video display area 191. In this case, the video server 4a may perform digital image processing on the video data based on information about the placement area 178 so that image data of only the placement area 178 is displayed while image data of other areas is not displayed, and then transmit the video data after the digital image processing to the user terminal 6a. Image data of areas other than the placement area 178 may be trimmed, or mosaic processing or blurring processing may be performed on the image data of areas other than the placement area 178. In this way, since only the placement area 178 is displayed on the user terminal 6a, it is possible to suitably prevent the surrounding environment of the logistics warehouse other than the placement area 178 from being confirmed by an outsider who is not related to the logistics warehouse. In particular, it is possible to suitably prevent a situation in which trade secrets in the logistics warehouse are grasped by an outsider. This example is particularly useful when an outsider who is not related to the logistics warehouse confirms the video data.

[0120] Although the embodiment of the present invention has been described above, the technical scope of the present invention should not be interpreted as being limited by the description of the embodiment. The embodiment is an example, and it is understood by those skilled in the art that various modifications of the embodiment are possible within the scope of the invention described in the claims. The technical scope of the present invention should be determined based on the scope of the invention described in the claims and its equivalents.

[0121] For example, in the first and second embodiments, the inspection process and the picking process are performed by a human worker K, but these processes may be performed by a robot (e.g., an autonomous walking robot) instead of a human. In this case, the video server 4 may identify the robot's identification information (robot ID) from video data showing the robot performing the inspection process, and then transmit the robot ID to the management server 3. The management server 3 may record the robot ID in the logistics management table. Similarly, the video server 4a may identify the robot ID from video data showing the robot performing the picking work, and then transmit the robot ID to the management server 3a. The management server 3a may record the robot ID in the logistics management table.

[0122] In the first embodiment, the inspection process is described as an example of the process for the product in the logistics warehouse, but the process for the product may be a predetermined process other than the inspection process. In this case, the video providing system 1 is provided with another device used for the predetermined process instead of the inspection terminal 5. In this regard, the management server 3 registers the identification information of the other device and the camera ID in association with each other. Furthermore, the management server 3 receives processing information related to the predetermined process (e.g., the ID of the predetermined process) and the identification information of the other device from the other device. The management server 3 registers the processing information (the ID of the predetermined process) and the camera ID in association with each other in the logistics management table based on the correspondence between the identification information of the other device and the camera ID. Thereafter, the management server 3 receives information about the product W from the user terminal 6, and identifies the processing information related to the predetermined process for the product W from the information about the product W based on the correspondence between the information about the product W and the processing information (the ID of the predetermined process), and transmits the video data captured by the camera 2 associated with the processing information to the user terminal 6.

[0123] In the second embodiment, the material handling device 9 is configured as a picking support device, but the material handling device 9 may be another material handling device such as a sorting support device. [Explanation of symbols]

[0124] 2, 2a: camera, 3, 3a: server, 4, 4a: video server, 5: inspection terminal, 6, 6a: user terminal, 8: communication network, 9: material handling device, 20: control unit, 21: storage device, 22: position information acquisition unit, 24: communication unit, 25: input operation unit, 26: imaging unit, 27: PZT mechanism, 30: control unit, 31: storage device, 32: input / output interface, 33: communication unit, 34: input operation unit, 35: display unit, 40: control unit control unit, 41: storage device, 42: input / output interface, 43: communication unit, 43: display unit, 44: input operation unit, 45: display unit, 50: control unit, 51: storage device, 52: code reading unit, 53: communication unit, 54: input operation unit, 55: display unit, 56: speaker, 70: camera setting screen, 72: inspection terminal selection area, 73: camera selection area, 74: inspection terminal selection area, 75: decision button, 76: inspection processing area setting area, 7 7: Camera selection area, 78: Inspection processing area, 79: Confirmation button, 80: Search result screen, 82: Button, 83: Video display screen, 84: Video display area, 85: Slider, 86: Zoom operation area, 89: Timeline, 90: Digital display, 91: Control unit, 92: Communication unit, 93: Indicator, 94: Operation button, 95: Display unit, 170: Camera setting screen, 172: Material handling device selection area, 173: Camera selection selection area, 174: material handling device selection area, 175: decision button, 176: placement area setting area, 177: camera selection area, 178: placement area, 179: decision button, 180: search result screen, 182: button, 190: video display screen, 191: video display area, 192: slider, 195: timeline, 196: zoom operation area, D: shipping inspection list, K: worker, U: user, W, W1: product, Z: zone

Claims

1. A video providing system that provides a user terminal with a video showing a state of inspection processing of a commodity by an inspection terminal, the video being taken by a camera installed in a logistics warehouse, registering the identification information of the inspection terminal and the identification information of the camera in association with each other; When performing the inspection process by the inspection terminal, a camera corresponding to the inspection terminal that performed the inspection process is identified based on a correspondence relationship between the identification information of the registered inspection terminal and the identification information of the camera; registering inspection processing information related to the inspection processing and video access information for accessing the video of the specified camera in association with each other; When checking an inspection process of the product using the user terminal, an inspection process to be checked is identified from among a plurality of inspection processes based on information about the product; providing, to the user terminal, a video showing the specified inspection process based on a correspondence relationship between the registered inspection process information and the video access information; Video delivery system.

2. The video access information is Including the identity of the identified camera; The video providing system according to claim 1 .

3. The video access information is Including time information indicating the time when the inspection process was performed, The video providing system according to claim 2 .

4. The video access information is domain information indicating the address of a server on which the image is stored; The video providing system according to claim 3 .

5. The video access information is It is composed of a URL format. The video providing system according to claim 4 .

6. The information regarding the product is Identification information of the product; Identification information relating to an order for said goods; Information indicating the product name of the product; Information indicating a product type of the product; Information indicating a shipping destination of the goods; Information indicating a shipping date for the product; Information indicating the arrival date of the product; at least one of The video providing system according to any one of claims 1 to 5.

7. Setting an inspection processing area in which the inspection processing is performed; The video providing system according to any one of claims 1 to 5.

8. The inspection processing area is identifiably displayed in the image. The video providing system according to claim 7.

9. The inspection processing area is enlarged and displayed in the image. The video providing system according to claim 7.

10. Displaying only the inspection processing area in the image; The video providing system according to claim 7.

11. A video providing system that provides a user terminal with a video showing a state of picking a product in a material handling device, the video being taken by a camera installed in a logistics warehouse, The identification information of the material handling device and the identification information of the camera are registered in association with each other, When performing material handling control for picking on the material handling device, a camera corresponding to the material handling device that is the target of the material handling control is identified based on the correspondence between the identification information of the registered material handling device and the identification information of the camera, registering the control information relating to the material handling control and the image access information for accessing the image of the specified camera in association with each other; When confirming the picking of the product by the user terminal, a material handling control corresponding to the picking to be confirmed is identified from among a plurality of material handling controls based on information about the product; providing, to the user terminal, a video showing a state of a picking operation corresponding to the specified material handling control based on a correspondence relationship between the registered control information and the video access information; Video delivery system.

12. The video access information is Including the identity of the identified camera; The video providing system according to claim 11.

13. The video access information is Including time information indicating the time when the product was picked in the material handling device, The video providing system according to claim 12.

14. The video access information is domain information indicating the address of a server on which the image is stored; The video providing system according to claim 13.

15. The video access information is It is composed of a URL format. The video providing system according to claim 14.

16. The information regarding the product is Identification information of the product; Identification information relating to an order for said goods; Information indicating the product name of the product; Information indicating a product type of the product; Information indicating a shipping destination of the goods; Information indicating a shipping date for the product; Information indicating the arrival date of the product; at least one of 16. The video providing system according to claim 11 .

17. Setting a placement area in which the material handling device is placed; 16. The video providing system according to claim 11 .

18. displaying the placement area in a identifiable manner in the image; The video providing system according to claim 17.

19. and enlarging and displaying the placement area in the image. The video providing system according to claim 17.

20. Displaying only the placement area in the image; The video providing system according to claim 17.

21. A video providing system that provides a user terminal with a video showing a predetermined processing of a product by a predetermined device, the video being taken by a camera installed in a logistics warehouse, registering the identification information of the predetermined device and the identification information of the camera in association with each other; When a predetermined process is performed by the predetermined device, a camera corresponding to the predetermined device that performed the predetermined process is identified based on a correspondence relationship between the registered identification information of the predetermined device and the identification information of the camera; registering predetermined processing information relating to a predetermined process and image access information for accessing the image of the specified camera in association with each other; When confirming a predetermined process for the product using the user terminal, a predetermined process to be confirmed is identified from among a plurality of predetermined processes based on information about the product; providing, to the user terminal, a video showing the specified predetermined process based on the correspondence between the registered predetermined process information and the video access information; Video delivery system.

22. A method for providing a user terminal with a video showing a state of inspection processing of a commodity by an inspection terminal, the video being captured by a camera installed in a logistics warehouse, comprising: registering identification information of the inspection terminal and identification information of the camera in association with each other; When performing the inspection process by the inspection terminal, a step of identifying a camera corresponding to the inspection terminal that performed the inspection process based on a correspondence relationship between identification information of the registered inspection terminal and identification information of the camera; registering inspection processing information related to the inspection processing and video access information for accessing the video of the specified camera in association with each other; When checking an inspection process of a product using the user terminal, identifying an inspection process to be checked from among a plurality of inspection processes based on information about the product; providing, to the user terminal, a video showing the specified inspection process based on a correspondence relationship between the registered inspection process information and the video access information; 23. A computer-implemented image providing method comprising:

23. A video providing program that causes a computer to execute the video providing method according to claim 22.

24. A method for providing a user terminal with an image showing a state of picking a commodity by a material handling device, the image being taken by a camera installed in a logistics warehouse, comprising: A step of registering identification information of the material handling device and identification information of the camera in association with each other; When performing material handling control for picking on the material handling device, a step of identifying a camera corresponding to the material handling device that is the target of the material handling control based on a correspondence relationship between the identification information of the registered material handling device and the identification information of the camera; a step of registering control information related to the material handling control and image access information for accessing the image of the specified camera in association with each other; When confirming the picking of the product by the user terminal, a step of identifying a material handling control corresponding to the picking to be confirmed from among a plurality of material handling controls based on information regarding the product; providing, to the user terminal, a video showing a state of a picking operation corresponding to the specified material handling control based on a correspondence relationship between the registered control information and the video access information; 23. A computer-implemented image providing method comprising:

25. A video providing program that causes a computer to execute the video providing method according to claim 24.

Images