Article search system and computing system
Through the camera and movable lamp system combined with the plane coordinate system, the randomly placed materials in the storage area are automatically identified and positioned, solving the problem of inefficient material management in small-scale factories and achieving fast and accurate material search and positioning.
Patent Information
- Application Number
- JP2024108191
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-07-25
- Filing Date
- 2024-07-04
- Publication Date
- 2025-02-06
AI Technical Summary
The prior art is difficult to effectively manage randomly stored materials in factories that produce small batches of products on a small scale, and manual intervention is often required and inefficient.
The camera and movable lamp system are adopted, combined with the plane coordinate system, and the materials placed randomly in the storage area are automatically identified and positioned, and precise positioning and guidance are achieved through identification codes and feature information.
It realizes rapid and accurate search and positioning of randomly placed materials in the storage area, reduces manual intervention, and improves management efficiency.
Smart Images

Figure 2025018961000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to an article search system and a computer system, and is suitable for application to, for example, an article search system and a computer system for searching for articles that may be stored in random positions within a storage area. [Background technology]
[0002] A method for managing the storage of parts and other items from the time they are received to the time they are removed from the warehouse in a factory is described in Patent Document 1. This method aims to improve the efficiency of removing items from the warehouse by shortening the cycle time from the time they are removed from the warehouse in an automated warehouse, and devise an operating mode for the lane on which the items to be removed are placed, enabling the items to be removed efficiently. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Publication No. 7-257707 Summary of the Invention [Problem to be solved by the invention]
[0004] However, while the method disclosed in Patent Document 1 is an efficient method in large factories that mass-produce a small variety of products, it is difficult to say that it is an effective method in small factories that produce a wide variety of products in small quantities, because managing the placement of parts in the storage area often requires manual intervention by workers.
[0005] The present invention has been made in consideration of the above points, and aims to propose an item search system and a computer system that can easily search for items that may be stored in random locations within a storage area. [Means for solving the problem]
[0006] In order to solve such problems, the present invention comprises an identification information acquisition unit that acquires characteristics of items that may be randomly placed within a storage area by acquiring spatial information of the storage area in which items may be placed, an identification unit that identifies the item from the characteristics of the item acquired by the identification information acquisition unit, a position recognition unit that assigns planar coordinates to the spatial information of the storage area acquired by the identification information acquisition unit and repeatedly associates items identified by the identification unit with the planar coordinates at any desired timing, an input unit that accepts characteristics of a desired item in order to search for its position within the storage area, a search unit that searches for the position of the desired item within the storage area based on the characteristics of the desired item input via the input unit, and a notification unit that notifies the position of the desired item searched for by the search unit. Effect of the Invention
[0007] According to the present invention, it is possible to realize an article search system and a computer system that can easily search for articles that may be stored in random locations within a storage area. [Brief description of the drawings]
[0008] [Figure 1] 1 is a schematic configuration diagram showing an example of a system configuration of an article search system according to a first embodiment. [Diagram 2] 1 is a block diagram showing an example of a simplified representation of the functions of an item search system. [Diagram 3] FIG. 11 is a plan view showing an example of a simplified map of a storage area. [Figure 4] FIG. 4 is a schematic diagram showing an example of managing the map of the storage area shown in FIG. 3 using a matrix coordinate system. [Diagram 5] 11 is a sequence chart showing an example of a procedure for linking position information of an item within a storage area to a map of the storage area. [Figure 6] FIG. 11 is a diagram showing an example of a search sequence for an item. [Figure 7]13 is a sequence chart for searching for an item that is a component part that makes up a parent item based on the identification code of a desired item. [Figure 8] 13 is a sequence chart for carrying a new item into a storage area. [Figure 9] 13 is a sequence chart for carrying out an article from a storage area. [Figure 10] 11 is a sequence chart showing an example of a measure to be taken when an identification code of an item that should be found in a storage area is not found. [Figure 11] FIG. 11 is a schematic configuration diagram showing an example of a system configuration of an article search system according to a second embodiment. [Figure 12] FIG. 13 is a system configuration diagram showing an example of the configuration of a computer system including a security system according to a third embodiment. [Figure 13] FIG. 13 is a diagram illustrating an example of the configuration of a storage management area management database. [Figure 14] FIG. 2 is a diagram showing an example of the configuration of a valuables management database; [Figure 15] FIG. 2 is a diagram illustrating an example of a configuration of a user information management database. [Figure 16] FIG. 13 is a diagram illustrating an example of a terminal screen displayed on the terminal. [Figure 17] FIG. 2 is a diagram showing an example of an image based on shooting data. [Figure 18] FIG. 13 is a diagram showing another example of a terminal screen displayed on the terminal. [Figure 19] FIG. 13 is a system configuration diagram showing an example of the configuration of a computer system including a production management system in a fourth embodiment. [Figure 20] FIG. 2 is a diagram illustrating an example of the configuration of an identification code management database. [Figure 21] FIG. 2 is a diagram illustrating an example of a configuration of a parts management database. [Figure 22] FIG. 13 is a diagram illustrating an example of the configuration of a task list management database. [Figure 23] FIG. 13 is a diagram illustrating an example of the configuration of an identification code position information management database. [Figure 24]FIG. 13 is a diagram showing an example of a terminal screen displayed on a user's terminal. [Diagram 25] FIG. 13 is a diagram showing an example of a terminal screen displayed on a user's terminal. [Figure 26] FIG. 13 is a system configuration diagram showing an example of the configuration of a computer system including a delivery system in a fifth embodiment. [Figure 27] FIG. 13 is a diagram illustrating an example of the configuration of a loading list management database. [Figure 28] FIG. 13 is a diagram showing an example of a terminal screen displayed on a user's terminal. [Figure 29] FIG. 23 is a diagram showing an example of the configuration of an identification code position storage database of an article search system in a sixth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] An embodiment of the present invention will now be described in detail with reference to the drawings.
[0010] (1) First embodiment FIG. 1 is a schematic diagram showing an example of the system configuration of an item search system 100 according to a first embodiment. The item search system 100 is a system for searching for items that may be placed at random positions in a space. In the first embodiment, a storage area 99 is illustrated as an example of a space, and parts that constitute a finished product (hereinafter referred to as "items") are illustrated as an example of an item. Note that there may be a work area and an aisle area in addition to the storage area 99. In the following description, when there is no need to distinguish each item 5 from another, they will simply be referred to as items 5.
[0011] In the storage area 99, in the illustrated example, an entrance 100a is provided on the rear left side wall for bringing in items 5 that are components that make up products manufactured by the factory's manufacturing process, and in the illustrated example, an exit 100b is provided on the right side of the front side wall for transporting items 5 out of the storage area 99.
[0012] A plurality of racks 10 are arranged on the floor of the storage area 99, and each rack 10 has, for example, four wheels on the underside. This allows each rack 10 to be moved to a random position on the floor of the storage area 99, and therefore each rack 10 can be arranged at a random position within the storage area 99. Therefore, in the storage area 99, the items 5 that can be placed on each rack 10 can be arranged at random positions. In the following description, when there is no need to distinguish each rack 10 from another, each rack 10 will be simply referred to as rack 10.
[0013] The racks 10 each have a flat shelf or multiple shelves, and at least one type of item 5 can be placed on each shelf. For example, the rack 10a shown in the lower left of the figure has two shelves, and different types of items 5a and 5b are placed on each shelf. On the top surface of each rack 10, a work slip corresponding to each item 5 to be placed is attached. On each work slip, an identification code 9 for identifying the type of item 5 to be placed on each rack 10 is printed. The identification code 9 is, for example, a barcode such as a QR (Quick Response) code (registered trademark). This allows the type of item 5 placed on the rack 10 to be known when the identification code 9 is read.
[0014] Meanwhile, a plurality of cameras 3 as an example of an identification information acquisition unit are fixed to the ceiling of the storage area 99. The cameras 3 photograph the space of the storage area 99 to acquire information about the space of the storage area 99 in which an item 5 may be placed, thereby acquiring an identification code 9 as an example of a characteristic of an item 5 that may be randomly placed in the space. Note that instead of the identification code 9, the characteristic of the item 5 may be, for example, the shape of the item 5 itself.
[0015] A camera 3 is provided on the ceiling of the storage area 99 for each area when the storage area 99 is divided into a plurality of areas. That is, one camera 3 is provided on the ceiling of each area. By combining the angles of view of the cameras 3, an image can be obtained that covers the entire space of the storage area 99. In the first embodiment, the storage area 99 is managed by dividing it into two areas, a left area and a right area, in the orientation shown in the figure, and one camera 3 is provided on the ceiling of the storage area 99 for each area.
[0016] In the first embodiment, an imaging device having a so-called autofocus function or a deep focal depth is used as the camera 3. This allows the camera 3 to reliably read the identification code 9 (hereinafter also simply referred to as the "identification code 9 of the item 5") on the work slip of the item 5 attached to each rack 10 that may be placed at random positions in the storage area 99, even if the height from the floor surface of the identification code 9 is not always constant.
[0017] It should be noted that, instead of camera 3 taking pictures downward from the ceiling of storage area 99 in which camera 3 is installed as described above, camera 3 (or movable lamp 7) may be installed facing a vertical surface (e.g., a side wall) within storage area 99, and the camera 3 may take a picture from the side of a work slip identification code 9 provided on the side of a vertical rack on which item 5 can be placed.
[0018] Furthermore, a movable lamp 7 is provided on the ceiling of the storage area 99 as an example of a notification unit that notifies the location of a desired item 5. At least one movable lamp 7 is provided on the ceiling. The movable lamp 7 includes a lamp unit 7a and a movable unit 7b. The lamp unit 7a has a function of emitting light with a certain degree of directionality.
[0019] The movable unit 7b has a fixed part that is fixed to the ceiling of the storage area 99, and the movable unit 7b that supports the lamp unit 7a is configured to be able to change the orientation of the lamp unit 7a so that it is inclined, for example, within a range of 180° left and right and 45° up and down, relative to the fixed part. As a result, the movable lamp 7 is configured to be able to irradiate light, for example, onto each rack 10, according to the input attitude control data. This allows a worker to recognize the position of a specific rack 10 within the storage area 99 based on the manner in which the movable lamp 7 irradiates light.
[0020] In the article search system 100 according to the first embodiment, the above-mentioned movable lamp 7, camera 3, and information terminal 6 are connected to each other via a wireless or wired network.
[0021] The information terminal 6 is a so-called tablet or computer equipped with a display unit, and when the location of the item 5 within the storage area 99 is identified by a search in response to an identification code (corresponding to the display of "XXX" in the illustrated example) input by the worker as an example of a characteristic of the desired item 5, the display unit displays the location of the item 5 within the storage area 99, as will be described in detail later. As described above, instead of the identification code, the characteristic of the item 5 may be the shape of the item 5. In this case, the type of item 5 is identified based on the shape of the item 5, and the identification code of the item 5 is identified.
[0022] Here, the worker manually inputs the identification code of the desired item 5, but instead, it may be input using voice recognition or by reading another type of barcode. When inputting using voice recognition, the input unit 35 is equipped with a voice recognition unit, and receives voice as the characteristics of the item 5 to be input when searching for the position of the item 5 within the storage area 99, and recognizes the received voice as the characteristics of the item 5 by the voice recognition function of this voice recognition unit.
[0023] It should be noted that the method of presenting the search results for the item 5 to the worker is not limited to this, and instead of displaying on the display unit of the information terminal 6 described above, for example, a screen display unit 95 may be provided on a side wall of the storage area 99, and the notification unit 37 may display on this screen display unit 95 the position of the item 5 in the storage area 99 searched for by the search unit 36. In this way, the worker can directly ascertain the position of the item 5 in the storage area 99 without operating the information terminal 6.
[0024] 2 is a block diagram showing an example of a simplified representation of the functions of the article search system 100. The article search system 100 includes a control unit 31, an identification information acquisition unit 32, an identification unit 33, a position recognition unit 34, an input unit 35, a search unit 36, a notification unit 37, and a storage unit 38, and preferably further includes an external connection interface 39. The control unit 31 is connected to the identification information acquisition unit 32, the identification unit 33, the position recognition unit 34, the input unit 35, the search unit 36, the notification unit 37, the storage unit 38, and the external connection interface 39, and controls the identification information acquisition unit 32, etc. while exchanging data with the identification information acquisition unit 32, etc. The external connection interface 39 is an example of a first external connection interface, and is an interface for connecting to an external system described later.
[0025] The memory unit 38 stores a product configuration table and a placement history table as described below. The product configuration table manages the relationship between a product (finished product) manufactured in the manufacturing process in the storage area 99 and a plurality of parts that constitute the product. On the other hand, the placement history table manages the placement history of the item 5 that has been stored in the storage area 99. The positions of the item 5 that have been recognized in the past by the position recognition unit 34 are written into this placement history table.
[0026] As described above, the identification information acquisition unit 32 has a function of acquiring the identification code 9 of the item 5 that may be placed at a random position within the storage area 99, and one example of such an acquisition is the camera 3. The identification information acquisition unit 32 is not limited to the camera 3, and may be a contactless reader or a laser reading device. The identification information acquisition unit 32 may be an airborne flying object equipped with the camera 3. This airborne flying object is an aircraft having at least one propeller, and is equipped with a GPS (Global Positioning System) function so that its position in the space within the storage area 99 to which it is moving can be grasped.
[0027] Under the control of the control unit 31, the identification unit 33 identifies the item 5 from the characteristics of the item 5 acquired by the identification information acquisition unit 32. Specifically, the identification unit 33 uses an image recognition function to perform image recognition on an image of the storage area 99 based on photographic data from the camera 3, which is an example of the identification information acquisition unit 32, to determine whether or not an identification code 9 of the item 5 is included in the image of the storage area 99.
[0028] If the identification code 9 is located at the edge of the camera 3's shooting range, the image of the identification code 9 will be distorted. In this distorted state, the position recognition unit 34 may have difficulty recognizing the identification code 9 even if it uses an image recognition function. Therefore, in this embodiment, distortion correction is performed on the image according to the shooting angle of the camera 3 and the distortion state of the captured image. For example, when a square identification code 9 is photographed by the camera 3, if the image is trapezoidal or diamond-shaped, distortion correction is performed on the image so that the shape becomes square. In this way, the recognition rate of the identification code 9 can be increased.
[0029] Furthermore, when the identification code of the item 5 includes information that enables identification of the orientation of the identification code itself, the identification unit 33 adjusts the orientation of the identification code to identify the item 5 from the identification code regardless of the orientation of the item 5. Here, it is desirable that the rack 10 on which the item 5 with an identification code is placed is placed in a position that allows the item 5 to be easily photographed by the camera 3 when it is brought into the storage area 99.
[0030] The position recognition unit 34, under the control of the control unit 31, assigns planar coordinates to the spatial information of the storage area 99 acquired by the identification information acquisition unit 32, and associates the item 5 repeatedly identified by the identification unit 33 at any timing with this planar coordinate. Specifically, the position recognition unit 34, for example, synthesizes two images taken by the two cameras 3 on the ceiling described above, and creates a map of the storage area 99 so as to cover the entire floor surface of the storage area 99. At this time, the position recognition unit 34 synthesizes the two images so that they overlap each other, thereby making it possible to construct a map of the storage area 99 that can cover the floor surface of the storage area 99 without omission. Furthermore, the position recognition unit 34 manages each matrix-like section of the map of the storage area 99 in one coordinate system.
[0031] Under the control of the control unit 31, the input unit 35 receives an identification code as an example of a characteristic of the desired item 5 in order to search for the location of the item 5 within the storage area 99. The characteristic of the item 5 may be at least one of a character and a symbol attached to the item 5. The input unit 35 receives input of the identification code via the information terminal 6 operated by the worker. The input unit 35 searches for the location of the desired item 5 within the storage area 99 from the association result by the position recognition unit 34 based on the received identification code.
[0032] Under the control of the control unit 31, the search unit 36 searches for the position of the desired item 5 within the storage area 99 from the association result by the position recognition unit 34 based on the identification code accepted by the input unit 35. Specifically, the search unit 36 searches for the position of the item 5 within the storage area 99 from the association result by the position recognition unit 34 based on the identification code of the item 5 accepted by the input unit 35, with the above-mentioned planar coordinates as a reference.
[0033] The search unit 36, under the control of the control unit 31, searches for and grasps the relationship between a product (finished product) and a plurality of parts that constitute the product, based on the product configuration table in the storage unit 38, and identifies the components that have the product as a parent item. Note that this identification may be performed by the control unit 31.
[0034] In this embodiment, the memory unit 38 has a placement history table that manages the placement history of items 5 that have been brought into the storage area 99, and if the item 5 cannot be found within the storage area 99 as a result of photographing by the camera 3, the search unit 36 checks the history of the location information of the item 5 from the above-mentioned placement history table.
[0035] The notification unit 37 has a function of notifying the worker of the position of the desired item 5 in the storage area 99 by an optical method according to the search result by the search unit 36. Specifically, the notification unit 37 outputs, via the control unit 31, posture control data for controlling the posture of the lamp unit 7a of the movable lamp 7 so that the lamp unit 7a of the movable lamp 7 faces the direction of the rack 10 on which the desired target item 5 is placed. This posture control data also includes lighting control data for the lamp unit 7a to irradiate light in a predetermined manner (for example, lighting or blinking) for a certain period of time. As a result, the lamp unit 7a of the movable lamp 7 irradiates light from the lamp unit 7a for a certain period of time so as to cover the rack 10 on which the target item 5 is placed.
[0036] In this embodiment, the notification unit 37 may display the results of a search by the search unit 36 for the location of the item 5 within the storage area 99 on the display unit of the portable information terminal 6 using augmented reality (AR).
[0037] In addition, in this embodiment, the notification unit 37 may project an image of the spatial information of the storage area 99 acquired by the identification information acquisition unit 32 onto a display unit (not shown) using, for example, projection mapping.
[0038] Furthermore, in this embodiment, the notification unit 37 may be configured to have a guidance unit that provides guidance regarding the location of the item 5 within the storage area 99 by at least one of sound and voice.
[0039] FIG. 3 is a plan view showing an example of a simplified map of the storage area 99. The map of the storage area 99 is composed of the photographed areas 33a and 33b captured by the two cameras 3 described above. As shown by the two-dot chain line, the photographed areas 33a and 33b are configured so that their adjacent areas overlap, and the angle of view of the two cameras 3 is configured to be larger than the photographed area so that no item 5 is missed. In other words, the angles of view of the two cameras 3 overlap so that no gaps are left between them. As a result, images captured of the storage area 99 using the two cameras 3 are stitched together to form a single image of the storage area 99.
[0040] In the illustrated example, a new rack 10 carrying items 5 can be brought in through an entrance 100a of the storage area 99, and a rack 10 in the storage area 99 can be taken out through an exit 100b. Even when a rack 10 is brought in or taken out in this manner, the camera 3 captures an image of the items 5 on the rack 10 being brought in or taken out, as shown by the two-dot chain line.
[0041] Fig. 4 is a schematic diagram showing an example of managing the map of the storage area 99 shown in Fig. 3 in a matrix coordinate system. The method of managing the coordinate system is performed by the above-mentioned position recognition unit 34. The position recognition unit 34 manages the map of the storage area 99 in one coordinate system with a large number of matrix-like rectangular sections corresponding to the map of the storage area 99. The position recognition unit 34 joins together images captured by the above-mentioned two cameras 3 to create one coordinate system.
[0042] The general configuration of the article search system 100 has been described above. Next, an example of the operation of the article search system 100 will be described.
[0043] 5 is a sequence chart showing an example of a procedure for linking position information of an item 5 within a storage area 99 to a map of the storage area 99. In step S101, the control unit 31 controls two cameras to capture images of the storage area 99 with the two cameras 3, respectively. In step S102, the position recognition unit 34 stitches together the two images of the storage area 99 to create a map of the storage area 99. In step S103, the control unit 31 assigns the above-mentioned coordinate system to the generated map.
[0044] On the other hand, in step S104, the worker carries the item 5 into an arbitrary position in the storage area 99 through the entrance 100a, and places the item 5 in a position where the identification code 9 attached to the work slip can be photographed by the camera 3.
[0045] Next, in step S105, the control unit 31 outputs an instruction to the camera 3 to read the identification code 9 of the item 5 at an arbitrary timing. In step S106, the camera 3 reads the identification code of the item 5. Note that the method of identifying the item 5 is not limited to the above-mentioned one, and may be a method using characters or symbols attached to the item 5, the shape of the item 5 itself, or a non-contact tag (RFID: Radio Frequency IDentification). In step S107, the control unit 31 causes the position recognition unit 34 to link the position information within the storage area 99 relating to the identification code 9 read by the camera 3 to the map. Linking here refers to managing the map in the coordinate system.
[0046] On the other hand, in step S108, the worker moves the position of the rack 10 on which the item 5 is mounted within the storage area 99.
[0047] Next, in step S109, the control unit 31 outputs an instruction to the camera 3 to read the identification code 9 of the item 5 at an arbitrary timing. In step S110, the camera 3 reads the identification code 9 in the storage area 99. Note that in step S110, the size of the identification code itself may be increased so that the identification code can be read, or the placement of the item 5 may be moved to a position visible to the camera 3. Note that in steps S109 to S110, since there is a high possibility that a worker is involved when the position of the item 5 on the rack 10 is changed, the presence of the worker may be recognized and the movement of the identification code within a certain range from the worker may be tracked. Also, in steps S109 to S110, reading of the identification code may be stopped outside business hours, such as at night. Next, in step S111, the control unit 31 links the position information in the storage area 99 related to the identification code 9 read by the camera 3 to the map.
[0048] 6 is a diagram showing an example of a search sequence for an article 5. In step S201, an operator inputs an identification code of a desired article 5 from the information terminal 6. In step S202, the control unit 31 compares the input identification code with the identification code 9 on the map. In step S203, the control unit 31 outputs attitude control data to the notification unit 37 for the movable lamp 7 corresponding to the coordinates of the article on the map with a matching identification code. This attitude control data includes control information for setting a predetermined rotation angle left / right and up / down.
[0049] In step S204, the notification unit 37 outputs attitude control data to the movable lamp 7. Then, the movable lamp 7 controls the movable unit 7b according to the input attitude control data to control the attitude of the lamp unit 7a so that the lamp unit 7a is oriented at a predetermined rotation angle left and right and up and down, and emits light from the lamp unit 7a for a certain period of time. In the first embodiment, when emitting light in this manner, in order to improve the visibility of the worker, a method such as changing the color of the lit light or blinking may be adopted, rather than simply turning it on. In the first embodiment, when the same type of desired article 5 exists in multiple racks 10, the color of the light may be changed according to the purpose.
[0050] Meanwhile, in step S205, the worker finds the desired item 5 by relying on the light emitted from the lamp portion 7a of the movable lamp 7, and moves the desired item 5 from the storage area 99 to the work area. The work area is a place where assembly is performed using the moved desired item 5.
[0051] In step S206, the control unit 31 outputs an instruction to turn off the lamp unit 7a of the movable lamp 7 to the notification unit 37 after a predetermined input or after a certain period of time has elapsed. In step S207, the notification unit 37 outputs the turn-off instruction to the movable lamp 7, turning off the lamp unit 7a.
[0052] The method of notifying the position of the item 5 in the storage area 99 is not limited to the spotlight method using the movable lamp 7 described above, but may include pinpointing the item 5 with a laser, suggesting the position as a shadow picture using light, displaying a map including the position of the item 5 on a tablet, smartphone, or monitor as an example of the information terminal 6, displaying the item 5 by superimposing it on virtual reality (AR: Augmented Reality), displaying the position of the item 5 in cooperation with a GPS (Global Positioning System), or simply displaying it on a screen. In addition, the method of notifying the position of the item 5 in the storage area 99 may include projecting the position of the item 5 in the storage area 99 by so-called projection mapping, indicating the position of the item 5 using a beacon, suggesting the position of the item 5 using a so-called patrol lamp (registered trademark) or searchlight, or guiding the position of the item 5 using sound or voice.
[0053] In the first embodiment, when the identification codes 9 are not recognized due to unintentional overlapping of the identification codes 9, and the control unit 31 determines that the item 5 is not present in the storage area 99 in the latest history, the movable lamp 7 may be configured to emit light according to the position information of the item 5 going back to the time when the desired item 5 was last present in the storage area 99. In this way, the worker can identify the location when searching for the desired item 5.
[0054] 7 is a sequence chart for searching for an item that is a component part that makes up a parent item from the identification code of a desired item 5. In step S301, a worker inputs, from the information terminal 6, the identification code of a finished product that is a parent item made up of a combination of multiple component parts (items 5). In step S302, the control unit 31 collates the part number of the item 5 that is a component part that makes up the parent item with the identification code 9 on the map.
[0055] In step S303, the control unit 31 controls the notification unit 37 to output attitude control data to all movable lamps 7 corresponding to the matching map coordinates for all items of goods 5. In step S304, the notification unit 37 outputs the input attitude control data and turns on or blinks the movable lamps 7 for all items of goods 5. Note that in step S304, the notification unit 37 may notify a plurality of items 5 collectively, or may notify a plurality of items 5 one by one by shining a light on the plurality of items 5 in order of proximity to the position of the search unit 36 (or information terminal 6), whose position relative to the storage area 99 is preset, or may notify a plurality of items 5 in a preset order.
[0056] Meanwhile, in step S305, a worker searches for all of the above items 5 using the guidance of the light emitted from the movable lamp 7, and moves them from the storage area 99 to the work area.
[0057] In step S306, the control unit 31 controls the notification unit 37 so that the movable lamp 7 is turned off after a certain period of time has elapsed. In step S307, the movable lamp 7 is turned off under the control of the notification unit 37.
[0058] 8 is a sequence chart for carrying a new item 5 into the storage area 99. In step S401, a worker passes through the entrance 100a of the storage area 99 while moving the rack 10, which has been positioned so that the identification code 9 attached to the work slip of the item 5 can be photographed by the camera 3.
[0059] In step S402, the identification information acquisition unit 32 controls the camera 3 capable of photographing the entrance 100a of the storage area 99 to read the identification code 9 on the work slip of the item 5. In step S403, the control unit 31 recognizes that the item 5 corresponding to the read identification code 9 has been brought into the storage area 99. In step S404, the notification unit 37 notifies the worker that the reading at the time of carrying in has been completed by turning on the movable lamp 7.
[0060] 9 is a sequence chart for carrying out an article from a storage area 99. In step S01, a worker places an article 5 on a rack 10 in a position where the article can be photographed by a camera 3, and passes through an exit 100b of the storage area 99.
[0061] In step S502, the identification information acquisition unit 32 reads the identification code of the item 5 using the camera 3 capable of photographing the exit 100b of the storage area 99. In step S503, the control unit 31 recognizes that the item with the read identification code 9 has been removed from the storage area 99. In step S504, the notification unit 37 notifies the worker that the reading at the time of removal has been completed by turning on the movable lamp 7.
[0062] In the first embodiment, as described above, in addition to turning on or blinking the movable lamp 7 described above, methods of notifying a worker that an item 5 has been brought into (stored) or taken out of (dispatched) the storage area 99 may include, for example, displaying a map on an information terminal 6 such as a tablet, smartphone, or monitor, linking with virtual reality (AR: Augmented Reality) or GPS (Global Positioning System), displaying on a screen, displaying using projection mapping, notifying with a patrol lamp (registered trademark), or notifying with sound or voice.
[0063] 10 is a sequence chart showing an example of a measure to be taken when an identification code 9 of an item 5 that should have been found in a storage area 99 is not found. In step S601, an operator inputs the identification code of a desired item 5 from an information terminal 6. In step S602, the control unit 31 compares the identification code 9 of an item 5 that is a component part that makes up a parent item with the identification code 9 on the map.
[0064] In step S603, the control unit 31 determines whether or not the item 5 of the specified part is present in the storage area 99. If not, step S604 is executed, whereas if present, step S604 is skipped.
[0065] In step S604, the control unit 31 refers to the placement history in the placement history table (not shown) described above for the item 5, and determines whether or not there is a placement history. If there is a placement history, the control unit 31 executes step S605, whereas if there is no placement history, the control unit 31 executes step S606.
[0066] In step S605, the notification unit 37 notifies the worker that the item has been taken out by the lighting state of the movable lamp 7. In step S606, the control unit 31 goes back to the most recent history of recognizing the target item 5, and outputs attitude control data to the movable lamp 7 corresponding to the coordinates of the item 5 within the storage area 99. In step S607, the notification unit 37 moves the movable lamp 7 according to the input attitude control data, and lights or blinks it. At this time, when the movable lamp 7 irradiates light onto multiple items 5, the light may be irradiated onto each item 5 in any order or a predetermined order or cycle, or the light may be irradiated onto each item 5 in order of proximity to the control unit 31, whose installation position has been determined in advance.
[0067] In step S608, the control unit 31 outputs an instruction to turn off the movable lamp 7 after a certain time has elapsed. In step S609, the notification unit 37 turns off the movable lamp 7.
[0068] Meanwhile, in step S610, a worker searches for a desired item 5 using the guidance of light emitted from the movable lamp 7, and moves it from the storage area 99 to the work area.
[0069] As described above, the item search system 100 of this embodiment comprises an identification information acquisition unit 32 that acquires characteristics of an item 5 that may be randomly placed in the space by acquiring spatial information of a storage area in which an item may be placed, an identification unit 33 that identifies an item from the characteristics of the item acquired by the identification information acquisition unit 32, a position recognition unit 34 that assigns planar coordinates to the spatial information of the storage area 99 acquired by the identification information acquisition unit 32 and repeatedly associates items identified by the identification unit 33 with the planar coordinates at any timing, an input unit 35 that accepts the characteristics of the desired item 5 in order to search for its position within the storage area 99, a search unit 36 that searches for the position of the desired item 5 in the storage area 99 from the position recognition result by the position recognition unit 34 based on the characteristics of the desired item 5 input via the input unit 35, and a notification unit 37 that notifies the position of the desired item 5 searched for by the search unit 36.
[0070] With this configuration, the identification information acquisition unit 32 acquires information about the space of the storage area 99 in which an item may be placed, thereby acquiring characteristics of the item 5 that may be randomly placed in the space. The identification unit 33 identifies the item 5 from the characteristics of the item 5 acquired by the identification information acquisition unit 32. The position recognition unit 34 assigns planar coordinates to the information about the space of the storage area 99, and repeatedly associates the item 5 identified by the identification unit 33 with the planar coordinates at any timing. The search unit 36 searches for the position of the desired item in the storage area 99 based on the characteristics of the desired item 5 input via the input unit 35. The notification unit 37 notifies the user of the position of the desired item searched for by the search unit 36.
[0071] In this embodiment, the identification information acquisition unit 32 is an airborne flying object equipped with a camera 3 as an example of an imaging unit. In this way, the identification information acquisition unit 32 can acquire the identification code of the item 5 more reliably by changing the position and orientation of the identification information acquisition unit 32 within the storage area 99.
[0072] In this embodiment, the identification unit 33 identifies the article 5 from the characteristics of the article 5 regardless of the orientation of the article 5. In this manner, the identification information acquisition unit 32 can more reliably acquire the identification code of the article 5 that may be placed in a random position and orientation within the storage area 99.
[0073] In this embodiment, the feature of the item 5 is an identification code that allows the item 5 to be distinguished from other items, and when the item 5 is brought into the storage area 99, the item 5 with the identification code is placed in a position that is easy to acquire by the identification information acquisition unit 32. In this way, the identification code of the item 5 can be read more reliably.
[0074] In this embodiment, the memory unit 38 has a placement history table (not shown) that manages the placement history of the items 5 that have been brought into the storage area 99, and the search unit 36 checks the history of the location information of the item 5 from this placement history table if the identification information acquisition unit 32 cannot acquire the item 5 within the storage area 99. In this way, even if the search unit is unable to find the desired item 5 within the storage area 99, the location where the item 5 was most recently located can be notified to the worker, making it easier to find the desired item 5 within the storage area 99.
[0075] In this embodiment, the notification unit 37 notifies the location of the item 5 in the storage area 99 by an optical method. In this way, it becomes easier for the worker to visually find the desired item 5 in the storage area 99.
[0076] In this embodiment, the notification unit 37 may be configured to display the position of the desired item 5 in the storage area 99, which is searched for by the search unit 36, on a screen display unit 95 provided on a side wall in the storage area 99. In this way, it is not necessary to provide a dedicated terminal for displaying the position of the item 5 in the storage area 99, and the worker can visually grasp the position of the desired item 5 in the storage area 99 even if he or she does not have an information terminal 6 in the storage area 99.
[0077] In this embodiment, the notification unit 37 uses augmented reality to display the results of the search performed by the search unit 36 for the location of the item 5 within the storage area 99 on the display unit of the portable information terminal 6. In this way, the worker can easily grasp the location of the item 5 using augmented reality, which is easy for the worker to grasp intuitively.
[0078] In this embodiment, the notification unit 37 projects an image of the spatial information of the storage area 99 acquired by the identification information acquisition unit 32 onto the display unit using, for example, projection mapping.
[0079] In this embodiment, the notification unit 37 has a guidance unit that provides guidance by at least one of sound and voice of the location of the item 5 in the storage area 99. In this manner, the worker can grasp the location of the desired item 5 in the storage area 99 by hearing.
[0080] In this embodiment, the identification information acquisition unit 32 stitches together images of the storage area 99 captured by the multiple cameras 3 to create a single image of the storage area 99. In this way, the space of the storage area 99 can be accurately covered without omissions.
[0081] In this embodiment, the input unit 35 has a voice recognition unit that receives voice as a characteristic of the article 5 to be input when searching for the location of the article 5 in the storage area 99, and uses a voice recognition function to recognize the received voice as the characteristic of the article 5. In this way, the worker does not need to manually input the identification code of the desired article 5, and the effort required to search for the location of the article 5 can be reduced.
[0082] In this embodiment, the storage area 99 has an entrance 100a through which the item 5 is brought in, the identification information acquisition unit 32 acquires the characteristics of the item 5 at the entrance 100a, and the recognition unit 33 recognizes that the item 5 corresponding to the acquired characteristics of the item 5 has been brought into the storage area 99. In this manner, the worker can reliably recognize that the item 5 has been brought into the storage area 99.
[0083] In this embodiment, the storage area 99 has an exit 100b through which the item 5 is removed, the identification information acquisition unit 32 acquires characteristics of the item 5 at the exit 100b, and the recognition unit 33 recognizes that the item 5 corresponding to the acquired characteristics of the item 5 has been removed from the storage area 99. In this manner, the worker can reliably recognize that the item 5 has been removed from the storage area 99.
[0084] (2) Second embodiment The item search system according to the second embodiment has almost the same configuration and operation as the item search system 100 according to the first embodiment, so a description of the similar configuration and operation will be omitted and the following description will focus on the differences.
[0085] The article search system according to the second embodiment includes a warehouse area 99a which corresponds to the storage area 99 of the article search system 100 according to the first embodiment, and a passage area 99b which is a space continuous with this warehouse area 99a.
[0086] Dedicated rails 98 as an example of a guide section are laid on the ceilings of the warehouse area 99a and the aisle area 99b so as to cover the entire floor surfaces of the warehouse area 99a and the aisle area 99b. A warehouse area dedicated rail 98a is installed on the ceiling of the warehouse area 99a, and an aisle area dedicated extension rail 98b is installed on the ceiling of the aisle area 99b. In the following description, when there is no particular need to distinguish between the warehouse area dedicated rail 98a and the aisle area dedicated extension rail 98b, they will simply be referred to as dedicated rails 98.
[0087] The dedicated rail 98 is provided with a movable part 97 that can move along the dedicated rail 98, and this movable part 97 can be driven by, for example, a rechargeable battery, and is configured to be able to move along the dedicated rail 98 while supporting the camera 3. Therefore, the camera 3 can capture images of the space within the warehouse area 99a and the passage area 99b by moving the movable part 97 along the dedicated rail 98.
[0088] A maintenance area 99c is provided in part of the warehouse area 99a. In this maintenance area 99c, a part of the above-mentioned warehouse area dedicated rail 98a descends from the ceiling to the floor of the warehouse area 99a. This allows a worker to reach the movable part 97 when the movable part 97 moving on the warehouse area dedicated rail 98a enters the maintenance area 99c, and allows a worker to perform maintenance work such as replacing the battery of the movable part 7b.
[0089] In the article search system according to the modified example of the second embodiment, the movable part 97 as an example of a guide part is provided with a remote-controlled electric lift that can move the camera 3 up and down in a direction perpendicular to the floor surface of the maintenance area 99c. In this way, maintenance such as battery replacement of the movable part 7b can be performed in the warehouse area 99a other than the above-mentioned maintenance area 99c.
[0090] (3) Other modifications In this embodiment, a QR code (registered trademark) is used as an example of an identification code (barcode) that is applied to identify each item 5 from another item, but the present invention is not limited to this, and other types of barcodes may be used.
[0091] In addition, in this embodiment, as a measure to be taken when an item 5 is intentionally removed from the storage area 99, the camera 3 as the identification information acquisition unit 32 may be configured to work in conjunction with various sensors to follow the actions of the worker, to follow the identification code of the item 5, to always read the identification code of the item 5 at the exit 100b, or the like.
[0092] Furthermore, in this embodiment, the timing for acquiring the location information of the items 5 within the storage area 99 can be, in addition to the arbitrary timings described above, randomly at a fixed time, when the items 5 are moving, only during the day or only at night, or in conjunction with human detection such as for workers, at short intervals during the time period when people are detected.
[0093] Furthermore, in the present embodiment, the fixed portion of the movable lamp 7 is mainly fixed to the ceiling, but the present invention is not limited to this, and the movable lamp 7 may be configured to be movable on the ceiling.
[0094] In addition, in this embodiment, methods for making the identification code of the item 5 easier to read include determining in advance the position of the rack 10 within the storage area 99 and determining in advance the position of the identification code, as well as reducing the information of the identification code and making the code itself larger.
[0095] In addition, in this embodiment, as a countermeasure when the identification code cannot be read, the position recognition unit 34 may refer to the placement history table in the memory unit 38 and notify the notification unit 37 about the item 5 on a date close to when the identification code was read, or may notify the notification unit 37 about the data one step prior in chronological order, or may automatically notify the notification unit 37 of the items 5 up to the point where they have been recognized.
[0096] (4) Third embodiment The item search system in the third embodiment has a configuration and operation that is almost the same as the item search system 100 according to the first embodiment and the item search system according to the second embodiment, and their modified examples (hereinafter collectively referred to and illustrated as "item search system 100 according to the first embodiment, etc."), so a description of the similar configurations and operations will be omitted, and the following description will focus on the differences. Note that in the following description, users, users, workers, etc. are examples of people, and unless otherwise specified, they are the same person. Also, in the following embodiments, illustrations of some networks are omitted.
[0097] The computer system according to the third embodiment includes a security system as described below in addition to the item search system 100 according to the first embodiment, etc. The security system includes a second interface (not shown) connectable to an external system, and is connected to the item search system 100 according to the first embodiment, etc. via a network (not shown) for communicating data, etc.
[0098] In the first embodiment, parts constituting a finished product are given as an example of the object 5 to be searched, but in the third embodiment, the belongings of a visitor (hereinafter also referred to as a "general user" or "owner") who visits the storage area 99 are given as an example of the belongings. In the following, valuables are given as an example of the belongings. Note that in the third embodiment, in addition to the belongings, parts constituting a finished product may also be searched.
[0099] In other words, the item search system of this embodiment is intended to be used when searching for visitors' belongings that may be brought into the storage area 99.
[0100] 12 is a system configuration diagram showing an example of the configuration of a computer system including a security system 300 according to the third embodiment. The computer system according to this embodiment includes the item search system 100 and the security system 300 according to the above-mentioned first embodiment etc.
[0101] The security system 300 receives the photographed data 199 from the item search system 100 according to the first embodiment etc. The security system 300 transmits the user ID, password, face information, update information, terminal location information and judgment result to the information terminal 6 of the administrator user, and notifies the information terminal 6 of the administrator user of the judgment result. The security system 300 also receives the user information and update information input to the information terminal 6 by the administrator user.
[0102] On the other hand, the security system 300 transmits the user ID, password, face information, update information, terminal location information, and judgment result to the information terminal 6 of the general user, and notifies the judgment result to the information terminal 6 of the general user. In addition, the security system 300 receives the user information and update information inputted to the information terminal 6 by the general user.
[0103] The security system 300 comprises a storage management area management database 302, a valuables management database 303, a user information management database 304, and a warning control unit 305. In the following description, database will be abbreviated to "DB".
[0104] The warning control unit 305 determines whether there is a problem with the security of the storage area 99, for example, by identifying a visitor based on the photographed data 199 and identifying the visitor's valuables based on the photographed data 199 and determining whether there is a problem with the security of the valuables based on the received photographed data 199. If there is a problem with the security of the visitor's valuables, the warning control unit 305 issues a warning or notification.
[0105] The storage area management DB 302 manages each storage area 99. The valuables management database 303 manages each valuable. The user information management DB 304 manages each user information. The storage area management DB 302, valuables management DB 303, and user information management DB 304 will be described in detail later.
[0106] 13 is a diagram showing an example of the configuration of the storage management area management database 302. The storage management area management database 302 manages, for each ID (IDentifier), a storage area ID for identifying each storage area 99 from another, a camera ID (IDentifier) for identifying each camera 3 from another, and storage area position information indicating the position of the storage area 99.
[0107] Fig. 14 is a diagram showing an example of the configuration of valuables management database 303. Valuables management database 303 manages, for each ID, a classification of valuables, an image of the valuables, a storage area ID, a user ID for identifying each visitor, and a proxy user ID for identifying each proxy user who represents each visitor. Although not shown in Fig. 14, the database also manages a user name (e.g., the owner's name) corresponding to the above-mentioned user ID (e.g., the owner's identifier).
[0108] 15 is a diagram showing an example of the configuration of the user information management database 304. The user information management database 304 manages, for each ID, a user name indicating the name of each user and a user image indicating an image of the user's appearance.
[0109] 16 is a diagram showing an example of a terminal screen displayed on the information terminal 6. In the example shown in the figure, the terminal screen displays, for each ID, a valuables classification, a valuables image, an owner name, and an owner image representing an image of the owner among the above-mentioned user IDs.
[0110] 17 is a diagram showing an example of an image based on the photographed data 199. The image includes, for example, person information 317A and valuables information 317B and 317C. The person information 317A and valuables information 317B and 317C are the person information and valuables information extracted by the warning control unit 305 described above from the photographed data 199 by image recognition, respectively.
[0111] The person information 317A is obtained from a face image and motion information (e.g., video, skeletal coordinate information) included in the image. On the other hand, the valuables information 317B is obtained from a type of valuables (e.g., a wallet) based on an image of the valuables included in the image (hereinafter referred to as a "valuables image").
[0112] 18 is a diagram showing another example of a terminal screen displayed on the information terminal 6. In the illustrated example, the terminal screen displays, for each ID, a valuables classification, a valuables image, an owner name, an owner image representing an image of the owner among the above-mentioned user IDs, owner motion information, and a terminal ID. The terminal ID indicates a value that can identify the information terminal 6 (for example, an IP (Interna Protocol) address).
[0113] The warning control unit 305 compares the valuables images with each other, and if the valuables images match, it further compares the most similar owner image corresponding to the valuables image with the face image based on the photographed data 199. If the warning control unit 305 cannot make a judgment based on the face image alone, it also compares the user's motion information with each other.
[0114] <Warning output processing> In the warning output process, a warning is output when a person other than the owner of the valuables enters the storage area 99. In this embodiment, the assumed situation is that a place for managing valuables in a factory or the like is provided within the storage area 99, and this warning output process is executed to prevent theft of the valuables. For example, workers working in the factory and visitors such as guests have information terminals 6 that can identify them, and use the information terminals 6 to register their valuables and users.
[0115] <When registering or updating valuables and storage areas> The warning control unit 305 executes user authentication using a predetermined login function.
[0116] In step A1, the administrator user inputs user information using the administrator user's information terminal. In step A2, the administrator user transmits the input user information to the security system using the administrator user's information terminal. In step A3, the security system 300 compares the user management information it manages with the received user information.
[0117] In step A4, if the user management information managed by security system 300 itself matches the received user information, security system 300 authenticates the login and transmits function list information to the information terminal of the administrative user. In step A5, if the user management information managed by security system 300 itself does not match the received user information, security system 300 rejects the login and transmits login screen information and error information to the information terminal of the administrative user.
[0118] <Select the function to register and update valuables and storage areas> In step A6, the information terminal of the administrator user displays a function list from the function list information received from the security system 300. In step A7, the administrator user selects a valuables (and storage area) registration and update function from the function list displayed on the information terminal.
[0119] In step A8, the administrator user's information terminal requests the security system 300 to send information related to valuables (and storage area) registration and update functions. In step A9, the security system 300 acquires a data list from its own management information of valuables (and storage area) based on the information requested from the administrator user's information terminal. In step A10, the security system 300 transmits the data list acquired from its own management information of valuables (and storage area) to the administrator user's information terminal.
[0120] <Register valuables (and storage area), enter updated information, and submit> In step A11, the administrator user's information terminal displays the list of valuables (and storage area) management data received from the security system 300. In step A12, the administrator user inputs information on the valuables (and storage area) that the administrator user wishes to register or update into the administrator user's information terminal. In step A13, the administrator user confirms the valuables (storage area) information that the administrator user wishes to register or update, which is written on the administrator user's information terminal.
[0121] In step A14, the information terminal of the administrator user transmits the registered and updated valuables (and storage area) information to the security system.
[0122] <Update valuables (and storage area) database> In step A15, the security system 300 updates the valuables (and storage area) management information in the storage area management DB 302 and valuables management DB 303 based on the valuables (and storage area) information received from the information terminal of the administrative user.
[0123] <Warning when someone enters the storage area (issuing a warning when someone other than the owner of valuables enters)> <Acquiring photographic data of the storage area> In step B1, the item search system 100 of the first embodiment etc. acquires image data from the camera 3 capturing a portion of the storage area 99. In step B2, the item search system 100 of the first embodiment etc. then extracts valuables information (e.g. valuables classification, valuables image) and person information (e.g. face image, motion information (video, skeletal coordinate information, etc.)) from the image data and transmits them to the security system 300.
[0124] <Selecting authorized users for valuables from photographic data and identifying people captured on camera> In step B3, the security system 300 waits to receive valuable information and person information from the item search system 100 of the first embodiment, etc. In step B4, the security system 300 creates a list of authenticated users linked to valuables from the valuable information received from the item search system 100 of the first embodiment, etc., its own valuables management information (valuable type, valuable image), and user management information (face information, motion information, terminal information). In step B5, the security system identifies people from the person information (face information, motion information, etc.) received from the object detection system.
[0125] <Determine whether the identified person is in the list of authenticated users> In step B6, if the identified person is present in the list of authenticated users, the security system 300 performs step B3. If the identified person is not present in the list of authenticated users or if it is unclear whether the identified person is present in the list of authenticated users, the security system 300 performs step B7.
[0126] <If it is unclear whether the identified person is an authenticated user, it is inferred from the information device they own> In step B7, the security system 300 requests the information terminal of an authenticated user from the list of authenticated users to transmit current location information (for example, GPS (Global Positioning System) information, beacon information).
[0127] In step B8, the information terminal of the authenticated user sends current location information to the security system. In step B9, the security system 300 waits for location information from the information terminal of the authenticated user for a certain period of time. If the security system 300 acquires location information within the certain period of time, it performs step B10, which will be described later, whereas if it does not receive location information within the certain period of time, it performs step B12, which will be described later.
[0128] In step B10, the security system 300 compares the location information received from the authenticated user's information terminal with the location information of the storage area. In step B11, the security system 300 performs step B3 if the location information of the authenticated user's information terminal is near the storage area. If the location information of the authenticated user's information terminal is not near the storage area, the security system 300 performs step B12.
[0129] <If the user is not an authenticated user, an alert is issued to the intruder in the storage area, and an authenticated user is notified> In step B12, the security system 300 issues a warning (displaying on a display, issuing an audio warning, turning on a lamp, etc.) to the person who has entered the storage area 99. In addition, the security system 300 transmits warning information to the information terminal of the authenticated user.
[0130] The computer system according to this embodiment includes an item search system according to at least one of the first embodiment, the second embodiment, and their modified examples, or a combination of any of them, and a security system 300 that includes a second external connection interface for connecting to the item search system and manages the security of the storage area 99. In this way, the security system 300 can manage the security of belongings (e.g., valuables) of visitors to the storage area 99 based on the photographed data 199 received from the item search system as photographed data by the camera 3.
[0131] The computer system according to this embodiment exchanges data and the like with, for example, the item search system 100 according to the first embodiment etc., via the second external connection interface. In this way, it is possible to ensure the security of the item 5 while exchanging data and the like with the item search system 100 according to the first embodiment etc., and utilizing the item search system 100 according to the first embodiment etc.
[0132] In this embodiment, the security system 300 sets the items 5 to be protected and the storage area 99 to be targeted, and registers and updates information (such as the valuables information) relating to the possessions (items 5) of visitors (e.g., owners) such as valuables as needed. In this way, the security system 300 can ensure the security of the items 5 in the storage area 99 that has been set.
[0133] In this embodiment, the security system 300 identifies the item 5 from the photographed data 199, which is an example of image information acquired internally or externally, and creates an authenticated user list that extracts pre-approved persons as owner information of the item 5. The authenticated user list may be managed, for example, as a database. In this way, the security system 300 can ensure the security of the item 5 in the storage area 99 by authenticating persons in the storage area 99 using the created authenticated user list.
[0134] In this embodiment, the security system 300 identifies a person from the photographed data 199, which is an example of image information acquired from inside or outside, and determines whether the person matches a person who has been previously authorized. In this way, by determining whether the identified person is an authorized person (e.g., a worker), the security of the item 5 in the storage area 99 can be ensured.
[0135] In this embodiment, the security system 300 judges whether or not the person carrying the information terminal 6 is a pre-authorized person, depending on whether the location information of the information terminal 6 carried by the pre-authorized person is near the target storage area 99. In this way, by verifying the person carrying the information terminal 6, the security of the items 5 in the storage area 99 can be ensured.
[0136] In this embodiment, the security system 300 issues a warning using light information, sound information, or both to a person who has been determined in advance to be an unauthorized person. In this way, the security of the article 5 can be protected from a person who has been determined to be an unauthorized person.
[0137] In this embodiment, when a warning is issued, the security system 300 transmits the information about the warning to the information terminal 6 of a person who has been authorized in advance. In this way, the authorized person can use the information terminal 6 to check the information about the warning, thereby ensuring the security of the item.
[0138] (5) Fourth embodiment The item search system in the fourth embodiment has a configuration and operation that is almost the same as the item search system 100 in the first embodiment etc. described above, so we will not explain the similar configuration and operation and will focus on the differences below.
[0139] The computer system according to the fourth embodiment includes a production management system as described below in addition to the article search system 100 according to the first embodiment etc. The production management system includes a second interface (not shown) connectable to an external system, and is connected to the article search system 100 according to the first embodiment etc. via a network (not shown) for communicating data etc.
[0140] 19 is a system configuration diagram showing an example of the configuration of a computer system including a production management system 400 in the fourth embodiment. The computer system according to this embodiment is equipped with the article search system 100 according to the first embodiment etc. described above and the production management system 400. The article search system 100 according to the first embodiment etc. is equipped with, in addition to the functions described above, for example, an identification code generation function and an identification code issuing function.
[0141] The production management system 400 transmits identification code information 9A corresponding to the identification code 9 to the article search system 100 according to the first embodiment etc. On the other hand, in this embodiment, the article search system 100 according to the first embodiment etc. has a function of issuing an identification code 9 to a user based on the identification code information 9A.
[0142] The production management system 400 includes a work list management DB 402, a parts information management DB 403, a user information management DB 404, and an identification code management DB 405. The user information management DB 404 is almost the same as the user information management DB 304 in the third embodiment, and therefore a description thereof will be omitted.
[0143] The work list management DB 402 manages work lists. The part information management DB 403 manages part information about, for example, the item 5. The identification code management DB 405 manages identification information. The work list management DB 402, the part information management DB 403, and the identification code management DB 405 will be described in detail later.
[0144] 20 is a diagram showing an example of the configuration of the identification code management DB 405. The identification code management DB 405 manages, for each ID (IDentifier), the identification code information of the identification code 9, the part number of the article 5, and the number of parts.
[0145] 21 is a diagram showing an example of the configuration of the part information management DB 403. The part information management DB 403 manages, for each ID, the part number of the item 5, a part image corresponding to the image of the item 5, and a remarks field. Note that the part image is shown diagrammatically for convenience of explanation.
[0146] 22 is a diagram showing an example of the configuration of the work list management DB 402. The work list management DB 402 manages, for each ID, a user ID for identifying each user, work content, a part number corresponding to the item 5, and a delivery date.
[0147] 23 is a diagram showing an example of the configuration of the identification code management DB 405 provided on the side of the article search system 100 according to the first embodiment etc. The identification code management DB 405 manages, for each ID, the identification code information of the identification code 9, location information, user ID, and update date and time.
[0148] 24 is a diagram showing an example of a terminal screen displayed on the user's information terminal 6. In the example shown, the terminal screen displays a part image, the number of parts, and a remarks column for each part number, and when the part number, part image, number of parts, and remarks column are entered and an update button is pressed, the input contents are registered.
[0149] 25 is a diagram showing an example of a terminal screen displayed on a user's information terminal 6. In the example shown, as a terminal screen for searching for parts for the next job, the job content, part number, part image, and delivery date are displayed for each ID, along with an input field 901 for the next job ID, a search button 902, and a cancel button 903. The part number is associated with the part number in FIG.
[0150] The next job ID input field 901 is a field for inputting a next job ID corresponding to the job content to be done next. The search button 902 is a button for searching the job list management DB 402 based on the part number of the item 5 as a part to be used in the next job corresponding to the next job ID input in the next job ID input field 901. The cancel button 903 is a button for canceling and erasing the terminal screen for searching for the part for the next job.
[0151] In this embodiment, the assumed situation for the item search process is, for example, that there is a production management system 400 for appropriately setting work content for workers, and that the item search system 100 according to the first embodiment etc. works in conjunction with that production management system 400.
[0152] <Issuing a new identification code for inventory management> <Issuing an identification code for inventory management> In step C1, the user inputs part information (for example, part number, part quantity) using the user's information terminal 6. In step C2, the user uses the user's information terminal 6 to issue an identification code.
[0153] In procedure C3, the user's information terminal 6 transmits part information (e.g., part number, number of parts) to the production management system 400. In procedure C4, the production management system 400 receives the part information (e.g., part number, number of parts) from the user's information terminal.
[0154] In procedure C5, the production management system 400 registers the part information (e.g., part number, part quantity) and the newly created identification code information in the identification code management database 405. In procedure C6, the production management system 400 transmits the newly created identification code information to the article search system 100 according to the first embodiment etc.
[0155] In procedure C7, the article search system 100 according to the first embodiment etc. receives the identification code information from the production management system 400. In procedure C8, the article search system 100 according to the first embodiment etc. generates an identification code image from the identification code information.
[0156] In step C9, the article search system 100 according to the first embodiment etc. prints the generated identification code image to obtain the identification code 9. In step C10, the article search system 100 according to the first embodiment etc. transmits a completion notification of the issuance of the identification code to the production management system 400.
[0157] In step C11, the production management system 400 receives a notification of completion of the issuance of the identification code from the article search system 100 according to the first embodiment, etc. In step C12, the user receives the identification code 9 issued by the article search system 100 according to the first embodiment, etc.
[0158] <Update identification code information for inventory management> <The user selects the identification code update function and reads the corresponding identification code> Step D1: The user selects the identification code update function using the user's information terminal 6. Step D2: The user's information terminal 6 changes its own state to a state in which the identification code 9 can be read.
[0159] In step D3, the user reads the identification code 9 that the user wishes to change using the information terminal 6. In step D4, the user's information terminal 6 transmits identification code information based on the read identification code 9 to the production management system 400. The identification code information includes, for example, a part number and part quantity information.
[0160] <Aggregate information from the production management system and display part information corresponding to the identification code> In step D5, the production management system 400 receives the identification code information from the user's information terminal 6. In step D6, the production management system 400 acquires the corresponding part number and part quantity information from the identification code information.
[0161] In procedure D7, production management system 400 transmits the part number, part quantity information, and part image information held by the production management system to the user's information terminal 6. In procedure D8, the user's information terminal 6 receives the part number, part quantity information, and part image information held by the production management system 400 transmitted from the production management system 400. In procedure D9, the user's information terminal 6 displays the part information (e.g., the part number, part image, and part quantity) on the screen.
[0162] <Update identification code information> In step D10, the user selects the part information (for example, part number, part image, number of parts) that he / she wishes to change based on the information displayed on the information terminal 6, and inputs the changed information.
[0163] In procedure D11, the user's information terminal 6 transmits the changed part information (e.g., part number, part image, number of parts) input by the user to the production management system 400. In procedure D12, the production management system 400 receives the changed part information (e.g., part number, part image, number of parts) transmitted by the user's information terminal 6.
[0164] In step D13, the production management system 400 updates the database based on the changed part information (for example, product number, product image, product quantity).
[0165] <Moving lamps indicate parts that should be prioritized according to delivery date> <Get the work information for which the user is responsible> In step E1, the production management system 400 creates a work list for which the user is responsible (e.g., work content, part numbers, part images, delivery dates) and transmits it to the user's information terminal 6. In step E2, the user's information terminal 6 receives the work list. In step E3, the user's information terminal 6 displays the work list.
[0166] <User enters current task completion status> In step E4, the user inputs the completion of the current task using the information terminal 6. In step E5, the user's information terminal 6 transmits, to the production management system, a command to delete the task for which the completion of the task has been input.
[0167] In step E6, the production management system 400 receives a deletion command for the work for which completion has been input, sent by the user's information terminal 6. In step E7, the production management system 400 updates the work list for which the user is responsible, based on the deletion command for the work for which completion has been input.
[0168] In step E8, the production management system 400 transmits a list of tasks for which the user is responsible to the user's information terminal 6. In step E9, the user's information terminal 6 receives the list of tasks for which the user is responsible, transmitted from the production management system 400.
[0169] In step E10, the user's information terminal 6 displays the updated work list for which the user is responsible.
[0170] <User requests location of next part> In step E11, the user executes a search function for parts required for the next task using the information terminal 6. In step E12, the user's information terminal 6 transmits part information (e.g., part number, part image) corresponding to the selected task to the item search system 100 according to the first embodiment etc.
[0171] In step E13, the article search system 100 according to the first embodiment etc. receives the part information (for example, part number, part image) corresponding to the selected work transmitted by the information terminal 6 of the user.
[0172] <Get applicable part information> In step E14, the article searching system 100 according to the first embodiment etc. extracts the relevant part information from its own article management database (not shown). If the same part exists, the part with the oldest registration date is given priority. In step E15, the article searching system 100 according to the first embodiment etc. acquires the location information of the relevant part (also referred to as "article").
[0173] <Irradiate the relevant part with light> In step E16, the article search system 100 according to the first embodiment calculates the light irradiation angle based on the part position information. In step E17, the article search system 100 according to the first embodiment issues an adjustment request for the irradiation angle of the lamp unit 7a and an irradiation command to the movable lamp 7.
[0174] In step E18, the movable lamp 7 in the item search system 100 according to the first embodiment etc. irradiates the corresponding location with light using the lamp unit 7a based on the adjustment request and the irradiation command. In step E19, the user goes to the location where the light is irradiated and obtains the corresponding part (item 5).
[0175] The computer system according to this embodiment includes an item search system according to at least one of the first embodiment, the second embodiment, and their modified examples, or a combination of any of them, and a production management system 400 that includes a second external connection interface for connecting to the item search system and manages production using items 5 in a storage area 99. In this way, the production management system 400 can manage production using items 5 in a storage area 99 by using an identification code 9 issued to a user via the item search system.
[0176] In this embodiment, the production management system 400 causes the item search system 100 according to, for example, the first embodiment to issue an identification code 9 corresponding to the item 5 constituting the product corresponding to the input product information (parts information) based on the input product information. In this way, production management of the item 5 can be performed using the identification code 9 issued based on the product information.
[0177] In this embodiment, the production management system 400 changes and updates the part information of the item 5 corresponding to the identification code information of the registered identification code 9. In this way, the production management of the item 5 can be performed using the changed and updated part information of the item 5.
[0178] In this embodiment, the production management system 400 transmits the above-mentioned identification code information to the article search system 100 according to the first embodiment or the like, and causes the system to issue an identification code 9 for the article 5 .
[0179] In this embodiment, the production management system 400 creates a list of tasks to be performed by the workers based on the worker information, the parts information, and the delivery date information. In this way, the production management of the item 5 can be performed using the created task list.
[0180] In this embodiment, the production management system 400 changes the progress status information of the list of tasks to be performed by the workers in accordance with the current progress, based on the worker information, parts information, and delivery date information.
[0181] (6) Fifth embodiment The item search system in the fifth embodiment has a configuration and operation that is almost the same as the item search system 100 in the first embodiment described above, so we will not explain the similar configuration and operation and will focus on the differences below.
[0182] The computer system according to the fifth embodiment includes a delivery system as described below in addition to the item search system 100 according to the first embodiment, etc. The delivery system includes a second interface (not shown) that can be connected to an external system, and is connected to the item search system 100 according to the first embodiment, etc. via a network (not shown) for communicating data, etc.
[0183] 26 is a system configuration diagram showing a configuration example of a computer system including a delivery system 500 in the fifth embodiment. The computer system according to this embodiment includes the item search system 100 and the delivery system 500 according to the first embodiment and the like.
[0184] The delivery system 500 transmits part information on the item 5 to be searched (hereinafter also referred to as "searched part information") to the item search system 100 according to the first embodiment etc. Meanwhile, in this embodiment, the item search system 100 according to the first embodiment etc. has a function of transmitting location information of the item 5 to be searched (hereinafter also referred to as "searched part location information") to the user's information terminal 6 based on the searched part information.
[0185] The delivery system 500 includes a loading list management DB 502, a parts information management DB 503, a user information management DB 504, an identification code management unit 505, and a delivery vehicle management unit 506. The parts information management DB 503 is almost the same as the parts information management DB 403 in the fourth embodiment, and therefore a description thereof will be omitted. The user information management DB 504 is almost the same as the user information management DB 304 in the third embodiment and the user information management DB 404 in the fourth embodiment, and therefore a description thereof will be omitted.
[0186] The loading list management DB 502 manages the loading list. The identification code management unit 505 manages identification code information corresponding to the identification code 9. The delivery vehicle management unit 506 manages delivery vehicles that are to carry and deliver the item 5 to be searched for.
[0187] 27 is a diagram showing an example of the configuration of the loading list management DB 502. The loading list management DB 502 manages, for each ID, the user ID of the user, the delivery vehicle name indicating the name of the vehicle to be dispatched, the loading location, the loading number indicating the lot of the item 5 to be loaded, the part number of the item 5, and the delivery date.
[0188] 28 is a diagram showing an example of a terminal screen displayed on a user's information terminal 6. In the example shown, the terminal screen displays the deliverer name, loading location, part number, part image, and delivery date for each ID, as well as a next job ID input field 911, a search button 912, and a cancel button 913. The loading location indicates, for example, where on the bed of the truck the part is to be placed in three dimensions. The loading location may also be displayed using multiple images.
[0189] The next job ID input field 911 is a field for inputting a next job ID corresponding to the job content to be done next. The search button 912 is a button for searching the loading list management DB 502 based on the part number of the item 5 as a part to be used in the next job corresponding to the next job ID input in the next job ID input field 911. The cancel button 913 is a button for canceling and erasing the terminal screen for searching for the part for the next job.
[0190] As an assumed situation in this embodiment, for example, it is assumed that there is a delivery system 500 capable of calculating an appropriate loading order of items 5 for a user, and the item search system 100 according to the first embodiment or the like cooperates with the delivery system 500. Also, in this assumed situation, it is assumed that the items 5 are delivered to multiple locations from one base including, for example, a storage area 99. Note that, here, for example, cases in which items are transported to long distances by large truck are excluded.
[0191] <When loading luggage, instruct the loading parts based on the order in which they will be easy to pick up at the time of delivery> <Get the work information for which the user is responsible> In step F1, the delivery system 500 creates a loading list for which the user is responsible (eg, delivery vehicle information, loading location information, part numbers, part images, delivery dates) and transmits it to the information terminal 6 of the user.
[0192] In step F2, the user's information terminal 6 receives the loading list. In step F3, the user's information terminal 6 displays the loading list.
[0193] <User enters current task completion status> In step F4, the user inputs the completion of the current work using the information terminal 6. In step F5, the user's information terminal 6 transmits to the delivery system 500 a deletion command for the work for which the completion of the work has been input.
[0194] In step F6, the delivery system 500 receives a deletion command for the work for which completion of the work has been input and transmitted by the user's information terminal 6. In step F7, the delivery system 500 updates the loading list for which the user is responsible based on the deletion command.
[0195] In step F8, the delivery system 500 transmits a loading list of items 5 for which a user, such as a truck driver, is responsible to the information terminal 6 of the user. In step F9, the information terminal 6 of the user receives the loading list for the user transmitted from the delivery system 500. In step F10, the information terminal 6 of the user displays the loading list.
[0196] <User requests location of next part> In step F11, the user uses the information terminal 6 to execute a search function for an item 5 corresponding to a part required for the next job. In step F12, the user's information terminal 6 transmits part information (e.g., part number, part image) corresponding to the selected job to the item search system 100 according to the first embodiment etc. In step F13, the item search system 100 according to the first embodiment etc. receives the part information transmitted by the user's information terminal 6.
[0197] <Get applicable part information> In step F14, the article search system 100 according to the first embodiment etc. extracts the corresponding part information from its own article management database (not shown), and if the same part exists, the part with the oldest registration date is given priority. In step F15, the article search system 100 according to the first embodiment etc. acquires the location information of the corresponding part.
[0198] <Irradiate the relevant parts with a movable lamp> In step F16, the article search system 100 according to the first embodiment etc. calculates the irradiation angle of the lamp unit 7a of the movable lamp 7 within the storage area 99 based on the position information of the part. In step F17, the article search system 100 according to the first embodiment etc. requests the movable lamp 7 to adjust the irradiation angle and commands it to emit light.
[0199] In step F18, the lamp unit 7a of the movable lamp 7 in the article search system 100 according to the first embodiment etc. illuminates the lamp unit 7a of the movable lamp 7 at the relevant location based on the above-mentioned adjustment request and illumination command. In step F19, the user goes to the illuminated location in the storage area 99 and obtains the relevant part.
[0200] The computer system according to this embodiment includes an item search system according to at least one of the first embodiment, the second embodiment, and their modified examples, or a combination of any of them, and a delivery system 500 that includes a second external connection interface for connecting to the item search system and manages a delivery vehicle to load an item 5 in a storage area 99. In this manner, the delivery system 500 can manage the delivery of the item 5 in the storage area 99 by using the identification code 9 issued to the user via the item search system.
[0201] In this embodiment, the delivery system 500 automatically creates, for example, a list of parts to be loaded, which allows a worker to appropriately load the items 5 that constitute the parts, based on the worker information, parts information, delivery date information, and delivery vehicle information. In this way, the items 5 can be appropriately loaded by referring to the list of parts to be loaded.
[0202] In this embodiment, the delivery system 500 changes the progress status of the list of parts to be loaded by the worker based on the worker information, parts information, delivery date information, and delivery vehicle information according to the current progress. In this way, the goods 5 can be appropriately loaded according to the list of parts to be loaded while grasping the progress status according to the current progress.
[0203] (7) Sixth embodiment The item search system in the sixth embodiment has a configuration and operation that is almost the same as the item search system 100 in the first embodiment described above, so we will not explain the similar configuration and operation and will focus on the differences below.
[0204] The article search system according to the sixth embodiment is characterized by a measure taken when the identification code 9 cannot be read in the article search system 100 according to the first embodiment and the like.
[0205] Fig. 29 is a diagram showing a configuration example of an identification code position storage DB of an article search system in the sixth embodiment. The identification code position storage DB is stored in, for example, the storage unit 38 shown in Fig. 2, and manages position information of an identification code 9 (hereinafter also referred to as "identification code position information").
[0206] The identification code position storage DB manages, for example, for each ID, the identification code information, position information, user ID, and update date of the identification code 9. The position information is information related to the position where the item 5 to which the identification code 9 is attached is located within the storage area 99 at the time when the identification code 9 corresponding to the identification code information was updated.
[0207] <Identification code re-reading function based on illuminance and person confirmation> <Reading the identification code from the camera image> In step G1, the article search system 100 according to the first embodiment etc. acquires identification code position information indicating the position in the storage area 99 of the identification code 9 of the article 5 to be searched for.
[0208] In procedure G2, the article search system 100 according to the first embodiment etc. adjusts the direction and angle of the camera 3 based on the identification code position information, and captures the identification code 9 with the camera 3. In procedure G3, the article search system 100 according to the first embodiment etc. reads the identification code 9 by inputting the captured data 199 to the identification information acquisition unit 32.
[0209] In step G4, if the identification code 9 is read by the identification information acquisition unit 32, the article search system 100 according to the first embodiment etc. updates the identification code position information corresponding to the identification code 9, and returns to and executes step G1.
[0210] <Check the illuminance when reading is not possible> In this embodiment, for example, when the illuminance is high, the aperture of the camera 3 is adjusted and the image is taken again, whereas when the illuminance is low, the image is taken again by irradiating the movable lamp 7. A specific description will be given below.
[0211] In step G5, the article search system 100 according to the first embodiment etc. acquires luminance information of the image if the identification code 9 cannot be read by the identification information acquisition unit 32. In step G6, the article search system 100 according to the first embodiment etc. adjusts the aperture of the camera 3 if the luminance information of the image is greater (brighter) than a specified value, and returns to and executes step G2.
[0212] In step G7, if the brightness information of the image is smaller (darker) than a specified value, the article search system 100 according to the first embodiment etc. calculates the light position, illuminates the image, and returns to step G2 to execute this.
[0213] In step G8, the article search system 100 according to the first embodiment etc. determines whether a person is present in the image if the luminance information of the image is within a specified value.
[0214] <Check the illuminance when reading is not possible. Perform skeleton detection when the illuminance is OK> In step G9, if the brightness information of the image is within a specified value, the article search system 100 according to the first embodiment etc. determines whether a person is present in the image using its own person determination function.
[0215] In step G10, when the item search system 100 according to the first embodiment etc. determines that no person is present in the image, it determines that the searched identification code 9 has moved, updates the identification code position information, and returns to and executes step G1.
[0216] <If it is determined that a person is present, it will take another photo after a certain period of time> In step G11, when the item search system 100 according to the first embodiment etc. determines that a person is present in the image, for example by skeleton detection, it checks whether or not it determined that a person was present in the previous image capture. In step G12, if the item search system 100 according to the first embodiment etc. determines that a person was not present in the previous image capture, it returns to step G2 so that the same location can be captured after a certain time.
[0217] In step G13, if the article search system 100 according to the first embodiment etc. determines that a person was present during the previous image capture, it transmits to the user's information terminal 6 a warning about the presence of a person and the position information of the observed location.
[0218] In step G14, the user's information terminal 6 receives the person presence warning and the position information of the observed location. In step G15, the user's information terminal 6 displays the person presence warning and the position information of the observed location.
[0219] In the computer system according to this embodiment, when the identification information acquisition unit 32 is unable to read the identification code 9, which is an example of a feature of the article 5, due to an external factor such as the shooting environment, the identification information acquisition unit 32 retries reading the identification code 9. In this way, the identification code 9 can be read more reliably.
[0220] In the computer system according to this embodiment, when the identification information acquisition unit 32 is unable to read the identification code 9, which is an example of a feature of an article, due to luminance, it adjusts the setting values of the camera 3, which is an example of an imaging unit, or the movable lamp 7, which is an example of an illumination unit, and retries reading the identification code 9. In this way, the identification code 9 can be read more reliably.
[0221] In the computer system according to this embodiment, when the identification information acquisition unit 32 is unable to read the identification code 9, which is an example of an article's characteristic, due to the presence of an obstacle such as a person, based on the result of photographing by the camera 3, which is an example of an imaging unit, the identification information acquisition unit 32 retries reading after a certain period of time. In this way, the identification code 9 can be read more reliably.
[0222] In the computer system according to this embodiment, the identification information acquisition unit 32 issues a notification and a warning to the outside when an identification code, which is an example of an article's characteristic, is read multiple times due to the presence of an obstacle such as a person, based on the result of shooting by the camera 3, which is an example of an imaging unit. In this way, it is possible to notify the outside that the identification code 9 cannot be read, and to provide an opportunity for the outside to take appropriate action.
[0223] The present invention is not limited to the above-described embodiment, and includes various modified examples and equivalent configurations within the spirit of the appended claims. For example, the above-described embodiment has been described in detail to clearly explain the present invention, and the present invention is not necessarily limited to those having all of the described configurations. In addition, each element described in parallel in this embodiment may be in a form in which at least one of the elements is connected in series to the other elements. [Industrial Applicability]
[0224] The present invention can be applied to an item search system that can easily search for items that may be stored in random locations within a storage area. [Explanation of symbols]
[0225] 3...camera, 7...movable lamp, 5...item, 6...terminal, 9...identification code, 10...rack, 31...control unit, 32...identification information acquisition unit, 33...identification unit, 37...notification unit, 99...storage area, 100...item search system.
Claims
1. an identification information acquisition unit that acquires information about a space in a storage area in which an item can be placed, and thereby acquires characteristics of an item that can be randomly placed in the space; an identification unit that identifies the article based on the characteristics of the article acquired by the identification information acquisition unit; a position recognition unit that assigns planar coordinates to the spatial information of the storage area acquired by the identification information acquisition unit, and repeatedly associates the item identified by the identification unit with the planar coordinates at any timing; an input unit for receiving a desired characteristic of the item for locating the item within the storage area; a search unit that searches for a location of the desired item in the storage area from an association result by the location recognition unit based on the characteristics of the desired item received by the input unit; a notification unit that notifies the user of the location of the desired item searched for by the search unit; An item search system comprising:
2. The identification information acquisition unit is connected to a movable part that can move along a guide part installed on an inner circumferential surface of the storage area.
2. The article search system according to claim 1.
3. The inner periphery of the storage area is a ceiling, The storage area has a maintenance area in which a portion of the guide portion descends from the ceiling toward a floor of the storage area.
3. The article search system according to claim 2.
4. the guide unit is provided with a lift that moves the identification information acquisition unit up and down in a direction perpendicular to a floor surface of the maintenance area.
3. The article search system according to claim 2.
5. The identification information acquisition unit is an airborne flying object equipped with an imaging unit, 2. The article search system according to claim 1.
6. The recognition unit is Identifying the article from a characteristic of the article regardless of the orientation of the article; 2. The article search system according to claim 1.
7. the characteristic of the article is an identification code that allows the article to be distinguished from other articles; When the item is carried into the storage area, the item to which the identification code is attached is placed at a position where it can be easily acquired by the identification information acquisition unit.
7. The article search system according to claim 6.
8. a placement history table for managing the placement history of the items that have been brought into the storage area; The search unit is if the identification information acquisition unit cannot acquire the item within the storage area, the location information history of the item is checked from the placement history table.
2. The article search system according to claim 1.
9. The notification unit is providing an optical indication of the location of the item within the storage area; 2. The article search system according to claim 1.
10. The notification unit is displaying, on a display unit provided in the storage area, the location of the desired item in the storage area searched for by the search unit; 2. The article search system according to claim 1.
11. The notification unit is displaying a result of the search performed by the search unit regarding the location of the item in the storage area on a portable display unit using augmented reality; The object search system according to claim 10.
12. The notification unit is projecting an image of the spatial information of the storage area acquired by the identification information acquisition unit onto a display unit; The object search system according to claim 10.
13. The notification unit is A guidance unit that guides the location of the item in the storage area by at least one of sound and voice, 2. The article search system according to claim 1.
14. The identification information acquisition unit stitches together images of the storage area captured by a plurality of imaging units to form a single image of the storage area.
2. The article search system according to claim 1.
15. The input unit includes: a voice recognition unit that receives voice as a feature of the item input when searching for the location of the item in the storage area, and recognizes the received voice as the feature of the item using a voice recognition function; 2. The article search system according to claim 1.
16. The storage area has an entrance through which the item is carried in, The identification information acquisition unit acquires characteristics of the item at the entrance, The identification unit recognizes that the item corresponding to the acquired characteristics of the item has been brought into the storage area.
2. The article search system according to claim 1.
17. The storage area has an exit port through which the items are carried out, The identification information acquisition unit acquires characteristics of the item at the exit, The identification unit recognizes that the item corresponding to the acquired feature of the item has been removed from the storage area.
2. The article search system according to claim 1.
18. The identification information acquisition unit When an external factor causes the item's characteristic code to be unreadable, the item's characteristic code is read again.
2. The article search system according to claim 1.
19. The identification information acquisition unit When the identification code, which is a feature of the article, cannot be read due to brightness, the setting value of the imaging unit or the irradiation unit is adjusted and reading of the identification code is retried.
2. The article search system according to claim 1.
20. The identification information acquisition unit If the identification code as a feature of the article cannot be read due to the presence of a person based on the result of the image capture by the imaging unit, the reading is retried after a certain period of time.
2. The article search system according to claim 1.
21. The identification information acquisition unit If the presence of a person is detected based on the results of the image capture by the imaging unit, and the identification code as a feature of the article is read multiple times, a notification and a warning are issued to the outside.
2. The article search system according to claim 1.
22. an identification information acquisition unit that acquires information about a space in a storage area in which an item can be placed, and thereby acquires characteristics of an item that can be randomly placed in the space; an identification unit that identifies the article based on the characteristics of the article acquired by the identification information acquisition unit; a position recognition unit that assigns planar coordinates to the spatial information of the storage area acquired by the identification information acquisition unit, and repeatedly associates the item identified by the identification unit with the planar coordinates at any timing; an input unit for receiving a desired characteristic of the item for locating the item within the storage area; a search unit that searches for a location of the desired item in the storage area from an association result by the location recognition unit based on the characteristics of the desired item received by the input unit; a notification unit that notifies the user of the location of the desired item searched for by the search unit; a first external connection interface for connecting to the item tracking system; An item search system comprising: a security system that includes a second external connection interface for connecting to the item search system and that manages security of the storage area; A computer system comprising:
23. The security system includes: Data is exchanged between the article search system and the second external connection interface.
23. The computer system of claim 22.
24. The security system includes: Set items to be protected and storage areas, and register and update information on visitors' valuables and other belongings as needed.
23. The computer system of claim 22.
25. The security system includes: Identifying an item from image information acquired internally or externally, and creating an authentication user list that extracts previously authorized people as the owner information of the item 23. The computer system of claim 22.
26. The security system includes: Identifying a person from image information acquired internally or externally and determining whether the person matches a previously approved person 23. The computer system of claim 22.
27. The security system includes: According to whether the location information of the information terminal carried by the pre-authorized person is near a target protected area, it is determined whether the person carrying the information terminal is the pre-authorized person.
23. The computer system of claim 22.
28. The security system includes: A warning is issued to a person who is determined not to be a pre-authorized person by using light information, sound information, or both.
28. The computer system of claim 27.
29. The security system includes: When a warning is issued, the information about the warning is transmitted to the information terminal of the person who has been pre-authorized.
29. The computer system of claim 28.
30. an identification information acquisition unit that acquires information about a space in a storage area in which an item can be placed, and thereby acquires characteristics of an item that can be randomly placed in the space; an identification unit that identifies the article based on the characteristics of the article acquired by the identification information acquisition unit; a position recognition unit that assigns planar coordinates to the spatial information of the storage area acquired by the identification information acquisition unit, and repeatedly associates the item identified by the identification unit with the planar coordinates at any timing; an input unit for receiving a desired characteristic of the item for locating the item within the storage area; a search unit that searches for a location of the desired item in the storage area from an association result by the location recognition unit based on the characteristics of the desired item received by the input unit; a notification unit that notifies the user of the location of the desired item searched for by the search unit; a first external connection interface for connecting to the item tracking system; An item search system comprising: a production management system that includes a second external connection interface for connecting to the item search system and that manages security of the storage area; A computer system comprising:
31. The production management system includes: Based on the input product information, an identification code corresponding to an item constituting a product corresponding to the product information is issued.
31. The computer system of claim 30.
32. The production management system includes: Change and update the part information of the item that corresponds to the identification code information of the registered identification code.
31. The computer system of claim 30.
33. The production management system includes: Transmitting the identification code information to the article search system to issue an identification code.
33. The computer system of claim 32.
34. The production management system includes: Create a list of tasks that workers should perform based on worker information, part information, and delivery date information 31. The computer system of claim 30.
35. The production management system includes: Based on worker information, parts information, and delivery date information, the progress status information of the list of tasks that workers should perform is changed according to the current progress.
35. The computer system of claim 34.
36. an identification information acquisition unit that acquires information about a space in a storage area in which an item can be placed, and thereby acquires characteristics of an item that can be randomly placed in the space; an identification unit that identifies the article based on the characteristics of the article acquired by the identification information acquisition unit; a position recognition unit that assigns planar coordinates to the spatial information of the storage area acquired by the identification information acquisition unit, and repeatedly associates the item identified by the identification unit with the planar coordinates at any timing; an input unit for receiving a desired characteristic of the item for locating the item within the storage area; a search unit that searches for a location of the desired item in the storage area from an association result by the location recognition unit based on the characteristics of the desired item received by the input unit; a notification unit that notifies the user of the location of the desired item searched for by the search unit; a first external connection interface for connecting to the item tracking system; An item search system comprising: A delivery system that includes a second external connection interface for connecting to the item search system and manages a delivery vehicle that is to load an item in the storage area; A computer system comprising:
37. The delivery system comprises: Create a list of parts to be loaded based on worker information, part information, delivery date information, and delivery vehicle information so that workers can load parts appropriately.
37. The computer system of claim 36.
38. The delivery system comprises: Change the progress status of the list of parts that workers should load based on worker information, part information, delivery date information, and delivery vehicle information according to the current progress.
37. The computer system of claim 36.
Citation Information
Patent Citations
Article carrying out method in automatic warehouse
JP1995257707A