Information processing apparatus, information processing method, and program

Abstract

To obtain a code identifier more accurately from one or more captured images of multiple codes, even if two or more same codes are used.SOLUTION: An information processing apparatus 1 includes: an image acquisition unit 11 which acquires one or more captured images obtained by imaging multiple codes including same codes; a position acquisition unit 12 which acquires code position information including a code identifier identifying a code and a position of the code, for each of the multiple codes included in the one or more captured images; a quantity acquisition unit 16 which acquires the number of each code identifier related to the multiple codes included in the one or more captured images, using the multiple pieces of code position information; and a quantity output unit 17 which outputs the number of each code identifier acquired by the quantity acquisition unit 16.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an information processing device and the like that acquires a code identifier for identifying a code by using a photographed image of the code. [Background technology]

[0002] Conventionally, a captured image of a code given to an object has been used to search for the object (see, for example, Patent Document 1). When performing processing using a captured image of such a code, a code identifier for identifying the code is usually obtained using the captured image of the code. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2022-159856 A Summary of the Invention [Problem to be solved by the invention]

[0004] It is preferable that the code assigned to the object is unique, that is, the same code is not assigned to two or more objects. In this way, if there are no duplicate codes included in the captured image, when performing a process using the code, such as an inventory of the object to which the code is assigned, it is only necessary to obtain the code identifier corresponding to the code included in the captured image. Even if there are duplicate code identifiers that are read, this is because only one code is read twice, so that a unique process can be performed to prevent duplicate code identifiers.

[0005] However, it is possible that two or more identical codes are included in a photographed image. For example, it is possible that the same code is attached to boxes of products such as shoes of the same type, color, and size. In this case, when a code attached to a box of a product, which is an object, is photographed for inventory or the like, and a code identifier corresponding to the code is obtained from the photographed image, there will be duplication in the code identifier. In this way, when there is duplication in the code identifiers acquired from the photographed image, there is a possibility that, for example, two or more code identifiers will be acquired from one code, or only one code identifier will be acquired from two identical codes, when acquiring the code identifiers of the codes included in the photographed image. When such code identifiers are acquired, there is a problem that the acquired code identifiers will be inaccurate, and the results of a process performed using the codes, such as inventory, will be erroneous. This is particularly noticeable when processing is performed using two or more photographed images.

[0006] The present invention has been made to solve the above-mentioned problems, and aims to provide an information processing device etc. that can more accurately acquire a code identifier from one or more captured images of a code, even when two or more of the same codes are used. [Means for solving the problem]

[0007] In order to achieve the above object, an information processing device according to one embodiment of the present invention includes an image acquisition unit that acquires one or more captured images of multiple codes including the same code, and a position acquisition unit that acquires code position information including a code identifier that identifies the code and the position of the code for each of the multiple codes included in the one or more captured images.

[0008] With this configuration, by obtaining the code identifier and the code position for each code, it is possible to prevent, for example, obtaining two or more code identifiers from one code, or obtaining only one code identifier from two identical codes, thereby enabling more accurate acquisition of code identifiers.

[0009] In addition, in an information processing device according to one aspect of the present invention, at least one of the one or more captured images includes a reference code indicating a reference for the position of the code, and the position acquisition unit may acquire the position of each code based on the position of the reference code. With this arrangement, the position of the code can be obtained using the reference code.

[0010] In the information processing device according to an aspect of the present invention, each of the one or more captured images may include a reference code. With this configuration, it becomes possible to obtain the position of the code in each captured image using the reference code.

[0011] In addition, in an information processing device according to one aspect of the present invention, the image acquisition unit acquires two or more captured images, and may further include a judgment unit that determines whether the two or more captured images contain a predetermined number of reference codes, and an alert output unit that outputs an alert when the judgment unit does not determine that the two or more captured images contain the predetermined number of reference codes. With this configuration, the outputted alert can notify the user that the image was not captured properly, and can, for example, urge the user to capture the image again.

[0012] In addition, in the information processing device according to an aspect of the present invention, the position acquisition section may acquire the position of each code based on the position of a specific code included in at least one of the one or more captured images. With this configuration, even if the reference code is not arranged, the position of each code can be obtained by using the position of a specific code as a reference.

[0013] In addition, an information processing device according to one aspect of the present invention may further include a number acquisition unit that acquires the number of each code identifier for a plurality of codes included in one or more captured images using a plurality of code position information, and a number output unit that outputs the number of each code identifier acquired by the number acquisition unit. With this configuration, it becomes possible to know the number of each code, which makes it possible to carry out, for example, an inventory of objects to which codes are assigned.

[0014] Furthermore, an information processing method according to one aspect of the present invention is an information processing method processed using an image acquisition unit and a position acquisition unit, and includes the steps of: the image acquisition unit acquiring one or more captured images capturing multiple codes including the same code; and the position acquisition unit acquiring code position information including a code identifier that identifies the code and the position of the code for each of the multiple codes included in the one or more captured images. Effect of the Invention

[0015] According to the information processing device and the like according to one aspect of the present invention, even when two or more of the same codes are used, it is possible to more accurately acquire a code identifier from one or more captured images of the code. [Brief description of the drawings]

[0016] [Figure 1] FIG. 1 is a block diagram showing a configuration of an information processing device according to an embodiment of the present invention; [Diagram 2] A flowchart showing the operation of the information processing device according to the embodiment. [Diagram 3] FIG. 13 is a diagram showing an example of the position of each reference code in the embodiment; [Figure 4] FIG. 13 is a diagram showing an example of an object to which a code is assigned in the embodiment. [Diagram 5] FIG. 13 is a diagram showing an example of code position information according to the embodiment; [Figure 6] FIG. 13 is a diagram showing an example of the number of pieces per code according to the embodiment; [Figure 7]FIG. 2 shows an example of the configuration of a computer system according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0017] Hereinafter, an information processing device and an information processing method according to the present invention will be described using embodiments. In the following embodiments, components and steps with the same reference numerals are the same or equivalent, and repeated description may be omitted. The information processing device according to the present embodiment acquires the code identifier of a code included in a captured image and the position of the code, thereby enabling more accurate acquisition of the code identifier even when two or more of the same code are used.

[0018] 1 is a block diagram showing the configuration of an information processing device 1 according to this embodiment. The information processing device 1 according to this embodiment includes an image acquisition unit 11, a position acquisition unit 12, a storage unit 13, a determination unit 14, an alert output unit 15, a number acquisition unit 16, and a number output unit 17. The information processing device 1 may be, for example, a portable information processing terminal having a photographing function, such as a smartphone, a tablet terminal, a PDA (Personal Digital Assistant), or the like, or may be an information processing device or a server that receives and processes photographed images from a device having a photographing function.

[0019] The image acquisition unit 11 acquires one or more captured images of a plurality of codes including the same code. The image acquisition unit 11 may acquire, for example, one captured image, or may acquire two or more captured images. In this embodiment, a case where two or more captured images are acquired by the image acquisition unit 11 will be mainly described. The image acquisition unit 11 may be, for example, an optical device such as a camera that captures an image, or may acquire an image captured by an optical device such as a camera. In this embodiment, a case where the image acquisition unit 11 is a camera will be mainly described. The captured image may be, for example, a color image, or a black and white or grayscale image. When the code has a color other than black and white, it is preferable that the captured image is a color image. The image acquisition unit 11 may acquire two or more captured images by repeating the acquisition of the captured image. The image acquisition unit 11 may, for example, repeatedly acquire the captured image periodically or irregularly. As an example, the image acquisition unit 11 may acquire the captured image in response to an instruction from a user. In addition, the image acquisition unit 11 may acquire, for example, a video. In this case, one frame constituting the video may be considered to be a captured image.

[0020] When the image acquisition unit 11 acquires a plurality of captured images, the plurality of captured images may be, for example, the result of capturing a plurality of codes separately into a plurality of captured images. In this case, for example, the plurality of captured images may or may not include overlapping portions. In the former case, for example, a certain code may be included in two or more captured images. Also, when capturing a plurality of codes separately into a plurality of captured images, it is preferable that the capture is performed so that each of the plurality of codes to be captured is included in at least one of the captured images.

[0021] The code may be, for example, a color code such as Chameleon Code (registered trademark), a QR Code (registered trademark), a two-dimensional code such as an AR marker, a barcode, or other codes. The code may be, for example, a code composed of a predetermined number of two-dimensional codes. As an example, the code may be composed of a plurality of AR markers. The number of two-dimensional codes constituting the code may be, for example, two, three, or four or more. The AR marker may be, for example, an ArUco marker. In addition, in order to collectively acquire code identifiers corresponding to a plurality of codes included in a captured image, it is preferable that the code is capable of reading a plurality of codes simultaneously. In this embodiment, a case where the code is composed of two square AR markers will be mainly described. Note that the two AR markers may be arranged so that one side of each AR marker faces each other, for example, as in the code 5 shown in FIG. 4.

[0022] The code of the photographed object may be, for example, given to the object. The object may be, for example, a commodity, a storage object stored in a warehouse or the like, or other object. The object may be, for example, a box-shaped object such as a cardboard box or a container, a bag, a bottle, a can, or other object. In this embodiment, the case where the object is a box-shaped commodity will be mainly described. As an example, a photographed image of a code given to each of a plurality of commodity boxes stacked in a warehouse or the like may be acquired by the image acquisition unit 11.

[0023] The method by which the code is applied to the object is not important. For example, the code may be affixed to the object, the code may be printed on the surface of the object, a tag (label) showing the code may be attached to the object, or the code may be applied to the object by other methods. It is preferable that the code is applied to the object in such a way that the code is easily read. For example, it is preferable that when the part of the object to which the code is applied is photographed, the code can be read in the photographed image.

[0024] Also, at least one of the one or more captured images may include a reference code. The reference code indicates a reference for the position of the code. For example, the position of the reference code may be the reference position for the positions of the other codes. As an example, when the position of each code is acquired, a position that is a coordinate value in a predetermined coordinate system in which the position of a certain reference code is a predetermined position such as the origin may be acquired. Also, when two or more reference codes are used, for example, each reference code may be associated with the position of the reference code, for example, the coordinate value in the predetermined coordinate system. Then, the position of a code that is in a predetermined positional relationship with the reference code may be acquired using the position of the reference code. For example, the xy orthogonal coordinate system that is the predetermined coordinate system may be set so that the x-axis direction is the horizontal direction and the y-axis direction is the vertical direction. Also, the unit length in the xy orthogonal coordinate system may be determined, for example, according to the length of the reference code or the length of the other codes. For example, the longitudinal length of the reference code may be the unit length. In this way, even if only one reference code is included in the captured image, the position of the other codes based on the reference code can be specified using the unit length. Furthermore, when two or more reference codes are included in one or more captured images acquired by the image acquisition unit 11, the unit length may be specified using the two or more reference codes. This unit length may be obtained, for example, by dividing the distance between two reference codes on the captured image by the distance between two positions in a predetermined coordinate system corresponding to the two reference codes. Furthermore, the captured image may be captured such that the left-right direction of the captured image is the horizontal direction, i.e., the x-axis direction in the xy orthogonal coordinate system, and the up-down direction is the vertical direction, i.e., the y-axis direction in the xy orthogonal coordinate system. In this way, the position of a code in one captured image based on the position of the reference code is specified using the unit length, and the position (coordinate value) of the reference code in the xy orthogonal coordinate system can be specified. The reference code may be the same as other codes, except that it is used as a reference for the position of the code.It is preferable that the position of the reference code does not change in real space, and therefore the reference code is preferably placed on a structure such as a shelf, a wall, a pillar, or a floor.

[0025] Each of the one or more captured images may include a reference code. In this case, the position of each code included in one captured image may be specified using the reference code included in the captured image. In this embodiment, this case will be mainly described. Note that a plurality of reference codes may be arranged so that all reference codes are photographed to obtain images of all codes to be photographed. For example, when a specific rectangular area is to be photographed, a reference code may be arranged at each of the four vertices of the rectangular area. In this way, for example, it is possible to detect that the photographing is not performed properly because some reference codes are not included in the captured image.

[0026] The position acquisition unit 12 acquires code position information including a code identifier for identifying the code and the position of the code for each of a plurality of codes included in one or more captured images. The position acquisition unit 12 may acquire the code identifier, for example, by detecting a code in the captured image and reading the code in the area of ​​the detected code. The code identifier may be any identifier that can identify the code. The code identifier may be, for example, the information indicated by the code (i.e., information obtained by reading the code) itself, or may be information managed in association with the information obtained by reading the code. In this embodiment, the former case will be mainly described.

[0027] When acquiring code position information using a plurality of captured images, it is preferable that the position acquisition unit 12 acquires one piece of code position information for one code existing in real space. For this reason, for example, when acquiring a plurality of pieces of code position information including the same code identifier and the same position from a plurality of different captured images, the position acquisition unit 12 may convert them into one piece of code position information by performing unique processing. Note that the same position may be, for example, the exact same position, or a position close enough to be considered to be substantially the same position. The acquired position may be, for example, a position (coordinate value) in a predetermined local coordinate system. The predetermined local coordinate system may be, for example, the above-mentioned xy orthogonal coordinate system. When acquiring code position information from two or more captured images, it is preferable that this local coordinate system is common to the two or more captured images. Also, the position of the code may be, for example, the coordinate value of a representative position of the code in the local coordinate system. The representative position of the code may be, for example, the position of the center of gravity of the code, or a predetermined position such as the upper left vertex of the code.

[0028] When at least one of the captured images includes a reference code, the position acquisition unit 12 may acquire the position of each code based on the position of the reference code. The position acquisition unit 12 may acquire the position of the code by using, for example, the position of the reference code, the positional relationship between the reference code in the captured image, and the code whose position is to be acquired. For example, when each captured image includes a reference code, the position acquisition unit 12 may acquire the position of each code by using the position of the reference code included in the captured image as a reference when acquiring code position information for each code included in the captured image. The position acquisition unit 12 may acquire the position of the code included in the captured image in a predetermined coordinate system by using, for example, the position in the predetermined coordinate system of the reference code included in one captured image as follows. The position acquisition unit 12 may specify, for example, the position of the reference code and the code in an image coordinate system that is a local coordinate system of the captured image by using a predetermined unit length, and acquire the relative positional relationship between the image coordinate system and the predetermined coordinate system by using the position of the reference code in the image coordinate system and the position of the reference code in the predetermined coordinate system. The position acquisition unit 12 may then identify the position (coordinate value) of the code in the predetermined coordinate system by using the position of the code identified in the image coordinate system and the relative positional relationship between the image coordinate system and the predetermined coordinate system. Note that the predetermined unit length may be identified by using the length of a reference code or the like, for example, as described above. In addition, when acquiring the relative positional relationship between the image coordinate system and the predetermined coordinate system, for example, a preset angle between both coordinate systems may be used. As described above, the angle may be set to, for example, 0 degrees.

[0029] In the storage unit 13, for example, one or more captured images acquired by the image acquisition unit 11 and code position information acquired by the position acquisition unit 12 may be stored. Also, for example, a code identifier of a reference code may be stored in the storage unit 13, and a pair of a code identifier of a reference code and a position of the reference code may be stored in the storage unit 13. Also, other information may be stored in the storage unit 13. The captured images and code position information stored in the storage unit 13 may be accumulated by, for example, the image acquisition unit 11 or the position acquisition unit 12. Also, the code identifier of the reference code stored in the storage unit 13 may be accumulated in the storage unit 13 via, for example, a recording medium, a communication line, an input device, or the like. The storage unit 13 is preferably realized by a non-volatile recording medium, but may be realized by a volatile recording medium. The recording medium may be, for example, a semiconductor memory, a magnetic disk, or the like.

[0030] When two or more captured images are acquired by the image acquisition unit 11, the determination unit 14 may determine whether the two or more captured images acquired by the image acquisition unit 11 contain a plurality of predetermined reference codes. For example, the determination unit 14 may acquire code identifiers of the plurality of codes included in the two or more captured images acquired by the image acquisition unit 11, and determine that the two or more captured images acquired contain the predetermined plurality of reference codes when the acquired plurality of code identifiers include all of the plurality of code identifiers corresponding to the plurality of reference codes stored in the storage unit 13, and otherwise determine that the two or more captured images acquired do not include at least a part of the predetermined plurality of reference codes. The process of acquiring the code identifiers from the captured images may be performed, for example, by the position acquisition unit 12 or the determination unit 14. Note that, when the determination unit 14 determines that the two or more captured images acquired do not include at least a part of the plurality of reference codes, the position acquisition unit 12 may not acquire code position information using the two or more captured images. This is because it is believed that two or more captured images are not captured so as to cover the entire code.

[0031] The determination unit 14 may determine whether or not the two or more captured images contain multiple reference codes in a predetermined order. In this case, for example, information indicating the order may also be stored in the storage unit 13. The determination unit 14 may determine that the two or more captured images contain multiple reference codes in a predetermined order when the order in which the multiple reference codes are included in the two or more captured images are photographed is the same as the predetermined order of the multiple reference codes, and may determine that the two or more captured images do not contain multiple reference codes in a predetermined order when this is not the case.

[0032] The alert output unit 15 may output an alert when the determination unit 14 does not determine that two or more captured images contain a plurality of predetermined reference codes, that is, when at least one of the plurality of predetermined reference codes is not included in two or more captured images. Note that, when the determination unit 14 determines that two or more captured images contain a plurality of predetermined reference codes, the alert output unit 15 does not need to output an alert.

[0033] In addition, when the judgment unit 14 makes a judgment taking into account the order of multiple reference codes, the alert output unit 15 may, for example, output an alert when it is not determined that two or more captured images contain multiple reference codes in a predetermined order, and may not need to output an alert when it is determined that two or more captured images contain multiple reference codes in a predetermined order.

[0034] It is preferable that the outputted alert can call attention to the fact that two or more captured images have not been acquired so as to include a plurality of reference codes. For example, in response to the output of this alert, acquisition of two or more captured images may be performed again. The output of this alert may be, for example, a display on a display device (e.g., a liquid crystal display or an organic EL display), a transmission to a predetermined device via a communication line, an audio output by a speaker, or a transfer to another component. The alert output unit 15 may or may not include a device that performs output (e.g., a display device or a communication device). The alert output unit 15 may be realized by hardware, or may be realized by software such as a driver that drives those devices.

[0035] The number acquiring unit 16 may acquire the number of each code identifier for each of the multiple codes included in one or more captured images, using the multiple code position information acquired by the position acquiring unit 12. The number acquiring unit 16 may acquire, as an example, multiple pairs of a code identifier for identifying a code and the number of the code. The number acquiring unit 16 may specify a set of code identifiers without duplication, for example, by performing a unique process on a set of multiple code identifiers included in the multiple code position information. Then, for a certain code identifier included in the set of code identifiers without duplication, the number of code position information including the code identifier may be counted, and a set of the code identifier and the count result may be created. The number acquiring unit 16 may acquire the number of each code by repeating this process for each code included in the set of code identifiers without duplication.

[0036] The number output unit 17 may output the number of each code identifier acquired by the number acquisition unit 16. The number output unit 17 may output, for example, a plurality of pairs of the code identifier and the number acquired by the number acquisition unit 16. Here, this output may be, for example, a display on a display device (for example, a liquid crystal display or an organic EL display), a transmission to a predetermined device via a communication line, a printing by a printer, an audio output by a speaker, storage in a recording medium, or a transfer to another component. Note that the number output unit 17 may or may not include a device that performs output (for example, a display device or a printer). Also, the number output unit 17 may be realized by hardware, or may be realized by software such as a driver that drives those devices.

[0037] Next, the operation of the information processing device 1 will be described with reference to the flowchart of FIG. (Step S101) The image acquisition unit 11 determines whether to acquire a captured image. If the captured image is to be acquired, the process proceeds to step S102. If not, the process of step S101 is repeated until it is determined that the captured image is to be acquired. Note that the image acquisition unit 11 may determine to acquire a captured image in response to, for example, an instruction to acquire a captured image (for example, a user pressing a capture button), or may determine to acquire a captured image when the captured image is accepted by the information processing device 1.

[0038] (Step S102) The image acquisition unit 11 acquires a photographed image. The acquired photographed image may be stored in the storage unit 13, for example.

[0039] In addition, when two or more captured images are acquired, for example, the processes of steps S101 and S102 may be repeated, or two or more captured images may be acquired in step S102. In this flowchart, the case where two or more captured images are acquired will be mainly described.

[0040] (Step S103) The judgment unit 14 judges whether or not a plurality of predetermined reference codes are included in two or more captured images. If a plurality of reference codes are included, the process proceeds to step S104, and if not, the process proceeds to step S107.

[0041] (Step S104) The position acquisition unit 12 acquires code position information for each of a plurality of codes included in the two or more acquired photographed images. The acquired code position information may be stored in the storage unit 13, for example.

[0042] (Step S105) The number obtaining unit 16 obtains the number of each chord by using the chord position information obtained in step S104.

[0043] (Step S106) The number output unit 17 outputs the number for each code acquired in step S105. Then, the process returns to step S101.

[0044] (Step S107) The alert output unit 15 outputs an alert. This alert may be, for example, an alert indicating that at least some of a plurality of predetermined reference codes are not included in two or more captured images. Then, the process returns to step S101.

[0045] Note that the order of the processes in the flowchart of Fig. 2 is an example, and the order of the steps may be changed as long as the same results can be obtained. In addition, in the flowchart of Fig. 2, the process ends when the power is turned off or an interrupt is issued to end the process.

[0046] Next, the operation of the information processing device 1 according to this embodiment will be described using a specific example. In this specific example, it is assumed that a plurality of pieces of information that associate the code identifier of a reference code with the position of the reference code shown in Fig. 3 are stored in the storage unit 13. For example, the position of a reference code identified by a code identifier "G9001" is a position indicated by coordinate values ​​(X9001, Y9001) in a certain local coordinate system. In this specific example, it is assumed that the positions of the plurality of reference codes indicate the coordinate values ​​where each reference code is located in a certain local coordinate system.

[0047] In this specific example, a case will be described in which a plurality of box-shaped products 3 with codes 5 on their sides, as shown in FIG. 4, are photographed by an information processing device 1, which is a smartphone. In FIG. 4, the plurality of products 3 are stored on a shelf 7, to which six reference codes 6 are attached. Six pairs of the code identifiers and positions of the reference codes shown in FIG. 3 correspond to the six reference codes 6. In this specific example, as shown in FIG. 4, the codes 5 and the reference codes 6 are composed of two AR markers arranged side by side. The positions of the reference codes shown in FIG. 3 may be, for example, positions in the local coordinate system of the shelf 7.

[0048] When a user inputs an instruction to start shooting while pointing the information processing device 1, which is a smartphone, at the product 3 shown in Fig. 4, shooting starts. Then, the image acquisition unit 11 acquires a video including the captured image and stores it in the storage unit 13 (steps S101, S102). Note that the user takes pictures so that each captured image includes at least one reference code 6. When shooting of all the products 3 is finished, the user inputs an instruction to end shooting. In response to this instruction, shooting is ended, and the acquisition of the video and storage in the storage unit 13 are also ended.

[0049] When the storage of the multiple captured images in the storage unit 13 is completed, the judgment unit 14 acquires the code identifiers of the multiple codes included in the multiple captured images stored, and judges whether the acquired multiple code identifiers include the six code identifiers shown in FIG. 3 (step S103). In this case, it is assumed that the acquired multiple code identifiers include all six code identifiers. Then, the judgment unit 14 judges that the multiple captured images include six reference codes 6, and passes the judgment result to the position acquisition unit 12. In this case, no alert is output. Note that if the acquired multiple code identifiers do not include at least any of the code identifiers of the six reference codes, an alert is output, and acquisition of code position information may not be performed (step S107).

[0050] When the position acquisition unit 12 receives a determination result indicating that six reference codes 6 were included in the multiple captured images, the position acquisition unit 12 acquires code position information for each of the multiple codes 5 included in the multiple captured images acquired (step S104). Specifically, the position acquisition unit 12 identifies the reference code 6 in a certain captured image by using the correspondence between the code identifier of the reference code shown in FIG. 3 and the position in the local coordinate system, and acquires the position of the identified reference code 6 on the captured image. The position acquisition unit 12 also identifies codes 5 other than the reference code 6 in the captured image, and acquires code position information including the code identifier and the position in the local coordinate system of each code 5. Note that the position of the code in the local coordinate system is a position based on the position of the reference code 6 in the local coordinate system. The position acquisition unit 12 may, for example, acquire the relative positional relationship between a reference code 6 on the captured image and a code 5 whose position is to be acquired, and acquire the position in the local coordinate system of the code 5 whose position is to be acquired using this relative positional relationship, the position of the reference code 6 in the local coordinate system, and a predetermined unit length.

[0051] Furthermore, when one code is included in multiple captured images, multiple pieces of the same code position information may be obtained for that one code. In this case, as described above, a unique process may be performed on the multiple pieces of code position information, so that one piece of code position information may be obtained for one code 5 arranged in real space. Fig. 5 is a diagram showing an example of multiple pieces of code position information after the unique process. As shown in Fig. 5, when duplicate codes are used, multiple pieces of code position information including the same code identifier and different positions (coordinate values) may be obtained.

[0052] The position acquisition unit 12 accumulates the acquired code position information in the storage unit 13. When the code position information is accumulated, the number acquisition unit 16 acquires a plurality of pairs of a code identifier and the number of codes 5 identified by the code identifier using the code position information, and passes the pairs to the number output unit 17 (step S105). Note that the number acquisition unit 16 may acquire a set of unique code identifiers from the code position information, as described above, and count the number of code position information including each code identifier included in the set, thereby acquiring a plurality of sets of code identifiers and numbers. FIG. 6 is a diagram showing an example of a plurality of sets of code identifiers and numbers acquired in this way. FIG. 6 shows, for example, that there are three products 3 to which a code 5 identified by a code identifier "G001" is assigned.

[0053] Upon receiving the multiple pairs of the code identifier and the quantity, the quantity output unit 17 outputs the multiple pairs of the code identifier and the quantity (step S106). The quantity output unit 17 may transmit the multiple pairs of the code identifier and the quantity to, for example, a device that performs an inventory process for multiple products 3. In this manner, the series of processes for acquiring the quantity for each code 5 is completed.

[0054] In addition, when processing is performed using captured images that are frames included in a moving image as in this specific example, the position acquisition unit 12 and the determination unit 14 may, for example, perform processing using all captured images or may perform processing using discrete captured images. When a moving image is acquired, the number of captured images is large, so the latter is usually preferable.

[0055] As described above, according to the information processing device 1 of the present embodiment, by acquiring the number of each code using the code position information, even if one code is included in multiple captured images, it is possible to avoid double counting of the code. Furthermore, even if two identical codes are given to different objects, they can be counted by using the positions, and it is possible to avoid counting two identical codes as one. In this way, it is possible to accurately grasp the number of each code, and for example, it is possible to perform processes such as inventory more accurately. Furthermore, by acquiring the position of each code using the reference code, it is possible to more easily acquire the position of the code. This is noticeable when the reference code is included in each captured image. Furthermore, by outputting an alert according to the judgment result by the judgment unit 14, it is possible to call attention to the fact that appropriate shooting has not been performed.

[0056] In the present embodiment, the case where each captured image includes a reference code has been mainly described, but this is not necessarily the case. The reference code may be included only in some of the captured images. In this case, as an example, the position acquisition unit 12 may synthesize the captured images to obtain one composite image, and may acquire the position of the code in the one composite image using the reference code. When generating this composite image, for example, the two captured images may be synthesized so that the same feature points included in the two captured images are at the same positions in the composite image. For example, three or more captured images may be synthesized by repeating this process. In this case, in order to generate one composite image from the multiple captured images, the multiple captured images may be captured so that some of them overlap. Note that a method of generating one composite image by connecting multiple captured images captured so that some of them overlap is already known, so a detailed description of the method of generating a composite image will be omitted.

[0057] When two or more reference codes are included in the composite image, the position acquisition section 12 may acquire the position of each code included in the composite image by using the position of the reference code that is closest to that code, for example.

[0058] Also, in the same manner as in the process of generating a composite image, the relative positional relationship between two or more captured images can be acquired. Therefore, the position acquisition unit 12 can also acquire the position of a code in a captured image that does not include a reference code by using the relative positional relationship between two or more captured images and using the position of a reference code included in a captured image as a reference, without having to composite two or more captured images. In this way, the position acquisition unit 12 may acquire the position of each code included in two or more captured images without having to composite two or more captured images.

[0059] Also, when the reference code is not included in one or more captured images acquired by the image acquisition unit 11, the position acquisition unit 12 may acquire the position of each code based on, for example, the position of a specific code included in at least one of the one or more captured images. When two or more captured images are acquired, the position acquisition unit 12 may acquire the position based on the specific code in a composite image obtained by combining the two or more captured images. The specific code may be, for example, a code determined by a predetermined rule in two or more captured images. For example, the code with the smallest code identifier number or the largest code identifier number among codes included only once in the composite image may be the specific code. Also, a code included in a specific position in the composite image, for example, a code in the upper left, a code in the lower left, a code located on the rightmost side, or a code located on the topmost side, may be the specific code. In this way, it is preferable that the specific code is uniquely determined in one or more captured images. Also, in this case, the position acquisition unit 12 may acquire the position of each code using the specific code by using the relative positional relationship of the two or more captured images, even if the two or more captured images are not combined. Furthermore, the position acquisition unit 12 may acquire the position of each code based on a position other than the reference code or the specific code. For example, when a predetermined mark is included in at least one of the one or more captured images, the position of each code may be acquired based on the mark.

[0060] In the present embodiment, the case where an alert is output when it is not determined that two or more acquired captured images contain multiple reference codes has been mainly described, but this is not necessarily the case. In the case where such an alert is not output, the information processing device 1 does not need to include the determination unit 14 and the alert output unit 15.

[0061] In addition, in the present embodiment, the case where the number of each code is acquired using the code position information has been mainly described, but this is not necessarily the case. When the number of each code is not acquired, the information processing device 1 may not include the number acquisition unit 16 and the number output unit 17. In this case, the information processing device 1 may further include an output unit that outputs a plurality of pieces of code position information. For example, the output unit may display, transmit, print, or store the code position information in a recording medium, or may pass it on to another component. The output unit may or may not include a device that performs output (for example, a display device or a communication device). The output unit may be realized by hardware, or may be realized by software such as a driver that drives those devices. In this case, for example, the number of each code may be acquired in an external device using the outputted plurality of pieces of code position information.

[0062] In the above embodiment, the case where the information processing device 1 is a stand-alone device has been mainly described, but the information processing device 1 may be a stand-alone device or a server device in a server-client system. In the latter case, the output unit and the reception unit may obtain information and output information via a communication line.

[0063] In addition, in the above embodiments, each process or function may be realized by centralized processing in a single device or a single system, or may be realized by distributed processing in multiple devices or multiple systems.

[0064] In addition, in the above embodiments, the transfer of information between each component may be performed, for example, by one component outputting information and the other component receiving information if the two components transferring the information are physically different, or, if the two components transferring the information are physically the same, by shifting from a processing phase corresponding to one component to a processing phase corresponding to the other component.

[0065] In the above embodiment, information related to the processing performed by each component, such as information accepted, acquired, selected, generated, transmitted, or received by each component, and information such as thresholds, formulas, and addresses used by each component in processing, may be temporarily or long-term stored in a recording medium (not shown) even if not specified in the above description. Furthermore, each component or a storage unit (not shown) may store information in the recording medium (not shown). Furthermore, each component or a reading unit (not shown) may read information from the recording medium (not shown).

[0066] In the above embodiment, if the information used by each component, such as the thresholds, addresses, and various setting values ​​used by each component in processing, may be changed by the user, the user may be able to change the information as appropriate, even if not specified in the above description. If the information is changeable by the user, the change may be realized, for example, by a reception unit (not shown) that receives a change instruction from the user, and a change unit (not shown) that changes the information in response to the change instruction. The reception unit (not shown) may receive the change instruction from an input device, may receive information transmitted via a communication line, or may receive information read from a predetermined recording medium.

[0067] In addition, in the above embodiment, when two or more components included in the information processing device 1 have a communication device, an input device, etc., the two or more components may physically have a single device, or may have separate devices.

[0068] In the above embodiment, each component may be configured by dedicated hardware, or a component that can be realized by software may be realized by executing a program. For example, each component may be realized by a program execution unit such as a CPU reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory. During execution, the program execution unit may execute the program while accessing a storage unit or a recording medium. Note that the software for realizing the information processing device 1 in the above embodiment is a program as follows. In other words, this program may be a program for making a computer function as an image acquisition unit that acquires one or more captured images of multiple codes including the same code, and a position acquisition unit that acquires code position information including a code identifier that identifies the code and the position of the code for each of the multiple codes included in the one or more captured images.

[0069] In addition, the functions realized by the above program do not include functions that can only be realized by hardware, such as a modem or an interface card in an acquisition unit that acquires information or an output unit that outputs information.

[0070] This program may be executed by being downloaded from a server or the like, or by reading out a program recorded on a predetermined recording medium (for example, an optical disk such as a CD-ROM, a magnetic disk, a semiconductor memory, etc.). This program may be used as a program constituting a program product. This program may be executed by a single computer or multiple computers. That is, centralized processing or distributed processing may be performed.

[0071] 7 is a diagram showing an example of a computer system 900 that executes the above program to realize the information processing device 1 according to the above embodiment. The above embodiment can be realized by computer hardware and a computer program executed thereon.

[0072] 7, the computer system 900 includes an MPU (Micro Processing Unit) 911, a ROM 912 such as a flash memory in which programs such as a boot-up program, application programs, system programs, and data are stored, a RAM 913 connected to the MPU 911 and temporarily storing instructions of application programs and providing a temporary storage space, a touch panel 914, a wireless communication module 915, and a bus 916 connecting the MPU 911, the ROM 912, and the like to each other. Note that a wired communication module may be provided instead of the wireless communication module 915. Also, instead of the touch panel 914, a display and an input device such as a mouse or a keyboard may be provided.

[0073] A program that causes the computer system 900 to execute the functions of the information processing device 1 according to the above embodiment may be stored in the ROM 912 via the wireless communication module 915. The program is loaded into the RAM 913 when executed. The program may also be loaded directly from the network.

[0074] The program does not necessarily include an operating system (OS) or a third-party program that causes the computer system 900 to execute the functions of the information processing device 1 according to the above embodiment. The program may include only an instruction portion that calls appropriate functions or modules in a controlled manner to obtain a desired result. How the computer system 900 operates is well known, and a detailed description will be omitted.

[0075] The above-mentioned embodiments are merely examples for specifically implementing the present invention, and are not intended to limit the technical scope of the present invention. The technical scope of the present invention is indicated by the claims, not by the description of the embodiments, and is intended to include modifications within the literal scope of the claims and the scope of equivalent meanings. [Explanation of symbols]

[0076] 1. Information processing device 11 Image acquisition section 12 Position acquisition part 13 Storage section 14 Judgment Department 15 Alert output section 16 Quantity Acquisition Section 17 Number output section

Claims

1. an image acquisition unit that acquires one or more captured images of a plurality of codes including the same code; an information processing apparatus comprising: a position acquisition unit that acquires, for each of a plurality of codes included in the one or more captured images, code position information including a code identifier that identifies the code and a position of the code.

2. At least one of the one or more photographed images includes a reference code indicating a reference for the position of the code, The information processing apparatus according to claim 1 , wherein the position acquisition unit acquires the position of each code with respect to the position of the reference code.

3. The information processing apparatus according to claim 2 , wherein each of the one or more photographed images includes the reference code.

4. The image acquisition unit acquires two or more captured images, a determination unit that determines whether the two or more captured images include a plurality of predetermined reference codes; The information processing apparatus according to claim 2 , further comprising: an alert output unit that outputs an alert when the determination unit determines that the two or more captured images do not contain a predetermined number of the reference codes.

5. The information processing apparatus according to claim 1 , wherein the position acquisition unit acquires the position of each code based on a position of a specific code included in at least one of the one or more captured images.

6. a number acquiring unit that acquires the number of codes for each code identifier for the plurality of codes included in the one or more captured images by using the plurality of pieces of code position information; The information processing apparatus according to claim 1 , further comprising: a number output unit that outputs the number of each code identifier acquired by the number acquisition unit.

7. An information processing method using an image acquisition unit and a position acquisition unit, The image acquisition unit acquires one or more captured images of a plurality of codes including the same code; and acquiring code position information, for each of a plurality of codes included in the one or more captured images, by the position acquisition unit, the code position information including a code identifier that identifies the code and a position of the code.

8. Computer, an image acquisition unit for acquiring one or more captured images of a plurality of codes including the same code; A program for causing the program to function as a position acquisition unit that acquires code position information including a code identifier that identifies the code and a position of the code for each of a plurality of codes included in the one or more captured images.

Images