Information processing apparatus, information processing method, and program

The information processing apparatus efficiently reads codes by utilizing a tile code structure within the apparatus's acquisition unit, addressing user adjustment challenges and improving reading efficiency even with limited imaging capabilities.

JP7697463B2Active Publication Date: 2025-06-24SONY GROUP CORP
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2022528424
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-06-02
Filing Date
2021-02-05
Publication Date
2025-06-24
Estimated Expiration
2041-02-05

AI Technical Summary

Technical Problem

Existing code reading technologies require user adjustment for optimal capture, especially when devices lack autofocus or present captured images, increasing user load and reducing efficiency.

Method used

An information processing apparatus with an acquisition unit that extracts a target code from an image containing a tile code, composed of multiple identical target codes arranged at a predetermined interval, allowing for efficient code reading even with limited imaging ranges or without presenting captured images.

Benefits of technology

The solution significantly reduces user adjustment burdens and improves code reading efficiency by ensuring high probabilities of capturing target codes within images, even with devices having restricted imaging capabilities.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007697463000001
    Figure 0007697463000001
  • Figure 0007697463000002
    Figure 0007697463000002
  • Figure 0007697463000003
    Figure 0007697463000003
Patent Text Reader

Abstract

[Problem] To achieve even more efficient reading of a target code. [Solution] Provided is an information processing device comprising an acquisition unit that acquires a target code from a captured image and that acquires information from said target code. The acquisition unit acquires a target code from an image in which captured is a tile code, constituted by a plurality of identical target codes that are arranged at prescribed intervals.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus, an information processing method, and a program.

Background Art

[0002] In recent years, techniques for recording and reading various information using codes such as two-dimensional codes have been developed. Also, many proposals have been made for efficiently reading various codes. For example, Patent Document 1 discloses a technique for performing correction suitable for each of data obtained by photographing a distant object and data obtained by photographing a nearby object by switching correction coefficients.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Efficient reading of various codes not only improves the information acquisition speed, but also reduces the load required for rereading and the like, leading to an improvement in usability.

Means for Solving the Problems

[0005] According to an aspect of the present disclosure, there is provided an information processing apparatus including an acquisition unit that acquires a target code from a photographed image and acquires information from the target code, wherein the acquisition unit acquires the target code from an image in which a tile code composed of a plurality of identical target codes arranged at a predetermined interval is photographed.

[0006] According to another aspect of the present disclosure, a processor obtains a target code from a captured image and obtains information from the target code, and the obtaining further includes obtaining the target code from an image in which a tile code composed of a plurality of identical target codes arranged at a predetermined interval is captured. An information processing method is provided.

[0007] According to another aspect of the present disclosure, a computer is provided with an acquisition unit that obtains a target code from a captured image and obtains information from the target code, and the acquisition unit obtains the target code from an image in which a tile code composed of a plurality of identical target codes arranged at a predetermined interval is captured. A program for causing the information processing apparatus to function as such is provided.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Mode for Carrying Out the Invention

[0009] Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In the present specification and drawings, components having substantially the same functional configuration are denoted by the same reference numerals, and redundant description is omitted.

[0010] Note that the description will be made in the following order. 1. Embodiment 1.1. Background 1.2. Example of functional configuration of information processing apparatus 10 1.3. Details 1.4. Processing flow 1.5. Application example 2. Example of hardware configuration 3. Summary

[0011] <1. Embodiment> <<1.1. Background>> First, the background of the present disclosure will be described. As described above, in recent years, technologies for recording and reading various information using codes such as two-dimensional codes have become widespread. By using various devices to read a code to be read (hereinafter referred to as a target code), a user can acquire various information.

[0012] On the one hand, when reading a target code using a general device, adjustment of the shooting position and the like by the user is required. For example, when reading a target code using a smartphone, the user is required to adjust the shooting position and the like so that the entire target code fits within the shooting range of the smartphone.

[0013] Also, in the case where the smartphone does not have an autofocus function, the user needs to further adjust the shooting position and the like so that the target code is in focus.

[0014] Generally, the above adjustment by the user is mainly performed while the user visually observes the captured image.

[0015] However, depending on the device for reading the target code, it may be difficult to perform the above adjustment while visually observing.

[0016] FIG. 1 is a diagram illustrating the relationship between an information processing apparatus 10 according to an embodiment of the present disclosure, the shooting range by the information processing apparatus 10, and a target code. As shown in the figure, the target code according to the present embodiment may include, for example, a two-dimensional code such as a QR code (registered trademark). In the following, an example in the case where the target code according to the present embodiment is a two-dimensional code will be described.

[0017] On the right side of FIG. 1, an example in the case where the information processing apparatus 10 according to the present embodiment is a watch-type wearable device is shown. The information processing apparatus 10 performs contactless shooting of the two-dimensional code C by a shooting unit 110 disposed on the back of the hand, for example, based on a user operation. Here, it is assumed that the shooting unit 110 does not have an autofocus function.

[0018] Also, in the following, it is assumed that the image captured by the shooting unit 110 is not presented to the user. That is, different from reading the two-dimensional code C using a general smartphone or the like, a situation will be described in which the user cannot adjust the shooting position while visually observing the captured image.

[0019] On the left side of FIG. 1, a two-dimensional code C and imaging ranges Ra to Rc by an imaging unit 110 included in the information processing apparatus 10 are illustrated.

[0020] Here, the imaging range Ra is an example in a case where imaging over a range sufficiently wider than the size of the two-dimensional code C is possible. For example, when the length of one side of the two-dimensional code C is S, the width of the imaging range Ra is W, and the height of the imaging range Ra is H, the imaging range Ra may satisfy the conditions of S << W and S << H.

[0021] In this case, even when an image captured by the imaging unit 110 is not presented to the user, there is a high possibility that the entire two-dimensional code C can be captured.

[0022] On the other hand, the imaging range Rb is an example in a case where imaging over a range slightly wider than the size of the two-dimensional code C is possible. For example, when the length of one side of the two-dimensional code C is S, the width of the imaging range Rb is W, and the height of the imaging range Rb is H, the imaging range Rb may satisfy the conditions of S ≦ W and S ≦ H.

[0023] In this case, the positions where the entire two-dimensional code C can be captured are extremely limited as compared with the imaging range Ra. For this reason, when an image captured by the imaging unit 110 is not presented to the user, it is assumed that the time required for adjusting the imaging position increases and the load on the user also increases.

[0024] On the other hand, the imaging range Rc is an example in a case where the imaging range is narrower than the size of the two-dimensional code C. For example, when the length of one side of the two-dimensional code C is S, the width of the imaging range Rc is W, and the height of the imaging range Rc is H, the imaging range Rc may satisfy the conditions of S > W and S > H.

[0025] In this case, even if an image captured by the imaging unit 110 is presented to the user, since the imaging unit 110 cannot capture the entire two-dimensional code C, the information recorded in the two-dimensional code C cannot be read by a normal method.

[0026] As described above, the user load related to reading the two-dimensional code C is greatly affected by the presence or absence of the presentation of the captured image and the characteristics of the shooting function including the shooting range and the autofocus function.

[0027] The technical idea according to an embodiment of the present disclosure was conceived by paying attention to the above points, and realizes more efficient reading of the target code.

[0028] For this purpose, the information processing apparatus 10 according to an embodiment of the present disclosure includes an acquisition unit 120 that acquires a target code from a captured image and acquires information from the acquired target code. Further, the acquisition unit 120 according to an embodiment of the present disclosure is characterized in that it acquires a two-dimensional code from an image in which a tile code composed of a plurality of identical target codes arranged at a predetermined interval is captured.

[0029] Here, the above tile code will be described in detail. FIG. 2 is a diagram showing an example of a tile code according to the present embodiment.

[0030] On the left side of FIG. 2, an example of a general two-dimensional code C is shown, and on the right side of FIG. 2, an example of a tile code TC according to the present embodiment is shown. Note that the size of the two-dimensional code C shown in FIG. 2 and the size of the tile code TC may be substantially the same.

[0031] The tile code according to the present embodiment may be a code in which at least two or more two-dimensional codes having the same shape and the same size are arranged at a predetermined interval in each of a first direction (for example, the X axis) and a second direction (for example, the Y axis) perpendicular to the first direction.

[0032] For example, in the tile code TC shown in FIG. 2, a two-dimensional code obtained by reducing the two-dimensional code C at a predetermined reduction rate so as to have the same shape as the two-dimensional code C shown on the left side in the figure and the same size (the side length is S) is arranged five by five on each of the X-axis and the Y-axis. Also, the length of the interval D between the two-dimensional codes in the tile code TC may be the same.

[0033] That is, in the tile code TC according to the present embodiment, a plurality of two-dimensional codes having complete identity in terms of shape and size are arranged in alignment with a predetermined interval.

[0034] Also, as described above, the overall size of the tile code TC according to the present embodiment may be substantially the same as the size of a general two-dimensional code C.

[0035] According to the tile code TC as described above, even when the shooting range by the shooting unit 110 is small, the possibility that any one of the plurality of included two-dimensional codes is shot can be greatly improved, and the reading performance of the two-dimensional code can be improved.

[0036] Also, according to the tile code TC as described above, even when the image shot by the shooting unit 110 is not presented to the user, there is a high possibility that any one of the two-dimensional codes is shot without the user particularly noticing. Therefore, according to the tile code TC according to the present embodiment, the adjustment load on the user can be greatly reduced.

[0037] Hereinafter, a configuration example for reading the tile code TC according to the present embodiment will be described in detail.

[0038] <<1.2. Functional Configuration Example of Information Processing Apparatus 10>> FIG. 3 is a block diagram showing a configuration example of the information processing apparatus 10 according to the present embodiment. As shown in FIG. 3, the information processing apparatus 10 according to the present embodiment may include a shooting unit 110 and an acquisition unit 120.

[0039] (Shooting Unit 110) The imaging unit 110 according to this embodiment captures an image. In particular, the imaging unit 110 according to this embodiment captures an image with a tile code as the subject. For this purpose, the imaging unit 110 according to this embodiment includes various imaging mechanisms according to the characteristics of the information processing apparatus 10.

[0040] For example, as described above, the information processing apparatus 10 according to this embodiment may be a watch-type wearable device. In this case, the imaging unit 110 according to this embodiment may photograph the tile code using an MLA sensor, a pinhole camera, or the like. The imaging unit 110 according to this embodiment may continuously photograph the tile code based on a user operation such as holding the information processing apparatus 10 over a flat surface.

[0041] On the other hand, the imaging unit 110 according to this embodiment only needs to have the function of photographing the tile code, and the imaging method is not necessarily limited to the above-described close-up photographing.

[0042] (Acquisition unit 120) The acquisition unit 120 according to this embodiment acquires a two-dimensional code from the image captured by the imaging unit 110 and acquires information from the two-dimensional code. At this time, one of the features of the acquisition unit 120 according to this embodiment is that it acquires a two-dimensional code from an image in which a tile code composed of a plurality of identical two-dimensional codes arranged at a predetermined interval is captured.

[0043] The functions of the acquisition unit 120 according to this embodiment are realized by various processors. The details of the functions of the acquisition unit 120 according to this embodiment will be described separately.

[0044] The functional configuration example of the information processing apparatus 10 according to this embodiment has been described above. Note that the above-described functional configuration described with reference to FIG. 3 is merely an example, and the functional configuration of the information processing apparatus 10 according to this embodiment is not limited to such an example.

[0045] The information processing apparatus 10 according to the present embodiment may further include a generation unit that generates a tile code in which a plurality of target codes having the same shape as the input target code are arranged at a predetermined interval based on the input target code.

[0046] For example, when the two-dimensional code C shown in FIG. 2 is input, the generation unit according to the present embodiment may generate a tile code TC based on the two-dimensional code C.

[0047] Further, the functions of the acquisition unit 120 according to the present embodiment may be realized by cooperation of a plurality of functional configurations. For example, the functions of the acquisition unit 120 may be realized by cooperation of a recognition unit that recognizes a two-dimensional code, an internal state holding unit that holds an internal state during processing, an output unit that outputs the recognized two-dimensional code, and a control unit that controls each of the above configurations.

[0048] The functional configuration of the information processing apparatus 10 according to the present embodiment can be flexibly deformed according to specifications and operations.

[0049] <<1.3. Details>> Next, the reading of the tile code by the information processing apparatus 10 according to the present embodiment (acquisition of the two-dimensional code included in the tile code and acquisition of information from the two-dimensional code) will be described in detail.

[0050] The reading of the tile code by the information processing apparatus 10 according to the present embodiment is roughly classified into three categories according to the size of the shooting range by the shooting unit 110.

[0051] First, a case where the imaging unit 110 has an imaging range Ra that is sufficiently wide with respect to the size of the two-dimensional code included in the tile code TC will be described. For example, when the length of one side of the two-dimensional code included in the tile code TC is S, the width of the imaging range Ra is W, and the height of the imaging range Ra is H, the imaging range Ra is 4(S + D) 2 ≦W 2 +H 2 and may satisfy the condition.

[0052] Also, here, it is assumed that the ratio (S:D) of the length S of one side of the two-dimensional code included in the tile code TC to the length D of the interval between the two-dimensional codes is known.

[0053] FIG. 4 is a diagram for explaining the process of the acquisition unit 120 when the imaging unit 110 according to the present embodiment has an imaging range Ra that is sufficiently wide with respect to the size of the two-dimensional code included in the tile code TC.

[0054] On the left side of FIG. 4, an example of the imaging range Ra with respect to the tile code TC is shown, and on the right side of FIG. 4, an example of the image IM captured by the imaging unit 110 within the imaging range Ra is shown.

[0055] In the image IM captured within the imaging range Ra that satisfies the above conditions, as shown in the figure, it is guaranteed that at least one two-dimensional code without information loss (i.e., without loss in the code, and the entire S×S is captured) is included.

[0056] In this case, the acquisition unit 120 according to the present embodiment first calculates the magnification (scale) R, position (T, L), and angle θ of the two-dimensional code in the captured image IM based on the size of the two-dimensional code forming the preset tile code and the length of the interval between the two-dimensional codes.

[0057] More specifically, the acquisition unit 120 may calculate the magnification R, position (T, L), and angle θ at which the correlation between the ratio of the code region corresponding to the two-dimensional code and the interval region corresponding to the interval in the image IM (code:interval) and the above-mentioned (S:D) is maximized.

[0058] At this time, the acquisition unit 120 may perform the above calculation by detecting the main frequency and angle by, for example, FFT (Fast Fourier Transform). On the other hand, the acquisition unit 120 may more restrictively detect the frequency and angle by limiting the correlation of code:interval = S:D.

[0059] Next, based on the above calculation results, the acquisition unit 120 according to the present embodiment acquires any one of the two-dimensional codes without information loss among the plurality of two-dimensional codes included in the image IM in which the tile code TC is photographed, and acquires information from the acquired two-dimensional code.

[0060] For example, in the case of an example shown in FIG. 4, the acquisition unit 120 may cut out and acquire the two-dimensional code indicated by the dotted line among the three two-dimensional codes without information loss included in the image IM.

[0061] At this time, the acquisition unit 120 may perform, for example, estimation of 3D homography or the like to correct the image IM.

[0062] According to the above processing, by calculating the frequency, angle, etc., the two-dimensional position without information loss can be specified, and reading can be performed at high speed.

[0063] Next, a case where the photographing unit 110 has a photographing range Rb slightly wider than the size of the two-dimensional code included in the tile code TC will be described. For example, when the length of one side of the two-dimensional code included in the tile code TC is S, the width of the photographing range Rb is W, and the height of the photographing range Rb is H, the photographing range Rb may satisfy the conditions of S + D ≤ W and S + D ≤ H.

[0064] FIG. 5 is a diagram for explaining the processing of the acquisition unit 120 in the case where the photographing unit 110 according to the present embodiment has a photographing range Rb slightly wider than the size of the two-dimensional code included in the tile code TC.

[0065] On the left side of FIG. 5, an example of the photographing range Ra for the tile code TC is shown.

[0066] In the image IM captured with the imaging range Rb that satisfies the above conditions, although there may be a two-dimensional code without information loss depending on the imaging position, in many cases, as shown in the center of FIG. 5, there are a plurality of two-dimensional codes with information loss (that is, there are defects in the code, and the entire S×S is not captured).

[0067] Also in this case, as described above, the acquisition unit 120 calculates the magnification (scale) R, position (T, L), and angle θ of the two-dimensional code in the image IM.

[0068] Next, the acquisition unit 120 according to the present embodiment executes a process of restoring a two-dimensional code without information loss by using a plurality of two-dimensional codes with information loss included in a single image IM in which the tile code TC is captured, and acquiring information from the restored two-dimensional code.

[0069] More specifically, the acquisition unit 120 according to the present embodiment may restore a two-dimensional code without information loss by synthesizing partial code regions extracted from each of the two-dimensional codes with information loss included in the image IM.

[0070] For example, the acquisition unit 120 according to the present embodiment may extract a partial code region corresponding to any one of the upper left side, upper right side, lower left side, and lower right side from each of the two-dimensional codes with information loss included in the image IM. In this case, the acquisition unit 120 can restore a two-dimensional code without information loss by synthesizing the extracted plurality of partial code regions.

[0071] For example, in the case of an example shown in FIG. 5, the acquisition unit 120 extracts a partial code region Pa corresponding to the lower right side, a partial code region Pb corresponding to the lower left side, a partial code region Pc corresponding to the upper right side, and a partial code region Pd corresponding to the upper left side from each of the two-dimensional codes with information loss included in the image IM.

[0072] At this time, the acquisition unit 120 according to the present embodiment can extract the partial code regions Pa to Pd based on the interval region corresponding to the interval between the two-dimensional codes in the tile code.

[0073] More specifically, the acquisition unit 120 can identify the partial code regions Pa to Pd from the positional relationship with the point by detecting the point where the interval regions intersect in the image IM. Note that the positional relationship between the point where the interval regions intersect and the partial code regions Pa to Pd can be obtained by the magnification ratio R, position (T, L), and angle θ described above.

[0074] Also, at this time, the acquisition unit 120 extracts the partial code regions Pa to Pd so that they respectively satisfy the following conditions.

[0075] Partial code region Pa = S1 × S3 Partial code region Pb = S1 × S4 Partial code region Pc = S2 × S3 Partial code region Pd = S2 × S4

[0076] However, at this time, S1 to S4 above shall satisfy S1 + S2 ≥ S and S3 + S4 ≥ S.

[0077] According to the above processing, even when the image IM does not contain a two-dimensional code without information loss, by synthesizing the partial code regions extracted from each of the two-dimensional codes with information loss, a two-dimensional code SC without information loss can be restored, and information can be obtained from the two-dimensional code SC.

[0078] Next, a case where the imaging unit 110 has an imaging range Rc narrower than the size of the two-dimensional code included in the tile code TC will be described. For example, when the length of one side of the two-dimensional code included in the tile code TC is S, the width of the imaging range Rc is W, and the height of the imaging range Rc is H, the imaging range Rc may satisfy the condition of S > W or S > H.

[0079] FIG. 6 is a diagram for explaining the processing of the acquisition unit 120 when the imaging unit 110 according to the present embodiment has an imaging range Rc narrower than the size of the two-dimensional code included in the tile code TC.

[0080] On the left side of FIG. 6, imaging ranges Rc1 to Rc4 for the tile code TC are illustrated. Thus, when the imaging unit 110 has an imaging range Rc narrower than the size of the two-dimensional code included in the tile code TC, the acquisition unit 120 according to the present embodiment may execute processing based on a plurality of images IM captured by the imaging unit 110.

[0081] That is, the acquisition unit 120 according to the present embodiment may restore a two-dimensional code without information loss using a two-dimensional code with information loss included in each of a plurality of images in which the tile code TC is captured.

[0082] Also in this case, the acquisition unit 120 first calculates the magnification (scale) R, position (T, L), and angle θ of the two-dimensional code in the image IM.

[0083] Next, the acquisition unit 120 calculates the width of the interval region based on the above calculation results and estimates the length S of one side of the two-dimensional code.

[0084] Next, the acquisition unit 120 extracts a partial code region P corresponding to any one of the upper left, upper right, lower left, and lower right from the two-dimensional code with missing information included in the input image IM. At this time, the acquisition unit 120 may perform a process of fitting the extracted partial code region P into a pixel region generated based on the length S of one side of the two-dimensional code estimated above.

[0085] The acquisition unit 120 may repeatedly execute the above extraction process until a sufficient partial code region for restoring a two-dimensional code without information loss is obtained.

[0086] For example, in the case of an example shown in FIG. 6, the acquisition unit 120 extracts a partial code area Pa (S1×S3) corresponding to the lower right side from a two-dimensional code with missing information included in the input image IM1.

[0087] Similarly, the acquisition unit 120 extracts a partial code area Pb (S1×S4) corresponding to the lower left side from a two-dimensional code with missing information included in the input image IM2.

[0088] Similarly, the acquisition unit 120 extracts a partial code area Pc (S2×S3) corresponding to the upper right side from a two-dimensional code with missing information included in the input image IM3.

[0089] Similarly, the acquisition unit 120 extracts a partial code area Pd (S2×S4) corresponding to the upper left side from a two-dimensional code with missing information included in the input image IM4.

[0090] Here, when S1 to S4 satisfy S1+S2≧S and S3+S4≧S, the acquisition unit 120 determines that a sufficient partial code area has been obtained to restore a two-dimensional code without missing information, and synthesizes the partial code areas Pa to Pd to be able to restore a two-dimensional code SC without missing information.

[0091] As described above in detail, the reading of the tile code by the information processing apparatus 10 according to the present embodiment has been described. Note that the extraction of the partial code area described with reference to FIGS. 5 and 6 and the restoration process of the two-dimensional code by synthesizing the partial code areas are merely examples.

[0092] The extraction of the partial code area and the restoration process of the two-dimensional code according to the present embodiment may be realized using other methods widely used in the field of image processing.

[0093] For example, the restoration of the two-dimensional code according to the present embodiment may be realized using a matching process based on image feature amounts. As the above image feature amounts, for example, SIFT feature amounts may be used.

[0094] Also, for example, the restoration of the two-dimensional code according to the present embodiment may be realized by a machine learning method using a CNN (Convolutional Neural Network) or the like.

[0095] Thus, the extraction of the partial code area and the restoration process of the two-dimensional code according to the present embodiment can be flexibly deformed.

[0096] Also, as shown in FIG. 6, when restoring the two-dimensional code using the partial code areas extracted from each of the plurality of images IM, the image IM does not necessarily have to be the one that has photographed the tile code TC.

[0097] The information processing apparatus 10 according to the present embodiment can also restore the two-dimensional code from a plurality of images IM that have photographed a general two-dimensional code C. In this case, it can be said that the acquisition unit 120 according to the present embodiment restores the target code without information loss using the target code with information loss included in each of the plurality of photographed images, and acquires information from the restored target code.

[0098] <<1.4. Flow of processing>> Next, the flow of processing by the information processing apparatus 10 according to the present embodiment will be described in detail. FIG. 7 is a flowchart showing an example of the flow of processing by the information processing apparatus 10 according to the present embodiment.

[0099] As shown in FIG. 7, first, an image photographed by the photographing unit 110 with the tile code as the subject is input to the acquisition unit 120 (S102).

[0100] Next, the acquisition unit 120 calculates the magnification (scale) R, position (T, L), and angle θ of the two-dimensional code included in the image photographed in step S102 based on the S:D ratio of the base (S104).

[0101] Next, based on the result of the calculation in step S104, the acquisition unit 120 determines whether a two-dimensional code without information loss is captured in the image captured in S102 (S106).

[0102] Here, when it is determined that a two-dimensional code without information loss is captured in the image captured in S102 (S106: Yes), the acquisition unit 120 acquires the two-dimensional code without information loss included in the image and acquires information from the two-dimensional code (S108).

[0103] On the other hand, when it is determined that a two-dimensional code without loss is not captured in the image captured in S102 (S106: No), subsequently, the acquisition unit 120 determines whether a sufficient partial code area capable of restoring a two-dimensional code without information loss is captured in the image (S110).

[0104] Here, when it is determined that a sufficient partial code area capable of restoring a two-dimensional code without information loss is captured in the image captured in S102, (S110: Yes), the acquisition unit 120 restores a two-dimensional code without information loss using a plurality of partial code areas extracted from the image (S112). Further, the acquisition unit 120 acquires information from the two-dimensional code restored in step S112 (S108).

[0105] On the other hand, here, when it is determined that a sufficient partial code area capable of restoring a two-dimensional code without information loss is not captured in the image captured in S102, (S110: No), the acquisition unit 120 extracts a partial code area that can be extracted from the image and stores the partial code area (S114).

[0106] Next, the acquisition unit 120 determines whether it is possible to restore a two-dimensional code without information loss using the stored partial code area (S116).

[0107] Here, when it is determined that a two-dimensional code without information loss can be restored using the stored partial code area (S116: Yes), the acquisition unit 120 restores a two-dimensional code without information loss using the stored partial code area (S112). Further, the acquisition unit 120 acquires information from the two-dimensional code restored in step S112 (S108).

[0108] On the other hand, when the acquisition unit 120 determines that a two-dimensional code without information loss cannot be restored using the stored partial code area, the acquisition unit 120 returns to step S102 and repeatedly executes the subsequent processing.

[0109] <<1.5. Application Example>> The above describes an example of the basic operation for reading the tile code by the information processing apparatus 10 according to the present embodiment.

[0110] Note that in the above, the case where the information processing apparatus 10 according to the present embodiment is a watch-type wearable device has been mainly described as an example. On the other hand, the form of the information processing apparatus 10 according to the present embodiment is not limited to such an example and can be realized as various devices.

[0111] For example, in recent years, the scenes where two-dimensional codes are utilized in transportation facilities have been increasing. For example, some airlines and railway companies provide services such as providing paper media tickets printed with two-dimensional codes to users or transmitting images of two-dimensional codes to smart phones or the like held by users.

[0112] In this case, the user can enter the venue or check in by having the two-dimensional code printed on the paper media ticket or the two-dimensional code displayed on a smart phone or the like read by a reading device installed at the airport or station.

[0113] However, in many cases, a reading device as described above does not present the captured image to the user. For this reason, it is difficult for the user to grasp whether the reading device is correctly reading the two-dimensional code and how to perform position adjustment to make the reading device correctly read the two-dimensional code.

[0114] From this, the information processing apparatus 10 according to the present embodiment may be applied as a two-dimensional code reading device in the transportation means as described above.

[0115] For example, the information processing apparatus 10 according to the present embodiment may be fixedly arranged, and the photographing unit 110 may photograph a tile code existing on a medium brought close by the user.

[0116] FIG. 8 is a diagram for explaining an example when the information processing apparatus 10 according to the present embodiment is applied as a two-dimensional code reading device in a transportation means.

[0117] On the left side of FIG. 8, the outer shape of the information processing apparatus 10 applied as a two-dimensional code reading device in a transportation means is illustrated. As shown in FIG. 8, in the information processing apparatus 10, a photographing unit 110 for photographing a tile code is arranged, for example, on the upper surface of the apparatus or the like.

[0118] In this case, the user causes the information processing apparatus 10 to photograph the tile code on the medium by, for example, holding the medium close to the photographing unit 110. Note that the medium may be a paper medium or an electronic medium such as a smartphone.

[0119] For example, in the case of an example shown on the right side of FIG. 8, the user brings the smartphone 20 close to the photographing unit 110 so that the tile code TC displayed on the display unit 210 provided in the smartphone 20 faces the photographing unit 110.

[0120] The smartphone 20 is an example of an information processing apparatus including a display unit that displays a tile code composed of a plurality of identical target codes arranged at predetermined intervals.

[0121] According to the information processing apparatus 10 and the smartphone 20 as described above, even when the user causes a device (imaging unit) with a fixed two-dimensional code to read it, it is possible to reduce the burden of alignment and effectively improve the reading accuracy.

[0122] As described above, the information processing apparatus 10 according to the present embodiment can be realized as various types of devices.

[0123] In addition, in the above, the case where the target code included in the tile code according to the present embodiment is a two-dimensional code has been mainly described as an example. On the other hand, the type of the target code included in the tile code according to the present embodiment is not limited to such an example.

[0124] The target code included in the tile code according to the present embodiment may be a one-dimensional code. FIG. 9 is a diagram showing an example of a tile code when the target code according to the present embodiment is a one-dimensional code.

[0125] Even in this case, in the tile code TC, a plurality of one-dimensional codes having the same shape and the same size are arranged at a predetermined interval.

[0126] For example, in the case of an example shown in FIG. 9, each of the one-dimensional codes included in the tile code TC has a width Sw and a height Sh, and is arranged at an interval Dw on the X axis and at an interval Dh on the Y axis.

[0127] The target code according to the present embodiment may be a pattern in which the width, height, and arrangement interval are determined in advance to predetermined values as described above. The tile code according to the present embodiment is applicable to various target patterns.

[0128] <2. Example of Hardware Configuration> Next, a hardware configuration example of the information processing apparatus 10 according to an embodiment of the present disclosure will be described. FIG. 10 is a block diagram showing a hardware configuration example of the information processing apparatus 10 according to an embodiment of the present disclosure. As shown in FIG. 10, the information processing apparatus 10 includes, for example, a processor 871, a ROM 872, a RAM 873, a host bus 874, a bridge 875, an external bus 876, an interface 877, an input device 878, an output device 879, a storage 880, a drive 881, a connection port 882, and a communication device 883. Note that the hardware configuration shown here is an example, and some of the components may be omitted. Further, other components not shown here may be further included.

[0129] (Processor 871) The processor 871 functions as, for example, an arithmetic processing unit or a control unit, and controls the overall operation or a part of the operations of each component based on various programs recorded in the ROM 872, the RAM 873, the storage 880, or the removable recording medium 901.

[0130] (ROM 872, RAM 873) The ROM 872 is a means for storing programs read by the processor 871, data used for calculations, and the like. In the RAM 873, for example, programs read by the processor 871 and various parameters that change as appropriate when executing the programs are stored temporarily or permanently.

[0131] (Host bus 874, bridge 875, external bus 876, interface 877) The processor 871, the ROM 872, and the RAM 873 are interconnected via, for example, a host bus 874 capable of high-speed data transmission. On the other hand, the host bus 874 is connected to an external bus 876 having a relatively low data transmission speed via, for example, a bridge 875. Further, the external bus 876 is connected to various components via an interface 877.

[0132] (Input device 878) As the input device 878, for example, a mouse, a keyboard, a touch panel, buttons, switches, levers, etc. are used. Further, as the input device 878, a remote controller (hereinafter, remote control) capable of transmitting a control signal using infrared rays or other radio waves may be used. In addition, the input device 878 includes a voice input device such as a microphone.

[0133] (Output device 879) The output device 879 is a device capable of visually or auditorily notifying the user of the acquired information, such as a display device such as a CRT (Cathode Ray Tube), LCD, or organic EL, an audio output device such as a speaker or headphones, a printer, a mobile phone, or a facsimile. In addition, the output device 879 according to the present disclosure includes various vibration devices capable of outputting a tactile stimulus.

[0134] (Storage 880) The storage 880 is a device for storing various data. As the storage 880, for example, a magnetic storage device such as a hard disk drive (HDD), a semiconductor storage device, an optical storage device, or a magneto-optical storage device is used.

[0135] (Drive 881) The drive 881 is a device that reads information recorded on a removable recording medium 901 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, or writes information to the removable recording medium 901.

[0136] (Removable recording medium 901) The removable recording medium 901 is, for example, a DVD medium, a Blu-ray (registered trademark) medium, an HD DVD medium, various semiconductor memory media, etc. Of course, the removable recording medium 901 may be, for example, an IC card equipped with a non-contact type IC chip, or an electronic device.

[0137] (Connection port 882) The connection port 882 is a port for connecting an external connection device 902 such as, for example, a USB (Universal Serial Bus) port, an IEEE 1394 port, a SCSI (Small Computer System Interface), an RS-232C port, or an optical audio terminal.

[0138] (External connection device 902) The external connection device 902 is, for example, a printer, a portable music player, a digital camera, a digital video camera, or an IC recorder.

[0139] (Communication device 883) The communication device 883 is a communication device for connecting to a network, and is, for example, a communication card for wired or wireless LAN, Bluetooth (registered trademark), or WUSB (Wireless USB), a router for optical communication, a router for ADSL (Asymmetric Digital Subscriber Line), or a modem for various communications.

[0140] <3. Summary> As described above, the information processing apparatus 10 according to an embodiment of the present disclosure includes an acquisition unit 120 that acquires a target code from a captured image and acquires information from the target code. Further, the acquisition unit 120 according to an embodiment of the present disclosure is characterized in that it acquires a target code from an image in which a tile code composed of a plurality of identical target codes arranged at a predetermined interval is captured.

[0141] According to the above configuration, it becomes possible to realize more efficient reading of the target code.

[0142] As described above, the preferred embodiments of the present disclosure have been described in detail with reference to the accompanying drawings. However, the technical scope of the present disclosure is not limited to such examples. It is obvious that those having ordinary knowledge in the technical field of the present disclosure can conceive of various modification examples or correction examples within the scope of the technical idea described in the claims, and it is naturally understood that these also belong to the technical scope of the present disclosure.

[0143] For example, in the above embodiment, FIGS. 1 and 8 are used to illustrate the case where the photographing unit 110 is arranged separately from a display unit such as a display. However, the arrangement of the photographing unit 110 is not limited to such an example. For example, the photographing unit 110 may be arranged below a display unit such as a display or a touch panel, and photograph the target code through the display unit. Further, in this case, the photographing unit 110 can also photograph a fingerprint from a finger of a user who touches the display unit in addition to the target code.

[0144] Also, each step related to the processing described in this specification does not necessarily need to be processed in time series in the order described in the flowchart or sequence diagram. For example, each step related to the processing of each device may be processed in an order different from the described order or may be processed in parallel.

[0145] Also, the series of processes by each device described in this specification may be realized using any of software, hardware, and a combination of software and hardware. The program constituting the software is, for example, pre-stored in a recording medium (non-transitory media) provided inside or outside each device. Then, each program is read into the RAM when executed by a computer, for example, and executed by various processors. The recording medium is, for example, a magnetic disk, an optical disk, a magneto-optical disk, a flash memory, or the like. Further, the above computer program may be distributed via a network, for example, without using a recording medium.

[0146] Moreover, the effects described in this specification are merely illustrative or exemplary and not limiting. That is, the technology according to the present disclosure may exhibit other effects that are apparent to those skilled in the art from the description herein, in addition to or instead of the above effects.

[0147] Note that the following configurations also fall within the technical scope of the present disclosure. (1) An acquisition unit that acquires a target code from a captured image and acquires information from the target code, comprising: The acquisition unit acquires a target code from an image in which a tile code composed of a plurality of identical target codes arranged at a predetermined interval is captured. An information processing apparatus. (2) The tile code is a code in which at least two or more target codes having the same shape and the same size are arranged at a predetermined interval in each of a first direction and a second direction perpendicular to the first direction. The information processing apparatus according to (1) above. (3) The acquisition unit acquires any one of the target codes without information loss among a plurality of target codes included in the image in which the tile code is captured, and acquires information from the acquired target code. The information processing apparatus according to (1) or (2) above. (4) The acquisition unit restores a target code without information loss by using a plurality of target codes with information loss included in the image in which the tile code is captured, and acquires information from the restored target code. The information processing apparatus according to (1) or (2) above. (5) The acquisition unit restores a target code without information loss by using a plurality of target codes with information loss included in a single image in which the tile code is captured. The information processing apparatus according to (4) above. (6) The acquisition unit restores the target code without information loss by using the target code with information loss included in each of the plurality of images in which the tile code is photographed. The information processing apparatus according to (4) above. (7) The acquisition unit synthesizes the partial code regions extracted from each of the target codes with information loss to restore the target code without information loss. The information processing apparatus according to any one of (4) to (6) above. (8) The acquisition unit extracts the partial code region corresponding to any one of the upper left side, upper right side, lower left side, and lower right side from each of the target codes with information loss, and synthesizes the extracted partial code regions to restore the target code without information loss. The information processing apparatus according to (7) above. (9) The acquisition unit extracts the partial code region based on the interval region corresponding to the interval between the target codes in the tile code. The information processing apparatus according to (8) above. (10) The acquisition unit calculates the magnification, position, and angle of the target code in the photographed image based on the size of the target code forming the preset tile code and the length of the interval between the target codes. The information processing apparatus according to any one of (1) to (9) above. (11) A photographing unit that photographs the tile code. Further comprising The information processing apparatus according to any one of (1) to (10) above. (12) The photographing unit photographs the tile code by contact printing. The information processing apparatus according to (11) above. (13) The information processing apparatus is a watch-type wearable device. The photographing unit continuously photographs the tile code based on an operation by the user. The information processing apparatus according to (11) or (12). (14) The information processing apparatus is fixedly installed, The photographing unit photographs the tile code existing on a medium approached by a user, The information processing apparatus according to (11) or (12). (15) The image in which the tile code is photographed is not presented to the user, The information processing apparatus according to any one of (1) to (14). (16) The target code includes a two-dimensional code, The information processing apparatus according to any one of (1) to (15). (17) The two-dimensional code includes a QR code, The information processing apparatus according to (16). (18) The processor obtains a target code from the photographed image and obtains information from the target code including The obtaining includes obtaining a target code from an image in which a tile code composed of a plurality of identical target codes arranged at predetermined intervals is photographed, further including Information processing method. (19) A computer An acquisition unit that obtains a target code from a photographed image and obtains information from the target code, comprising The acquisition unit obtains a target code from an image in which a tile code composed of a plurality of identical target codes arranged at predetermined intervals is photographed, Information processing apparatus, A program for causing it to function. (20) An acquisition unit that obtains a target code from a photographed image and obtains information from the target code, comprising The acquisition unit restores a target code without information loss using a target code with information loss included in each of a plurality of captured images, and acquires information from the restored target code. Information processing apparatus. (21) The processor generates a tile code in which a plurality of target codes having the same shape as the input target code are arranged at a predetermined interval based on the input target code. including Information processing method. (22) A display unit that displays a tile code composed of a plurality of identical target codes arranged at a predetermined interval. comprising Information processing apparatus.

Explanation of Signs

[0148] 10 Information processing apparatus 110 Imaging unit 120 Acquisition unit 20 Smartphone 210 Display unit TC Tile code C Target code P Partial code area

Claims

1. An acquisition unit that acquires a target code from a captured image and acquires information from the target code, comprising: The acquisition unit calculates the magnification, position, and angle of the target code in the captured image based on the size of the target code forming the tile code and the length of the interval between the target codes, which are preset, from an image in which a tile code composed of a plurality of identical target codes arranged at a predetermined interval is captured, and acquires the target code. An information processing apparatus.

2. The tile code is a code in which at least two or more target codes having the same shape and the same size are arranged at a predetermined interval in each of a first direction and a second direction perpendicular to the first direction. The information processing apparatus according to Claim 1.

3. The acquisition unit acquires any one of the target codes without information loss among the plurality of target codes included in the image in which the tile code is captured, and acquires information from the acquired target code. The information processing apparatus according to Claim 1.

4. The acquisition unit restores a target code without information loss using a plurality of target codes with information loss included in the image in which the tile code is captured, and acquires information from the restored target code. The information processing apparatus according to Claim 1.

5. The acquisition unit restores a target code without information loss using a plurality of target codes with information loss included in a single image in which the tile code is captured. The information processing apparatus according to Claim 4.

6. The acquisition unit restores a target code without information loss using the target codes with information loss included in each of the plurality of images in which the tile code is captured. The information processing apparatus according to Claim 4.

7. The acquisition unit synthesizes the partial code regions extracted from each of the target codes with information loss to restore the target code without information loss. The information processing apparatus according to Claim 4.

8. The acquisition unit extracts the partial code region corresponding to any one of the upper left side, upper right side, lower left side, and lower right side from each of the target codes with information loss, and synthesizes the extracted partial code regions to restore the target code without information loss. The information processing apparatus according to Claim 7.

9. The acquisition unit extracts the partial code region based on the interval region corresponding to the interval between the target codes in the tile code. The information processing apparatus according to claim 8.

10. An imaging unit that images the tile code, further comprising the information processing apparatus according to claim 1.

11. The imaging unit images the tile code by contact printing. The information processing apparatus according to claim 10.

12. The information processing apparatus is a watch-type wearable device, and the imaging unit continuously images the tile code based on an operation by a user. The information processing apparatus according to claim 10.

13. The information processing apparatus is fixedly installed, and the imaging unit images the tile code existing on a medium approached by a user. The information processing apparatus according to claim 10.

14. The image in which the tile code is imaged is not presented to the user. The information processing apparatus according to claim 1.

15. The target code includes a two-dimensional code. The information processing apparatus according to claim 1.

16. The two-dimensional code includes a QR code. The information processing apparatus according to claim 15.

17. A processor obtains a target code from the captured image and obtains information from the target code including the obtaining includes calculating a magnification, a position, and an angle of the target code in the captured image based on a size of the target code forming the preset tile code and a length of an interval between the target codes from an image in which a tile code composed of a plurality of identical target codes arranged at a predetermined interval is captured, and obtaining the target code. further including an information processing method.

18. A program for causing a computer to function as an information processing apparatus including an acquisition unit that obtains a target code from a captured image and obtains information from the target code, wherein the acquisition unit calculates a magnification, a position, and an angle of the target code in the captured image based on a size of the target code forming the preset tile code and a length of an interval between the target codes from an image in which a tile code composed of a plurality of identical target codes arranged at a predetermined interval is captured, and obtains the target code. and functioning as an information processing apparatus.

Citation Information

Patent Citations

  • Code pattern image generating device and method, code pattern image reading device and method, and code pattern image medium

    JP2007041691A

  • Imaging device and image processing device

    JP2011239292A

  • Information code reader

    JP2013206348A

  • Three-dimensional information code and three-dimensional information code reader

    JP2017091050A

  • Code pattern image generation apparatus and method, code pattern image reader apparatus and method, and code pattern image medium

    US20070023523A1