Optical information reading device

Abstract

To provide a configuration that can easily pick up an image of an information code in a readable state without being affected by an ambient environment such as illumination.SOLUTION: A user holds an information code 31 over an imaging window 24a that is provided on a top face 11a of a housing 11 together with a display screen 23a, and an imaging unit 24 picks up an image of the information code through the imaging window. When the picked-up image that is determined to include a high luminance area Sa where the luminance is equal to or more than a predetermined threshold includes, in its outer peripheral part, the high luminance area Sa, a display unit 23 is controlled to display, on the display screen 23a, a first processing image Pc1 subjected to image processing to remove the high luminance area Sa from the picked-up image.SELECTED DRAWING: Figure 8

Description

[Technical field]

[0001] The present invention relates to a stationary optical information reader that optically reads an information code. [Background technology]

[0002] Conventionally, in a stationary optical information reading device that optically reads an information code, in order to clearly indicate to a user the position where the information code should be held, at least a part of the captured image for capturing and reading the information code is previewed on the display screen of the reading device. For example, in a code reading device disclosed in the following Patent Document 1, before extracting a code from an image captured by a camera, an image size and a selection instruction for displaying the image on the display screen are received from an input device, and the size, position, and zoom size of the preview image on the display screen are set according to the image size and selection instruction. This allows a user to adjust the position where the code is held while viewing the preview image on the display screen. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2007-122229 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, in a stationary optical information reading device, the imaging direction for imaging the information code is upward, so that ceiling lighting and the like may be reflected in the captured image. If the information code is not imaged so that it can be decoded due to such reflection, reading will fail. For example, lighting and the like may wrap around the surface of a display medium to which an information code is attached from the edge, and if the information code is attached near the edge, the wrapped lighting and the like may be reflected and imaged so as to overlap with the information code, which may easily cause reading failure.

[0005] However, even if the above-mentioned reflection occurs, the image of the information code displayed in the preview looks relatively clear, so that an inexperienced user may think that the code can be read without any problem, and may not understand the reason for the failure to read the code. Even if the ceiling lighting or the like is arranged so as not to be reflected in the captured image, the same problem may occur if the lighting is moved to a different location or the surrounding environment changes.

[0006] The present invention has been made to solve the above-mentioned problems, and an object of the present invention is to provide a configuration that makes it easy to capture an image so that an information code can be read without being affected by the surrounding environment such as lighting. [Means for solving the problem]

[0007] In order to achieve the above object, one aspect of the present invention is A stationary optical information reader (10) that optically reads an information code (31, 40) held up by a user, comprising: A housing (11); a display unit (23) having a display screen (23a) on one surface (11a) of the housing; an imaging section (24) that captures an image through an imaging window (24a) provided on the one surface; a reading unit (21) that performs a reading process for reading information recorded in the information code from an image of the information code captured by the imaging unit; a control unit (21) capable of controlling the display unit so that at least a part of an image captured by the imaging unit is displayed on the display screen; a determination unit (21) that determines whether or not there is a high brightness area (Sa) in the captured image, the brightness of which is equal to or greater than a predetermined threshold; Equipped with The control unit is characterized in that, when a high-brightness area is included in the outer periphery of the captured image in which the determination unit has determined that the high-brightness area is included, the control unit controls the display unit so that a processed image (Pc1) that has been image-processed to remove the high-brightness area from the captured image is displayed on the display screen.

[0008] Another aspect of the present invention is A stationary optical information reader (10) that optically reads an information code (31, 40) held up by a user, comprising: A housing (11); a display unit (23) having a display screen (23a) on one surface (11a) of the housing; an imaging section (24) that captures an image through an imaging window (24a) provided on the one surface; a reading unit (21) that performs a reading process for reading information recorded in the information code from an image of the information code captured by the imaging unit; a control unit (21) capable of controlling the display unit so that at least a part of an image captured by the imaging unit is displayed on the display screen; a determination unit (21) that determines whether or not there is a high brightness area (Sa) in the captured image, the brightness of which is equal to or greater than a predetermined threshold; Equipped with The control unit is characterized in that, when a high-brightness area is included in the central part of the captured image in which the determination unit has determined that the high-brightness area is included, a processed image (Pc2) that has been image-processed to remove the outer periphery located on the outer side of the central part from the captured image is displayed on the display screen. The symbols in parentheses above indicate the corresponding relationship with the specific means described in the embodiments described later. Effect of the Invention

[0009] In the present invention, an information code held up by a user is imaged by an imaging unit through an imaging window provided on one side of a housing together with a display screen. Then, if a high-luminance area is included in the outer periphery of the captured image that is determined by a determination unit to have a high-luminance area having a luminance equal to or greater than a predetermined threshold, a control unit controls a display unit to display a processed image that has been image-processed to remove the high-luminance area from the captured image on the display screen.

[0010] As a result, if there is an area where ceiling lighting or the like is reflected in the outer periphery of the captured image, the processed image is previewed on the display screen after image processing to remove the area as a high-brightness area. The user tries to hold the information code so that it is within the previewed processed image, so that the information code in the captured image can be separated from the high-brightness area. Therefore, it is possible to realize an optical information reading device that can easily capture an image so that the information code can be read without being affected by the surrounding environment such as lighting.

[0011] In the present invention, an information code held up by a user is imaged by an imaging unit through an imaging window provided on one side of a housing together with a display screen. Then, when a high-luminance area is included in the center of the captured image that is determined by a determination unit to have a high-luminance area having a luminance equal to or greater than a predetermined threshold, a control unit controls a display unit to display a processed image on the display screen, the processed image being image-processed to remove an outer periphery located on the outer periphery side of the center from the captured image.

[0012] As a result, if there is an area where ceiling lighting or the like is reflected in the center of the captured image, a processed image that has been image-processed to remove the outer peripheral area located on the outer side of the center is previewed on the display screen. Since the user tries to hold the information code so that it is within the previewed processed image, the display medium itself on which the information code is displayed or the like blocks the lighting, etc., and in this state, it becomes difficult to capture the high-brightness area. In other words, the user can be prompted to hold the display medium of the information code so as to block the lighting, etc. Therefore, it is possible to realize an optical information reading device that can easily capture an information code so that it can be read without being affected by the surrounding environment such as lighting.

[0013] The determination section may determine that a high luminance area is present when a ratio of areas in a captured image where the luminance is equal to or greater than a predetermined threshold value is within a certain range.

[0014] This makes it possible to prevent an image that has been unnecessarily image-processed from being previewed even in cases where illumination light or the like is reflected over a wide range exceeding the above-mentioned certain range, where it is highly likely that the information code cannot be imaged so as to be readable in the first place.On the other hand, when illumination light or the like is reflected over a narrow range smaller than the above-mentioned certain range, where it is highly likely that the information code can be imaged so as to be readable without special image processing or the like, it makes it possible to prevent an image that has been unnecessarily image-processed from being previewed even in such cases.

[0015] The control unit may control the display unit so that the processed image enlarged according to the removed area is displayed on the display screen, thereby preventing the processed image displayed as a preview from becoming smaller due to the removed area becoming larger.

[0016] The control unit may control the display unit to display image-capturing position information indicating the position of the image-capturing window on the display screen when the reading process by the reading unit continues to fail. This makes it possible to clearly indicate to the user the position of the image-capturing window over which the information code should be held, thereby quickly resolving the situation in which the reading process continues to fail.

[0017] The control unit may control the display unit so that, when the reading process by the reading unit continues to fail and the code determination unit determines that the processed image contains a specific pattern, guidance information encouraging movement to a position where the information code can be read is displayed on the display screen based on the position of the specific pattern.

[0018] This makes it possible to prompt a user who has seen the guidance information to move to a position where the information code can be read, thereby quickly resolving the situation in which the reading process continues to fail.

[0019] When encouraging the subject to move to a position away from the imaging window where the information code can be read, the control unit may control the display unit to display, as the above-mentioned guidance information, a video on the display screen in which a semi-transparent object resembling an information code gradually shrinks and changes repeatedly.

[0020] This allows the user who sees the guidance information to intuitively understand that he or she is being prompted to move the information code to a position away from the display screen (that is, the imaging window).

[0021] When encouraging the user to move to a position closer to the imaging window where the information code can be read, the control unit may control the display unit to display, as the above-mentioned guidance information, a video on the display screen in which a semi-transparent object resembling an information code gradually expands and changes repeatedly.

[0022] This allows the user who sees the guidance information to intuitively understand that he or she is being prompted to move the information code to a position closer to the display screen (that is, the imaging window). [Brief description of the drawings]

[0023] [Figure 1] FIG. 2 is a perspective view showing a reading terminal according to the first embodiment. [Diagram 2] FIG. 2 is a plan view showing the reading terminal of FIG. [Diagram 3] FIG. 2 is a side view showing the reading terminal of FIG. [Figure 4] 2 is a front view of the reading terminal of FIG. 1 as viewed from the insertion port side. [Diagram 5] 2 is a block diagram illustrating a schematic electrical configuration of the reading terminal of FIG. 1. [Figure 6] 5 is a flowchart illustrating the flow of captured image display processing performed by the control unit in the first embodiment. [Figure 7] FIG. 7(A) is an explanatory diagram illustrating an captured image when there is a high-brightness area on the outer periphery, and FIG. 7(B) is an explanatory diagram illustrating a first processed image that has been image-processed to remove the lower edge side including the high-brightness area. [Figure 8] FIG. 8(A) is an explanatory diagram illustrating a display screen on which the first processed image of FIG. 7(B) is previewed, and FIG. 8(B) is an explanatory diagram illustrating a display screen in which the imaging position of the information code has been changed so that the entire code is reflected in the first processed image. [Figure 9] FIG. 9(A) is an explanatory diagram illustrating an image captured when there is a high-brightness area in the center, and FIG. 9(B) is an explanatory diagram illustrating a second processed image that has been image-processed to remove the outer periphery and leave the center. [Figure 10] FIG. 10(A) is an explanatory diagram illustrating a display screen on which a preview of the second processed image of FIG. 9(B) is displayed, and FIG. 10(B) is an explanatory diagram illustrating a display screen in which the imaging position of the information code has been changed so that the entire code is reflected in the second processed image. [Figure 11] FIG. 11(A) is an explanatory diagram illustrating the positional relationship between the preview display range and the imaging range when lighting or the like is reflected on the outer periphery of the imaging range, and FIG. 11(B) is an explanatory diagram illustrating the positional relationship between the preview display range and the imaging range when lighting or the like is reflected in the center of the imaging range. [Figure 12] 10 is a flowchart illustrating the flow of captured image display processing performed by a control unit in the second embodiment. [Figure 13] FIG. 11 is an explanatory diagram illustrating a display screen on which imaging position information is displayed. [Figure 14] FIG. 11 is an explanatory diagram illustrating a display screen that displays a preview when the QR code is held too close; [Figure 15] 13 is an explanatory diagram illustrating a display example in which a semi-transparent object resembling a QR code gradually shrinks, as guidance information to encourage a user to move to a position away from the imaging window. FIG. [Figure 16] FIG. 11 is an explanatory diagram illustrating a display screen that displays a preview when the QR code is held up at a distant position. [Figure 17] 13 is an explanatory diagram illustrating a display example in which a semi-transparent object resembling a QR code gradually expands as guidance information to encourage a user to move to a position closer to the imaging window. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0024] [First embodiment] Hereinafter, a first embodiment in which a stationary optical information reader according to the present invention is applied to a reading terminal will be described with reference to the drawings. The reading terminal 10 according to this embodiment is configured as a touch panel type payment information processing device that allows a user (purchaser) to select and use a number of payment methods, such as information code payment using optical reading of a payment information code (also called a payment code), contact IC card payment, contactless payment, magnetic card payment, etc. The reading terminal 10 is used by being connected to a POS terminal (not shown), which is a higher-level device, in a state where it is placed on a counter in a store so that the user can operate it by touch.

[0025] As shown in Figs. 1 to 4, the reading terminal 10 has a display screen 23a that also functions as an operation surface of a touch panel arranged on the upper surface 11a of a housing 11 that constitutes the outer hull of the reading terminal 10, a slot 12 for a magnetic card is provided at a position on the right side of the display screen 23a as seen from the user (the left side as seen from the store clerk), and an insertion port 13 for an IC card is provided at a position on the front side as seen from the user (one side in the longitudinal direction of the upper surface 11a formed in a substantially rectangular shape: the lower side in Fig. 2). In addition, an imaging window 24a of an imaging unit 24 is provided at a position on the upper surface 11a that is further back than the display screen 23a as seen from the user (the other side in the longitudinal direction of the upper surface 11a: the upper side in Fig. 2). The upper surface 11a of the housing 11 may correspond to an example of "one surface of the housing".

[0026] A control unit 21 that controls the entire reading terminal 10 is provided within the housing 11. This control unit 21 is mainly configured with a microcomputer and has a CPU, a system bus, an input / output interface, etc., and configures an information processing device together with a storage unit 22 consisting of a semiconductor memory, etc. Programs for executing various payment processes and programs for executing captured image display processing, which will be described later, etc. are stored in advance in the storage unit 22 so as to be executable by the control unit 21.

[0027] 5, the reading terminal 10 includes a display unit 23, an imaging unit 24, an operation unit 25, a notification unit 26, an external interface 27, a payment information reading unit 28, and the like, in addition to the control unit 21 and the storage unit 22 described above. The display unit 23 is configured as a known touch panel type display device, and includes a display means configured as a known display device such as a liquid crystal display, and a transparent operation panel that is superimposed on the display screen 23a of the display means and can detect the area of ​​the display screen 23a being pressed (contacted) as an operation surface. The display content of the display unit 23 is controlled by the control unit 21.

[0028] The imaging unit 24 is configured as a camera equipped with a light receiving sensor (for example, a C-MOS area sensor, a CCD area sensor, etc.), and is configured to be controlled by the control unit 21 and output captured image data captured through the imaging window 24a to the control unit 21. The imaging unit 24 is arranged in the housing 11 so that the imaging range is the outside through the imaging window 24a. In the control unit 21, an information code reading process is performed to optically read information recorded in the information code from the captured image of the information code by the imaging unit 24 capturing an image of the information code through the imaging window 24a by the imaging unit 24. In this embodiment, the imaging window 24a is provided at a position on the upper surface 11a that is deeper than the display screen 23a with respect to the user, but is not limited thereto, so that the imaging window 24a faces the same direction as the display screen 23a, for example, the imaging window 24a may be provided on the same plane as the display screen 23a near the display screen 23a with respect to another surface different from the upper surface 11a that is easily visible to the user. The control unit 21 and the imaging unit 24 that perform this information code reading process may correspond to an example of a "reading unit."

[0029] The operation unit 25 is configured to include the above-mentioned operation panel and one or more keys provided on a side or the like of the housing 11, and is configured to output signals to the control unit 21 in response to touch operations and key operations on the operation surface (display screen 23a) of the touch panel.

[0030] The notification unit 26 is equipped with a light-emitting unit such as an LED, a speaker, a buzzer, etc., and is configured to issue a predetermined notification according to the result of the payment process, etc., by controlling the light-emitting state of the light-emitting unit, the voice guidance of the speaker, the sounding state of the buzzer, etc., through control by the control unit 21.

[0031] The external interface 27 is configured as an interface for performing data communication with external devices such as a settlement server and a POS terminal, and functions to perform communication processing in cooperation with the control unit 21.

[0032] The payment information reading unit 28 includes a card reader for contact IC cards (hereinafter also referred to as IC card reader 28a), a card reader for magnetic cards (hereinafter also referred to as magnetic card reader 28b), and a contactless reading unit 28c for contactless payment.

[0033] The IC card reader 28a is configured to output payment information read from the IC chip of an IC card inserted into the slot 13 to a specified position to the control unit 21 via a card reading terminal connected to the external connection terminal of the IC card.

[0034] The magnetic card reader 28b is configured to output payment information read from a magnetic card swiped through the slot 12 to the control unit 21.

[0035] The contactless reading unit 28c has a near field communication (NFC) function, and is configured to use a contactless payment antenna (not shown) provided on the top surface 11a inside the housing 11 to output payment information read from a contactless communication medium for payment (a contactless IC card, a mobile terminal with contactless payment function, a medium for electronic money, etc.) held over the top surface 11a to the control unit 21.

[0036] In the reading terminal 10 configured in this manner, payment information is acquired after selecting one of the following: optical reading of the payment code by an information code reading process, reading from an IC card by IC card reader 28a, reading from a magnetic card by magnetic card reader 28b, or reading from a non-contact communication medium by non-contact reading unit 28c, and the control unit 21 performs payment processing using that payment information.

[0037] In this embodiment, in an information code reading process for reading information codes including not only payment codes but also barcodes and QR codes (registered trademark), a captured image display process is performed by the control unit 21 in order to clearly indicate to the user the position to hold the information code. In this captured image display process, at least a part of the captured image for capturing and reading the information code is previewed on the display screen 23a. In particular, in this embodiment, the preview display is adjusted (controlled) to suppress the influence of the surrounding environment, such as lighting, on the information code reading process.

[0038] The captured image display process performed by the control unit 21 will be described in detail below with reference to the flowchart shown in FIG. When a captured image display process is started by the control unit 21 in response to a predetermined operation or the like being performed on the operation unit 25, captured image data captured by the imaging unit 24 is acquired in a captured image acquisition process shown in step S101 of Fig. 6. Next, in a brightness measurement process shown in step S102, the brightness value of each pixel in the captured image acquired as described above is measured.

[0039] Next, in the determination process of step S103, it is determined whether or not the captured image has a high luminance area (hereinafter also referred to as high luminance area Sa) that requires adjustment of the preview display. In this embodiment, if the captured image has an area made up of pixels whose measured luminance is equal to or greater than a predetermined threshold value and the proportion of the area in the captured image is within a certain range, it is determined that the high luminance area Sa exists. Note that the control unit 21 that performs the determination process of step S103 above may correspond to an example of a "determination unit."

[0040] Here, when there is no area where the measured luminance is equal to or higher than the predetermined threshold because the ceiling lighting or the like is not reflected in the captured image, it is determined that there is no high-luminance area Sa that requires adjustment of the preview display. Also, even if there is an area where the measured luminance is equal to or higher than the predetermined threshold, if the area is so small that it has no possibility of affecting the reading process and the ratio in the captured image is smaller than the above-mentioned fixed range, it is also determined that there is no high-luminance area Sa that requires adjustment of the preview display. On the other hand, even if there is an area where the measured luminance is equal to or higher than the predetermined threshold, if the area is wide enough to exceed the above-mentioned fixed range, it is also determined that there is no high-luminance area Sa that requires adjustment of the preview display. In such a case, it is assumed that the lighting light or the like is reflected over a wide range, and even if the preview display is adjusted, it is highly likely that the information code cannot be captured in a readable manner. Note that when the ratio of the area where the measured luminance is equal to or higher than the predetermined threshold in the captured image exceeds the above-mentioned fixed range, in order to prevent the reflection of the lighting light or the like over a wide range by changing the placement location, orientation, etc. of the reading terminal 10, the user may be prompted to change the placement state by a predetermined notification or the like by the notification unit 26.

[0041] As described above, when it is determined that there is no high-luminance area Sa that requires adjustment of the preview display (No in S103), in the preview display process shown in step S108, the captured image obtained as described above is preview-displayed on the display screen 23a without removing a part thereof or the like. Then, when the reading of the information code has not been successful (No in S109), the process from the above step S101 is performed, and when the reading of the information code is successful (Yes in S109), this captured image display process ends.

[0042] On the other hand, when it is determined that there is a high-luminance area Sa that requires adjustment of the preview display (Yes in S103), in the determination process of step S104, it is determined whether or not the high-luminance area Sa is included in the central portion of the captured image.

[0043] Here, for example, as in the captured image P1 illustrated in FIG. 7A, when an information code 31 printed on a display medium 30 such as a card is captured and read, if the high brightness area Sa is included not in the center of the captured image P1 but in the outer periphery located on the outer periphery of the center (No in S104), a high brightness area removal process shown in step S105 is performed. In this process, image processing is performed to remove one edge side including the high brightness area Sa from the outer periphery of the captured image. Note that, for convenience, in FIG. 7A and FIG. 9 described later, the high brightness area Sa is illustrated with hatching, and the illumination part that goes around the display medium 30 is assigned the symbol Sb. In addition, in this embodiment, the center and the outer periphery in the captured image are set so that the area ratio is a predetermined value (for example, 1:1), but this is not limited thereto, and the area ratio, aspect ratio, etc. may be set according to the usage environment, etc., or may be changed each time according to the area occupied by the high brightness area Sa.

[0044] In the example of Fig. 7(A), a processed image (hereinafter also referred to as a first processed image Pc1) is generated by performing image processing so as to remove the lower edge side including the high luminance region Sa, as illustrated in Fig. 7(B). Then, in a preview display process shown in step S108, the first processed image Pc1 generated as described above is preview-displayed on the display screen 23a.

[0045] When the first processed image Pc1 is generated as illustrated in FIG. 7B, the first processed image Pc1 with the lower edge side including the high luminance area Sa removed is previewed on the display screen 23a as illustrated in FIG. 8A. In this embodiment, the display screen 23a except for the display area of ​​the first processed image Pc1 is a monochromatic display area Pm of dark colors (e.g., black), and in FIG. 8, the monochromatic display area Pm is cross-hatched for convenience. The display screen 23a except for the display area of ​​the first processed image Pc1 may not be an area where the monochromatic display area Pm or the like is displayed, but may be an area where other information different from the captured image is displayed, or may be an area where no display is performed temporarily.

[0046] As shown in Fig. 8(A), when the first processed image Pc1 is previewed so that only a part of the information code 31 is reflected, the user tries to hold the information code 31 so that it is within the first processed image Pc1 previewed. Therefore, as shown in Fig. 8(B), the imaging position of the information code 31 is changed so that the entire information code 31 is reflected within the first processed image Pc1. As a result, the information code 31 and the high brightness area Sa are separated in the captured image, so that there is no risk of reading failure due to lighting or the like overlapping with the information code 31.

[0047] On the other hand, for example, as in the captured image P2 illustrated in Fig. 9A, if the high luminance area Sa is included in the center of the captured image (Yes in S104), an outer periphery removal process is performed as shown in step S106. In this process, image processing is performed such that the outer periphery of the captured image P2 is removed and the center is left.

[0048] In the example of Fig. 9(A), a processed image (hereinafter also referred to as a second processed image Pc2) is generated by image processing such that the peripheral portion of the captured image P2 is removed and the central portion is left as shown in Fig. 9(B). Then, when an image enlargement process is performed to enlarge the second processed image Pc2 according to the removed area (S107), the second processed image Pc2 enlarged as described above is previewed on the display screen 23a in a preview display process shown in step S108.

[0049] When the second processed image Pc2 is enlarged and generated as shown in FIG. 9(B), the enlarged second processed image Pc2 is previewed on the display screen 23a as shown in FIG. 10(A).

[0050] As shown in Fig. 10(A), when the information code 31 is previewed so that only a part of it is reflected in the second processed image Pc2, the user tries to hold the information code 31 so that it is within the previewed second processed image Pc2. Therefore, as shown in Fig. 10(B), the imaging position of the information code 31 is changed so that the entire information code 31 is reflected within the second processed image Pc2. As a result, the display medium 30 on which the information code 31 is printed blocks the illumination or the like that causes the high luminance area Sa, and reading does not fail due to the illumination or the like overlapping with the information code 31.

[0051] That is, if lighting or the like is reflected in the outer periphery of the imaging range (reading range) E1, the outer periphery is excluded from the preview display as shown in Fig. 11(A), and if lighting or the like is reflected in the center of the imaging range E1, the center is enlarged and displayed in a preview as shown in Fig. 11(B). As can be seen from Figs. 11(A) and (B), the preview display range E2 changes depending on the area where lighting or the like is reflected, but the imaging range (reading range) E1 does not change.

[0052] As described above, in the reading terminal 10 according to the present embodiment, the information code 31 held by the user is imaged by the imaging unit 24 through the imaging window 24a provided together with the display screen 23a on the top surface 11a of the housing 11. Then, when a high-luminance area Sa is included in the outer periphery of a captured image determined to have a high-luminance area Sa having a luminance equal to or greater than a predetermined threshold, the display unit 23 is controlled so that a first processed image Pc1 obtained by image processing to remove the high-luminance area Sa from the captured image is displayed on the display screen 23a.

[0053] As a result, if there is an area where ceiling lighting or the like is reflected in the outer periphery of the captured image, a first processed image Pc1 that has been image-processed to remove that area as a high-brightness area Sa is previewed on the display screen 23a. The user attempts to hold the information code 31 so that it is within the first processed image Pc1 previewed, and therefore the information code 31 in the captured image can be separated from the high-brightness area Sa. Therefore, it is possible to realize a reading terminal 10 that can easily capture an image of an information code so that it can be read, without being affected by the surrounding environment such as lighting.

[0054] Then, when a high-brightness area Sa is contained in the center of an captured image in which it is determined that the captured image has a high-brightness area Sa whose brightness is equal to or greater than a predetermined threshold value, the display unit 23 is controlled so that a second processed image Pc2, which has been image-processed to remove the outer periphery located on the outer side of the central area from the captured image, is displayed on the display screen 23a.

[0055] As a result, if there is an area where the ceiling lighting or the like is reflected in the center of the captured image, a second processed image Pc2 that has been image-processed to remove the outer peripheral portion located on the outer periphery side of the center is previewed on the display screen 23a. The user tries to hold the information code 31 so that it is within the previewed second processed image Pc2, so that the display medium 30 itself on which the information code 31 is displayed or the like blocks the lighting or the like, and in this state, it becomes difficult to capture the high brightness area Sa. In other words, the user can be prompted to hold the display medium 30 of the information code 31 so as to block the lighting or the like.

[0056] In particular, in the determination process of step S103, if the ratio of areas in the captured image where the luminance is equal to or greater than a predetermined threshold value is within a certain range, it is determined that a high luminance area Sa exists.

[0057] This makes it possible to prevent an image that has been unnecessarily image-processed from being previewed even in cases where illumination light or the like is reflected over a wide range exceeding the above-mentioned certain range, where it is highly likely that the information code cannot be imaged so as to be readable in the first place.On the other hand, when illumination light or the like is reflected over a narrow range smaller than the above-mentioned certain range, where it is highly likely that the information code can be imaged so as to be readable without special image processing or the like, it makes it possible to prevent an image that has been unnecessarily image-processed from being previewed even in such cases.

[0058] In addition, in the captured image display process performed by the control unit 21, when a second processed image Pc2 is generated by performing image processing so as to remove the peripheral portion of the captured image P2 and leave the central portion, the second processed image Pc2 is enlarged according to the removed area (S107) and displayed on the display screen 23a (S108). This prevents the previewed second processed image Pc2 from becoming small due to the large removed area. Note that in the high brightness area removal process (S105), the peripheral portion of the captured image may be removed in an L-shape so as to include the high brightness area Sa, and the first processed image Pc1 enlarged according to the removed area may be displayed on the display screen 23a.

[0059] [Second embodiment] Next, a second embodiment in which a stationary information code reader according to the present invention is applied to a reading terminal will be described with reference to the drawings. The second embodiment is different from the first embodiment in that imaging position information or guidance information is displayed when the reading process continues to fail. Therefore, the same components as those in the first embodiment are denoted by the same reference numerals and the description thereof is omitted.

[0060] In the captured image display process in this embodiment, a guidance display mode is provided to more specifically indicate to the user the position where the information code should be held during the information code reading process. The guidance display mode is a mode that is switched to when a reading failure state in which the reading process has failed continues for a certain period of time, and when the guidance display mode is switched to, a process is performed to display imaging position information indicating the position of the imaging window 24a and guidance information that encourages the user to move to a position where the information code can be read.

[0061] Hereinafter, the captured image display process performed by the control unit 21 in this embodiment will be described in detail with reference to the flowchart shown in Fig. 12. Note that in this embodiment, a case where a QR code 40 having three-corner position detection patterns (finder patterns) 41 as a specific pattern is read will be described as an example.

[0062] In the state where the preview is displayed as described above (S108 in FIG. 12), if reading has failed (No in S109), a determination is made in step S201 as to whether or not the mode has been switched to the guidance display mode. If the mode has not been switched to the guidance display mode (No in S201), a determination is made in step S202 as to whether or not the reading failure state has continued for a certain period of time (e.g., 5 s). If the reading failure state has not continued for the certain period of time (No in S202), the processing from step S101 is performed. On the other hand, if the reading failure state has continued for the certain period of time (Yes in S202), the mode is switched to the guidance display mode described above (S203).

[0063] As described above, if the reading failure state continues for a certain period of time and the guidance display mode is to be switched to, or if the reading has failed (No in S109) and the guidance display mode has already been switched to (Yes in S201), a determination is made in step S204 as to whether or not the QR code 40 is in a code display state in which at least a portion of the QR code 40 is included in the preview image.

[0064] In this determination process, if the previewed image is a captured image, it is determined that the captured image is in the code display state if at least one of the position detection patterns 41 of the QR code 40 is included in the captured image. Also, if the previewed image is a processed image (first processed image Pc1 or second processed image Pc2), it is determined that the code display state is included if at least one of the position detection patterns 41 of the QR code 40 is included in the processed image. Note that the control unit 21 that performs the determination process in step S204 above may correspond to an example of a "code determination unit" that determines whether or not the processed image includes a specific pattern of an information code.

[0065] Here, if the previewed image does not include the position detection pattern 41 of the QR code 40, it is determined that the code display state is not in progress (No in S204), and an imaging position information display process shown in step S205 is performed. In this process, imaging position information D1 indicating the position of the imaging window 24a is displayed on the display screen 23a for a user who does not know the position of the imaging window 24a. Specifically, for example, as illustrated in FIG. 13, the imaging position information D1 is displayed on the image previewed on the display screen 23a, with an arrow indicating the position of the imaging window 24a. Thereafter, the process from step S101 is performed. By displaying the imaging position information D1 in this manner, the position of the imaging window 24a can be clearly indicated to the user. Note that in FIG. 13, for convenience, illustration of screen display portions other than the imaging position information D1 is omitted.

[0066] On the other hand, if at least one position detection pattern 41 of the QR code 40 is included in the previewed image, it is determined that the code is displayed (Yes in S204). Even in this case, if the QR code 40 has not been read successfully (No in S206), a guidance information display process is performed as shown in step S207. In this process, guidance information that encourages the user to move to a position where the QR code 40 can be read, based on the position of the position detection pattern 41 in the captured image (or processed image), is displayed on the image previewed on the display screen 23a.

[0067] 14, when one position detection pattern 41 is previewed together with many light and dark cells, it is determined that the QR code 40 is held too close to the imaging window 24a. In such a case, guidance information D2a is displayed to encourage the user to move to a position away from the imaging window 24a where the QR code 40 can be read.

[0068] In this embodiment, as can be seen from Fig. 15(A) to (C), the guidance information D2a is displayed on the display screen 23a as an animated moving image in which a semi-transparent body imitating a general QR code gradually shrinks and repeats the change. Furthermore, as the guidance information D2a, text information such as "You are holding the device too close" and "Please move it away from the terminal" is displayed on the display screen 23a. Note that in Fig. 15, for convenience, the QR code 40 is simply illustrated by a two-dot chain line.

[0069] This allows the user who sees the guidance information D2a to intuitively understand that he or she is being prompted to move the QR code 40 to a position away from the display screen 23a (i.e., the imaging window 24a). Considering the possibility that the display screen 23a may be hidden by the display medium on which the QR code 40 is displayed, the notification unit 26 may further issue a voice notification such as "Please move away from the terminal."

[0070] 16, when the QR code 40 is previewed with the distance between the position detection patterns 41 being close, it is determined that the QR code 40 is held far from the imaging window 24a. In such a case, guidance information D2b is displayed to encourage the user to move to a position closer to the imaging window 24a where the QR code 40 can be read.

[0071] In this embodiment, as can be seen from Fig. 17(A) to (C), the guidance information D2b is displayed on the display screen 23a as an animated video in which a semi-transparent body imitating a general QR code gradually expands and repeats the change. Furthermore, as the guidance information D2b, text information such as "You are holding the device too far away" and "Please move closer to the terminal" is displayed on the display screen 23a. Note that in Fig. 17, for convenience, the QR code 40 is simply illustrated by a two-dot chain line.

[0072] This allows the user who sees the guidance information D2b to intuitively understand that he or she is being prompted to move the QR code 40 to a position closer to the display screen 23a (that is, the imaging window 24a).

[0073] Also, for example, when the two position detection patterns 41 are previewed so as to be spaced apart by a predetermined distance or more, it is determined that the QR code 40 is held in a misaligned direction along the display screen 23a relative to the imaging window 24a. In such a case, guidance information is displayed on the display screen 23a to encourage movement in a direction so that the center position of the QR code 40 determined from both position detection patterns 41, etc., coincides with the center position of the display screen 23a.

[0074] When reading a type of information code other than a QR code, such as a data matrix code or a maxicode, the code display status can be determined and guidance information can be displayed based on a specific pattern arranged in the four corners of the information code.

[0075] As described above, in the reading terminal 10 according to the present embodiment, in the captured image display process performed by the control unit 21, when the state in which the reading process fails continues and the code display state is not in effect, the imaging position information D1 indicating the position of the imaging window 24a is displayed on the display screen 23a (S205). This makes it possible to clearly indicate to the user the position of the imaging window 24a over which the information code should be held, and therefore makes it possible to quickly resolve the state in which the reading process continues to fail. Note that even when it is determined that the code display state is in effect, the imaging position information D1 indicating the position of the imaging window 24a may be displayed on the display screen 23a.

[0076] In addition, in the captured image display process performed by the control unit 21, if it is determined that the reading process continues to fail and the code display state is active, guidance information encouraging movement to a position where the information code can be read is displayed on the display screen 23a based on the position of the specific pattern.

[0077] This makes it possible to prompt a user who has seen the guidance information to move to a position where the information code can be read, thereby quickly resolving the situation in which the reading process continues to fail.

[0078] In particular, when encouraging the user to move to a position away from the imaging window 24a where the information code can be read, a video of a semi-transparent object resembling an information code gradually shrinking and repeating this change is displayed on the display screen 23a as guidance information D2a.

[0079] This allows the user who sees the guidance information D2a to intuitively understand that he or she is being prompted to move the information code to a position away from the display screen 23a (that is, the imaging window 24a).

[0080] Furthermore, when encouraging the user to move to a position closer to the imaging window 24a where the information code can be read, a video of a semi-transparent body resembling an information code gradually expanding and repeating this change is displayed on the display screen 23a as guide information D2b.

[0081] This allows the user who sees the guidance information D2b to intuitively understand that he or she is being prompted to move the information code to a position closer to the display screen 23a (that is, the imaging window 24a).

[0082] The present invention is not limited to the above-described embodiments, and may be embodied as follows, for example. (1) The present invention is not limited to application to stationary reading terminals capable of reading various payment information, but may also be applied to stationary reading terminals capable of optically reading information codes, etc., without having a payment function. In addition, the present invention is not limited to application to stationary reading terminals of the touch panel type, but may also be applied to stationary reading terminals having a known display device other than a touch panel.

[0083] (2) The information code to be read in the present invention is not limited to being printed on a display medium 30 such as a card, and may be displayed on the screen of a mobile terminal, for example. [Explanation of symbols]

[0084] 10 Reading terminal (optical information reading device) 11. Cabinet 11a Top surface (one side) 21 Control unit (reading unit, judgment unit, code judgment unit) 23 Display section 23a Display screen 24 Imaging unit (reading unit) 24a Imaging window 30 Display media 31 Information Code 40 QR Code (Information Code) 41 Position detection pattern (specific pattern) D1 Imaging location information D2a, D2b Guide Information Pc1 First processed image Pc2 Second processed image Sa High luminance area

Claims

1. A stationary optical information reading device that optically reads an information code held up by a user, comprising: A housing and A display unit having a display screen on one surface of the housing; an imaging unit that captures an image through an imaging window provided on the one surface; a reading unit that performs a reading process for reading information recorded in the information code from an image of the information code captured by the imaging unit; a control unit capable of controlling the display unit so that at least a part of an image captured by the imaging unit is displayed on the display screen; a determination unit that determines whether or not the captured image includes a high-luminance area having a luminance equal to or greater than a predetermined threshold; Equipped with The control unit controls the display unit so that, when a high-brightness area is included in the outer periphery of the captured image in which the determination unit has determined that the high-brightness area is included, a processed image that has been image-processed to remove the high-brightness area from the captured image is displayed on the display screen.

2. The optical information reading device according to claim 1, characterized in that, when the high-brightness area is included in the central part of the captured image in which the determination unit has determined that the high-brightness area is included, the control unit controls the display unit so that a processed image that has been image-processed to remove the outer periphery located on the outer side of the central part from the captured image is displayed on the display screen.

3. A stationary optical information reading device that optically reads an information code held up by a user, comprising: A housing and A display unit having a display screen on one surface of the housing; an imaging unit that captures an image through an imaging window provided on the one surface; a reading unit that performs a reading process for reading information recorded in the information code from an image of the information code captured by the imaging unit; a control unit capable of controlling the display unit so that at least a part of an image captured by the imaging unit is displayed on the display screen; a determination unit that determines whether or not the captured image includes a high-luminance area having a luminance equal to or greater than a predetermined threshold; Equipped with The control unit controls the display unit so that when a high-brightness area is included in the central portion of the captured image in which the determination unit has determined that the high-brightness area is present, a processed image that has been image-processed to remove from the captured image an outer periphery located on the outer side of the central portion is displayed on the display screen.

4. The optical information reading device according to claim 1 or 3, characterized in that the determination unit determines that the high-brightness area is present when a ratio of areas in the captured image whose brightness is equal to or greater than the predetermined threshold value is within a certain range.

5. 4. The optical information reading device according to claim 1, wherein the control unit controls the display unit so that the processed image enlarged in accordance with the removed area is displayed on the display screen.

6. The optical information reading device according to claim 1 or 3, characterized in that the control unit controls the display unit so that imaging position information indicating the position of the imaging window is displayed on the display screen when the reading process by the reading unit continues to fail.

7. a code determination unit that determines whether or not a specific pattern of an information code is included in the processed image; The optical information reading device according to claim 1 or 3, characterized in that, when the reading process by the reading unit continues to fail and the code determination unit determines that the specific pattern is included in the processed image, the control unit controls the display unit so that guidance information encouraging movement to a position where the information code can be read is displayed on the display screen based on the position of the specific pattern.

8. The optical information reading device of claim 7, characterized in that when encouraging movement to a position away from the imaging window where the information code can be read, the control unit controls the display unit so that a video of a semi-transparent object resembling an information code gradually shrinking and repeatedly changing is displayed on the display screen as the guidance information.

9. The optical information reading device described in claim 7, characterized in that when encouraging movement to a position closer to the imaging window where the information code can be read, the control unit controls the display unit so that a video of a semi-transparent object resembling an information code that gradually expands and repeats this change is displayed on the display screen as the guidance information.

Images