Information code reading system

Abstract

To provide a configuration in which an information code can be adjusted to a display state in which it can be easily read, without any manual operation of a user.SOLUTION: On the presumption that an installed type settlement apparatus 10 reads a settlement code C1 displayed on a screen of a portable terminal 40, information of an adjustment reference pattern P1 captured by a front camera 54 when the settlement code C1 displayed on a display screen 53a is captured so as to be able to be read by an imaging unit 24 is stored in a storage unit 52 as display adjustment information. In information code display processing carried out by a control unit 51, based on an image capturing result of the front camera 54 and the display adjustment information of the storage unit 52, adjustment processing for adjusting at least either of a position of the settlement code C1 on the display screen 53a and its size is carried out so that the settlement code C1 displayed on the display screen 53a is captured so as to be able to be read by the imaging unit 24.SELECTED DRAWING: Figure 8

Description

Technical Field

[0001] The present invention relates to an information code reading system for optically reading an information code.

Background Art

[0002] Conventionally, when causing a reading device or the like to read an information code displayed on a mobile terminal or the like, in order to clearly indicate to the user the position where the information code should be held up, a captured image for capturing and reading the information code is preview-displayed on the display screen of the reading device or the like. For example, in the display device disclosed in Patent Document 1 below, at a barcode display unit provided on the display screen, a barcode information display area for displaying barcode information and an interface display area for displaying an interface for adjusting the display state of the barcode information are displayed. Then, when reading the barcode information displayed on the display screen with a barcode reader or the like, the user himself / herself adjusts the display state by selecting an interface in the interface display area, thereby realizing good reading of barcode information.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] By the way, in payments using information codes and the like, the opportunity to read barcodes, QR codes (registered trademarks), etc. displayed on the screen of a mobile terminal with a reading device such as a settlement device installed in a store is increasing. Also, the opportunity to read an information code displayed on the screen of a display device such as a settlement device installed in a store with a mobile terminal is also increasing.

[0005] On the other hand, when causing a store reader device to read an information code displayed on a mobile terminal, inexperienced users may have trouble reading it because they cannot accurately grasp the position where the mobile terminal should be held with respect to the reader device. The same problem may occur when causing a mobile terminal to read an information code displayed on a display device in a store. In a configuration where the user operates to adjust the display of the information code, such as the display device disclosed in Patent Document 1 above, inexperienced users also have trouble with the operation.

[0006] The present invention has been made to solve the above-described problems, and an object thereof is to provide a configuration that can adjust an information code to a display state that is easy to read without manual operation by the user.

Means for Solving the Problems

[0007] To achieve the above object, one aspect of the present invention is a portable display terminal (40) on which an information code (C1) is displayed on a screen, a stationary reading device (10) that reads the information code, and an information code reading system (1) including wherein the reading device includes a device-side imaging unit (24) that images the information code, and a reading unit (21) that reads information recorded in the information code imaged by the device-side imaging unit, and the display terminal includes a terminal-side display unit (53) for displaying the information code on a terminal-side display screen (53a), a terminal-side imaging unit (54) having an imaging direction in which the terminal-side display screen faces, and a terminal-side control unit (51) that controls the display content by the terminal-side display unit. When the information code displayed on the terminal-side display screen is imaged so as to be readable by the device-side imaging unit, information on at least a specific part (P1) corresponding to at least a part of the reading device imaged by the terminal-side imaging unit is stored as display adjustment information in a terminal-side storage unit (52). comprising Based on the imaging result of the terminal-side imaging unit and the display adjustment information in the terminal-side storage unit, the terminal-side control unit performs an adjustment process of adjusting at least one of the position and size of the information code on the terminal-side display screen so that the information code displayed on the terminal-side display screen is imaged so as to be readable by the device-side imaging unit.

[0008] Another aspect of the present invention is A stationary display device (10) on which an information code (C2) is displayed on a screen A portable reading terminal (40) for reading the information code An information code reading system (1a) comprising The reading terminal includes A terminal-side imaging unit (54) for imaging the information code A reading unit (51) for reading information recorded in the information code imaged by the terminal-side imaging unit comprising The display device includes A device-side display unit (23) for displaying the information code on a device-side display screen (23a) A device-side imaging unit (24) having an imaging direction toward the direction in which the device-side display screen faces A device-side control unit (21) for controlling the display content by the device-side display unit When the information code displayed on the device-side display screen is imaged so as to be readable by the terminal-side imaging unit, information on at least a specific part corresponding to at least a part of the reading terminal imaged by the device-side imaging unit is stored as display adjustment information in a device-side storage unit (22). comprising The device-side control unit performs adjustment processing for adjusting at least one of the position and size of the information code on the device-side display screen so that the information code displayed on the device-side display screen is imaged so as to be readable by the terminal-side imaging unit based on the imaging result of the device-side imaging unit and the display adjustment information in the device-side storage unit. Note that the reference numerals in each of the above parentheses indicate the correspondence with the specific means described in the embodiments described later.

Advantages of the Invention

[0009] In the present invention, on the premise that an information code displayed on a portable display terminal is read by a stationary reading device, when the information code displayed on the terminal-side display screen is imaged so as to be readable by the device-side imaging unit, information on at least a part of the specific part corresponding to the reading device imaged by the terminal-side imaging unit is stored in the terminal-side storage unit as display adjustment information. Then, the terminal-side control unit performs adjustment processing for adjusting at least one of the position and size of the information code on the terminal-side display screen so that the information code displayed on the terminal-side display screen is imaged so as to be readable by the device-side imaging unit based on the imaging result of the terminal-side imaging unit and the display adjustment information in the terminal-side storage unit.

[0010] Thereby, it becomes easier to adjust the display state of the information code so that it is suitable for reading by the reading device only by the user facing the information code displayed on the display terminal toward the reading device. Therefore, the display state of the information code can be adjusted to a state where it is easy to read without the user performing a manual operation.

[0011] The specific part is a rectangular area that is a single color on the device-side display screen provided in the reading device, and the display adjustment information may be information on the position occupied by the rectangular area in the captured image. Thereby, since the position and size of the specific part serving as a reference for the adjustment processing in the captured image can be grasped more clearly, the display state of the information code can be adjusted more appropriately.

[0012] The specific part is a rectangular area where the area other than the specific pattern on the device-side display screen provided in the reading device is a single color, and the display adjustment information may be information on the position occupied by the imaging image of the rectangular area. As a result, after grasping the presence or absence of imaging of the specific part by the specific pattern, it is possible to more clearly grasp the position and size of the specific part in the imaging image that is the reference for the adjustment process, so that the display state of the information code can be adjusted more appropriately.

[0013] When the imaging result of the terminal-side imaging unit includes a high-brightness area, the terminal-side control unit may perform adjustment processing so as to avoid a corresponding range according to the range occupied by the imaging image of the high-brightness area. As a result, the corresponding range according to the range occupied by the imaging image of the high-brightness area is estimated as the range on the terminal-side display screen irradiated after strong external disturbance light or the like that causes the high-brightness area is reflected by the reading device, and the information code is displayed so as to avoid the corresponding range. For this reason, even when external disturbance light or the like reflected by the reading device irradiates the terminal-side display screen, the display state of the information code can be adjusted so as to avoid the irradiation range.

[0014] The terminal-side control unit may adjust the brightness of the terminal-side display screen based on the ambient brightness obtained from the imaging result of the terminal-side imaging unit. As a result, when the surroundings are too dark, the brightness of the terminal-side display screen can be adjusted brighter so that the information code displayed on the screen can be imaged readably, and when the surroundings are too bright, the brightness of the terminal-side display screen can be adjusted darker so that the information code displayed on the screen can be imaged readably. In this way, by adjusting the brightness of the terminal-side display screen according to the ambient brightness, the display state of the information code can be adjusted more appropriately.

[0015] The terminal-side control unit may perform adjustment processing after the determination unit determines that the display terminal is in a stationary state. As a result, it is possible to suppress the display state of the information code from being adjusted unnecessarily while the display terminal is held over the reading device.

[0016] In the present invention, on the premise that an information code displayed on a stationary display device is read by a portable reading terminal, when the information code displayed on the device-side display screen is imaged so as to be readable by the terminal-side imaging unit, information on at least a specific part corresponding to at least a part of the reading terminal imaged by the device-side imaging unit is stored in the device-side storage unit as display adjustment information. Then, based on the imaging result of the device-side imaging unit and the display adjustment information in the device-side storage unit, the device-side control unit performs an adjustment process of adjusting at least one of the position and size of the information code on the device-side display screen so that the information code displayed on the device-side display screen is imaged to be readable by the terminal-side imaging unit.

[0017] Thereby, just by the user aiming the reading terminal at the information code displayed on the display device, the display state of the information code is easily adjusted to be suitable for reading by the reading terminal. Therefore, the information code can be adjusted to a display state that is easy to read without the user performing a manual operation.

[0018] The information on the specific part stored in the device-side storage unit as display adjustment information may be information on a rectangular area with a predetermined aspect ratio located at the center of the captured image. Since a portable reading terminal is usually imaged as a rectangular object, from the comparison results of the position and size of the rectangular object in the actual captured image on the display device and the rectangular area at the center of the captured image that is the reference for the adjustment process, the relative position of the rectangular object with respect to the display device, that is, the relative position of the reading terminal can be estimated. For this reason, based on the imaging result of the device-side imaging unit and the display adjustment information in the device-side storage unit, an adjustment process can be performed so that the information code displayed on the device-side display screen is imaged to be readable by the terminal-side imaging unit.

[0019] When the imaging result of the device-side imaging unit includes a high-brightness area, the device-side control unit may perform adjustment processing to avoid a corresponding range according to the range occupied by the high-brightness area in the captured image of the high-brightness area. Thereby, the corresponding range according to the position occupied by the captured image of the high-brightness area is estimated as the range on the device-side display screen irradiated after strong external disturbance light or the like that causes the high-brightness area is reflected by the reading terminal, and the information code is displayed so as to avoid the corresponding range. For this reason, even when external disturbance light or the like reflected by the reading terminal irradiates the device-side display screen, the display state of the information code can be adjusted so as to avoid the irradiation range.

[0020] The device-side control unit may adjust the brightness of the device-side display screen based on the ambient brightness obtained from the imaging result of the device-side imaging unit. Thereby, when the surroundings are too dark, the brightness of the device-side display screen can be adjusted brighter so that the information code displayed on the screen can be imaged readably, and when the surroundings are too bright, the brightness of the device-side display screen can be adjusted darker so that the information code displayed on the screen can be imaged readably. In this way, by adjusting the brightness of the device-side display screen according to the ambient brightness, the display state of the information code can be adjusted more appropriately.

[0021] The device-side control unit may perform adjustment processing after the determination unit determines that the reading terminal is in a stationary state. Thereby, it is possible to suppress the display state of the information code from being adjusted unnecessarily while the reading terminal is being directed toward the display device.

Brief Description of the Drawings

[0022]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Figure 22

Figure 23

Figure 24

DETAILED DESCRIPTION OF THE INVENTION

[0023] [First Embodiment] Hereinafter, a first embodiment in which an information code reading system according to the present invention is embodied will be described with reference to the drawings. The information code reading system 1 according to the present embodiment is configured as a system that causes a stationary reading device to read an information code displayed on the screen of a portable display terminal. In the present embodiment, as shown in FIG. 1, a settlement device 10 is adopted as the stationary reading device, and this settlement device 10 targets for reading a settlement information code (hereinafter also referred to as a settlement code C1) displayed on the screen of a portable terminal 40 adopted as the portable display terminal.

[0024] The settlement device 10 according to the present embodiment is configured as a touch panel type settlement information processing device that allows a user (purchaser) to select and use a plurality of settlement methods such as information code settlement using optical reading of the settlement code C1, contact IC card settlement, non-contact settlement, and magnetic card settlement. The settlement device 10 is used while being connected to a POS terminal (not shown) serving as a host device in a state where it is placed on a store counter so that a user can perform a touch operation.

[0025] As shown in FIGS. 1 and 2, the settlement device 10 has a display screen 23a that also functions as an operation surface of a touch panel disposed on the upper surface 11a of a housing 11 that constitutes its outer shell. A slot 12 for a magnetic card is provided at a position on the right side as viewed from the user (left side as viewed from the store clerk) with respect to this display screen 23a, and an insertion port 13 for an IC card is provided at a position on the front side as viewed from the user (one side in the longitudinal direction of the upper surface 11a formed in a substantially rectangular shape: the lower side in FIG. 2). Further, an imaging window 24a of the imaging unit 24 is provided at a position on the back side of the upper surface 11a with respect to the user relative to the display screen 23a (the other side in the longitudinal direction of the upper surface 11a: the upper side in FIG. 2).

[0026] Inside the housing 11, a control unit 21 that controls the entire payment device 10 is provided. This control unit 21 is mainly composed of a microcomputer, has a CPU, a system bus, an input / output interface, etc., and constitutes an information processing device together with a storage unit 22 composed of a semiconductor memory or the like. In the storage unit 22, programs for executing various payment processes and programs for executing imaging image display processes described later are pre-stored so as to be executable by the control unit 21.

[0027] Also, as shown in FIG. 3, in addition to the above-described control unit 21 and storage unit 22, the payment device 10 includes a display unit 23, an imaging unit 24, an operation unit 25, a notification unit 26, an external interface 27, a payment information reading unit 28, and the like. The display unit 23 is configured as a known touch panel type display device, and includes a display means configured as a known display device such as a liquid crystal display, and a transparent operation panel that can detect a range in which a pressing operation (contact) is made on the display screen 23a of the display means and overlaps the display screen 23a as an operation surface. The display content of this display unit 23 is controlled by the control unit 21.

[0028] The imaging unit 24 is configured as a camera including a light receiving sensor (e.g., a C-MOS area sensor, a CCD area sensor, etc.), and is configured to be controlled by the control unit 21 to output imaging image data captured through the imaging window 24a to the control unit 21. This imaging unit 24 is disposed in the housing 11 so that the outside through the imaging window 24a is the imaging range. In the control unit 21, when an information code such as the settlement code C1 is imaged through the imaging window 24a by the imaging unit 24, an information code reading process for optically reading the information recorded in the information code from the captured image of the information code is performed. In the present embodiment, the imaging window 24a is provided at a position on the upper surface 11a that is deeper than the display screen 23a with respect to the user. However, the present invention is not limited to this, and for example, the imaging window 24a and the display screen 23a may be provided on the same surface in the vicinity of the display screen 23a on another surface that is different from the upper surface 11a and is easy for the user to visually recognize and faces the same direction as the display screen 23a. Note that the imaging unit 24 corresponds to an example of the "device-side imaging unit", and the control unit 21 that performs the information code reading process may correspond to an example of a "reading unit" that reads the information recorded in the imaged information code.

[0029] The operation unit 25 is configured to include the operation panel and one or more keys provided on the side surface of the housing 11 or the like, and is configured to output a signal corresponding to a touch operation or a key operation on the operation surface (display screen 23a) of the touch panel to the control unit 21.

[0030] The notification unit 26 includes a light emitting unit such as an LED, a speaker, a buzzer, etc., and is configured to perform a predetermined notification according to the result of the settlement process or the like by controlling the light emission state of the light emitting unit, the voice guidance of the speaker, the ringing state of the buzzer, etc. under the control of the control unit 21.

[0031] The external interface 27 is configured as an interface for performing data communication with external devices such as a settlement server and a POS terminal, and functions to perform communication processing in cooperation with the control unit 21.

[0032] The payment information reading unit 28 includes a card reader for a contact IC card (hereinafter also referred to as the IC card reader 28a), a card reader for a magnetic card (hereinafter also referred to as the magnetic card reader 28b), and a non-contact reading unit 28c for non-contact payment.

[0033] The IC card reader 28a is configured to output payment information read from the IC chip of the IC card to the control unit 21 via a card reading terminal that connects to the external connection terminals of the IC card inserted from the insertion port 13 to a specified position.

[0034] The magnetic card reader 28b is configured to output payment information read from the magnetic card swiped through the slot 12 to the control unit 21.

[0035] The non-contact reading unit 28c has a near-field wireless communication (NFC) function or the like, and uses a non-contact payment antenna (not shown) provided on the upper surface 11a side inside the housing 11 to read payment information from a non-contact communication medium for payment (such as a non-contact IC card, a mobile terminal having a non-contact payment function, a medium for electronic money, etc.) held above the upper surface 11a, and is configured to output the payment information to the control unit 21.

[0036] In the payment device 10 configured in this way, after the payment information is acquired by selecting any one of the optical reading of the payment code C1 by the information code reading process, the reading from the IC card by the IC card reader 28a, the reading from the magnetic card by the magnetic card reader 28b, and the reading from the non-contact communication medium by the non-contact reading unit 28c, the payment process using the payment information is performed by the control unit 21.

[0037] Next, a mobile terminal 40 on which an information code such as the payment code C1 is displayed on the screen will be described with reference to the drawings. The mobile terminal 40 according to this embodiment is a portable information processing terminal such as a smartphone held by a user, and is configured by installing an application program (hereinafter also referred to as a code settlement application) for adjusting the display state of the settlement code C1 when performing information code settlement using the settlement code C1.

[0038] As shown in FIGS. 1 and 4, the housing 41 constituting the outer shell of the mobile terminal 40 is substantially thin plate-shaped and is formed to be substantially rectangular when viewed from the front. A touch panel type display screen 53a enlarged so as to have a narrow bezel is arranged on the surface 42 thereof. In addition, a front camera 54 having the imaging direction in which the display screen 53a faces is arranged in the vicinity of the display screen 53a. Further, a rear camera 55 is arranged on the back surface 43 of the housing 41. Note that FIG. 4 illustrates a state in which the settlement code C1 is displayed on the display screen 53a in a reference state.

[0039] As shown in FIG. 5, the mobile terminal 40 includes a control unit 51 composed of a CPU or the like, a storage unit 52 composed of a ROM, a RAM, a non-volatile memory, etc., a display unit 53 having a touch panel type display screen 53a, a front camera 54 and a rear camera 55, an operation unit 56 that outputs a signal corresponding to a touch operation on the touch panel (display screen 53a) and an operation on various operation keys to the control unit 51, a notification unit 57 having an LED, a speaker, a buzzer, a vibrator, etc., a G sensor 58, and a communication unit 59 configured as a communication interface capable of wireless communication with an external device such as a settlement server.

[0040] The G-sensor 58 is a three-axis acceleration sensor (three-axis motion sensor) capable of detecting acceleration in three axial directions, and functions as an attitude detection unit for detecting the attitude of the housing 41. This G-sensor 58 is configured to output signals corresponding to accelerations in the x direction (the short-axis direction of the surface 42), the y direction (the long-axis direction of the surface 42), and the z direction (the direction orthogonal to the surface 42) as shown in FIG. 4 to the control unit 51. Based on the detection results by the G-sensor 58, the control unit 51 can determine whether the mobile terminal 40 is in a stationary state where it is stationary, or estimate the movement state of the mobile terminal 40, etc.

[0041] In the mobile terminal 40 configured as described above, when the code settlement application is started, in the information code display process performed by the control unit 51, the settlement code C1 is displayed on the display screen 53a. When the settlement device 10 performing the information code settlement process successfully reads the settlement code C1 by the imaging unit 24 and reads the settlement information, the settlement information is transmitted to a settlement server or the like together with information such as the purchased goods. When the settlement process is completed at the settlement server or the like, information regarding the completion of the settlement is notified to the mobile terminal 40. Note that the display unit 53 corresponds to an example of a "terminal-side display unit", and the display screen 53a may correspond to an example of a "terminal-side display screen". Further, the control unit 51 that performs the above information code display process may correspond to an example of a "terminal-side control unit" that controls the display content by the display unit 53.

[0042] In the present embodiment, in order to smoothly read the settlement code C1 by the settlement device 10, in the above information code display process performed by the mobile terminal 40, an adjustment process for adjusting the display state of the settlement code C1 on the display screen 53a is performed based on the imaging result of the front camera 54 and the display adjustment information of the storage unit 52. Specifically, the adjustment process is performed so as to adjust at least one of the position and size of the settlement code C1 on the display screen 53a such that the settlement code C1 displayed on the display screen 53a can be imaged by the imaging unit 24 of the settlement device 10 for reading. Note that the front camera 54 may correspond to an example of a "terminal-side imaging unit".

[0043] Therefore, in the settlement device 10 that performs information code settlement processing, information regarding the adjustment reference pattern P1 for indicating the adjustment reference in the above adjustment processing is stored in advance in the storage unit 22 so as to be screen-displayable on the display screen 23a. The adjustment reference pattern P1 may correspond to an example of a "specific part" that is at least a part of the settlement device 10 imaged by the front camera 54 when the settlement code C1 displayed on the display screen 53a is imaged so as to be readable by the imaging unit 24.

[0044] In the present embodiment, as shown in FIG. 6(A), the adjustment reference pattern P1 is set to be a rectangular area having a single display color (for example, black) and a predetermined aspect ratio (α / β). Then, during the information code settlement processing performed by the control unit 21, as shown in FIG. 6(B), the adjustment reference pattern P1 is screen-displayed on the display screen 23a so as to have a predetermined positional relationship with respect to the imaging window 24a. Note that the display screen 23a on which the adjustment reference pattern P1 is screen-displayed may correspond to an example of the "device-side display screen".

[0045] On the other hand, in the mobile terminal 40 that performs information code display processing, information regarding the above-described adjustment reference pattern P1, specifically, for example, information regarding the shape such as the above-described predetermined aspect ratio, display color, information regarding the relative position with respect to the imaging window 24a, etc. is stored in advance in the storage unit 52 as the above-described display adjustment information. Note that the storage unit 52 may correspond to an example of the "terminal-side storage unit".

[0046] Therefore, in the adjustment processing performed by the control unit 51, based on the imaging state of the adjustment reference pattern P1 imaged by the front camera 54 and the information regarding the adjustment reference pattern P1 stored in the storage unit 52 as display adjustment information, the display state of the settlement code C1 on the display screen 53a can be adjusted so that the settlement code C1 displayed on the display screen 53a is imaged so as to be readable by the imaging unit 24 of the settlement device 10.

[0047] Specifically, for example, when the adjustment reference pattern P1 is imaged as illustrated in FIG. 7(A), in the mobile terminal 40, the relative positional relationship with the payment device 10 as illustrated in FIG. 7(B) is estimated. In this case, assuming that the mobile terminal 40 is properly held over the payment device 10 and the payment code C1 displayed on the display screen 53a is in a state where it can be read by the imaging unit 24 of the payment device 10, the display state of the payment code C1 is not adjusted. In the drawing of the payment device 10 on which the adjustment reference pattern P1 such as FIG. 7 is displayed on the screen, the images of the mobile terminal 40 and the payment code C1 as seen from the payment device 10 are schematically illustrated by a two-dot chain line.

[0048] On the other hand, when a deviation in a predetermined direction of the mobile terminal 40 with respect to the payment device 10 is estimated from the captured image of the adjustment reference pattern P1, the display position of the payment code C1 is adjusted in the direction opposite to the direction of the deviation.

[0049] Specifically, for example, when a part of the adjustment reference pattern P1 including two corner portions is imaged as illustrated in FIG. 8(A), in the mobile terminal 40, the relative positional relationship with the payment device 10 shifted in the positive x direction as can be seen from FIG. 8(B) is estimated. In this case, in the above adjustment process, as illustrated in FIG. 9(A), the payment code C1 that was displayed in the reference state on the display screen 53a is adjusted to be shifted most negatively in the x direction without changing the size, as illustrated in FIG. 9(B). By this adjustment, as can be seen from FIG. 8(C), the payment code C1 displayed on the display screen 53a is in a display state where it can be imaged and read by the imaging unit 24 of the payment device 10.

[0050] Also, for example, as illustrated in FIG. 10(A), when the adjustment reference pattern P1 is imaged such that the area occupied in the captured image is equal to or less than a certain value (e.g., 20%), in the mobile terminal 40, as can be seen from FIG. 10(B), a relative positional relationship that is too far from the settlement device 10 is estimated. In this case, in the above adjustment process, as illustrated in FIG. 11(A), the settlement code C1 that was displayed in the reference state on the display screen 53a is subjected to a display adjustment to be enlarged, as illustrated in FIG. 11(B). By this adjustment, as can be seen from FIG. 10(C), the settlement code C1 displayed on the display screen 53a is in a display state where it can be read by the imaging unit 24 of the settlement device 10.

[0051] Also, for example, as illustrated in FIG. 12(A), when a part of the adjustment reference pattern P1 is imaged so that there is no corner, in the mobile terminal 40, as can be seen from FIG. 12(B), a relative positional relationship that is too close to the settlement device 10 is estimated. In this case, in the above adjustment process, as illustrated in FIG. 13(A), the settlement code C1 that was displayed in the reference state on the display screen 53a is subjected to a display adjustment to be reduced, as illustrated in FIG. 13(B). By this adjustment, as can be seen from FIG. 12(C), the settlement code C1 displayed on the display screen 53a is in a display state where it can be read by the imaging unit 24 of the settlement device 10. Also, when a part of the adjustment reference pattern P1 including one corner is imaged, a relative positional relationship that is too close is estimated as described above, and by performing a display adjustment to reduce the settlement code C1, the settlement code C1 is in a display state where it can be read by the imaging unit 24 of the settlement device 10.

[0052] Hereinafter, with reference to FIG. 14, the respective flows of the information code settlement process performed by the control unit 21 of the settlement device 10 and the information code display process performed by the control unit 51 of the mobile terminal 40 when performing information code settlement will be described in detail.

[0053] In the payment device 10, when the information code payment process is started (F10 in FIG. 14), the imaging unit 24 can image the payment code C1 (F11). At this time, the adjustment reference pattern P1 described above is displayed on the display screen 23a as illustrated in FIG. 6(B) (F12). When the reading of the payment information from the imaged payment code C1 is successful in the state where the adjustment reference pattern P1 is displayed on the screen (F13), this payment information is transmitted to a payment server or the like together with information on purchased goods or the like.

[0054] On the other hand, in the mobile terminal 40, when the control unit 51 starts the information code display process by starting the code payment application (F20), the payment code C1 is displayed on the display screen 53a in the reference state as illustrated in FIG. 4 (F21). Then, the movement state of the mobile terminal 40 is monitored based on the detection result of the G sensor 58 (F22).

[0055] Thereafter, in order to have the payment device 10 read the payment code C1 displayed on the screen, when the user holds the mobile terminal 40 over the payment device 10, it is determined that the mobile terminal 40 is in a stationary state based on the detection result of the G sensor 58 (F23). For example, when the acceleration in the z direction is close to the gravitational acceleration g and the accelerations in the x direction and the y direction are both close to 0, it is determined that the mobile terminal 40 is in a stationary state. Note that, on the premise that the front camera 54 is activated before the stationary state is determined, it may be determined whether the mobile terminal 40 is in a stationary state based on the frame difference in the captured image of the adjustment reference pattern P1 continuously captured by the front camera 54.

[0056] After this determination of the stationary state, the front camera 54 is activated (F24), and the adjustment reference pattern P1 displayed on the payment device 10 can be imaged (F25). Note that the control unit 51 that performs the determination process of determining the stationary state of the mobile terminal 40 based on the detection result of the G sensor 58 or the like may correspond to an example of a "determination unit".

[0057] Then, the state of the adjustment reference pattern P1 imaged by the front camera 54 is analyzed (F26). When it is determined from the image analysis result that the adjustment reference pattern P1 is imaged such that the display adjustment of the payment code C1 is required, the display state of the payment code C1 on the display screen 53a is adjusted so that the payment code C1 can be imaged readably by the imaging unit 24 of the payment device 10 (F27). When the adjustment reference pattern P1 is imaged as shown in FIG. 8(A), as shown in FIG. 9(B), display adjustment is made to move in the direction opposite to the estimated deviation direction of the payment code C1. When the adjustment reference pattern P1 is imaged as shown in FIG. 10(A), as shown in FIG. 11(B), display adjustment is made to enlarge the display of the payment code C1. When the adjustment reference pattern P1 is imaged as shown in FIG. 12(A), as shown in FIG. 13(B), display adjustment is made to reduce the display of the payment code C1. On the other hand, when the adjustment reference pattern P1 is imaged such that the display adjustment of the payment code C1 is not required as shown in FIG. 7(A), the display state of the payment code C1 is not adjusted either.

[0058] By the display adjustment as described above, the display is adjusted so that the payment code C1 can be imaged readably by the imaging unit 24 of the payment device 10. Thus, the user can have the payment device 10 read the payment code C1 displayed on the screen of the mobile terminal 40 just by turning the display screen 53a of the mobile terminal 40 toward the imaging window 24a of the payment device 10.

[0059] As described above, in the information code reading system 1 according to the present embodiment, on the premise that the settlement code C1 displayed on the screen of the mobile terminal 40 is read by the stationary settlement device 10, when the settlement code C1 displayed on the display screen 53a is imaged so that it can be read by the imaging unit 24, the information of the adjustment reference pattern P1 imaged by the front camera 54 is stored in the storage unit 52 as display adjustment information. Then, in the information code display process performed by the control unit 51, based on the imaging result of the front camera 54 and the display adjustment information in the storage unit 52, an adjustment process is performed to adjust at least one of the position and size of the settlement code C1 on the display screen 53a so that the settlement code C1 displayed on the display screen 53a can be imaged so as to be readable by the imaging unit 24.

[0060] Thereby, it becomes easier to adjust the display state of the settlement code C1 to be suitable for reading by the settlement device 10 only by the user facing the settlement code C1 displayed on the screen of the mobile terminal 40 toward the settlement device 10. Therefore, the display state of the settlement code C1 can be adjusted to a state where it is easy to read without the user performing a manual operation.

[0061] Also, in the information code display process performed by the control unit 51, after it is determined that the mobile terminal 40 is in a stationary state (F23), if it is determined that the adjustment reference pattern P1 has been imaged so that adjustment of the display of the settlement code C1 is required, an adjustment process for adjusting the display state of the settlement code C1 on the display screen 53a is performed (F27). Thereby, it is possible to suppress the display state of the settlement code C1 from being unnecessarily adjusted while the mobile terminal 40 is being held over the settlement device 10.

[0062] The adjustment reference pattern P1 for indicating the adjustment reference in the above adjustment process is a rectangular area of a single color on the display screen 23a provided in the settlement device 10, and the display adjustment information is information on the position occupied by the adjustment reference pattern P1 in the captured image. As a result, the position and size of the captured image of the adjustment reference pattern (specific part) P1 serving as the reference for the adjustment process can be grasped more clearly, so that the display state of the settlement code C1 can be adjusted more appropriately.

[0063] Note that the adjustment reference pattern P1 is not limited to being set as a rectangular area of a single black color, and may be set as a rectangular area of a single color of another color, or may be set as an area of a specified shape of a single color. Also, for example, the adjustment reference pattern P1 may be set as a rectangular area where the area other than the specific pattern is a single color. Specifically, for example, as illustrated in FIG. 15(A), the adjustment reference pattern P1 is set such that a broken-line outer frame serving as the specific pattern P1a is arranged in another display color near the outer edge of the rectangular area of a single black color, and may be displayed on the display screen 23a as illustrated in FIG. 15(B). As a result, after grasping the presence or absence of imaging of the adjustment reference pattern P1 by the specific pattern P1a, the position and size of the captured image of the adjustment reference pattern P1 can be grasped more clearly, so that the display state of the settlement code C1 can be adjusted more appropriately.

[0064] Also, information regarding a specific part corresponding to at least a part of the settlement device 10 imaged by the front camera 54 when the settlement code C1 displayed on the display screen 53a is imaged so as to be readable by the imaging unit 24, for example, the upper surface 11a of the housing 11 or the shape of the display screen 23a, etc., may be stored in the storage unit 52 as display adjustment information instead of the adjustment reference pattern P1. Even configured in this way, based on the imaging result of the front camera 54 and the display adjustment information of the storage unit 52, the adjustment process is performed so that the settlement code C1 displayed on the display screen 53a is imaged by the imaging unit 24 so as to be readable, and the above effects are achieved depending on the appearance of the housing 11 and the like.

[0065] As a modification of this embodiment, in the information code display process performed by the control unit 51, the brightness of the display screen 53a may be adjusted based on the ambient brightness obtained from the imaging result of the front camera 54. Thereby, when the surroundings are too dark, the brightness of the display screen 53a can be adjusted brighter so that the settlement code C1 displayed on the screen can be imaged readably. When the surroundings are too bright, the brightness of the display screen 53a can be adjusted darker so that the settlement code C1 displayed on the screen can be imaged readably. In this way, by adjusting the brightness of the display screen 53a according to the ambient brightness, the display state of the settlement code C1 can be adjusted more appropriately.

[0066] [Second Embodiment] Next, an information code reading system according to the second embodiment of the present invention will be described with reference to the drawings. In this second embodiment, the main difference from the first embodiment is that the display position of the settlement code C1 is adjusted so as to avoid the estimated irradiation range of the disturbing light. Therefore, the same reference numerals are given to substantially the same components as those in the first embodiment, and the description thereof is omitted.

[0067] There may be a case where, after strong disturbing light or the like is reflected by the display screen 23a or the like of the settlement device 10, the reflected light (hereinafter also referred to as reflected light or the like) is irradiated onto the display screen 53a of the mobile terminal 40. In such a case, if at least a part of the settlement code C1 is included in the irradiation range of the reflected light or the like, there is a possibility that the settlement device 10 cannot image the settlement code C1 readably.

[0068] Therefore, in the information code display process performed by the control unit 51 in this embodiment, in the imaging result of the front camera 54, determination processing is performed to determine whether the captured image includes a high-brightness area where imaging of reflected light or the like is estimated based on the distribution of luminance values in the captured image. If it is determined by this determination processing that the captured image includes a high-brightness area, a corresponding range on the display screen 53a is set according to the range of the high-brightness area in the captured image, and it is estimated that this corresponding range is the irradiation range of reflected light or the like. Then, adjustment processing is performed to adjust the display state of the settlement code C1 so as to avoid the corresponding range thus estimated.

[0069] Specifically, for example, as illustrated in FIG. 16(A), when a high-brightness area Pb is imaged so as to cover a part of the adjustment reference pattern P1 by the front camera 54, it is determined that the high-brightness area Pb is included in the captured image. Then, the deviation direction of the high-brightness area Pb with respect to the center of the captured image (the positive x-direction side in the example of FIG. 16(A)) is obtained, and a corresponding range Pc on the display screen 53a is set so as to be shifted in the same direction as this deviation direction. In the example of FIG. 16(A), a corresponding range Pc shifted to the positive x-direction side as shown in FIG. 17(A) is set, and adjustment processing is performed to shift the display position of the settlement code C1 to the negative x-direction side so as to avoid the corresponding range Pc as shown in FIG. 17(B).

[0070] Therefore, in the settlement device 10, by changing from the imaging state of the settlement code C1 irradiated with reflected light or the like (see FIG. 16(B)) to the imaging state of the settlement code C1 adjusted to avoid reflected light or the like (see FIG. 16(C)), the settlement code C1 can be imaged so as to be readable.

[0071] As described above, in the information code reading system 1 according to this embodiment, in the information code display process performed by the control unit 51, when the captured image of the front camera 54 includes a high-brightness area Pb, adjustment processing is performed to avoid a corresponding range Pc according to the range of the high-brightness area Pb in the captured image.

[0072] That is, a corresponding range Pc according to the range occupied by the imaging image of the high-brightness region Pb is estimated as the irradiation range on the display screen 53a irradiated with reflected light or the like that is the cause of the high-brightness region Pb, and the settlement code C1 is displayed so as to avoid the corresponding range Pc. Thereby, even when the display screen 53a is irradiated with disturbance light or the like reflected by the settlement device 10, the display state of the settlement code C1 can be adjusted so as to avoid the irradiation range.

[0073] [Third Embodiment] Next, an information code reading system according to the third embodiment of the present invention will be described with reference to the drawings. The information code reading system 1a according to the third embodiment is configured as a system that causes a portable reading terminal to read an information code displayed on a stationary display device. In this embodiment, as shown in FIG. 18, the portable terminal 40 described above is adopted as the portable reading terminal, and this portable terminal 40 reads a settlement information code (hereinafter also referred to as a settlement code C2) displayed on the settlement device 10 adopted as the stationary display device. The settlement code C2 is generated so that settlement information and the like are recorded as an information code for information code settlement, similar to the settlement code C1 described above.

[0074] Therefore, in the portable terminal 40 in this embodiment, an information code settlement process is started by the control unit 51 by a predetermined application program activated at the time of information code settlement. In this information code settlement process, while the imaging image of the rear camera 55 is preview-displayed on the display screen 53a, an information code reading process for reading the settlement code C2 imaged by the rear camera 55 is performed. Note that the rear camera 55 corresponds to an example of the "imaging unit on the terminal side", and the control unit 51 that performs the information code reading process may correspond to an example of a "reading unit" that reads the information recorded in the imaged information code.

[0075] On the other hand, in the settlement device 10 in this embodiment, in the information code display process performed by the control unit 21 during information code settlement, the settlement code C2 is displayed on the display screen 23a of the display unit 23. In this information code display process, in order to smoothly read the settlement code C2 by the mobile terminal 40, adjustment processing is performed to adjust the display state of the settlement code C2 on the display screen 23a based on the imaging result of the imaging unit 24 and the display adjustment information in the storage unit 22. Note that the display unit 23 corresponds to an example of the "device-side display unit", and the display screen 23a may correspond to an example of the "device-side display screen". Also, the control unit 21 that performs the above information code display process may correspond to an example of the "device-side control unit" that controls the display content by the display unit 23.

[0076] Specifically, the above adjustment processing is performed so as to adjust at least one of the position and size of the settlement code C2 on the display screen 23a so that the settlement code C2 displayed on the display screen 23a can be imaged and read by the rear camera 55 of the mobile terminal 40.

[0077] In the storage unit 22 of the settlement device 10, information on a specific part corresponding to at least a part of the mobile terminal 40 imaged by the imaging unit 24 is stored in advance as the above display adjustment information. Specifically, on the premise that the range occupied by the mobile terminal 40 in the captured image is substantially rectangular, information on a rectangular area with a predetermined aspect ratio located at the center of the captured image is stored. That is, the display adjustment information in this embodiment is approximate outer shape information of the mobile terminal 40, which is set as a criterion for determining whether the mobile terminal 40 is included in the captured image and, if included, for analyzing how it is imaged. Then, from the comparison results of the position and size of the rectangular object in the actual captured image by the settlement device 10 and the rectangular area at the center of the captured image that is the reference for the adjustment processing, the relative position of the rectangular object with respect to the settlement device 10, that is, the relative position of the mobile terminal 40 can be estimated. Note that the storage unit 22 may correspond to an example of the "device-side storage unit".

[0078] Therefore, in the adjustment process performed by the control unit 21, based on the captured image captured by the imaging unit 24 and the information stored as display adjustment information in the storage unit 22, the display state of the payment code C2 displayed on the display screen 23a can be adjusted so that the payment code C2 displayed on the display screen 23a can be read by the rear camera 55 of the mobile terminal 40.

[0079] Specifically, for example, when the mobile terminal 40 is imaged as illustrated in FIG. 19(A), in the payment device 10, the relative positional relationship with the mobile terminal 40 as illustrated in FIG. 19(B) is estimated. In this case, since the mobile terminal 40 is properly held over the payment device 10 and the payment code C2 displayed on the display screen 23a is in a state where it can be read by the rear camera 55 of the mobile terminal 40, the display state of the payment code C2 is not adjusted. In the drawings of the payment device 10 where the payment code C2 such as in FIG. 19 is displayed on the screen, the outer shape image of the mobile terminal 40 as seen from the payment device 10 is schematically illustrated by a two-dot chain line.

[0080] On the other hand, when the mobile terminal 40 in the captured image of the mobile terminal 40 is shifted in a predetermined direction, the display position of the payment code C2 is adjusted in the direction opposite to the direction of the shift. In the present embodiment, based on the shifts in the x direction (the short-axis direction of the display screen 23a), the y direction (the long-axis direction of the display screen 23a), and the z direction (the direction perpendicular to the display screen 23a) as illustrated in FIG. 20 and the like, the display position of the payment code C2 is adjusted.

[0081] Specifically, for example, as illustrated in FIG. 20(A), when a part of the mobile terminal 40 is imaged, the settlement device 10 estimates the relative positional relationship with the mobile terminal 40 shifted in the positive x direction as illustrated in FIG. 20(B). In this case, in the above adjustment process, as illustrated in FIG. 20(B), the settlement code C2 that was displayed in the reference state on the display screen 23a is shifted to the most positive x direction (the same direction as the estimated shift direction) without changing the size, as illustrated in FIG. 20(C). By this adjustment, as can be seen from FIG. 20(C), the settlement code C2 displayed on the display screen 23a is imaged in a state where it can be read by the rear camera 55 of the mobile terminal 40.

[0082] Also, for example, as illustrated in FIG. 21(A), when the mobile terminal 40 is imaged such that the area occupied in the captured image is equal to or less than a certain value (for example, 20%), the settlement device 10 estimates that the relative positional relationship with the mobile terminal 40 is too far, as illustrated in FIG. 21(B). In this case, in the above adjustment process, as illustrated in FIG. 21(B), the settlement code C2 that was displayed in the reference state on the display screen 23a is enlarged, as illustrated in FIG. 21(C). By this adjustment, as can be seen from FIG. 21(C), the settlement code C2 displayed on the display screen 23a is imaged in a state where it can be read by the rear camera 55 of the mobile terminal 40.

[0083] Also, for example, as illustrated in FIG. 22(A), when the mobile terminal 40 is imaged such that the area occupied in the captured image is equal to or greater than a certain value (for example, 60%), the settlement device 10 estimates that the relative positional relationship with the mobile terminal 40 is too close, as illustrated in FIG. 22(B). In this case, in the above adjustment process, as illustrated in FIG. 22(B), the settlement code C2 that was displayed in the reference state on the display screen 23a is reduced, as illustrated in FIG. 22(C). By this adjustment, as can be seen from FIG. 22(C), the settlement code C2 displayed on the display screen 23a is imaged in a state where it can be read by the rear camera 55 of the mobile terminal 40.

[0084] Hereinafter, with reference to FIG. 23, the respective flows of the information code settlement process performed by the control unit 51 of the mobile terminal 40 and the information code display process performed by the control unit 21 of the settlement device 10 when performing information code settlement will be described in detail.

[0085] In the mobile terminal 40, when the information code settlement process is started (F30 in FIG. 23), the rear camera 55 can image the settlement code C2 (F31). Then, when the reading operation is started so that the rear camera 55 faces the settlement device 10 (F32), if the reading of the settlement information from the imaged settlement code C2 is successful (F33), the settlement information and the like are transmitted to the settlement server and the like via the communication unit 59.

[0086] On the other hand, in the settlement device 10, when the information code display process is started by the control unit 21 (F40), the imaging unit 24 can image the mobile terminal 40 (F41). Then, the settlement code C2 is displayed on the display screen 23a in the reference state as illustrated in FIG. 19(B) (F42).

[0087] Thereafter, in order to read the settlement code C2 displayed on the screen, when the user holds the mobile terminal 40 over the settlement device 10, based on the frame difference in the captured image of the mobile terminal 40 continuously captured by the imaging unit 24, it is determined that the mobile terminal 40 is stationary (F43). Note that the control unit 21 that performs the determination process for determining the stationary state of the mobile terminal 40 based on the frame difference in the captured image can correspond to an example of a "determination unit".

[0088] After determining the stationary state, the imaging state of the mobile terminal 40 imaged by the imaging unit 24 is analyzed (F44). If it is determined from the image analysis result that the mobile terminal 40 is imaged such that the display of the payment code C2 needs to be adjusted, the display state of the payment code C2 on the display screen 23a is adjusted so that the payment code C2 can be imaged readably by the rear camera 55 of the mobile terminal 40 (F45). When a part of the mobile terminal 40 is imaged as shown in Fig. 20(A), as shown in Fig. 20(C), a display adjustment is made to shift the payment code C2 in the positive x direction (the same direction as the estimated deviation direction). When the mobile terminal 40 is imaged as shown in Fig. 21(A), as shown in Fig. 21(C), a display adjustment is made to enlarge the display of the payment code C2. When the mobile terminal 40 is imaged as shown in Fig. 22(A), as shown in Fig. 22(C), a display adjustment is made to reduce the display of the payment code C2. On the other hand, when the mobile terminal 40 is imaged such that the display of the payment code C2 does not need to be adjusted as shown in Fig. 19(A), the display state of the payment code C2 is not adjusted either.

[0089] By adjusting the display as described above so that the payment code C2 can be imaged readably by the rear camera 55 of the mobile terminal 40, the user can cause the mobile terminal 40 to read the payment code C2 displayed on the screen of the payment device 10 just by pointing the rear camera 55 of the mobile terminal 40 at the display screen 23a of the payment device 10.

[0090] As described above, in the information code reading system 1a according to the present embodiment, on the premise that the payment code C2 displayed on the screen of the payment device 10 is read by the mobile terminal 40, when the payment code C2 displayed on the display screen 23a is imaged so as to be readable by the rear camera 55, the imaging unit 24 captures the approximate outer shape information (information on specific parts) of the mobile terminal 40, which is stored in the storage unit 22 as display adjustment information. Then, in the information code display process performed by the control unit 21, based on the imaging result of the imaging unit 24 and the display adjustment information in the storage unit 22, adjustment processing is performed to adjust at least one of the position and size of the payment code C2 on the display screen 23a so that the payment code C2 displayed on the display screen 23a is imaged to be readable by the rear camera 55.

[0091] Thereby, it becomes easier to adjust the display state of the payment code C2 to be suitable for reading by the mobile terminal 40 only by the user turning the mobile terminal 40 toward the payment code C2 displayed on the screen of the payment device 10. Therefore, the display state of the payment code C2 can be adjusted to a state where it is easy to read without the user performing a manual operation.

[0092] In the information code display process performed by the control unit 21, after it is determined that the mobile terminal 40 is in a stationary state (F43), if it is determined that the mobile terminal 40 is being imaged so that the display of the payment code C2 needs to be adjusted, adjustment processing for adjusting the display state of the payment code C2 on the display screen 23a is performed (F45). Thereby, it is possible to suppress the display state of the payment code C2 from being adjusted unnecessarily while the mobile terminal 40 is being turned toward the payment device 10.

[0093] As a modification of this embodiment, in the information code display process performed by the control unit 21, the brightness of the display screen 23a may be adjusted based on the ambient brightness obtained from the imaging result of the imaging unit 24. Thereby, when the surroundings are too dark, the brightness of the display screen 23a can be adjusted brighter so that the settlement code C2 displayed on the screen can be imaged for reading, and when the surroundings are too bright, the brightness of the display screen 23a can be adjusted darker so that the settlement code C2 displayed on the screen can be imaged for reading. In this way, by adjusting the brightness of the display screen 23a according to the ambient brightness, the display state of the settlement code C2 can be adjusted more appropriately.

[0094] [Fourth Embodiment] Next, an information code reading system according to the fourth embodiment of the present invention will be described with reference to the drawings. In this fourth embodiment, the main difference from the third embodiment above is that the display position of the settlement code C2 is adjusted so as to avoid the estimated irradiation range of the disturbing light. Therefore, the same reference numerals are given to the substantially same components as those in the third embodiment, and the description thereof is omitted.

[0095] There may be a case where, after strong disturbing light or the like is reflected from the back surface 43 of the mobile terminal 40, the reflected light (hereinafter also referred to as reflected light or the like) is irradiated onto the display screen 23a of the settlement device 10. In such a case, if at least a part of the settlement code C2 is included in the irradiation range of the reflected light or the like, there is a possibility that the settlement code C2 cannot be imaged for reading by the mobile terminal 40.

[0096] Therefore, in the information code display process performed by the control unit 21 in this embodiment, in the imaging result of the imaging unit 24, determination processing is performed to determine whether the captured image includes a high-luminance region where imaging of reflected light or the like is estimated based on the distribution of luminance values in the captured image. If it is determined by this determination processing that the captured image includes a high-luminance region, a corresponding range on the display screen 23a is set according to the range occupied by the high-luminance region in the captured image, and it is estimated that this corresponding range is the irradiation range of reflected light or the like. Then, adjustment processing is performed to adjust the display state of the payment code C2 so as to avoid the corresponding range thus estimated.

[0097] Specifically, for example, as illustrated in FIG. 24(A), when the high-luminance region Pb is imaged so as to cover a part of the back surface 43 of the mobile terminal 40 by the imaging unit 24, it is determined that the high-luminance region Pb is included in the captured image. Then, the deviation direction of the high-luminance region Pb with respect to the center of the captured image (the negative x-direction in the example of FIG. 24(A)) is obtained, and the corresponding range Pc on the display screen 23a is set so as to be shifted in the same direction as this deviation direction. In the example of FIG. 24(A), the corresponding range Pc shifted to the negative x-direction as shown in FIG. 24(B) is set, and adjustment processing is performed to shift the display position of the payment code C2 to the positive x-direction so as to avoid the corresponding range Pc as shown in FIG. 24(C).

[0098] Therefore, in the mobile terminal 40, by changing from the imaging state of the payment code C2 irradiated with reflected light or the like (see FIG. 24(B)) to the imaging state of the payment code C2 adjusted to avoid reflected light or the like (see FIG. 24(C)), the payment code C2 can be imaged so as to be readable.

[0099] As described above, in the information code reading system 1a according to this embodiment, in the information code display process performed by the control unit 21, when the captured image of the imaging unit 24 includes the high-luminance region Pb, adjustment processing is performed to avoid the corresponding range Pc according to the range occupied by the high-luminance region Pb in the captured image.

[0100] That is, a corresponding range Pc corresponding to the range occupied by the high-brightness region Pb in the captured image is estimated as the irradiation range on the display screen 23a irradiated with reflected light or the like that causes the high-brightness region Pb, and the settlement code C2 is displayed so as to avoid the corresponding range Pc. Thereby, even when the display screen 23a is irradiated with disturbance light or the like reflected from the back surface 43 of the mobile terminal 40, the display state of the settlement code C2 can be adjusted so as to avoid the irradiation range.

[0101] Note that the present invention is not limited to the above-described embodiments and the like, and may be embodied as follows, for example. (1) The information code reading system 1 according to the present invention is not limited to being adopted in a settlement system that causes a settlement code C1 displayed on a screen of a mobile terminal 40 to be read by a settlement device 10, and may be adopted in a system that causes a general information code such as a barcode or a QR code displayed on a screen of a portable display terminal to be read by a stationary reading device.

[0102] (2) The information code reading system 1a according to the present invention is not limited to being adopted in a system that causes a settlement code C2 displayed on a screen of a settlement device 10 to be read by a mobile terminal 40, and may be adopted in a system that causes a general information code such as a barcode or a QR code displayed on a screen of a stationary display device to be read by a portable reading terminal.

Explanation of Reference Numerals

[0103] 1, 1a Information code reading system 10 Settlement device (reading device, display device) 21 Control unit (reading unit, device-side control unit, determination unit) 22 Storage unit (device-side storage unit) 23 Display unit (device-side display unit) 23a Display screen (device-side display screen) 24 Imaging unit (device-side imaging unit, ) 40 Mobile terminal (display terminal, reading terminal) 51 Control unit (terminal-side control unit, determination unit, reading unit) 52 Storage unit (terminal-side storage unit) 53 Display unit (terminal-side display unit) 53a Display screen (terminal-side display screen) 54 Front camera (terminal-side imaging unit) 55 Rear camera (terminal-side imaging unit) 58 G-sensor C1, C2 Settlement code (information code) P1 Adjustment reference pattern (specific part) Pb High-brightness area

Claims

1. A portable display terminal on which an information code is displayed on a screen, A stationary reading device that reads the information code, An information code reading system comprising: The reading device includes: A device-side imaging unit that images the information code, A reading unit that reads information recorded in the information code imaged by the device-side imaging unit, And comprises: The display terminal includes: A terminal-side display unit for displaying the information code on a terminal-side display screen, A terminal-side imaging unit having an imaging direction in the direction in which the terminal-side display screen faces, A terminal-side control unit that controls the display content by the terminal-side display unit, A terminal-side storage unit that stores information on a specific part corresponding to at least a part of the reading device imaged by the terminal-side imaging unit when the information code displayed on the terminal-side display screen is imaged so as to be readable by the device-side imaging unit as display adjustment information, And comprises: The terminal-side control unit performs an adjustment process of adjusting at least one of the position and size of the information code on the terminal-side display screen so that the information code displayed on the terminal-side display screen is imaged so as to be readable by the device-side imaging unit based on the imaging result of the terminal-side imaging unit and the display adjustment information of the terminal-side storage unit. An information code reading system characterized by this.

2. The specific part is a rectangular area that is a single color on a device-side display screen provided in the reading device, The information code reading system according to claim 1, wherein the display adjustment information is information on a position occupied by the imaging image of the rectangular area.

3. The specific part is a rectangular area in which a single color is obtained except for a specific pattern on a device-side display screen provided in the reading device, The information code reading system according to claim 1, wherein the display adjustment information is information on a position occupied by the imaging image of the rectangular area.

4. The terminal-side control unit performs the adjustment process so as to avoid a corresponding range according to a range occupied by the imaging image of the high-brightness area when the imaging result of the terminal-side imaging unit includes a high-brightness area. The information code reading system according to claim 1, characterized by this.

5. The terminal-side control unit adjusts the brightness of the terminal-side display screen based on the ambient brightness obtained from the imaging result of the terminal-side imaging unit. The information code reading system according to claim 1, characterized by this.

6. The display terminal includes a determination unit that determines whether or not the display terminal is in a stationary state in which the display terminal is considered to be stationary. The information code reading system according to claim 1, wherein the terminal-side control unit performs the adjustment process after being determined to be in the stationary state by the determination unit.

7. A stationary display device on which an information code is displayed on a screen, A portable reading terminal that reads the information code, An information code reading system comprising: The reading terminal includes: A terminal-side imaging unit that images the information code, A reading unit that reads information recorded in the information code imaged by the terminal-side imaging unit, and is provided with The display device includes: A device-side display unit for displaying the information code on a device-side display screen, A device-side imaging unit that uses the direction in which the device-side display screen faces as an imaging direction, A device-side control unit that controls the display content by the device-side display unit, A device-side storage unit that stores information on a specific part corresponding to at least a part of the reading terminal imaged by the device-side imaging unit when the information code displayed on the device-side display screen is imaged so as to be readable by the terminal-side imaging unit as display adjustment information, and is provided with The device-side control unit performs an adjustment process of adjusting at least one of the position and size of the information code on the device-side display screen so that the information code displayed on the device-side display screen is imaged so as to be readable by the terminal-side imaging unit based on the imaging result of the device-side imaging unit and the display adjustment information of the device-side storage unit. An information code reading system characterized by this.

8. The information on the specific part stored in the device-side storage unit as the display adjustment information is information on a rectangular area having a predetermined aspect ratio located at the center of the captured image. The information code reading system according to claim 7, characterized by this.

9. The device-side control unit performs the adjustment process so as to avoid a corresponding range according to the range occupied by the high-brightness area in the captured image of the high-brightness area when the captured image of the device-side imaging unit includes a high-brightness area. The information code reading system according to claim 7, characterized by this.

10. The device-side control unit adjusts the brightness of the device-side display screen based on the ambient brightness obtained from the imaging result of the device-side imaging unit. The information code reading system according to claim 7, characterized by this.

11. The display device includes a determination unit that determines whether or not the reading terminal is in a stationary state regarded as being stationary based on an imaging result obtained by imaging the reading terminal with the device-side imaging unit. The information code reading system according to claim 7, wherein the device-side control unit performs the adjustment process after being determined to be in the stationary state by the determination unit.

Images