Information transfer system, transmission apparatus, reception apparatus, information transfer method, and program
By dividing information into multiple two-dimensional codes with switching detection markers and correcting reads based on detected progress rates, the system enhances data transfer efficiency and recognition rates, addressing issues of code size and rolling shutter phenomena in two-dimensional code recognition.
Patent Information
- Application Number
- PCT/JP2023/020143
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-30
- Publication Date
- 2024-12-05
AI Technical Summary
The use of two-dimensional codes for information transfer is hindered by increased code size when storing additional information, leading to decreased visibility of main content, and recognition failures due to intermediate brightness and the rolling shutter phenomenon during rapid display switching.
Divide information into multiple two-dimensional codes with added switching detection markers, displayed sequentially at a preset speed, allowing for correction of failed reads based on detected switching progress rates, thereby maintaining high recognition rates.
Improves data transfer efficiency while maintaining a high recognition rate by correcting failed code reads and mitigating the effects of intermediate brightness and rolling shutter issues.
Smart Images

Figure JP2023020143_05122024_PF_FP_ABST
Abstract
Description
Information transfer system, transmitting device, receiving device, information transfer method and program
[0001] One aspect of the present invention relates to an information transfer system that transfers information data from a sending side to a receiving side using a two-dimensional code, and a sending device, a receiving device, an information transfer method, and a program used in this system.
[0002] Two-dimensional codes are used, for example, to store high-density information data and display it on paper, allowing viewers to view the information data by reading the two-dimensional code with a device equipped with a camera. Two-dimensional codes are also used to add link information such as a URL (Uniform Resource Locator) to content displayed on a terminal display.
[0003] However, if the device reading the 2D code does not have a network access function, or if it has the function but is in an environment where it cannot access the network, communication will be one-way from the sending device to the receiving device, so it will be necessary to store and display the viewing information itself, rather than link information, in the 2D code.In such cases, the size of the 2D code will increase, and the 2D code, which is supposed to be additional information, will overwhelm the display of the main information such as content, reducing the visibility of the main information.
[0004] Therefore, a technology has been proposed in which the transmitting device divides the additional information into multiple two-dimensional codes and displays these two-dimensional codes in chronological order as moving images, thereby enabling the display of large amounts of additional information while reducing the size of the two-dimensional code (see, for example, non-patent document 1).
[0005] Kun Xie, SEBASTIEN GABOURY, AND SYLVAIN HALLE, “Real-Time Streaming Communication With Optical Code”, IEEE Access, pp.284-298, date of publication January 4, 2016.
[0006] However, if the display switching speed of the 2D code, i.e., the frame rate, is increased in order to efficiently display the 2D code as a moving image in a short time, there is a concern that the receiving device may fail to read the 2D code displayed as the moving image, resulting in a decrease in the recognition rate of the 2D code.The reason for this is thought to be that when the display of the 2D code is switched, parts of the previous and next images are mixed together when the image is read, causing the color of the cells in the image to be displayed as gray, which is an intermediate color between black and white, and making it impossible for the receiving device to correctly recognize these gray cells.
[0007] Furthermore, when the receiving camera reads an image by sequentially scanning the displayed image frame from top to bottom, a time difference occurs in the reading timing depending on the scanning position within the frame. This is called the rolling shutter phenomenon. When this rolling shutter phenomenon occurs, gray cells appear depending on the scanning position within a frame when reading a 2D code, which is one of the causes of a decrease in recognition rate. The rolling shutter phenomenon is described in detail on the Internet at: <URL: https: / / www.klv.co.jp / corner / what-is-shutter.html>.
[0008] The present invention has been made in light of the above circumstances, and aims to provide a technique that enables improvement in data transfer efficiency while maintaining a high recognition rate.
[0009] In order to solve the above problem, one aspect of the present invention involves, when transferring information to be transferred from a transmitting device to a receiving device using a two-dimensional code, first dividing the information to be transferred into a plurality of divided pieces of information in the transmitting device, converting each of the divided pieces into a two-dimensional code, and adding switching detection markers to the two-dimensional codes in a predetermined positional relationship with the two-dimensional codes for detecting a switching progress rate during a display switching period between the two-dimensional codes.The two-dimensional codes to which the switching detection markers have been added are then displayed sequentially on a display device at a preset display switching speed.
[0010] Meanwhile, the receiving device acquires image information obtained by reading the two-dimensional codes displayed sequentially on the display device with an imaging device from the imaging device, determines whether each of the received two-dimensional codes represented by the acquired image information was successfully read, and stores the received two-dimensional codes separately as first two-dimensional codes that were successfully read and second two-dimensional codes that were unsuccessfully read based on the determination result.The receiving device then detects the switching progress rate for the second two-dimensional code based on the switching detection marker added to the second two-dimensional code, and corrects the second two-dimensional code based on the detected switching progress rate.The receiving device then regenerates the divided information based on the first two-dimensional code and the corrected second two-dimensional code, and combines the regenerated divided information to regenerate the information to be transferred.
[0011] According to one aspect of the present invention, even if reading of a two-dimensional code fails due to the brightness becoming neutral during a display switching period when a two-dimensional code is displayed as a moving image, or if reading of a two-dimensional code fails due to the effects of the rolling shutter phenomenon, it is possible to correct the two-dimensional code that failed to be read based on the switching progress rate detected by the switching detection marker.
[0012] That is, according to one aspect of the present invention, it is possible to provide a technique that enables improvement in data transfer efficiency while maintaining a high recognition rate.
[0013] FIG. 1 is a diagram showing an example of the configuration of an information transfer system according to an embodiment of the present invention. FIG. 2 is a block diagram showing an example of the hardware configuration of a transmitting device used in the information transfer system shown in FIG. 1. FIG. 3 is a block diagram showing an example of the software configuration of a transmitting device used in the information transfer system shown in FIG. 1. FIG. 4 is a block diagram showing an example of the hardware configuration of a receiving device used in the information transfer system shown in FIG. 1. FIG. 5 is a block diagram showing an example of the software configuration of a receiving device used in the information transfer system shown in FIG. 1. FIG. 6 is a flowchart showing an example of the processing procedure and processing content of two-dimensional code transmission control executed by the control unit of the transmitting device shown in FIG. 3. FIG. 7 is a flowchart showing an example of the processing procedure and processing content of two-dimensional code reproduction processing executed by the control unit of the receiving device shown in FIG. 5. FIG. 8 is a flowchart showing an example of the processing procedure and processing content when reading of a two-dimensional code is successful in the two-dimensional code correction management processing of the two-dimensional code reproduction processing shown in FIG. 7. FIG. 9 is a flowchart showing an example of the processing procedure and processing content when reading of a two-dimensional code is unsuccessful in the two-dimensional code correction management processing of the two-dimensional code reproduction processing shown in FIG. 7. FIG. 10 is a diagram showing an example of a two-dimensional code and a switching detection marker generated in the two-dimensional code transmission control shown in FIG. 6. Fig. 11 is a diagram showing an example of the size of a switching detection marker and its position relative to a two-dimensional code. Fig. 12 is a diagram for explaining an example of a change in brightness that occurs in a read two-dimensional code. Fig. 13 is a diagram showing an overview of the two-dimensional code correction management process shown in Figs. 8 and 9. Fig. 14 is a diagram showing an example of a switching progress rate calculation process in the two-dimensional code correction management process shown in Figs. 8 and 9. Fig. 15 is a diagram showing an example of operation when there are multiple two-dimensional codes that have failed to be read in the two-dimensional code correction management process shown in Figs. 8 and 9.
[0014] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
[0015] [One Embodiment] (Configuration Example) (1) System FIG. 1 is a diagram showing an example of the configuration of an information transfer system according to one embodiment of the present invention.
[0016] In one embodiment of the information transfer system, as a basic configuration, a transmitting device TX divides information to be transferred, such as content or its additional information, into multiple pieces, and sequentially displays two-dimensional codes of each piece of divided information as a moving image at a predetermined frame rate. In response to this, a receiving device RX reads the images of each of the two-dimensional codes displayed as a moving image using a camera, recognizes each of the two-dimensional codes from the images of the read two-dimensional codes, decodes them, and reproduces the information to be transferred.
[0017] (2) Transmitting Device TX The transmitting device TX is, for example, a personal computer. Note that, in addition to a personal computer, a mobile terminal such as a smartphone or a tablet terminal may also be used as the transmitting device TX.
[0018] 2 and 3 are block diagrams showing an example of the hardware configuration and software configuration of the transmitting device TX, respectively.
[0019] The transmitting device TX includes a control unit 1 that uses a hardware processor such as a central processing unit (CPU), and a storage unit having a program storage unit 2 and a data storage unit 3, and an input / output interface unit 4 are connected to the control unit 1 via a bus 5. Note that hereinafter, the interface will be abbreviated as I / F.
[0020] An input device 6 such as a keyboard and a mouse, and a display device 7 such as a liquid crystal display are connected to the input / output I / F unit 4. The input / output I / F unit 4 has a function of taking in operation information input at the input device 6 and a function of outputting display information to the display device 7 for display.
[0021] It should be noted that a camera, an audio device, an external storage device, etc. may also be connected to the input / output I / F unit 4. A communication I / F unit may also be provided in the input / output I / F unit 4. The communication I / F unit is used to transfer information between a server device on the Web or on the cloud and other terminal devices via a network (not shown).
[0022] The program storage unit 2 is, for example, a combination of a nonvolatile memory such as a solid-state drive (SSD) as a storage medium that can be written to and read from at any time, and a nonvolatile memory such as a read-only memory (ROM), and stores middleware such as an operating system (OS), as well as application programs required to execute each control process according to an embodiment. Hereinafter, the OS and each application program will be collectively referred to as the program.
[0023] The data storage unit 3 is a combination of a nonvolatile memory such as an SSD that can be written to and read from at any time, and a volatile memory such as a RAM (Random Access Memory), and the storage area thereof is provided with a data storage unit 31. The data storage unit 31 is used to store information to be transferred, such as content and its additional information.
[0024] The control unit 1 includes a data division processing unit 11, a two-dimensional code generation processing unit 12, a switching detection marker addition processing unit 13, and a two-dimensional code display control processing unit 14 as processing functions necessary to implement one embodiment.
[0025] These processing units 11 to 14 are all realized by causing a hardware processor in the control unit 1 to execute an application program stored in the program storage unit 2. Note that some or all of the processing units 11 to 14 may be realized using hardware such as an LSI (Large Scale Integration) or an ASIC (Application Specific Integrated Circuit).
[0026] The data division processing unit 11 divides the transfer target information stored in the data storage unit 31 into multiple pieces of information each having a predetermined data length. This division process generates multiple pieces of divided information. The data length, which is the unit of division, is set so that the display size of the two-dimensional code obtained by encoding each piece of divided information does not excessively restrict the display area of other display information.
[0027] The two-dimensional code generation processing unit 12 converts each of the division information into a two-dimensional code.
[0028] The switching detection marker addition processing unit 13 generates a switching detection marker used to detect the switching progress rate during the display switching period of the two-dimensional code, and adds the generated switching detection marker to each two-dimensional code to be transmitted, generated by the two-dimensional code generation processing unit 12.
[0029] The switching detection markers consist of a first switching detection marker MKa to be added to two-dimensional codes whose transmission order is odd-numbered, and a second switching detection marker MKb to be added to two-dimensional codes whose transmission order is odd-numbered. An example of the switching detection markers MKa and MKb will be described in the operation example.
[0030] The two-dimensional code display control processing unit 14 sequentially displays the two-dimensional codes to which the switching detection markers have been added on the display device 7 as moving images at a preset display switching speed, that is, a frame rate.
[0031] (3) Receiving Device RX The receiving device RX is configured by, for example, a smartphone. Note that, in addition to a smartphone, a tablet terminal, a personal computer, or the like may also be used as the receiving device RX. Furthermore, a camera without a web access function may also be used as the receiving device RX.
[0032] 4 and 5 are block diagrams showing an example of the hardware configuration and software configuration of the receiving device RX, respectively.
[0033] The receiving device RX has a control unit 10 that uses a hardware processor such as a CPU, just like the transmitting device TX, and is connected to this control unit 10 via a bus 50 with a memory unit having a program memory unit 20 and a data memory unit 30, and an input / output I / F unit 40.
[0034] A UI device in which an input device 60 using a pressure-sensitive or capacitance touch input sheet is superimposed on the display screen of a display device 70 using, for example, a liquid crystal or organic EL is connected to the input / output I / F unit 40. The input / output I / F unit 40 takes in operation information inputted at the input device 60 and outputs display information to the display device 70 for display.
[0035] Furthermore, a camera 80 serving as an imaging device is connected to the input / output I / F unit 40. The camera 80 is used to read images of each two-dimensional code displayed as a moving image on the display device 7 of the transmission device TX.
[0036] The receiving device RX may be provided with a communication I / F unit for transferring information between a server device on the Web or on the cloud or other terminal devices via a network (not shown).
[0037] The program storage unit 20 uses, for example, a nonvolatile memory such as an SSD as a storage medium that can be written to and read from at any time, and stores application programs necessary for executing each control process according to an embodiment, in addition to middleware such as an OS. Hereinafter, the OS and each application program will be collectively referred to as the program.
[0038] The data storage unit 30 is a combination of a non-volatile memory such as an SSD that can be written to and read from at any time, and a volatile memory such as a RAM, and its storage area includes a camera image storage unit 301, a read success code storage unit 302, a read failure code storage unit 303, and a playback information storage unit 304.
[0039] The camera image storage unit 301 is used to store image data of the two-dimensional code captured by the camera. The reproduction information storage unit 304 is used to store information to be transferred that has been reproduced by decoding and combining the two-dimensional code.
[0040] The successfully read code storage unit 302 is used to temporarily store two-dimensional codes that have been recognized without error during the reading process as reference data for correcting two-dimensional codes that have failed to be read.
[0041] The unsuccessfully read code storage unit 303 is used to temporarily store two-dimensional codes that have failed to be read as codes that require correction.
[0042] The reproduced information storage unit 304 is used to store the transfer target information reproduced by decoding and combining the two-dimensional code.
[0043] The control unit 10 includes a camera image acquisition processing unit 101, a two-dimensional code identification processing unit 102, a correction management unit 103, and a data reproduction processing unit 104 as processing functions necessary to implement one embodiment.
[0044] These processing units 101 to 104 are all realized by causing the hardware processor of the control unit 10 to execute application programs stored in the program storage unit 20 .
[0045] The camera image acquisition processing unit 101 captures moving image data of the two-dimensional code captured by the camera 80 via the input / output I / F unit 40, and temporarily stores the captured moving image data of the two-dimensional code in the camera image storage unit 301.
[0046] The two-dimensional code identification processing unit 102 identifies a two-dimensional code image for each frame from the image data stored in the camera image storage unit 301 .
[0047] The correction management unit 103 corrects a two-dimensional code that has failed to be read by using a switching detection marker added to the two-dimensional code and the two-dimensional code that was successfully read one code before or one code after the code that failed to be read, and is equipped with a decoding processing unit 1031, a switching progress rate calculation processing unit 1032, and a code correction processing unit 1033.
[0048] The decoding processing unit 1031 decodes each two-dimensional code identified by the two-dimensional code identification processing unit 102 to determine whether reading has been successful or unsuccessful.
[0049] The switching progress rate calculation processing unit 1032 calculates the switching progress rate during the two-dimensional code display switching period based on the change in brightness of the switching detection marker added to the two-dimensional code that has failed to be read.
[0050] The code correction processing unit 1033 corrects the brightness of the two-dimensional code that failed to be read, based on the previous or next two-dimensional code that was successfully read and the calculated switching progress rate.
[0051] An example of the two-dimensional code correction management process by the correction management unit 103 will be described in the operation example.
[0052] The data reproduction processing unit 104 restores the divided information by respectively decoding the two-dimensional codes that were successfully read and the two-dimensional codes that were unsuccessfully read but were corrected by the correction management unit 103. The data reproduction processing unit 104 then combines the restored divided information to restore the transfer target information before transmission, and stores the restored transfer target information in the reproduction information storage unit 304.
[0053] (Example of Operation) Next, an example of operation of the information transfer system configured as above will be described.
[0054] (1) Operation of the Transmitting Device TX FIG. 6 is a flowchart showing an example of the processing procedure and processing contents of the two-dimensional code display processing executed by the control unit 1 of the transmitting device TX.
[0055] In this example, the explanation will be given assuming that the information to be transferred, such as main information of the content or its additional information, is created in advance, for example, within the transmitting device TX, or obtained from a website, etc., and stored in advance in the data storage unit 31.
[0056] (1-1) Division of Information to be Transferred Under the control of the data division processing unit 11, the control unit 1 of the transmission device TX first determines the number of divisions K of the information to be transferred in accordance with the constraints of the display size of the two-dimensional code in step S10. Then, in step S11, the information to be transferred stored in the data storage unit 31 is divided into the K pieces of information. Note that the information to be transferred may be divided into K pieces of information in advance.
[0057] (1-2) Addition of Switch Detection Marker In step S12, the control unit 1 of the transmission device TX monitors whether a display termination request has been input by the user, and terminates the process if the display termination request has been input. On the other hand, if the display termination request has not been input, the two-dimensional code generation and display process is executed as follows.
[0058] That is, first, in step S13, the control unit 1 of the transmission device TX converts each of the divided information items into a two-dimensional code by the two-dimensional code generation processing unit 12.
[0059] Next, under the control of the switching detection marker addition processing unit 13, the control unit 1 of the transmission device TX determines in step S14 whether the display order of each of the two-dimensional codes is odd or even. If it is odd, an odd-numbered switching detection marker MKa is selected in step S15, and the selected switching detection marker MKa is added opposite the top and left sides of the two-dimensional code in step S17. On the other hand, if it is even, an even-numbered switching detection marker MKb is selected in step S16, and the selected switching detection marker MKb is added opposite the bottom and right sides of the two-dimensional code in step S17.
[0060] 10 shows an example of the addition of a switching detection marker MKa to be added to the odd-numbered two-dimensional codes and a switching detection marker MKb to be added to the even-numbered two-dimensional codes. As shown in the figure, a switching detection marker MKa having a shape obtained by inverting an L-pattern upside down is selected and added to the odd-numbered two-dimensional codes, and a switching detection marker MKb having a shape obtained by inverting an L-pattern left to right is selected and added to the even-numbered two-dimensional codes.
[0061] The size and position of the switching detection markers MKa and MKb are set, for example, as shown in Fig. 11. That is, the width W of the switching detection markers MKa and MKb is set to a width that can be read sufficiently by a reading device. For example, if the two-dimensional code is composed of multiple uniformly sized rectangular cells, the width W is set to be equal to the width of one of these cells.
[0062] The positions at which the switching detection markers MKa and MKb are added are set so as to separate them from the two-dimensional code by a necessary and sufficient margin area M so as not to impede reading of the two-dimensional code. For example, if the two-dimensional code is composed of multiple uniformly sized rectangular cells as described above, the margin area M is set to twice the width W of the switching detection markers MKa and MKb.
[0063] The length of one side (outer side) of the switching detection markers MKa and MKb is set to the length of the side of the two-dimensional code plus the blank area M and the width W of the switching detection marker. For example, if the length of the side of the two-dimensional code is N, the length is set to N+M+W.
[0064] The densities of the switching detection markers MKa and MKb are set uniformly so that the luminance when read is uniformly the minimum luminance.
[0065] (1-3) Display of two-dimensional code and switching detection marker Subsequently, under the control of the two-dimensional code display control processing unit 14, in step S18, the control unit 1 of the transmission device TX outputs and displays the two-dimensional code to which the switching detection markers MKa and MKb have been added to the display device 7 via the input / output I / F unit 4. Then, each time one two-dimensional code is displayed, the control unit 1 of the transmission device TX waits for t seconds in step S19, and then returns to step S12 to generate a two-dimensional code for the next divided information, generate and add switching detection markers, and perform the display processing.
[0066] As a result, two-dimensional codes corresponding to the division information are displayed on the display device 7 of the transmitting device TX at intervals of t seconds, with switching detection markers MKa and MKb with different pattern shapes added alternately for odd-numbered and even-numbered codes, and are displayed sequentially as if they were moving images.
[0067] (2) Operation of Receiving Device RX FIG. 7 is a flowchart showing an example of the processing procedure and processing content of the two-dimensional code reproduction processing executed by the control unit 10 of the receiving device RX.
[0068] (2-1) Acquisition of Camera Image and Identification of Two-dimensional Code First, in step S10, the control unit 10 of the receiving device RX monitors the user's operation to read the two-dimensional code. Then, when the reading operation is detected, under the control of the camera image acquisition processing unit 101, the camera 80 is started and the reading process of the two-dimensional code displayed on the display device 7 of the transmitting device TX is started.
[0069] In the reading process, the control unit 10 of the receiving device RX sequentially takes in the moving image data of the two-dimensional code captured by the camera 80 via the input / output I / F unit 40 and stores it in the camera image storage unit 301 in step S21.
[0070] Next, under the control of the two-dimensional code identification processing unit 102, the control unit 10 of the receiving device RX reads the moving image data of the two-dimensional code frame by frame from the camera image storage unit 301. Then, each of the read frame images is binarized in step S22, and a two-dimensional code image is obtained in step S23.
[0071] The two-dimensional code identification processing unit 102 detects the specific pattern of each two-dimensional code from each two-dimensional code image. For example, if the two-dimensional code is a QR Code (registered trademark), it detects its finder pattern. Then, in step S24, it determines whether or not the finder pattern has been detected. If not, the process returns to step S21 via step S20, and the acquisition of the camera image and the two-dimensional code identification process in steps S21 to S24 are repeated.
[0072] (2-2) Two-dimensional code correction management process When the receiver RX reads the two-dimensional code displayed as a moving image, depending on the timing of the reading, the two-dimensional code may be read during the switching period between two adjacent two-dimensional codes. In this case, it is expected that the brightness (density) of the cells of the read two-dimensional code will be an intermediate color.
[0073] 12 shows an example in which the brightness (density) of the two-dimensional code read during the switching period becomes an intermediate color. In this state, if the two-dimensional code is binarized using a single fixed threshold value, the recognition accuracy of the two-dimensional code will decrease.
[0074] Therefore, in step S30, the control unit 10 of the receiving device RX, under the control of the correction management unit 103, executes the following process to correct the intermediate color that appears in the two-dimensional code to the correct brightness (density) based on the brightness of the previous two-dimensional code that was successfully read.
[0075] 8 and 9 are flowcharts showing an example of the processing procedure and processing content of the two-dimensional code correction management processing executed by the correction management unit 103. Also, Fig. 12 is a diagram showing an outline of the correction management processing.
[0076] (2-2-1) Determining Whether Correction is Necessary Each time one of the two-dimensional codes is read, the correction management unit 103 first decodes the two-dimensional code in step S301 using the decoding processing unit 1031. Then, in step S302, the correction management unit 103 performs error correction processing or a parity check on the decoded data to determine whether there is an error, and determines whether the two-dimensional code has been successfully read.
[0077] (2-2-2) When Reading is Successful If it is determined in step S302 that reading is successful, the correction management unit 103 stores the successfully read two-dimensional code in the successfully read code storage unit 302 in step S303.
[0078] Next, in step S304, the correction management unit 103 determines whether or not a two-dimensional code that failed to be read is stored in the read failure stack provided in the read failure code storage unit 303, and if a two-dimensional code that failed to be read is not stored, the correction management process ends.
[0079] On the other hand, if two-dimensional codes that have failed to be read are stored in the read failure stack, in step S305 the correction management unit 103 reads one of the two-dimensional codes that have failed to be read from the read failure stack, and performs the following correction process on the two-dimensional code that has been read.
[0080] That is, in step S306, the correction management unit 103 first calculates the switching progress rate using the switching progress rate calculation processing unit 1032. This switching progress rate is calculated by detecting a change in brightness of the switching detection marker added to the two-dimensional code to be corrected that failed to be read.
[0081] FIG. 14 is a diagram illustrating an example of the switching progress rate calculation process. For example, the two-dimensional code to be corrected, including the switching detection marker, is first transformed into data in the front direction using affine transformation or the like, and the size is also transformed in the same way. Next, for the cell (brightness Lc) in the two-dimensional code for which the switching progress rate is to be calculated, the brightness Lx of the portion of the switching detection marker whose position on the x-coordinate corresponds to the reference cell and the brightness Ly of the portion whose position on the y-coordinate corresponds to the reference cell are detected. The brightness L0 of the corners of the switching detection marker is also detected, and the minimum brightness Ll and maximum brightness Lh of the cell in the two-dimensional code are also detected.
[0082] Then, the switching progress rate calculation processing unit 1032 calculates the switching progress rate a for the reference cell by the following formula: a = |Lx + Ly - L0| / (Lh - Ll) However, if the switching progress rate a is a < 0 or a > 1, a is corrected so that 0 ≦ a ≦ 1.
[0083] Subsequently, in step S307, the correction management unit 103 calculates a correction value L for the luminance Lc of the cell of the two-dimensional code to be corrected by the code correction processing unit 1033 based on the calculated switching progress rate a and the luminance of the immediately previous two-dimensional code that was successfully read, using the following formula: L = Lh + (Lc - Lh) / a, and corrects the luminance of the cell from Lc to L. A specific example of the correction value is shown in Figure 14.
[0084] Finally, in step S308, the correction management unit 103 decodes the brightness-corrected two-dimensional code again using the decoding processing unit 1031, and determines whether or not there is an error in the decoded data. If no error is detected, the correction management unit 103 determines in step S309 that the correction was successful, and returns to step S303 to overwrite and save the corrected two-dimensional code in the read success code storage unit 302.
[0085] If uncorrected read failure codes are stored in the read failure code storage unit 303, the correction management unit 103 repeatedly executes the correction process in steps S305 to S309 for each of these read failure codes.
[0086] FIG. 15 shows an example of the operation when multiple failed read codes CD1 to CD3 are stored in the failed read stack, and corrections are made sequentially to the failed read codes based on the two-dimensional codes that were successfully read.
[0087] If the correction is not successful, the correction management unit 103 discards the two-dimensional code that failed to be corrected from the read failure stack in the read failure code storage unit 303 in step S310.
[0088] (2-2-3) When Reading Fails If it is determined in step S302 that reading has failed, the correction management unit 103 executes the correction process as follows.
[0089] That is, first, in step S311, the correction management unit 103 determines whether or not the immediately preceding two-dimensional code that was successfully read is stored in the read success code storage unit 302. If the result of this determination is that the successfully read two-dimensional code is not stored, the correction management unit 103 stores the two-dimensional code that failed to be read in the read failure code storage unit 303 in step S317.
[0090] On the other hand, suppose that the previous successfully read two-dimensional code is stored in the successfully read code storage unit 302. In this case, in step S312, the correction management unit 103 calculates a switching progress rate for the two-dimensional code that failed to be read by the switching progress rate calculation processing unit 1032. This calculation process of the switching progress rate is performed in the same manner as the method previously described in step S306 using FIG. 14 .
[0091] Next, in step S313, the correction management unit 103 corrects the brightness of each cell of the two-dimensional code that failed to be read, based on the calculated switching progress rate a and the brightness of the immediately preceding two-dimensional code that was successfully read, using the code correction processing unit 1033. This code correction processing is also performed in the same manner as the method previously described in step S307 using FIG.
[0092] Finally, in step S314, the correction management unit 103 decodes the brightness-corrected two-dimensional code again using the decoding processing unit 1031, and determines whether or not there is an error in the decoded data. If no error is detected, the correction management unit 103 determines in step S315 that the correction was successful, and in step S316 overwrites and saves the corrected two-dimensional code in the read success code storage unit 302.
[0093] On the other hand, if an error is still detected in the corrected two-dimensional code, the correction management unit 103 stores the corrected two-dimensional code in the read failure code storage unit 303 in step S317.
[0094] (2-2-4) Dealing with Rolling Shutter Binary code images can be affected by the rolling shutter phenomenon that occurs due to the camera's scanning method, and the pixel brightness (density) can change linearly in the horizontal or vertical direction. In this case, if the binary code image is binarized using a single fixed threshold value, the recognition accuracy of the 2D code will decrease.
[0095] However, even for two-dimensional codes that have failed to be read due to the effects of the rolling shutter phenomenon, the correction management unit 103 corrects the brightness based on the brightness of the two-dimensional codes that were successfully read before and after and the switching progress rate calculated from the switching detection markers MKa and MKb added to the two-dimensional code that failed to be read, just as in the case of two-dimensional codes that failed to be read due to a change in brightness during the switching period described above. Note that in this example, the switching detection markers MKa and MKb have a shape that is an L-shaped pattern that is inverted vertically or horizontally, so that correction can be made not only in the horizontal direction of the two-dimensional code but also in the vertical direction.
[0096] (2-3) Reproduction of Transfer Target Information In step S25, the control unit 10 of the receiving device RX receives the two-dimensional code determined to have been successfully read by the correction management unit 103 and the corrected two-dimensional code, and decodes each of the received two-dimensional code data to reproduce the respective divided information under the control of the data reproduction processing unit 104. Then, the data reproduction processing unit 104 combines the stored divided information to reproduce the transfer target information before division, and stores the reproduced transfer target information in the reproduced information storage unit 304.
[0097] The reproduced transfer target information is read from the reproduced information storage unit 304 in response to, for example, a display operation by the user, and is displayed on the display device 70 of the receiving device RX.
[0098] (Actions and Effects) As described above, in one embodiment, the transmitting device TX alternately adds odd-numbered and even-numbered switching detection markers MKa and MKb to each generated two-dimensional code in the order in which they are displayed, and the two-dimensional codes to which the switching detection markers MKa and MKb are added are displayed as moving images at regular time intervals t on the display device 7. Meanwhile, the receiving device RX determines whether the two-dimensional code read by the camera 80 was successfully read, and corrects the brightness of a two-dimensional code that failed to be read based on the brightness of the two-dimensional codes that were successfully read before and after it, and the switching progress rate calculated from the switching detection markers MKa and MKb added to the two-dimensional code that failed to be read.
[0099] Therefore, even if the reading of a two-dimensional code fails due to the brightness becoming intermediate during the switching period when the two-dimensional code is displayed as a moving image, or due to the effects of the rolling shutter phenomenon, it is possible to correct the two-dimensional code that failed to be read based on the switching progress rate detected by the switching detection marker, thereby improving data transfer efficiency while maintaining a high recognition rate.
[0100] [Other embodiments] (1) In one embodiment, an example was described in which an L-shaped pattern that is inverted vertically or horizontally is used as the switching detection markers MKa and MKb. However, for example, when using a reading device that does not require measures against rolling shutter, it is also possible to use a linear pattern that corresponds only to the left and right sides of the two-dimensional code.
[0101] (2) The types and configurations of the transmitting device and receiving device, the processing procedures and contents of the two-dimensional code display process representing the information to be transferred performed by the transmitting device and the two-dimensional code reproduction process performed by the receiving device, the types and configurations of the information to be transferred, the types of two-dimensional codes, etc. can be modified and implemented in various ways within the scope of the gist of this invention.
[0102] Although the embodiments of the present invention have been described in detail above, the above description is merely an example of the present invention in every respect. It goes without saying that various improvements and modifications can be made without departing from the scope of the present invention. In other words, when implementing the present invention, specific configurations according to the embodiments may be appropriately adopted.
[0103] In short, this invention is not limited to the above-described embodiments, and in the implementation stage, the components can be modified and embodied without departing from the spirit of the invention. Furthermore, various inventions can be formed by appropriately combining multiple components disclosed in the above-described embodiments. For example, some components may be omitted from all the components shown in the embodiments. Furthermore, components from different embodiments may be appropriately combined.
[0104] TX...Transmitting device RX...Receiving device 1, 10...Control unit 2, 20...Program storage unit 3, 30...Data storage unit 4, 40...Input / output I / F unit 5, 50...Bus 6, 60...Input device 7, 70...Display device 80...Camera 11...Data division processing unit 12...Two-dimensional code generation processing unit 13...Switching detection marker addition processing unit 14...Two-dimensional code display control processing unit 31...Data storage unit 101...Camera image acquisition processing unit 102...Two-dimensional code identification processing unit 103...Correction management unit 1031...Decoding processing unit 1032...Switching progress rate calculation processing unit 1033...Code correction processing unit 104...Data reproduction processing unit 301...Camera image storage unit 302...Reading success code storage unit 303...Reading failure code storage unit 304...Reproduction information storage unit
Claims
1. An information transfer system for transferring information to be transferred from a transmitting device to a receiving device using a two-dimensional code, the transmitting device comprising: a first processing unit for dividing the information to be transferred into a plurality of divided pieces of information; a second processing unit for converting each of the divided pieces of information into a two-dimensional code; a third processing unit for adding to the two-dimensional codes a switching detection marker for detecting a switching progress rate during a display switching period between the two-dimensional codes, the switching detection marker being positioned in a predetermined relationship with the two-dimensional code; and a fourth processing unit for sequentially displaying the two-dimensional codes to which the switching detection marker has been added on a display device at a preset display switching speed; the receiving device comprising: a fifth processing unit for acquiring, from an imaging device, image information obtained by reading the two-dimensional codes sequentially displayed on the display device with an imaging device; a sixth processing unit for determining whether each of the received two-dimensional codes represented by the image information was successfully read and for storing the received two-dimensional codes separately into a first two-dimensional code that was successfully read and a second two-dimensional code that was unsuccessfully read based on the determination result; an eighth processing unit that detects the switching progress rate related to the second two-dimensional code based on the switching detection marker added to the second two-dimensional code, and corrects the second two-dimensional code based on the detected switching progress rate; and an eighth processing unit that regenerates the divided information based on the first two-dimensional code and the corrected second two-dimensional code, and combines the regenerated divided information to regenerate the information to be transferred.
2. The information transfer system of claim 1, wherein the third processing unit adds the switching detection marker in a first positional relationship to the two-dimensional codes that are odd-numbered in the display order, and adds the switching detection marker in a second positional relationship to the two-dimensional codes that are even-numbered.
3. The information transfer system of claim 1, wherein the third processing unit uses a linear image pattern of uniform density as the switching detection marker, the length of which is set to correspond to the length of one side of the two-dimensional code, and the linear image pattern is positioned opposite at least one side of the two-dimensional code at a predetermined distance.
4. The information transfer system of claim 1, wherein the seventh processing unit detects the switching progress rate for the second two-dimensional code based on a linear change in brightness of the switching detection marker, and corrects the brightness of the second two-dimensional code based on the detected switching progress rate and the brightness of the first two-dimensional code that is successfully read before and after the second two-dimensional code.
5. A transmitting device used in an information transfer system that transfers information to be transferred from a transmitting device to a receiving device using a two-dimensional code, comprising: a first processing unit that divides the information to be transferred into a plurality of divided pieces of information; a second processing unit that converts each of the divided pieces of information into a two-dimensional code; a third processing unit that adds switching detection markers to the two-dimensional codes in a state having a predetermined positional relationship with the two-dimensional codes, for detecting a switching progress rate during a display switching period between the two-dimensional codes; and a fourth processing unit that sequentially displays the two-dimensional codes with the switching detection markers added on a display device at a preset display switching speed.
6. A receiving device which reads the two-dimensional codes displayed on the transmitting device of claim 5 and reproduces the information to be transferred, comprising: a fifth processing unit which acquires image information obtained by reading the two-dimensional codes displayed sequentially on the display device with an imaging device from the imaging device; a sixth processing unit which judges whether each of the received two-dimensional codes represented by the image information was successfully read and, based on the judgment result, separates the received two-dimensional codes into a first two-dimensional code which was successfully read and a second two-dimensional code which was unsuccessfully read, and stores the separated codes; a seventh processing unit which detects the switching progress rate for the second two-dimensional code based on the switching detection marker added to the second two-dimensional code, and corrects the second two-dimensional code based on the detected switching progress rate; and an eighth processing unit which reproduces the divided information based on the first two-dimensional code and the second two-dimensional code after the correction, and combines the reproduced divided information to reproduce the information to be transferred.
7. An information transfer method executed by a system that transfers information to be transferred from a transmitting device to a receiving device using a two-dimensional code, comprising: a step by the transmitting device dividing the information to be transferred into a plurality of divided pieces of information; a step by the transmitting device converting each of the divided pieces of information into a two-dimensional code; a step by the transmitting device adding to the two-dimensional codes a switching detection marker for detecting a switching progress rate during a display switching period between the two-dimensional codes, the switching detection marker being positioned in a predetermined relationship with the two-dimensional code; a step by the transmitting device sequentially displaying the two-dimensional codes to which the switching detection marker has been added at a preset display switching speed on a display device; a step by the receiving device acquiring, from an imaging device, image information obtained by reading the two-dimensional codes displayed sequentially on the display device with an imaging device; a step by the receiving device determining whether each of the received two-dimensional codes represented by the image information was successfully read and, based on the determination result, storing the received two-dimensional codes separately into a first two-dimensional code that was successfully read and a second two-dimensional code that was unsuccessfully read; an information transfer method comprising: a step of the receiving device detecting the switching progress rate related to the second two-dimensional code based on the switching detection marker added to the second two-dimensional code, and correcting the second two-dimensional code based on the detected switching progress rate; and a step of the receiving device reproducing the divided information based on the first two-dimensional code and the corrected second two-dimensional code, and combining the reproduced divided information to reproduce the information to be transferred.
8. A program for causing a processor included in the receiving device to execute at least one of the processes performed by the fifth to eighth processing units included in the receiving device according to claim 6.
Citation Information
Patent Citations
Bar code preparing device, bar code reading device, and moving image bar code
JP2004078351A
Image processor
JP2006246136A
Information transfer system and information transfer method
JP2007156969A
Two-dimensional color code display device and display method for the same, and two-dimensional color code reading device and reading method for the same
JP2014235676A
