Information processing device, method for controlling the information processing device, and program

Abstract

Improving the usability of information processing devices that use encoded information as input. [Solution] The information processing device includes: a determination means for determining a reading device for reading encoded information from among a plurality of reading devices that can be connected to the information processing device; a display control means for displaying a guide screen on a display unit corresponding to the reading device determined by the determination means from among the plurality of connectable reading devices; and a control means for performing control to read the encoded information using the determined reading device.

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus, a control method for an information processing apparatus, and a program.

Background Art

[0002] In recent years, as a method of inputting information in an information processing apparatus, a predetermined code such as a QR code (registered trademark) in which information is encoded (hereinafter referred to as a two-dimensional code) has been used. In an image forming apparatus such as an MFP (Multifunction Peripheral) which is an example of an information processing apparatus, a two-dimensional code storing job setting information such as copy or print, or login information can be used as information input. Patent Document 1 discloses a technique for logging in to an image forming apparatus using a two-dimensional code.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Improvement in convenience in an information processing apparatus using encoded information as input information is required.

Means for Solving the Problems

[0005] An information processing device according to one aspect of the present disclosure is characterized by comprising: a determination means for determining a reading device for reading encoded information from among a plurality of reading devices that can be connected to the information processing device; a display control means for displaying a guide screen on a display unit corresponding to the reading device determined by the determination means from among the plurality of connectable reading devices; and a control means for performing control to read the encoded information using the reading device determined by the determination means. [Effects of the Invention]

[0006] According to this disclosure, it is possible to improve the convenience of an information processing device that uses encoded information as input information. [Brief explanation of the drawing]

[0007] [Figure 1] This is a block diagram showing the hardware configuration of an image forming apparatus. [Figure 2] This is a block diagram showing the software configuration of an image forming apparatus. [Figure 3] This figure shows an example of the operation screen of an image forming apparatus. [Figure 4] This figure shows an example of a 2D code. [Figure 5] This flowchart shows an example of how an application processes data. [Figure 6] This flowchart details the process of determining the code reading device. [Figure 7] This flowchart shows the details of the code reading process that performs the reading of 2D codes. [Figure 8] This figure shows an example of a code reading guide screen. [Figure 9] This figure shows an example of a code read error screen. [Figure 10] This figure shows an example of a 2D code. [Figure 11] This flowchart shows the details of the code reading process that performs the reading of 2D codes. [Figure 12] It is a diagram showing a code reading guide screen. [Figure 13] It is a block diagram showing the hardware configuration of an image forming apparatus. [Figure 14] It is a flowchart showing the details of the reading device determination process. [Figure 15] It is a flowchart showing the details of the process for executing the code reading process. [Figure 16] It is a diagram showing an example of a code reading guide screen. [Figure 17] It is a flowchart showing the details of the reading device determination process. [Figure 18] It is a diagram showing an example of a code reading guide screen. [Figure 19] It is a flowchart showing the details of the device determination process. [Figure 20] It is a flowchart showing the details of the reading device determination process. [Figure 21] It is a flowchart showing the details of the process for executing the code reading process. [Figure 22] It is a diagram showing an example of a code reading guide screen.

Embodiments for Carrying Out the Invention

[0008] Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the matters of the present disclosure, and not all combinations of the features described in the following embodiments are essential for the solution means of the present disclosure. The same reference numerals are assigned to the same components.

[0009] <<First Embodiment>> <Overview> As a method of inputting information in an information processing apparatus, a two-dimensional code in which information is encoded is used. As a device for reading a two-dimensional code in an information processing apparatus, there are a general-purpose camera such as a web camera, or a dedicated device (hereinafter referred to as a code scanner) for reading a one-dimensional code or a two-dimensional code such as a barcode. Such code reading devices such as two-dimensional code cameras and code scanners have diversified in recent years. Therefore, when a user is made to read a two-dimensional code in an information processing apparatus, a method of holding the two-dimensional code suitable for each of the various reading devices installed in the information processing apparatus is required. For example, when both a camera and a code scanner can be installed in the information processing apparatus, if there is no reading instruction suitable for each two-dimensional code reading device, the operability of the user may be impaired.

[0010] As described above, an improvement in convenience in an information processing apparatus that uses encoded information as input information is required. In the present embodiment, an example will be described in which, according to the type of two-dimensional code reading device used in the information processing apparatus, a two-dimensional code reading guide suitable for the two-dimensional code reading device is notified to the user. As a result, the operability of the user is not impaired, and the user can easily execute two-dimensional code reading in the information processing apparatus. Hereinafter, the configuration of a specific embodiment will be described.

[0011] <Configuration> Figure 1 is a block diagram showing the hardware configuration of an image forming apparatus, which is an example of an information processing apparatus according to this embodiment. Figure 1(a) shows an example configuration in which a camera is provided as a two-dimensional code reading device connected to the information processing apparatus. Figure 1(b) shows an example configuration in which a code scanner is provided as a two-dimensional code reading device connected to the information processing apparatus. In this embodiment, an image forming apparatus 100 is used as an example of an information processing apparatus. The image forming apparatus is, for example, an MFP (Multi-Function Printer). Note that this embodiment is not limited to image forming apparatuses such as MFPs, but can be applied to various information processing apparatuses equipped with code reading processing functions, such as computers.

[0012] The hardware configuration of the image forming apparatus 100 connected to a camera will be explained using Figure 1(a). The image forming apparatus 100 is an MFP equipped with various job execution functions such as printer function, copy function, and scanner function. The image forming apparatus 100 has a control unit 110, an operation unit 120, a printer 121, and a scanner 122.

[0013] The control unit 110 includes a CPU 111, ROM 112, RAM 113, HDD 114, operation interface 115, printer interface 116, scanner interface 117, USB interface 118, and network interface 119. Each component within the control unit 110 is connected by a system bus (not shown).

[0014] The CPU 111 controls the entire system of the image forming apparatus 100. The ROM 112 stores the system's boot program. The RAM 113 is the system work memory for the CPU 111 to operate, and is a memory for temporarily storing print image data, scanned image data, and setting data. The RAM 113 also stores programs and data such as the operating system, system software, and application software. The HDD 114 stores the operating system, system software, application software, and various image data.

[0015] The operation unit I / F 115 is an interface unit with the operation unit 120, outputting screen data to be displayed on the touch panel display screen of the operation unit 120 and receiving information entered by the user via the touch panel. The operation unit 120 is a display unit that displays screen information output from the control unit 110, and also a reception unit that receives operations from the user.

[0016] The printer interface 116 is the interface unit for printer 121. The scanner interface 117 is the interface unit for scanner 122. The control unit 110 controls scanner 122 via scanner interface 117 to acquire image data of a document, and controls printer 121 via printer interface 116 to print the image onto paper.

[0017] The USBI / F118 is an interface unit for USB devices connected to the image forming apparatus 100 from outside. In Figure 1(a), a camera 140 is connected to the USBI / F118. The camera 140 is a camera device such as a webcam and can capture images or videos of the area around the image forming apparatus 100. The control unit 110 controls the camera 140's shooting via the USBI / F118. The captured image data captured by the camera 140 is stored in the RAM 113 or HDD 114. Applications running in the image forming apparatus 100 can use the captured image data stored in the RAM 113 or HDD 114 to perform processing using the camera images.

[0018] In this embodiment, it is assumed that the camera 140 uses a USB device compliant with the UVC (UsbVideoClass) standard. UVC is a camera driver provided by the operating system and has an interface for controlling camera shooting via system calls.

[0019] The network interface 119 is the interface unit with the network 130 and controls communication between the image forming apparatus 100 and an information processing device or cloud server connected to the network. The network 130 is, for example, the internet.

[0020] Next, the hardware configuration of the image forming apparatus 100 to which the code scanner 150 is connected will be explained using Figure 1(b). In Figure 1(b), the code scanner 150 is connected from outside the image forming apparatus 100 via the USBI / F118. The code scanner 150 is a code scanner device for reading one-dimensional codes or two-dimensional codes such as barcodes. The control unit 110 controls the code reading of the code scanner 150 via the USBI / F118. In this embodiment, it is assumed that the code scanner is a USB device conforming to the HID (Human Interface Device) Class standard. HID recognizes the code scanner 150 connected to the control unit 110 as a human interface device similar to a keyboard. Applications executed in the image forming apparatus 100 can acquire code reading data as input data, similar to keyboard input.

[0021] Figure 2 is a block diagram showing the software configuration of the image forming apparatus 100 according to this embodiment. Application 200 is software executed by the CPU 111 of the control unit 110 and is stored in ROM 112, RAM 113, or HDD 114, etc. Application 200 is a code-utilizing application that uses code. Application 200 includes a UI control unit 201, a code reading device control unit 202, a code reading control unit 205, a job control unit 206, and a code-utilizing application control unit 210.

[0022] The UI (User Interface) control unit 201 receives input operations from the user on the touch panel of the operation unit 120 and transmits the received data to various software within the application 200. The UI control unit 201 also receives responses from the various software within the application 200 and performs display control to create and display display screen data for the operation unit 120.

[0023] The code reading device control unit 202 includes a camera control unit 203 and a code scanner control unit 204, and controls the code reading device for reading 2D codes. Which code reading device, the camera control unit 203 or the code scanner control unit 204, is used is determined based on the connection status of the code reading control unit 205. For example, if the code reading control unit 205 is connected to the camera 140, the camera control unit 203 is used. If the code reading control unit 205 is connected to the code scanner 150, the code scanner control unit 204 is used.

[0024] The camera control unit 203 controls the startup and shutdown of the camera 140, and the start and stop of image or video recording. The camera control unit 203 transmits the image data captured by the camera 140 (hereinafter referred to as camera image data) to the UI control unit 201, so that the camera image data can be displayed on the display screen of the operation unit 120. The image shown by the camera image data is called a camera image or captured image. In addition, the camera control unit 203 transmits the camera image data, which includes a 2D code captured by the camera 140 as the subject, to the code reading control unit 205, so that the code reading control unit 205 can perform 2D code detection processing using the camera image.

[0025] Furthermore, the camera control unit 203 notifies the UI control unit 201 of the start and stop of camera 140 shooting. This notification allows the UI control unit 201 to display a status indicator on the display screen of the operation unit 120, showing that camera 140 is currently shooting.

[0026] Furthermore, the camera control unit 203 is not limited to code reading. Software within application 200 can perform processing using camera images or videos via the camera control unit 203 (for example, facial recognition login for the image forming apparatus 100). In addition, software within application 200 can perform processing to display camera images or videos on the screen or to display the status while the camera is capturing images via the UI control unit 201.

[0027] The code scanner control unit 204 controls the startup and shutdown of the code scanner 150 and acquires data from the 2D code detected by the code scanner 150.

[0028] The code reading control unit 205 analyzes the camera image data received from the camera control unit 203 and detects the position and shape of the 2D code contained in the camera image data. The code reading control unit 205 also analyzes the 2D code detected from the camera image data and obtains the data stored in the 2D code. The obtained data is transmitted to the code utilization application control unit 210.

[0029] Similarly, the code reading control unit 205 acquires the data stored in the 2D code detected by the code scanner control unit 204 and transmits it to the code utilization application control unit 210. The code reading control unit 205 can also determine whether the data stored in the 2D code is divided and stored in multiple 2D codes, and generate a single concatenated data from the detection results of multiple 2D codes.

[0030] The job control unit 206 includes a scan processing unit 207, a copy processing unit 208, and a print processing unit 209, and controls the scanner 122 and printer 121 to execute various jobs such as scanning, copying, and printing.

[0031] The code utilization application control unit 210 acquires data from the 2D code received from the code reading control unit 205 and executes various application processing using the acquired data. In this embodiment, the code utilization application control unit 210 includes a login processing unit 211, a job execution processing unit 212, and a payment processing unit 213. The login processing unit 211 executes login processing using user information such as username and password stored in the 2D code. The job execution processing unit 212 uses job setting information such as copy or print stored in the 2D code and executes job execution processing using the job setting information in the job control unit 206. The payment processing unit 213 uses payment information stored in the 2D code and executes payment processing for the job executed in the job control unit 206.

[0032] Figure 3 shows an example of the operation screen of the image forming apparatus 100 in this embodiment. Screen 300 in Figure 3 is the main menu screen displayed on the display screen of the operation unit 120 of the image forming apparatus 100. Screen 300 displays various buttons for executing login processing (Login 301), and for executing various jobs (Copy 302, Print 303, and Scan 304). Screen 300 also displays various buttons for executing various code-based applications (Code Payment Print 305, Code Payment Copy 306, and Code Job Execution 307).

[0033] The code payment print button 305 is a button for executing the processing of the payment processing unit 213. When the code payment print button 305 is pressed, the payment processing unit 213 performs the payment processing for the print job executed by the print processing unit 209 using the payment information stored in the 2D code.

[0034] The Code Payment Copy 306 is a button for executing the processing of the payment processing unit 213. When the Code Payment Print 305 is pressed, the payment processing unit 213 performs the payment processing for the copy job executed by the copy processing unit 208 using the payment information stored in the 2D code.

[0035] The Code Job Execution button 307 is a button used to execute the processing of the Job Execution Processing Unit 212. When the Code Job Execution button 307 is pressed, the Job Execution Processing Unit 212 executes various jobs using the job setting information stored in the two-dimensional code.

[0036] When the UI control unit 201 detects that any of the following buttons are pressed—login 301, code payment print 305, code payment copy 306, and code job execution 307—it displays a 2D code reading guide screen, described later, on the display screen of the operation unit 120. The code reading control unit 205 then starts the 2D code reading process, and various code-using applications are executed using the data from the 2D code reading result.

[0037] Figure 4 shows an example of a two-dimensional code according to this embodiment. In this embodiment, an example in which a two-dimensional code is used as encoded information is described. Furthermore, the QR code (registered trademark) is used as the two-dimensional code in the explanation. However, it is not limited to this example. Other types of one-dimensional or two-dimensional codes may be used as encoded information.

[0038] The 2D code 400 is a matrix-type 2D barcode, composed of black and white squares (called cells) as its smallest unit. As shown in the 2D code 400, various information such as format information and data, including position detection patterns, timing patterns, and error correction levels, is embedded as encoded information through the combination of cells.

[0039] Figure 5 is a flowchart illustrating an example of the processing of application 200 according to this embodiment. The processing shown in Figure 5 is realized by the CPU 111 of the image forming apparatus 100 functioning as each functional part of application 200 shown in Figure 2, as described above. That is, the flowchart in Figure 5 is realized by the CPU 111 reading a program stored in ROM 112 or HDD 114, etc., into RAM 113 and executing it. Note that some or all of the functions of the steps in Figure 5 may be realized by hardware such as ASICs or electronic circuits. The symbol "S" in the description of each process means that it is a step in the flowchart (the same applies to flowcharts in this specification hereafter).

[0040] Figure 5 is a flowchart of the entire process of application 200. More specifically, it is a flowchart of the process that uses a 2D code, which is encoded information, as input. The process shown in the flowchart in Figure 5 is initiated when one of the various code-using application buttons on screen 300 shown in Figure 3 is pressed. Specifically, the process shown in the flowchart in Figure 5 is initiated when one of the following is pressed: Login 301, Code Payment Print 305, Code Payment Copy 306, or Code Job Execution 307.

[0041] In S501, the code reading control unit 205 determines the code reading device to be used to read the 2D code. Details of the process in S501 will be described later with reference to Figure 6.

[0042] In S502, the code reading control unit 205 executes code reading processing by the camera control unit 203 or code scanner control unit 204 of the code reading device control unit 202, according to the type of code reading device determined in S501. In this S502 process, the code reading control unit 205 instructs the UI control unit 201 to execute the display processing of a code reading guide screen according to the type of code reading device. The UI control unit 201 displays the code reading guide screen according to the type of code reading device on the display screen of the operation unit 120. Details of the S502 process will be described later with reference to Figure 7.

[0043] In S503, the code reading control unit 205 acquires the data stored in the read 2D code and transmits the data to the code utilization application control unit 210. For example, the code reading control unit 205 decodes the data of the 2D code, which is the encoded information, and transmits the decoded data to the code utilization application control unit 210. In S504, the code utilization application control unit 210 uses the data received from the code reading control unit 205 to execute various application processes. For example, when executing a code payment print application, the payment processing unit 213 executes payment processing for the completed print job based on the payment ID information obtained from the data of the 2D code reading result. In this case, the print job has already been executed in a process separate from the processing in the flowchart of Figure 5. Furthermore, that print job may have been separately transmitted to the image forming apparatus 100 or stored on a cloud server. The print job is then executed based on separate user operations on the image forming apparatus 100. In this embodiment, the explanation focuses on the processing related to reading the 2D code, so a detailed explanation of the print job is omitted. Once the S505 process is complete, application 200 terminates the process shown in the flowchart in Figure 5.

[0044] Figure 6 is a flowchart detailing the process of determining the code reading device in S501 of Figure 5.

[0045] In S610, the code reading control unit 205 acquires connected device information indicating whether the camera 140 or the code scanner 150 is connected. First, the camera control unit 203 and the code scanner control unit 204 each identify whether the camera 140 or the code scanner 150 is connected to the USBI / F118. The code reading control unit 205 acquires the connection status of the camera 140 or code scanner 150 identified by the camera control unit 203 and the code scanner control unit 204 as connected device information. For example, if the camera 140 is connected, the code reading control unit 205 is notified by the camera control unit 203 that the camera 140 is connected.

[0046] In S611, the code reading control unit 205 determines whether the camera 140 is connected based on the connected device information acquired in S610. If the code reading control unit 205 determines that the camera 140 is connected (Yes in S611), it proceeds to S612. If the code reading control unit 205 determines that the camera 140 is not connected (No in S611), it proceeds to S613. In S613, the code reading control unit 205 determines that the code reading device is the camera 140. Then, the code reading control unit 205 terminates the processing shown in the flowchart in Figure 6.

[0047] In S613, the code reading control unit 205 determines whether the code scanner 150 is connected based on the connected device information acquired in S610. If the code reading control unit 205 determines that the code scanner 150 is connected (Yes in S613), it proceeds to S614. If the code reading control unit 205 determines that the code scanner 150 is not connected (No in S613), it proceeds to S615.

[0048] In S614, the code reading control unit 205 determines that the code reading device is the code scanner 150. The code reading control unit 205 then terminates the process shown in the flowchart in Figure 6. In S615, the code reading control unit 205 determines that there is no code reading device. The code reading control unit 205 then terminates the process shown in the flowchart in Figure 6.

[0049] Figure 7 is a flowchart detailing the code reading process that performs the reading of the 2D code in S502 of Figure 5.

[0050] In S720, the code reading control unit 205 acquires code reading device information, which indicates the information of the code reading device determined in the code reading device determination process shown in Figure 6.

[0051] In S721, the code reading control unit 205 determines whether the code reading device information acquired in S720 indicates the camera 140. If the code reading control unit 205 determines that the code reading device information indicates the camera 140 (Yes in S721), it proceeds to S722. If the code reading control unit 205 determines that the code reading device information does not indicate the camera 140 (No in S721), it proceeds to S729.

[0052] In S722, the code reading control unit 205 determines whether the camera 140 is being used by another application. Specifically, the code reading control unit 205 queries the camera control unit 203 to determine whether the camera 140 is being used by another application. If the code reading control unit 205 determines that the camera 140 is not being used by another application (No in S722), it proceeds to S723. If the code reading control unit 205 determines that the camera 140 is being used by another application (Yes in S722), it proceeds to S728.

[0053] In S723, the code reading control unit 205 activates the camera 140. That is, the code reading control unit 205 starts the camera capture process in the camera control unit 203. In S723, the camera control unit 203 activates the camera 140 based on the instruction from the code reading control unit 205 and notifies the UI control unit 201 that camera capture has started.

[0054] Next, in S724, the camera control unit 203 acquires camera image data through camera shooting processing and transmits the acquired camera image data to the code reading control unit 205 and the UI control unit 201.

[0055] Next, in S725, the UI control unit 201 displays a camera code reading guide screen on the display screen of the operation unit 120. At this time, the UI control unit 201 displays the camera image indicated by the camera image data acquired from the camera control unit 203, and a status display indicating that the camera 140 is taking a picture, on the camera code reading guide screen. Details will be described later with reference to Figure 8.

[0056] Next, in S726, the code reading control unit 205 performs a 2D code detection process from the camera image data acquired in S724 and determines whether a 2D code has been detected. If the code reading control unit 205 determines that a 2D code has been detected from the camera image data (Yes in S726), it proceeds to S727. If the code reading control unit 205 determines that no 2D code has been detected from the camera image data (No in S726), it returns to S724.

[0057] In S727, the code reading control unit 205 terminates the camera capture process in the camera control unit 203. The camera control unit 203 stops the camera 140 and notifies the UI control unit 201 that camera capture has stopped. Then, the code reading control unit 205 terminates the process shown in the flowchart in Figure 7.

[0058] Next, we will explain the process in S728 when it is determined in S722 that another application is using the camera. In S728, the UI control unit 201 displays a camera code reading error screen on the display screen of the operation unit 120. At this time, the UI control unit 201 indicates that the camera 140 is in use. Details will be described later using Figure 9. Then, the code reading control unit 205 terminates the process shown in the flowchart in Figure 7.

[0059] Next, we will explain the processing in S729 when it is determined in S721 that the code reading device is not the camera 140. In S729, the code reading control unit 205 determines whether the code reading device information acquired in S720 indicates the code scanner 150. If the code reading control unit 205 determines that the code reading device information indicates the code scanner 150 (Yes in S729), it proceeds to S730. If the code reading control unit 205 determines that the code reading device information does not indicate the code scanner 150 (No in S729), it proceeds to S734.

[0060] In S730, the code reading control unit 205 activates the code scanner 150. That is, the code reading control unit 205 starts the code detection process in the code scanner control unit 204. The code scanner control unit 204 activates the code scanner 150 based on instructions from the code reading control unit 205.

[0061] Next, in S731, the UI control unit 201 displays a code reading guide screen for the code scanner on the display screen of the operation unit 120. Details will be described later with reference to Figure 8.

[0062] Next, in S732, the code reading control unit 205 determines whether the code detection process of the code scanner control unit 204 has been completed. If the code reading control unit 205 determines that the code scanner control unit 204 has detected a 2D code (Yes in S732), it proceeds to S733. If the code reading control unit 205 determines that the code scanner control unit 204 has not detected a 2D code (No in S732), it returns to S732.

[0063] In S733, the code reading control unit 205 terminates the code detection process in the code scanner control unit 204. The code scanner control unit 204 stops the code scanner 150. Then, the code reading control unit 205 terminates the process shown in the flowchart in Figure 7.

[0064] In S734, the UI control unit 201 displays a code reading error screen on the display screen of the operation unit 120. The UI control unit 201 also indicates that the camera 140 and the code scanner 150 are not connected. Details will be described later using Figure 9. Then, the code reading control unit 205 completes the processing shown in the flowchart in Figure 7.

[0065] Figure 8 shows an example of a code reading guide screen according to this embodiment. The code reading guide screen is a screen that notifies the user of the guide to reading a two-dimensional code. The code reading guide screen is also an instruction screen that instructs the user to read the two-dimensional code. Figure 8(a) is an example of a code reading guide screen 800 for a camera, which is displayed in S725. The code reading guide screen 800 is a screen that is displayed on the display screen of the operation unit 120 of the image forming apparatus 100. The code reading guide screen 800 has a title area 801, a message area 802, an image area 803, a cancel button 805, and a status area 806.

[0066] The title area 801 and message area 802 display text to help the user easily hold the 2D code up to the camera 140. For example, instructions on how to hold the 2D code up to the camera and text (not shown) describing the installation location of the camera 140 of the image forming apparatus 100 are displayed.

[0067] In the image area 803, camera image data acquired by the camera control unit 203 is displayed and updated in real time. In addition, a frame 804 for easier scanning of a 2D code is displayed superimposed on the captured image in the image area 803.

[0068] The cancel button 805 is used to terminate the code reading process using the camera 140. When the cancel button 805 is pressed, the code reading control unit 205 terminates the code reading process, and the UI control unit 201 closes the code reading guide screen 800 and returns the display screen of the operation unit 120 to the main menu screen, screen 300.

[0069] In the status area 806, a message indicating that the camera 140 is taking pictures is displayed when the camera control unit 203 starts taking pictures. The user can recognize that the camera 140 is taking pictures by checking the status display shown in the status area 806 of the code reading guide screen 800.

[0070] Figure 8(b) shows an example of a code reading guide screen for a code scanner, as displayed in S731. The code reading guide screen 810 has a title area 811, a message area 812, an image area 813, and a cancel button 805.

[0071] In the title area 811 and message area 812, text is displayed to help the user easily hold the 2D code up to the code scanner 150. For example, instructions on how to hold the 2D code up to the scanner and a description of the installation location of the code scanner 150 in the image forming apparatus 100 are displayed (not shown). In the image area 813, unlike the image display for the camera, an icon image is displayed to indicate that the 2D code should be held up to the code scanner 150.

[0072] In this embodiment, a code reading guide screen is displayed according to the type of code reading device connected to the image forming apparatus 100. This makes it easy for the user to understand how to read the 2D code.

[0073] Figure 9 shows an example of a code reading error screen according to this embodiment. Figure 9(a) is an example of a code reading error screen displayed in S734 when the code reading device is not connected. The code reading guide screen 900 has a title area 901 and a message area 902 indicating a reading error, as well as a cancel button 805. Figure 9(b) is an example of a code reading error screen displayed in S728 when another application is using the camera 140. The code reading guide screen 910 has a title area 911 and a message area 912 indicating that another application is using the camera, as well as a cancel button 805.

[0074] As described above, in this embodiment, the display of the code reading guide screen can be switched between a camera display and a code scanner display depending on the type of code reading device determined. This improves the convenience of information processing equipment that uses encoded information as input information. In other words, 2D code reading can be easily performed without impairing user operability.

[0075] Furthermore, although this embodiment shows an example of displaying a camera image on the code reading guide screen 800 for the camera, the display of the camera image may be determined by automatic or manual settings. For example, if the display screen of the operation unit 120 of the image forming apparatus 100 is small, the camera image displayed on the code reading guide screen may become difficult to see. Therefore, the display of the camera image may be automatically switched on or off depending on the size of the display screen. Even if the camera image is not displayed on the display screen, if there is a status display on the display screen indicating that the camera is taking pictures, the user can recognize that the camera is taking pictures.

[0076] Similarly, in this embodiment, an example was shown in which the code reading guide screen 800 for the camera displays a status indicating that the camera is taking pictures. However, whether or not the status is displayed may be determined by automatic or manual settings.

[0077] Furthermore, although this embodiment shows an example of switching the display of the code reading guide screen depending on the type of code reading device, the voice guidance for code reading instructions may also be switched using the voice output (not shown) provided by the operation unit 120 of the image forming apparatus 100. Alternatively, the voice guidance for code reading instructions may be switched by performing both the display of the code reading guide screen and the voice output depending on the type of code reading device.

[0078] <<Second Embodiment>> In the first embodiment, an example was described in which a code reading device is determined based on connection information of a camera or code scanner connected to the image forming apparatus, and the code reading guide screen is switched according to the type of code reading device determined. In this embodiment, an example is described in which the code reading guide screen is switched according to the type of application that uses the code, in addition to the type of code reading device. Examples of applications that use the code include login applications, code payment applications, and code job execution applications. These applications are executed in the image forming apparatus 100, but the corresponding applications are also stored in the information processing terminal device held by the user using the image forming apparatus 100.

[0079] Since the basic configuration and processing of this embodiment are the same as those described in the first embodiment, the explanation will be omitted, and the differences will be described in detail.

[0080] Figure 10 shows an example of a two-dimensional code according to this embodiment. Figure 10(a) will be used to explain the two-dimensional code used in the code payment application. Code payment is a method of making payments using a payment code such as a two-dimensional code. Payment ID information is stored in the payment two-dimensional code. The code payment application of the image forming apparatus 100 can perform various services such as payment, charging, or balance confirmation using the payment ID information obtained from the payment two-dimensional code scanned by the user. Screen 1000 in Figure 10(a) is the two-dimensional code display screen of the code payment application displayed on an information processing terminal device such as a smartphone, and the two-dimensional code 1001 is displayed. In this embodiment, there is one two-dimensional code used in the code payment application, and the amount of data per code is about 20 bytes.

[0081] Next, Figure 10(b) will be used to explain the 2D code used in the code job execution application. Code job execution is the process of executing a job using various job setting information stored in a 2D code. The code job execution application of the image forming apparatus 100 uses the job setting information obtained from the 2D code for job execution that the user has scanned to execute the job indicated by the job type contained in the 2D code. The 2D code for code job execution contains a lot of information, such as the job type (copy, print, or copy, etc.) and job setting information. For example, in the case of a copy job, the job setting information includes the number of copies, magnification, duplex setting, staple setting, paper tray setting, etc. In the case of a scan job, the job setting information includes color, resolution, duplex, density, save location, etc. Thus, the 2D code for code job execution needs to store a lot of information. For this reason, the data may be divided and stored in multiple 2D codes. The screen 1010 in Figure 10(b) is a 2D code display screen of a code job execution application displayed on an information processing terminal device such as a smartphone, and displays a first 2D code 1012 and a second 2D code 1013. In this embodiment, two 2D codes are used in the code job execution application, and the amount of data per code is approximately 400 bytes.

[0082] In this embodiment, the process for executing the code reading process in S502 differs from that of the first embodiment. Specifically, in this embodiment, in S502, the process shown in the flowchart of Figure 11 is performed instead of the process shown in the flowchart of Figure 7. Figure 11 is a flowchart detailing the code reading process for reading two-dimensional codes in this embodiment. The process shown in the flowchart of Figure 11 is a process that supports the reading of multiple two-dimensional codes.

[0083] In S1101, the code reading control unit 205 obtains code usage application information, which is information about code usage applications, from each processing unit of the code usage application control unit 210. For example, code usage application information is information about the amount of encoded information used by various code usage applications. Specifically, code usage application information is information indicating the total amount of data of the two-dimensional codes used by various code usage applications. In this embodiment, the job execution processing unit 212 has code usage application information with a data amount of 800 bytes, and the settlement processing unit 213 has code usage application information with a data amount of 20 bytes.

[0084] Since steps S1102 to S1105 are the same processes as steps S720 to S723 in the flow chart of Figure 7, their explanation will be omitted.

[0085] In S1106, following S1105, the code reading control unit 205 determines whether the amount of data indicated by the code usage application information acquired in S1101 is greater than or equal to a predetermined value (for example, 400 bytes or more). If the code reading control unit 205 determines that the amount of data indicated by the code usage application information is greater than or equal to the predetermined value (Yes in S1106), it proceeds to S1107. If the code reading control unit 205 determines that the amount of data indicated by the code usage application information is not greater than or equal to the predetermined value (No in S1106), it proceeds to S1111.

[0086] S1107 to S1109 are processes that handle the reading of multiple 2D codes. In S1107, the camera control unit 203 acquires camera image data through camera shooting and transmits the acquired camera image data to the code reading control unit 205 and the UI control unit 201. In S1108, the UI control unit 201 displays a multiple code reading guide screen for the camera on the display screen of the operation unit 120. Details will be described later with reference to Figure 12.

[0087] In S1109, the code reading control unit 205 performs a detection process for multiple 2D codes from the camera image data acquired in S1107. The code reading control unit 205 then determines whether all of the multiple 2D codes have been detected from the camera image data. If the code reading control unit 205 determines that all of the multiple 2D codes have been detected from the camera image data (Yes in S1109), it proceeds to S1110. If the code reading control unit 205 determines that not all of the 2D codes have been detected from the camera image data (No in S1109), it returns to S1107.

[0088] Furthermore, the 2D code includes information about code concatenation (for example, whether or not codes are concatenated, their order, and the total number of codes) in its header information. The code reading control unit 205 can determine whether or not all 2D codes have been detected based on this concatenation information. In addition, when reading multiple 2D codes, the process in S503 (the process of obtaining data from the read codes) involves concatenating the decoding results (decoded results) of each 2D code and obtaining them as a single data set.

[0089] S1110 is the same process as S727 in Figure 7. S1111 to S1113 are the same processes as S724 to S726 in Figure 7. S1114 is the same process as S728 in Figure 7. S1115 to S1116 are the same processes as S729 to S730 in Figure 7.

[0090] In S1117, following S1116, the code reading control unit 205 determines whether the amount of data indicated by the code usage application information acquired in S1101 is greater than or equal to a predetermined value (for example, 400 bytes or more). If the code reading control unit 205 determines that the amount of data indicated by the code usage application information is greater than or equal to the predetermined value (Yes in S1117), it proceeds to S1118. If the code reading control unit 205 determines that the amount of data indicated by the code usage application information is not greater than or equal to the predetermined value (No in S1117), it proceeds to S1121.

[0091] S1118 to S1119 are processes that handle the reading of multiple 2D codes. In S1118, the UI control unit 201 displays a multiple code reading guide screen for the code scanner on the display screen of the operation unit 120. Details will be described later with reference to Figure 12.

[0092] Next, in S1119, the code reading control unit 205 determines whether the code scanner control unit 204 has completed the code detection process for multiple 2D codes. If the code reading control unit 205 determines that the code scanner control unit 204 has detected all 2D codes (Yes in S1119), it proceeds to S1120. If the code reading control unit 205 determines that the code scanner control unit 204 has not detected all 2D codes (No in S1119), it returns to S1118.

[0093] S1120 is the same process as S733 in Figure 7. S1121 to S1122 are the same processes as S731 to S732 in Figure 7. Also, S1123 is the same process as S734 in Figure 7.

[0094] Figure 12 shows the code reading guide screen according to this embodiment. Figure 12(a) is an example of the code reading guide screen for multiple 2D codes for the camera, which is displayed in S1108. In the title area 1201 and message area 1202 of the code reading guide screen 1200, text is displayed to make it easier for the user to hold the camera 140 over multiple 2D codes simultaneously. This display allows the camera 140 to capture multiple 2D codes within a single camera image file, so all 2D codes can be detected in a single code reading process. The image area 1203 and status area 1208 are the same as in the example described in Figure 8(a).

[0095] Figure 12(b) is an example of a code reading guide screen for multiple 2D codes for a code scanner, displayed in S1118. The title area 1211 and message area 1212 of the code reading guide screen 1210 display text to help the user easily hold the code scanner 150 over the multiple 2D codes one by one in sequence. When the first 2D code is detected, the UI control unit 201 updates the text on the code reading guide screen 1210 to instruct the user to read the next 2D code. This display allows the code scanner 150 to detect multiple 2D codes one by one, enabling all 2D codes to be detected in multiple code reading processes. The image area 1213 is the same as the example described in Figure 8(b).

[0096] As described above, in this embodiment, the display of the code reading guide screen is switched according to the information of the application using the code. This allows the user to easily perform 2D code reading without compromising user operability, even when reading multiple 2D codes.

[0097] In this embodiment, an example was described in which the total data volume information of the 2D codes used by the code-using application is used as the code-using application information, but the invention is not limited to this example. Other information related to the code-using application, such as the total number of 2D codes used by the code-using application, may also be used as the code-using application information.

[0098] Furthermore, in this embodiment, while an example was described in which two 2D codes are used in a code job execution application that utilizes multiple 2D codes, the number of 2D codes is not limited to two. Any number of 2D codes can be used.

[0099] Furthermore, in this embodiment, when using the camera 140, an example was described in which the code reading guide screen display switching process and code reading process are performed in order to read multiple 2D codes simultaneously. However, a method of reading 2D codes one by one may also be used. Similarly, when using the code scanner 150, if a code scanner capable of reading multiple 2D codes simultaneously is used, the code reading guide screen display switching process may be performed for that purpose.

[0100] <<Third Embodiment>> In the first and second embodiments, examples were described in which the code reading guide screen is switched depending on the type of code reading device connected when either the camera 140 or the code scanner 150 is connected to the image forming apparatus. In this embodiment, an example is described in which the code reading guide screen is switched when both the camera and the code scanner are connected to the image forming apparatus.

[0101] Figure 13 is a block diagram showing the hardware configuration of the image forming apparatus according to this embodiment. The difference between the image forming apparatus 1300 shown in Figure 13 and the image forming apparatus 100 shown in Figure 1 is that the control unit 1310 of the image forming apparatus 1300 has two USB interfaces, a first USB interface 1318 and a second USB interface 1323, instead of a USB interface 118. In addition, the image forming apparatus 1300 is connected to a camera 1340 via the first USB interface 1318 and to a code scanner 1350 via the second USB interface 1323. The other hardware configurations are the same as those described in Figure 1, so their description is omitted.

[0102] In this embodiment as well, the processing in the flowchart shown in Figure 5 is the same as in the first embodiment. In this embodiment, the processing shown in Figure 5 is realized by the CPU 1311 of the image forming apparatus 1300 functioning as each functional unit of the application 200 shown in Figure 2, as described above. That is, the flowchart in Figure 5 in this embodiment is realized by the CPU 1311 reading a program stored in the ROM 1312 or HDD 1314, etc., into the RAM 1313 and executing it. Some or all of the functions of the steps in Figure 5 may be realized by hardware such as an ASIC or electronic circuit.

[0103] In this embodiment, the reading device determination process (S501) and the code reading process (S502) in Figure 5 differ from the example described in the first embodiment. The differences from the first embodiment will be explained below.

[0104] Figure 14 is a flowchart detailing the reading device determination process in S502 in this embodiment. The process of determining the code reading device based on the device information used will be explained below using the flowchart shown in Figure 14. Note that the device information used refers to the information used to select the target reading device for the code reading process, and is set by the application using the code. For example, in the code payment print 305, only the code scanner 1350 is set as the device used.

[0105] In S1400, the code reading control unit 205 acquires connection device information for the camera 1340 and the code scanner 1350. In the first embodiment, examples were described in which the connected device was either the camera or the code scanner, or neither was connected. In this embodiment, the connected device may be the camera alone, the code scanner alone, both the camera and the code scanner, or neither.

[0106] In S1401, the code reading control unit 205 acquires information about the device to be used for the code reading process. In S1402, the code reading control unit 205 determines whether or not to use the camera 1340 for code reading based on the information about the device to be used acquired in S1401. If the code reading control unit 205 determines that the device to be used is the camera 1340 (Yes in S1402), it proceeds to S1403. If the code reading control unit 205 determines that the device to be used is not the camera 1340 (No in S1402), it proceeds to S1406.

[0107] In S1403, the code reading control unit 205 determines whether the camera 1340 is connected based on the connected device information acquired in S1400. If the code reading control unit 205 determines that the camera 1340 is connected (Yes in S1403), it proceeds to S1404. If the code reading control unit 205 determines that the camera is not connected (No in S1403), it proceeds to S1405.

[0108] In S1404, the code reading control unit 205 determines that the code reading device is a camera. Then, the code reading control unit 205 terminates the processing shown in the flowchart in Figure 14. In S1405, the code reading control unit 205 determines that the code reading device is a camera. Then, the code reading control unit 205 terminates the processing shown in the flowchart in Figure 14.

[0109] In S1406, the code reading control unit 205 determines whether the code scanner 1350 is connected based on the connected device information acquired in S1400. If the code reading control unit 205 determines that the code scanner 1350 is connected (Yes in S1406), it proceeds to S1407. If the code reading control unit 205 determines that the code scanner 1350 is not connected (No in S1406), it proceeds to S1408.

[0110] In S1407, the code reading control unit 205 determines that the code reading device is the code scanner 1350. The code reading control unit 205 then terminates the processing shown in the flowchart in Figure 14. In S1408, the code reading control unit 205 determines that the code reading device is none (no code scanner). The code reading control unit 205 then terminates the processing shown in the flowchart in Figure 14.

[0111] Figure 15 is a flowchart detailing the process for executing the code reading process in S502 in this embodiment.

[0112] Since steps S1520 to S1533 are the same as steps S720 to S733 in the flow chart of Figure 7, their explanation will be omitted. Note that the code reading device information acquired in S1520 will be one of the following: camera, no camera, code scanner, or no code scanner. Also, in S1529, if the code reading control unit 205 determines that the code reading device is not a code scanner (i.e., if it determines that the code reading device is neither a camera nor a code scanner), the process proceeds to S1534.

[0113] In S1534, the code reading control unit 205 determines whether the code reading device information acquired in S1520 indicates that there is no camera. If the code reading control unit 205 determines that there is no camera (Yes in S1534), it proceeds to S1535. If the code reading control unit 205 determines that there is a camera (No in S1534), it proceeds to S1536.

[0114] In S1535, the UI control unit 201 displays a camera code reading error screen on the display screen of the operation unit 1320. At this time, the UI control unit 201 indicates that the camera 1340, which is set as the device to be used, is not connected. Then, the code reading control unit 205 terminates the process shown in the flowchart in Figure 15.

[0115] In S1536, the UI control unit 201 displays a code scanner code reading error screen on the display screen of the operation unit 1320. At this time, the UI control unit 201 indicates that the code scanner 1350, which is set as the device to be used, is not connected. Then, the code reading control unit 205 terminates the process shown in the flowchart in Figure 15.

[0116] Figure 16 shows an example of a code reading guide screen according to this embodiment. Figure 16(a) is an example of a code reading error screen displayed in S1535 when the camera 1340 of the user device is not connected. Figure 16(b) is an example of a code reading error screen displayed in S1536 when the code scanner 1350 of the user device is not connected. As shown in Figures 16(a) and (b), the code reading guide screen 1600 displays text to indicate that the camera or code scanner set as the user device is not connected.

[0117] The above describes the processing using device information when both a camera and a code scanner may be connected to an image forming apparatus. Next, we will describe the processing using preferred device information, which is different from device information, when both a camera and a code scanner may be connected to an image forming apparatus. Preferred device information is information that selects the device to be used preferentially for code reading processing. Preferred device information may also include information that allows device changes to be permitted in order to use another connected device when the preferred device is not connected. Preferred device information is set by the application that uses the code.

[0118] Figure 17 is a flowchart detailing the read device determination process in S502 in another example of this embodiment. The difference between the flowchart process shown in Figure 17 and the flowchart process shown in Figure 14 is that it performs processing based on priority device information.

[0119] S1700 is the same process as S1400. In S1701, the code reading control unit 205 obtains priority device information for the code reading process. In S1702, the code reading control unit 205 determines whether to prioritize the camera 1340 for code reading based on the priority device information obtained in S1701. If the code reading control unit 205 determines that the priority device is the camera 1340 (Yes in S1702), it proceeds to S1703. If the code reading control unit 205 determines that the priority device is not the camera 1340 (No in S1702), it proceeds to S1708.

[0120] In S1703, the code reading control unit 205 determines whether the camera 1340, which is the priority device, is connected, based on the connected device information acquired in S1700. If the code reading control unit 205 determines that the camera 1340 is connected (Yes in S1703), it proceeds to S1704. If the code reading control unit 205 determines that the camera 1340 is not connected (No in S1703), it proceeds to S1705.

[0121] In S1704, the code reading control unit 205 determines that the code reading device is the camera 1340. Then, the code reading control unit 205 completes the process shown in the flowchart in Figure 17.

[0122] In S1705, the code reading control unit 205 determines, based on the connected device information obtained in S1700, whether or not a code scanner 1350 that is not a priority device is connected. If the code reading control unit 205 determines that the code scanner 1350 is connected (Yes in S1705), it proceeds to S1706. If the code reading control unit 205 determines that the code scanner 1350 is not connected (No in S1705), it proceeds to S1707.

[0123] In S1706, the code reading control unit 205 determines that the code reading device is the code scanner 1350. Then, the code reading control unit 205 completes the process shown in the flowchart in Figure 17.

[0124] In S1707, the code reading control unit 205 determines that there is no code reading device. Then, the code reading control unit 205 terminates the process shown in the flowchart in Figure 17.

[0125] In S1708, the code reading control unit 205 determines whether the code scanner 1350, which is the priority device, is connected or not, based on the connected device information obtained in S1700. If the code reading control unit 205 determines that the code scanner 1350 is connected (Yes in S1708), it proceeds to S1709. If the code reading control unit 205 determines that the code scanner 1350 is not connected (No in S1708), it proceeds to S1710.

[0126] In S1709, the code reading control unit 205 determines that the code reading device is the code scanner 1350. Then, the code reading control unit 205 completes the process shown in the flowchart in Figure 17.

[0127] In S1710, the code reading control unit 205 determines whether the camera 1340, which is not a priority device, is connected, based on the connected device information acquired in S1700. If the code reading control unit 205 determines that the camera is connected (Yes in S1710), it proceeds to S1711. If the code reading control unit 205 determines that the camera is not connected (No in S1710), it proceeds to S1712.

[0128] In S1711, the code reading control unit 205 determines that the code reading device is the camera 1340. Then, the code reading control unit 205 completes the process shown in the flowchart in Figure 17.

[0129] In S1712, the code reading control unit 205 determines that there is no code reading device. Then, the code reading control unit 205 terminates the process shown in the flowchart in Figure 17.

[0130] In the explanation of the process in Figure 17, an example of processing is described when the preferred device information is information that selects the device to be used preferentially for the code reading process. As mentioned above, the preferred device information may include information that sets permission to change devices in order to use another connected device when the preferred device is not connected. If the preferred device information includes information that sets permission to change devices, the determination process in S1705 in Figure 17 may also determine whether permission to change devices has been set. That is, S1705 may be configured to proceed to S1706 if the code scanner 1350 is connected and permission to change devices has been set, and to S1707 otherwise. Similarly, S1710 may be configured to proceed to S1711 if the camera 1340 is connected and permission to change devices has been set, and to S1712 otherwise.

[0131] Figure 18 shows an example of a code reading guide screen according to this embodiment. Figure 18(a) is an example of a code reading guide screen for a camera when the preferred device, the code scanner 1350, is not connected and device changes to another code reading device are permitted. In the code reading guide screen 1800, the message area 1802 displays text indicating that the device used for code reading has been changed from the preferred device, the code scanner, to the camera.

[0132] Figure 18(b) shows an example of a code reading guide screen for a code scanner when the preferred device, camera 1340, is not connected and a device change to another code reading device is permitted. In the code reading guide screen 1810, the message area 1812 displays text indicating that the device used for code reading has been changed from the preferred device, the camera, to the code scanner.

[0133] Note that while this example assumes that information regarding permission to change devices is included in the preferred device information, the screen when information regarding permission to change devices is not used can also be the same as the screen shown in Figure 18.

[0134] The above describes the processing using priority device information when both a camera and a code scanner can be connected to an image forming apparatus. Next, we will describe an example in which the code reading device is determined in the order in which the devices are connected, when both a camera and a code scanner can be connected to an image forming apparatus.

[0135] Figure 19 is a flowchart detailing the reading device determination process in S502 in another example of this embodiment. The difference between the process shown in Figure 19 and the processes shown in Figures 14 and 17 is that the code reading device to be used is automatically determined according to the connection order of the camera 1340 or code scanner 1350 that are connected to the image forming apparatus 1300.

[0136] In S1900, the code reading control unit 205 sets the connected device number N=1. In S1901, the code reading control unit 205 obtains the connected device information of the camera 1340 and code scanner 1350 that were connected to the image forming apparatus 1300 as the Nth device. Here, the connection order of the code reading devices is determined by the earliest (or latest) time in which the camera 1340 or code scanner 1350 was connected to the first USBI / F 1318 or the second USBI / F 1323. Alternatively, the order may be determined by the USBI / F number order, with the first USBI / F 1318 being the 1st and the second USBI / F being the 2nd.

[0137] In S1902, the code reading control unit 205 determines whether the camera is connected or not based on the Nth connected device information obtained in S1901. If the code reading control unit 205 determines that the camera is connected (Yes in S1902), it proceeds to S1903. If the code reading control unit 205 determines that the camera is not connected (No in S1902), it proceeds to S1905.

[0138] In S1903, the code reading control unit 205 determines whether the camera 1340 is being used by another application. If the code reading control unit 205 determines that the camera 1340 is not being used by another application (No in S1903), it proceeds to S1904. If the code reading control unit 205 determines that the camera 1340 is being used by another application (Yes in S1903), it proceeds to S1905.

[0139] In S1904, the code reading control unit 205 determines that the code reading device is the camera 1340. Then, the code reading control unit 205 completes the process shown in the flowchart in Figure 19.

[0140] In S1905, the code reading control unit 205 determines whether the code scanner is connected or not based on the Nth connected device information obtained in S1901. If the code reading control unit 205 determines that the code scanner is connected (Yes in S1905), it proceeds to S1906. If it determines that the camera is not connected (No in S1905), it proceeds to S1907.

[0141] In S1906, the code reading control unit 205 determines that the code reading device is the code scanner 1350. Then, the code reading control unit 205 completes the process shown in the flowchart in Figure 19.

[0142] In S1907, the code reading control unit 205 determines whether there is information about other connected devices for the camera 140 or the code scanner 150. If the code reading control unit 205 determines that there is information about other connected devices (Yes in S1907), it proceeds to S1909. If the code reading control unit 205 determines that there is no information about other connected devices (No in S1907), it proceeds to S1908.

[0143] In S1908, the code reading control unit 205 determines that there is no code reading device. Then, the code reading control unit 205 terminates the process shown in the flowchart in Figure 19.

[0144] In S1909, the connected device number N = N+1, and the process returns to S1901, repeating the flow.

[0145] As described above, in this embodiment, when both a camera and a code scanner can be connected, one code reading device is determined according to predetermined criteria. This allows switching to display a code reading guide screen corresponding to the type of code reading device. The predetermined criteria are the device used, the preferred device, and the connection order. In this embodiment, the predetermined criteria may be user-selected. That is, the code reading device may be determined based on the user's selection.

[0146] <<Fourth Embodiment>> In the third embodiment, an example was described in which, when both a camera and a code scanner are connected, the code reading guide screen is switched using either one of the code reading devices. In this embodiment, an example is described in which, when both a camera and a code scanner are connected, the code reading process is performed using both code reading devices. The configuration of the image forming apparatus 1300 in this embodiment is the same as in the example described in the third embodiment.

[0147] Furthermore, in this embodiment as well, the processing shown in the flowchart in Figure 5 is the same as in the first embodiment. As explained in the third embodiment, the processing shown in Figure 5 in this embodiment is realized by the CPU 1311 of the image forming apparatus 1300 functioning as each functional unit of the application 200 shown in Figure 2, as described above. That is, the flowchart in Figure 5 in this embodiment is realized by the CPU 1311 reading a program stored in the ROM 1312 or HDD 1314, etc., into the RAM 1313 and executing it.

[0148] In this embodiment, the reading device determination process (S501) and the code reading process (S502) in Figure 5 differ from the example described in the first embodiment. The differences from the first embodiment will be explained below.

[0149] Figure 20 is a flowchart detailing the reading device determination process in S502 in this embodiment. Below, an example of performing a code reading process using both the camera 1340 and the code scanner 1350 as code reading devices will be described using the flowchart shown in Figure 20.

[0150] In S2000, the code reading control unit 205 acquires connection device information for the camera 1340 and the code scanner 1350. In S2001, the code reading control unit 205 determines whether the camera and the code scanner are connected based on the connection device information acquired in S2000. If the code reading control unit 205 determines that the camera and the code scanner are connected (Yes in S2001), it proceeds to S2002. If the code reading control unit 205 determines that the camera and the code scanner are not connected (No in S2001), it proceeds to S2004.

[0151] In S2002, the code reading control unit 205 determines whether the camera 1340 is being used by another application. If the code reading control unit 205 determines that the camera 1340 is not being used by another application (No in S2002), it proceeds to S2003. If the code reading control unit 205 determines that the camera 1340 is being used by another application (Yes in S2003), it proceeds to S2004.

[0152] In step S2003, the code reading control unit 205 determines that the code reading device is either the camera 1340 or the code scanner 1350. Then, the code reading control unit 205 completes the process shown in the flowchart in Figure 20.

[0153] In S2004, since the camera 1340 and the code scanner 1350 are not connected, the code reading control unit 205 performs the processing corresponding to S501 in the first or second embodiment, as shown in Figure 6. That is, the code reading device determination process is performed for when either the camera or the code scanner is to be used. Then, the code reading control unit 205 terminates the processing shown in the flowchart in Figure 20.

[0154] Figure 21 is a flowchart detailing the process for executing the code reading process in S502 in this embodiment.

[0155] In S2110, the code reading control unit 205 acquires code reading device information. In S2111, the code reading control unit 205 determines whether the code reading device information acquired in S2110 indicates both the camera 1340 and the code scanner 1350. If the code reading control unit 205 determines that the code reading device information indicates both the camera 1340 and the code scanner 1350 (Yes in S2111), it proceeds to S2112. If the code reading control unit 205 determines that the code reading device information does not indicate both the camera 1340 and the code scanner 1350 (No in S2111), it proceeds to S2119.

[0156] In S2112, the code reading control unit 205 determines whether the camera 1340 is being used by another application. If the code reading control unit 205 determines that the camera 1340 is being used by another application (Yes in S2112), it proceeds to S2119. If the code reading control unit 205 determines that the camera 1340 is not being used by another application (No in S2112), it proceeds to S2113.

[0157] In S2113, the code reading control unit 205 activates both the camera 1340 and the code scanner 1350. Specifically, the code reading control unit 205 sends an instruction to the camera control unit 203 to activate the camera 1340, and the camera control unit starts the camera capture process. It also notifies the UI control unit 201 that camera capture has started. Furthermore, the code scanner control unit 204 activates the code scanner 1350 based on the instruction from the code reading control unit 205.

[0158] Next, in S2114, the camera control unit 203 acquires camera image data through camera shooting processing and transmits the acquired camera image data to the code reading control unit 205 and the UI control unit 201.

[0159] Next, in S2115, the UI control unit 201 displays code reading guide screens for both the camera and code scanner devices on the display screen of the operation unit 120. At this time, the UI control unit 201 also displays a status indicator showing that the camera 140 is taking a picture.

[0160] Next, in S2116, the code reading control unit 205 performs a 2D code detection process from the camera image data acquired in S2114. If the code reading control unit 205 determines that it has detected a 2D code from the camera image data (Yes in S2116), it proceeds to S2118. If the code reading control unit 205 determines that it has not detected a 2D code from the camera image data (No in S2116), it proceeds to S2117.

[0161] In S2117, the code reading control unit 205 determines whether the code detection process of the code scanner control unit 204 has been completed. If the code reading control unit 205 determines that the code scanner control unit 204 has detected a 2D code (Yes in S2117), it proceeds to S2118. If the code reading control unit 205 determines that the code scanner control unit 204 has not detected a 2D code (No in S2117), it returns to S2114.

[0162] In S2118, the code reading control unit 205 terminates the code detection process for both the camera 1340 and the code scanner 1350. At this time, the camera control unit 203 stops the camera 1340 and notifies the UI control unit 201 that camera shooting has stopped. The code scanner control unit 204 also stops the code scanner 1350. Then, the code reading control unit 205 terminates the process shown in the flowchart in Figure 21.

[0163] In S2119, the code reading control unit 205 proceeds to the flowchart process shown in detail in Figure 5, which is shown in Figure 7 or Figure 11, because the code reading device information does not indicate both the camera and the code scanner. That is, the code reading control unit 205 performs the code reading process when using either the camera or the code scanner. Then, the code reading control unit 205 finishes the process shown in the flowchart in Figure 21.

[0164] Figure 22 shows an example of a code reading guide screen according to this embodiment. Figure 22(a) is an example of a code reading guide screen when performing code reading processing using both a camera and a code scanner. In the code reading guide screen 2200, the message area 2202 and the image area 2203 indicate that both a camera and a code scanner are used for code reading, and that either device can read a 2D code. In addition, the status area 2207 of the code reading guide screen 2200 indicates to the user that the camera 140 is taking an image.

[0165] Figure 22(b) shows an example of the screen after the 2D code has been read using both the camera and the code scanner. Here, the code usage application is assumed to be an application that performs the login process. The user holds the 2D code up to the camera 1340 to perform code reading. The display screen switches from the code reading guide screen 2200 to the code usage application screen 2205 after code reading is complete, and a pop-up display 2206 appears indicating that the camera has finished reading the 2D code. This allows the user to confirm that the code has been read by holding the 2D code up to the camera 1340.

[0166] As explained above, when both the camera and the code scanner are connected, the code reading device is determined to be both devices, allowing the display to switch to a code reading guide screen that utilizes both the camera and the code scanner.

[0167] In this embodiment, we have described a case where a total of two code reading devices are used, with one camera and one code scanner, but the number of devices is not limited to two. Also, multiple devices of the same type may be used. For example, two cameras may be provided. The screen may be switched depending on the performance of the connected camera. For example, two cameras with the same performance may be provided. Even in this case, the notification content for the camera's installation location will differ, so the screen display will switch depending on the connected device.

[0168] <<Other Embodiments>> In the embodiments described above, an image forming apparatus having a printer and a scanner was used as an example of an information processing device, but the invention is not limited to this example. The embodiments described above can be applied to any information processing device that can connect a camera and a code scanner.

[0169] Furthermore, in the embodiments described above, while examples were explained in which the two-dimensional code in the code payment print 305 and code payment copy 306 stores payment ID information, various other types of information may also be included. For example, the job setting information described above may be included in the two-dimensional code used in the code payment print 305 and code payment copy 306. Similarly, payment ID information may be included in the two-dimensional code used in the code job execution 307.

[0170] Furthermore, a combination of the third or fourth embodiment and the second embodiment may be used. That is, in the process of executing the code reading process in the third or fourth embodiment, code usage application information may be acquired. Then, based on the amount of data indicated by the code usage application information, multiple code reading guides, as described in the second embodiment, may be displayed.

[0171] The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions.

[0172] The disclosure of this embodiment includes configurations represented by the following examples of information processing devices, control methods for information processing devices, and programs.

[0173] <Configuration 1> An information processing device, A determination means for determining a reading device for reading encoded information from among a plurality of reading devices that can be connected to the information processing device, A display control means that displays a guide screen on the display unit corresponding to the reading device determined by the determination means from among the plurality of connectable reading devices, A control means that performs control to read the encoded information using the reading device determined by the determination means, An information processing device characterized by having the following features.

[0174] <Configuration 2> The information processing apparatus according to configuration 1, characterized in that the guide screen includes a message notifying the method of reading using the reading device.

[0175] <Structure 3> The information processing apparatus according to configuration 1 or 2, characterized in that the guide screen includes a message indicating the location where the reading device is provided in the information processing apparatus.

[0176] <Structure 4> The determination means determines the reading device based on receiving an instruction to launch an application that uses the encoded information. The information processing apparatus according to any one of configurations 1 to 3, characterized in that the control means performs processing in the application using the result of decoding the read encoded information.

[0177] <Composition 5> The information processing apparatus according to configuration 4, characterized in that the information processing apparatus is configured to be able to connect to any one of the plurality of connectable reading devices.

[0178] <Composition 6> The information processing apparatus according to configuration 5, characterized in that the plurality of connectable reading devices include a camera and a code scanner.

[0179] <Composition 7> The information processing apparatus according to configuration 6, characterized in that the display control means causes the display unit to display one of the following screens according to the determined reading device: a first screen for a camera, a second screen for a code scanner, a third screen indicating an error when the determined reading device is a camera, and a fourth screen indicating an error when the device is not connected.

[0180] <Structure 8> The information processing apparatus according to configuration 7, characterized in that the first screen includes the display of an image captured by the camera and a frame superimposed on the image.

[0181] <Composition 9> The information processing apparatus according to configuration 8, characterized in that the display control means does not display the image and the frame on the first screen when the size of the display unit is smaller than a predetermined size.

[0182] <Composition 10> The information processing device according to any one of configurations 7 to 9, characterized in that the first screen includes a display of the status that the camera is taking a picture.

[0183] <Composition 11> The information processing apparatus according to any one of configurations 7 to 10, characterized in that the second screen includes the display of an image showing the code scanner.

[0184] <Composition 12> The information processing apparatus according to any one of configurations 7 to 11, characterized in that the display control means causes the third screen to be displayed on the display unit when the determined reading device is a camera and the camera is being used in a second application different from the application.

[0185] <Composition 13> The information processing device according to any one of configurations 4 to 12, characterized in that the application includes login, code payment, and code job execution.

[0186] <Composition 14> The information processing apparatus according to any one of configurations 4 to 13, characterized in that the control means activates the reading device determined by the determination means based on the receipt of an instruction to activate the application, and when the reading of the encoded information is completed, the activated reading device is stopped.

[0187] <Composition 15> The system further includes means for obtaining application information regarding the amount of encoded information used by the aforementioned application, The information processing device according to any one of configurations 4 to 14, characterized in that, when the amount of encoded information indicated by the application information is greater than or equal to a predetermined value, the display control means causes the display unit to display a guide screen that notifies the user of a guide to read a plurality of the encoded information.

[0188] <Composition 16> The information processing apparatus according to configuration 4, characterized in that the information processing apparatus is configured to be able to connect multiple reading devices from among the multiple connectable reading devices simultaneously.

[0189] <Composition 17> The application further includes an acquisition means for acquiring device information indicating a reading device that is set as the target reading device, The information processing apparatus according to configuration 16, characterized in that the determination means determines the reading device for reading the encoded information to be the connected reading device when the reading device indicated by the usage device information is connected to the information processing apparatus.

[0190] <Composition 18> The application further includes an acquisition means for acquiring device information indicating a reading device that is set as the target reading device, The determination means determines that if the reading device indicated by the usage device information is not connected to the information processing device, there is no reading device to read the encoded information. The information processing apparatus according to configuration 16 or 17, characterized in that, when the determination means determines that the reading device is not present, the display control means causes the display unit to display a fifth screen indicating an error that the reading device is not connected.

[0191] <Composition 19> The information processing apparatus according to configuration 18, characterized in that the fifth screen is a different screen for each reading device indicated by the usage device information.

[0192] <Composition 20> The system further includes means for acquiring priority device information indicating the reading device to be used preferentially, The information processing apparatus according to configuration 16, characterized in that the determination means determines the reading device for reading the encoded information to be the connected reading device when the reading device indicated by the priority device information is connected to the information processing apparatus.

[0193] <Composition 21> The system further includes means for acquiring priority device information indicating the reading device to be used preferentially, If the reading device indicated by the priority device information is not connected to the information processing device, the determination means determines the reading device for reading the encoded information to be a second reading device not indicated in the priority device information. The information processing apparatus according to configuration 16 or 20, characterized in that, when the second reading device is determined by the determination means, the display control means causes the display unit to display a sixth screen as the guide screen, which indicates that the reading device has been changed and notifies the display unit of a reading guide corresponding to the reading device.

[0194] <Composition 22> The information processing apparatus according to configuration 21, characterized in that the sixth screen is a different screen for each reading device that is changed.

[0195] <Composition 23> The information processing apparatus according to configuration 16, characterized in that the determination means determines a reading device to read the encoded information based on the connection order of the reading devices connected to the information processing apparatus.

[0196] <Composition 24> The determination means determines that all of the simultaneously connected reading devices are reading devices for reading encoded information. The information processing apparatus according to configuration 16, wherein the display control means, when a plurality of reading devices are determined by the determination means, displays a seventh screen, which is a reading guide corresponding to the plurality of reading devices, on the display unit as the guide screen.

[0197] <Composition 25> The information processing apparatus according to configuration 24, characterized in that, after displaying the seventh screen, if the encoded information is read, the display control means causes the display unit to display an eighth screen that notifies the reading device used for reading.

[0198] <Composition 26> The information processing apparatus according to any one of configurations 1 to 25, characterized in that the display control means displays a guide screen on the display unit that notifies a reading guide corresponding to the reading device, and outputs a notification corresponding to the reading device by voice.

[0199] <Composition 27> The information processing apparatus according to any one of configurations 1 to 26, characterized in that the information processing apparatus is an image forming apparatus having a printer and a scanner.

[0200] <Composition 28> A method for controlling an information processing device, The steps include: determining a reading device for reading encoded information from among a plurality of reading devices that can be connected to the information processing device; The steps include: displaying a guide screen on the display unit corresponding to the selected reading device from among the multiple connectable reading devices; The steps include: performing control to read the encoded information using the determined reading device; A control method for an information processing device, characterized by having the following features.

[0201] <Composition 29> A program for causing a computer to function as one of the means of an information processing device described in any one of items 1 to 27 of the configuration. [Explanation of symbols]

[0202] 100 Image forming apparatus 110 Control Unit 120 Operation section 140 Cameras 150 Code Scanners

Claims

1. An information processing device, A determination means for determining a reading device for reading encoded information from among a plurality of reading devices that can be connected to the information processing device, A display control means that displays a guide screen on the display unit corresponding to the reading device determined by the determination means from among the plurality of connectable reading devices, A control means that performs control to read the encoded information using the reading device determined by the determination means, An information processing device characterized by having the following features.

2. The information processing apparatus according to claim 1, characterized in that the guide screen includes a message notifying the method of reading using the reading device.

3. The information processing apparatus according to claim 1, characterized in that the guide screen includes a message indicating the location where the reading device is provided in the information processing apparatus.

4. The determination means determines the reading device based on receiving an instruction to launch an application that uses the encoded information. The information processing apparatus according to claim 1, characterized in that the control means performs processing in the application using the result of decoding the read encoded information.

5. The information processing apparatus according to claim 4, characterized in that the information processing apparatus is configured to be able to connect to any one of the plurality of connectable reading devices.

6. The information processing apparatus according to claim 5, characterized in that the plurality of connectable reading devices include a camera and a code scanner.

7. The information processing apparatus according to claim 6, characterized in that the display control means causes the display unit to display one of the following screens according to the determined reading device: a first screen for a camera, a second screen for a code scanner, a third screen indicating an error when the determined reading device is a camera, and a fourth screen indicating an error when the device is not connected.

8. The information processing apparatus according to claim 7, characterized in that the first screen includes the display of an image captured by the camera and a frame superimposed on the image.

9. The information processing apparatus according to claim 8, characterized in that the display control means does not display the image and the frame on the first screen when the size of the display unit is smaller than a predetermined size.

10. The information processing apparatus according to claim 7, characterized in that the first screen includes a display of the status that the camera is taking a picture.

11. The information processing apparatus according to claim 7, characterized in that the second screen includes the display of an image showing the code scanner.

12. The information processing apparatus according to claim 7, characterized in that the display control means causes the third screen to be displayed on the display unit when the determined reading device is a camera and the camera is being used in a second application different from the application.

13. The information processing device according to claim 4, characterized in that the application includes any of login, code payment, and code job execution.

14. The information processing apparatus according to claim 4, characterized in that the control means activates the reading device determined by the determination means based on the receipt of an instruction to activate the application, and when the reading of the encoded information is completed, the activated reading device is stopped.

15. The system further includes means for obtaining application information regarding the amount of encoded information used by the aforementioned application, The information processing apparatus according to claim 4, characterized in that, when the amount of encoded information indicated by the application information is greater than or equal to a predetermined value, the display control means causes the display unit to display a guide screen as the guide screen, which notifies a guide for reading a plurality of the encoded information.

16. The information processing apparatus according to claim 4, characterized in that the information processing apparatus is configured to be able to connect multiple reading devices from among the multiple connectable reading devices simultaneously.

17. The application further includes an acquisition means for acquiring device information indicating a reading device that is set as the target reading device, The information processing apparatus according to claim 16, characterized in that the determination means determines the reading device for reading the encoded information to be the connected reading device when the reading device indicated by the usage device information is connected to the information processing apparatus.

18. The application further includes an acquisition means for acquiring device information indicating a reading device that is set as the target reading device, The determination means determines that if the reading device indicated by the usage device information is not connected to the information processing device, there is no reading device to read the encoded information. The information processing apparatus according to claim 16, characterized in that, when the determination means determines that the reading device is not present, the display control means causes the display unit to display a fifth screen indicating an error that the reading device is not connected.

19. The information processing apparatus according to claim 18, characterized in that the fifth screen is a different screen for each reading device indicated by the usage device information.

20. The system further includes means for acquiring priority device information indicating the reading device to be used preferentially, The information processing apparatus according to claim 16, characterized in that the determination means determines the reading device for reading the encoded information to be the connected reading device when the reading device indicated by the priority device information is connected to the information processing apparatus.

21. The system further includes means for acquiring priority device information indicating the reading device to be used preferentially, If the reading device indicated by the priority device information is not connected to the information processing device, the determination means determines the reading device for reading the encoded information to be a second reading device not indicated in the priority device information. The information processing apparatus according to claim 16, characterized in that when the second reading device is determined by the determination means, the display control means causes the display unit to display a sixth screen as the guide screen, which indicates that the reading device has been changed and notifies the display unit of a reading guide corresponding to the reading device.

22. The information processing apparatus according to claim 21, characterized in that the sixth screen is a different screen for each reading device that is changed.

23. The information processing apparatus according to claim 16, characterized in that the determination means determines a reading device to read the encoded information based on the connection order of the reading devices connected to the information processing apparatus.

24. The determination means determines that all of the simultaneously connected reading devices are reading devices for reading encoded information. The information processing apparatus according to claim 16, wherein, when a plurality of reading devices are determined by the determination means, the display control means causes the display unit to display a seventh screen, which is a reading guide corresponding to the plurality of reading devices, as the guide screen.

25. The information processing apparatus according to claim 24, characterized in that, after the seventh screen is displayed, if the encoded information is read, the display control means causes the display unit to display an eighth screen that notifies the reading device used for reading.

26. The information processing apparatus according to claim 1, characterized in that the display control means displays a guide screen on the display unit that notifies a reading guide corresponding to the reading device, and outputs a notification corresponding to the reading device by voice.

27. The information processing apparatus according to claim 1, characterized in that the information processing apparatus is an image forming apparatus having a printer and a scanner.

28. A method for controlling an information processing device, The steps include: determining a reading device for reading encoded information from among a plurality of reading devices that can be connected to the information processing device; The steps include: displaying a guide screen on the display unit corresponding to the selected reading device from among the multiple connectable reading devices; The steps include: performing control to read the encoded information using the determined reading device; A control method for an information processing device, characterized by having the following features.

29. A program for causing a computer to function as one of the means of an information processing apparatus described in any one of claims 1 to 27.

Images