Terminal device, display control method, and program

Abstract

To provide a terminal device, a display control method, and a program that prevent convenience for a user from being impaired when receiving packets transmitted from an image processing device, detecting a direction in which the image processing device is located, and displaying the direction in which the image processing device is located on a display unit.SOLUTION: In a communication system in which a terminal device and a plurality of electronic apparatuses communicate with each other using first and second wireless communication methods, a terminal device 100 includes: a distance information acquisition unit 134 that acquires distance information indicating a distance to an electronic apparatus through short-range wireless communication with the electronic apparatus; a direction information acquisition unit 136 that acquires first direction information indicating a direction of the electronic apparatus with respect to the terminal device through the short-range wireless communication with the electronic apparatus; a correction unit 138 that performs correction processing of the first direction information so that the first direction information indicates a direction of a target position in the electronic apparatus based on the distance information; and a display control unit 140 that causes a display unit 112 to display the direction of the target position based on the corrected first direction information.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present disclosure relates to a terminal device, a display control method, and a program.

Background Art

[0002] Patent Document 1 discloses a terminal that performs Bluetooth (registered trademark) communication with an image processing device. The terminal according to Patent Document 1 receives a Bluetooth packet transmitted from the image processing device, detects the direction in which the image processing device is located based on the received packet, and displays the detected direction in which the image processing device is located on a display unit.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the technology according to Patent Document 1, the direction of the antenna of the image processing device is detected and displayed on the display unit. Therefore, when a user holding the terminal approaches the image processing device by more than a predetermined distance, the direction displayed on the display unit may deviate from the direction with respect to a desired position (for example, the central position of the image processing device, or the direction with respect to the position of the operation panel of the image processing device, etc.). Therefore, in the technology according to Patent Document 1, there is a possibility that the convenience for the user may be impaired.

Means for Solving the Problems

[0005] The terminal device according to this disclosure includes: a distance information acquisition unit that acquires distance information indicating the distance between the terminal device and the electronic device by short-range wireless communication with the electronic device; a direction information acquisition unit that acquires first direction information indicating the direction of the electronic device relative to the terminal device by short-range wireless communication with the electronic device; a correction unit that performs correction processing of the first direction information based on the distance information so that the first direction information indicates the direction of the target position in the electronic device; and a display control unit that causes a display unit to display the direction of the target position based on the corrected first direction information.

[0006] Furthermore, the display control method according to this disclosure acquires distance information indicating the distance between a terminal device and the electronic device via short-range wireless communication with the electronic device, acquires first direction information indicating the direction of the electronic device relative to the terminal device via short-range wireless communication with the electronic device, performs correction processing of the first direction information based on the distance information so that the first direction information indicates the direction of the target position in the electronic device, and displays the direction of the target position on the display unit based on the corrected first direction information.

[0007] Furthermore, the program according to this disclosure causes a computer to perform the following steps: acquiring distance information indicating the distance between a terminal device and the electronic device via short-range wireless communication with the electronic device; acquiring first direction information indicating the direction of the electronic device relative to the terminal device via short-range wireless communication with the electronic device; performing correction processing of the first direction information based on the distance information so that the first direction information indicates the direction of a target position in the electronic device; and displaying the direction of the target position on a display unit based on the corrected first direction information. [Brief explanation of the drawing]

[0008] [Figure 1] This is a diagram showing the communication system according to Embodiment 1. [Figure 2] This is a diagram showing the communication system according to Embodiment 1. [Figure 3]This diagram shows the configuration of the terminal device according to Embodiment 1. [Figure 4] This is a diagram showing the configuration of the electronic device according to Embodiment 1. [Figure 5] This flowchart shows the process performed by the terminal device according to Embodiment 1. [Figure 6] This flowchart shows the process performed by the terminal device according to Embodiment 1. [Figure 7] This flowchart shows the process performed by the terminal device according to Embodiment 1. [Figure 8] This is a diagram illustrating the positional relationship between the electronic device and the terminal device according to Embodiment 1. [Figure 9] This figure illustrates a model table used in a first example of the correction process according to Embodiment 1. [Figure 10] This figure illustrates a model table used in a second example of the correction process according to Embodiment 1. [Figure 11] This diagram shows the positional relationship between the terminal device and the electronic device in the comparative example. [Figure 12] This figure illustrates a screen displayed on a terminal device according to Embodiment 1. [Figure 13] This figure illustrates a screen displayed on a terminal device according to Embodiment 1. [Figure 14] This figure illustrates a screen displayed on a terminal device according to Embodiment 1. [Figure 15] This figure illustrates a screen displayed on a terminal device according to Embodiment 1. [Figure 16] This figure illustrates a screen displayed on a terminal device according to Embodiment 1. [Figure 17] This figure illustrates a screen displayed on a terminal device according to Embodiment 1. [Modes for carrying out the invention]

[0009] (Embodiment 1) Hereinafter, embodiments will be described with reference to the drawings. For clarity of explanation, the following description and drawings have been appropriately omitted and simplified. Also, in each drawing, the same elements are denoted by the same reference numerals, and duplicate explanations are omitted as necessary.

[0010] FIG. 1 and FIG. 2 are diagrams showing a communication system 1 according to Embodiment 1. FIG. 1 is a diagram schematically showing the communication system 1 according to Embodiment 1. The communication system 1 includes a terminal device 100 and an electronic device 200.

[0011] The terminal device 100 is, for example, a portable terminal device such as a smartphone or a tablet terminal. Also, the terminal device 100 may be a computer device such as a PC (Personal Computer). The terminal device 100 has at least a display unit 112. Other components of the terminal device 100 will be described later.

[0012] The electronic device 200 is, for example, a printer. Also, the electronic device 200 may be, for example, a multifunction peripheral (MFP), a projector device, a scanner, etc. Note that a multifunction peripheral having a printing function is also an example of a printer. In Embodiment 1, the case where the electronic device 200 is a printer such as a multifunction peripheral will be described.

[0013] The electronic device 200 which is a printer has at least an operation panel 220, a paper feed tray 232, and a paper discharge tray 234. The operation panel 220 is, for example, a touch panel in which a display device and an input device are integrated. The paper feed tray 232 stores sheets of paper which are printing media, for example, by paper size. Sheets of paper on which an image is formed are discharged to the paper discharge tray 234. Other components of the electronic device 200 will be described later.

[0014] Terminal device 100 and electronic device 200 communicate with each other using wireless communication by a first wireless communication method and wireless communication by a second wireless communication method. The first wireless communication method is a standard that has a faster communication speed and a longer communication range compared to the second wireless communication method. The first wireless communication method is, in a narrow sense, a wireless LAN (Local Area Network), and more specifically, Wi-Fi (registered trademark). The following explanation will describe an example where the first wireless communication method is Wi-Fi, but the first wireless communication method may be other communication methods.

[0015] The second wireless communication method is a standard with a slower communication speed and shorter communication range compared to the first wireless communication method. Therefore, the second wireless communication method is a standard that realizes short-range wireless communication. Furthermore, the second wireless communication method is a standard that enables the transmission of beacon signals. The second wireless communication method is, in a narrow sense, Bluetooth, and more specifically, BLE (Bluetooth Low Energy). The following explanation will describe an example where the second wireless communication method is BLE, but the second wireless communication method may be other communication methods. Note that the beacon signal in BLE corresponds to an advertised packet. Also, the first wireless communication method may be capable of transmitting beacon signals. If the first wireless communication method is Wi-Fi, the electronic device 200 may transmit a beacon signal to inform surrounding devices of its SSID (Service Set Identifier).

[0016] Figure 2 illustrates a communication system 1 having multiple electronic devices 200. The communication system 1 illustrated in Figure 2 includes five electronic devices 200A to 200E, a terminal device 100, and an access point 10. The access point 10 is, for example, a wireless LAN access point. In the following description, the electronic devices 200A to 200E may be referred to as printers A to E, respectively.

[0017] Each electronic device 200 transmits (broadcasts) a BLE beacon Bb corresponding to the second wireless communication method. The BLE beacon Bb is a beacon signal compliant with the BLE standard. Upon receiving the BLE beacon Bb, the terminal device 100 can locate the electronic devices 200. Furthermore, upon receiving the BLE beacon Bb, the terminal device 100 can obtain distance information indicating the distance from the terminal device 100 to the electronic devices 200. Additionally, if both the terminal device 100 and the electronic devices 200 are compatible with Bluetooth 5.1 or later standards, upon receiving the BLE beacon Bb, the terminal device 100 can obtain first direction information indicating the direction of the electronic devices 200 relative to the terminal device 100. Further details will be described later.

[0018] Electronic devices 200A to 200B can be connected to terminal device 100 via access point 10. When electronic devices 200 are operating in infrastructure mode and connected to access point 10, wireless communication between terminal device 100 and electronic devices 200 is performed by terminal device 100 wirelessly connecting to access point 10. Such a connection is referred to as an infrastructure connection.

[0019] On the other hand, electronic devices 200C to 200E can be connected directly to terminal device 100 without going through access point 10. In this case, electronic device 200 activates an internal access point, and terminal device 100 connects to the internal access point, thereby enabling direct communication between terminal device 100 and electronic device 200. Such a connection is called a direct connection. The direct connection between terminal device 100 and electronic device 200 may be performed by communication compliant with the WFD (Wi-Fi Direct) standard, or by using Wi-Fi ad-hoc mode.

[0020] Electronic devices 200C to 200E transmit (broadcast) a Wi-Fi beacon Bw containing the SSID. The Wi-Fi beacon Bw is a beacon signal compliant with the Wi-Fi standard. When terminal device 100 receives the Wi-Fi beacon Bw, the SSID contained in the Wi-Fi beacon Bw is displayed. At this time, the operation panel 220 of electronic devices 200C to 200E displays the SSID and the password for connection. When the user of terminal device 100 sets the SSID and password displayed on the operation panel 220 on their terminal device 100, terminal device 100 is directly connected to electronic devices 200C to 200E.

[0021] Figure 3 shows the configuration of a terminal device 100 according to Embodiment 1. The terminal device 100 has as its main hardware components a processing unit 102, a storage unit 104, a first wireless communication unit 106, a second wireless communication unit 108, a display unit 112, and an operation unit 114. The processing unit 102, storage unit 104, first wireless communication unit 106, second wireless communication unit 108, display unit 112, and operation unit 114 may be interconnected via a data bus or the like.

[0022] The processing unit 102 is a processor, such as a CPU (Central Processing Unit). The processing unit 102 may have multiple processors. The processing unit 102 has the function of an arithmetic unit that performs control processing and calculation processing. The processing unit 102 controls the storage unit 104, the first wireless communication unit 106, the second wireless communication unit 108, the display unit 112, and the operation unit 114.

[0023] The storage unit 104 is, for example, a storage device such as a memory or hard disk. The storage unit 104 is, for example, a ROM (Read Only Memory) or RAM (Random Access Memory). The storage unit 104 has the function of storing control programs and arithmetic programs executed by the processing unit 102. The storage unit 104 also has the function of temporarily storing processing data. The storage unit 104 may include a database.

[0024] The first wireless communication unit 106 is a wireless communication device that performs wireless communication compliant with a first wireless communication method. For example, the first wireless communication unit 106 performs wireless communication compliant with the Wi-Fi standard. The second wireless communication unit 108 is a wireless communication device that performs wireless communication compliant with a second wireless communication method. For example, the second wireless communication unit 108 performs wireless communication compliant with the BLE standard.

[0025] The display unit 112 and the operation unit 114 constitute the user interface. The display unit 112 consists of a display or the like that shows various information to the user. The operation unit 114 consists of buttons or the like that that accept input operations from the user. The display unit 112 and the operation unit 114 may be integrated using a touch panel or the like.

[0026] Furthermore, the terminal device 100 has a software configuration consisting of the basic software OS 120 (Operating System) and a printing application 130. The printing application 130 is application software that operates using the functions of OS 120. The printing application 130 has the following components: a search processing unit 132, a distance information acquisition unit 134, a direction information acquisition unit 136, a correction unit 138, a display control unit 140, a connection processing unit 150, a printing control unit 160, and an error determination unit 170.

[0027] Each of the above-mentioned components can be realized, for example, by executing a program under the control of the processing unit 102. More specifically, each component of the printing application 130 can be realized by the processing unit 102 executing a program stored in the storage unit 104. Alternatively, the necessary programs may be recorded on any non-volatile recording medium and installed as needed to realize each component.

[0028] Furthermore, each component is not limited to being implemented by software through a program; it may also be implemented by a combination of hardware, firmware, and software. Additionally, each component may be implemented using a user-programmable integrated circuit, such as an FPGA (field-programmable gate array) or a microcontroller. In this case, the program composed of the above-mentioned components may be implemented using this integrated circuit.

[0029] The search processing unit 132 performs processing to search for the electronic device 200 using the first wireless communication method and the second wireless communication method. Details will be described later. The distance information acquisition unit 134 acquires distance information indicating the distance between the terminal device 100 and the electronic device 200 by short-range wireless communication with the electronic device 200. Details will be described later. The direction information acquisition unit 136 acquires first direction information indicating the direction of the electronic device 200 relative to the terminal device 100 by short-range wireless communication with the electronic device. Details will be described later.

[0030] The correction unit 138 performs correction processing on the first direction information. Based on the distance information, the correction unit 138 performs correction processing on the first direction information so that the first direction information indicates the direction of the target position in the electronic device 200. Details will be described later. The correction unit 138 may also perform correction processing when the distance to the electronic device 200 is less than a predetermined threshold.

[0031] The display control unit 140 controls the display on the display unit 112. Specifically, the display control unit 140 controls the display on the display unit 112 to display information about the electronic device 200 discovered by the search processing by the search processing unit 132. Based on the corrected first direction information, the display control unit 140 displays the direction of the target position relative to the terminal device 100 on the display unit 112. More details will be described later.

[0032] Furthermore, the correction unit 138 may perform correction processing based on information that associates the distance to the electronic device 200, the angle corresponding to the direction of the terminal device 100 relative to the electronic device 200, and the correction amount of the first direction information. Alternatively, the correction unit 138 may calculate the correction amount of the first direction information based on the distance to the electronic device 200, the angle corresponding to the direction of the terminal device 100 relative to the electronic device 200, and the positional relationship between the antenna used for short-range wireless communication and the target position. More details will be described later.

[0033] Here, the target position described above may correspond to a position on the electronic device 200 whose direction should be displayed on the display unit 112. Therefore, the target position corresponds to a desired direction that, when displayed on the display unit 112, enhances convenience for the user. The target position described above may also correspond to the operation panel 220 of the electronic device 200. Furthermore, the target position may be changed depending on the conditions. In addition, if an error occurs with respect to the electronic device 200, the correction unit 138 may perform a correction process so that the first direction information indicates the direction of the target position related to the error. In this case, the display control unit 140 may display the direction of the target position related to the error on the display unit 112. Alternatively, when the terminal device 100 transmits print data to the electronic device 200 which has a printing function, the correction unit 138 may perform a correction process so that the first direction information indicates the direction of the target position corresponding to the paper output tray 234 of the electronic device 200 relative to the terminal device 100. In this case, the display control unit 140 may display the direction of the target position corresponding to the paper output tray 234 on the display unit 112.

[0034] The connection processing unit 150 performs processing to enable communication between the terminal device 100 and the electronic device 200. Details will be described later. The print control unit 160 controls the connected electronic device 200 (printer) to perform printing. Details will be described later. When the print control unit 160 receives a print command from the user, it controls the connected electronic device 200 to send print data. Here, the print command includes print data. "Print data" refers to data indicating the image to be printed on the paper. The error determination unit 170 determines whether or not any error has occurred in the electronic device 200. Details will be described later.

[0035] Figure 4 shows the configuration of the electronic device 200 according to Embodiment 1. Figure 4 shows the case where the electronic device 200 is a printer. The electronic device 200 has a processing unit 202, a storage unit 204, a first wireless communication unit 206, a second wireless communication unit 208, a printing unit 210, and a user interface 212 (UI). The processing unit 202, storage unit 204, first wireless communication unit 206, second wireless communication unit 208, printing unit 210, and user interface 212 may be interconnected via a data bus or the like.

[0036] The processing unit 202 is, for example, a processor such as a CPU. The processing unit 202 may have multiple processors. The processing unit 202 has the function of an arithmetic unit that performs control processing and calculation processing. The processing unit 202 controls the storage unit 204, the first wireless communication unit 206, the second wireless communication unit 208, the printing unit 210, and the user interface 212.

[0037] The storage unit 204 is, for example, a storage device such as memory or a hard disk. The storage unit 204 is, for example, ROM or RAM. The storage unit 204 has the function of storing control programs and arithmetic programs executed by the processing unit 202. The storage unit 204 also has the function of temporarily storing processing data. The storage unit 204 may include a database.

[0038] The first wireless communication unit 206 is a wireless communication device that performs wireless communication compliant with a first wireless communication method. For example, the first wireless communication unit 206 performs wireless communication compliant with the Wi-Fi standard. The second wireless communication unit 208 is a wireless communication device that performs wireless communication compliant with a second wireless communication method. For example, the second wireless communication unit 208 performs wireless communication compliant with the BLE standard. In addition, the first wireless communication unit 206 of the electronic devices 200C to 200E may activate an internal access point according to a given connection setting. In this case, the first wireless communication unit 206 accepts a connection request from the terminal device 100. The connection setting is, for example, the setting of the SSID and passphrase, or the setting of the communication frequency band. The setting of the communication frequency band corresponds to the channel setting.

[0039] The printing unit 210 has a printing function for forming an image on paper, i.e., a printing medium. The printing unit 210 includes a printing engine. The printing engine is a mechanical configuration that performs printing of an image onto the printing medium. The printing engine may have, for example, a mechanism that performs printing using toner in an electrophotographic manner. Alternatively, the printing engine may have, for example, a mechanism that performs printing in an inkjet manner. The printing engine may also have a transport mechanism for transporting the printing medium.

[0040] The user interface 212 includes input devices such as buttons, a keyboard, a touch panel, or a mouse, and output devices such as a display or speakers. The user interface 212 may also have the input and output devices integrated into a single unit. The user interface 212 accepts data input operations from the user and outputs information to the user. The user interface 212 includes the operation panel 220 described above.

[0041] Figures 5 to 7 are flowcharts illustrating the processes performed by the terminal device 100 according to Embodiment 1. Note that a portion of the flowchart shown in Figure 5 and the flowcharts shown in Figures 6 and 7 correspond to the display control methods performed by the terminal device 100. The search processing unit 132 performs a search process using the first wireless communication method (step S102). That is, the search processing unit 132 searches for an electronic device 200 that can be connected using the first wireless communication method.

[0042] Specifically, the discovery processing unit 132 searches for electronic devices 200 that can connect to the infrastructure as follows. In the example in Figure 2, the discovery processing unit 132 searches for electronic devices 200A to 200B as follows. That is, the discovery processing unit 132 sends a discovery request packet onto the network of the access point 10 to which the terminal device 100 is connected. At this time, the electronic devices 200A to 200B connected to this access point 10 send a response packet in response to the discovery request packet. The discovery processing unit 132 can discover the electronic devices 200 connected to the access point 10 based on the received response packets.

[0043] Furthermore, the search processing unit 132 searches for electronic devices 200 that can be directly connected as follows. In the example shown in Figure 2, the search processing unit 132 searches for electronic devices 200C to 200E as follows. That is, the first wireless communication unit 106 of the terminal device 100 receives the Wi-Fi beacon Bw transmitted by the electronic devices 200. The search processing unit 132 can search for electronic devices 200 that can be directly connected using the received Wi-Fi beacon Bw.

[0044] The discovery processing unit 132 obtains the discovery result indicating the electronic device 200 discovered by the discovery. At this time, the discovery processing unit 132 may obtain the identification information and address information of the electronic device 200 contained in the response packet or Wi-Fi beacon Bw. The identification information is, for example, the serial number of the electronic device 200, but is not limited to this. The identification information of the electronic device 200 that makes a direct connection may be the SSID. The address information is an address unique to the electronic device 200. The address information is, for example, the MAC (Media Access Control) address, but is not limited to this.

[0045] The search processing unit 132 performs a search process using the second wireless communication method (step S104). Specifically, the second wireless communication unit 108 of the terminal device 100 receives a BLE beacon Bb transmitted by the electronic device 200. The search processing unit 132 can search for the electronic device 200 using the received BLE beacon Bb. The search processing unit 132 obtains a search result indicating the electronic device 200 found through the search. At this time, the search processing unit 132 may also obtain the identification information and address information of the electronic device 200 contained in the BLE beacon Bb.

[0046] The search processing unit 132 performs a mapping process for the search results (step S106). Specifically, the search processing unit 132 maps the search results from the first wireless communication method in S102 and the search results from the second wireless communication method in S104 based on the address information of the electronic device 200 discovered by the search. At this time, the display control unit 140 may cause the mapped search results to be displayed on the display unit 112. In other words, the display control unit 140 may control the display unit 112 to display information about the electronic device 200 discovered by the search. Furthermore, the display control unit 140 may control the display unit 112 to display a device list, which is a list of information about the electronic device 200 discovered by the search.

[0047] More specifically, the search processing unit 132 compares the address information included in the search results from the first wireless communication method with the address information included in the search results from the second wireless communication method. Based on the comparison, the search processing unit 132 associates the search results with matching address information with the search results of the same electronic device 200. The search results from the first wireless communication method indicate electronic devices 200 that can be connected via the first wireless communication method, such as Wi-Fi. On the other hand, the BLE beacon Bb used in the search processing using the second wireless communication method may include additional information that is not obtained by the response packets and Wi-Fi beacon Bw used in the search processing using the first wireless communication method. Therefore, by associating the search results, additional information about electronic devices 200 that can be connected via the first wireless communication method, such as Wi-Fi, can be indicated.

[0048] Additional information may include status information indicating the state of the electronic device 200. Status information may indicate, for example, whether the electronic device 200 is in an operating state, an idle state, or an error state. An operating state means that the electronic device 200 is executing jobs such as printing using its own functions. An idle state means that the electronic device 200 is not executing jobs and is waiting for job submissions. An error state means that some kind of error has occurred in the electronic device 200 and the electronic device 200 is unable to execute jobs. For example, if the electronic device 200 is a printer, an error state could mean that the printer is out of ink / toner, out of printing media such as paper, has a jam in the printing media, or has a component failure. An operating state means that a new job cannot be executed immediately. An idle state means that a new job can be executed immediately. An error state means that user action is required to execute a job.

[0049] The distance information acquisition unit 134 acquires distance information of the discovered electronic device 200 via short-range wireless communication such as BLE or Bluetooth (step S110). Specifically, the distance information acquisition unit 134 acquires radio wave strength information indicating the radio wave strength of the received BLE beacon Bb. The radio wave strength information may correspond to the received radio wave strength or the received signal strength. The distance information acquisition unit 134 estimates the distance between the terminal device 100 and the electronic device 200 using the radio wave strength information.

[0050] In other words, the stronger the signal strength of the BLE beacon Bb, the closer the distance is between the electronic device 200 that transmitted the BLE beacon Bb and the terminal device 100. Conversely, the weaker the signal strength of the BLE beacon Bb, the farther the distance is between the electronic device 200 that transmitted the BLE beacon Bb and the terminal device 100. For example, in the case of iBeacon (registered trademark), one of the BLE standards, the range in which the beacon signal is transmitted can be set to one of three types: "Immediate," "Near," and "Far." Here, for example, "Immediate" corresponds to a distance of a few centimeters, "Near" to a distance of a few meters, and "Far" to a distance of about 10 meters. In this way, the distance information acquisition unit 134 acquires distance information indicating the distance between the terminal device 100 and the electronic device 200.

[0051] Alternatively, the distance information acquisition unit 134 may calculate the distance between the electronic device 200 that transmitted the BLE beacon Bb and the terminal device 100 based on the radio wave strength of the BLE beacon Bb. Generally, it is known that radio wave strength decreases inversely proportional to the square of the distance. Therefore, if the radio wave strength at a reference distance is known, the distance between the terminal device 100 and the electronic device 200 can be calculated based on the radio wave strength of the BLE beacon Bb actually received. In this case, the BLE beacon Bb is configured to include reference radio wave strength information. The distance information acquisition unit 134 then calculates the distance between the terminal device 100 and the electronic device 200 based on the reference radio wave strength information and the radio wave strength information. As a result, the distance information acquisition unit 134 acquires distance information indicating the distance between the terminal device 100 and the electronic device 200.

[0052] The direction information acquisition unit 136 acquires direction information for each detected electronic device 200 via short-range wireless communication such as BLE or Bluetooth (step S112). Specifically, the direction information acquisition unit 136 acquires first direction information indicating the direction of the electronic device 200 relative to the terminal device 100 using the direction detection function defined in the Bluetooth 5.1 standard and later. More specifically, the direction information acquisition unit 136 calculates the angle of arrival (AoA) of the radio waves received by the terminal device 100 for the BLE beacon Bb transmitted from the electronic device 200. The angle of arrival AoA can be calculated using the AoA method described in Patent Document 1. That is, the terminal device 100 has multiple antennas. The terminal device 100 receives radio waves, i.e., BLE beacon Bb, with multiple antennas. The direction information acquisition unit 136 of the terminal device 100 calculates the angle of arrival AoA, which is the angle with respect to the direction in which the multiple antennas are aligned, based on the distance between the multiple antennas and the phase difference of the radio waves received by the multiple antennas.

[0053] The correction unit 138 determines whether the distance between the terminal device 100 and the electronic device 200 is less than a predetermined threshold (step S114). Specifically, the correction unit 138 determines whether the distance indicated in the distance information obtained in the S110 process is less than the threshold. If the distance to the electronic device 200 is not less than the threshold (NO in S114), the S116 process, which will be described later, is omitted. On the other hand, if the distance to the electronic device 200 is less than the threshold (YES in S114), the correction unit 138 performs correction processing of the first direction information (step S116). In other words, the correction unit 138 performs correction processing of the first direction information so that the first direction information indicates the direction of the target position on the electronic device 200 relative to the terminal device 100. The details of the S116 process will be described later. The target position on the electronic device 200 is, for example, the position corresponding to the operation panel 220. However, as described above, the target position can be changed depending on the conditions.

[0054] The processes S110 to S116 may also be executed at any time thereafter. For example, the electronic device 200 may transmit a BLE beacon Bb at predetermined intervals. In this case, the terminal device 100 may perform the processes S110 to S116 each time it receives a BLE beacon Bb. Alternatively, the terminal device 100 may perform the processes S110 to S116 before the processes S120, S140, S170, and S180 described later. Furthermore, the processes S172 to S180 described later may be executed at any time.

[0055] Similarly, the processes S102 to S106 may be executed at any time thereafter as appropriate. For example, the electronic device 200 may transmit a Wi-Fi beacon Bw at predetermined intervals. In this case, the terminal device 100 may perform the process in S102 each time it receives a Wi-Fi beacon Bw. Also, if the terminal device 100 transmits a search request packet at predetermined intervals, the terminal device 100 may perform the process in S102 each time it receives a response packet. Also, the terminal device 100 may perform the process in S104 each time it receives a BLE beacon Bb. And, as described above, the terminal device 100 may perform the process in S106 each time S102 and S104 are executed.

[0056] The display control unit 140 controls the orientation display of the discovered electronic device 200 (step S120). Specifically, the display control unit 140 controls the display unit 112 to display an orientation indicator indicating the direction shown by the first orientation information. If the correction process in S116 is not performed, the first orientation information may indicate the direction of the antenna of the electronic device 200 (the wireless board 240, which will be described later). Therefore, in this case, the display control unit 140 causes the display unit 112 to display an orientation indicator indicating the direction of the antenna of the electronic device 200.

[0057] On the other hand, when the process in S116 is executed, the display control unit 140 displays the direction of the target position of the electronic device 200 relative to the terminal device 100 on the display unit 112 based on the corrected first direction information. Here, in the process in S116 executed before S120, the target position is the position corresponding to the operation panel 220 of the electronic device 200. In other words, the correction unit 138 performs the correction process with the target position as the position of the operation panel 220. To put it another way, the correction unit 138 performs the correction process on the first direction information so that the first direction information indicates the direction of the operation panel 220 relative to the terminal device 100. Then, the display control unit 140 displays the direction of the operation panel 220 of the electronic device 200 relative to the terminal device 100 on the display unit 112. The display control unit 140 may also display some message on the display unit 112.

[0058] The connection processing unit 150 determines whether an electronic device 200 to execute a job such as printing has been selected (step S130). For example, the connection processing unit 150 determines whether an electronic device 200 has been selected when the user selects one electronic device 200 from the device list of electronic devices 200 displayed on the display unit 112 under the control of the display control unit 140. For example, if the user taps one electronic device from the device list of electronic devices 200 displayed on the display unit 112, which is a touch panel, the tapped electronic device 200 is selected. If no electronic device 200 is selected (NO in S130), the connection processing unit 150 repeats the process in S130.

[0059] On the other hand, if electronic device 200 is selected (YES in S130), the connection processing unit 150 determines whether the connection method of the selected electronic device 200 is an infrastructure connection or a direct connection (step S132). This determination may be made depending on whether the selected electronic device 200 was discovered in the process of S102 by a response packet to a discovery request packet or by a Wi-Fi beacon Bw. In this case, if the selected electronic device 200 was discovered by a response packet, the connection processing unit 150 determines that the connection method of the selected electronic device 200 is an infrastructure connection. On the other hand, if the selected electronic device 200 was discovered by a Wi-Fi beacon Bw, the connection processing unit 150 determines that the connection method of the selected electronic device 200 is a direct connection.

[0060] Furthermore, the BLE beacon Bb may include information indicating the connection method of the electronic device 200 that transmitted the BLE beacon Bb. In this case, if the selected electronic device 200 is discovered by the BLE beacon Bb in the processing of S104, the connection processing unit 150 may determine the connection method using the information indicating the connection method included in the BLE beacon Bb. Alternatively, the connection processing unit 150 may determine that the connection method of the selected electronic device 200 is a direct connection if the information regarding the selected electronic device 200 includes a unique SSID. On the other hand, the connection processing unit 150 may determine that the connection method of the selected electronic device 200 is an infrastructure connection if the information regarding the selected electronic device 200 includes an SSID related to the access point 10.

[0061] Furthermore, if an electronic device 200 is selected, the display control unit 140 may display the selected electronic device 200 in the device list in a way that distinguishes it from the unselected electronic device 200. For example, the display control unit 140 may display the selected electronic device 200 in the device list in a way that makes it more prominent than the unselected electronic device 200.

[0062] If the selected connection method for the electronic device 200 is an infrastructure connection ("infrastructure connection" in S132), the connection processing unit 150 performs processing to connect the terminal device 100 to the electronic device 200 via an infrastructure connection (step S134). In this case, as described above, the connection processing unit 150 performs processing to connect the terminal device 100 to the electronic device 200 via the access point 10. At this time, the connection processing unit 150 may control the first wireless communication unit 106 to ensure that the terminal device 100 and the electronic device 200 are connected using the first wireless communication method.

[0063] On the other hand, if the connection method of the selected electronic device 200 is a direct connection ("direct connection" in S132), the display control unit 140 controls the direction display of the selected electronic device 200 (step S140). The process of S140 may be substantially the same as the process of S120 described above. However, the message displayed on the display unit 112 in the process of S140 may differ from that in the process of S120. That is, in the process of S140, the display unit 112 may display a message prompting the user to enter the password displayed on the operation panel 220 of the electronic device 200 into the terminal device 100. Also, as described above, the processes of S110 to S116 may be executed before the process of S140. Therefore, the display control unit 140 controls the display unit 112 to display a direction display indicating the direction indicated by the first direction information. If the process of S116 is executed, the display control unit 140 controls the display unit 112 to display a direction display indicating the direction indicated by the corrected first direction information, that is, the direction display indicating the target position.

[0064] The connection processing unit 150 determines whether the password required for direct connection has been entered into the terminal device 100 (step S150). Specifically, the connection processing unit 150 determines whether the password has been entered by the user operating the operation unit 114, etc. If the password has not been entered (NO in S150), the connection processing unit 150 repeats the process in S150.

[0065] On the other hand, if a password is entered (YES in S150), the connection processing unit 150 performs processing to directly connect the terminal device 100 to the electronic device 200 (step S152). In this case, as described above, the connection processing unit 150 performs processing to directly connect the terminal device 100 and the electronic device 200 without going through the access point 10. At this time, the connection processing unit 150 may control the first wireless communication unit 106 to connect the terminal device 100 and the electronic device 200 using the first wireless communication method.

[0066] The print control unit 160 determines whether or not there is a print command (step S160). Specifically, the print control unit 160 determines whether or not a print command has been received by the user operating the operation unit 114, etc. If there is no print command (NO in S160), the print control unit 160 repeats the process of S160. On the other hand, if there is a print command (YES in S160), the print control unit 160 controls the electronic device 200 connected to the terminal device 100 to transmit the print data included in the print command (step S162). The print control unit 160 may also control the first wireless communication unit 106 to transmit the print data to the electronic device 200 using the first wireless communication method. As a result, the electronic device 200, which is a printer, prints by forming an image corresponding to the print data on the printing medium. As described above, the printing medium on which the image corresponding to the print data has been formed is discharged into the output tray 234.

[0067] The display control unit 140 controls the direction display of the selected electronic device 200 (step S170). The process in S170 may be substantially the same as the process in S120 described above. However, the message displayed on the display unit 112 in the process in S170 may differ from that in the process in S120. That is, in the process in S170, the display unit 112 may display a message indicating that the terminal device 100 has sent print data to the selected electronic device 200. Also, as described above, the processes in S110 to S116 may be executed before the process in S170. Therefore, the display control unit 140 controls the display unit 112 to display a direction display indicating the direction indicated by the first direction information. When the process in S116 is executed, the display control unit 140 controls the display unit 112 to display the direction indicated by the corrected first direction information, that is, the direction indicating the target position.

[0068] Furthermore, the target position whose direction is indicated in the S170 process may differ from that in the S120 process. That is, in the S170 process, the user is interested in the output tray 234. Therefore, it is preferable for the user that the direction of the output tray 234 relative to the terminal device 100 is indicated on the display unit 112 of the terminal device 100.

[0069] Therefore, when the terminal device 100 transmits print data to the electronic device 200, the target position may be changed to a position corresponding to the output tray 234 of the electronic device 200. The correction unit 138 may perform a correction process (S116) so that the first direction information indicates the direction of the target position corresponding to the output tray 234 relative to the terminal device 100. The display control unit 140 may then display the direction of the target position corresponding to the output tray 234 relative to the terminal device 100 on the display unit 112.

[0070] The error determination unit 170 determines whether or not an error has occurred in the electronic device 200 (step S172). Specifically, the error determination unit 170 may determine whether or not it has acquired error information indicating that an error has occurred. The error determination unit 170 may determine that an error has occurred when the terminal device 100 receives error information indicating that an error has occurred from the electronic device 200. Alternatively, the error determination unit 170 may determine that an error has occurred when the connection to the electronic device 200 is interrupted. Alternatively, the error determination unit 170 may determine that an error has occurred when the electronic device 200, which should exist, is not found in the processes of S102 to S104.

[0071] Errors may include, for example, an abnormality in the connection between the electronic device 200 and the terminal device 100, a malfunction in the operation of the electronic device 200, or a paper jam or other problem during printing. The above-mentioned error information may be included, for example, in the BLE beacon Bb transmitted from the electronic device 200. The error information may indicate, for example, the type of error and the location related to the error on the electronic device 200. The "location related to the error" corresponds to the location where an indicator showing the cause of the error is displayed, or the location of a switch or other device related to the operation that resolves the error. The "location related to the error" may be, for example, the location of an LED (Light Emitting Diode) related to the error, or the location of a button related to the error.

[0072] If no error occurs in the electronic device 200 (NO in S172), the process in S172 is repeated. On the other hand, if an error occurs in the electronic device 200 (YES in S172), the display control unit 140 controls the direction display of the electronic device 200 that has an error (step S180). The process in S180 may be substantially the same as the process in S120 described above. However, the message displayed on the display unit 112 in the process in S180 may differ from that in the process in S120. That is, in the process in S180, the display unit 112 may display a message indicating that an error has occurred in the electronic device 200. Also, as described above, the processes in S110 to S116 may be executed before the process in S180. Therefore, the display control unit 140 controls the display unit 112 to display a direction display indicating the direction indicated by the first direction information. When the process in S116 is executed, the display control unit 140 controls the display unit 112 to display the corrected first direction information, that is, the direction indicator showing the direction indicated by the target position.

[0073] Furthermore, the target position whose direction is indicated in the S180 process may differ from that in the S120 process. That is, in the S180 process, the user is interested in the position related to the error. Therefore, it is preferable for the user that the direction to the position related to the error is indicated on the display unit 112 of the terminal device 100.

[0074] Therefore, if an error occurs in the electronic device 200, the target location may be changed to the location related to the error that occurred in the electronic device 200. The correction unit 138 may perform a correction process (S116) so that the first direction information indicates the direction of the target location related to the error. The display control unit 140 may then display the direction of the target location related to the error on the display unit 112.

[0075] Figure 6 shows a first example of the correction process in S116 in the flowchart shown in Figure 5. Figure 7 shows a second example of the correction process in S116 in the flowchart shown in Figure 5. First, the first example shown in Figure 6 will be explained.

[0076] The correction unit 138 identifies the model of the electronic device 200 (step S12). Specifically, the correction unit 138 may identify the model of the electronic device 200 using the model information contained in the BLE beacon Bb received from the electronic device 200. Alternatively, in the case of an electronic device 200 that performs infrastructure connection, the correction unit 138 may identify the model of the electronic device 200 using the model information contained in the response packet received from the electronic device 200.

[0077] The correction unit 138 identifies a model table corresponding to the identified model (step S14). Specifically, the storage unit 104 of the terminal device 100 has pre-stored model tables corresponding to various models of electronic devices 200. The correction unit 138 identifies a model table corresponding to the model identified in the processing of S12. The model tables will be described later.

[0078] The correction unit 138 acquires the angle β corresponding to the direction of the terminal device 100 relative to the electronic device 200 (step S16). Specifically, the correction unit 138 detects the transmission angle of radio waves in the electronic device 200, i.e., the radiation angle (AoD: Angle of Departure), for the BLE beacon Bb transmitted from the electronic device 200. The radiation angle AoD can be calculated using the AoD method described in Patent Document 1. That is, the electronic device 200 has multiple antennas. The electronic device 200 radiates radio waves, i.e., BLE beacon Bb, from the multiple antennas. The correction unit 138 of the terminal device 100 calculates the radiation angle AoD, which is the angle relative to the direction in which the multiple antennas are aligned, based on the distance between the multiple antennas and the phase difference of the radio waves transmitted from the multiple antennas. It is assumed that information indicating the distance between the multiple antennas in the electronic device 200, and information indicating the timing of transmitting radio waves from the multiple antennas, is provided to the terminal device 100 in advance. This information may be included in the BLE beacon Bb. As a result, the correction unit 138 acquires second direction information.

[0079] Alternatively, the terminal device 100 may emit radio waves such as BLE beacons. The electronic device 200 may then detect the reception angle of the radio waves, i.e., the angle of arrival AoA, for the radio waves such as BLE beacons transmitted from the terminal device 100. The angle of arrival AoA can be calculated using the method described in Patent Document 1. That is, the electronic device 200 has multiple antennas. The electronic device 200 receives radio waves with the multiple antennas. The electronic device 200 calculates the angle of arrival AoA, which is the angle with respect to the direction in which the multiple antennas are aligned, based on the distance between the multiple antennas and the phase difference of the radio waves received by the multiple antennas. The electronic device 200 then transmits second directional information indicating the angle of arrival AoA to the terminal device 100. As a result, the correction unit 138 acquires the second directional information.

[0080] Here, angle β corresponds to the angle of the direction of the terminal device 100 with respect to the direction in which the wireless board having the multiple antennas and the target position are aligned. Therefore, the correction unit 138 calculates angle β from the angle of the direction in which the wireless board and the target position are aligned with respect to the direction in which the multiple antennas are aligned, and the second direction information (radiation angle AoD or arrival angle AoA).

[0081] Figure 8 is a diagram illustrating the positional relationship between the electronic device 200 and the terminal device 100 according to Embodiment 1. Figure 8 shows the terminal device 100 and the electronic device 200. The diagram of the electronic device 200 shown in Figure 8 is a schematic view of the electronic device 200 from above. The electronic device 200 has an operation panel 220 corresponding to a target position. In the example of Figure 8, the wireless circuit board 240 is provided to the left of the operation panel 220 when viewed from the front surface 200a of the electronic device 200. Note that the position of the wireless circuit board 240 in the electronic device 200 may differ depending on the model of the electronic device 200. Therefore, the positional relationship between the wireless circuit board 240 and the operation panel 220 may also differ depending on the model of the electronic device 200.

[0082] The wireless board 240 is equipped with antennas for transmitting and receiving radio waves such as BLE beacons and Wi-Fi beacons. Therefore, the distance information obtained in the processing of S110 may indicate the distance between the terminal device 100 and the wireless board 240 of the electronic device 200. In addition, the first direction information obtained in the processing of S112 may indicate the direction of the wireless board 240 of the electronic device 200 relative to the terminal device 100. Here, as shown in Figure 8, the wireless board 240 and the terminal device 100 are connected by a line Ln1. Note that line Ln1 is assumed to connect the reference point P1 of the terminal device 100 and the reference point P2 of the wireless board 240. Also, for the sake of explanation, it is assumed that the multiple antennas of the terminal device 100 are arranged parallel to the front surface 100a of the terminal device 100. In this case, the angle α of line Ln1 with respect to surface 100a corresponds to the direction of the wireless board 240 of the electronic device 200 relative to the terminal device 100, i.e., the first direction information. Furthermore, the length L of the line Ln1 corresponds to the distance between the terminal device 100 and the electronic device 200 (wireless board 240). Note that the multiple antennas of the terminal device 100 do not need to be arranged parallel to the plane 100a.

[0083] Furthermore, let's assume that the wireless board 240 and the operation panel 220 are connected by a line Ln2. Line Ln2 connects the reference point P2 of the wireless board 240 to the reference point P3 of the operation panel 220. Let l be the distance between the wireless board 240 and the operation panel 220. In this case, l corresponds to the length of line Ln2. The direction indicated by line Ln2 corresponds to the direction in which the wireless board 240 and the operation panel 220 are aligned. In this case, the angle β mentioned above corresponds to the angle of line Ln1 with respect to line Ln2 at the reference point P2. In other words, angle β corresponds to the angle formed by line Ln2 and line Ln1.

[0084] Furthermore, the operation panel 220 and the terminal device 100 are connected by a line Ln3. Line Ln3 connects the reference point P3 of the operation panel 220 and the reference point P1 of the terminal device 100. In this case, the angle of line Ln3 relative to line Ln1 at reference point P1 corresponds to a correction amount Δα of the angle α indicated by the first direction information. In other words, the correction amount Δα corresponds to the angle formed by line Ln1 and line Ln3. Now, consider the triangle Tr1 formed by lines Ln1, Ln2, and Ln3 connecting the reference points P1, P2, and P3. As described above, the length of line Ln2 corresponds to the distance l between the wireless board 240 and the operation panel 220, and the distance l is determined according to the model of the electronic device 200. The angle β at reference point P2 and the distance L corresponding to the length of line Ln1 are obtained by the process described above. Therefore, triangle Tr1 can be uniquely determined. Therefore, the correction amount Δα can also be uniquely determined.

[0085] The correction unit 138 obtains a correction amount Δα corresponding to the distance L and angle β by referring to the model table (step S18). Here, the model table is information that associates the distance L to the electronic device 200, the angle β corresponding to the direction of the terminal device 100 relative to the electronic device 200, and the correction amount Δα of the angle α indicated by the first direction information. Therefore, the correction unit 138 performs the correction processing of the first direction information based on this model table.

[0086] Figure 9 is a diagram illustrating a model table used in a first example of the correction process according to Embodiment 1. The terminal device 100 pre-stores a group of model tables Tb1 corresponding to various models of the electronic device 200. The group of model tables Tb1 includes a model table corresponding to model A, a model table corresponding to model B, and a model table corresponding to model B.

[0087] For example, suppose that in the S12 process, the model of the electronic device 200 is identified as "Model A". In this case, in the S14 process, the correction unit 138 identifies the model table TbA related to Model A. Then, the correction unit 138 obtains a correction amount Δα from the model table TbA that corresponds to the distance L and angle β obtained in the above process.

[0088] In the model table TbA illustrated in Figure 9, the range of distance L, the range of angle β, and the correction amount Δα are associated. For example, if the distance L is L1 to L2 (L1 or greater and less than L2) and the angle β is β1 to β2 (β1 or greater and less than β2), the correction unit 138 uses the model table TbA to determine the correction amount Δα. 112 Let's assume that... Also, if the distance L is L1 to L2 and the angle β is β2 to β3 (between β2 and less than β3), the correction unit 138 uses the model table TbA to set the correction amount Δα to Δα 123 Let's assume that... Also, if the distance L is L2 to L3 (L2 or more and less than L3) and the angle β is β1 to β2, the correction unit 138 uses the model table TbA to set the correction amount Δα to Δα 212 Let's assume that.

[0089] The correction unit 138 corrects the angle α of the electronic device 200 relative to the terminal device 100 by the acquired correction amount Δα (step S20). As a result, the direction corresponding to the corrected angle α may point towards the target position. In the example in Figure 8, if the corrected angle α is denoted as α', then it is corrected to α' = α + Δα, so the direction corresponding to the corrected angle α', i.e., the direction of line Ln3, points towards the target position, which is the operation panel 220. Therefore, the corrected first direction information may indicate the direction of the target position relative to the terminal device 100. In other words, the correction unit 138 performs correction processing on the first direction information so that the first direction information indicates the direction of the target position in the electronic device relative to the terminal device 100.

[0090] In the model table illustrated in Figure 9, the range of distance L, the range of angle β, and the correction amount Δα are associated, but the configuration is not limited to this. In the model table, multiple values ​​of distance L, multiple values ​​of angle β, and the correction amount Δα may be associated. In this case, if the distance obtained in processing S110 or the angle β obtained in processing S16 does not match the distance shown in the model table, interpolation processing may be performed.

[0091] Note that even with the same model of electronic device 200, the distance l between the wireless board 240 and the target location may differ if the target location is different. Therefore, it should be noted that the model table will also differ if the target location is different. In other words, for example, for model A, different model tables are provided in advance for cases where the target location is the operation panel 220, the output tray 234, and the location related to an error. For example, before processing S170, the correction unit 138 may perform the correction process using the model table where the distance l is the distance between the wireless board 240 and the output tray 234.

[0092] Next, the second example shown in Figure 7 will be described. The correction unit 138 identifies the model of the electronic device 200 in the same manner as the process in S12 (step S32). The correction unit 138 obtains a distance l corresponding to the identified model (step S34). Here, as described above, the distance l corresponds to the distance between the wireless board 240 and the target position in the electronic device 200. The distance l also corresponds to the correction parameter in the correction process.

[0093] Figure 10 is a diagram illustrating a model table used in a second example of the correction process according to Embodiment 1. The terminal device 100 has pre-stored a model table Tb2 corresponding to various models of the electronic device 200. In the model table Tb2, the model and the distance l are associated. Note that the model table Tb2 illustrated in Figure 10 is for the case where the target position is the operation panel 220. For model A, the distance l between the wireless board 240 and the operation panel 220 is la. For model B, the distance l between the wireless board 240 and the operation panel 220 is lb. For model C, the distance l between the wireless board 240 and the operation panel 220 is lc.

[0094] Note that, as in the first example, even with the same model of electronic device 200, the distance l between the wireless board 240 and the target location may differ if the target location is different. Therefore, it should be noted that the model table will also differ if the target location is different. For example, before processing S170, the correction unit 138 may perform the correction process using a model table where the distance l is the distance between the wireless board 240 and the paper output tray 234.

[0095] The correction unit 138 obtains the angle β corresponding to the direction of the terminal device 100 relative to the electronic device 200 in the same manner as the process in S16 (step S36). The correction unit 138 calculates the correction amount Δα using the distance L, distance l and angle β (step S38). Specifically, the correction unit 138 calculates the correction amount Δα using the law of sines for the triangle formed by the terminal device 100, the wireless board 240 and the target position.

[0096] Let's explain using Figure 8. For the triangle Tr1 formed by the lines Ln1, Ln2, and Ln3 connecting the reference points P1, P2, and P3 as exemplified in Figure 8, the following equation (1) holds true according to the Law of Sines. l / sin(Δα)=L / sin(180°-β-Δα) ···(1)

[0097] Therefore, the correction unit 138 performs the first direction information correction process by calculating Δα that satisfies equation (1). Note that equation (1) depends on the distance l and which side the wireless board 240 is on relative to the operation panel 220, and is therefore based on the positional relationship between the wireless board 240 having an antenna and the operation panel 220 which is the target position. In other words, the correction unit 138 performs the correction process by calculating the first direction information correction amount Δα based on the distance L to the electronic device 200, the angle β corresponding to the direction of the terminal device 100 relative to the electronic device 200, and the positional relationship between the antenna and the target position.

[0098] The correction unit 138 corrects the angle α of the electronic device 200 relative to the terminal device 100 by the acquired correction amount Δα (step S40). As a result, similar to the first example, the direction corresponding to the corrected angle α may point towards the target position. In other words, the correction unit 138 performs correction processing on the first direction information so that the first direction information indicates the direction of the target position in the electronic device.

[0099] Figure 11 shows the positional relationship between the terminal device 900 and the electronic device 200 according to the comparative example. The comparative example in Figure 11 corresponds to the technology described in Patent Document 1. As indicated by arrow A, when the terminal device 900 is sufficiently far from the electronic device 200, the direction indicator InD displayed on the display unit 912 of the terminal device 900 can be said to indicate the approximate direction of the electronic device 200. Furthermore, when the terminal device 900 is sufficiently far from the electronic device 200, there is no problem as long as the direction indicator InD indicating the approximate direction of the electronic device 200 is displayed on the display unit 112 of the terminal device 900.

[0100] On the other hand, suppose that the user holding the terminal device 900 moves toward the electronic device 200, as indicated by arrow ArA, and the terminal device 900 approaches the electronic device 200 by a predetermined distance or more, as indicated by arrow B. In this case, the direction indicator InD displayed on the display unit 912 indicates the direction of the wireless board 240. Here, when the terminal device approaches the electronic device 200, it is desirable that the direction indicator InD indicates the direction of an object that the user is interested in, such as the operation panel 220. However, if the position of the wireless board 240 is far from the object of interest, such as the operation panel 220, the direction of the direction indicator InD may deviate from the desired direction. Therefore, in the comparative example, the convenience for the user may be impaired.

[0101] In contrast, in this embodiment, the correction unit 138 is configured to perform correction processing on the first direction information based on distance information so that the first direction information indicates the direction of the target position on the electronic device 200 relative to the terminal device 100. The display control unit 140 is configured to display the direction of the target position relative to the terminal device 100 on the display unit 112 based on the corrected first direction information. This makes it possible to suppress the display of a direction that is deviated from the direction toward the desired position on the electronic device 200 (for example, the position of the operation panel 220 of the electronic device 200). Therefore, convenience for the user is improved.

[0102] Furthermore, in this embodiment, the correction unit 138 may be configured to perform correction processing when the distance to the electronic device 200 is less than a predetermined threshold. This prevents the correction processing from being performed even when it is sufficient to display the approximate direction of the electronic device 200, such as when the terminal device 100 is sufficiently far from the electronic device 200. Therefore, an increase in processing load is suppressed.

[0103] Furthermore, in this embodiment, the correction unit 138 may be configured to perform correction processing based on information that associates the distance to the electronic device 200, the angle corresponding to the direction of the terminal device 100 relative to the electronic device 200, and the correction amount of the first direction information. Alternatively, the correction unit 138 may be configured to calculate the correction amount of the first direction information based on the distance to the electronic device 200, the angle corresponding to the direction of the terminal device 100 relative to the electronic device 200, and the positional relationship between the antenna used for short-range wireless communication and the target position. The former configuration allows for correction processing with simpler processing compared to the latter configuration. On the other hand, the latter configuration allows for more accurate correction processing compared to the former configuration. Furthermore, the latter configuration eliminates the need for the association information (table) required in the former configuration. That is, it eliminates the need to prepare in advance complex information that associates the distance to the electronic device 200, the angle corresponding to the direction of the terminal device 100 relative to the electronic device 200, and the correction amount of the first direction information.

[0104] Furthermore, in this embodiment, the target position may correspond to the position of the operation panel 220 of the electronic device 200. This allows the direction of the operation panel 220, an object that is highly likely to attract the user's attention, to be displayed on the display unit 112. Therefore, convenience for the user is improved.

[0105] Furthermore, the target location may be changed depending on the conditions. This means that if the location that the user is most likely to focus on changes depending on the conditions, the target location will also change. Therefore, convenience for the user is improved.

[0106] Furthermore, in this embodiment, when an error occurs in the electronic device 200, the correction unit 138 may be configured to perform a correction process so that the first directional information indicates the direction of the location related to the error. In this case, the display control unit 140 may be configured to display the direction of the location related to the error on the display unit 112. This allows the user to easily grasp the location of the error occurring in the electronic device 200. Therefore, convenience for the user is improved.

[0107] Furthermore, in this embodiment, when the terminal device 100 transmits print data to the electronic device 200 having a printing function, the correction unit 138 may be configured to perform correction processing so that the first direction information indicates the direction of the target position corresponding to the paper output tray 234. In this case, the display control unit 140 may be configured to display the direction of the target position corresponding to the paper output tray 234 on the display unit 112. This allows the user to easily grasp the position of the paper output tray 234. Therefore, convenience for the user is improved.

[0108] Figures 12 to 17 illustrate the screens displayed on the terminal device 100 according to Embodiment 1. Figures 12 to 15 illustrate the case where the target position corresponds to the position of the operation panel 220. Figure 12 is an example of the device list displayed on the terminal device 100 according to Embodiment 1. Figure 12 shows the device list Lt when printers A to E (electronic devices 200A to 200E) are found. Figure 12 shows an example of indicating the direction for each printer in the device list Lt.

[0109] The device list Lt shown in Figure 12 displays each printer (electronic device 200) in order of proximity to the terminal device 100. In the example in Figure 12, the distances from the terminal device 100 to each printer are closest to printer D, printer C, printer B, printer A, and printer E. Note that the order in which the printers are displayed in the device list Lt does not have to be in order of proximity to the terminal device 100. This is also true for the device list Lt in other figures.

[0110] Furthermore, the device list Lt illustrated in Figure 12 includes a direction indicator InD that shows the direction of each printer relative to the terminal device 100. For each printer, the direction indicator InD indicates the direction shown by the first direction information using the direction of an arrow. Here, if the distance between the terminal device 100 and the printer is less than a threshold, the direction indicator InD for that printer shows the corrected direction, i.e., the direction of the operation panel 220.

[0111] In the device list Lt illustrated in Figure 12, the direction of printer D is indicated by the direction indicator InDd, which shows the direction of printer D relative to terminal device 100. Direction indicator InDd indicates that the direction of printer D is to the right relative to terminal device 100. Also in the device list Lt, the direction of printer C is indicated by the direction indicator InDc, which shows the direction of printer C relative to terminal device 100. Direction indicator InDc indicates that the direction of printer C is diagonally to the left and forward relative to terminal device 100.

[0112] Furthermore, in the device list Lt, the direction of printer B is indicated by the direction indicator InDb, which shows the direction of printer B relative to terminal device 100. Direction indicator InDb indicates that the direction of printer B is diagonally forward to the right relative to terminal device 100. Furthermore, in the device list Lt, the direction of printer A is indicated by the direction indicator InDa, which shows the direction of printer A relative to terminal device 100. Direction indicator InDa indicates that the direction of printer A is forward relative to terminal device 100. Furthermore, in the device list Lt, the direction of printer E is indicated by the direction indicator InDe, which shows the direction of printer E relative to terminal device 100. Direction indicator InDe indicates that the direction of printer E is diagonally backward to the left relative to terminal device 100.

[0113] Figure 13 shows an example of selecting a printer using the device list Lt displayed on the terminal device 100 according to Embodiment 1. Figure 13 shows the device list when printers A to E (electronic devices 200A to 200E) are found. The device list illustrated in Figure 13 displays each printer (electronic device 200) in order of proximity to the terminal device 100. On the other hand, unlike the device list illustrated in Figure 12, the device list illustrated in Figure 13 does not show direction. In the example in Figure 13, the distance from the terminal device 100 to each printer is closest in the order of printer D, printer C, printer B, printer A, and printer E.

[0114] In the example shown in Figure 13, the user selects printer B using the device list displayed on the terminal device 100. When the user selects printer B, the display unit 112 of the terminal device 100 displays a direction indicator InD, which indicates the direction of printer B relative to the terminal device 100, as illustrated in Figure 13. Alternatively, as shown in the example in Figure 13, the display unit 112 may display the distance between the terminal device 100 and printer B, which is "3.1m". Furthermore, as shown in the example in Figure 13, the display unit 112 may display a message such as "Distance and direction of selected printer". If the distance between the terminal device 100 and printer B is less than a threshold, the correction process of the correction unit 138 causes the direction indicator InD to indicate the direction of the operation panel 220 of the electronic device 200.

[0115] Figure 14 illustrates the screen displayed on the display unit 112 of the terminal device 100 when the terminal device 100 according to Embodiment 1 makes a direct connection with an electronic device 200 which is a printer. Figure 14 illustrates the screen displayed on the display unit 112 in the process of S140 in the flowchart shown in Figure 5.

[0116] As illustrated in Figure 14, the display unit 112 of the terminal device 100 displays a direction indicator InD that shows the direction of the selected printer. Here, if the distance between the terminal device 100 and the printer is less than a threshold, the correction process of the correction unit 138 causes the direction indicator InD to show the direction of the operation panel 220 of the electronic device 200 relative to the terminal device 100.

[0117] Furthermore, as shown in the example in Figure 14, the display unit 112 may display the distance between the terminal device 100 and the printer, which is "3.1m". Also, as shown in the example in Figure 14, the display unit 112 may display a message such as "Distance and direction of the selected printer". In addition, as shown in the example in Figure 14, the display unit 112 may display a message MeA such as "Please enter the password displayed on the printer's operation panel into the terminal device". This message MeA prompts the user to enter the password displayed on the printer's (electronic device 200) operation panel 220 into the terminal device 100.

[0118] Figure 15 illustrates the screen displayed on the display unit 112 of the terminal device 100 when the terminal device 100 according to Embodiment 1 sends print data to the electronic device 200, which is a printer. Figure 15 illustrates the screen displayed on the display unit 112 in the process of S170 in the flowchart shown in Figure 5.

[0119] As illustrated in Figure 15, the display unit 112 of the terminal device 100 displays a direction indicator InD that shows the direction of the selected printer relative to the terminal device 100. Here, if the distance between the terminal device 100 and the printer is less than a threshold, the correction process of the correction unit 138 causes the direction indicator InD to show the direction of the operation panel 220 of the electronic device 200 relative to the terminal device 100.

[0120] Furthermore, as illustrated in Figure 15, the display unit 112 may display the distance between the terminal device 100 and the printer, which is "3.1m". Also, as illustrated in Figure 15, the display unit 112 may display a message such as "Distance and direction of the selected printer". In addition, as illustrated in Figure 15, the display unit 112 may display a message MeB such as "Print data has been sent to the printer". This message MeB indicates that print data has been sent to the selected printer (electronic device 200).

[0121] Figure 16 illustrates the screen displayed on the display unit 112 of the terminal device 100 when the terminal device 100 according to Embodiment 1 sends print data to the electronic device 200, which is a printer. Figure 16 illustrates the screen displayed on the display unit 112 in the process of S170 in the flowchart shown in Figure 5. Here, Figure 16 illustrates the case where the target position corresponds to the position of the paper output tray 234. In the example of Figure 16, it is assumed that the distance between the terminal device 100 and the printer is less than a threshold. In this case, the correction process of the correction unit 138 causes the direction indicator InD to show the direction of the paper output tray 234 of the electronic device 200 relative to the terminal device 100. This allows the user to easily understand the position of the paper output tray 234. Therefore, convenience for the user is improved.

[0122] Furthermore, as illustrated in Figure 16, if the direction indicator InD indicates the direction of the output tray 234 relative to the terminal device 100, the display unit 112 may display a message Me1 such as "Please check the output tray." Also, as illustrated in Figure 16, the display unit 112 may display the message MeB illustrated in Figure 15.

[0123] Figure 17 illustrates a screen displayed on the display unit 112 of the terminal device 100 when an error occurs in the electronic device 200 according to Embodiment 1. Figure 17 illustrates a screen displayed on the display unit 112 in the process of S180 in the flowchart shown in Figure 5. Here, Figure 17 illustrates the case where the target position is the position related to the error. In the example of Figure 17, it is assumed that the distance between the terminal device 100 and the printer is less than a threshold. In this case, the correction process of the correction unit 138 causes the direction indicator InD to show the direction of the position related to the error in the electronic device 200 relative to the terminal device 100. In the example of Figure 17, the position related to the error corresponds to the position of the LED related to the error. This allows the user to easily understand the position of the LED related to the error. Therefore, convenience for the user is improved.

[0124] Furthermore, as illustrated in Figure 17, if the direction indicator InD indicates the direction of the LED related to an error in the terminal device 100, the display unit 112 may display a message Me2 such as "Please check if the LED is lit." Also, as illustrated in Figure 17, the display unit 112 may display a message MeC such as "An error has occurred in the printer." This message MeC is a message to inform the user that an error has occurred in the printer.

[0125] (modified version) It should be noted that the present invention is not limited to the embodiments described above, and can be modified as appropriate without departing from the spirit of the invention. For example, the communication system 1 shown in Figure 2 has five electronic devices 200, but the number of electronic devices 200 in the communication system 1 is arbitrary.

[0126] Furthermore, the order of each process in the flowchart described above can be changed as appropriate. Also, one or more of the processes in the flowchart described above can be omitted. For example, in the flowchart shown in Figure 5, the order of processes S102 and S104 may be reversed. Alternatively, processes S102 and S104 may be executed in parallel. Also, the order of processes S110 and S112 may be reversed. Alternatively, processes S110 and S112 may be executed in parallel. Also, processes S172 to S180 may be omitted. Also, processes S160 to S170 may be omitted. Also, processes S130 to S152 may be omitted.

[0127] Furthermore, in the example described above, the target position in the processing of S120 and S140 was set to the position corresponding to the operation panel 220, but the target position in this case does not have to be the position corresponding to the operation panel 220. For example, the target position in this case may be the central position of the electronic device 200.

[0128] Furthermore, the target position does not need to be changed during the processing of S170 and S180. In other words, even if print data is transmitted to the electronic device 200 or if an error occurs in the electronic device 200, the target position may remain the position corresponding to the operation panel 220. However, changing the target position in the above cases further improves convenience for the user.

[0129] In the examples described above, the program includes a set of instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more of the functions described in the embodiments. The program may be stored on a non-temporary computer-readable medium or a physical storage medium. Examples, but not limited to, include random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technologies, CD-ROM, digital versatile disk (DVD), Blu-ray® disc or other optical disc storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage devices. The program may be transmitted over a temporary computer-readable medium or a communication medium. Examples, but not limited to, include temporary computer-readable medium or a communication medium that includes electrically, optically, acoustically or otherwise propagating signals. [Explanation of Symbols]

[0130] 1...Communication system, 10...Access point, 100...Terminal device, 102...Processing unit, 104...Storage unit, 106...First wireless communication unit, 108...Second wireless communication unit, 112...Display unit, 114...Operation unit, 130...Printing application, 132...Search processing unit, 134...Distance information acquisition unit, 136...Direction information acquisition unit, 138...Correction unit, 140...Display control unit, 150...Connection processing unit, 160...Printing control unit, 170...Error determination unit, 200...Electronic equipment, 202...Processing unit, 204...Storage unit, 206...First wireless communication unit, 208...Second wireless communication unit, 210...Printing unit, 212...User interface, 220...Operation panel, 232...Paper feed tray, 234...Paper output tray, 240...Wireless board

Claims

1. A terminal device, A distance information acquisition unit acquires distance information indicating the distance between the terminal device and the electronic device through short-range wireless communication with the electronic device, A direction information acquisition unit acquires first direction information indicating the direction of the electronic device relative to the terminal device through the short-range wireless communication with the electronic device, Based on the distance information, the first direction information indicates the direction of the target position in the electronic device. By obtaining the correction amount for the first direction information based on information that associates the distance to the electronic device, the angle corresponding to the direction of the terminal device relative to the electronic device, and the correction amount for the first direction information, or, By calculating the first directional information correction amount based on the distance to the electronic device, the angle corresponding to the direction of the terminal device relative to the electronic device, and the positional relationship between the antenna used for short-range wireless communication and the target position, A correction unit that performs the correction processing of the first direction information, A display control unit that causes the direction of the target position to be displayed on the display unit based on the corrected first direction information, A terminal device having the following features.

2. The correction unit performs the correction process when the distance to the electronic device is less than a predetermined threshold. The terminal device according to claim 1.

3. The aforementioned target position is the position corresponding to the operation panel of the electronic device. The terminal device according to claim 1.

4. The aforementioned target position is changed according to the conditions. The terminal device according to claim 1.

5. If an error occurs in the aforementioned electronic device, The correction unit performs a correction process so that the first direction information indicates the direction of the target position related to the error. The display control unit causes the direction of the target position related to the error to be displayed on the display unit. The terminal device according to claim 4.

6. When the terminal device transmits print data to the electronic device having a printing function, The correction unit performs a correction process so that the first direction information indicates the direction of the target position corresponding to the paper output tray of the electronic device. The display control unit causes the direction of the target position corresponding to the paper output tray to be displayed on the display unit. The terminal device according to claim 4.

7. By short-range wireless communication with an electronic device, distance information indicating the distance between the terminal device and the electronic device is obtained. Through the short-range wireless communication with the electronic device, first directional information indicating the direction of the electronic device relative to the terminal device is obtained. Based on the distance information, the first direction information indicates the direction of the target position in the electronic device. By obtaining the correction amount for the first direction information based on information that associates the distance to the electronic device, the angle corresponding to the direction of the terminal device relative to the electronic device, and the correction amount for the first direction information, or, By calculating the first directional information correction amount based on the distance to the electronic device, the angle corresponding to the direction of the terminal device relative to the electronic device, and the positional relationship between the antenna used for short-range wireless communication and the target position, Perform the correction process for the first direction information, Based on the corrected first directional information, the direction of the target position is displayed on the display unit. Display control method.

8. The steps include: obtaining distance information indicating the distance between a terminal device and an electronic device through short-range wireless communication with the electronic device; The steps include: obtaining first directional information indicating the direction of the electronic device relative to the terminal device through short-range wireless communication with the electronic device; Based on the distance information, the first direction information indicates the direction of the target position in the electronic device. By obtaining the first directional information correction amount based on information that associates the distance to the electronic device, the angle corresponding to the direction of the terminal device relative to the electronic device, and the first directional information correction amount, or, By calculating the first directional information correction amount based on the distance to the electronic device, the angle corresponding to the direction of the terminal device relative to the electronic device, and the positional relationship between the antenna used for short-range wireless communication and the target position, The steps include: performing the correction processing of the first direction information, A step of displaying the direction of the target position on the display unit based on the corrected first direction information, A program that causes a computer to execute something.

Images