Information processing device, control method for information processing device, and program

The system addresses communication errors in distance measurement by switching from UWB to BLE, ensuring continuous distance information acquisition.

JP2025165206APending Publication Date: 2025-11-04CANON KK
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024069171
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-04-22
Publication Date
2025-11-04

AI Technical Summary

Technical Problem

Existing distance measurement systems fail to provide distance information when communication errors occur, as users are only notified of errors without establishing communication.

Method used

The system switches from UWB communication to BLE communication for distance measurement when errors occur in UWB, ensuring continuous distance information acquisition.

Benefits of technology

Enables the user to obtain distance information by switching to BLE communication when UWB communication fails, maintaining functionality and reliability.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025165206000001_ABST
    Figure 2025165206000001_ABST
Patent Text Reader

Abstract

To solve a problem in which, when an error occurs in UWB communication, distance information cannot be obtained and the distance to the target object cannot be determined.SOLUTION: When UWB communication fails, distance measurement can be performed using BLE communication, and distance information can be notified to a user.SELECTED DRAWING: Figure 10
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to an information processing device, a control method for an information processing device, and a program. [Background technology]

[0002] In recent years, systems and applications that measure the distance to an object and incorporate the distance information have become popular. Patent Document 1 describes a system in which a portable terminal device (electronic key) carried by a user communicates with an in-vehicle device to measure the distance using UWB (ultra-wideband) wireless communication, and performs authentication based on the acquired distance information. In Patent Document 1, UWB communication is performed, and if a communication error occurs, the user is notified of this. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-64905 Summary of the Invention [Problem to be solved by the invention]

[0004] In the distance measurement communication method described in Patent Document 1, when a communication error occurs, the user can be notified of the error, but because communication is not established, the user will not be able to obtain distance information. [Means for solving the problem]

[0005] The information processing device of the present invention is characterized in that, in a system in which a first information processing device measures distance to a second information processing device using a first distance measurement communication method, when an error occurs in the first distance measurement communication method and distance information cannot be obtained, the information processing device switches to a second distance measurement communication method and measures the distance. [Effects of the Invention]

[0006] According to the present invention, when an error occurs in the first distance measurement communication method, the user can obtain information on the distance to the target object by using the second distance measurement communication method. [Brief explanation of the drawings]

[0007] [Figure 1] 1 is a diagram showing a system configuration including an information processing apparatus according to an embodiment of the present invention; [Figure 2] FIG. 2 is a diagram illustrating a hardware configuration of a mobile terminal. [Figure 3] FIG. 2 is a diagram illustrating a hardware configuration of a print processing device. [Figure 4] FIG. 2 is a diagram illustrating a software configuration of the mobile terminal. [Figure 5] FIG. 2 is a diagram illustrating a software configuration of the print processing device. [Figure 6] FIG. 1 is a diagram illustrating a distance measurement method using UWB. [Figure 7] FIG. 10 is a sequence diagram showing an operation when a device list is displayed. [Figure 8] FIG. 10 is a diagram illustrating an example of a mobile terminal operation screen. [Figure 9] FIG. 2 is a diagram illustrating a configuration of a wireless communication packet. [Figure 10] This is a sequence diagram when performing distance measurement using BLE communication. DETAILED DESCRIPTION OF THE INVENTION

[0008] The best mode for carrying out the present embodiment will be described below with reference to the drawings. In this embodiment, a mobile terminal and a print processing device will be used as examples of information processing devices, but this does not limit the scope of the present invention as defined in the claims, and not all of the combinations of features described in the embodiment are necessarily essential to the solution of the invention.

[0009] A detailed description will be given below with reference to the drawings.

[0010] <System Configuration in this Example> Fig. 1 is a diagram showing an example of the configuration of a data processing system according to this embodiment, in which 101 is a mobile terminal which is an information processing device, and 102 and 103 are print processing devices which are also information processing devices.

[0011] Reference numeral 110 denotes a LAN (Local Area Network) to which the print processing devices 102 and 103 are connected, and the connected devices exchange information through mutual communication via the LAN 110 .

[0012] Reference numerals 104, 106, and 108 denote wireless signals using Bluetooth Low Energy (BLE) transmitted and received by the mobile terminal 101 and print processing devices 102 and 103. A wireless personal area network (WPAN) can be formed between devices that can communicate with each other via wireless signals.

[0013] Reference numerals 105, 107, and 109 denote UWB (Ultra Wide Band) wireless signals transmitted and received by the mobile terminal 101 and print processing devices 102 and 103. A WPAN (wireless personal area network) can be formed between devices that can communicate with each other via wireless signals.

[0014] The information processing device of this embodiment is characterized in that in such a data processing system, distance is measured using UWB communication, and when an error occurs in the UWB communication, distance measurement continues to operate using BLE communication.

[0015] <Mobile device hardware configuration> FIG. 2 is a block diagram showing the hardware configuration of the mobile terminal 101 appearing in FIG.

[0016] The mobile terminal 101 may be, for example, a smartphone or tablet, and may run a terminal operating system and programs for controlling calls and data communications. It may also be a personal computer or the like that does not include the audio control unit 211, microphone / speaker 212, position detection control unit 217, GPS sensor 218, direction detection control unit 219, or gyro sensor 220, which will be described later. It may also be a personal computer or the like that does not include the acceleration detection control unit 221, acceleration sensor 222, mobile phone data communication unit 208, etc.

[0017] Each hardware component is connected to a system bus 201. A ROM 203 is a non-volatile memory that stores an operating system (OS) for the mobile terminal 101 and applications that control calls and data communications, and these are executed by a CPU 202. Applications that control data communications include a printing application, mail software, and a web browser.

[0018] The RAM 204 is a work memory area for applications to execute programs, and also serves as a memory for temporarily storing data that must be temporarily saved when the applications execute programs.

[0019] The storage device 205 is a non-volatile storage device that stores user data, various operation mode settings, operation logs, and the like that need to be retained even after the mobile terminal 101 is restarted.

[0020] The network controller 206 controls communication by a wireless LAN communication unit 207 for joining the network of the LAN 110 via a LAN terminal (not shown). 206 also controls communication by a mobile phone data communication unit 208 for joining a network provided by a mobile carrier. 206 also controls communication by a BLE communication unit 209 for forming a WPAN between nearby information processing devices that can reach each other via wireless signals using BLE. 206 also controls communication by a UWB communication unit 210 for forming a WPAN for performing ranging and data communication between nearby information processing devices that can reach each other via wireless signals using UWB. In BLE communication and UWB communication, communication functions can be controlled independently to achieve the purpose of communication.

[0021] The audio control unit 211 is used, for example, when a call application is started and the user is making a call. Audio data is input and output via the microphone / speaker 212, and the audio control unit 211 acts as an intermediary between the audio data and the audio data control program.

[0022] A display control unit 213 controls information to be output on a display 214 of the mobile terminal 101. An input control unit 215 controls information designated by a user using buttons or a touch panel 216 of the mobile terminal 101.

[0023] The position detection control unit 217 acquires position information of the mobile terminal 101 from the GPS sensor 218 and provides it to the operation system. The direction detection control unit 219 acquires direction information of the mobile terminal 101 from the gyro sensor 220 and provides it to the operation system. The acceleration detection control unit 221 acquires acceleration information of the mobile terminal 101 from the acceleration sensor 222 and provides it to the operation system. These controls are controlled by the operation system running on the CPU 202.

[0024] The mobile terminal 101 is capable of communicating with the print processing devices 102 and 103 via the UWB communication unit 210 for distance measurement. The UWB communication unit 210 supports at least TWR (Two Way Ranging) shown in FIG. 6 as a communication method for distance measurement. The mobile terminal 101 transmits distance measurement request data and receives corresponding distance measurement response data via the UWB communication unit 210. The mobile terminal 101 is capable of providing distance information generated by the CPU 202 calculating the distance through data processing of the received distance measurement response data at a timing expected by an application. In this way, the mobile terminal 101 is capable of providing distance information between the print processing devices 102 and 103 in the system configuration shown in FIG. 1 and peripheral devices (not shown) that support UWB communication.

[0025] <Print processing device - overall configuration> Fig. 3 is a diagram showing the hardware configuration of the print processing device 102 that constitutes the system of Fig. 1. Note that the print processing device 103 has a similar configuration, so a description thereof will be omitted.

[0026] The print processing device 102 has an operation unit 350 that allows the user to perform various operations, a scanner unit 360 that reads image information in accordance with instructions from the operation unit 350, and a printer unit 370 that prints image data on paper.

[0027] Scanner unit 360 includes a CPU that controls scanner unit 360, an illumination lamp for reading an original, a scanning mirror, etc. Printer unit 370 includes a CPU that controls printer unit 370, a photosensitive drum for forming and fixing an image, a fixing unit, etc.

[0028] The print processing device 102 also includes a scanner unit 360, a printer unit 370, and a controller 300 that comprehensively controls communication with external information devices such as a mobile terminal 101 and a print server 150 connected via a LAN 110, a wireless LAN 310, etc.

[0029] <Print processing device-controller configuration> The inside of the controller 300 will be described in detail with reference to FIG.

[0030] The controller 300 includes a BLE communication unit 305, a UWB communication unit 307, and a Wi-Fi communication unit 309, which are capable of communicating with the external mobile terminal 101. The controller 300 has a CPU 301 as a control unit that controls the print processing device 102 in an overall manner.

[0031] The RAM 302 is a system work memory for the operation of the CPU 301, and is also an image memory for temporarily storing image data. The ROM 303 is a non-volatile memory that stores a boot program executed by the CPU 301. The HDD 304 is a non-volatile storage device that stores system software, image data, software counter values, etc.

[0032] The controller 300 also includes a raster image processor (RIP) 311 that converts PDL code included in a print job received via the LAN 110, wireless communication 310, or the like into a bitmap image.

[0033] The controller 300 also has a scanner image processing unit 312 that corrects, processes, and edits image data input from the scan unit 360. It also has a printer image processing unit 313 that corrects, converts resolution, and the like for image data output from the printer unit 370, and an image rotation unit 314 that rotates the image data. It also has an image compression unit 315 that performs JPEG compression and expansion for multi-value image data and JBIG, MMR, or MH compression and expansion for binary image data.

[0034] The device I / F 316 connects the scanner unit 360 and printer unit 370 to the controller 300 and performs synchronous / asynchronous conversion of image data. It also includes an image bus 380 that connects these units together and transfers image data at high speed.

[0035] The computer also includes a scanner / printer communication I / F 320 that communicates with the scanner unit 360 and the printer unit 370, respectively, and a system bus 390 that connects these together.

[0036] The controller 300 also includes an ImageBusI / F 321 that functions as a bus bridge that connects the system bus 390 and the image bus 380 and converts the data structure.

[0037] The operation unit 350 has a role of transmitting information input by the user to the CPU 301 via the operation unit I / F 317, and outputting an operation screen, image data, and the like.

[0038] A network 318 is connected to the LAN 110 and communicates with the print server 150 and other information processing devices. A modem 319 is connected to an external facsimile device (not shown) and transmits and receives data.

[0039] The controller 300 also records and manages the history of job execution, such as user name, number of copies, color printing, and output attribute information, as job log information, in the HDD 304 or RAM 302 when a print or copy job is executed.

[0040] <Mobile device software configuration> FIG. 4 is a block diagram illustrating the software configuration of the mobile terminal 101 shown in FIG. 1 and the data area managed by the software.

[0041] The application 401 is an application executed by the CPU 202 on the mobile terminal 101 in this embodiment, and is installed in the ROM 203 as an application that runs on the operating system.

[0042] Document 406 indicates an area of ​​data that the software stores and manages in RAM 204 .

[0043] The platform 408 can be configured with a platform such as Google's Android (registered trademark) or Apple's iOS (registered trademark). The platform 408 includes a group of device drivers for controlling various hardware and provides applications running on the platform 408 with APIs for using the various hardware. For example, for BLE (Bluetooth) communication and UWB (Ultra Wide Band) communication, an API compliant with Apple's "Neaby Interaction" is provided. Furthermore, an API compliant with the "Common Service Management Layer (CSML) specification," standardized by the FiRa Consortium, an organization promoting and disseminating UWB, is provided. The device driver group includes a BLE communication control unit 409, a UWB communication control unit 410, and a WIFI communication control unit 411.

[0044] A UI unit 402 is the UI unit of the application 401, and provides a user interface for allowing the user to set functions specific to the application and for displaying information.

[0045] The print processing device search unit 403 provides a function for the mobile terminal 101 to search for the print processing devices 102 and 103 within a WPAN that allows BLE transmission and reception via the BLE communication control unit 409. The print processing device search unit 403 also provides a function for acquiring distance information by controlling communication for measuring distances with the print processing devices 102 and 103 via the UWB communication control unit 410. After the search, the UWB communication control unit 410 is also capable of continuously making distance measurement requests to the image forming device 102 and receiving distance measurement responses without requiring the user to check or operate a UI unit. The UWB communication control unit 410 is capable of continuously measuring the distance to the print processing device 102 and informing the user of the distance to the print processing device 102.

[0046] The print control unit 404 provides a function for generating a print job for a communicable image forming apparatus and transmitting the print job.

[0047] <Print processing device software configuration> 5 is a block diagram showing the software configuration of the print processing device 102 shown in FIG. 1 and the data area managed by the software. The software configuration of the print processing device 103 is the same, so a description thereof will be omitted. The software shown in the figure is a program deployed in RAM 302 and executed by CPU 301. Print job 514, document 515, and user account 509 indicate data areas stored and managed by the software in RAM 302 and HDD 304.

[0048] An application 501 is an application that runs on the print processing device 102 and is installed in the ROM 303 as an application that runs on the operating system.

[0049] The platform 510 can be configured to include an operating system such as Linux (registered trademark), a JAVA (registered trademark) virtual machine, an OSGi (registered trademark) framework, and a group of device drivers. JAVA is a registered trademark of Oracle Corporation. The OSGi framework is a JAVA-based service platform defined by the OSGi Alliance (a standards organization).

[0050] The platform 510 includes a group of device drivers for controlling various types of hardware, and provides applications running on the platform 510 with APIs for using the hardware. For example, the BLE communication control unit 511 is a device driver for controlling the BLE communication unit 305, and the UWB communication control unit 512 is a device driver for controlling the UWB communication unit 307. The WIFI communication control unit 513 is a device driver for controlling the WIFI communication unit 309. For protocol control using BLE communication and UWB communication, an API compliant with Apple's "Neaby Interaction" is provided. An API compliant with the "Common Service Management Layer (CSML) specification," standardized by the FiRa Consortium, an organization promoting and disseminating UWB, is provided.

[0051] Although not shown, the platform 510 also includes a scanner module that controls the scanner 360 and a printer module that controls the printer 370. The platform 510 also provides applications with APIs for reading and writing data for a print job 514 and a user account 509.

[0052] Furthermore, a UI unit 502, a terminal device search 503, a print 504, a copy 505, a read 506, a send 507, and a login authentication 508 are applications that run on a platform 510. A user interface that provides various functions to the operation unit 250 is displayed as icons, application display names, or the like.

[0053] For example, the copy function 505 controls reading 506 and printing 504 via the platform 510 to execute copying. Printing 504 provides a function to print document data stored in the document 515 or print jobs stored in the print job 514. Transmission 507 provides a function to transmit externally the document data acquired from the reading 506. The UI unit 502 is a module that provides a user interface such as a menu screen for selecting functions specific to applications (e.g., copy, print, transmission) from the operation unit 350.

[0054] The login authentication 508 is a module that provides a login function when the user uses the printing processing apparatus 102.

[0055] The terminal device search unit 503 causes the BLE communication control 511 to send out a beacon signal indicating the presence of the printing processing apparatus using the BLE communication control 511, or causes the UWB communication control unit 512 to return ranging response data for ranging request data in UWB communication.

[0056] Also, in the print job 514 which is a management area of the platform 510, data of jobs received from the user at any time and their contents are recorded and managed.

[0057] <UWB Ranging Method> FIG. 6 shows a ranging method for measuring the distance between an Anchor and a Tag, which is a ranging method adapted in the data processing system including the mobile terminal 101 and the printing processing apparatus 102 of the present embodiment and defined in the IEEE802.15.4 group. This method measures the distance by calculating the frame arrival time (ToA: Time Of Arrival) per unit distance based on the speed at which radio waves propagate in space. FIG. 6 shows a Two Way Ranging (TWR) ranging method in which frames are transmitted bidirectionally between the Anchor and the TAG. In TWR, the ANCHOR is responsible for the ranging subject, and the TAG is the ranging object.

[0058] In this patent, the mobile terminal 101 corresponds to the Anchor, and the print processing device 102 (103) corresponds to the Tag.

[0059] When measuring the distance to a TAG, an Anchor issues a POLL frame to the TAG. When a TAG receives a POLL frame and recognizes that it is addressed to it, it sends a RESP frame to the Anchor a predetermined time (Treply) after it receives the frame. This RESP frame has a Treply value assigned to it.

[0060] When the Anchor receives the RESP frame, it calculates the time (Tround) from the issuance of the POLL frame to the reception of the RESP frame. Furthermore, the Anchor uses the Treply value included in the RESP frame to calculate the ToA required to transmit the POLL and RESP frames. Finally, the Anchor calculates the distance to the TAG from this ToA time and the propagation speed of radio waves (speed of light).

[0061] <Mobile application operation process> 7 is a sequence diagram showing the operation process of the data processing system according to this embodiment. After the user operating the mobile terminal 101 starts an application (which may be a part of a printer search application, a print application, etc.), the application searches for a print processing device, measures the distance to the print processing device, and displays the distance on the mobile terminal 101.

[0062] The detailed operation will be explained using this sequence diagram.

[0063] The operational flows shown in these sequence diagrams are realized by the hardware and software components constituting the mobile terminal 101 and print processing device 102 shown in the above-mentioned Figures 2 to 5. Regarding the software components, the mobile terminal 101 operates when the CPU 202 executes a program loaded in the RAM 204. The print processing device 102 operates when the CPU 301 executes a program loaded in the RAM 302.

[0064] <Application launch> First, the mobile terminal 101 accepts a user operation and starts the application 401 (step S701). The top menu displayed immediately after the application 401 starts is shown in Fig. 8(a). This is a user interface that accepts various input operations from the user.

[0065] A button 801 is a button for transitioning to a screen for selecting a print processing device to be instructed to print, and when no selection is made, the message "not selected" is displayed as shown in the button 801.

[0066] Button 802 is a button for selecting a photo saved in the mobile terminal 101 and transitioning to a screen for printing. If a print processing device to be instructed to print has not been selected, pressing this button is invalid. Button 803 is a button for selecting a file such as a PDF saved in the mobile terminal 101 and transitioning to a screen for printing. If a print processing device to be instructed to print has not been selected, pressing this button is invalid, just like button 802.

[0067] <Printer Search> When the button 801 in the top menu of FIG. 8(a) is pressed, the mobile terminal 101 starts searching for a print processing device (step S702).

[0068] The mobile terminal 101 receives an advertisement packet transmitted by the BLE communication units 305 of the printing processing apparatuses 102, 103, etc. in the data processing system shown in FIG. 1 (step S703). Next, the mobile terminal 101 performs pairing to establish an authentication connection for data communication with the printing processing apparatus 102 (step S704). Subsequently, information necessary for the application is exchanged between the mobile terminal 101 and the printing processing apparatus 102 by GATT communication (step S705). The information to be exchanged is defined as a profile in terms of the data structure that the printing processing apparatus has as a BLE device and its operation method. In the printing processing apparatus of the present embodiment, UWBTAG information unique to the printing processing apparatus can also be transmitted and received in this GATT communication. As profile components of a basic printing processing apparatus, at least the "model name" is obtained, and as profile components of a network communication apparatus such as WiFi, the "IP address" information is obtained and displayed in the device list (FIG. 8(b)-811). After the exchange of the above information is completed in GATT communication, the mobile terminal 101 disconnects the GATT communication. The printing processing apparatus 102 returns to transmitting the BLE beacon signal again when the GATT communication ends.

[0069] <UWBTAG information> UWBTAG information is information composed of at least a PANID (Personal Area Network ID) for identifying a UWB communication partner defined in IEEE802.15.4 and the addresses of the packet sender and receiver. Furthermore, UWBTAG information is information composed of an IEEE802-compliant address uniquely assigned to a wireless terminal. Also, it may include information indicating a UWB communication-compatible device in a broad sense. Furthermore, communication capability information and communication setting information necessary for UWB communication as shown in FIG. 9(b), FIG. 9(c), and FIG. 9(d) may be included in the GATT communication profile.

[0070] The communication protocol between the mobile terminal 101 and the print processing device 102 is designed to control communication based on the "Common Service Management Layer" of the Fira Consortium, which is defined on the basis of the IEEE802.15.4 standard. Furthermore, communication is controlled based on the "Near by Interaction Protocol" of Apple Inc. In these communication protocol specifications, UWB TAG information is used as information for identifying the communication destination for the UWB communication.

[0071] These standards share the commonality that UWB radio chips consume more energy than other wireless technologies. Therefore, prior to UWB communication, they use a secondary channel (often BLE communication) to detect nearby UWB devices and establish UWB communication capabilities and communication settings. Furthermore, they share the commonality of exchanging information required for UWB communication, such as data required between applications.

[0072] <BLEアドバタイズパケット> 9(a) shows an example of a BLE advertisement packet 900 transmitted from the print processing device 102, 103. There are multiple formats for the BLE advertisement packet 900 transmitted by the print processing device 102, 103, but here, it is assumed that the advertisement packet 900 is in the Air Print Bluetooth Beacon format manufactured by Apple Inc. The BLE advertisement packet 900 is radio beacon data that is broadcast as a so-called beacon signal, and is transmitted at intervals of several milliseconds to several seconds.

[0073] First, at the beginning of a BLE advertisement packet 900, there is a 1-byte preamble 901 that is used by a BLE wireless element to time signal reading. Next, there is a 4-byte access address 902 into which a value indicating that the packet is a BLE advertisement packet 900 is inserted. Next, there is a protocol data unit 905 that is composed of a maximum of 39 bytes as the actual data area. However, since the protocol data unit 905 consumes 2 bytes for a header 903 and 6 bytes for an advertiser's address 904, the remaining 31 bytes constitute the advertiser's data 907.

[0074] The format of the Air Print Bluetooth Beacon will be described as an example of Advertiser's Data 907. First, the Header 908, which is a common value for Air Print Bluetooth Beacons, consists of 9 bytes.

[0075] Next, Connection Information 909, which is 1 byte, indicates information such as the IP address format and whether the print processing device transmitting the advertisement packet is a printer or a print server.

[0076] Next, a Server or Resource Path 910 indicating the ID information of the printer determined by the server is composed of 2 bytes.

[0077] Next, a port number Port 911 is configured with 2 bytes, and then an IP address (IP v4 Address or IP v6 Address) 912 is configured with 16 bytes.

[0078] Finally, TxPower913 indicating the signal strength emitted by the beacon is composed of 1 byte. The signal strength of the beacon emitted by the BLE communication control unit 409 is predetermined, and the signal strength value is stored in TxPower913.

[0079] At the end of the BLE advertisement packet 900, CRC906 for error detection is composed of 3 bytes, and the above constitutes the entire advertisement packet.

[0080] As described above, an example of the advertisement packet has been shown. As the information exchange necessary prior to UWB communication, it is a packet format that uses BLE communication as a secondary channel. For example, UWBTAG information and UWB communication setting information may be included in the advertisement packet.

[0081] <BLE Gatt Communication> <UWB Fira standard Capabilitey Message> FIG. 9(c) showing the message specification of the communication capability in the communication protocol definition (CSML: Common Service Management Layer) defined by Fira that can be adapted in UWB ranging in the data processing system of this embodiment. It is a communication message in the network layer and transport layer in the communication protocol stack. Information exchange regarding compatibility and communication capabilities between FiRa devices is performed through a communication channel of another band such as BLE or NFC.

[0082] It is a component of the BLE communication control unit in the platform in the software configuration shown in FIGS. 4 and 5, and a communication protocol stack for processing the corresponding message is implemented as part of the API called from the upper application.

[0083] The interface, communication capability message 940, is composed of the "FiRA PHY version" (the physical layer version) and "FiRA MAC version" (the MAC layer version) defined by Fira. 940 further comprises "Device Roles" 941, which identifies the UWB communication role, i.e., whether the "ANCHOR" function, which is the subject of ranging, and the "TAG" function, which is the target of ranging, are supported. 940 further comprises "UWB Parameter Support" 942, which includes settings related to supported ranging.

[0084] <UWB Fira standard Configurationメッセージ> Next, Fig. 9(d) shows the communication configuration message specification in the Fira-defined communication protocol definition (CSML: Common Service Management Layer) applicable to UWB ranging in the data processing system of this embodiment. The settings for communication are determined based on the exchange of the communication capability message 940 described above. For example, this includes UWB DeviceRole 965, RangingMethods 966, etc. Communication configuration messages containing this setting information are exchanged.

[0085] When determining these UWB communication settings, the mobile terminal 101 and print processing devices 102 and 103 in the sequence diagram shown in Figure 7 negotiate with each other as FiRa devices. Based on requests from the applications of the mobile terminal 101 and the print processing devices 102 and 103, arbitration between "ANCHOR" and "TAG" roles is performed as UWB devices, and the "Device Roles" are determined. Specifically, by pressing the button for the print processing device whose printer location is desired on the printer search screen of the application on the mobile terminal 101, the print processing device search unit 403 of the application issues a ranging request with the Role set to ANCHOR.

[0086] In this way, communication setting information for UWB communication is exchanged using BLE communication.

[0087] <Distance measurement request> Next, the mobile terminal 101 exchanges a UWB capability message 940 and a UWB configuration message 960 using BLE. Based on the UWB communication settings determined by the exchange and the UWB tag information, the mobile terminal 101 transmits a ranging request packet to the print winning device 102 (step S706). This ranging request packet is in the format required to perform TWR ranging as defined in IEEE802.15.4, as shown in FIG. 6. It is sufficient for the packet to include at least ranging request identification information, request source address information, request destination address information, and an IEEE802-compliant address.

[0088] <Ranging response> Next, the print processing device 102 that has received this distance measurement request packet transmits a distance measurement response packet after a predetermined time Treply has elapsed (step S707). The mobile terminal 101 that has received the distance measurement response packet calculates the distance based on the TWR distance measurement method shown in FIG.

[0089] <IEEE802.15.4 standard> 9(b) shows the packet specifications used in UWB ranging in the data processing system of this embodiment. The specifications related to UWB ranging are defined as the structure of a UWB frame 920 in the physical layer and data link layer (MAC) of a general communication protocol stack.

[0090] The UWB frame 920 is composed of a preamble "SYNC" for synchronizing between the transmitting and receiving devices, and an "SFD" field indicating the boundary between the preamble and the PHY header. Furthermore, the frame 920 is composed of a PHY header "PHR" 921 and a PHY payload "PHY payload" 922 field.

[0091] The PHY header "PHR" 921 further includes a flag "Ranging" 923 field that identifies whether the frame is issued for ranging. In the data processing system of this embodiment, the ranging request packet transmitted by the mobile terminal 101 to perform ranging is set to "1" in the Ranging field 923 in the frame structure by the UWB communication control unit (FIG. 4-410, FIG. 5-512).

[0092] The PHY payload 922 is composed of a MAC header "MHR" 924, a MAC payload "MAC payload", and a "MAC footer".

[0093] The MAC header 924 further comprises a "Frame Control" field 925, which indicates the frame format used to control frames in the data link layer (MAC). 924 further comprises a packet destination PAN ID "Destination PAN Identifer" 926. 924 further comprises a packet destination address "Destination Address" 927 and a packet source PAN ID "Source PAN Identifier" 928. 924 further comprises a packet source address "Source Address" 929, etc. The PANID and Address information are set as device-specific information in the UWB communication control unit (Figure 4-410, Figure 5-512).

[0094] The mobile terminal 101 in the data processing system of this embodiment sets the address information obtained from the print processing device in the destination fields (926, 927).

[0095] At this time, the image forming apparatus 102 side that received the ranging request packet analyzes the Ranging field 923 and packet sender of the frames that make up the received packet using its own UWB communication control unit 512. It also analyzes destination address information PANID (926, 928), addresses (927, 929), etc. It creates a frame with time information required for analyzing the frame and processing the response, and transmits a ranging response packet to the mobile terminal 101.

[0096] <Device list display> Next, the mobile terminal 101 displays a list of device information, including distance information calculated from the distance measurement response packets (S707) received from the searched print processing devices 102 and 103, as a device list 811 (step S708). An example of the device list display screen is shown in Fig. 8(b). Note that when the update button 813 is pressed, it is possible to check changes in the device status by explicitly executing the operation steps from steps S703 to S707.

[0097] An example of the display contents of the searched device shown in the search results is shown in Figure 8(b) on the device list display screen (811). In the example shown, the search target model name "C iR-3300-01", IP address "192.168.0.25", distance "5.3 m", and communication interface type icon are displayed. As such, it is sufficient for the user to be able to determine the attributes necessary to select a device to print from the display of the search target, and the display is not limited to the example shown.

[0098] On the device list display screen shown in Fig. 8(b), by pressing button 810, a menu for setting search conditions is provided that allows transition to the search condition setting screen shown in Fig. 8(c). As shown in Fig. 8(c), the search target can be narrowed down in such a form that the wireless communication standard corresponding to the device being searched for can be selected as a condition for displaying search results. A wireless communication standard selection item 831 is provided for narrowing down the search target. A display order selection item 832 for inputting settings related to the display order of search results is arranged and is capable of accepting settings. In the illustrated example, a permutation can be selected in ascending or descending order of the distance from the search target. Fig. 8(c) is an example, and it may have other selection items and be a user interface that allows the search result narrowing and display permutation to be operated according to the user's intention.

[0099] <Distance measurement by BLE> So far, the case where distance measurement is performed using UWB communication, the distance measurement is successfully completed, and the distance information is included in the device list for display has been described. Here, the case where a communication error occurs during UWB communication will be explained.

[0100] When a communication error occurs in UWB communication, distance information cannot be obtained, and the distance to the printing processing device cannot be known. Therefore, a method of switching to the aforementioned BLE communication for distance measurement will be explained.

[0101] Fig. 10 is a flowchart diagram describing the flow of switching to BLE communication (second communication) for distance measurement when an error occurs in UWB communication (first communication).

[0102] As described above, the mobile terminal 101 transmits a distance measurement request packet to the printing processing device (similar to steps S1001 and S706).

[0103] The mobile terminal 101 determines whether a ranging response packet has arrived from the print processing device 102. The method of determination is to determine an error if no ranging response packet is received within a certain time period after the ranging request packet is sent in step S1001. A possible error may be a malfunction in the UWB communication control unit 410 on the print processing device 102 side, preventing the ranging response packet from being sent. In such a case, the ranging response packet does not arrive at the mobile terminal 101, and a communication error is determined. If the ranging response packet is received in step S1002, the process proceeds to S1003. If the ranging response packet cannot be received as described above, the process proceeds to S1004.

[0104] Step S1003 has been explained in the section <Distance Measurement Response>, so the explanation will be omitted.

[0105] Step S1004 is a flow when the ranging response packet cannot be received normally. In order to perform ranging communication through BLE communication, the mobile terminal 101 receives the advertising packet (beacon) 900 transmitted again by the print processing device 102 using the BLE communication control unit 209.

[0106] In step S1005, the propagation loss can be determined from the value of TxPower 913 stored in the advertisement packet 900 received in step S1004 and the received signal strength of the advertisement packet 900 when it was actually received. Then, the distance to the print processing device 102 that issued the advertisement packet can be determined. Specifically, the distance can be calculated using the Friis propagation formula (Equation 1). Here, RSSI is the signal strength when the advertisement packet 900 is received by the mobile terminal 101, and TxPower is TxPower 913 in the advertisement packet. d is the distance, and Equation 1 can be modified to calculate d as shown in Equation 2.

[0107] RSSI=TxPower-20×lg(d)...Equation 1 d=10^((TxPower-RSSI) / 20)...Equation 2 For example, if the signal strength of the advertising packet 900 emitted from the print processing device 102 is 4 dBm and the signal strength when the advertising packet 900 is received by the mobile terminal 101 is -76 dBm, then d is 10,000 mm. Therefore, it can be seen that the distance between the mobile terminal 101 and the print processing device 102 is 10 m.

[0108] In step S1006, the distance information acquired by calculation is displayed as device list information on the UI screen of the mobile terminal 101. Device list 811 is an example of when ranging is being performed via UWB communication, with the UWB icon being displayed as active and the distance acquired via UWB ranging being displayed together. On the other hand, device list 812 is an example of when UWB communication has resulted in an error and ranging is being performed via BLE communication. In this example, the icon is grayed out and has diagonal lines to indicate that UWB communication is out of service, but this is not limiting. Information on the distance acquired via BLE communication is also displayed together. Furthermore, the device list 812 may explicitly indicate that UWB communication is out of service and ranging is being performed via BLE communication.

[0109] Finally, a selection is accepted for the candidate devices displayed in the device list (FIG. 7 - step S709). When the selection is accepted, the selected printer is displayed in the top menu in the selected printer selection field (FIG. 8(d)-841). By selecting a device, the device is displayed in the top menu (FIG. 8(d)), and buttons 802 and 803 become enabled.

[0110] The above has explained how to acquire distance information when distance measurement using UWB communication is successful and when it fails and distance measurement is performed by switching to BLE communication, and how to display the acquired distance information on the mobile terminal 101.

[0111] In this way, the data processing system of this embodiment is configured to be able to acquire distance information by switching to BLE communication and performing distance measurement when UWB communication between the mobile terminal 101 and the print processing device 102 fails.

[0112] <Other embodiments> The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

Claims

1. In an information processing device that measures a distance to an external device using a first communication, a first measuring means for acquiring a distance from an external device through a first communication and measuring a distance to the external device; and a second measuring means for switching to a second communication to measure the distance to the external device when the first measuring means cannot acquire distance information from the external device.

2. 2. The information processing apparatus according to claim 1, wherein the first communication is UWB communication.

3. 2. The information processing apparatus according to claim 1, wherein the second communication is BLE communication.

4. 2. The information processing device according to claim 1, wherein the second measuring means measures the distance from the signal strength of an advertisement packet of BLE.

5. 2. The information processing apparatus according to claim 1, further comprising display control means for displaying the distance to the external device measured by the second measuring means in a device list.

6. A control method for an information processing device that measures a distance to an external device using first communication, comprising: a first measurement step of acquiring a distance from an external device through a first communication and measuring a distance to the external device; A control method for an information processing device, characterized by having a second measurement step of switching to second communication and measuring the distance to the external device if distance information cannot be obtained from the external device by the first measurement step.

7. 7. The method for controlling an information processing apparatus according to claim 6, wherein the first communication is UWB communication.

8. 7. The method for controlling an information processing apparatus according to claim 6, wherein the second communication is BLE communication.

9. 7. The method according to claim 6, wherein the second measuring step measures the distance from the signal strength of an advertisement packet of BLE.

10. 7. The method for controlling an information processing apparatus according to claim 6, further comprising a display control step of displaying the distance to the external device measured in the second measuring step in a device list.

11. A program for causing a computer to function as each of the means of the information processing apparatus according to any one of claims 1 to 5.

Citation Information

Patent Citations

  • Mobile terminal device, equipment, control method, program, and system

    JP2022064905A