Wireless tag search support system and method

Abstract

In a wireless tag search support method provided with a wireless tag and a portable terminal for receiving radio waves emitted by the wireless tag, when the battery remaining amount of the wireless tag is equal to or less than a predetermined warning remaining amount, the wireless tag transmits a battery depletion notification signal, and the portable terminal receives the battery depletion notification signal. The portable terminal calculates, on the basis of the battery depletion notification signal, the relative orientation of the source of the battery depletion notification signal with reference to the observation point at which the battery depletion notification signal has been received, and generates tag orientation information including terminal position information at the observation point and the relative orientation. During a search after the battery of the wireless tag is used up, the portable terminal acquires terminal position information at the search location, and displays navigation information to the transmission source on the basis of the terminal position information and the tag orientation information.

Description

Technical Field

[0001] This invention relates to a wireless tag search support system and method. Background Technology

[0002] Previously, there have been systems that use wireless tags to determine the location of items. For example, Patent Document 1 discloses a system (excerpt): "The server is configured to communicate with a tag reading device via a network connection. The tag reading device is configured to search for and determine the location of items within a predetermined range, and to determine the location information of the items based on the signal strength emitted and detected by the electronic tags of the items. The location information is sent to the server via the network connection, and the server performs actions in the database and appends the location information in the original data format of the database."

[0003] Existing technical documents

[0004] Patent documents

[0005] Patent Document 1: Japanese Patent Application Publication No. 2017-45440 Summary of the Invention

[0006] The problem the invention aims to solve

[0007] According to Patent Document 1, by attaching a wireless tag to an item and receiving the wireless signal emitted by the tag, the location of the item can be determined based on the signal strength and receiving direction of the wireless signal. However, there is a problem that when the battery of the wireless tag is depleted, it cannot transmit wireless signals and cannot obtain clues for searching for the item.

[0008] The present invention was made in view of the above circumstances, and its object is to provide support for searching wireless tags when the battery of a wireless tag is depleted.

[0009] Solution for solving the problem

[0010] To address the aforementioned issues, the present invention provides the structure described in the claims. As one example, the present invention is a wireless tag search support system comprising a wireless tag and a portable terminal for receiving radio waves emitted by the wireless tag. The wireless tag includes a battery, a tag-side transmitter, and a tag-side processor; the portable terminal includes: a terminal-side receiver for receiving the radio waves emitted by the wireless tag; a position detection sensor for detecting terminal position information in the absolute coordinate system of the portable terminal; a terminal-side processor; and a display. When the remaining battery level of the wireless tag is below a predetermined warning level, the tag-side processor controls the tag-side transmitter to transmit a battery depletion notification signal indicating that the battery is nearing depletion. The terminal-side processor calculates the relative orientation of the source of the battery depletion notification signal based on the observation location where the portable terminal receives the battery depletion notification signal. It then acquires the terminal's location information from the location detection sensor at that observation location and generates tag orientation information that includes the terminal's location information at the observation location and the relative orientation. During the search after the wireless tag's battery is depleted, based on the terminal's location information and the tag orientation information acquired from the location detection sensor at the search location, it displays navigation information to the source of the battery depletion notification signal on the display.

[0011] Furthermore, this invention is a wireless tag search support method, specifically a method for supporting wireless tag search with a wireless tag and a portable terminal that receives radio waves emitted by the wireless tag. The method is characterized by comprising the following steps: receiving a battery depletion notification signal to notify the wireless tag that its battery is nearing depletion when the remaining battery level of the wireless tag falls below a predetermined warning level; calculating, based on the battery depletion notification signal, the relative orientation of the source of the battery depletion notification signal relative to the observation location where the portable terminal receives the signal, obtaining terminal location information at the observation location, and generating tag orientation information including the terminal location information and the relative orientation; and during a search after the wireless tag's battery has depleted, obtaining the terminal location information at the search location, and displaying navigation information to the source of the battery depletion notification signal on a display provided by the portable terminal based on the terminal location information and the tag orientation information.

[0012] The effects of the invention

[0013] According to the present invention, it is possible to support the search for wireless tags even when the battery of the wireless tag is depleted. Other objectives, structures, and effects than those described above will be clarified in the following embodiments. Attached Figure Description

[0014] Figure 1This is a schematic diagram of the wireless tag search support system.

[0015] Figure 2 This is a schematic structural diagram of the wireless tag in this embodiment.

[0016] Figure 3 This is a front view of the portable terminal in this embodiment.

[0017] Figure 4 This is a schematic structural diagram of the portable terminal according to this embodiment.

[0018] Figure 5A This is a diagram showing the processing of stage 1 at the first observation location in representation A.

[0019] Figure 5B This is a diagram showing the processing of stage 1 at the second observation location in representation A.

[0020] Figure 5C This is a diagram representing the processing in stage 2 of method A.

[0021] Figure 6A This is a diagram representing the processing of stage 1 in representation B.

[0022] Figure 6B This is a diagram representing the processing in stage 2 of representation method B.

[0023] Figure 7A This is a diagram showing an example of the posture of a portable terminal (the portable terminal is in a horizontal position).

[0024] Figure 7B This is a diagram showing an example of the posture of a portable terminal (a state of tilt relative to the horizontal plane).

[0025] Figure 7C This is a diagram showing an example of the posture of a portable terminal (a state of tilt relative to the horizontal plane).

[0026] Figure 8 This is a diagram representing the calculation and processing of tag orientation information in an absolute coordinate system when the portable terminal is tilted relative to the horizontal plane.

[0027] Figure 9A This is a diagram representing the label orientation information saved in stage 1.

[0028] Figure 9B This is an explanation Figure 9A A graph of the parameters included.

[0029] Figure 10A This is another example of terminal posture information, showing the posture information acquisition state of a portable terminal during automatic search before the battery is about to run out.

[0030] Figure 10B This is a diagram showing an example of an automatically captured image.

[0031] Figure 11 This is a flowchart illustrating the processing flow in the case of wireless methods (such as Bluetooth) that use radio wave intensity for ranging.

[0032] Figure 12 This is a detailed diagram illustrating the process in Stage 1.

[0033] Figure 13 This is a detailed diagram illustrating the processing in stage 2.

[0034] Figure 14A This is a diagram representing the navigation process from the search start point (location C) to the first observation location (location A) in navigation type 2.

[0035] Figure 14B This is a diagram representing the navigation process in navigation type 2, from the first observation location (location A) to the candidate location (location X) with the highest probability of tag search.

[0036] Figure 15 This is a flowchart illustrating the processing flow of a wireless method for ranging using radio wave intensity. Detailed Implementation

[0037] This invention relates to a wireless tag search support system and method for supporting the search of wireless tags with depleted batteries. Therefore, this invention is expected to improve the technology for lost item location management and search support, particularly for labor-intensive industries, and thus can be expected to contribute to UN Sustainable Development Goals (SDGs) 8.2 (enhancing economic productivity, with a focus on labor-intensive industries that increase the value of goods and services, through diversification, technological upgrading and innovation).

[0038] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. In all the drawings used to describe the embodiments, the same reference numerals are used to label the same components in principle, and repeated descriptions are omitted.

[0039] [First Implementation]

[0040] Figure 1 This is a schematic diagram of the wireless tag search support system.

[0041] exist Figure 1 The wireless tag search support system 100 shown is configured to wirelessly connect wireless tag 1 and portable terminal 2.

[0042] When the remaining battery level of wireless tag 1 falls below a predetermined warning level, wireless tag 1 sends a battery depletion notification signal to indicate that the battery is about to run out.

[0043] When the portable terminal 2 receives a battery depletion notification signal, it calculates the relative orientation of the source of the battery depletion notification signal based on the observation location where the portable terminal 2 receives the battery depletion notification signal, obtains the terminal position information representing the terminal position detected by the position detection sensor at the observation location, generates and stores tag orientation information representing the terminal position information and the relative orientation.

[0044] During the search after the battery of wireless tag 1 is depleted, a navigation screen 270 containing navigation information from the search location to the source of the battery depletion notification signal is displayed on display 207 based on the terminal location information and tag orientation information. Figure 1 In the example of navigation information, a search object icon 271 representing the source of a battery depletion notification signal is displayed, along with a distance 272 from the search location to the search object icon 271, and a search guide arrow 273 indicating the direction of the source relative to the search location.

[0045] exist Figure 1 This indicates the case where wireless tag 1 has not moved from the location at the time the battery depletion notification signal was sent. In this case, since the current location of wireless tag 1 is the same as that of the transmitting source 3, the location shown by the search object icon 271 is the same as the current location of wireless tag 1.

[0046] On the other hand, if the wireless tag 1 moves further from the transmitting source 3 that sent the battery depletion notification signal, the location shown by the search target icon 271 is the location of the transmitting source 3, not the current location of the wireless tag 1. However, the wireless tag search support system 100 is characterized by using information from the location where the wireless tag 1 last sent the battery depletion notification signal, held by the portable terminal 2, to indicate the location of the transmitting source 3 as the most likely candidate location to be searched after the wireless tag 1's battery is depleted, thus providing search support for the wireless tag 1 with a depleted battery.

[0047] Figure 2 This is a schematic structural diagram of the wireless tag in this embodiment.

[0048] like Figure 2 As shown, the wireless tag 1 includes a microprocessor 101, a BT communicator 116 (BT: Bluetooth (registered trademark)), and a battery 120, which are interconnected via a bus 121.

[0049] The microprocessor 101 monitors the remaining battery level of the battery 120 and controls the transmission of a battery depletion notification signal when the battery is nearing depletion. Therefore, the microprocessor 101 is an example of a tag-side processor.

[0050] The BT communication unit 116 is an example of a tag-side transmitter that transmits wireless signals.

[0051] The battery 120 is, for example, a button cell battery.

[0052] Figure 3 This is a front view of the portable terminal in this embodiment. Figure 4 This is a schematic structural diagram of the portable terminal according to this embodiment.

[0053] like Figure 3 As shown, the portable terminal 2 has a home button 230, a handset 231, a notification light 232, a built-in camera 206, a distance sensor 213, a display 207, and a touch panel 208 on its surface. Furthermore, although... Figure 3 Not shown in the figure, but the portable terminal 2 has volume buttons and a power button on the side, and a speaker 218 on the bottom (see figure). Figure 4 Microphone 217 (see reference) Figure 4 ), power and communication connectors, headphone jack, and an external camera 205 on the back (see reference). Figure 4 (e.g., fingerprint sensors). It should be noted that the configuration location may not be as described above. Figure 3 That way.

[0054] like Figure 4 As shown, the portable terminal 2 includes a processor 201, RAM 202, ROM 203, memory 204, external camera 205, built-in camera 206, display 207, touch panel 208, accelerometer 209, gyroscope sensor 210, geomagnetic sensor 211, position detection sensor 212, distance sensor 213, telephone network communication device 214, LAN communication device 215, BT communication device 216, microphone 217, speaker 218, key input I / F 219, and battery 220, which are interconnected via bus 221.

[0055] Processor 201 is, for example, a CPU, which is equivalent to a terminal-side processor.

[0056] ROM203 stores the control program 251 for the basic operations of the portable terminal 2.

[0057] The memory 204, implemented as an EPPROM such as a Micro SD card, is capable of storing the wireless tag search support application 252 and data generated during the execution of the processing program. The control program 251 and the wireless tag search support application 252 are deployed and executed by the processor 201 in RAM 202.

[0058] Accelerometer 209 is, for example, a 3-axis accelerometer that can detect motion in the direction of gravity, and is therefore equivalent to a gravity system sensor.

[0059] The gyroscope sensor 210 can detect the angular velocity of the rotational motion of the portable terminal 2 and the tilt relative to the horizontal plane, thus functioning as an example of an attitude sensor. The sensor output of the gyroscope sensor 210, or the tilt (pitch angle) of the reference axis of the portable terminal 2 relative to the horizontal plane calculated based on the sensor output of the gyroscope sensor 210, is an example of attitude information.

[0060] The geomagnetic sensor 211 detects the Earth's magnetic field to determine the azimuth in the absolute coordinate system, thus functioning as an example of an azimuth sensor. In the processing described later, the angle (yaw angle) between the reference axis of the portable terminal 2 and an axis of the absolute coordinate system (e.g., the north-south axis) can be obtained using the azimuth information detected by the geomagnetic sensor 211. When the azimuth information is defined by the absolute coordinate system, the azimuth observed from the reference point of the portable terminal 2 (e.g., the center point of the portable terminal 2 on the reference axis) remains constant regardless of the attitude of the portable terminal 2; therefore, the aforementioned pitch angle can be used as attitude information. When the azimuth information is not defined by the absolute coordinate system but by the yaw angle relative to the reference axis of the portable terminal 2, the yaw angle is included in the attitude information.

[0061] The position detection sensor 212 is a sensor that detects position information in an absolute coordinate system, such as a GPS sensor.

[0062] The ranging sensor 213 is implemented, for example, by a distance sensor using a stereo camera, or a ranging sensor using wireless communication (e.g., an ultrasonic ranging sensor) that measures distance using time of response (TOF).

[0063] The telephone network communication device 214 is a type of communication device that enables 4G, 5G and other mobile communication functions.

[0064] The LAN communication device 215 is a type of communication device that uses Wi-Fi (registered trademark) standards to achieve wireless communication functions.

[0065] BT communication device 216 is a type of communication device used for communication connection between wireless tag 1 and portable terminal 2, and functions as a detector for detecting the direction of transmission source 3 used in the processing of FIG6.

[0066] The wireless tag search support system 100 of this embodiment generally has two stages: a stage of automatically generating and saving tag location information from the observation location to the source 3 of the battery depletion notification signal and a stage of searching based on the tag location information.

[0067] The wireless tag search support system 100 is as follows (see Figure 5): The observation location information of wireless tag 1 before the battery is about to run out (equivalent to the location information of the transmitting source 3) is pre-stored in portable terminal 2 (stage 1). During the search after the battery runs out (stage 2), the current location information of portable terminal 2 at the start of the search and the observation location information of wireless tag 1 are used to navigate the user to the location of wireless tag 1 before the battery ran out (equivalent to the location of the transmitting source 3) using the principle of three-point measurement.

[0068] In the method for obtaining the location information of wireless tag 1 before the battery is about to run out in stage 1 prior to the search, depending on the wireless method, there are two types: (Method A) wireless method that uses radio wave intensity for ranging (Bluetooth (registered trademark) etc.) and (Method B) wireless method that uses response time for ranging (UWB etc.).

[0069] In this embodiment, the time when the location information of the wireless tag 1 is stored in the portable terminal 2 is already close to the point where the battery is depleted. Therefore, it is generally believed that even if the direction information can be obtained, the reliability of the accuracy of the detected distance information is low due to the unstable radio wave intensity close to the point where the battery is depleted.

[0070] Therefore, in (Method A), the location information of the point where the (horizontal) directional vectors from the two locations intersect is stored as the observation location information of the wireless tag 1, utilizing the movement (detection) of the portable terminal 2. In actual system implementation, the location information of the two observation points and the vector information from each point can also be stored as the observation location information of the wireless tag 1, and the observation location of the wireless tag 1 can be calculated during the actual search.

[0071] On the other hand, in the case of (Method B), ranging is performed using the response time, so it is generally believed that the accuracy of the distance information is high as long as the radio waves can be observed. Therefore, as the location information at the observation time of wireless tag 1, the direction vector and distance are calculated and stored. Here, too, in the actual system implementation, as the location information at the observation time of wireless tag 1, the location information, vector information, and distance information of the observation location can also be stored, and the location of wireless tag 1 can be calculated during the search.

[0072] (Method A)

[0073] Figure 5A This is a diagram representing the processing of method A in stage 1 at the first observation location. Figure 5B This is a diagram representing the processing of method A in stage 1 at the second observation location. Figure 5C This is a diagram representing the processing in stage 2 of method A.

[0074] Figure 5A At the first observation location (location A), portable terminal 2 receives the radio wave of a battery depletion notification signal. Location A is the first observation location before the battery is about to run out. Then, based on the direction of the received radio wave, the direction of the transmitter 3 of wireless tag 1 observed from location A is determined (the first direction, equivalent to "relative azimuth"), and the first direction vector is calculated and stored. It should be noted that because the reliability of radio wave intensity is low, the distance from location A to the observation location of wireless tag 1 is unknown. Since the distance is unknown, the first direction vector can be set to a unit length. In addition, portable terminal 2 uses position detection sensor 212 to detect the terminal position at the first observation location (location A).

[0075] exist Figure 5B Similarly, in stage 1 shown, portable terminal 2 receives the battery depletion notification signal at the second observation location (location B). Location B is the observation location before the second battery is about to run out. Based on the direction of the received radio wave, the direction of the transmitter 3 of wireless tag 1 observed from location B is determined (the second direction, equivalent to "relative azimuth"), and the second direction vector is calculated and stored. It should be noted that because the reliability of radio wave intensity is low, the distance from location B to the observation location of wireless tag 1 is unknown. Since the distance is unknown, the second direction vector can be set to a unit length. In addition, portable terminal 2 uses position detection sensor 212 to detect the terminal position at the second observation location (location B).

[0076] Then, the portable terminal 2 determines the intersection of the extension of the first direction vector starting from location A and the extension of the second direction vector starting from location B as the transmitting source 3 (location X). Furthermore, the vector from location A to the transmitting source 3 (location X) is generated as the tag orientation vector V. AX Tag orientation vector VAx This is one way to obtain tag location information. Tag location vector V Ax The portable terminal 2 automatically generates and saves the data without user intervention. This is the process for stage 1.

[0077] exist Figure 5C In stage 2 shown, the portable terminal 2 acquires the current location information of the search start point (location C) from the location detection sensor 212. Then, based on the location information of the absolute coordinate system of the observation point (location A) and the search start point (location C), the vector V from location C towards location A is calculated. CA Then, for vector V CA Add the label orientation vector V AX To find the vector V CX The navigation screen 270 is displayed on the portable terminal 2. Vector V CX This indicates the direction and distance from location C, where the battery was determined to be located where wireless tag 1 was present just before it was about to run out of power.

[0078] (Method B)

[0079] Figure 6A This is a diagram representing the processing in stage 1 of method B. Figure 6B This is a diagram representing the processing in stage 2 of representation method B.

[0080] exist Figure 6A In phase 1 shown, firstly, when the remaining amount of battery 120 is below the warning level, wireless tag 1 sends a battery depletion notification signal.

[0081] Portable terminal 2 uses the observation location (location A) where the battery is about to run out after receiving the battery depletion notification signal as a reference. Based on the receiving direction of the antenna built into portable terminal 2, it estimates the estimated location (location X) of the source 3 transmitting the battery depletion notification signal, and estimates the distance based on the radio wave intensity. Thus, it generates the tag orientation vector V. Ax Tag orientation vector V Ax The direction indicates the receiving direction of the antenna, and the length indicates the distance to the transmitting source estimated based on the radio wave intensity.

[0082] Assume that in this state, the battery of wireless tag 1 is depleted. Subsequently, when the user begins searching for items attached to wireless tag 1, the item retrieval cannot proceed because no response signal is emitted from wireless tag 1. Therefore, stage 2 above is the stage where the user uses the location information of wireless tag 1 before its battery is about to run out (the location information of the transmitting source 3) as a clue to calculate the most likely search candidate locations when wireless tag 1 is searching (after the battery is depleted) and displays navigation information to reach those locations.

[0083] exist Figure 6B In stage 2 shown, with Figure 5C Similarly, in method A shown, the vector V is calculated... CA Then, with the label orientation vector V Ax The vector V is obtained by adding them together. CX .

[0084] Figure 7A This is a diagram illustrating the posture of a portable terminal (the portable terminal is in a horizontal position). Figure 7B , Figure 7C This is a diagram showing an example of the posture of a portable terminal (a state of tilt relative to the horizontal plane).

[0085] like Figure 7A As shown, when the portable terminal 2 is in a horizontal position, and the portable terminal 2 is rotated in the horizontal plane with the terminal reference axis vector Vo pointing towards the wireless tag 1, the search guide arrow 273 is aligned with the terminal reference axis vector Vo. The terminal reference axis vector Vo is a vector that passes through the terminal position and is parallel to the long side of the rectangular portable terminal 2.

[0086] However, as Figure 7B , Figure 7C As shown, when the portable terminal 2 is tilted relative to the horizontal plane, even if the portable terminal 2 is rotated within the horizontal plane, the search guide arrow 273 does not align with the terminal reference axis vector Vo. Therefore, in this case, the tag orientation vector V is corrected based on the posture information of the portable terminal 2. Ax .

[0087] Figure 8 This is a diagram representing the calculation and processing of tag orientation information in an absolute coordinate system when the portable terminal is tilted relative to the horizontal plane.

[0088] like Figure 8 As shown, portable terminal 2 calculates the terminal reference axis vector Vo, which passes through the terminal position and is parallel to the terminal reference axis. Then, it calculates the relationship between the terminal reference axis vector Vo and the tag orientation vector V. Ax Relative relationship information (e.g., terminal reference axis vector Vo and tag orientation vector V) Ax (The angle). This calculation can be performed using existing technology.

[0089] Next, the portable terminal 2 acquires GPS sensor information, geomagnetic sensor information, and gravity system sensor information when it receives a battery depletion notification signal. Then, the portable terminal 2 determines the starting point of the reference axis based on the GPS sensor information. Furthermore, as attitude information, the portable terminal 2 determines the orientation (north, south, east, and west in the horizontal plane) of the terminal's reference axis based on the geomagnetic sensor information, and determines the rotation angle of the terminal's reference axis relative to the horizontal plane based on the gravity system sensor information.

[0090] Portable terminal 2 uses posture information to represent the orientation vector V based on the tag.Ax The vector V of the observed source 3 (location X) at the search location (location C) is calculated. CX1 The calibration is performed, and the search guide arrow 273 is displayed on the navigation screen 270. It should be noted that... Figure 8 Point a is equivalent to the point after correcting the source 3 (location X) determined based on the posture information, assuming the portable terminal 2 is in a horizontal state.

[0091] Figure 9A This is a diagram representing the tag location information saved in Phase 1. Additionally, Figure 9B This is an explanation Figure 9A A graph of the parameters included.

[0092] like Figure 9A As shown, the portable terminal 2 calculates the elevation angle, azimuth angle, and rotation angle of the reference axis based on the weight system sensor information from the gravity system sensor (3-axis accelerometer). Based on these, it transforms them into elevation angle α and azimuth angle β representing the direction of the transmitting source 3 (tag direction). Then, the portable terminal 2 saves the "terminal position information", "tag direction", and tag-terminal distance as information before the battery is about to run out.

[0093] Figure 9B The elevation angle θ represents the tilt of the reference axis relative to the horizontal plane, and the azimuth angle δ represents east, west, south, and north. Based on the tag orientation information in Figure 9, even if the portable terminal 2 is tilted relative to the horizontal plane when automatically generating the tag orientation information, it can be corrected to be parallel to the horizontal plane and the tag orientation information can be generated. Therefore, even if the posture is different during the search compared to when the tag orientation information is obtained, the search guidance arrow 273 can be displayed with higher accuracy.

[0094] Figure 10A This is another example of terminal posture information, showing the posture information acquisition state of a portable terminal during automatic search before the battery runs out. Figure 10B This is a diagram showing an example of an automatically captured image.

[0095] like Figure 10A As shown, when the portable terminal 2 receives a battery depletion notification signal (stage 1), it automatically takes a picture using at least one of the built-in camera 206 or the external camera 205, preferably both, to generate and save a terminal posture image at the time of receiving the battery depletion notification signal.

[0096] During the search (Phase 2), the user visually identifies the terminal's posture image to determine the location and posture of the portable terminal 2 when it receives the battery depletion notification signal. For example, in Figure 10BThe ceiling 300 and lighting 301 are reflected in the terminal posture image, thus the room in which the ceiling 300 and lighting 301 are located can be determined. Furthermore, the orientation of the portable terminal 2 when receiving the battery depletion notification signal can be inferred from the orientation of the lighting 301 seen in the determined room.

[0097] (Processing flow)

[0098] Figure 11 This is a flowchart illustrating the processing flow in the case of wireless methods (such as Bluetooth) that use radio wave intensity for ranging. Figure 12 This is a detailed diagram illustrating the process in Stage 1. Figure 13 This is a detailed diagram illustrating the processing in stage 2.

[0099] like Figure 11 As shown, portable terminal 2 waits to receive a battery depletion notification signal (S11: No). When portable terminal 2 receives the battery depletion notification signal (S11: Yes), phase 1 begins.

[0100] (Phase 1)

[0101] In step 1 of phase 1, the portable terminal 2 acquires the location information of the first observation location (location A) from the location detection sensor 212. Additionally, the portable terminal 2 uses substantially all the information from the wireless tag communication, geomagnetic sensor 211, accelerometer 209, and gyroscope sensor 210 to acquire the first direction information (first direction vector) of the transmission source 3 observed from the first observation location (location A) (see reference). Figure 12 Step 1). It should be noted that the portable terminal 2 may not use all the information from the wireless tag communication, the geomagnetic sensor 211, the accelerometer 209, and the gyroscope sensor 210, but may select and use them appropriately.

[0102] Before the location of portable terminal 2 changes (S12: No), wait for the start of step 2 in phase 1. When the location of portable terminal 2 changes (S12: Yes), begin processing step 2 in phase 1. Here, "change" refers to a degree of movement between the wireless tag 1 and portable terminal 2 in relative directions, specifically movement capable of triangulation. Therefore, movement of portable terminal 2 along the extended line shown by the tag's orientation information is not included in "change".

[0103] In step 2 of phase 1 ( Figure 12In Step 2), the portable terminal 2 obtains the current position of a second observation position (location B), which is different from the first observation position (location A), from the location detection sensor 212. Additionally, the portable terminal 2 uses substantially all or appropriately selected information from various sensors, including wireless tag communication, geomagnetic sensor 211, accelerometer 209, and gyroscope sensor 210, to obtain second direction information (second direction vector) from the second observation position (location B) regarding the observation of the transmitting source 3.

[0104] In step 3 of phase 1 ( Figure 12 In Step 3), the portable terminal 2 determines the intersection of the extended line of the first direction information observed from the first observation position (location A) and the extended line of the second direction information observed from the second observation position (location B) as the location (location X) of the transmitting source 3, and calculates the distance from the first observation position (location A) to the transmitting source 3 (location X). Then, using the location information of the first observation position (location A), the first direction information observed from the first observation position (location A), and the distance from the first observation position (location A) to the transmitting source 3 (location X), the tag orientation information (tag orientation vector) is calculated and saved (refer to...). Figure 12 (Step 3). After Phase 1 is completed, proceed to Phase 2.

[0105] In phase 2, the portable terminal 2 waits for a tag search start instruction (S21: No). When the portable terminal 2 receives a tag search start instruction (S21: Yes), it obtains the location information of the search start location (location C) from the location detection sensor 212 (S22).

[0106] Based on the location information of the first observation location (location A) and the search start location (location C), the orientation information of the tag observed from the first observation location (location A), and the distance from the first observation location (location A) to the transmission source 3 (location X), the portable terminal 2 calculates the tag search navigation information from the search start location (location C) to the transmission source 3 (location X) (S23).

[0107] The portable terminal 2 displays a navigation screen 270 that shows a tag search navigation from the search start location (location C) to the source 3 to perform navigation (S24).

[0108] like Figure 13As shown, there are two navigation types in the tag search navigation: navigation type 1 and navigation type 2. Navigation type 1 generates and displays a search guide arrow 273 from the search start point (location C) to the intersection point (location X). Navigation type 2 provides navigation from the search start point (location C) to the first observation point (location A). When the user moves the portable terminal 2 to the first observation point (location A), a search guide arrow 273 from the first observation point (location A) to the intersection point (location X) is displayed.

[0109] Figure 14A This is a diagram representing the navigation process from the search start point (location C) to the first observation location (location A) in navigation type 2. Figure 14B This is a diagram representing the navigation process in navigation type 2, from the first observation location (location A) to the candidate location (location X) with the highest probability of tag search.

[0110] In navigation type 2, such as Figure 14A As shown, firstly, the portable terminal 2 displays navigation information (an arrow indicating location A) from the search start point (location C) to the first observation location (location A) on the display 207. Then, when the user arrives at the first observation location (location A), as shown... Figure 14B As shown, the portable terminal 2 displays navigation information (an arrow indicating location X) from the first observation position (location A) to location X on the display 207.

[0111] Figure 15 This is a flowchart illustrating the processing flow of a wireless method for ranging using radio wave intensity. (Regarding...) Figure 11 Shared processes are labeled with the same step number, and repeated descriptions are omitted.

[0112] Figure 15 Flowcharts and Figure 11 The difference in the flowchart is that steps 1 and 3 of phase 1 are executed, but step 2 is omitted. That is, in the wireless method of ranging using radio wave intensity, in step 1 of phase 1, the portable terminal 2 obtains the current position of the first observation position (location A) from the location detection sensor 212, and obtains the first direction information (refer to) indicating the direction of the transmitting source 3 (location X) observed from the first observation position (location A). Figure 12 Step 1).

[0113] Next, the portable terminal 2 uses the distance and first direction information of the source 3 transmitting the battery depletion notification signal, obtained based on the radio wave intensity of the battery depletion notification signal, to calculate and save tag orientation information representing the direction and distance from the current position (location A) to the source 3 (location X). The subsequent stage 2... Figure 11 It is the same, therefore the explanation is omitted.

[0114] According to this embodiment, a battery depletion notification signal is sent before the wireless tag 1 runs out of battery. Upon receiving the signal, the portable terminal 2 calculates and saves tag location information, including the orientation and distance from the observation location to the transmitting source 3. This process (stage 1) is performed automatically, thus eliminating the need for manual intervention by the user.

[0115] Furthermore, when searching for an item with Wi-Fi tag 1, if Wi-Fi tag 1 has run out of battery, there will be no response from it. Therefore, during the user's processing in phase 2, navigation can be performed based on the tag's location information, using the transmitting source 3 as the most likely location of Wi-Fi tag 1 before its battery runs out. Thus, even when the user does not receive a response from Wi-Fi tag 1 due to battery depletion, clues for searching Wi-Fi tag 1 can be obtained, making the search for Wi-Fi tag 1 easier.

[0116] The invention described above is based on the specific implementation method and is completed by the inventor of the present invention. However, the present invention is not limited to the described implementation method and various changes can be made without departing from its spirit.

[0117] For example, Bluetooth (registered trademark) and UWB are illustrated as indoor positioning systems, but other wireless communication methods suitable for indoor positioning can also be applied to this invention.

[0118] The implementation methods include the following approaches.

[0119] (Note 1)

[0120] A wireless tag search support system includes a wireless tag and a portable terminal that receives radio waves emitted by the wireless tag, characterized in that...

[0121] The wireless tag includes a battery, a tag-side transmitter, and a tag-side processor.

[0122] Portable terminals have the following features:

[0123] The terminal-side receiver receives the radio waves emitted by the wireless tag;

[0124] A position detection sensor detects the terminal position information in the absolute coordinate system of the portable terminal;

[0125] Terminal-side processor; and

[0126] monitor,

[0127] When the remaining battery level of the wireless tag is below a predetermined warning level, the tag-side processor controls the transmission of a battery depletion notification signal to the tag-side transmitter to indicate that the battery is nearing depletion.

[0128] The terminal-side processor calculates the relative location of the source of the battery depletion notification signal, based on the observation location where the portable terminal receives the battery depletion notification signal.

[0129] The terminal location information is obtained from the location detection sensor at the observation location.

[0130] Generate tag orientation information that includes the terminal location information and the relative orientation at the observation location.

[0131] During a search after the wireless tag's battery is depleted, navigation information to the source of the battery depletion notification signal is displayed on the display based on the terminal location information and the tag orientation information obtained from the location detection sensor at the search location.

[0132] (Note 2)

[0133] A method for supporting wireless tag search is a method for supporting wireless tag search in a portable terminal equipped with a wireless tag and receiving radio waves emitted by the wireless tag, characterized in that it includes:

[0134] The step of receiving a battery depletion notification signal to notify the wireless tag that the battery is nearing depletion when the remaining battery level of the wireless tag falls below a predetermined warning level;

[0135] Based on the battery depletion notification signal, the steps include: calculating the relative azimuth of the source of the battery depletion notification signal with reference to the observation location where the portable terminal receives the signal; obtaining the terminal location information at the observation location; and generating tag location information containing the terminal location information and the relative azimuth.

[0136] The step of obtaining terminal location information at the search location when the wireless tag's battery is depleted, and displaying navigation information to the source of the battery depletion notification signal on the display of the portable terminal based on the terminal location information and the tag's orientation information.

[0137] Explanation of reference numerals in the attached figures

[0138] 1: Wireless tag, 2: Portable terminal, 3: Transmitter, 100: Wireless tag search support system, 101: Microprocessor, 116: BT communicator, 120: Battery, 121: Bus, 201: Processor, 202: RAM, 203: ROM, 204: Memory, 205: External camera, 206: Internal camera, 207: Display, 208: Touch panel, 209: Accelerometer sensor, 210: Gyroscope sensor, 211: Geomagnetic sensor, 212: Position detection sensor, 213 214: Distance sensor; 215: Telephone network communication device; 216: LAN communication device; 217: BT communication device; 218: Microphone; 219: Speaker; 210: Keypad input I / F; 220: Battery; 221: Bus; 230: Home button; 231: Handpiece; 232: Notification light; 251: Control program; 252: Wireless tag search support application; 270: Navigation screen; 271: Search object icon; 272: Distance; 273: Search guide arrow; 300: Ceiling; 301: Lighting.

Claims

1. A wireless tag search support system, comprising a wireless tag and a portable terminal for receiving radio waves emitted by the wireless tag, characterized in that, The wireless tag includes a battery, a tag-side transmitter, and a tag-side processor. Portable terminals have the following features: The terminal-side receiver receives the radio waves emitted by the wireless tag; A position detection sensor detects the terminal position information in the absolute coordinate system of the portable terminal; Terminal-side processor; as well as monitor, When the remaining battery level of the wireless tag is below a predetermined warning level, the tag-side processor controls the transmission of a battery depletion notification signal to the tag-side transmitter to indicate that the battery is nearing depletion. The terminal-side processor calculates the relative location of the source of the battery depletion notification signal, based on the observation location where the portable terminal receives the battery depletion notification signal. The terminal location information is obtained from the location detection sensor at the observation location. Generate tag orientation information that includes the terminal location information and the relative orientation at the observation location. During a search after the wireless tag's battery is depleted, navigation information to the source of the battery depletion notification signal is displayed on the display based on the terminal location information and the tag orientation information obtained from the location detection sensor at the search location.

2. The wireless tag search support system according to claim 1, characterized in that, The terminal-side processor calculates the distance and relative orientation to the source of the battery depletion notification signal, with the observation location as the reference, based on the radio wave intensity and reception direction of the battery depletion notification signal. The terminal-side processor generates tag location information that includes the terminal location information at the observation location and the distance and relative orientation to the source of the battery depletion notification signal based on the observation location.

3. The wireless tag search support system according to claim 1, characterized in that, When the terminal-side processor receives the battery depletion notification signal at the first observation location, it controls the transmission of the search signal for the wireless tag from the first observation location. Based on the response time from transmitting the search signal to receiving a response signal from the wireless tag in response to the search signal, it calculates the first distance from the first observation location to the source of the battery depletion notification signal, obtains the terminal location information at the first observation location (i.e., the first terminal location information), and generates first tag location information containing the first distance and the first terminal location information. When the battery depletion notification signal is received again at the second observation location, the transmission control of the search signal for the wireless tag is initiated from the second observation location. Based on the response time from the transmission of the search signal to the receipt of a response signal from the wireless tag in response to the search signal, a second distance from the second observation location to the source of the battery depletion notification signal is calculated. The terminal location information at the second observation location, i.e., the second terminal location information, is obtained. A second tag location information containing the second distance and the second terminal location information is generated. Based on the first tag location information and the second tag location information, the location that is at the first distance from the first observation location and at the second distance from the second observation location is calculated as the location of the source of the battery depletion notification signal, and the tag location information representing that location is generated.

4. The wireless tag search support system according to claim 1, characterized in that, The portable terminal also includes a gravity system sensor for detecting the posture of the portable terminal. The terminal-side processor acquires the posture information of the portable terminal at the observation location, and the posture information is also included in the tag orientation information. The navigation information is displayed using the gesture information contained in the label orientation information.

5. The wireless tag search support system according to claim 1, characterized in that, The terminal-side processor displays the navigation information that allows direct access from the search location to the transmitting source without passing through the observation location.

6. The wireless tag search support system according to claim 1, characterized in that, The terminal-side processor displays the navigation information from the search location to the observation location, and displays the navigation information from the observation location to the transmitting source when the portable terminal moves to the observation location.

7. A method for supporting wireless tag search, comprising a wireless tag and a portable terminal that receives radio waves emitted by the wireless tag, characterized in that, include: The step of receiving a battery depletion notification signal to notify the wireless tag that the battery is nearing depletion when the remaining battery level of the wireless tag falls below a predetermined warning level; Based on the battery depletion notification signal, the steps are as follows: calculate the relative orientation of the source of the battery depletion notification signal with reference to the observation location where the portable terminal receives the battery depletion notification signal, obtain the terminal location information at the observation location, and generate tag orientation information containing the terminal location information and the relative orientation. as well as The step of obtaining terminal location information at the search location when the wireless tag's battery is depleted, and displaying navigation information to the source of the battery depletion notification signal on the display of the portable terminal based on the terminal location information and the tag's orientation information.

Images