Display control system, information processing apparatus, method, and computer program
The display control system enhances RFID-based location estimation by calculating an estimated range for movable objects using passive RFID tags and self-position estimation, addressing cumulative errors and spatial constraints to provide accurate and efficient tracking.
Patent Information
- Application Number
- JP2023072671
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-04-26
- Publication Date
- 2024-11-08
AI Technical Summary
Existing RFID-based systems for estimating the location of managed objects suffer from cumulative errors and spatial constraints, leading to inaccuracies in determining the position of movable targets in real space.
A display control system utilizing passive RFID tags attached to both movable targets and fixed positions, combined with self-position estimation methods, calculates the movement of a reading device to estimate the location of targets within a defined range based on the amount of movement between reading times, accounting for estimation errors and reading ranges.
Provides accurate and intuitive visualization of the estimated location of movable objects, allowing users to efficiently manage and track their positions, even in environments with obstructions, by displaying an estimated range that reflects the cumulative error and movement of the reading device.
Smart Images

Figure 2024157966000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a display control system, an information processing device, a method, and a computer program. [Background technology]
[0002] RFID (Radio Frequency IDentification) is a technology that enables information embedded in small devices, also called tags, to be read by an external reader via short-range wireless communication. For example, by attaching an RFID tag with embedded unique identification information to an item, it becomes possible to efficiently determine the location of the item and to easily visualize the information of the items under management. Among them, passive RFID tags, which transmit information using the energy of electromagnetic waves emitted from a reader, are inexpensive to manufacture because they do not require batteries, and can operate semi-permanently, so they are being used in a wide range of situations.
[0003] Patent Document 1 discloses a management system that utilizes RFID to improve the efficiency of construction work progress management. In the management system of Patent Document 1, RFID tags are installed at specific locations and RFID tags are also attached to building materials, and the latest locations and statuses of the building materials are presented to the user based on information read from the RFID tags by a handheld terminal.
[0004] Patent Document 2 discloses a technique that combines reading information from an RFID tag with a self-location estimation method in order to estimate the location of a managed object without relying on GPS (Global Positioning System) positioning, which is prone to being unstable in environments with many obstructions. According to the technique of Patent Document 2, the location of a managed object is estimated based on the known location of a fixedly installed position tag and the relative movement amount of a reader calculated according to the self-location estimation method (also called PDR (Pedestrian Dead Reckoning)).
[0005] Patent document 3 discloses a technology in which identification information is received at multiple different locations from an RFID tag that is previously attached to a lost item, and the location of the item is estimated on a screen using a triangulation technique based on the strength of the received signal. [Prior art documents] [Patent documents]
[0006] [Patent Document 1] JP 2020-129312 A [Patent Document 2] Patent Publication No. 2021-141415 [Patent Document 3] JP 2004-294403 A Summary of the Invention [Problem to be solved by the invention]
[0007] Patent Documents 1 to 3 suggest visualizing information including the estimated location of a managed object. In particular, by combining reading information from an RFID tag with a self-location estimation method as in the technology disclosed in Patent Document 2, it is possible to estimate the location of managed objects scattered in a wide space and provide the user with the location information. However, the combination of reading information from an RFID tag with a self-location estimation method may be affected by several error factors, such as the effect of accumulated errors, spatial constraints in the real space, and obsolescence of information over time.
[0008] In view of the above, the present invention aims to provide an improved mechanism for displaying information relating to the estimated location of a managed object. [Means for solving the problem]
[0009] According to one aspect, there is provided a display control system including a first wireless device storing first identification information for identifying a managed object that is attached to a managed object that is movable in real space; a second wireless device storing unique second identification information that is installed at a predetermined position in the real space; a reading device capable of reading the identification information stored in the wireless device from the wireless device; an estimation unit that estimates the location of the managed object based on a result of reading the first identification information from the first wireless device at a first read time by the reading device and a result of reading the second identification information from the second wireless device at a second read time by the reading device; and a display control unit that causes a display device to display an estimated range in which the managed object is estimated to be located in the real space based on the location estimated by the estimation unit, wherein the size of the estimated range is based on the amount of movement of the reading device between the first read time and the second read time. Effect of the Invention
[0010] According to the present invention, an improved mechanism for displaying information regarding the estimated location of managed objects can be provided. [Brief description of the drawings]
[0011] [Figure 1] FIG. 1 is a schematic diagram showing an example of a configuration of a display control system according to an embodiment. [Diagram 2] FIG. 2 is a block diagram showing an example of the configuration of a tag reader included in the portable system according to an embodiment. [Diagram 3] FIG. 2 is a block diagram showing an example of the configuration of a user terminal included in the mobile system according to an embodiment. [Figure 4] FIG. 4 is a block diagram showing an example of a configuration of a management server according to an embodiment. [Diagram 5] FIG. 4 is an explanatory diagram showing an example of the configuration of a target table according to an embodiment. [Figure 6] FIG. 4 is an explanatory diagram showing an example of the configuration of a region table according to an embodiment. [Figure 7]FIG. 4 is an explanatory diagram showing an example of the configuration of a position tag table according to an embodiment. [Figure 8] FIG. 4 is an explanatory diagram showing an example of the configuration of a reader table according to an embodiment; [Figure 9A] FIG. 8 is a schematic diagram illustrating an example of setting areas corresponding to the example data of FIGS. 6 and 7. [Figure 9B] FIG. 8 is a schematic diagram showing an example of the arrangement of position tags corresponding to the data examples of FIGS. 6 and 7; [Figure 10] FIG. 4 is an explanatory diagram showing an example of the configuration of a movement amount table according to an embodiment; [Figure 11] FIG. 4 is an explanatory diagram showing an example of a configuration of a tag detection table according to an embodiment. [Figure 12] FIG. 4 is an explanatory diagram showing an example of a configuration of a position information table according to an embodiment. [Figure 13A] FIG. 11 is a first explanatory diagram of the relationship between the movement path of the tag reader and the size of the estimated range. [Figure 13B] FIG. 13 is a second explanatory diagram of the relationship between the movement path of the tag reader and the size of the estimated range. [Figure 14] FIG. 2 is an explanatory diagram showing an example of a plurality of coordinate regions (grids). [Figure 15] FIG. 4 is an explanatory diagram showing a first example of the configuration of an information viewing screen. [Figure 16] FIG. 11 is an explanatory diagram showing a second example of the configuration of an information viewing screen. [Figure 17] FIG. 11 is an explanatory diagram showing a first example of display of position information including an estimation range. [Figure 18] FIG. 11 is an explanatory diagram showing a second example of display of position information including an estimated range. [Figure 19] FIG. 13 is an explanatory diagram showing a third example of display of position information including an estimated range. [Figure 20] FIG. 13 is an explanatory diagram showing a fourth example of display of position information including an estimated range. [Figure 21] 10 is a flowchart showing an example of the flow of a data transmission process according to an embodiment. [Figure 22] 10 is a flowchart showing an example of a flow of a position estimation process according to an embodiment. [Diagram 23]10 is a flowchart showing an example of a flow of a display control process according to an embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0012] Hereinafter, the embodiments will be described in detail with reference to the attached drawings. Note that the following embodiments do not limit the invention according to the claims. Although the embodiments describe a number of features, not all of these features are essential to the invention, and the features may be combined in any manner. Furthermore, in the attached drawings, the same reference numbers are used for the same or similar configurations, and duplicated descriptions are omitted.
[0013] <1. System Overview> FIG. 1 is a schematic diagram showing an example of the configuration of a display control system 1 according to an embodiment. The display control system 1 is a system that tracks the location of a managed object, which may change daily, and visualizes the location information. In this embodiment, the display control system 1 handles the location information of the managed object in order to support management of work involving the movement of the managed object in real space. As an example, the work of constructing a building includes work processes such as carrying materials to a site, distributing the materials to floors or rooms, and installing the materials, and at least one managed object may move in each work process. The managed object may include at least one of an object located in the real space and a user who is active in the real space. The object may be an inanimate object (e.g., a machine, an apparatus, an instrument, a material, a consumer good, a part, a vehicle, or a robot) or a living object (e.g., an animal or a plant). In the following, an example of the work of constructing a building will be mainly described, but the technology according to the present disclosure is also applicable to other types of work.
[0014] In this embodiment, the display control system 1 estimates the location of each managed object, and manages location information including the estimation result. The location of each managed object may be expressed by two-dimensional or three-dimensional position coordinates. In this embodiment, a plurality of zones are set in the real space. Each managed object may be estimated to be located within one of the zones based on the estimation result of the location.
[0015] Referring to FIG. 1, a plurality of areas 10a, 10aa, 10ab, 10ac, 10ad, 10ae, 10b, 10ba, and 10bb are set in the real space. The areas 10a and 10b may correspond to, for example, districts (for example, different construction sites) that are geographically separated from each other. The areas 10aa and 10ad are areas set within the area 10a with a spatial granularity narrower than that of the area 10a, and may correspond, for example, to separate buildings constructed in a certain district. The areas 10ab and 10ac are areas set within the area 10aa with a spatial granularity narrower than that of the area 10aa, and may correspond, for example, to separate floors constituting a certain building. Similarly, the area 10ae is an area set within the area 10ad with a spatial granularity narrower than that of the area 10ad. Although not shown in FIG. 1, further areas that may correspond to rooms may be set within each floor with an even narrower spatial granularity. In this way, the multiple zones set in the real space have a tree-like hierarchical relationship, and the zone data described below defines this hierarchical relationship.
[0016] In the example of FIG. 1, a user 20a moves between multiple areas while carrying a portable system 100. In this specification, the expression that a user carries some object is intended to broadly include various ways in which the user moves with the object (e.g., moving while holding or wearing the object). Also, items 30a, 30b, and 30c are located in areas 10ab, 10aa, and 10b, respectively. These items are objects whose position information is managed by the display control system 1. In addition to the items, users (e.g., workers, supervisors, and other related parties) may also be managed.
[0017] The display control system 1 utilizes wireless devices, also called tags, to track the location of the managed object. The location tag is a wireless device (second wireless device) installed in each of a plurality of areas. Typically, a plurality of location tags are installed at different positions in the real space. In the figure, a location tag 40a is installed in the area 10a, a location tag 40aa is installed in the area 10aa, a location tag 40ab is installed in the area 10ab, a location tag 40ac is installed in the area 10ac, a location tag 40ad is installed in the area 10ad, and a location tag 40ae is installed in the area 10ae. Similarly, a location tag 40b is installed in the area 10b. Two or more location tags may be installed in one area, and in the example of FIG. 1, two location tags are installed in the area 10ba. Each location tag stores unique identification information (second identification information) associated with the corresponding installation area in an internal memory.
[0018] The target tag is a wireless device (first wireless device) attached to each managed object that can move in real space. Fig. 1 shows a target tag 50a attached to an item 30a, a target tag 50b attached to an item 30b, and a target tag 50c attached to an item 30c. Each target tag stores, in an internal memory, identification information (first identification information) for identifying the managed object to which the target tag is attached.
[0019] In the following description, when it is not necessary to distinguish between the areas 10a to 10bb, the alphabet at the end of the reference numeral will be omitted and these will be collectively referred to as the area 10. The same applies to the items 30 (items 30a, 30b, ...), the position tags 40 (40a, 40b, ...), the target tags 50 (target tags 50a, 50b, ...), the users 20, and other elements.
[0020] The number of areas set in the real space and the number of managed objects are not limited to the example shown in Fig. 1 and may be any number. Similarly, the number of users who use the display control system 1 and the number of portable systems 100 (described later) carried by the users may also be any number.
[0021] In this embodiment, each of the tags such as the position tag 40 and the target tag 50 is a passive RFID tag (passive tag). The passive tag is composed of a small IC (Integrated Circuit) chip with built-in memory and an antenna, and stores unique identification information and other information for identifying the tag in the memory. In this specification, the identification information is also simply called ID, and the identification information for identifying the tag is also called tag ID. Note that the tag ID may be considered as information for identifying the object to which the tag is attached. The IC chip of the passive tag operates using the energy of electromagnetic waves emitted from the tag reader, modulates the tag ID and other information stored in the memory into an information signal, and transmits (returns) the information signal from the antenna.
[0022] In another embodiment, each tag may be an active RFID tag. When each tag actively (for example, periodically) transmits information to the surroundings using power from a built-in battery, the tag may be called a beacon tag. In yet another embodiment, each tag may be a wireless device that responds to a signal from a reader and returns information, for example, by the NFC (Near Field Communication) method or the Bluetooth (registered trademark) method. Each tag may be called by any name, such as an IC tag, an IC card, or a responder.
[0023] The display control system 1 includes a mobile system 100 and a management server 200. The mobile system 100 and the management server 200 are connected to a network 5. The network 5 may be a wired network, a wireless network, or any combination thereof. Examples of the network 5 may include the Internet, an intranet, and a cloud network.
[0024] The mobile system 100 includes at least a tag reader 110. The tag reader 110 is a reading device capable of reading information stored in a wireless device such as an RFID tag. The tag reader 110 can detect a management target to which a target tag 50 is attached, for example, by reading a tag ID from the target tag 50. The tag reader 110 attempts to read periodically or in response to some trigger such as a user operation, and transmits a tag reading result to the management server 200. The tag reader 110 may be capable of communicating directly with the management server 200, or may be capable of communicating indirectly with the management server 200 via some relay device (for example, a user terminal 160 described later). An example of a specific configuration of the tag reader 110 will be further described later.
[0025] In the example shown in FIG. 1, the mobile system 100 further includes a user terminal 160. The user terminal 160 may be any type of terminal device or information processing device, such as a notebook PC (Personal Computer), a tablet PC, a smartphone, or a smart watch. The user terminal 160 may be used for interaction with the user 20 by the display control system 1. An example of a specific configuration of the user terminal 160 will be further described later.
[0026] The management server 200 is an information processing device that manages location information and other information of managed objects in a database. The management server 200 may be implemented as an application server, a database server, or a cloud server using, for example, a high-performance general-purpose computer. The management server 200 receives tag reading results from the tag reader 110 and updates the database based on the received tag reading results. For example, the management server 200 estimates the location of each managed object based on the tag reading results. An example of a specific configuration of the management server 200 will be further described later.
[0027] 1 shows a single management server 200, the functions of the management server 200, which will be described in detail later, may be provided by a single device, or may be provided by multiple physically separate devices working together. In addition, in this embodiment, an example will be described in which the management server 200 holds the database, but a device separate from the management server 200 may hold part or all of the database. For example, some of the data may be held by a wireless device (e.g., a location tag or a target tag), a tag reader 110, or a user terminal 160.
[0028] 1 shows an example in which portable system 100 includes tag reader 110 and user terminal 160, which are separate devices. However, portable system 100 is not limited to this example. For example, tag reader 110 may have some or all of the functions of user terminal 160, which will be described later, and user terminal 160 may have some or all of the functions of tag reader 110, which will be described later. In addition, the functions of management server 200 described in this embodiment may be realized in user terminal 160.
[0029] <2. Example of a portable system configuration> <2-1. Example of tag reader configuration> Fig. 2 is a block diagram showing an example of a configuration of tag reader 110 included in portable system 100 according to an embodiment. Referring to Fig. 2, tag reader 110 includes control unit 111, storage unit 112, communication unit 113, measurement unit 114, operation unit 115, and reading unit 116.
[0030] The control unit 111 is composed of a memory that stores a computer program, and one or more processors (e.g., a CPU (Central Processing Unit)) that execute the computer program. The control unit 111 controls the overall functions of the tag reader 110 described in this specification. For example, the control unit 111 causes the reading unit 116 to execute reading of an RFID tag within a tag reading range, and causes the read information, the read time, and the signal reception level to be temporarily stored in the memory unit 112 as read result data. In addition, the control unit 111 causes the measurement unit 114 to measure the position of the tag reader 110 in parallel with reading the RFID tag, and causes the measurement result to be stored in the memory unit 112. Then, the control unit 111 transmits the read result data and the measurement result data stored in the memory unit 112 to the management server 200 via the communication unit 113, together with the reader identification information (also called a reader ID) of the own device.
[0031] The storage unit 112 may include any type of storage medium, such as a semiconductor memory such as a Read Only Memory (ROM) or a Random Access Memory (RAM), an optical disk, or a magnetic disk. In this embodiment, the storage unit 112 stores the above-mentioned reading result data, measurement result data, and the reader ID of the tag reader 110.
[0032] The communication unit 113 is a communication interface for the tag reader 110 to communicate with the management server 200. For example, the communication unit 113 may be a WLAN interface for communicating with a WLAN (Wireless Local Area Network) access point, or a cellular communication interface for communicating with a cellular base station. The communication unit 113 may also be a connection interface for connecting to a relay device (for example, a Bluetooth (registered trademark) interface or a USB (Universal Serial Bus) interface).
[0033] The measurement unit 114 is a unit capable of measuring the position of the tag reader 110. In this embodiment, the measurement unit 114 periodically measures the relative movement amount of the tag reader 110 from a certain reference position using a self-location estimation method also called PDR, and outputs the measured movement amount to the control unit 111. The reference position for measuring the relative movement amount may be, for example, the position of the tag reader 110 at the time when the tag reader 110 is started. The relative movement amount of the tag reader 110 may be treated as a relative position. For example, the measurement unit 114 includes a three-axis acceleration sensor 114a, a gyro sensor 114b, and a geomagnetic sensor 114c. The three-axis acceleration sensor 114a measures the acceleration applied to the tag reader 110 in a device coordinate system unique to the tag reader 110, and outputs first sensor data. The gyro sensor 114b measures the angular velocity of the tag reader 110, that is, the change in the attitude of the tag reader 110, and outputs second sensor data. Geomagnetic sensor 114c measures the orientation of tag reader 110 in real space and outputs third sensor data. Based on the sensor data from these sensors, measurement unit 114 can measure the relative movement amount of tag reader 110 by accumulating the acceleration while converting the direction of the acceleration of tag reader 110 into a direction in a coordinate system of real space. The relative movement amount output from measurement unit 114 to control unit 111 may be a two-dimensional vector in a horizontal plane, or may be a three-dimensional vector including a component in the height direction.
[0034] As will be described later, in this embodiment, the position coordinates of the installation position of each position tag 40 are known and registered in a database. Therefore, the position coordinates of the point where the tag reader 110 is currently located can be estimated based on the amount of relative movement from the time when the tag reader 110 detected a certain position tag 40 to the current time and the known position coordinates of the position tag 40. In this embodiment, an example in which the management server 200 estimates the absolute position of the tag reader 110 will be mainly described, but the control unit 111 or measurement unit 114 of the tag reader 110 may access the database to estimate the absolute position of the tag reader 110.
[0035] Note that instead of tag reader 110 including measurement unit 114, mobile system 100 may include a measurement device separate from tag reader 110 (eg, capable of measuring the amount of relative movement using a self-location estimation method).
[0036] In a modified example, the measurement unit 114 may further include an air pressure sensor 114d shown by a dashed line in FIG. 2. The air pressure sensor 114d measures the atmospheric pressure and outputs air pressure data indicating the measured value to the control unit 111. In this modified example, the air pressure data output from the air pressure sensor 114d may be used to estimate the height of the point where the tag reader 110 is currently located. For example, in a linear air pressure-height model, the relative height of the current position from the reference point can be derived by multiplying the drop in the air pressure value of the current position from the air pressure value of the reference point by a predetermined coefficient. When the reference point is provided on the ground, this relative height represents the height of the current position above the ground. An air pressure sensor that measures the atmospheric pressure at the reference point may be additionally provided.
[0037] Operation unit 115 accepts operations by user 20. Operation unit 115 includes, for example, a physical input device such as a button, switch, or lever arranged on the housing of tag reader 110. Operation unit 115 accepts operations by user 20 via the input device, and outputs an operation signal to control unit 111. Operation unit 115 may also include a voice input interface such as a microphone.
[0038] The reading unit 116 is a unit capable of reading information stored in each of the position tags 40 and the target tags 50 under the management of the display control system 1. Referring to FIG. 2, the reading unit 116 includes an RF controller 120, a power amplifier 121, a filter 122, a first coupler 123, a second coupler 124, an antenna 125, a power detection unit 126, and a canceller 127. The RF controller 120 outputs a transmission signal (e.g., a signal modulated in the UHF band) from the TX terminal to the power amplifier 121 in accordance with the control of the control unit 111. The power amplifier 121 amplifies the transmission signal input from the RF controller 120 and outputs it to the filter 122. The amplification factor of the transmission signal here may be variably controllable, and the higher the amplification factor, the higher the output intensity of the electromagnetic wave radiated from the tag reader 110. The filter 122 may be, for example, a low-pass filter, and removes unnecessary low-frequency components of the transmission signal amplified by the power amplifier 121. The first coupler 123 distributes the transmission signal that has passed through the filter 122 to the second coupler 124 and the power detection unit 126. The second coupler 124 outputs the transmission signal input from the first coupler 123 to the antenna 125, and outputs the reception signal input from the antenna 125 to the RF controller 120. The antenna 125 transmits the transmission signal input from the coupler 124 into the air as an electromagnetic wave. The antenna 125 also receives a signal returned from an RFID tag present within the reading range of the tag reader 110 in response to the transmission signal, and outputs the reception signal to the coupler 124. The power detection unit 126 detects the power level of the signal input from the first coupler 123, and outputs a signal RF_DETECT indicating the detected power level to the control unit 111. The canceller 127 receives a signal CARRIER_CANCEL indicating the power level of the carrier wave from the control unit 111. Then, the canceller 127 cancels the carrier component of the transmission signal based on CARRIER_CANCEL, thereby extracting a desired signal component of the reception signal to be output to the RX terminal of the RF controller 120. The RF controller 120 demodulates the signal input from the RX terminal, acquires the tag ID and other information returned from the RFID tag, and outputs the acquired information to the control unit 111.Furthermore, the RF controller 120 measures the reception level (also called reception intensity) of a signal input from the RX terminal, and outputs the measurement result to the control unit 111.
[0039] In this embodiment, the tag reading attempt by the reading unit 116 may be performed periodically (e.g., once per second) without requiring an explicit instruction from the user. Data transmission from the communication unit 113 to the management server 200 may also be performed periodically (e.g., once every few seconds) or each time a tag is read, without requiring an explicit instruction from the user. In order to reduce the communication load by omitting transmission of redundant data, the control unit 111 may exclude from the data to be transmitted a record that is the same as a record that has been transmitted within a recent predetermined period. Note that, in another embodiment, one or both of the tag reading attempt by the reading unit 116 and the transmission of data to the management server 200 may be performed in response to detection of a user input via the operation unit 115. When the communication unit 113 indirectly communicates with the management server 200 via a relay device, the transmission of data to the management server 200 may be performed only while the connection between the communication unit 113 and the relay device is valid.
[0040] <2-2. Example of user terminal configuration> Fig. 3 is a block diagram showing an example of a configuration of a user terminal 160 included in the portable system 100 according to an embodiment. Referring to Fig. 3, the user terminal 160 includes a control unit 161, a storage unit 162, a communication unit 163, an operation unit 165, a display unit 171, an audio output unit 172, and a vibration unit 173.
[0041] The control unit 161 includes a memory that stores a computer program, and one or more processors that execute the computer program. The processor may be a CPU or an IC (Integrated Circuit) such as a microcontroller (e.g., a one-chip microcomputer). The control unit 161 controls the overall functions of the user terminal 160 described in this specification. For example, in the display control system 1, when the user 20 desires to view location information of a managed object, the control unit 161 causes the display unit 171 to display a screen presenting the requested information. Some examples of the screens displayed to the user 20 will be further described later.
[0042] The storage unit 162 may include any type of storage medium, such as a semiconductor memory such as a ROM or a RAM, an optical disk, or a magnetic disk. In this embodiment, the storage unit 162 temporarily stores, for example, a map image and location information of the managed object received from the management server 200 (described later) for screen display.
[0043] The communication unit 163 is a communication interface for the user terminal 160 to communicate with the management server 200. For example, the communication unit 163 may be a WLAN interface or a cellular communication interface. Although not shown in FIG. 3, the user terminal 160 may further include a connection interface (for example, a Bluetooth (registered trademark) interface or a USB interface) for connecting to a peripheral device.
[0044] The operation unit 165 accepts operations and information input by the user 20. The operation unit 165 includes input devices such as a touch sensor, a keypad, a keyboard, a button, or a pointing device. The operation unit 165 accepts operations by the user 20 via the input devices and outputs operation signals to the control unit 161. The operation unit 165 may further include other types of input devices, such as a voice input interface such as a microphone or a sensor that detects vibration.
[0045] The display unit 171 displays images and information. The display unit 171 may be, for example, a liquid crystal display or an OLED (Organic Light-Emitting Diode) display. The audio output unit 172 outputs audio. The audio output unit 172 may be, for example, a speaker. The vibration unit 173 vibrates the user terminal 160. The vibration unit 173 may be, for example, a vibrator including an eccentric motor.
[0046] <3. Management Server Configuration Example> <3-1. Basic configuration> 4 is a block diagram showing an example of a configuration of the management server 200 according to an embodiment. Referring to FIG. 4, the management server 200 includes a communication unit 210, a database (DB) 220, and a management unit 230.
[0047] The communication unit 210 is a communication interface for the management server 200 to communicate with other devices. The communication unit 210 may be a wired communication interface or a wireless communication interface. In this embodiment, the communication unit 210 communicates with the mobile system 100 (for example, one or both of the tag reader 110 and the user terminal 160). The database 220 stores various data for estimating the location of the managed object and managing the location information. The database 220 is accessible by the management unit 230. In this embodiment, the database 220 includes an object table 310, an area table 320, a location tag table 330, a reader table 340, a movement amount table 360, a tag detection table 370, and a location information table 380. The management unit 230 is a collection of multiple software modules that perform various processes related to location estimation and providing location information to a user. Each software module can be operated by one or more processors (not shown) of the management server 200 executing a computer program stored in a memory (not shown). In this embodiment, the management unit 230 includes a data management unit 231, an estimation unit 232, and a display control unit 233.
[0048] <3-2. Data Management> (1) Target table FIG. 5 shows an example of the configuration of the object table 310. The object table 310 has four data items: a tag ID 311, an object ID 312, a name 313, and an object type 314. The tag ID 311 is identification information that uniquely identifies the object tag 50 attached to each managed object. The value of the tag ID 311 is the same as the value of the tag ID stored inside the corresponding object tag 50. The object ID 312 is identification information that uniquely identifies each managed object. The name 313 indicates the name of each managed object. In the example of FIG. 5, the managed object identified by the object ID "IT11" is given the name "material A1". The object type 314 is one aspect of type information associated with the managed object. In the example of FIG. 5, "material A1" and "material A2" are classified into the same object type "T1", while "material B1" is classified into an object type "T2" different from the object type "T1".
[0049] (2) Area table FIG. 6 shows an example of the configuration of the area table 320 of the database 220. The area table 320 stores area data that defines a plurality of areas set in real space. The area table 320 has six data items, namely, an area ID 321, a name 322, a parent area 323, a map 325, a scale 326, and a direction 327. The area ID 321 is identification information that uniquely identifies each of the plurality of areas. The name 322 indicates the name of each area. In the example of FIG. 6, the area identified by the area ID "A000" is given the name "District A". The parent area 323 identifies areas that directly include each area in the hierarchical relationship of the plurality of areas set in real space by the value of the area ID 321 of another record in the area table 320. In the example of FIG. 6, the parent area of the area identified by the area ID "AA00" is "A000", which means that "Building A" is included in "District A". For the highest level area in the hierarchical relationship of multiple areas, the parent area 323 may be blank. The map 325 is a data item for storing map data available for each area in association with the corresponding area when the map data is registered by the user. The map data includes at least image data representing a map image. In addition, the map data may include boundary data defining the boundary positions of the areas. The scale 326 indicates a ratio for converting a distance on the map image to a distance in real space when the map data is registered (e.g., how many meters in real space one pixel of the image corresponds to). The orientation 327 is a data item for storing orientation information indicating an orientation on the map image when the map data is registered. For example, the orientation information may include a vector pointing to a specific direction (e.g., north) in the two-dimensional coordinates of the map image. FIG. 9A shows an example of the positional relationship of areas belonging to "District A" among the areas defined by the area data illustrated in FIG. 6.
[0050] (3) Location tag table FIG. 7 shows an example of the configuration of the position tag table 330 of the database 220. The position tag table 330 has three data items: a tag ID 331, an installation area 332, and a tag position 333. The tag ID 331 is identification information that uniquely identifies each of the position tags 40 installed in the real space. The value of the tag ID 331 is the same as the value of the tag ID stored inside the corresponding position tag 40. The installation area 332 identifies the area in which each position tag 40 is installed by the value of the area ID 321 in the area table 320. That is, the tag ID of each position tag 40 is associated with the installation area corresponding to the position tag 40 in the position tag table 330. Referring to FIG. 7, for example, the tag ID "TG500" is associated with the area ID "A000". This indicates that the position tag 40 identified by the tag ID "TG500" is installed in the area identified by the area ID "A000". The tag position 333 indicates the position coordinates of the installation position of each position tag 40 .
[0051] FIG. 9B shows an example of the arrangement of the position tags 40 corresponding to the data example of the position tag table 330 in FIG. 7, assuming the positional relationship of the areas shown in FIG. 9A. In a building as shown in the figure, the walls, floors, and ceilings often block wireless signals. If a position tag 40 is installed in each of the areas separated from each other by such obstructions, it becomes possible to determine which area the tag reader 110 was located in at the time of detection based on which position tag 40 the tag reader 110 detected. This embodiment combines such a simple determination of the location area based on tag reading and a more precise location estimation using a self-location estimation method described later. For a relatively large area, the detectable range of one position tag 40 may not cover a sufficient area, so two or more position tags 40 may be installed in one area, such as "Floor A1" in FIG. 9B.
[0052] (4) Leader table FIG. 8 shows an example of the configuration of the reader table 340. The reader table 340 has four data items: a reader ID 341, a name 342, a read range 343, and a user 344. The reader ID 341 is identification information that uniquely identifies each tag reader 110 used in the system. The name 342 indicates the name of each reader. The read range 343 indicates the length of the read range (how far away the tag ID can be read from the wireless device) as the performance of each reader. Note that, if the read range lengths of all the tag readers 110 are uniform, the reader table 340 does not need to include the read range 343 as a data item. The user 344 is identification information that identifies the user 20 who uses each tag reader 110. In the example of FIG. 8, the tag reader 110 identified by the reader ID "RD01" has the name "reader A" and is used by a user identified by the user ID "UR91".
[0053] (5) Data registration The data management unit 231 manages various data stored in the database 220 as described above. Data to be registered in each table of the database 220 may be generated by, for example, a user or an engineer. The data management unit 231 may receive a data file describing such data via the communication unit 210 and register the data in each table. The map data of each area may be data based on, for example, a CAD (Computer-Aided Design) drawing. The data management unit 231 may also provide, for example, the user terminal 160, with a user interface (UI) for accepting registration, modification, or deletion of data.
[0054] The configuration of the database managed by the management server 200 is not limited to the configuration described here. Two or more tables shown in FIG. 4 may be integrated into one table, or one table may be separated into two or more tables. Each table may have additional data items or may not have one or more of the data items described. For example, the object table 310 may have additional data items such as the manufacturer and owner of the item to be managed and the organization to which the user belongs. The area table 320 may have a data item indicating the height above ground of each floor. The area table 320 may have a data item indicating the elevation of the ground surface of each district or each building. Such height above ground or elevation may be used, for example, when deriving the height of a point where a certain managed object is located from a measured value of air pressure.
[0055] <3-3. Estimation of location> The estimation unit 232 estimates the location of the managed object to which the target tag 50 is attached based on the result of reading the tag ID from the target tag 50 by the tag reader 110 and the result of reading the tag ID from the position tag 40 by the same tag reader 110. Typically, the estimation unit 232 estimates the locations of multiple managed objects that are movable in real space. The movement amount table 360 and the tag detection table 370 of the database 220 are used for estimating such locations.
[0056] (1) Movement amount table FIG. 10 shows an example of the configuration of the movement amount table 360. The movement amount table 360 is a table for accumulating records of measurement result data received from the tag reader 110 (hereinafter, referred to as measurement result records). The movement amount table 360 has three data items, namely, a measurement time 361, a reader ID 362, and a movement amount 363. The measurement time 361 indicates the time when the measurement was performed for the measurement result indicated by each measurement result record. The reader ID 362 indicates the tag reader 110 that performed the measurement for the measurement result indicated by each measurement result record by the value of the reader ID 341 in the reader table 340. In the example of FIG. 10, six records in the movement amount table 360 indicate the results of movement amount measurements performed by the tag reader 110 identified by the reader ID "RD01" at six different times "ymd1" to "ymd6". The movement amount 363 indicates the relative movement amount as a measurement result. Here, the movement amount 363 represents the relative movement amount in the form of a three-dimensional vector in the coordinate system of the real space.
[0057] (2) Tag detection table 11 shows an example of the configuration of tag detection table 370. Tag detection table 370 is a table for accumulating records of read result data received from tag reader 110 (hereinafter referred to as read result records). Tag detection table 370 has four data items: read time 371, tag ID 372, reader ID 373, and reception strength 374. Read time 371 indicates the time when the tag ID was read for each read result record. Tag ID 372 indicates the tag ID read for each read result record. Reader ID 373 indicates the tag reader 110 that performed tag reading for each read result record by the value of reader ID 341 in reader table 340. In the example of FIG. 11, the first record in the tag detection table 370 indicates that the tag reader 110 identified by the reader ID "RD01" read the tag ID "TG511" (e.g., the tag ID of the position tag 40 of "Floor A1") at time "ymd1". The second record indicates that the tag reader 110 read the tag ID "TG011" (e.g., the tag ID of the target tag 50 of "Material A1") at time "ymd5". The third record indicates that the tag reader 110 read the tag ID "TG021" (e.g., the tag ID of the target tag 50 of "Material B1") at time "ymd6". The reception strength 374 indicates the reception level of the signal received by the tag reader 110 when reading the tag for each reading result record.
[0058] (3) Estimation of location Assume that a tag reader 110 reads a tag ID from a target tag 50 at a first read time, and further reads a tag ID from a position tag 40 at a second read time. The second read time may be before or after the first read time. The estimation unit 232 can estimate the position coordinates of the point where the managed object to which the detected target tag 50 is attached is located, based on the amount of relative movement between the first read time and the second read time of this tag reader 110 and the known position of the detected position tag 40.
[0059] Specifically, the estimation unit 232 adds each record of the measurement result data received from the portable system 100 via the communication unit 210 to the movement amount table 360 as a measurement result record. In addition, the estimation unit 232 adds each record of the reading result data received from the portable system 100 via the communication unit 210 to the tag detection table 370 as a reading result record. When the target tag 50 is detected by the tag reader 110, the estimation unit 232 estimates the position coordinates (u, v, h) of the point where the target tag 50 is located at that time according to the following equation (1):
number
[0060] When the same target tag 50 is detected multiple times within a certain period of time, the estimation unit 232 may estimate the position coordinates of the corresponding managed object based on the relative movement amount of the tag reader 110 at the time when the signal reception strength was the highest. Furthermore, when the same target tag 50 is detected multiple times within a certain period of time, the estimation unit 232 may estimate that the corresponding managed object is located at the center (for example, the center of gravity position) of the multiple detection positions derived using the above-mentioned calculation formula.
[0061] The estimation unit 232 may select a reference location tag to be used for estimating the location of a certain managed object based on a correlation between the result of reading the tag ID from a target tag 50 of the managed object and the result of reading the tag ID from one or more position tags 40. The correlation here may include one or both of a temporal correlation and a spatial correlation. For example, the estimation unit 232 may focus on each position tag 40 in order of the smallest difference in the tag ID reading time with respect to a certain target tag 50, and first select a position tag 40 that satisfies both of the following conditions 1 and 2 as the reference location tag: Condition 1: The straight-line distance between the estimated positions of the tag readers at the two read times is less than a first threshold (threshold determination may be performed separately for the distance in the horizontal plane and the distance in the vertical direction). Condition 2: The cumulative movement of the tag reader between the two read times is below the second threshold.
[0062] The estimation unit 232 estimates that the corresponding managed object is located in the area associated with the tag ID of the reference position tag selected according to the above-mentioned conditions. That is, the value of the installation area 332 in the position tag table 330 of the reference position tag selected for the target tag 50 of a certain managed object identifies the area in which the managed object is located. Note that the estimation unit 232 may determine that the location of a managed object for which a reference position tag cannot be selected because there is no position tag 40 that satisfies the above-mentioned conditions is unknown.
[0063] The estimation unit 232 further derives an estimation error for the managed object whose location has been estimated. The estimation error is used to determine an estimated range in real space in which the managed object is estimated to be located. The estimation error depends on the amount of movement of the tag reader 110 between the first read time and the second read time. The amount of movement here is the cumulative amount of movement along the movement path of the tag reader 110, as in the above-mentioned condition 2. That is, when the tag reader 110 moves non-linearly between the first position at the first read time and the second position at the second read time, the cumulative amount of movement is greater than the linear distance between the first position and the second position. Specifically, the amount of movement of the tag reader 110 is measured K times (K is an integer equal to or greater than 2) at a certain measurement period between the first read time T1 and the second read time T2, and the kth (k=1,...,K) measurement result is expressed as M. k It is expressed as M k is a two-dimensional or three-dimensional vector. The estimation unit 232 estimates the cumulative movement amount Z T1→T2 may be derived, for example, according to the following formula (2):
number
number
[0064] The estimation unit 232 derives the location and other information for each managed object in this manner, and adds a location information record indicating the result to the location information table 380.
[0065] (4) Location information target table FIG. 12 shows an example of the configuration of the location information table 380. The location information table 380 is a table for accumulating location information about various managed objects under the management of the display control system 1. The location information table 380 has seven data items, namely, an object ID 381, a location position 382, a location area 383, a reference location tag 384, an estimated error 385, a read time 386, and a reader 387. The object ID 381 indicates which managed object each record in the location information table 380 indicates by using an identifier of the managed object registered in the object table 310. The location position 382 indicates the location coordinates of the location of each managed object estimated by the estimation unit 232. The location area 383 indicates the area in which each managed object is estimated to be located by using the value of the area ID registered in the area table 320. In the example of FIG. 12, the managed object identified by the object ID "IT11" is estimated to be located at a point having coordinates (u1, v1, h1) in the area identified by the area ID "AA10". The reference position tag 384 indicates the reference position tag selected when estimating the location of each managed object by the value of the tag ID of the reference position tag. The estimated error 385 indicates the value of the estimated error derived for the location of each managed object using the formulas (2) and (3). The read time 386 indicates the time (first read time) when the tag ID was read from the target tag 50 of each managed object. The reader 387 indicates the tag reader 110 that read the tag ID from the target tag 50 of each managed object by the value of the reader ID 341 in the reader table 340.
[0066] <3-4. Displaying location information> The display control unit 233 can display information about each of the multiple managed objects on the display unit 171 of the user terminal 160 in order to assist the user in understanding the state of the managed objects. In particular, in this embodiment, the display control unit 233 displays position information on the screen based on the estimation result of the location of each managed object by the estimation unit 232.
[0067] (1) Determination of the estimated range For example, the display control unit 233 may superimpose a display object indicating the location of one or more managed objects estimated to be located in a zone selected by a user on a map image based on map data of the zone. However, some error factors may act on the combination of reading information from an RFID tag and a self-location estimation method. Therefore, the display control unit 233 may display the estimated range on the display unit 171 by superimposing a display object indicating the estimated range in which the managed object is estimated to be located, taking into account the estimation error of the location of the managed object. The display control unit 233 may determine the estimated range of the location of the managed object based on the estimated location of the managed object and the estimation error derived at the time of the estimation. The estimated range may be determined further based on the reading range of the tag reader 110.
[0068] As an example, the estimated range of the location of the managed object may be defined using a radius centered on the estimated location and depending on the estimation error. Typically, the estimated range may be circular. The display control unit 233 may determine the radius R of the estimated range, for example, according to the following formula (4):
number
[0069] 13A and 13B are explanatory diagrams of the relationship between the movement path of tag reader 110 and the size of the estimated range. In the diagrams, time T2 is the read time when tag reader 110 reads the tag ID from position tag 40 installed at point 401 in area 10. Time T1 is the time when tag reader 110 reads the tag ID from target tag 50 attached to managed object 30. In the first scenario shown on the left of FIG. 13A, tag reader 110 moves along non-linear movement path 402 from time T2 to time T1. Vector 403 is a linear vector that goes from the start point of movement path 402 to the end point.
[0070] The point 404 shown on the right side of FIG. 13A is the location of the managed object 30 estimated based on the results of tag reading by the tag reader 110 at time T1 and time T2 in the first scenario. The point 404 is located at a position where the position of the point 401 where the position tag 40 is installed is moved by the amount of the vector 403 representing the relative movement amount of the tag reader 110 between the two reading times T1 and T2. However, the managed object 30 is not necessarily located strictly at this point 404, but is estimated to be located inside a substantially circular estimated range 405 drawn with the point 404 at the center. The size of the estimated range 405 is based on the cumulative movement amount along the movement path 402 of the tag reader 110 between the two reading times T1 and T2, as described above.
[0071] In the second scenario shown on the left in Fig. 13B, tag reader 110 moves from time T2 to time T1 along a non-linear movement path 412 that is longer than movement path 402 in the first scenario. Vector 413 is a linear vector that goes from the start point of movement path 412 to the end point.
[0072] The point 414 shown on the right side of FIG. 13B is the location of the managed object 30 estimated based on the results of tag reading by the tag reader 110 at time T1 and time T2 in the second scenario. The point 414 is located at a position where the position of the point 401 where the position tag 40 is installed is moved by the amount of the vector 413 representing the relative movement amount of the tag reader 110 between the two reading times T1 and T2. However, the managed object 30 is not necessarily located strictly at this point 414, but is estimated to be located inside a substantially circular estimated range 415 drawn with the point 414 at the center. The size of the estimated range 415 is based on the cumulative movement amount along the movement path 412. Since the movement path 412 is longer than the movement path 402, the estimated range 415 in the second scenario is larger than the estimated range 405 in the first scenario.
[0073] The calculation formula for determining the radius R of the estimated range is not limited to the above formula (4). For example, the term D of the reading range RANGE may be omitted. Alternatively, the read range term D RANGE may be a variable value that depends on the signal reception level when reading the tag ID from the target tag 50.
[0074] The display control unit 233 acquires the location coordinates of the location of the managed object for which display of location information is requested, the estimated error, and the reader ID of the corresponding tag reader 110 by referring to the location information table 380 of the database 220. The display control unit 233 also determines the radius R of the estimated range based on the acquired estimated error and the reading range of the tag reader 110. Since the radius R of the estimated range here represents a distance in real space, the display control unit 233 converts the radius R into a distance on the screen using the scale of the displayed map image. Then, the display control unit 233 displays a display object representing the estimated range on the screen in such a way that the center of the display object is aligned with the location coordinates of the managed object and is superimposed on the map image. The user can intuitively grasp within which range of real space the managed object is estimated to be located by looking at the display object on the screen, while considering the influence of the accumulated error of the PDR, which differs depending on the situation.
[0075] (2) Grid and area display In an embodiment, the display control unit 233 may provide the user with a grid display, which will be described below, to enable a global or general understanding of the locations of many managed objects. For example, real space is regularly divided into a number of coordinate regions (also called grids). In this specification, the grid display means a display of location information summarized for each grid. Meanwhile, the zone display means a display of location information summarized for each zone. The grid display and the zone display may be selectively switchable by the user.
[0076] FIG. 14 shows an example of a plurality of coordinate regions set in real space. The area 10c shown in FIG. 14 corresponds to one floor of a certain building. The area 10c includes areas 10ca, 10cb, 10cc, and 10cd, which correspond to rooms in the floor. In the figure, a total of four rectangular coordinate regions GR1 to GR4, each having a size of 2×2, are regularly set in the area 10c. The shapes of these coordinate regions may be uniform, and the intervals of the boundaries between the coordinate regions may be constant on each coordinate axis. The boundaries of the coordinate regions shown by dashed lines in the figure do not necessarily coincide with the boundaries of the small areas (areas 10ca, 10cb, 10cc, and 10cd) in the space shown by thick lines in the figure. In FIG. 14, icons representing the installation positions of a plurality of position tags (for example, position tags 40ca and 40cf) are also shown. In addition, icons representing the estimated positions of a plurality of managed objects (for example, item 30ca) are also shown. Note that the number and size of the coordinate regions are not limited to the example shown in FIG. 14. The size of the coordinate regions may be set to a fixed value in advance. Alternatively, the display control unit 233 may set the size of the coordinate region to different values depending on the size of the area to be displayed.
[0077] FIG. 15 shows a first example of the configuration of an information viewing screen 500 that can be provided by the display control unit 233 in this embodiment. The information viewing screen 500 can be called up in response to a user input via the operation unit 165 of the user terminal 160, for example, and can be displayed by the display unit 171 of the user terminal 160. Referring to FIG. 15, the information viewing screen 500 includes a building selection field 501, a floor selection field 502, function buttons 505, a map display area 510, and a list display area 520. When the user selects a building and a floor for which he or she wishes to view location information in the fields 501 and 502, a map image of the selected floor is displayed in the map display area 510. The display control unit 233 superimposes a boundary line (dashed line in the figure) representing the boundary between multiple coordinate areas on this map image. In the example of FIG. 15, a total of nine coordinate areas, 3×3, are set on the selected floor.
[0078] In the map display area 510, the location information of a large number of managed objects is displayed in the form of statistical information for each coordinate area. The statistical information here may include, for example, one or more of the following: 1) The number of managed objects estimated to be currently located in each coordinate area 2) The number of managed objects by category that are estimated to be currently located in each coordinate area 3) The number of managed objects estimated to be located in each coordinate area during a certain period in the past 4) The number of managed objects by category that are estimated to be located in each coordinate area during a certain period in the past 5) The number of items in 1) through 4) that meet a specific filtering condition The filtering conditions may include, for example, one or more of conditions related to the managed object and conditions related to the tag reader that detected the managed object. For example, the conditions related to the managed object may include a condition related to the name or type of the managed object. The conditions related to the tag reader may include a condition that only managed objects detected by a specific tag reader (for example, a tag reader used by the logged-in user) are displayed. The function button 505 on the information viewing screen 500 is a button that calls up a UI that allows the user to specify the filtering conditions. Such a UI may be configured according to any known method, and therefore a detailed description thereof will be omitted here.
[0079] Boxes 511 superimposed on the map display area 510 indicate the number of items and users estimated to be currently located in the corresponding coordinate area. By presenting such statistical information for each coordinate area, the user can easily and quickly grasp the general location of the managed object. It is also possible to avoid information congestion on the screen when there are many managed objects.
[0080] In the list display area 520, managed objects estimated to be located in the floor selected by the user are displayed in the form of a list grouped by location area. In the example of FIG. 15, the list display area 520 includes a plurality of list items 521 that can be expanded and collapsed. When the user operates any of the list items 521, a list of managed objects located in the area corresponding to the operated list item 521 is displayed (when the same list item 521 is operated again, the list of managed objects that was once displayed is hidden). When the user selects a specific coordinate area in the map display area 510, the managed objects displayed in the list display area 520 may be reduced to only the managed objects estimated to be located in the selected coordinate area.
[0081] FIG. 16 shows a second example of the configuration of the information viewing screen 500 that can be provided by the display control unit 233 in this embodiment. In the second example, the information viewing screen 500 includes a display switching button 503 in addition to the components described in relation to FIG. 15. The display switching button 503 is a button for switching the display format of the location information in the map display area 510 between a grid display and a zone display. In the example of FIG. 16, the zone display is selected. In the map display area 510, five boxes 531 are superimposed on a map image including five zones. Each box 531 shows statistical information (the number of items and the number of users) about the managed object estimated to be located in the corresponding zone.
[0082] (3) Display of location information including estimated range The display control unit 233 may display, on the screen at any timing, the location estimated by the estimation unit 232 for each managed object 30 and the estimated range based on the estimation error.
[0083] In an embodiment, the display control unit 233 displays a list of a plurality of managed objects on the display unit 171 of the user terminal 160, as described with reference to FIG. 15 and FIG. 16. Then, in response to the user designating a first managed object among the managed objects in the list, the display control unit 233 displays a first estimated range in real space in which the first managed object is estimated to be located on the display unit 171. In the example of the grid display in FIG. 15, the list of managed objects may be a list of managed objects estimated to be located in a grid designated by the user among a plurality of grids. In the example of the area display in FIG. 16, the list of managed objects may be a list of managed objects estimated to be located in an area designated by the user among a plurality of areas. In this way, by detailed display of information in the procedure of displaying statistical information by grid or area, designating a grid or area, and designating a managed object, it is possible to smoothly guide the user to the location information of each managed object while avoiding information congestion.
[0084] FIG. 17 is an explanatory diagram showing a first example of display of location information including an estimated range. In the first example, an icon 541 and a sign 542 are displayed in the map display area 510 in response to a user selecting a list item 522 in the list display area 520 of the information viewing screen 500. The icon 541 is a display object showing the location of the material A7, which is a managed object corresponding to the list item 522. The sign 542 is a display object showing the estimated range in which the material A7 is estimated to be located. If only the icon 541 is displayed, when the material A7 is not found at the point where the icon 541 is plotted, the user may think that the material A7 has moved to a completely different location. On the other hand, by providing the sign 542 showing the estimated range based on the estimation error as in the example of FIG. 17, the user can search preferentially within the range shown by the sign 542 in the real space and more easily find the material A7. For example, in response to a tap on the icon 541 or the sign 542, or any other user input, the display control unit 233 may switch the display state of the sign 542 between displayed and hidden.
[0085] FIG. 18 is an explanatory diagram showing a second example of displaying location information including an estimated range. In the second example, the display control unit 233 determines the display mode of the sign indicating the estimated range for the managed object 30 based on the elapsed time from the time (first read time) when the tag ID was read from the target tag 50 of the managed object 30. The display mode here may include, for example, one or more of the display color, the lighting / blinking pattern, the presence or absence of supplementary text, and the contents of the supplementary text. For example, the display control unit 233 may determine the display color of the sign indicating the estimated range as follows, by comparing the elapsed time from the first read time with a predetermined reference value: If the elapsed time is less than the reference value, the display color will be the first color. When the elapsed time exceeds the reference value, the display color is changed to the second color. For example, the first color may be blue and the second color may be yellow to alert the user.
[0086] 18, in response to the user selecting list items 522 and 523 in the list display area 520, an icon 541a and a marker 542a, as well as an icon 541b and a marker 542b, are displayed in the map display area 510. The icon 541a indicates the location of the material A7 corresponding to the list item 522. The marker 542a indicates the estimated range in which the material A7 is estimated to be located. The icon 541b indicates the location of the material A8 corresponding to the list item 523. The marker 542b indicates the estimated range in which the material A8 is estimated to be located. As can be seen from FIG. 18, the estimated range indicated by the marker 542a is larger than the estimated range indicated by the marker 542b. This is because the estimation error when the location of the material A7 is estimated is evaluated to be larger than the estimation error when the location of the material A8 is estimated, for example, due to the magnitude of the cumulative movement amount of the tag reader 110.
[0087] In addition, the display color of the indicator 542a is different from the display color of the indicator 542b. For example, the display color of the indicator 542a is yellow, which means that a time exceeding the reference value has passed since the time when the material A was last detected. In the example of Fig. 18, supplementary text 543a is also displayed to inform the user that two days have passed since the last detection time of the material A7. This display mode makes it possible to make the user aware, when a long time has passed since the last detection time of each managed object, that the managed object may have moved during that elapsed time (and therefore that the managed object may no longer be located within the displayed range).
[0088] FIG. 19 is an explanatory diagram showing a third example of display of location information including an estimated range. In the third example, the display control unit 233 determines the estimated range for a management object estimated to be located in a certain area based on the location and estimation error of the management object, as well as boundary data defining the boundary position of the area. More specifically, for example, the estimated range provisionally defined for a certain management object using the radius R in formula (4) is assumed to extend across the boundary of the management object's location area (for example, a wall that blocks wireless signals). In this case, the display control unit 233 may trim the estimated range at the boundary of the location area under the assumption that the management object is not located beyond the boundary. Note that the estimated range does not need to be trimmed at a boundary that does not prevent movement, such as a door.
[0089] 19, in response to the user selecting a list item 522 in the list display area 520, a sign 552 is displayed in the map display area 510. The sign 552 indicates an estimated range in which the material A7 is estimated to be located. In the first example in FIG. 17, the estimated range indicated by the sign 542 for the material A7 is a circle centered on the location of the material A7, whereas in the third example in FIG. 19, the estimated range indicated by the sign 552 is trimmed at the boundary of the area in which the material A7 is located ("Room 201"). In an environment in which the managed object is not expected to move linearly beyond the boundary of the area, a more probable estimated range of the managed object can be shown to the user by deforming the estimated range in this way to fit the boundary of the area, rather than simply defining it as a circle.
[0090] FIG. 20 is an explanatory diagram showing a fourth example of display of location information including an estimated range. In the fourth example, in response to the user pointing to a certain point using the cursor 560 in the map display area 510, the marker 542c and the marker 542d are displayed. The marker 542c indicates an estimated range including the pointed point and in which the resource A9 is estimated to be located. The marker 542d indicates an estimated range including the pointed point and in which the resource B8 is estimated to be located. The display control unit 233 compares the estimated range determined based on the location and estimation error of each managed object with the pointed point, thereby identifying the managed object that includes the point within the estimated range, and performs display as shown in FIG. 20. This allows the user to easily know which one or more managed objects are estimated to be located near the point of interest through interaction on the screen.
[0091] The examples of displaying position information described with reference to FIGS. 17 to 20 may be combined with each other in any manner.
[0092] <4. Processing flow> In this section, examples of the flow of several processes that can be executed in the display control system 1 will be described with reference to the flowcharts of Figures 21 to 23. In the following description, processing steps will be abbreviated as S (step).
[0093] <4-1. Data transmission process> FIG. 21 is a flowchart showing an example of the flow of a data transmission process executed by the mobile system 100.
[0094] First, in S11, the reading unit 116 of the tag reader 110 attempts to read the tag ID from a nearby RFID tag by emitting electromagnetic waves within the reading range. If the result of the tag reading attempt is that a tag ID is received from a nearby RFID tag using electromagnetic wave energy (S12-YES), the process proceeds to S13. On the other hand, if a tag ID is not received (S12-NO), the process proceeds to S15.
[0095] In S13, control unit 111 acquires the current time as the tag ID read time, for example by referring to an internal real-time clock. Next, in S14, control unit 111 transmits read result data including the read tag ID, read time, reception level, and reader ID of tag reader 110 to management server 200 via communication unit 113. Then, the process proceeds to S15.
[0096] At S15, measurement unit 114 of tag reader 110 measures the relative movement amount of tag reader 110 based on sensor data output from, for example, a three-axis acceleration sensor, a gyro sensor, and a geomagnetic sensor. Here, measurement unit 114 may further cause an air pressure sensor to measure atmospheric pressure. Next, at S16, control unit 111 obtains the current time as the measurement time. Next, at S17, control unit 111 transmits measurement result data including the relative movement amount (and air pressure value) measured by measurement unit 114, the measurement time, and the reader ID of tag reader 110 to management server 200 via communication unit 113.
[0097] Thereafter, the process returns to S11. Such data transmission process may be performed repeatedly at a fixed measurement period during the period in which tag reading attempts are activated in the portable system 100.
[0098] <4-2. Location estimation process> Fig. 22 is a flowchart showing an example of the flow of the position estimation process executed by the management server 200. It is assumed that some measurement result records are stored in the movement amount table 360 and some reading result records are stored in the tag detection table 370 at the time when the position estimation process of Fig. 22 is started.
[0099] First, in S21, the estimation unit 232 of the management server 200 focuses on one management target and acquires a read result record for the target tag 50 attached to that management target from the tag detection table 370. Next, in S22, the estimation unit 232 extracts read result records for one or more position tags 40 received from the same tag reader 110 as the acquired read result record from the tag detection table 370. Next, in S23, the estimation unit 232 selects one reference position tag based on the correlation between the read result record for the target tag 50 and the read result records for one or more position tags 40.
[0100] Next, in S24, the estimation unit 232 calculates the relative movement amount of the tag reader 110 between the read time (first read time) of the target tag 50 and the read time (second read time) of the reference position tag by referring to the measurement result record in the movement amount table 360. Next, in S25, the estimation unit 232 estimates the location of the managed object of interest based on the calculated relative movement amount of the tag reader 110 and the known position of the reference position tag. The estimation unit 232 can estimate the location of the managed object according to, for example, the above-mentioned formula (1).
[0101] Next, in S26, the estimation unit 232 derives the cumulative movement amount of the tag reader 110 between the first read time and the second read time. The estimation unit 232 may derive the cumulative movement amount, for example, according to the above-mentioned formula (2). Next, in S27, the estimation unit 232 derives an estimation error by multiplying the derived cumulative movement amount by a predetermined coefficient. Furthermore, in S28, the estimation unit 232 determines that the area associated with the reference position tag in the position tag table 330 is the location area of the managed object of interest.
[0102] Then, in S29, the estimation unit 232 adds a location information record indicating the target ID of the management target, the location coordinates of the estimated location, the estimation error, and the location area to the location information table 380 of the database 220.
[0103] The estimation unit 232 may repeat the above process by sequentially focusing on each of one or more managed objects that may have moved within a certain period of time. By periodically executing such a process, location information reflecting the latest state of each managed object may be maintained in the database 220.
[0104] <4-3. Display control processing> Fig. 23 is a flowchart showing an example of the flow of a display control process executed by cooperation between the user terminal 160 and the management server 200. Here, it is assumed that the information browsing screen 500 described using Figs. 15 to 20 is called up by the user and displayed by the display unit 171 under the control of the control unit 161 of the user terminal 160.
[0105] First, in S41, the display control unit 233 of the management server 200 accepts a user input specifying an area for which position information should be provided. For example, the user specifies a building and a floor via the UI of the information browsing screen 500.
[0106] Next, in S42, the display control unit 233 acquires from the database 220 map data that is registered in association with the specified area.
[0107] Next, in S43, the display control unit 233 displays on the screen location information for one or more managed objects estimated to be located in the specified area in a display mode selected by the user (for example, grid display or area display). The location information displayed here may be statistical information for each coordinate area or each area. The display control unit 233 also displays a list of the one or more managed objects on the screen.
[0108] Next, in S44, the display control unit 233 accepts a user input specifying the managed objects included in the displayed list. Here, it is assumed that one or more managed objects can be specified by the user.
[0109] Next, in S45, the display control unit 233 determines an estimated range for the specified managed object based on the estimation error of the location of the managed object. The estimated range is typically defined using the location of the managed object and a radius R determined according to the above-mentioned formula (4). However, if the estimated range crosses a boundary of an area, the estimated range may be trimmed at the boundary position.
[0110] Next, in S46, the display control unit 233 displays the display object indicating the estimated range determined in S45 on the screen in a form superimposed on the map image of the specified area. At this time, the display control unit 233 may variably determine the display mode of the display object based on the elapsed time from the time of reading the tag ID from the target tag to be managed.
[0111] The display control process shown in Fig. 23 may be actually performed interactively via a UI. When the user changes the designation of the area, location information of the managed object estimated to be located in the newly designated area is displayed on the screen. Also, when the user changes the designation of the managed object, a display object indicating the estimated range of the location of the newly designated managed object is displayed on the screen. Based on data continuously received from the tag reader 110, the latest location information of the managed object may be reflected on the screen in real time.
[0112] <5. Summary> Various embodiments, examples, and modifications of the technology according to the present disclosure have been described in detail above with reference to FIGS. 1 to 23. In the above-described embodiment, a first wireless device storing first identification information for identifying a managed object that can move in real space is attached to the managed object. A second wireless device storing unique second identification information is installed at a predetermined position in the real space. The reading device reads the first identification information from the first wireless device at a first read time, and reads the second identification information from the second wireless device at a second read time. Based on the results of these reads, an estimated range in which the managed object is estimated to be located in the real space is displayed by a display device. The size of the estimated range is determined based on the amount of movement of the reading device between the first read time and the second read time. Therefore, a user can efficiently perform tasks such as planning work, progress management, verifying the placement of the managed object, or investigating the history of movement of the managed object while checking the estimated range on the screen, which may change depending on the accuracy of position estimation.
[0113] In the above embodiment, the estimated range is determined based on the estimated location of the managed object and an estimated error that depends on the movement amount of the reading device. Therefore, when providing the user with location information of the managed object based on the measurement of the relative positional relationship between the first wireless device and the second wireless device, the extent to which the cumulative error of the measurement affects the location estimation can be clearly conveyed to the user through the size of the estimated range. In addition, by determining the estimated range further based on the reading range of the reading device, the size of the estimated range can also take into account the potential deviation of the estimated position that may be affected by the size of the reading range.
[0114] In the above embodiment, the estimation error can be derived by multiplying the cumulative movement amount of the reader by a predetermined coefficient. In this way, by treating a certain percentage of the cumulative movement amount as the estimation error, the position estimation error can be easily derived without using a complex algorithm.
[0115] In the above-described embodiment, the estimated range is displayed by superimposing a display object indicating the estimated range on a map image based on map data associated with the real space, so that the user can intuitively grasp that the managed object is likely to be located within the range indicated by the display object on the map.
[0116] In the above-described embodiment, the display mode of the display object indicating the estimated range may be determined based on the elapsed time from the first read time when the first identification information is read from the first wireless device. Here, the accumulated error of the PDR and the elapsed time from the read time are both factors that affect the reliability of the location estimation result. However, these two factors are usually not correlated with each other. Therefore, by expressing the influence of the accumulated error by the size of the estimated range and expressing the influence of the elapsed time by the display mode of the object (for example, the display color), the user can distinguish between the two factors and accurately evaluate the reliability of the location estimation result.
[0117] It should be noted that the reading of identification information from the wireless device described in this specification does not require communication with an external device such as a GPS satellite or a wireless base station, and therefore the above-described embodiment is particularly suitable for managing the location of a movable object or a user in an environment where external communication is difficult, such as indoors, underground, or in a tunnel.
[0118] <6. Other embodiments> The above-mentioned embodiment can also be realized in the form of a process in which a program for realizing one or more functions is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.
[0119] The disclosure of this specification includes at least the following display control system, information processing device, method, and computer program. (Item 1) a first wireless device that stores first identification information for identifying a managed object, the first identification information being attached to the managed object that is movable in a real space; a second wireless device that is installed at a predetermined position in the real space and that stores unique second identification information; a reader capable of reading identification information stored in a wireless device from the wireless device; an estimation unit that estimates a location of the managed object based on a result of reading the first identification information from the first wireless device at a first read time by the reader and a result of reading the second identification information from the second wireless device at a second read time by the reader; a display control unit that displays, on a display device, an estimated range in which the managed object is estimated to be located in the real space based on the location estimated by the estimation unit; and Including, the size of the estimated range is based on a movement amount of the reading device between the first reading time and the second reading time; Display control system. (Item 2) 2. The display control system according to item 1, wherein the estimated range is determined based on the location and an estimation error that depends on the amount of movement. (Item 3) 3. The display control system of item 2, wherein the estimated range is determined further based on a reading range of the reading device. (Item 4) The estimation error is derived by multiplying the amount of movement by a predetermined coefficient; The estimated range is defined with a radius centered on the location and dependent on the sum of the read range and the estimated error. Item 3. A display control system according to item 3. (Item 5) The display control system according to any one of items 1 to 4, wherein the display control unit causes the display device to display the estimated range by superimposing a display object indicating the estimated range on a map image based on map data associated with the real space. (Item 6) the map data includes data defining boundary positions of a plurality of areas set in the real space; The estimated range is determined based on the location, an estimation error depending on the movement amount, and the data. Item 5. A display control system according to item 5. (Item 7) 7. The display control system according to item 6, wherein the multiple areas are areas separated from each other by obstructions that block wireless signals. (Item 8) 8. The display control system according to any one of items 1 to 7, wherein the display control unit determines a display mode of a display object indicating the estimated range based on an elapsed time from the first read time. (Item 9) 9. The display control system of claim 8, wherein the display control unit determines the display color of the display object to be a first color when the elapsed time from the first read time is below a reference value, and determines the display color of the display object to be a second color different from the first color when the elapsed time from the first read time is above the reference value. (Item 10) A display control system according to any one of items 1 to 9, wherein the movement amount of the reading device between the first reading time and the second reading time is a cumulative movement amount along a movement path of the reading device. (Item 11) The reading device periodically measures the amount of movement of the reading device, The cumulative movement amount is derived by summing absolute values of movement amounts in a plurality of measurement periods between the first reading time and the second reading time. Item 11. The display control system according to item 10. (Item 12) 12. The display control system according to any one of items 1 to 11, wherein the managed objects are objects located in the real space or users who are active in the real space. (Item 13) The estimation unit estimates locations of a plurality of managed objects that are movable in the real space; The display control unit is displaying a list of the plurality of managed objects on the display device; when a first managed object is designated by a user from among the plurality of managed objects, a first estimated range in which the first managed object is estimated to be located in the real space is displayed on the display device; A display control system according to any one of items 1 to 12. (Item 14) The real space is regularly divided into a plurality of coordinate regions; the list of the plurality of managed objects is a list of managed objects that are estimated by the estimation unit to be located in a coordinate area designated by the user among the plurality of coordinate areas. Item 14. The display control system according to item 13. (Item 15) An information processing device for displaying position information of a managed object that can be moved in real space on a display device, A first wireless device storing first identification information for identifying the management target is assigned to the management target; a second wireless device storing unique second identification information is installed at a predetermined position in the real space; The information processing device includes: a communication unit that communicates with a reader capable of reading identification information stored in the wireless device from the wireless device; an estimation unit that estimates a location of the managed object based on a result of reading the first identification information from the first wireless device at a first read time by the reader and a result of reading the second identification information from the second wireless device at a second read time by the reader; a display control unit that causes the display device to display an estimated range in which the managed object is estimated to be located in the real space based on the estimated location; and Equipped with the size of the estimated range is based on a movement amount of the reading device between the first reading time and the second reading time; Information processing device. (Item 16) A method for displaying position information of a managed object that can be moved in real space on a display device, comprising: A first wireless device storing first identification information for identifying the management target is assigned to the management target; a second wireless device storing unique second identification information is installed at a predetermined position in the real space; The method comprises: acquiring location information indicating an estimated location of the managed object based on a result of reading the first identification information from the first wireless device at a first read time by a reading device and a result of reading the second identification information from the second wireless device at a second read time by the reading device; displaying, on the display device, an estimated range in which the managed object is estimated to be located in the real space based on the acquired position information; Including, the size of the estimated range is based on a movement amount of the reading device between the first reading time and the second reading time; method. (Item 17) A computer program that, when executed by a processor of an information processing device, causes the processor to execute an operation for displaying, on a display device, position information of a managed object that is movable in real space, the computer program comprising: A first wireless device storing first identification information for identifying the management target is assigned to the management target; a second wireless device storing unique second identification information is installed at a predetermined position in the real space; The operation includes: acquiring location information indicating an estimated location of the managed object based on a result of reading the first identification information from the first wireless device at a first read time by a reading device and a result of reading the second identification information from the second wireless device at a second read time by the reading device; displaying, on the display device, an estimated range in which the managed object is estimated to be located in the real space based on the acquired position information; Including, the size of the estimated range is based on a movement amount of the reading device between the first reading time and the second reading time; Computer program.
[0120] The invention is not limited to the above-described embodiments, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]
[0121] 1: display control system, 5: network, 10 (10a, 10b, ...): area, 20 (20a): user, 30 (30a, 30b, ...): item, 40 (40a, 40b, ...): position tag (second wireless device), 50 (50a, 50b, ...): target tag (first wireless device), 100: mobile system, 110: tag reader (reading device), 160: user terminal (information processing device / display device) location), 200: management server (information processing device), 210: communication unit, 220: database, 231: data management unit, 232: estimation unit, 233: display control unit, 402, 412: movement route, 404, 414: location, 405, 415: estimation range, 500: information viewing screen, 542, 542a, 542b, 542c, 542d, 552: sign (display object), T1: first reading time, T2: second reading time
Claims
1. a first wireless device that stores first identification information for identifying a managed object, the first identification information being attached to the managed object that is movable in a real space; a second wireless device that is installed at a predetermined position in the real space and that stores unique second identification information; a reader capable of reading identification information stored in a wireless device from the wireless device; an estimation unit that estimates a location of the managed object based on a result of reading the first identification information from the first wireless device at a first read time by the reader and a result of reading the second identification information from the second wireless device at a second read time by the reader; a display control unit that displays, on a display device, an estimated range in which the managed object is estimated to be located in the real space based on the location estimated by the estimation unit; and Including, the size of the estimated range is based on a movement amount of the reading device between the first reading time and the second reading time; Display control system.
2. The display control system according to claim 1 , wherein the estimated range is determined based on the location and an estimation error that depends on the amount of movement.
3. The display control system according to claim 2 , wherein the estimated range is determined further based on a reading range of the reading device.
4. The estimation error is derived by multiplying the amount of movement by a predetermined coefficient; The estimated range is defined using a radius centered on the location and dependent on the sum of the read range and the estimated error. The display control system according to claim 3 .
5. The display control system according to claim 1 , wherein the display control unit causes the display device to display the estimated range by superimposing a display object indicating the estimated range on a map image based on map data associated with the real space.
6. the map data includes data defining boundary positions of a plurality of areas set in the real space; The estimated range is determined based on the location, an estimation error depending on the movement amount, and the data. The display control system according to claim 5 .
7. The display control system according to claim 6 , wherein the plurality of zones are zones separated from each other by a shield that blocks wireless signals.
8. The display control system according to claim 1 , wherein the display control unit determines a display mode of the display object indicating the estimated range based on an elapsed time from the first read time.
9. 9. The display control system according to claim 8, wherein the display control unit determines the display color of the display object to be a first color when the elapsed time from the first read time is below a reference value, and determines the display color of the display object to be a second color different from the first color when the elapsed time from the first read time is above the reference value.
10. The display control system according to claim 1 , wherein the movement amount of the reading device between the first reading time and the second reading time is a cumulative movement amount along a movement path of the reading device.
11. The reading device periodically measures the amount of movement of the reading device, the cumulative movement amount is derived by summing absolute values of movement amounts in a plurality of measurement periods between the first reading time and the second reading time; The display control system according to claim 10.
12. The display control system according to claim 1 , wherein the managed objects are objects located in the real space or users who are active in the real space.
13. The estimation unit estimates locations of a plurality of managed objects that are movable in the real space; The display control unit is displaying a list of the plurality of managed objects on the display device; when a first managed object is designated by a user from among the plurality of managed objects, a first estimated range in which the first managed object is estimated to be located in the real space is displayed on the display device; The display control system according to claim 1 .
14. The real space is regularly divided into a plurality of coordinate regions; the list of the plurality of managed objects is a list of managed objects that are estimated by the estimation unit to be located in a coordinate area designated by the user among the plurality of coordinate areas. The display control system according to claim 13.
15. An information processing device for displaying position information of a managed object that can be moved in real space on a display device, a first wireless device storing first identification information for identifying the management target is assigned to the management target; a second wireless device storing unique second identification information is installed at a predetermined position in the real space; The information processing device includes: a communication unit that communicates with a reader capable of reading identification information stored in the wireless device from the wireless device; an estimation unit that estimates a location of the managed object based on a result of reading the first identification information from the first wireless device at a first read time by the reader and a result of reading the second identification information from the second wireless device at a second read time by the reader; a display control unit that causes the display device to display an estimated range in which the managed object is estimated to be located in the real space based on the estimated location; and Equipped with the size of the estimated range is based on a movement amount of the reading device between the first reading time and the second reading time; Information processing device.
16. A method for displaying position information of a managed object that can be moved in real space on a display device, comprising: a first wireless device storing first identification information for identifying the management target is assigned to the management target; a second wireless device storing unique second identification information is installed at a predetermined position in the real space; The method comprises: acquiring location information indicating an estimated location of the managed object based on a result of reading the first identification information from the first wireless device at a first read time by a reading device and a result of reading the second identification information from the second wireless device at a second read time by the reading device; displaying, on the display device, an estimated range in which the managed object is estimated to be located in the real space based on the acquired position information; Including, the size of the estimated range is based on a movement amount of the reading device between the first reading time and the second reading time; method.
17. A computer program that, when executed by a processor of an information processing device, causes the processor to execute an operation for displaying, on a display device, position information of a managed object that is movable in real space, the computer program comprising: a first wireless device storing first identification information for identifying the management target is assigned to the management target; a second wireless device storing unique second identification information is installed at a predetermined position in the real space; The operation includes: acquiring location information indicating an estimated location of the managed object based on a result of reading the first identification information from the first wireless device at a first read time by a reading device and a result of reading the second identification information from the second wireless device at a second read time by the reading device; displaying, on the display device, an estimated range in which the managed object is estimated to be located in the real space based on the acquired position information; Including, the size of the estimated range is based on a movement amount of the reading device between the first reading time and the second reading time; Computer program.
Citation Information
Patent Citations
Information processor
JP2004294403A
Building performance management method and performance management system
JP2020129312A
Communication apparatus, information processing apparatus, and location information management method
JP2021141415A
