ADDITIONAL MODULE FOR A DEVICE, SERVER SETUP, LOCALIZATION PROCEDURE, COMPUTER PROGRAM AND CORRESPONDING STORAGE MEDIUM
Patent Information
- Application Number
- DE502019013495
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2019-05-06
- Publication Date
- 2025-07-17
- Estimated Expiration
- 2039-05-06
AI Technical Summary
Conventional localization methods, such as satellite-based systems and active RFID, are unreliable indoors and require uniform infrastructure, potentially disrupting sensitive devices and systems, and cannot be used in emission-sensitive areas.
An add-on module that passively measures local electromagnetic field distributions using a sensor system, determines position by comparing with a predetermined map, and transmits data to a server for tracking, without requiring direct communication with field-generating infrastructure.
Enables reliable, low-effort, cost-effective, and energy-efficient localization indoors and in emission-sensitive areas, avoiding signal interference and infrastructure adaptation, with improved accuracy through temporal field distribution measurements.
Description
[0001] The present invention relates to an additional module for a device, in particular a mobile device, a server device for communicating with the additional module or with the mobile device, a corresponding localization method for localizing the additional module or the mobile device, a corresponding computer program or computer program product that implements the localization method, and a corresponding computer-readable storage medium.
[0002] Localization, i.e., the location or positioning of devices, materials, and people, is a useful functionality in a wide variety of application areas. Various methods have been used to date. Examples include satellite-based positioning systems (GPS, GLONASS, etc.), active positioning using radar, or communication between a positioning system and a device to be located, for example, by reading RFID tags of passing devices at a checkpoint. However, these solutions can have the disadvantage that they do not function reliably depending on local signal reception conditions, for example, within buildings, and / or require a uniform electronic infrastructure on the part of the positioning system and all devices to be located, i.e., the use of predetermined communication standards, frequencies, and protocols.This can limit the flexibility of the respective solution. Another disadvantage of conventional solutions is that the signals used could impair or disrupt sensitive devices or systems, or that the localization methods cannot be applied in emission-sensitive areas.
[0003] Document DE 10 2005 007 309 A1 describes a mobile device for determining location, which records environmental data prevailing at that location to determine its current location and transmits it to a database. A search is then carried out in the database, during which associated location information is determined depending on the environmental data. This location information is then transmitted from the database to the mobile device. The environmental data can include electromagnetic waves generated by terrestrial sources in various frequency ranges. For example, the environmental data can include radio signals or WLAN signals. The possibility is mentioned of providing transmitters by laying a high-frequency line within a building, which has a stub line or the like in various rooms for the local coupling of a signal for the mobile device.
[0004] Document DE 10 2013 013156A1 describes a method for pedestrian navigation in a building using a mobile communications device and a plurality of transmitters arranged in the building. For this purpose, an application is loaded into the electronic device, wherein the floor plan of the building, the locations of the individual transmitters designated by coordinates and the identifiers of the individual transmitters are stored in a database of the application. The communications device searches for existing transmitters, the identifiers and signal strengths of the receivable transmitters are recorded, communication with the receivable transmitters is terminated and the current position of the communications device is determined by comparing the identifiers of the detected transmitters with the coordinates of the transmitters stored in the database. The current position is specified by evaluating the signal strengths of the detected transmitters.
[0005] Document DE 10 2015 117 280 A1 relates to a locating device for locating a mobile object. A detection device is provided for detecting free electromagnetic field strengths, and an evaluation module determines location data for the mobile object based on the detected free electromagnetic field strengths. The evaluation of free field strengths explicitly eliminates the use of dedicated reference sources. The free electromagnetic field strengths are those generated by natural electromagnetic fields, for example, those caused by the sun, or artificial electromagnetic fields, for example, by power lines, substations, satellites, and so on.
[0006] Document US 2011 / 0117924 A1 describes a positioning method in which a mobile station determines a signal strength indicator (RSSI) and / or performs a signal propagation time measurement. Based on a comparison with characteristics stored in a database, a satellite-based positioning system based on dead reckoning is improved.
[0007] The publication "CNN-based Indoor Localization using RSS Time-Series," by M. Ibrahim et al., 2018 IEEE Symposium on Computers and Communications (ISCC), June 25, 2018, pages 1044-1049, describes an indoor localization method in which time series of Wi-Fi signal strengths (RSS) are recorded and provided as input data to a trained artificial neural network. The network predicts the position of a mobile node based on the time series of signal strengths. The RSS values are transmitted to a server for prediction by the neural network.
[0008] The object of the present invention is to enable the localization of devices in buildings and sensitive areas. This object is achieved according to the invention by the subject matter of the independent patent claims. Advantageous embodiments and further developments of the present invention are specified in the dependent patent claims, in the description, and in the figures.
[0009] An add-on module according to the invention is designed to be integrated into an existing, particularly mobile, device in order to equip this device with a localization functionality. The add-on module thus enables – possibly in conjunction with the respective device – a location determination of the add-on module or the device equipped with the add-on module.
[0010] Integration in this sense can mean or include connecting the add-on module to the mobile device via a connector, an interface, an electrical connection, or a data connection. The add-on module can then exchange data or signals with the respective device or access the device's resources via the connection interface. Likewise, the add-on module can be designed as a standalone unit, in which case integrating the add-on module into the respective device can then, for example, simply mean mechanically connecting the add-on module to the mobile device.
[0011] The device within the meaning of the present invention can therefore be an electrical or electronic device that has its own electrical and / or electronic devices. However, the device within the meaning of the present invention can also be a non-electronic device, a tool, a transport item, a component, a transport trolley, a patient bed, a piece of clothing—particularly one worn by a person—and / or the like.
[0012] The additional module according to the invention comprises a measuring device and a localization device. The measuring device is configured to passively measure, by means of a sensor system, a local electromagnetic field distribution caused by a respective surrounding infrastructure without exchanging data with this infrastructure. Measuring the field distribution can, for example, mean or include measuring or determining a local field strength, a field gradient, an energy and / or frequency spectrum of local electromagnetic fields or radiation, their polarization, and / or the like. The localization device is configured to automatically determine a current spatial position of the additional module by comparing the measured field distribution with a predetermined map that specifies a spatially resolved reference field distribution and positions of the field-causing infrastructure.
[0013] Furthermore, the localization device can be configured to transmit the measured field distribution and / or the determined position via a wireless data connection to an external server device, such as a server, a cloud server, a data center, or the like, to enable tracking of the add-on module or the respective device equipped therewith. In the former case, the server device can then evaluate the measured field distribution to localize the add-on module or the respective mobile device, for example, by comparing the measured field distribution with the specified map.
[0014] The predefined map is designed as a building plan, in which the positions of the field-generating infrastructure are entered. Additionally, the reference field distribution is entered, for example, as a heat map or corresponding to a topological map. Lines or uniformly marked areas can indicate identical field distributions or identical values of field distribution parameters.
[0015] The reference field distribution can be determined, for example, through a preparatory measurement and then specified, i.e., provided, for example, to a manufacturer of the add-on module or an operator of the server device. Particularly advantageously, the reference field distribution can be loaded onto the add-on module by a respective user or operator of the add-on module. This allows the add-on module according to the invention to be adapted particularly easily and flexibly to different areas of application, for example, different building complexes and / or to changes in the respective field-generating infrastructure. The field-generating infrastructure can, in particular, comprise stationary devices or devices that emit electromagnetic fields or radiation.These can be, for example, routers, repeaters or access points (access points) of a WLAN network infrastructure, electronic devices equipped with radio devices, such as, in particular, fixed-installation televisions, vending machines, coffee machines, smoke detectors, production machines, manufacturing equipment, control or monitoring systems, medical devices and / or the like.
[0016] Such devices and equipment, i.e., the field-generating infrastructure, cause an individual electromagnetic field distribution depending on the relative positions and the types or types of the devices and equipment that make up the field-generating infrastructure. The present invention therefore proposes, in particular, passive location determination on the part of the device to be located based on the measured field distribution. This means that the device to be located does not necessarily have to actively transmit or communicate with an external positioning device. This offers the advantage that no communication, i.e., no signal or data transmission, is required between the field-generating infrastructure and the respective additional module or device to be located, and likewise, no dedicated infrastructure for determining the device's position needs to be installed.The additional module or the respective mobile device therefore does not have to be adapted or coordinated with the respective field-generating infrastructure or registered with the infrastructure.
[0017] Furthermore, localization or tracking can also be used in emission-sensitive areas, i.e., areas sensitive to signals or radio waves, since the add-on module or the respective mobile device itself does not need to emit any radio signals, radiation, or the like for localization. Such sensitive areas could include, for example, an intensive care unit or radiology department in a hospital, where current regulations often require mobile electronic devices to be switched to a passive operating mode (airplane mode) or switched off.
[0018] However, since active field emissions—namely, the electromagnetic field distribution emitted or generated by the existing field-causing infrastructure—are used for localization, the present invention can utilize the advantages of both active and passive location determination while simultaneously avoiding their respective disadvantages. For example, in contrast to conventional approaches, the present invention typically does not require a direct line of sight between the infrastructure and the additional module or the respective mobile device, or between the latter and a position marker or a camera intended for optical tracking, or the like.
[0019] Since the field distribution is generated by a regular operation of the infrastructure independent of the localization functionality and this infrastructure does not have to be specifically provided or constructed for the localization functionality, the present invention advantageously enables localization in a particularly low-effort, cost-effective and energy-efficient manner.
[0020] Since the field-generating infrastructure is typically located within a building, such as the aforementioned hospital, an office or factory building, or the like, the field distribution is generated directly within this building and thus not shielded by the building. Thus, the present invention advantageously enables reliable and energy-efficient localization even within buildings, since, for example, no signals originating from outside the respective building need to be received or measured. This makes the present invention particularly suitable for indoor positioning.
[0021] Particularly preferably, the respective local field distribution can be measured multiple times in succession, or a temporal progression of the field distribution can be measured. This can advantageously make it possible to detect and eliminate, i.e., calculate out, temporally variable interference influences, for example, moving field sources such as mobile devices of other people in the vicinity, and their influence on the measured field distribution. This can improve the accuracy and reliability of the reference field distribution and ultimately the localization of the add-on module or the respective device equipped with the add-on module.
[0022] Once the respective position of the additional module or the respective device equipped with it has been determined, this position can be provided by the additional module or the device and / or by the server device. This means that the current position of the additional module or the device can be queried or retrieved at any time, which can result in a variety of advantages depending on the respective area of application. For example, waiting times or delays can be avoided which could previously occur when a certain component, tool or device is needed for a next work step but first has to be searched for. Particularly in the medical environment, especially in hospitals, such delays can have life-threatening consequences which can be avoided or reduced by the present invention.
[0023] In an advantageous embodiment of the present invention, the add-on module according to the invention is implemented in hardware and has a connection interface by means of which the add-on module can be physically connected to the respective device via a corresponding device-side interface. The add-on module can be configured to obtain electrical energy for its operation from the respective device via the connection interface, to communicate with the respective device, and / or to access facilities, components, or resources of the respective device. For example, the sensor system can be part of the add-on module or part of the respective device and, in the latter case, can then be controlled or read by the add-on module.The fact that the additional module can be connected to the respective device via the connection interface according to the invention can result in a number of different advantages depending on the design of the connection interface or the respective device. For example, the additional module can be particularly simple and compact in design, as it does not necessarily have to have its own power supply and / or can use or utilize computing resources, sensors, and / or a communication device of the respective device.
[0024] Since the connection interface can be standardized, the add-on module can be easily mass-produced and used with a wide range of devices. This makes it particularly easy to retrofit existing mobile devices with the add-on module. The connection interface can be configured as a USB, Thunderbolt, or HDMI port, as part of an RJ-45 connector, as a serial interface, or similar.
[0025] It is unaffected that the additional module can additionally or alternatively be designed to be self-sufficient, i.e. it can itself comprise or have all the components or devices necessary for the localization functionality. The additional module can therefore, for example, have its own power supply, its own sensors for measuring the field distribution, its own communication device for sending data to the server device, its own control unit with a processor and a data memory as well as an operating program and / or the like. This can advantageously enable the additional module to be used particularly flexibly even if the respective mobile device does not have a suitable device-side interface. In this case, the connection interface of the additional module can even be dispensed with, which means that it can advantageously be designed particularly simply, for example, to be water- and / or dust-tight.
[0026] However, the additional module can be particularly advantageously configured to prioritize the use of resources of the device that are available or accessible via the connection interface over the use of any existing facilities or resources of the additional module, in particular if the resources on the device side, i.e. those accessible via the connection interface, are more powerful than the resources or facilities of the additional module.
[0027] In an advantageous alternative embodiment of the present invention, the additional module according to the invention is embodied in software, i.e., implemented, for example, as a computer program or computer program product. The measuring device and the localization device are then functional blocks of the software, i.e., software modules, software components, subprograms or subroutines, or the like. The additional module is then configured to send corresponding control instructions to the respective device for measuring the field distribution and for determining and transmitting the position or for transmitting the measured field distribution, which control instructions accomplish this using the device's facilities or resources.
[0028] In other words, the add-on module according to the invention can be loaded as additional software onto a data storage device of the respective device that is to be equipped with the localization functionality in the form of the add-on module. The add-on module then fully utilizes the existing hardware of the respective device. The solution proposed here advantageously enables a particularly cost-effective and low-effort use of the add-on module according to the invention, since, for example, a large number of corresponding add-on modules can be loaded onto a large number of devices simultaneously in an automated manner.
[0029] Furthermore, the implementation of the add-on module according to the invention in software enables particularly simple and flexible adaptability of the add-on module. The add-on module can therefore be updated and further improved particularly easily, even after it has already been deployed or used. A further advantage of implementing the add-on module in software is that, if necessary, an existing data memory of the respective device can be used to store the add-on module, thus advantageously requiring no additional space in the device for the add-on module.
[0030] A combination is also possible in which the additional module according to the invention is implemented partly in hardware and partly in software.
[0031] In a further advantageous embodiment of the present invention, the additional module is configured to automatically initiate the transmission of at least one ping or ping signal by the additional module or the respective mobile device into its surroundings to support localization, and to detect response signals or echoes received by the additional module or the respective device from, in particular, stationary, components or devices of the field-generating infrastructure. Furthermore, the additional module is then configured to automatically perform a runtime analysis based on the response signals and / or their detection times and to determine the position of the additional module based on a result of the runtime analysis and the specified map. Additionally or alternatively, the additional module is configured to send the response signals, their detection times, and / or the result of the runtime analysis to the server device.Runtime analysis, i.e., determining the time between sending the ping signal and receiving the corresponding response signals, can determine the distance between the add-on module or the respective mobile device and the infrastructure components or devices that are sending or have sent the response signals. Additionally or alternatively, the response signals can identify the respective transmitting infrastructure component.
[0032] In other words, although a signal exchange is provided between the additional module or device on the one hand and the infrastructure on the other, this signal exchange is minimal in terms of data transmission and its requirements for the infrastructure, the communication protocols or methods used, and the like.
[0033] The ping method provided here can fundamentally be executed by a large number of devices and the software running on them, meaning that the ping signal can be interpreted by these devices without any special measures being required. Thus, the prerequisites for using the additional module according to the invention in the embodiment proposed here are still limited so that it can be flexibly applied in a large number of different environments in which different devices, software, and communication methods are used, in order to support localization, for example to improve its accuracy or reliability. A second localization method is particularly advantageous here, through which the accuracy of the position determination can be improved and / or the localization based on the measured field distribution can be verified or checked for plausibility.
[0034] In a further advantageous embodiment of the present invention, the additional module is configured to additionally evaluate a signal from a satellite-based positioning system (GPS, GlONASS, Galileo, etc.) to determine the position and / or to transmit it to the server device. In other words, the additional module can have a receiver for signals from the satellite-based positioning system or read out or query data from such a receiver of the respective mobile device. As described above, the accuracy of a position determination based on a satellite-based positioning system can be reduced, particularly inside buildings. However, the present embodiment of the present invention is based on the recognition that an advantage can still be gained by additionally using the signal from the satellite-based positioning system.For example, based on the satellite signal, such as a GPS, GLONASS, or Galileo signal, or a history of such signals, the respective building or a particular building wing in which the additional module or the respective device is currently located can be identified. For more precise localization, the measured local electromagnetic field distribution can then be evaluated as described. By taking the satellite signal into account, improved reliability or plausibility of the position or location determination can be achieved. This is because, for example, if the local values of the reference field distribution are the same at different locations in different building wings or different buildings, the actual position of the additional module or the respective device can be narrowed down based on the satellite signal.
[0035] In a further advantageous embodiment of the present invention, the add-on module is configured to determine, based on the measured field distribution and / or its specific position, whether it is located in an emission-sensitive area and, if and as long as this is the case, to prevent or delay the transmission of signals by the add-on module and / or the respective device equipped with the add-on module. For example, the transmission of the above-mentioned data to the server device or the described transmission of the ping signal can be postponed until it is detected, based on the measured field distribution and / or the specific position, that the add-on module is no longer located in the or an emission-sensitive area.
[0036] As already described, such emission-sensitive areas can be, for example, an intensive care unit or a radiology department in a hospital, etc. Delaying or postponing the transmission of signals can also be advantageous in industrial environments or, for example, in the vicinity of measuring equipment, radio telescopes, and / or the like.
[0037] Corresponding emission-sensitive areas can, for example, be specified or stored on the specified map or in a separate table or database. Additionally or alternatively, an emission-sensitive area can, if necessary, be identified by the add-on module itself, for example based on the measured field distribution. For this purpose, corresponding predefined parameter values for the field distribution can be stored, for example in a data memory of the add-on module, which indicate an emission-sensitive area or are to be interpreted accordingly. An example of such a parameter value or a corresponding field distribution in an emission-sensitive area can, for example, be a threshold value for a magnetic field strength. A magnetic field strength above such a predefined threshold value can, for example, be present in the environment of a magnetic resonance imaging scanner.
[0038] A further aspect of the present invention is a server device with a communication module and a data memory, as well as a processor connected to these, i.e. to the communication module and the data memory. The server device according to the invention is configured to receive, by means of the communication module, measurement data from devices, in particular mobile devices, each of which indicates a locally measured electromagnetic field distribution, to automatically compare this measurement data with a predetermined map stored in the data memory, and thereby to determine the respective position at which the respective device measured the respective received field distribution. As already described in connection with the additional module according to the invention, the predetermined map indicates a spatially resolved reference field distribution and / or positions of a field-causing, in particular stationary, infrastructure.The server device is further configured to store or update the specific position assigned to the respective device in a corresponding position database stored or filed in the data memory. The server device according to the invention can therefore, in particular, be the server device mentioned in connection with the additional module according to the invention and accordingly have the properties or features mentioned or described there. The server device according to the invention can therefore, for example, be a server, a cloud server, a data center, or the like, and optionally have or include further components or parts, for example, further interfaces, data lines, a power supply, and / or the like.The server device according to the invention can provide the position database, for example, to external devices or for corresponding requests, so that the positions of all devices entered in the position database can be provided by the server device according to the invention or can be queried by the server device according to the invention.
[0039] A further aspect of the present invention is a system comprising the server device according to the invention and at least one additional module according to the invention, preferably a plurality of additional modules according to the invention. The server device and the additional modules can preferably be coordinated with one another on the software side, for example, configured to communicate with one another via a predefined communication protocol.
[0040] A further aspect of the present invention is a method for locating at least one device equipped with an additional module according to the invention. One method step of the method according to the invention comprises mapping an electromagnetic reference field distribution and / or a field-emitting or field-generating stationary infrastructure in a surveillance area in which the at least one mobile device is to be located. For this purpose, for example, corresponding field values of the electromagnetic field distribution for the reference field distribution can be measured with spatial resolution, whereby respective positions at which the field values are measured are recorded and assigned to the field values measured there.
[0041] Likewise, for example, a computer-aided simulation of a field propagation or field distribution can be carried out based on the positions of the infrastructure in order to determine the reference field distribution as the expected field distribution in the monitoring area.
[0042] A further method step of the method according to the invention comprises measuring a local field distribution using the device to be located while or when the device is located in the surveillance area. A further method step of the method according to the invention comprises automatically locating the mobile device by comparing the measured local field distribution with the map, i.e., the reference field distribution and / or the positions of the infrastructure, by the respective mobile device itself and / or by the server device according to the invention, to which the measured field distribution was possibly transmitted by the device.
[0043] In other words, the method according to the invention can be a method for operating the system according to the invention, the server device according to the invention and / or the additional module according to the invention.
[0044] The method according to the invention can accordingly comprise further measures, processes or procedures which are described in connection with the other aspects of the present invention as - optionally optional - further method steps.
[0045] In an advantageous embodiment of the method according to the invention, the reference field distribution map is generated by simulating it using a predefined field propagation model. For this purpose, the positions, device types, and operating profiles of field-emitting components or devices of the stationary infrastructure are provided to the field propagation model as input data. The field propagation model can therefore be a mathematical-physical model that simulates the propagation of electromagnetic waves, fields, or radiation in a spatial area and / or an expected resulting overall field distribution—namely, the reference field distribution—that results or is established by the interaction or superposition of the components of the infrastructure or the individual fields emitted by them.In particular, a shape or architecture of the monitoring area, for example, in the form of a building plan or the like, can also be provided to the field propagation model as part of the input data. The operating profiles of the field-emitting components can, for example, indicate their operating status, operating times, or a power, particularly time-dependent, at which the individual components or devices are operated. This can advantageously contribute to a particularly accurate and reliable simulation of the reference field distribution.
[0046] In a further advantageous embodiment of the present invention, a respective field strength is measured for the reference field distribution and the local field distribution in a frequency-resolved manner for several frequency ranges specified for different communication methods. In other words, for example, it is measured which individual field strengths are present in different frequency ranges or frequency bands and contribute to the respective overall field distribution. For example, it is possible to measure which respective field strengths or field distribution components are generated by mobile communications, WLAN signals, low-energy communication, Bluetooth, infrared, radio communication, and / or the like.This can advantageously contribute to improved localization accuracy, since, for example, different areas or positions in which the same field strength is present, nominally or in integrated terms, can be differentiated from one another on the basis of differences in the respective division or distribution of the field strength or a corresponding field energy across different frequency ranges.
[0047] In a further advantageous embodiment of the present invention, to generate the reference field distribution map, a temporal profile of the electromagnetic field distribution in the monitored area is measured over at least a predetermined period of time, preferably over at least one day or at least one week. The field distribution can be measured continuously, or a plurality of individual measurement points can be recorded consecutively during the predetermined period. The predetermined period can depend on the monitored area or on an activity that regularly occurs in the monitored area.
[0048] For example, if an activity or operation in the monitored area, particularly the infrastructure of the monitored area, follows a regular or periodic pattern, the specified period can preferably correspond to at least a corresponding period duration. For example, in many companies and facilities, a day is considered such a period, since operations and thus possibly also the field distribution change throughout the day, but this change is repeated at least essentially every day.
[0049] By measuring the temporal progression of the field distribution and generating a map of the reference field distribution based on this temporal progression, temporal, particularly periodic, changes in the field distribution in the monitoring area can be captured and taken into account when locating the respective mobile device. In particular, this can lead to improved accuracy and reliability in localization.
[0050] The entire time course can be entered on the map. Likewise, for example, individual values selected or calculated from the time course for different times or time intervals of the specified period can be entered on the map. For example, maximum and minimum values, average values for different parts or intervals of the specified period and / or similar things can be entered on the map. For this purpose, for example, the specified period can be divided into several intervals of specified time length. For example, a day can be divided into working time and non-working time or, for example, into intervals of one hour, two hours, three hours or the like, or a specified period of one week can be divided into intervals of 12 hours or 24 hours.In this way, the data volume of the map can be advantageously reduced, but the temporal progression of the field distribution can still be taken into account.
[0051] In an advantageous development of the present invention, the measured temporal profile is provided as input, i.e., as input data, to a predefined machine learning component, in particular a deep-learning-based artificial neural network. This machine learning component is trained to optimize the reference field distribution by reducing noise in the temporal profile caused by temporally variable signal or field sources that are not part of the stationary infrastructure. This can advantageously reduce the accuracy and reliability of locating the device, as well as, if necessary, the complexity of locating, for example, the comparison of the measured field distribution with the reference field distribution.
[0052] For example, training data for the machine learning component can be a field distribution unaffected by external sources, as well as various measured temporal profiles of field distributions measured under the influence of one or more sources, preferably moving through the monitoring area in different ways. The trained machine learning component can then deliver a cleaned or optimized reference field distribution as output, i.e., as output data, based on the respective input.
[0053] A further aspect of the present invention is a computer program or computer program product comprising instructions which, when the computer program is executed by the server device according to the invention, on the one hand, and the additional module according to the invention or the respective device equipped therewith, on the other hand, effect implementation of the method according to the invention. In other words, the computer program according to the invention can therefore be executed by the system according to the invention in order to effect implementation of the method according to the invention and
[0054] A further aspect of the present invention is a computer-readable storage medium, i.e. a computer-readable data carrier on which the computer program or computer program product according to the invention is stored.
[0055] To execute the computer program according to the invention, i.e., a corresponding program code, the system according to the invention, the server device according to the invention, and / or the additional module according to the invention can each have a corresponding processor and a respective corresponding computer-readable storage medium connected to the respective processor. The processor can be, for example, a microchip or microprocessor, an integrated circuit or hardware circuit, or part of a controller or the like.
[0056] The properties and developments of the additional module according to the invention, the server device according to the invention, the method according to the invention, the computer program according to the invention, and the computer-readable storage medium according to the invention, as well as the corresponding advantages, described above and below, are mutually transferable between these aspects of the invention. Thus, the invention also includes those developments of the aspects of the present invention that have configurations that, to avoid unnecessary redundancy, are not explicitly described here in the respective combination or not separately for each aspect of the invention.
[0057] Further features, details, and advantages of the present invention will become apparent from the following description of preferred embodiments and from the drawings. FIG 1 shows a schematic overview of a system comprising a mobile device and an external server, wherein the mobile device has an additional module for localization; FIG 2 shows a schematic plan view of a section of an interior area of a building in which the device from FIG 1 by means of its additional module; and FIG 3 shows an exemplary schematic flow chart for a method for operating the system from FIG 1 to locate the mobile device.
[0058] The exemplary embodiments explained below are preferred embodiments of the invention. In the exemplary embodiments, the described components of the embodiments each represent individual, independently considered features of the invention, which also further develop the invention independently of one another and are thus also to be considered as components of the invention, either individually or in a combination other than that shown. Furthermore, the described embodiments can also be supplemented by further features of the invention already described.
[0059] In the figures, identical, similar, functionally identical or corresponding elements are each identified by the same reference numerals.
[0060] FIG 1 shows a schematic overview of a system comprising a mobile device 1, which in this case is equipped with an additional module 2 for providing a localization functionality for the mobile device 1, and an external server 3.
[0061] Locating or tracking, and if necessary, tracking devices, goods, facilities and / or persons, especially if they are mobile and therefore may be located at positions that are not known a priori at any given time, has so far required a problematically high use of resources and time, especially indoors or in closed environments, and may, for example, require a dedicated infrastructure of active devices that communicate only using a given communication method and a given communication protocol.
[0062] These problems and challenges are addressed in this application. To this end, the device 1 comprises a device processor 4 and a memory module 5, i.e., a data processing device, as well as a communications module 6 and a GPS module 7. These modules or devices are connected to each other and to a module interface 8 of the device 1, to which the additional module 2 is connected in this application.
[0063] The additional module 2 accordingly has a connection interface 9 for connecting the additional module 2 to the device 1. Furthermore, the additional module 2 in this case has a processor 10 and a data memory 11 connected thereto. Also connected to the processor 10 are further devices of the additional module 2, in this case comprising a measuring device 12, a localization device 13, a communication device 14, and a GPS receiver 15.
[0064] At least some modules, devices, or components are thus present redundantly in both device 1 and additional module 2. This represents a possible implementation, but at least some redundancies can be eliminated for an alternative, particularly cost-saving design on the additional module 2 and / or on the device 1 side.
[0065] In this case, the server 3 is an external device, so that communication between the device 1 or the additional module 2 on the one hand and the server 3 on the other hand takes place via a wireless data connection. For this purpose, the server 3 in this case has a server communication interface 16 and, connected thereto, a server processor 17 and a memory device 18. In this case, a device database 19 and a position database 20 are stored in the memory device 18. A plurality of electronic devices, such as the device 1 and / or the additional module 2, are registered or identified in the device database 19. In the position database 20, specific positions of the devices or devices identified in the device database 19 are stored, if known.
[0066] With the FIG 1 The system shown schematically makes it possible to locate device 1 even indoors or in buildings. FIG 2 As an example of such an environment, the figure shows a schematic plan view of a section of an interior area of a building in which the device 1 is to be located. Since the position of the device 1 is to be determined or monitored in the interior area or building shown, the interior area shown here is also referred to as the monitoring area 21. The monitoring area 21 in this case comprises several corridors 22, from which several rooms 23 can be reached. In this case, the rooms 23 include, for example, among other things, an equipment room 24, a lounge 25, and an examination room 26.
[0067] Distributed throughout the surveillance area 21 is an infrastructure 27 consisting of stationary devices that generate an electromagnetic field distribution in the surveillance area 21. Examples of components of the infrastructure 27 include several access points 28 (WLAN access points), a printer 29, a vending machine 30, a television 31, and a magnetic resonance imaging scanner, referred to here as MRI 32.
[0068] A method for locating the device 1 in the monitoring area 21 will be described below using a FIG 3 exemplary and schematically illustrated flow chart 33 with reference to FIG 1 und FIG 2 be explained.
[0069] In a method step S1, a map of the monitoring area 21 is first created, which indicates a spatially resolved electromagnetic reference field distribution in the monitoring area 21 as well as the positions of the devices or components of the field-generating infrastructure 27. This may include measuring the field distribution, a corresponding simulation, AI- or machine learning-assisted optimization, and / or the like. The map of the monitoring area 21 thus created is then provided to the server 3 and the additional module 2.
[0070] In a process step S2, the device 1 is equipped with the additional module 2. Here, the additional module 2 is integrated into the device 1 and connected to its module interface 8.
[0071] The process steps S1 and S2 can also be carried out in a different order or in parallel.
[0072] After completing these preparatory steps, the mobile device 1 should be in use. The mobile device 1 can be, for example, a mobile phone, a portable computer, a mobile medical device, a patient bed, a tool or instrument, or the like. In this case, the localization functionality of the device 1, expanded by the additional module 2, is activated, and the device 1 is located in the monitoring area 21. FIG 2 the device 1 is shown in an exemplary position in the lounge 25.
[0073] In a method step S3, the local electromagnetic field distribution is measured at the position of the device 1. In this case, this can be done using the measuring device 12 of the additional module 2 and / or using a corresponding sensor system of the device 1, which can be controlled by the additional module 2, in particular by the measuring device 12.
[0074] In parallel, in a method step S4, a ping signal, i.e., an echo request, is sent by the device 1 or the additional module 2, for example, by the communication module 6 or the communication device 14. If the device 1 or the additional module 2 subsequently receives corresponding response signals from one or more devices or components of the infrastructure 27, a runtime analysis based thereon is performed, for example, by the localization device 13, for example using the processor 10 and / or the device processor 4.
[0075] In a method step S5, the position of the device 1 is determined, for example by the localization device 13, based on the measured local field distribution and, if appropriate, taking into account a result of the runtime analysis. In this case, a signal from the GPS module 7 or the GPS receiver 15 or a position or localization history determined by means of this can also be taken into account, for example up to a point in time at which the device 1 entered the monitoring area 21. At the FIG 2In the exemplary position of the device 1 in the common room 25, the local electromagnetic field distribution there may, for example, be composed of signal or field components generated by the access points 28, the vending machines 30, and the television 31, but not by the printer 29 or the MRI 32. This results in an individual position-dependent superposition of these field components on the local field distribution at the position of the device 1, so that the position of the device 1 can be determined by comparison with the specified map.
[0076] In a method step S6, the additional module 2 automatically checks whether the determined position lies within a sub-area of the monitoring area 21 marked on the map as signal- or emission-sensitive. In this case, for example, the examination room 26 with the MRI 32 can be marked as such a sensitive area. If this is the case, i.e., if the device 1 is located in a sensitive area, the transmission of signals by the additional module 2 and the device 1 is automatically prevented or delayed until the device 1 is no longer located in a sensitive area. This is indicated here by a loop-like method step S7.
[0077] If the device 1 is not or no longer located in the or a correspondingly sensitive area, the data determined in a method step S8 is sent to the server 3. This data can include, for example, the measured field distribution, the determined position, the result of the runtime analysis, signals from the GPS module 7 or the GPS receiver 15, and / or the like. This data can be sent, for example, via the communication module 6 or the communication device 14.
[0078] As indicated here by an alternative program path, process steps S5 to S7 can be skipped, thus eliminating the need for position determination by device 1 or the additional module 2 itself. The data acquired or determined in process step S4, in particular the measured local field distribution, can then be transmitted directly to server 3 in process step S8.
[0079] In a method step S9, the server 3 processes the corresponding data sent by the device 1 or the additional module 2 and received via the server communication interface 16 using the server processor 17. This can include different processes or calculation steps depending on which data was sent or received. For example, the server 3 can determine the position of the device 1 based on the received data, identify the respective device 1 and / or the respective additional module 2, check whether these are already entered in the device database 19, and / or the like. Determining the position of the device 1 by the server 3 can be advantageous here, since the server 3 typically has more computing capacity or resources than the device 1 and the additional module 2.
[0080] In a method step S10, the server 3 updates the position database 20 with the determined position of the device 1 or the additional module 2. Since the database 20 is made available to other users, devices or programs by the server 3, the current position of the device 1 or the additional module 2 is then available so that they can be found by querying the position database 20.
[0081] In this case, an environmental context in the form of the field distribution provided by the field-generating infrastructure 27 already present in the monitoring area 21 is exploited to localize the device 1 in a respective target environment, in this case within the monitoring area 21, i.e., to determine the position of the device 1. The components or devices of the infrastructure 27 can generate the electromagnetic field distribution in the monitoring area 21 by actively emitting fields or signals and / or solely due to their regular operation. The components of the infrastructure 27 clearly form a network through which the field distribution in the monitoring area 21 is generated or spanned. By measuring a local characteristic of the field distribution, the respective position within this network can then be determined.
[0082] Not only the mobile device 1 considered here as an example, but also the components or devices of the infrastructure 27 can be equipped with the additional module 2. This can then also determine or monitor the positions of the components or devices of the infrastructure 27. This can advantageously enable, for example, maintaining an inventory list, implementing theft monitoring, automatically adjusting the reference field distribution upon detection of a change in the position of a component of the infrastructure 27, for example by the server 3, and the like.
[0083] The additional module 2 and its functions can be implemented entirely or partially in hardware or software. This may depend on the functions to be implemented, the type and configuration of the respective device 1 or the respective component of the infrastructure 27, and / or the like.
[0084] Overall, an existing electrical or electronic infrastructure 27 can be advantageously used for localization purposes in the manner described, and at least parts of the localization functionality can be transferred from the infrastructure 27 to the devices 1, facilities, or elements to be localized, saving components and costs, so that the infrastructure 27 does not have to be specifically designed or adapted for the localization purpose. The examples described thus demonstrate how the localization of devices, facilities, elements, or persons can be particularly advantageously enabled, particularly in buildings and sensitive areas.
Claims
1. Add-on module (2) for integration in an existing device (1) in order to equip the device (1) with a localisation functionality, comprising a measuring unit (12) and a localisation unit (13), wherein - the measuring unit (12) is configured to measure passively by means of sensors a local electromagnetic field distribution generated by a given surrounding infrastructure (27), which is located inside a building, inside the building, without any data being exchanged with this infrastructure (27), and - the localisation unit (13) is configured, automatically to determine an instantaneous spatial position of the add-on (2) module by comparing the measured field distribution with a specified map that is in the form of a building plan of the building and defines a spatially resolved reference field distribution and positions of the field-generating infrastructure (27).
2. Add-on module (2) according to claim 1, wherein the localisation unit (13) is configured, in order to facilitate tracking of the add-on module (2), to send the measured field distribution and / or the determined position via a wireless data connection to a server unit (3).
3. Add-on module (2) according to one of claims 1 or 2, characterised in that the add-on module (2) is implemented in hardware and comprises a connection interface (9), by means of which the add-on module (2) can be connected physically to the associated device (1) via a corresponding device-based interface (8).
4. Add-on module (2) according to one of claims 1 or 2, characterised in that the add-on module (2) is implemented in software, wherein the measuring unit (12) and the localisation unit (13) are function blocks of the software, and the add-on module (2) is configured to send to the associated device (1) appropriate control instructions for measuring the field distribution and for determining and sending the position, or for sending the measured field distribution.
5. Add-on module (2) according to one of the preceding claims, characterised in that the add-on module (2) is configured, in order to assist the localisation, automatically to cause the add-on module (2) or the associated device (1) to emit at least one ping signal into its surrounding area and to detect response signals, which are received by the add-on module (2) or the associated device (1) from components (28, 29, 30, 31, 32) of the field-generating infrastructure (27), and automatically - to perform a transit-time analysis based on the response signals and / or the times at which they were detected, and to determine the position of the add-on module (2) on the basis of a result of the transit-time analysis and the specified map, and / or - to send to the server unit (3) the response signals, the times at which they were detected, and / or the result of the transit-time analysis.
6. Add-on module (2) according to one of the preceding claims, characterised in that the add-on module (2) is configured additionally to analyse a signal from a satellite-based positioning system, in order to determine the position, and / or to transfer said signal to the server unit (3).
7. Add-on module (2) according to one of the preceding claims, characterised in that the add-on module (2) is configured to ascertain from the measured field distribution and / or from its own determined position, whether it is in an emission-sensitive zone (26), and if, and as long as, this is the case, to delay any sending of signals by the add-on module (2) and / or the associated device (1) equipped with the add-on module (2).
8. Method (33) for localising at least one device (1), which is equipped with an add-on module (2) according to one of claims 1 to 7, comprising the method steps: - mapping an electromagnetic reference field distribution inside a building and a field-emitting stationary infrastructure, which is located inside the building, (27) in a monitoring region (21) in which the device (1) is meant to be localised; - measuring a local field distribution inside the building by means of the device (1) to be localised if this device is in the monitoring region (21); and - automatically localising the device (1) by comparing the measured local field distribution with the map by means of the device (1).
9. Method (33) according to claim 8, also comprising automatically localising the device (1) by comparing the measured local field distribution with the map, by way of a server unit (3), to which the measured field distribution has been transferred by the device (1), wherein the server unit (3) has a communication module (16) and a data storage medium (18) and also a processor (17) connected to each, wherein measurement data that indicates the electromagnetic field distribution measured locally at the location of the device is received by the device (1) by means of the communication module (16), this measurement data is automatically compared with the map by means of the server unit (3) and thereby the position is determined at which the device (1) has measured the received field distribution, and the determined position associated with the device (1) is stored or updated in a position database (20), which is stored in the data storage medium (18).
10. Method (33) according to one of claims 8 or 9, characterised in that in order to produce the map of the reference field distribution, a specified field propagation model is used to simulate this map, wherein the field propagation model is provided with positions, device types and operating profiles of field-emitting components of the stationary infrastructure (27) as input data.
11. Method (33) according to one of claims 8 to 10, characterised in that for the reference field distribution and the local field distribution, a field strength is measured in a frequency-resolved manner for each of a plurality of frequency ranges specified for different communication methods.
12. Method (33) according to one of claims 8 to 11, characterised in that in order to produce the map of the reference field distribution, a variation in the electromagnetic field distribution over time in the monitoring region is measured over at least a specified time period, preferably over at least one day or at least one week.
13. Method (33) according to claim 12, characterised in that the measured variation over time is provided as an input to a specified machine learning component, in particular to a deep-learning based artificial neural network, which is trained to optimise the reference field distribution by reducing noise in the variation over time, which noise is caused by time-varying sources that do not belong to the stationary infrastructure (27).