Indoor navigation method based on location markers and application therefor
The method addresses indoor navigation challenges by employing a simple indoor map and location marker system with predetermined values, allowing for efficient navigation and reduced costs, without the need for frequent map updates or detailed store addresses.
Patent Information
- Application Number
- PCT/KR2024/004776
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-27
- Filing Date
- 2024-04-09
- Publication Date
- 2024-12-05
AI Technical Summary
Current indoor navigation methods using beacons face challenges such as the need for accurate indoor maps, frequent map updates, and the difficulty of assigning detailed addresses in large spaces like supermarkets, which increases costs and user inconvenience.
A method that uses a simple indoor map that doesn't need to perfectly match the actual layout, allowing for beacon location changes or additions without updating the map, and omits the need for detailed addresses by employing a location marker system with predetermined values including floor information, allowing for navigation using a combination of wireless signals and inertial measurement.
Enables efficient indoor navigation with reduced map update requirements, supports multiple locations with a single app, and eliminates the need for detailed store addresses, while maintaining low costs and ease of use.
Smart Images

Figure KR2024004776_05122024_PF_FP_ABST
Abstract
Description
Indoor navigation method and application based on location markers
[0001] The present invention relates to a method and application for a mobile terminal to calculate a location and perform navigation using an indoor map in an indoor location where satellite signals required for location calculation do not reach well, such as a large mart, department store, airport, movie theater, subway, etc.
[0002] Outdoors, satellite signals, such as those from the Global Positioning System (GPS), can be received to determine one's location. However, indoors, satellite signals are largely unavailable. For this reason, there is currently no commercially available indoor navigation method worldwide. Several methods for indoor navigation have been proposed, one of which is the use of beacons, a representative example being Bluetooth Low Energy (BLE). By installing multiple BLE beacons indoors and knowing their locations, a device can receive the beacon signals and determine its own location. Furthermore, the compass function on a smartphone can be used to determine the approximate direction, enabling indoor navigation.
[0003] To keep a beacon device permanently operational, electrical work is required indoors, and if the beacon device uses batteries, the batteries in numerous beacon devices will need to be replaced periodically.
[0004] One of the challenges of existing indoor navigation systems using beacons is the need for an accurate indoor map. When devices like smartphones use the beacon's reception power to calculate the distance between the beacon and the device or determine the device's location, they rely on an accurate indoor map and the precise location of the beacon.
[0005] Another issue is that indoor navigation devices must update their map data whenever a beacon device's location changes or is added. To minimize these map updates, users can use different navigation apps depending on the location. However, this can be inconvenient for users, requiring them to install different apps for different locations.
[0006] A method has been proposed whereby each store within a building is assigned a detailed address and this address is broadcast from a beacon installed within that store. However, this method requires that each store be assigned a detailed address, making it difficult to assign detailed addresses in places like large supermarkets where the entire building is a single store.
[0007] Current indoor navigation systems utilizing beacons face the challenge of requiring map data updates when beacon locations change or additional beacons are added. Furthermore, an additional drawback of existing indoor navigation methods using beacons is the requirement for accurate indoor maps. Creating and maintaining accurate indoor maps can hinder cost reduction. Assigning detailed addresses to stores within a building requires assigning addresses to each store, making it difficult for large retailers, such as supermarkets, to do so, as the entire building is a single store.
[0008] The purpose of the present invention to solve the above problems is to implement an indoor navigation system that can use a simple indoor map that does not have to perfectly match the shape of an actual room, does not require updating the indoor map when the location of a beacon is changed or additionally installed, does not require assigning a detailed address to each store in a building, and also works in a large mart where the entire building is a single store.
[0009] The technical problems to be achieved in the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present invention belongs from the description below.
[0010] In order to achieve the above object, a method for providing indoor navigation based on a location marker by a terminal having a navigation application installed according to an embodiment of the present invention comprises the steps of: downloading a location marker and an indoor map; receiving a wireless signal including a location expressed using the location marker from one or more wireless devices; calculating a location of the terminal using the received wireless signals, the downloaded location marker, and the indoor map; and performing indoor navigation using the calculated location, wherein the location marker is assigned with predetermined values to a predetermined location of the indoor map, and the predetermined values include floor information.
[0011] In one embodiment of the present invention, the location marker may include at least one of a road number, a road location value, or a number of detailed location values.
[0012] In one embodiment of the present invention, when there is only one floor on which navigation is performed, the location marker may omit floor information.
[0013] In one embodiment of the present invention, the indoor map may include the location marker.
[0014] In one embodiment of the present invention, when the terminal receives a wireless signal including a location expressed using the location mark from one or more wireless devices, the wireless signal may include at least one of information on the height at which the wireless device is installed, information on the transmission power of the wireless signal, or an identification number assigned for downloading the location mark and an indoor map.
[0015] In one embodiment of the present invention, when the terminal downloads a location marker and an indoor map, the terminal can additionally download latitude and longitude information mapped to the location marker.
[0016] In one embodiment of the present invention, a wireless device that transmits a wireless signal including a location expressed using the location marker may include one or more of a WiFi AP, a BLE beacon device, and a UWB device.
[0017] In one embodiment of the present invention, when a location expressed using the location marker included in the wireless signal is between two location markers expressed on the map, the expressed location can be expressed as a combination of a marker row vector included in one of the two location markers and one detailed location value.
[0018] Here, the direction of increase of the detailed location value may be consistent with the direction of increase of the road location value included in the location mark.
[0019] In one embodiment of the present invention, the step of downloading the location marker and the indoor map may be performed by downloading the location marker and the indoor map included in the navigation application when the terminal installs the navigation application, or by downloading the location marker and the indoor map from the navigation application server or a pre-designated indoor map providing server in real time when the navigation application is executed on the terminal.
[0020] In one embodiment of the present invention, when the terminal downloads the indoor map, if the indoor map is stored in the terminal, the indoor map can be downloaded when the version of the indoor map to be downloaded does not match the version of the stored indoor map.
[0021] In one embodiment of the present invention, when the terminal downloads a location marker and an indoor map, one or more of an item location file, an item location file, or a store location file may be additionally downloaded.
[0022] In one embodiment of the present invention, in the step of calculating the location of the terminal using the received wireless signals, the downloaded location marker, and the indoor map, when the signal power received from the beacon device installed at the intersection is greater than a predetermined first threshold power value, the terminal can determine the location of the intersection as the location of the terminal.
[0023] In one embodiment of the present invention, in the step of calculating the position of the terminal using the received wireless signals, the downloaded location marker, and the indoor map, when the signal power received from the beacon device installed at the intersection is greater than a predetermined second threshold power value and the change in direction measured by the inertial measurement unit (IMU) sensor of the terminal is greater than a predetermined threshold change amount, the terminal can determine the position of the intersection as the position of the terminal.
[0024] In one embodiment of the present invention, in the step of calculating the location of the terminal using the received wireless signals, the downloaded location marker, and the indoor map, when the reception power of a beacon device located on a different road from the road on which the terminal is traveling among the roads connected to the intersection increases by a predetermined threshold power change amount or more for a predetermined period of time, or when the signal reception rate of a beacon device located on a different road from the intersection increases by a predetermined threshold reception rate change amount or more for a predetermined period of time, the terminal can determine the location of the intersection as the location of the terminal.
[0025] In one embodiment of the present invention, in the step of performing indoor navigation using the calculated location, if the destination of the navigation being performed is a product location or a store, an advertisement for a product different from the product or a store different from the store may be received.
[0026] In one embodiment of the present invention, the step of performing indoor navigation using the calculated location may include the steps of: receiving an item from a user; displaying a plurality of stores that have the item on the screen of the terminal; and providing the user with a shortest distance or minimum time route to visit all stores displayed on the screen or some stores selected by the user.
[0027] In one embodiment of the present invention, after the terminal stores the calculated location, the stored location can be set as a destination or waypoint for navigation.
[0028] Using embodiments of the present invention, an indoor navigation method and application capable of providing the following functions can be provided. Specifically, when a terminal such as a smartphone performs indoor navigation, a simplified indoor map can be used that does not need to perfectly match the actual indoor layout. Furthermore, the terminal does not need to update the indoor map when the beacon location is changed or additional beacons are installed. Furthermore, addresses do not need to be assigned to each store within a building. Furthermore, users can pre-save their vehicle location in a parking lot or other location and set it as a destination.
[0029] The effects that can be obtained from the present invention are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood by a person having ordinary skill in the art to which the present invention belongs from the description below.
[0030] Figure 1 is a flowchart showing how a smartphone with an app installed that operates using an existing BLE beacon device determines its location.
[0031] Figure 2 is an example diagram showing an existing terminal estimating a distance using reception power from four BLE beacon devices.
[0032] FIG. 3 is a drawing showing an indoor map used in one embodiment of the present invention, a terminal located on the indoor map, a beacon device, a Wi-Fi connection device, a location marker, and a user.
[0033] Figure 4 is a flowchart illustrating the operation of indoor navigation according to one embodiment of the present invention.
[0034] FIG. 5 is a configuration diagram of a mart shopping system equipped with a D2D device and a server according to one embodiment of the present invention.
[0035] FIG. 6 is a block diagram of a terminal used for indoor navigation according to one embodiment of the present invention.
[0036] This disclosure may be subject to various modifications and various embodiments. Specific embodiments are illustrated and described in detail in the drawings. However, this is not intended to limit the disclosure to specific embodiments, but rather to encompass all modifications, equivalents, and alternatives falling within the spirit and technical scope of the disclosure.
[0037] In embodiments of the present disclosure, “at least one of A and B” may mean “at least one of A or B” or “at least one of combinations of one or more of A and B.” Furthermore, in embodiments of the present disclosure, “at least one of A and B” may mean “at least one of A or B” or “at least one of combinations of one or more of A and B.”
[0038] When a component is referred to as being "connected" or "connected" to another component, it should be understood that it may be directly connected or connected to that other component, but that there may be other components intervening. Conversely, when a component is referred to as being "directly connected" or "connected" to another component, it should be understood that there are no other components intervening.
[0039] The terminology used in this disclosure is only used to describe specific embodiments and is not intended to limit the present disclosure. The singular expression includes the plural expression unless the context clearly indicates otherwise. In this disclosure, it should be understood that the terms "comprises" or "has" indicate the presence of a feature, number, step, operation, component, part, or combination thereof described in the specification, but do not preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.
[0040] Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the art to which this disclosure pertains. Terms defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant technology, and shall not be interpreted in an idealized or overly formal sense unless explicitly defined herein.
[0041] Throughout the specification, a terminal includes an application / program, which is software stored on a computer-readable storage medium, and hardware such as a processor, memory, display, and communication module. The processor cooperates with the hardware to run the application. The display can display a user interface screen provided by the application. Depending on the terminal type, the display can receive user input, such as touch input. The communication module can communicate with a server via a communication network or with other terminals or devices through device-to-device (D2D) communication. The terminal can be implemented in various forms, and can refer to various devices that a user can carry and use while moving, such as a communication-capable tablet PC, wireless phone, mobile phone, smart phone, smart watch, smart glass, e-book reader, PMP (portable multimedia player), portable game console, navigation device, digital camera, DMB (digital multimedia broadcasting) player, digital audio recorder, digital audio player, digital picture recorder, digital picture player, digital video player, etc. Here, the user refers to a person who uses the terminal.
[0042] An application is software stored on a computer-readable storage medium, containing instructions and data for executing the operations of the present disclosure. The application is installed on a terminal and executed there. Furthermore, the application can communicate with a designated server via a communication network. Hereinafter, the application may be simply referred to as an app.
[0043] A server may include one or more processors, a memory that loads a computer program to be executed by the processors, a storage device that stores the computer program and various data, and a communication interface.
[0044] Hereinafter, preferred embodiments of the present disclosure will be described in more detail with reference to the attached drawings. In order to facilitate an overall understanding in describing the present disclosure, identical reference numerals are used for identical components in the drawings, and redundant descriptions of identical components are omitted.
[0045] First, to help understand the present invention, an indoor navigation method using an existing Bluetooth low energy (BLE) device is described.
[0046] Fig. 1 is a flowchart illustrating a method for determining a location of a smartphone installed with an app that utilizes an existing BLE beacon device. Referring to Fig. 1, the smartphone can download a map including the location of each beacon device (S101). The smartphone can receive wireless signals from multiple beacons and measure the reception power of each beacon (S102). The measured reception power values are converted into distances from each beacon device, so that the terminal can estimate its own location (S103). Here, it is assumed that the transmission power is known in advance. Therefore, the terminal can calculate a path loss value by subtracting the reception power from the transmission power, and then convert this path loss value into a distance between the terminal and the beacon.
[0047] FIG. 2 is an example diagram showing a terminal estimating a distance using reception power from four BLE beacon devices. Referring to FIG. 2, a smartphone terminal can estimate a distance using reception power from four BLE beacon devices indicated as 1, 2, 3, and 4. By receiving 22316, which is the identifier (ID) of BLE terminal 4 (S102), the smartphone can recognize that the signal is sent by terminal 4, and the location of terminal 4 is stored in the navigation app. Alternatively, the BLE terminal can transmit the latitude and longitude values of its location, and the navigation app can display the location of BLE terminal 4 on an indoor map where the latitude and longitude exactly match. Meanwhile, in FIG. 2, the signal from BLE device 2 is blocked by the user and received at a low power, so the terminal can calculate that the distance to BLE device 2 is farther than the actual distance. Due to environmental factors such as these, it is known that the location estimated by BLE usually has a distance error of several meters or more.
[0048] A problem with current BLE beacon navigation is that the map file or beacon location file must be updated whenever the beacon device's location changes. Because map files are typically large, it's more efficient to leave the map file as is and update only the beacon device's location file. In all of the above cases, the navigation app must update the map file or beacon device location file that contains the beacon device's location. Many commercially available outdoor navigation apps can utilize latitude and longitude values calculated by GPS reception, so this isn't a major issue. However, indoor navigation apps can struggle to create compatible maps using latitude and longitude values. Measuring precise locations, such as latitude, longitude, or altitude, indoors can be very challenging, making it challenging to create maps based on precise locations. In particular, indoor maps, such as those for supermarkets and department stores, often provide only rough estimates that don't match the actual location.
[0049] Therefore, the present invention proposes a navigation method that operates even on rough indoor maps that do not precisely map locations such as latitude, longitude, and altitude. Rough indoor maps are much simpler to create than detailed indoor maps and require relatively less indoor map data. Therefore, the cost of creating indoor maps can be reduced, and the amount of indoor map data required for navigation can also be reduced.
[0050] Other advantages of the indoor navigation method proposed by the present invention are as follows. Since no map updates are required even if there are changes to the beacon device, a single indoor navigation app can support navigation for an unlimited number of indoor locations. Furthermore, location files for beacon devices are not required, nor is detailed address assignment for each business. Furthermore, the proposed method can utilize the assistance of wireless devices, such as pre-installed Wi-Fi access points (APs), when calculating indoor locations, and can also integrate indoor and outdoor navigation.
[0051] FIG. 3 illustrates an indoor map (400) used in one embodiment of the present invention, a terminal (100), a beacon device (200), a Wi-Fi access point (WiFi AP) (300), a location marker (410), and a user (500) located on the indoor map (400). In one embodiment of the present invention, it is assumed that a navigation app is installed on the terminal. The indoor map (400) of FIG. 3 is not an indoor map (400) that exactly matches the interior of a large mart, but rather shows a general appearance. In the indoor map (400) of FIG. 3, there are predetermined location markers (410) at predetermined locations. A marker may also mean a barcode or QR code physically attached to an object or sign. However, the location marker (410) in the present invention assigns predetermined values to predetermined locations on the map. For example, the location marker (410) may be expressed as a combination of location information and marker information. For example, it can be expressed as 'position row vector, marker row vector', but it is not limited to the above-described example. Indoor maps can exist by floor. If the indoor map is an image file composed of pixels, a specific location of the indoor map can be a pixel coordinate value of the map image file. For example, Fig. 3 shows an indoor map of the 3rd floor, and location A can correspond to the pixel coordinate of (70, 70). Here, the pixel coordinate corresponds to a row vector having two elements. The marker information of the position marker (410) can also be expressed as one or more row vectors. For example, in FIG. 3, the marker information of each location A, B, C, D, E, F, G, H, and I can be expressed as (3,1,1), (3,1,2), (3,1,3), (3,1,4), (3,2,1), (3,2,2), (3,2,3), (3,2,4), (3,3,1), respectively, and in this case, the location marker of location A can be recorded in the location marker file as, for example, '(70, 70), (3,1,1)'.Here, the first value of the marker row vector may be 3, which may mean the third floor. The second value of the marker row vector may represent a road. That is, it may represent road 1, road 2, and road 3. Road 1 is a road that starts from A and goes through B, C, and D to E, road 2 is a road that starts from E and goes through F, G, and H to A, road 3 is a road that starts from I and goes through G and J to B, and road 4 is a road that starts from F and goes through G to C. The third value of the marker row vector may be a road position value indicating a position on the road. If the terminal (100) moves from position A to position D, the third value of the marker row vector increases from 1 to 4. As described above, the roads may be continuously connected in the direction in which the third value of the marker row vector increases. For the 3rd road, the third value of the marker row vector can start from I and increase to B. In the position representation by coordinates such as latitude or longitude, one location has one row vector (e.g., (latitude, longitude) row vector). On the other hand, in the position representation by the location marker (410), the marker information can have multiple row vectors. That is, since the locations G or F in FIG. 3 are overlapping parts of two roads, the marker information can have two row vectors. For example, in FIG. 3, G can have two marker row vectors, (3,2,3) and (3,3,2), and in this case, the location marker of location G can be recorded in the location marker file as, for example, '(700, 1200), (3,2,3), (3,3,2)'. Here, (700, 1200) is a position row vector and represents the pixel coordinates where location G is located in the indoor map file. Although not shown in Figure 3, location A may additionally have a marker row vector of (3,2,5) if necessary. The above-described location marker (410) may be assigned to each building in a similar manner.For example, the marker row vector (3,1,1) of the location marker (410) used in one building can be used in the same way in other buildings. In addition, since the location marker can be created based on the path that the user (500) moves, it can be efficient in guiding the user's (500) movement. If indoor navigation is performed in a building with only one floor, the location marker can omit the floor information. Many supermarkets in the United States, Canada, Australia, etc. are actually single-story buildings. That is, if there is only one floor where navigation is performed, the marker row vectors may not include the floor information and may be expressed only as a road number and a road position value, such as (1,1), for example. When configuring an indoor map (400), such a location marker (410) may be included in the indoor map (400) or may be provided as a location marker (410) file separate from the indoor map (400) file.
[0052] FIG. 4 is a flowchart illustrating an operation of an indoor navigation system according to an embodiment of the present invention. Referring to FIG. 4, a terminal (100) downloads a location marker (410) file and an indoor map (400) file (S401). Thereafter, the terminal (100) receives a wireless signal including location information expressed using the location marker (410) from one or more devices (S402). The terminal (100) calculates its location using the location information of the received wireless signal, the downloaded location marker (410), and the indoor map (400). (S403) The terminal (100) can perform indoor navigation using the calculated location (S404).
[0053] The terminal (100) downloads the location marker (410) and the indoor map (400) (S401). First, when the terminal (100) installs the app, the indoor map (400) and the location marker (410) included in the app are downloaded. Second, when the app is updated, the indoor map and the location marker are downloaded together. Third, when the user (500) runs the app on the terminal (100), the indoor map (400) and the location marker (410) can be downloaded in real time by accessing the app server or the corresponding indoor map providing server. Here, the location marker (410) may be included in the indoor map (400). For convenience, it is assumed below that the indoor map (400) includes the location marker (410).
[0054] Since the digital map of a country is usually very large, it is efficient to download only the indoor map (400) of the location of the terminal (100) from the app server or the indoor map providing server. Typically, such downloads are possible via the Internet, but they can be downloaded directly at the location using device-to-device (D2D) communication. With the recent advancement of D2D technology, the number of beacons and D2D communication devices capable of transmitting and receiving information is increasing. Ultra-wideband (UWB) communication, a type of D2D communication, has been installed in smartphones from manufacturers such as Samsung and Apple (registered trademark) since 2021. Bluetooth has also been installed in smartphones for a long time. Using this D2D communication, terminals (100), such as smartphones, can download indoor maps (400) directly at their location through D2D communication. For example, FIG. 5 shows a mart shopping system (500) equipped with a terminal-to-terminal communication device (520) and a server (510). Although a mart is used as an example in the present invention, the present invention is not limited thereto, and the present invention can be applied to any structure or building that constitutes a space. Examples include shopping centers, factories, train stations, airports, exhibition halls, and event halls. Since the mart server (510) is connected to the terminal (100) through the terminal-to-terminal communication device (520), the terminal (100) can directly download an indoor map (400) from the mart server (510) through terminal-to-terminal communication. This terminal-to-terminal communication device (520) can also perform the role of a beacon device (200). The advantage of downloading an indoor map (400) through such terminal-to-terminal communication is that downloading is possible even without an Internet connection.Of course, the terminal (100) can also access the mart server (510) via the Internet to download the indoor map (400) of the mart. However, the Internet is usually paid, but communication between terminals can be free, so the burden on the user of the present invention can be reduced.
[0055] The terminal (100) needs to know the building or area in which it is located to download the related indoor map (400). There are multiple ways in which the terminal (100) can know the building or area in which it is located. First, the terminal (100) can receive a mobile communication signal such as LTE (long term evolution), which is one of the wireless mobile communication technologies, or a signal from a Wi-Fi wireless access point (WiFi AP (300)) to know its approximate location. For example, an LTE repeater may be installed in a supermarket, and the terminal (100) may be connected to an LTE base station through this repeater, and the terminal (100) may recognize the supermarket where this repeater is installed as its location. Alternatively, the Wi-Fi wireless access point (WiFi AP (300)) may also inform the location in which it is installed. In other words, the terminal (100) can roughly know its location through a communication means such as LTE or Wi-Fi. The above-described method has already been commercialized. Second, the terminal (100) can determine its location through the beacon device (200). For example, the beacon device (200) can transmit building or location information expressed in 16 bits by including it in the beacon signal, and the terminal (100) can download an indoor map (400) corresponding to the 16-bit value. In addition, the beacon device (200) can broadcast the location of the building (e.g., latitude and longitude information) or the name of the building. Third, the terminal (100) can manually input the corresponding information from the user (500). For example, when the user (500) selects a region and a related business name in the terminal app, the region can be selected as 'Daejeon Yuseong-gu Gwanpyeong-dong' and the business name can be selected as 'Lotte Mart'.
[0056] From the user's (500) perspective, it may be most convenient to integrate indoor and outdoor navigation. To integrate indoor and outdoor navigation, when downloading location markers (410) and indoor maps (400), latitude and longitude information mapped to the location markers (410) can be downloaded together. At this time, latitude and longitude information mapped to all location markers (410) is not required. Only latitude and longitude information for location markers (410) of entrances and exits through which the user (500) enters and exits indoors and outdoors is required. For example, I in FIG. 3 corresponds to an entrance and has latitude and longitude information along with the location marker (410). In FIG. 3, the latitude and longitude are indicated as (36.426565, 127.386682). Here, the latitude and longitude of the entrance can be easily obtained from an outdoor map that is already commercially available. That is, when a user (500) goes from indoors to outdoors, indoor navigation is performed by a location marker (410) and outdoor navigation based on latitude and longitude can be performed starting from the location marker (410) of the entrance.
[0057] The interior of a building, such as a supermarket, may periodically change its internal configuration. In the aforementioned case, the building's indoor map (400) needs to be updated. The version of the building's indoor map (400) may change depending on the update described above. Therefore, the terminal (100) can download the building's indoor map (400) only when the version of the building's indoor map (400) previously downloaded and stored differs from the current version of the building's indoor map (400). For buildings that do not manage the version of the indoor map (400), a previously downloaded indoor map (400) can be used, or the current indoor map (400) can be redownloaded and used. The selection of the aforementioned methods can be performed automatically or manually by the terminal (100).
[0058] The terminal (100) receiving a wireless signal including a location expressed using a location marker (410) from multiple devices (S402) may receive a signal transmitted by a beacon device (200) such as a BLE device. In addition, it may receive a signal transmitted by an existing installed WiFi wireless access device (WiFi AP (300)) or a device-to-device (D2D) communication device such as UWB that may be installed in the future. Here, the signal transmitted by the beacon device (200) may take various forms such as a packet or a pulse. In Korea, numerous WiFi wireless access devices (WiFi APs) provide free Internet access in large marts, department stores, subways, airports, etc. There are also many WiFi wireless access devices (WiFi APs) that provide paid Internet access. However, WiFi beacons can be received and demodulated not only from free WiFi APs but also from paid WiFi APs. Therefore, in the case of Korea, since WiFi beacons can often be received indoors or outdoors in urban areas, if the WiFi beacon includes location information expressed using a location marker (410), indoor navigation can be established without installing any additional beacon devices (200) or by installing a very small number of beacon devices (200). For example, a WiFi AP (300) is already installed at location F in FIG. 3, and this WiFi AP (300) can transmit a wireless signal including the location expressed using the location marker (410). In the future, device-to-device (D2D) devices that can be installed in our living spaces can perform their own unique roles while simultaneously broadcasting locations based on location markers (410), so the cost of building indoor navigation systems can be further reduced in the future.
[0059] The location included in the wireless signal can be expressed using the downloaded location marker (410). The indoor map (400) can include information on the number of detailed location values each location marker (410) has. For example, as shown in FIG. 3, the area between A and B can be divided into 20 equal parts and values from 1 to 20 can be assigned to each part. As the third value of the marker row vector (i.e., the road location value) increases from A to B, the values from 1 to 20 assigned to the 20 equal parts can also be assigned to increase in the same direction as the third value increases. That is, the smallest value, 1, can be assigned to A, and 20 can be assigned to the part closest to B. Therefore, the location of A can be expressed as (3,1,1,1), and similarly, the location of B can be expressed as (3,1,2,1). Here, (3,1,1,1) and (3,1,2,1) are a combination of a marker row vector and a detailed location value. In the following, the above-mentioned form is referred to as a detailed marker row vector. If the beacon device (200) is at position a of FIG. 3, the location of the beacon device (200) will be (3,1,1,14). Therefore, the beacon device (200) located at a can broadcast its location (3,1,1,14). As described above, if there are multiple location markers (410) on the indoor map (400), most locations indoors can be expressed by a combination of the marker row vectors of the location markers (410) and the detailed location values. Here, the mart may not be able to install the beacon exactly at position a. This may slightly increase the error of the location value calculated in step S403, but indoor navigation can operate by taking this error into account. For example, when a terminal (100) goes from A to G via B, the indoor navigation app of the terminal (100) can consider the error and transmit the guidance, “Turn left a little later,” at (3,1,1,18) or (3,1,1,19) a little earlier than at (3,1,1,20).Therefore, when a building official installs a beacon device (200), even if it is not installed exactly at position a, no major problem may occur.
[0060] Since the beacon device (200) broadcasts its location based on the location mark (410) on the indoor map (400), the terminal (100) does not need to update the indoor map (400) at all even if a new beacon device (200) is newly installed in the mart or the location of the existing beacon device (200) is moved. That is, since the present invention does not utilize the ID of the beacon device (200), the indoor map (400) is not updated even if the ID of the beacon device (200) is changed. In addition, since the indoor map (400) does not include the location of the beacon, there is no need to update the indoor map (400) even if the location of the beacon is changed. As described above, by using the location marker (410), the provider of the indoor map (400) of the mart does not need to spend a relatively large amount of money to produce the indoor map (400) to match the latitude and longitude exactly, and also does not need to update the indoor map (400) when the installation of the beacon is changed.
[0061] The terminal (100) can calculate its own location using the received wireless signal, the downloaded location mark (410), and the indoor map (400). (S403) Since the reception power of the wireless signal is inversely proportional to the square of the signal propagation distance, by using this, the location expressed by the location mark (410) can be calculated even if the actual physical distance between the two beacon devices (200) is not known, and thus the location of the terminal (100) can be displayed on the indoor map (400). That is, the relative detailed location can be calculated regardless of whether the distance between the two beacon devices (200) is 10 m or 20 m. Here, it is assumed that the transmission power of each beacon device (200) is the same and a predetermined transmission power value is used. If the transmission power of each beacon device (200) is not the same, each beacon device (200) must transmit its own transmission power by including it in the beacon signal. For example, if beacon devices (200) are installed at a and b in FIG. 3 and the terminal (100) is at position c, which is the middle of the two beacon devices (200), the reception power of the two beacon signals will be almost the same, and therefore the position of the terminal (100) can be calculated as (3,1,2,3) or (3,1,2,4) or (3,1,2,5). If the ratio of the reception power value of the beacon device (200) located at a to the reception power value of the beacon device (200) located at b is 1:16, since the signal generally decreases in proportion to the square of the distance, the distance ratio is approximately 1:4, and therefore the position of the terminal (100) can be calculated as (3,1,2,10). This is because (3,2,1,10) is 4 spaces away from b and 16 spaces away from a, so the distance ratio becomes 1:4. By using the location marker (410) as described above, the terminal (100) can know the detailed location on the indoor map (400) without knowing the physical distance between the two beacon devices (200). The calculation based on the power ratio was performed from a two-dimensional perspective.In reality, since calculations must be made for a three-dimensional space, height information on where the beacon device (200) is installed is required, and this height information can be included in the beacon signal. The height information can be expressed in the detailed location units or in meters. As in two dimensions, the position in three dimensions can be calculated using the ratio of power and distance.
[0062] Ultra-wideband (UWB) can be used as a beacon, and UWB can accurately measure the distance between a device and a terminal (100) in centimeters (cm) without using receiving power. For the reasons described above, in the case of an UWB beacon, if information on how many meters (m) the detailed location unit corresponds to is included in the beacon signal and broadcast, the terminal (100) can calculate by converting between the meter (m) unit and the detailed location unit.
[0063] When a user (500) moves, there are various methods for calculating the location. In the present invention, location locking at the location of a beacon device (200) is described. In the following, it is assumed that the beacon device (200) is necessarily present at an intersection where two roads meet, such as A, B, C, D, E, F, G, and H in FIG. 3. In indoor and outdoor navigation, route guidance at an intersection may be very important. In this case, it may be very important for the terminal (100) to accurately recognize that the user (500) is approaching and passing the intersection. In the present invention, recognizing that the terminal (100) is at an intersection and determining the current location of the terminal (100) as the location of the intersection may be defined or expressed as 'location locking'. Methods for determining location locking are as follows.
[0064] First, when a terminal (100) receives a signal from a beacon device (200) located at an intersection, and the received power is greater than a predetermined power value, the terminal (100) can determine its location as the intersection. At this time, the received power may be continuously greater than the predetermined power value, and in this case, the terminal (100) can be determined to be at the intersection when the received power value is the largest.
[0065] Second, when the reception power of the signal of the intersection beacon device (200) is greater than a predetermined value and the change in direction measured by the IMU sensor of the terminal (100) is greater than the predetermined change, the terminal (100) can determine the corresponding point in time as the location of the intersection. This is a very useful technique when the user (500) turns right or left at the intersection. For example, when the signal reception power received by the beacon device (200) at intersection B is -75 dBm or higher and the change in direction measured by the IMU sensor of the terminal (100) is 60 degrees or more, the location lock can be determined. A turn at a four-way intersection generally causes a change in direction of about 90 degrees.
[0066] Third, when the reception power of a beacon device (200) located on a different road of the intersection increases by a predetermined power change amount or more for a predetermined period of time, or when the reception rate of the beacon device (200) increases by a predetermined reception rate change amount or more for a predetermined period of time, a location lock can be determined. For example, when the power increases by 15 dB or more for 1 second, or the reception rate increases by 40% or more for 2 seconds, the terminal (100) can determine a location lock. When the terminal (100) enters the intersection, since a line of sight (LOS) between the terminal (100) and the beacon device (200) installed on the left or right road of the traveling direction is secured, the terminal (100) can suddenly receive a signal from the corresponding beacon device (200) with a large power or measure a rapid increase in the signal reception rate for the corresponding beacon device (200).
[0067] The above-described 'location locking' technique is very useful for accurately estimating the location of the user (500). For example, if a terminal (100) located at A in FIG. 3 passes B and moves to J, and a beacon device (200) is installed at location B, the beacon device (200) will broadcast the location of (3,1,2,1). The terminal (100) determines the location lock at the moment when the power of the signal broadcasting the value (3,1,2,1) is, for example, -70 dBm or higher. That is, at this moment, the terminal (100) determines its location as (3,1,2,1). Thereafter, the terminal (100) can calculate the direction of travel and the speed of travel using the geomagnetic sensor and acceleration sensor of the built-in IMU device, and can estimate the distance moved from the location (3,1,2,1) by using these. When determining the direction of travel, the terminal (100) can directly utilize the output value of the built-in geomagnetic sensor. In addition, the progress speed can be calculated by the number of steps per hour of the user (500) and the stride length of the user (500). The stride length can be calculated by converting the height information input in advance by the user (500) into the stride length. The method of a pedometer application that measures the number of steps can be used as is to calculate the number of steps. Since the pedometer application is generally widely used, it is not described in the present invention.
[0068] Position locking can be performed even when the beacon device (200) is installed at a location other than an intersection. For example, in FIG. 3, when the terminal (100) passes the location (3,1,1,14), the signal of the beacon device (200) installed at the location (3,1,1,14) will be received by the terminal (100) with a very high power, for example, the reception power will be as high as -68 dBm, which is greater than the predetermined locking power value of -70 dBm, so that the terminal (100) can determine its current position as (3,1,1,14). In addition, in FIG. 3, when the terminal (100) goes from A to J via B, a left turn is possible within the location range from (3,1,1,19) to (3,1,2,4). Accordingly, the terminal (100) can determine the location lock when the change in the geomagnetic sensor value in the range of the above location exceeds a predetermined threshold change, for example, 60 degrees. In addition, in FIG. 3, when the terminal (100) moves from A to J via B, if a beacon device (200) is installed at location J, the terminal (100) can suddenly detect an increase in the power or reception rate of the signal of the beacon device (200) installed at location J when moving from (3,1,1,19) to (3,1,2,1). Therefore, at this moment, the terminal (100) can determine (3,1,2,1) as its location.
[0069] The terminal (100) performing indoor navigation using the calculated location (S404) may simply end by displaying the location of the terminal (100) and the location of the destination on the indoor map (400), or may be performed by setting the shortest distance or the minimum time distance between the current location of the terminal (100) and the destination using a route setting algorithm, and when the terminal (100) approaches the intersection of the set route, providing the terminal (100) with guidance at the intersection through a screen or sound. Generally, smartphones have a built-in IMU sensor, which provides a compass function. The terminal (100) can use this to determine its direction even indoors, which can assist in performing navigation. Since the above-described process is already widely performed in general outdoor navigation apps, it will not be described in detail in the present invention.
[0070] One of the primary services of indoor navigation systems used in places like supermarkets may be to guide users to a desired item. In other words, the destination may be a shelf containing the item. If the terminal (100) downloads a file containing the locations of all individual items in the supermarket, the terminal (100) can determine the location of the item. With the recent significant increase in smartphone performance and storage capacity, it is possible for the terminal (100) to download an item information file containing the locations of all items in the supermarket. However, for individual items, the greater the number of items, the greater the amount of information required. Therefore, downloading a file containing the locations of all individual items can be time-consuming and costly. Therefore, it may be more efficient for the terminal (100) to contact the supermarket server (510) via the Internet or device-to-device (D2D) communication. That is, the terminal (100) can inquire about the location of the item from the mart server (510) via the Internet or through a device-to-device (D2D) communication device (520). Meanwhile, in the case of items, a file storing the location of the items in advance can be relatively easily downloaded from the mart server (510) or the operating server of the navigation app. For example, the item 'soy sauce' is located near (3,3,3,10), which is the d location in FIG. 3, and since the amount of item information is relatively small compared to the item itself, there is no significant burden on the terminal (100) since it stores it in advance. Accordingly, when the terminal (100) downloads the indoor map (400) of the mart where it is located, it can also download the location file for the item, and by using this, the terminal (100) can know the location of the item from the stored file without having to inquire with the mart server (510) in step S404.
[0071] In a large outlet mall or underground shopping mall other than a supermarket, the terminal (100) can download a store information file instead of a product location file, and the terminal (100) can use the location information included in the store information file downloaded and stored in step S404 to find the location of the store. The store information file can include, in addition to the location of the store, a list of products for sale, information on events, discounts, out-of-stock products, etc., and the terminal (100) can display this information to the user (500) on the screen. In particular, when the user (500) inputs a desired product into the terminal (100), the terminal (100) can display a number of stores selling the product on the screen. If the user (500) selects the stores he or she wishes to visit, the terminal (100) can provide the user (500) with the shortest or shortest time route to visit all of the stores. Furthermore, if the user (500) specifies the order in which the stores are to be visited, the terminal (100) can provide the shortest or shortest time route to visit the stores in order. Here, the shortest path means the path with the shortest distance, and the minimum time path means the path with the shortest travel time.
[0072] When the terminal (100) performs indoor navigation, if the destination is a product or item, advertisements for products other than the selected destination may be received. This may be consumer-tailored targeted advertising. For example, if product A wet tissue is selected as the destination, an advertisement containing a discount coupon for wet tissue B may be received by the terminal (100) during navigation. In this case, the probability that the user (500) will purchase wet tissue B may increase. Similarly, if the destination is a store, the terminal (100) may receive advertisements for other stores selling the same items as the selected store. In this case, the user (500) may enter store B, where the advertisement was received, rather than store A, which is the destination.
[0073] After storing the calculated current location in step S403, the terminal (100) can set the stored location as a destination. For example, when a user (500) purchases an item at a store, the terminal (100) can store the current location. Thereafter, when the user (500) intends to return the item, the terminal (100) can set the stored location as a destination or a transit point. The aforementioned storage of the calculated current location can also be performed in a parking lot. For example, by storing the current location immediately after the user (500) gets out of his / her car, the user (500) can set the stored location of his / her car as a destination after completing the shopping.
[0074] Fig. 6 is a block diagram of a terminal (100) used for indoor navigation according to one embodiment of the present invention. In Fig. 6, the terminal is assigned a different symbol, 600, than 100, but both 100 and 600 refer to the same terminal.
[0075] Referring to FIG. 6, a terminal (600) may include at least one processor (610), a memory (620), a transmission / reception device (630) connected to a network to perform communication, and a D2D device (640) to perform D2D communication. In addition, the terminal (600) may further include an input interface device (650), an output interface device (660), a storage device (670), etc. Each component included in the terminal (600) may be connected by a bus (680) to perform communication with each other. However, each component included in the terminal (600) may be connected through an individual interface or individual bus centered on the processor (610), rather than a common bus (680). For example, the processor (610) may be connected to at least one of a memory (620), a transceiver (630), a D2D device (640), an input interface device (650), an output interface device (660), and a storage device (670) via a dedicated interface.
[0076] The processor (610) can execute program commands stored in at least one of the memory (620) and the storage device (670). The processor (610) may refer to a central processing unit (CPU), a graphics processing unit (GPU), or a dedicated processor in which methods according to embodiments of the present invention are performed. Each of the memory (620) and the storage device (670) may be configured with at least one of a volatile storage medium and a non-volatile storage medium. For example, the memory (620) may be configured with at least one of a read-only memory (ROM) and a random access memory (RAM).
[0077] The operations of the method according to the embodiments of the present disclosure can be implemented as a computer-readable program or code on a computer-readable recording medium. A computer-readable recording medium includes any type of recording device that stores information readable by a computer system. Furthermore, a computer-readable recording medium can be distributed across network-connected computer systems, allowing the computer-readable program or code to be stored and executed in a distributed manner.
[0078] Additionally, the computer-readable recording medium may include hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, etc. The program instructions may include not only machine language codes produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter, etc.
[0079] While some aspects of the present disclosure have been described in the context of a device, they may also represent a description of a corresponding method, wherein a block or device corresponds to a method step or a feature of a method step. Similarly, aspects described in the context of a method may also be described as a corresponding block or item or a feature of a corresponding device. Some or all of the method steps may be performed by (or using) a hardware device, such as, for example, a microprocessor, a programmable computer, or an electronic circuit. In some embodiments, at least one or more of the most important method steps may be performed by such a device.
[0080] In embodiments, a programmable logic device (e.g., a field-programmable gate array) may be used to perform some or all of the functions of the methods described herein. In embodiments, the field-programmable gate array may operate in conjunction with a microprocessor to perform one of the methods described herein.
[0081] Although the present disclosure has been described with reference to preferred embodiments thereof, it will be understood by those skilled in the art that various modifications and changes may be made to the present disclosure without departing from the spirit and scope of the present disclosure as set forth in the claims below.
[0082] There is.
Claims
1. A method for providing indoor navigation based on location markers by a terminal having a navigation application installed thereon. Steps to download location markers and indoor maps; A step of receiving a wireless signal including a location expressed using the above location marker from one or more wireless devices; A step of calculating the location of the terminal using the received wireless signals, the downloaded location marker, and the indoor map; and A step of performing indoor navigation using the calculated location is included. The above location markers are assigned predetermined values to predetermined locations on the indoor map, and the predetermined values include floor information. Indoor navigation method based on location markers.
2. In paragraph 1, The above location marker includes at least one of a road number, a road location value, or a number of detailed location values. Indoor navigation method based on location markers.
3. In paragraph 1, If there is only one floor on which navigation is performed, the above location marker omits floor information. Indoor navigation method based on location markers.
4. In paragraph 1, The above indoor map includes the above location markers, Indoor navigation method based on location markers.
5. In paragraph 1, When the terminal receives a wireless signal including a location expressed using the location marker from one or more wireless devices, The wireless signal includes at least one of the following: height information at which the wireless device is installed, transmission power information of the wireless signal, location marker, and identification number assigned for downloading an indoor map. Indoor navigation method based on location markers.
6. In paragraph 1, When the above terminal downloads location markers and indoor maps, The above terminal additionally downloads latitude and longitude information mapped to the above location marker. Indoor navigation method based on location markers.
7. In paragraph 1, A wireless device that transmits a wireless signal including a location expressed using the above location marker includes at least one of a Wi-Fi access point (WiFi AP), a low-power Bluetooth (BLE) beacon device, and an ultra-wideband (UWB) device. Indoor navigation method based on location markers.
8. In paragraph 1, If a location expressed using the location marker included in the wireless signal is between two location markers expressed on the map, the location expressed is expressed as a combination of a marker row vector included in one of the two location markers and one detailed location value. Indoor navigation method based on location markers.
9. In paragraph 8, The direction of increase of the above detailed location value is consistent with the direction of increase of the road location value included in the above location mark. Indoor navigation method based on location markers.
10. In paragraph 1, Steps to download location markers and indoor maps: When the terminal installs the navigation application, the terminal downloads the location marker and the indoor map included in the application, or when the navigation application is executed on the terminal, the terminal downloads the location marker and the indoor map in real time from the navigation application server or a pre-designated indoor map providing server. Indoor navigation method based on location markers.
11. In paragraph 1, At the stage where the terminal downloads the indoor map, If the indoor map is stored in the terminal, the indoor map is downloaded when the version of the indoor map to be downloaded does not match the version of the stored indoor map. Indoor navigation method based on location markers.
12. In paragraph 1, At the stage where the terminal downloads the location marker and indoor map, Additional download of one or more of the product location file, item location file, or store location file. Indoor navigation method based on location markers.
13. In paragraph 1, In the step of calculating the location of the terminal using the received wireless signals and the downloaded location marker and indoor map, When the signal power received from the beacon device installed at the intersection is greater than the first threshold power value set in advance, The terminal determines the location of the intersection as the location of the terminal, Indoor navigation method based on location markers.
14. In paragraph 1, In the step of calculating the location of the terminal using the received wireless signals and the downloaded location marker and indoor map, When the signal power received from the beacon device installed at the intersection is greater than the second threshold power value set in advance and the change in direction measured by the inertial measurement unit (IMU) sensor of the terminal is greater than the threshold change in advance, The terminal determines the location of the intersection as the location of the terminal, Indoor navigation method based on location markers.
15. In paragraph 1, In the step of calculating the location of the terminal using the received wireless signals and the downloaded location marker and indoor map, When the reception power of a beacon device located on a different road from the road on which the terminal is traveling among the roads connected to the intersection increases by more than a predetermined threshold power change amount for a predetermined period of time, or when the signal reception rate of a beacon device located on a different road from the intersection increases by more than a predetermined threshold reception rate change amount for a predetermined period of time, The terminal determines the location of the intersection as the location of the terminal, Indoor navigation method based on location markers.
16. In paragraph 1, In the step of performing indoor navigation using the calculated location above, If the destination of the navigation performed above is a product location or a store, advertisements for products other than the above product or stores other than the above store are received. Indoor navigation method based on location markers.
17. In paragraph 1, The step of performing indoor navigation using the above calculated location is: Step of receiving items from the user; A step of displaying a number of stores that have the above items on the screen of the terminal; and A step of providing the user with the shortest distance or minimum time route to visit all stores displayed on the screen or some stores selected by the user, Indoor navigation method based on location markers.
18. In paragraph 1, After the terminal stores the calculated location, it sets the stored location as a destination or waypoint for navigation. Indoor navigation method based on location markers.
19. An application stored in a recording medium that enables a terminal to perform the following functions, wherein the functions are: Ability to download location markers and indoor maps; A function of receiving a wireless signal including a location expressed using the above location marker from one or more wireless devices; A function for calculating the location of the terminal using the received wireless signals and the downloaded location marker and indoor map; and Includes a function for performing indoor navigation using the calculated location above, The above location markers are assigned predetermined values to predetermined locations on the indoor map, and the predetermined values include floor information. Application for indoor navigation based on location markers
Citation Information
Patent Citations
Navigation system
JP2015176157A
Determining Proximity to Venue
JP2017509975A
Method and apparatus for providing wireless location service using the beacon
KR101634879B1
Positioning method
KR1020140026302A
Method and system for providing area specific messaging
US20080220720A1
