Indoor positioning and navigation method and device

By matching indoor environment images within a building to determine the current location and plan a route, the problem of low indoor positioning accuracy and high cost caused by satellite signal blockage is solved, achieving efficient indoor navigation and route planning.

CN118999550APending Publication Date: 2024-11-22BEIJING JINGDONG QIANSHITECHNOLOGY CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310554125.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-17
Publication Date
2024-11-22

AI Technical Summary

Technical Problem

In existing technologies, indoor positioning and navigation in buildings suffer from low positioning accuracy and high cost due to satellite signal blockage, making it difficult to achieve efficient path planning.

Method used

By matching indoor environment images inside buildings with a preset image library, the current location information is determined, and a walking path is planned based on the building model, achieving indoor positioning and navigation without the need for hardware devices.

Benefits of technology

It enables efficient indoor positioning and navigation even without a network, reduces costs, and supports applications in various indoor scenarios, such as offices, warehouses, and supermarkets.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118999550A_ABST
    Figure CN118999550A_ABST
Patent Text Reader

Abstract

The invention discloses an indoor positioning and navigation method and device, and relates to the technical field of computers. A specific embodiment of the method comprises the following steps: acquiring target position information and an indoor environment picture in a building sent by a user; matching the indoor environment picture with a preset picture library to determine current position information corresponding to the indoor environment picture according to a matching result; and determining a walking path according to the current position information, the target position information and a building model corresponding to the building, so that the user walks to a target position corresponding to the target position information along the walking path. According to the embodiment, positioning can be performed through scene recognition, so that efficient planning of the walking path is realized, the efficiency is improved, the method does not depend on hardware equipment for positioning, and the implementation cost is low.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to a method and device for indoor positioning and navigation. Background Art

[0002] For indoor positioning and navigation in buildings, accurate positioning cannot be achieved through satellites because buildings block satellite signals. In related technologies, software and a variety of hardware devices are used to assist in indoor positioning and navigation, but this method is costly, and indoor satellite signals are weak, resulting in low positioning accuracy. Summary of the invention

[0003] In view of this, an embodiment of the present invention provides a method and device for indoor positioning and navigation, which can perform indoor positioning through scene recognition, thereby achieving efficient planning of walking paths and improving efficiency. This method does not rely on hardware equipment positioning and has low implementation cost.

[0004] To achieve the above object, according to one aspect of an embodiment of the present invention, a method for indoor positioning and navigation is provided, comprising:

[0005] Obtain the target location information and indoor environment pictures in the building sent by the user;

[0006] Matching the indoor environment picture with a preset picture library to determine the current location information corresponding to the indoor environment picture according to the matching result;

[0007] A walking path is determined according to the current position information, the target position information, and a building model corresponding to the building, so that the user walks along the walking path to the target position corresponding to the target position information.

[0008] Optionally, before matching the indoor environment picture with a preset picture library, the process includes:

[0009] Collecting multiple indoor environment pictures of the building;

[0010] Annotate location information for each indoor environment picture according to the building model;

[0011] The preset picture library is constructed according to the multiple indoor environment pictures and the location information of each indoor environment picture.

[0012] Optionally, the location information includes at least one of building identification, floor information, area information, location identification and orientation information.

[0013] Optionally, determining a walking path according to the current position information, the target position information, and a building model corresponding to the building includes:

[0014] Obtaining current floor information corresponding to the current location information;

[0015] Determine the floor passage position corresponding to the current position information according to the current floor information and the building model;

[0016] The walking path is determined according to the current position information, the floor passage position and the target position information.

[0017] Optionally, after determining the walking path according to the current position information, the target position information and a building model corresponding to the building, the method further includes:

[0018] Determine an average walking distance of the user along the walking path;

[0019] Obtaining the number of steps taken by the user along the walking path;

[0020] The walking position of the user on the walking path is determined according to the average step distance and the number of walking steps.

[0021] Optionally, determining an average walking distance of the user along the walking path includes:

[0022] Obtaining the length of a section walked by the user along the walking path within a preset time and the number of walking steps corresponding to the length of the section;

[0023] The average walking distance of the user is determined according to the length of the road section and the number of walking steps corresponding to the length of the road section.

[0024] Optionally, the walking path includes one or more turning points; after determining the walking path according to the current position information, the target position information and a building model corresponding to the building, the method further includes:

[0025] In response to monitoring that the distance between the user and the turning point on the walking path is less than a preset distance threshold, a reminder message indicating that the user has reached the turning point is generated.

[0026] Optionally, after determining the walking position of the user on the walking path according to the average step distance and the number of walking steps, the method further includes:

[0027] Acquire the orientation direction of the device of the user when walking along the walking path;

[0028] The orientation direction of the device is compared with the travel direction corresponding to the walking position, and when the comparison result indicates that the orientation direction of the device is different from the travel direction corresponding to the walking position, the walking position is updated.

[0029] According to another aspect of an embodiment of the present invention, there is provided an indoor positioning and navigation device, comprising:

[0030] An acquisition module is used to acquire the target location information and indoor environment pictures in the building sent by the user;

[0031] A matching module, matching the indoor environment picture with a preset picture library to determine the current location information corresponding to the indoor environment picture according to the matching result;

[0032] A determination module determines a walking path according to the current location information, the target location information and a building model corresponding to the building, so that the user walks along the walking path to the target location corresponding to the target location information.

[0033] According to another aspect of an embodiment of the present invention, there is provided an electronic device, including:

[0034] one or more processors;

[0035] a storage device for storing one or more programs,

[0036] When the one or more programs are executed by the one or more processors, the one or more processors implement the indoor positioning and navigation method provided by the present invention.

[0037] According to another aspect of an embodiment of the present invention, a computer-readable medium is provided, on which a computer program is stored. When the program is executed by a processor, the method for indoor positioning and navigation provided by the present invention is implemented.

[0038] One embodiment of the above invention has the following advantages or beneficial effects: the method matches the indoor environment picture of the building sent by the user with the preset picture library to determine the current location information corresponding to the indoor environment picture sent by the user, and then determines the user's walking path based on the current location information and the target location information sent by the user and the architectural model of the building, so that the user can walk along the walking path and navigate to the target location corresponding to the target location information. The method can determine the corresponding current location information by identifying the indoor environment picture, realize scene recognition and positioning, and thus realize efficient planning and navigation of indoor walking paths; the method does not rely on hardware equipment for positioning and has low cost; the method has a wide range of uses and can be applied to a variety of scenarios, such as office scenarios, warehouse picking scenarios, supermarket shopping scenarios, etc.

[0039] The further effects of the above-mentioned non-conventional optional manner will be described below in conjunction with the specific implementation manner. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] The accompanying drawings are used to better understand the present invention and do not constitute an improper limitation of the present invention.

[0041] Figure 1 is a schematic diagram of the main process of an indoor positioning and navigation method according to an embodiment of the present invention;

[0042] Figure 2 is a schematic diagram of the main process of another indoor positioning and navigation method according to an embodiment of the present invention;

[0043] Figure 3 is a schematic diagram of the main process of another indoor positioning and navigation method according to an embodiment of the present invention;

[0044] Figure 4 is a schematic diagram of a building floor structure in which current location information and target location information span across floors according to an embodiment of the present invention;

[0045] Figure 5 is a schematic diagram of main modules of an indoor positioning and navigation device according to an embodiment of the present invention;

[0046] Figure 6 is an exemplary system architecture diagram to which embodiments of the present invention may be applied;

[0047] Figure 7 It is a schematic diagram of the structure of a computer system of a terminal device or a server suitable for implementing an embodiment of the present invention. DETAILED DESCRIPTION

[0048] The following is a description of exemplary embodiments of the present invention in conjunction with the accompanying drawings, including various details of the embodiments of the present invention to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present invention. Similarly, for clarity and conciseness, the description of well-known functions and structures is omitted in the following description.

[0049] Figure 1 is a schematic diagram of the main process of an indoor positioning and navigation method according to an embodiment of the present invention. Figure 1 As shown, the method comprises the following steps:

[0050] Step S101: Acquire target location information and indoor environment pictures in a building sent by a user;

[0051] Step S102: matching the indoor environment picture with a preset picture library to determine the current position information corresponding to the indoor environment picture according to the matching result;

[0052] Step S103: determining a walking path according to the current position information, the target position information and a building model corresponding to the building, so that the user walks along the walking path to the target position corresponding to the target position information.

[0053] In an embodiment of the present invention, the method can be applied to indoor positioning and navigation of buildings. For example, it can be used to quickly find meeting rooms, workstations, etc. It can also be used to find SKUs (Stock keeping Unit, a unit of measurement for inventory in and out) in warehouses and commodities in supermarkets.

[0054] In an embodiment of the present invention, an indoor environment picture of a building sent by a user is obtained so that the current location information can be determined later through the indoor environment picture. The indoor environment picture may be a picture with indoor landmarks, such as a picture of a wall with marked objects, green plants, etc. At the same time, the target location information sent by the user is obtained, and the target location information includes at least one of a building identification, floor information, area information, location identification, and orientation information. For example, the target location information is Area A, Floor 6, Building 5.

[0055] In an embodiment of the present invention, after obtaining the indoor environment picture sent by the user, the indoor environment picture is matched with the preset picture library, and the current location information corresponding to the indoor environment picture can be determined through the matching result. Before matching the indoor environment picture with the preset picture library, a preset picture library is constructed. The preset picture library includes multiple indoor environment pictures and the location information corresponding to each indoor environment picture.

[0056] In the embodiment of the present invention, Figure 2 As shown, before matching the indoor environment image with the preset image library, it includes:

[0057] Step S201: Collect multiple indoor environment pictures of a building;

[0058] Step S202: marking location information for each indoor environment picture according to the building model;

[0059] Step S203: constructing a preset picture library according to the multiple indoor environment pictures and the location information of each indoor environment picture.

[0060] In an embodiment of the present invention, when constructing a preset picture library, multiple indoor environment pictures of a building are collected. The collected indoor environment pictures can be pictures with landmarks indoors. According to the building model, location information is annotated for each collected indoor environment picture. The location information of each indoor environment picture is the location of the indoor environment picture. The location information can include one or more of the building identification, floor information, area information, location identification and orientation information, and can also include a city identification. For example, the building identification can be the building number, the floor information can be the floor, the area information can be the area identification, the location identification can be the specific location, the orientation information can be the orientation, and the city identification can be the city. Then, a preset picture library is constructed based on the collected multiple indoor environment pictures and the location information corresponding to each indoor environment picture.

[0061] In an embodiment of the present invention, the collected indoor environment picture is matched with each indoor environment picture in the preset picture library, and an image matching algorithm can be used for matching. For example, a similarity algorithm can be selected to calculate the matching result, and the indoor environment picture in the preset picture library with the highest similarity to the collected indoor environment picture in the matching result is used as the successfully matched indoor environment picture, and then the position information of the successfully matched indoor environment picture in the preset picture library is used as the current position information corresponding to the collected indoor environment picture. Among them, the similarity algorithm can be selected from one or more of Manhattan distance, Chebyshev distance, Mahalanobis distance, angle cosine distance, etc.

[0062] After obtaining the current location information corresponding to the indoor environment picture of the building sent by the user, the user's walking path can be determined according to the current location information, the target location information and the building model corresponding to the building, so that the user can reach the target location corresponding to the target location information along the walking path. Before determining the walking path, it is necessary to model the building, obtain the 3D model of the building, and mark the location information of each destination in the building model, for example, the location of the meeting room, workstation, commodity location, shelf location, etc.

[0063] In an embodiment of the present invention, when determining the walking path, the current floor information corresponding to the current position information is obtained. If the current floor information and the target floor information corresponding to the target position information indicate that the current position and the target position are on the same floor, the walking path can be determined based on the current position information and the target position information.

[0064] In the embodiment of the present invention, Figure 3 As shown, the walking path is determined according to the current position information, the target position information and the building model corresponding to the building, including:

[0065] Step S301: Acquire current floor information corresponding to current location information;

[0066] Step S302: determining the floor passage position corresponding to the current position information according to the current floor information and the building model;

[0067] Step S303: Determine the walking path according to the current position information, the floor channel position and the target position information.

[0068] In an embodiment of the present invention, if the current floor information and the target floor information of the target position information indicate that the current position and the target position are not on the same floor, it is necessary to determine the floor passage position of the current floor according to the current floor information and the building model. The floor passage position can be an elevator position or a stair position. The user can select according to the actual situation, and the floor passage position can be one or more. If the floor passage position can be randomly selected, the walking path can be determined according to the current position information, the floor passage position and the target position information. It is also possible to calculate and determine the walking path corresponding to each floor passage position according to each floor passage position, the current position information and the target position information, and then select the walking path with the shortest distance from each walking path corresponding to each floor passage position as the walking path of the user. It is also possible to determine the floor passage position closest to the current position, so as to determine the walking path according to the floor passage position closest to the distance, the current position information and the target position information.

[0069] Figure 4 This is a schematic diagram of the floor structure of a building in which the current location information and the target location information are not on the same floor, i.e., across floors, wherein the starting point is the current location information, the starting point is located at the F1 floor, the end point is the target location information, the end point is located at the F3 floor, the floor passage position is the elevator, and the walking path can be determined through the starting point, the elevator and the end point.

[0070] In the embodiment of the present invention, the walking path includes a first walking path from the current position to the floor passage position, a second walking path across floors through the floor passage position, and a third walking path from the floor passage position to the target position. The first walking path and the third walking path can be obtained according to Dijkstra algorithm, Floyd algorithm, etc., in combination with the building model.

[0071] In an embodiment of the present invention, after determining the walking path based on the current position information, the target position information and the building model corresponding to the building, the method also includes: determining the average step distance of the user walking along the walking path; obtaining the number of walking steps of the user along the walking path; and determining the walking position of the user on the walking path based on the average step distance and the number of walking steps.

[0072] In an embodiment of the present invention, after determining the walking path, the user can walk along the walking path. During this process, the user's walking position can be determined by the user's average step distance and the number of walking steps, that is, the average step distance multiplied by the number of walking steps equals the walking distance. The user's walking position can be determined based on the walking distance, thereby locating the user's position in an off-network state.

[0073] In an embodiment of the present invention, determining the average pace distance of a user walking along a walking path includes: obtaining the length of a section walked by the user within a preset time and the number of walking steps corresponding to the section length; determining the average pace distance of the user based on the section length and the number of walking steps corresponding to the section length.

[0074] In an embodiment of the present invention, the length of the road section walked by the user within a preset time and the corresponding number of walking steps can be obtained, and the average step distance is equal to the length of the road section divided by the corresponding number of walking steps. The road section length can be the length of the straight road section walked by the user, that is, the straight road section from one inflection point to the next inflection point.

[0075] In an embodiment of the present invention, the walking path includes one or more turning points; after determining the walking path according to the current position information, the target position information and the building model corresponding to the building, the method further includes: in response to monitoring that the distance between the user and the turning point on the walking path is less than the preset distance threshold, generating a reminder message indicating that the turning point has been reached. Among them, the preset distance threshold can be set by definition, or it can be determined according to the average step distance of the user. That is, when the user is about to reach the turning point, the user can be guided by sending a reminder message to the user, and the reminder message can be implemented through sound or vibration mode. For example, the reminder message can be implemented through a vibration mode, which can facilitate the user to determine the direction of travel by sensing the vibration of the device when both hands are occupied, such as when carrying items or picking goods. Different directions can be set to have different vibration frequencies, and the vibration frequency can be set by definition, such as turning left to vibrate once and turning right to vibrate 3 times to remind the user.

[0076] In an embodiment of the present invention, after determining the walking position of the user on the walking path based on the average step distance and the number of walking steps, it also includes: obtaining the orientation direction of the device of the user when walking along the walking path; comparing the orientation direction of the device with the travel direction corresponding to the walking position, and updating the walking position when the comparison result indicates that the orientation direction of the device is different from the travel direction corresponding to the walking position.

[0077] In an embodiment of the present invention, there are one or more turning points on the walking path, and the orientation direction of the device can be obtained by an electronic compass on the device (such as a mobile phone). The orientation direction of the device is compared with the travel direction corresponding to the walking position at a preset interval. If the comparison result indicates that the orientation direction of the device and the travel direction corresponding to the walking position on the walking path are the same, the walking position is not updated; if the comparison result indicates that the orientation direction of the device and the travel direction corresponding to the walking position on the walking path are different, it means that the user has passed the turning point, and the device and the walking position are no longer on the same straight line segment, but the walking position is not updated in time. At this time, the walking position needs to be updated, and the walking position is updated to the turning point position so that the travel direction corresponding to the walking position is the same as the orientation direction of the device, so that the user's position can be corrected to accurately locate the user's position in real time.

[0078] The method for indoor positioning and navigation provided by the embodiment of the present invention matches the indoor environment picture in the building sent by the user with the preset picture library, determines the current position information corresponding to the indoor environment picture sent by the user, and then determines the walking path of the user according to the current position information and the target position information sent by the user and the architectural model of the building, so that the user can walk along the walking path and navigate to the target position corresponding to the target position information. The method can determine the corresponding current position information by identifying the indoor environment picture, realize scene recognition and positioning, and thus realize indoor positioning and navigation; the method can realize the planning of cross-floor paths according to the different floors where the current position and the target position are located, so as to determine the walking path of the user; the method can send reminder information to the user before reaching the turning point to guide the user's direction of travel; the method can dynamically calculate the average step distance of the user to determine the walking position of the user, and update the walking position through the orientation direction of the device, and can also realize the positioning of the user's position in the absence of a network; the method does not rely on hardware equipment for positioning, and has low cost; the method has a wide range of uses and can be applied to a variety of indoor scenes, such as office scenes, warehouse picking scenes, supermarket shopping scenes, etc.

[0079] like Figure 5 As shown, according to another aspect of an embodiment of the present invention, a device 500 for indoor positioning and navigation is provided, including:

[0080] An acquisition module 501 acquires target location information and indoor environment pictures in a building sent by a user;

[0081] A matching module 502 matches the indoor environment picture with a preset picture library to determine the current position information corresponding to the indoor environment picture according to the matching result;

[0082] The determination module 503 determines a walking path according to the current position information, the target position information and the building model corresponding to the building, so that the user walks along the walking path to the target position corresponding to the target position information.

[0083] In an embodiment of the present invention, the matching module 502 is also used to: before matching the indoor environment picture with the preset picture library, collect multiple indoor environment pictures of the building; mark the location information for each indoor environment picture according to the building model; and construct a preset picture library according to the multiple indoor environment pictures and the location information of each indoor environment picture.

[0084] In the embodiment of the present invention, the location information includes at least one of a building identifier, floor information, area information, a location identifier, and orientation information.

[0085] In an embodiment of the present invention, the determination module 503 is further used to: obtain the current floor information corresponding to the current position information; determine the floor channel position corresponding to the current position information based on the current floor information and the building model; determine the walking path based on the current position information, the floor channel position and the target position information.

[0086] In an embodiment of the present invention, the determination module 503 is also used to: determine the average step distance of the user walking along the walking path after determining the walking path based on the current position information, the target position information and the building model corresponding to the building; obtain the number of walking steps of the user along the walking path; and determine the walking position of the user on the walking path based on the average step distance and the number of walking steps.

[0087] In an embodiment of the present invention, the determination module 503 is further used to: obtain the length of the section walked by the user along the walking path within a preset time and the number of walking steps corresponding to the section length; determine the user's average pace distance based on the section length and the number of walking steps corresponding to the section length.

[0088] In an embodiment of the present invention, the walking path includes one or more turning points; the determination module 503 is also used to: after determining the walking path based on the current position information, the target position information and the building model corresponding to the building, in response to monitoring that the distance between the user and the turning point on the walking path is less than a preset distance threshold, generate a reminder message indicating that the turning point has been reached.

[0089] In an embodiment of the present invention, the determination module 503 is also used to: after determining the walking position of the user on the walking path based on the average step distance and the number of walking steps, obtain the orientation direction of the device of the user when walking along the walking path; compare the orientation direction of the device with the travel direction corresponding to the walking position, and update the walking position when the comparison result indicates that the orientation direction of the device is different from the travel direction corresponding to the walking position.

[0090] According to another aspect of an embodiment of the present invention, an electronic device is provided, comprising: one or more processors; a storage device for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the indoor positioning and navigation method provided by the present invention.

[0091] According to another aspect of an embodiment of the present invention, a computer-readable medium is provided, on which a computer program is stored. When the program is executed by a processor, the method for indoor positioning and navigation provided by the present invention is implemented.

[0092] Figure 6 An exemplary system architecture 600 is shown to which the method for indoor positioning navigation or the apparatus for indoor positioning navigation according to the embodiments of the present invention may be applied.

[0093] like Figure 6 As shown, system architecture 600 may include terminal devices 601, 602, 603, network 604 and server 605. Network 604 is used to provide a medium for communication links between terminal devices 601, 602, 603 and server 605. Network 604 may include various connection types, such as wired, wireless communication links or optical fiber cables, etc.

[0094] Users can use terminal devices 601, 602, and 603 to interact with server 605 through network 604 to receive or send messages, etc. Various communication client applications can be installed on terminal devices 601, 602, and 603, such as shopping applications, web browser applications, search applications, instant messaging tools, email clients, social platform software, etc. (only examples).

[0095] The terminal devices 601 , 602 , and 603 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smart phones, tablet computers, laptop computers, and desktop computers, etc.

[0096] The server 605 may be a server that provides various services, such as a backend management server (only an example) that provides support for shopping websites browsed by users using the terminal devices 601, 602, and 603. The backend management server may analyze and process the received data such as product information query requests, and feed back the processing results (such as target push information, product information - only an example) to the terminal device.

[0097] It should be noted that the indoor positioning and navigation method provided in the embodiment of the present invention is generally executed by the server 605 , and accordingly, the indoor positioning and navigation device is generally arranged in the server 605 .

[0098] It should be understood that Figure 6The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to the implementation requirements.

[0099] Reference below Figure 7 , which shows a schematic diagram of the structure of a computer system 700 of a terminal device suitable for implementing an embodiment of the present invention. Figure 7 The terminal device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0100] like Figure 7 As shown, the computer system 700 includes a central processing unit (CPU) 701, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 702 or a program loaded from a storage part 708 into a random access memory (RAM) 703. In the RAM 703, various programs and data required for the operation of the system 700 are also stored. The CPU 701, the ROM 702, and the RAM 703 are connected to each other via a bus 704. An input / output (I / O) interface 705 is also connected to the bus 704.

[0101] The following components are connected to the I / O interface 705: an input section 706 including a keyboard, a mouse, etc.; an output section 707 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 708 including a hard disk, etc.; and a communication section 709 including a network interface card such as a LAN card, a modem, etc. The communication section 709 performs communication processing via a network such as the Internet. A drive 710 is also connected to the I / O interface 705 as needed. A removable medium 711, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 710 as needed, so that a computer program read therefrom is installed into the storage section 708 as needed.

[0102] In particular, according to the embodiments disclosed in the present invention, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present invention include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 709, and / or installed from the removable medium 711. When the computer program is executed by the central processing unit (CPU) 701, the above-mentioned functions defined in the system of the present invention are executed.

[0103] It should be noted that the computer-readable medium shown in the present invention may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present invention, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In the present invention, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.

[0104] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present invention. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0105] The modules involved in the embodiments of the present invention may be implemented by software or hardware. The modules described may also be set in a processor, for example, it may be described as: a processor includes an acquisition module, a matching module and a determination module. The names of these modules do not constitute a limitation on the modules themselves in some cases, for example, the acquisition module may be described as "acquiring target location information and indoor environment pictures in a building sent by a user".

[0106] As another aspect, the present invention also provides a computer-readable medium, which may be included in the device described in the above embodiment; or it may exist independently without being assembled into the device. The above computer-readable medium carries one or more programs, and when the above one or more programs are executed by a device, the device includes: an acquisition module, which acquires the target location information and indoor environment picture in the building sent by the user; a matching module, which matches the indoor environment picture with a preset picture library to determine the current location information corresponding to the indoor environment picture according to the matching result; a determination module, which determines the walking path according to the current location information, the target location information and the building model corresponding to the building, so that the user walks along the walking path to the target location corresponding to the target location information.

[0107] According to the technical solution of the embodiment of the present invention, the method for indoor positioning and navigation determines the current position information corresponding to the indoor environment picture sent by the user by matching the indoor environment picture in the building with the preset picture library, and then determines the walking path of the user according to the current position information and the target position information sent by the user and the architectural model of the building, so that the user can walk along the walking path and navigate to the target position corresponding to the target position information. The method can determine the corresponding current position information by identifying the indoor environment picture, realize scene recognition and positioning, and thus realize indoor positioning and navigation; the method can realize the planning of cross-floor paths according to the different floors where the current position and the target position are located, so as to determine the walking path of the user; the method can send reminder information to the user before reaching the turning point to guide the user's direction of travel; the method can dynamically calculate the average step distance of the user to determine the walking position of the user, and update the walking position through the orientation direction of the device, and can also realize the positioning of the user's position in the absence of a network; the method does not rely on hardware equipment for positioning, and the cost is low; the method can be applied to a variety of indoor scenes, such as office scenes, warehouse picking scenes, supermarket shopping scenes, etc.

[0108] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may occur depending on design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A method for indoor positioning and navigation, characterized in that: include: Obtain the target location information and indoor environment pictures in the building sent by the user; Matching the indoor environment picture with a preset picture library to determine the current location information corresponding to the indoor environment picture according to the matching result; A walking path is determined according to the current position information, the target position information, and a building model corresponding to the building, so that the user walks along the walking path to the target position corresponding to the target position information.

2. The method according to claim 1, characterized in that Before matching the indoor environment image with the preset image library, the following steps are included: Collecting multiple indoor environment pictures of the building; Annotate location information for each indoor environment picture according to the building model; The preset picture library is constructed according to the multiple indoor environment pictures and the location information of each indoor environment picture.

3. The method according to claim 2, characterized in that The location information includes at least one of a building identification, floor information, area information, a location identification and orientation information.

4. The method according to claim 3, characterized in that: Determining a walking path according to the current position information, the target position information, and a building model corresponding to the building includes: Obtaining current floor information corresponding to the current location information; Determine the floor passage position corresponding to the current position information according to the current floor information and the building model; The walking path is determined according to the current position information, the floor passage position and the target position information.

5. The method according to claim 1, characterized in that After determining the walking path according to the current position information, the target position information and the building model corresponding to the building, the method further includes: Determine an average walking distance of the user along the walking path; Obtaining the number of steps taken by the user along the walking path; The walking position of the user on the walking path is determined according to the average step distance and the number of walking steps.

6. The method according to claim 5, characterized in that Determining an average walking distance of the user along the walking path includes: Obtaining the length of a section walked by the user along the walking path within a preset time and the number of walking steps corresponding to the length of the section; The average walking distance of the user is determined according to the length of the road section and the number of walking steps corresponding to the length of the road section.

7. The method according to claim 1, characterized in that The walking path includes one or more turning points; after determining the walking path according to the current position information, the target position information and a building model corresponding to the building, the method further includes: In response to monitoring that the distance between the user and the turning point on the walking path is less than a preset distance threshold, a reminder message indicating that the user has reached the turning point is generated.

8. The method according to claim 5, characterized in that After determining the walking position of the user on the walking path according to the average step distance and the walking step number, the method further includes: Acquire the orientation direction of the device of the user when walking along the walking path; The orientation direction of the device is compared with the travel direction corresponding to the walking position, and when the comparison result indicates that the orientation direction of the device is different from the travel direction corresponding to the walking position, the walking position is updated.

9. An indoor positioning and navigation device, characterized in that: include: An acquisition module is used to acquire the target location information and indoor environment pictures in the building sent by the user; A matching module, matching the indoor environment picture with a preset picture library to determine the current location information corresponding to the indoor environment picture according to the matching result; A determination module determines a walking path according to the current location information, the target location information and a building model corresponding to the building, so that the user walks along the walking path to the target location corresponding to the target location information.

10. An electronic device, characterized in that: include: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 8.

11. A computer readable medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 8 is implemented.