Navigation method and device of head-mounted equipment, medium and head-mounted equipment

Abstract

The embodiment of the invention provides a navigation method and device of head-mounted equipment, a medium and the head-mounted equipment. The navigation method of the head-mounted equipment comprises the following steps: acquiring the current position of the head-mounted equipment and multimedia data acquired by the head-mounted equipment; determining a three-dimensional map based on the current position and the multimedia data; determining a navigation route based on the three-dimensional map, the current position and the destination position, and determining the three-dimensional map through the current position and the multimedia data so as to determine the navigation route based on the three-dimensional map, the current position and the destination position, thereby guiding the movement of a user using the head-mounted device through the navigation route. The navigation service of the head-mounted device to the user is improved, and the user experience is further improved.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a navigation method, apparatus, medium and head-mounted device for a head-mounted device. Background Art

[0002] A head-mounted device is worn on the user's head, such as smart glasses, headphones, etc., wherein the user wears the head-mounted device and moves in various indoor or outdoor scenes, and the existing head-mounted device provides the user with the current location and presents a floor map. At this time, the user combines the floor map presented by the existing head-mounted device and the counter inquiry to achieve navigation to the destination location, resulting in poor navigation service effect of the existing head-mounted device for the user. Summary of the invention

[0003] The embodiments of the present application provide a navigation method, apparatus, medium and head-mounted device for a head-mounted device, which can determine a navigation route based on the three-dimensional map, the current location and the destination location at least to a certain extent, and guide the movement of a user using the head-mounted device through the navigation route, thereby improving the navigation service of the head-mounted device to the user and thereby improving the user experience.

[0004] Other features and advantages of the present application will become apparent from the following detailed description, or may be learned in part by the practice of the present application.

[0005] According to one aspect of an embodiment of the present application, a navigation method for a head mounted device is provided, comprising:

[0006] Acquire the current position of the head mounted device and the multimedia data collected by the head mounted device;

[0007] Determining a three-dimensional map based on the current location and the multimedia data;

[0008] A navigation route is determined based on the three-dimensional map, the current location and the destination location.

[0009] In some embodiments of the present application, the destination location includes at least one, and determining the navigation route based on the three-dimensional map, the current location and the destination location includes:

[0010] Obtain user preference information;

[0011] Determine the order of arrival between the destination locations according to the user's preference information and the destination locations;

[0012] determining a plurality of the navigation routes based on the arrival order and the current location;

[0013] An optimal navigation route is determined based on the multiple navigation routes and the three-dimensional map.

[0014] In some embodiments of the present application, determining a three-dimensional map based on the current location and the multimedia data includes:

[0015] receiving a plan map sent by a location terminal corresponding to the current location;

[0016] Creating corresponding stereo features based on the multimedia data;

[0017] A three-dimensional map is determined according to the three-dimensional features and the planar map.

[0018] In some embodiments of the present application, determining the three-dimensional map according to the three-dimensional features and the planar map includes:

[0019] determining a characteristic region based on the region of the planar map;

[0020] If the feature information of the three-dimensional feature is consistent with the feature information of the corresponding feature area, a three-dimensional map is determined based on the three-dimensional feature and the feature area.

[0021] In some embodiments of the present application, after determining the navigation route based on the three-dimensional map, the current location and the destination location, the navigation method of the head mounted device further includes:

[0022] Collecting eye features of the user and determining the current position of the eye features;

[0023] Determining a location corresponding to display information based on the current location of the eye feature, wherein the display information includes navigation information in the navigation route and / or surrounding store information;

[0024] If the current position of the eye feature changes within a preset time, determining the amount of position change of the eye feature;

[0025] The position of the displayed information is adjusted based on the amount of position change of the eye feature.

[0026] In some embodiments of the present application, after determining the navigation route based on the three-dimensional map, the current location and the destination location, the navigation method of the head mounted device further includes:

[0027] receiving the number of customers sent by a target terminal corresponding to the destination location;

[0028] Determining the number of people in line based on the number of customers;

[0029] If the number of people in the queue is less than the preset threshold number of people in the queue, a reminder message is transmitted.

[0030] In some embodiments of the present application, after determining the navigation route based on the three-dimensional map, the current location and the destination location, the navigation method of the head mounted device further includes:

[0031] Acquire a user type wearing the head mounted device and display information, wherein the display information includes navigation information in the navigation route and / or surrounding store information;

[0032] If the user type is a blind person, the display information is output in a non-visual manner.

[0033] According to one aspect of an embodiment of the present application, a navigation device for a head mounted device is provided, comprising:

[0034] An acquisition module is used to obtain the current position of the head mounted device;

[0035] A first determining module, configured to determine a corresponding map according to the current position of the head mounted device;

[0036] The second determination module is used to determine a navigation route based on the map, the current location and the destination location.

[0037] According to one aspect of an embodiment of the present application, a computer-readable medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the navigation method of the head-mounted device as described in the above embodiment is implemented.

[0038] According to one aspect of an embodiment of the present application, a head-mounted device is provided, comprising: one or more processors; a storage device for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the navigation method of the head-mounted device as described in the above embodiments.

[0039] According to one aspect of an embodiment of the present application, a computer program product or a computer program is provided, the computer program product or the computer program including computer instructions, the computer instructions being stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the navigation method of the head-mounted device provided in the above embodiment.

[0040] In the technical solutions provided in some embodiments of the present application, a three-dimensional map is determined by the current position and multimedia data, so that a navigation route can be determined based on the three-dimensional map, the current position and the destination position, thereby guiding the movement of users using a head-mounted device through the navigation route, improving the navigation service of the head-mounted device to the user, and further improving the user experience.

[0041] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] The drawings herein are incorporated into the specification and constitute a part of the specification, showing embodiments consistent with the present application, and together with the specification, are used to explain the principles of the present application. Obviously, the drawings described below are only some embodiments of the present application, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. In the drawings:

[0043] Figure 1 A schematic diagram of a head mounted device according to an embodiment of the present application is shown;

[0044] Figure 2 A schematic flow chart of a navigation method for a head mounted device according to an embodiment of the present application is shown;

[0045] Figure 3 Shows Figure 2 Schematic diagram of the process of step S120;

[0046] Figure 4 Shows Figure 2 Schematic diagram of the process of step S130;

[0047] Figure 5 A block diagram of a navigation device of a head mounted device according to an embodiment of the present application is shown;

[0048] Figure 6 A schematic diagram of the structure of a computer system suitable for implementing a head mounted device according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0049] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this application will be more comprehensive and complete and fully convey the concept of the example embodiments to those skilled in the art.

[0050] In addition, described feature, structure or characteristic can be combined in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present application. However, those skilled in the art will appreciate that the technical scheme of the present application can be put into practice without one or more of the specific details, or other methods, components, devices, steps, etc. can be adopted. In other cases, known methods, devices, realizations or operations are not shown or described in detail to avoid blurring the various aspects of the application.

[0051] The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities may be implemented in software form, or in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0052] The flowcharts shown in the accompanying drawings are only exemplary and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps can be decomposed, and some operations / steps can be combined or partially combined, so the actual execution order may change according to actual conditions.

[0053] Figure 1 A flowchart of a navigation method for a head-mounted device according to an embodiment of the present application is shown. The method can be applied to a head-mounted device, which may include but is not limited to one or more of a head massager, a head controller, headphones, and smart glasses, and may also be a wearable device, such as an AR (Augmented Reality) device, a VR (Virtual Reality) device, an MR (Mixed Reality) device, and the like.

[0054] In the embodiments of the present application, the head mounted device is taken as smart glasses as an example for explanation. Figure 1 The smart glasses include a frame 10 and temples 20, and the temples 20 are respectively connected to opposite sides of the frame 10. The user can wear the head-mounted device on the user's head through the temples 20. In some embodiments, the near-eye display device can also be worn on the user's head through other wearing components, such as a connecting strap or a connecting buckle with elastic, magnetic or adhesive force.

[0055] The frame 10 may be provided with a display (lens) to display image information. In some embodiments, lenses may not be provided, or only ordinary lenses may be provided. Image information is displayed through an integrated display device. The user may wear the display device on the user's head through the temples 20 and directly view the image information displayed by the display device without displaying it through lenses.

[0056] The display may be a lens, and the lens may be a waveguide lens with a grating structure, or may be other forms such as a plain glasses lens, a sunglass lens, a prescription glasses lens, a prescription sunglass lens, etc., wherein a prescription glasses lens or a prescription sunglass lens refers to a glasses lens or a sunglass lens provided according to a prescription (or an eye test sheet).

[0057] refer to Figure 2 The navigation method of the head mounted device at least includes steps S110 to S130, which are described in detail as follows (the method is applied to a head mounted device as an example for explanation below):

[0058] In step S110, the current position of the head mounted device and the multimedia data collected by the head mounted device are obtained.

[0059] In an embodiment of the present application, a head-mounted device is worn by a user. When the user wears the head-mounted device, the current position of the head-mounted device is the current position of the user. In addition, a global positioning system may also be used to determine or locate the current position of the head-mounted device.

[0060] The current position of the head-mounted device is determined based on the wireless information, Bluetooth information and / or QR code information collected by the head-mounted device, so that the head-mounted device can determine the current position based on the current environment, thereby improving the positioning accuracy and convenience of the head-mounted device. Optionally, the current position of the head-mounted device can be a position in an indoor scene or a position in an outdoor scene, and can be adjusted according to actual needs.

[0061] In an embodiment of the present application, the head-mounted device enters a first shopping mall as the user moves, and the first shopping mall is provided with multiple wireless networks. When the head-mounted device is in the first shopping mall, the wireless module in the head-mounted device is connected to the multiple wireless networks in the first shopping mall, and the head-mounted device collects wireless information of the first shopping mall, so as to determine the current position of the head-mounted device through the wireless information collected by the head-mounted device, thereby realizing the determination of the current position of the head-mounted device. Optionally, the position accuracy of the head-mounted device is further improved by the signal strength of the wireless information collected by the head-mounted device.

[0062] In an embodiment of the present application, the head-mounted device enters the first shopping mall as the user moves, and multiple Bluetooth signal terminals are provided in the first shopping mall. When the head-mounted device is in the first shopping mall, the Bluetooth module in the head-mounted device is connected to the multiple Bluetooth signal terminals in the first shopping mall, and the Bluetooth information of the first shopping mall collected by the head-mounted device is used to determine the current location of the head-mounted device through the Bluetooth information collected by the head-mounted device, thereby realizing the determination of the current location of the head-mounted device. Optionally, the signal strength of the Bluetooth information collected by the head-mounted device is used to further improve the location accuracy of the head-mounted device. The Bluetooth information can be the merchant location information, the location information indicated in the corridor, or the floor information, which is not limited here.

[0063] In an embodiment of the present application, the head-mounted device enters the first shopping mall as the user moves, and multiple QR code information is set in the first shopping mall. When the head-mounted device is in the first shopping mall, the scanning module in the head-mounted device scans the multiple QR code information in the first shopping mall, and the head-mounted device collects the QR code information of the first shopping mall, so as to determine the current location of the head-mounted device through the QR code information collected by the head-mounted device, thereby realizing the determination of the current location of the head-mounted device. Optionally, the QR code information can be the merchant location information, the location information indicated in the corridor, or the floor information, which is not limited here.

[0064] In addition, the wireless module, Bluetooth module and scanning module in the head-mounted device can be used separately or in combination to integrate wireless information, Bluetooth information and QR code information to determine the current position of the head-mounted device, thereby realizing accurate positioning of the current position of the head-mounted device by multiple information, and the current position of the head-mounted device can be determined synchronously in different ways, thereby improving the detection enrichment of the current position of the head-mounted device.

[0065] Among them, multimedia data collected by the head-mounted device is obtained. The head-mounted device shoots or photographs the environment in front of the head-mounted device through a camera to form multimedia data. The multimedia data can be photos or videos, and is transmitted to the control end of the head-mounted device so that the control end of the head-mounted device can further process the multimedia data.

[0066] Please refer to Figure 3 In step S120, a three-dimensional map is determined based on the current position and the multimedia data.

[0067] In an embodiment of the present application, the current position of the head mounted device is used as a factor for determining a plane map, so that a location terminal corresponding to the current position of the head mounted device determines a corresponding plane map.

[0068] In one embodiment, step S120 includes:

[0069] Step S121, receiving a plane map sent by a location terminal corresponding to the current location;

[0070] In an embodiment of the present application, a head-mounted device and a location terminal corresponding to the current location are wirelessly connected, and the head-mounted device and the location terminal corresponding to the current location are associated based on the wireless connection to facilitate communication between the head-mounted device and the location terminal corresponding to the current location, and the head-mounted device receives a plane map sent by the location terminal corresponding to the current location, thereby determining the plane map corresponding to the head-mounted device at the current location. Optionally, the location terminal corresponding to the current location can be a router or annunciator at the current location, and the plane map sent. The location terminal corresponding to the current location can be a location terminal for an indoor environment or a location terminal for an outdoor environment.

[0071] If the current location of the head-mounted device is the first shopping mall, the location terminal corresponding to the first shopping mall sends a floor map of the first shopping mall to the head-mounted device. Further, the floor map of the first shopping mall is traversed, and the location point of the current location of the head-mounted device relative to the floor map of the first shopping mall is marked. Optionally, the location point of the current location of the head-mounted device relative to the floor map of the first shopping mall is determined based on the store information collected by the head-mounted device, so as to further realize the navigation of the head-mounted device in indoor scenes or outdoor scenes.

[0072] Step S122: creating corresponding three-dimensional features based on the multimedia data;

[0073] In an embodiment of the present application, the head-mounted device collects multimedia data during movement. The multimedia data may be image data and / or video data. The multimedia data contains corresponding scenes or objects. Corresponding three-dimensional features are created based on the multimedia data to determine the three-dimensional features of the head-mounted device during movement. The three-dimensional features are combined with a planar map to further form a three-dimensional map.

[0074] With respect to the decomposition of multimedia data, each frame of the picture is determined based on the multimedia data, and the scene or object in the picture is frozen, so as to perform three-dimensional modeling based on the scene or object in the picture, thereby creating three-dimensional features of the corresponding scene or object, and then use the multimedia data collected by the head-mounted device to perform three-dimensionalization, and enable the head-mounted device to collect surrounding multimedia data in real time during movement, thereby ensuring the coordination between the three-dimensional features and the flat map, thereby ensuring the accuracy of the three-dimensional map.

[0075] Step S123, determining a three-dimensional map according to the three-dimensional features and the plane map;

[0076] In an embodiment of the present application, a feature area is determined based on the area of ​​the plane map; if the feature information of the three-dimensional feature is consistent with the feature information of the corresponding feature area, a three-dimensional map is determined based on the three-dimensional feature and the feature area. At this time, the feature area can be the corresponding store area, stair area, walking area, etc. in the plane map. The feature area is used as a reference area to facilitate matching the three-dimensional feature and the feature area, and then combining the three-dimensional feature with the feature area, thereby realizing the creation of three-dimensional features in the feature area, and then realizing the creation of a three-dimensional map.

[0077] Specifically, the feature information of the three-dimensional feature can be the name of the three-dimensional feature or the symbol of the three-dimensional feature, which is not limited at this time. When the feature information of the feature area can be the name of the feature area, the matching of the three-dimensional feature and the feature area is achieved by matching the name, thereby achieving the creation of the three-dimensional feature in the feature area, and then achieving the creation of the three-dimensional map.

[0078] Please refer to Figure 4 In step S130, a navigation route is determined based on the three-dimensional map, the current location and the destination location.

[0079] In an embodiment of the present application, a navigation route is determined according to the map stereo map, the current position and the destination position, so that the navigation route is referenced by multiple factors, thereby ensuring the accuracy of the navigation route. At this time, the stereo map is determined by the current position and multimedia data, so that the navigation route is determined based on the stereo map, the current position and the destination position, thereby guiding the movement of the user using the head-mounted device through the navigation route, improving the navigation service of the head-mounted device to the user, and thus improving the user experience.

[0080] Wherein, the destination location includes at least one, and when there are one or more destination locations, a navigation route is determined based on the three-dimensional map, the current location and a destination location, and the navigation route is used as the best navigation route for the user, and is used for navigation, so that the user moves from the current location to the destination location along the navigation route, satisfying the user's preference arrangement. Optionally, the number of destination locations is not limited.

[0081] The specific steps are as follows:

[0082] Step S131, obtaining user preference information;

[0083] In the embodiment of the present application, the user's preference information may be the user's shopping interest information, the user's shopping intention, the user's previous shopping record, etc., which is not limited here. The user's preference information is used as one of the factors for determining the navigation route, so that the navigation route meets the user's preference arrangement, and the destination location can also be further screened based on the user's preference information. Optionally, the user's preference information is input into the head mounted device by the user.

[0084] Step S132: determining the arrival order between the destination locations according to the user's preference information and the destination locations;

[0085] In an embodiment of the present application, at least one of the destination locations is obtained, and the arrival order between the destination locations is determined based on the user's preference information and the destination locations. At this time, the user's preference information is used as an influencing factor of the arrival order between the destination locations, and the arrival order of each destination location is determined.

[0086] Among them, if the user's preference information is shopping intention, which is buying sneakers, drinking tea and resting respectively, the destination locations are sneaker store, tea shop and lounge respectively, and the arrival order between the destination locations is determined according to the user's preference information and the destination locations. The ranking of the destination locations is influenced by the user's preference information, and the corresponding arrival order between the destination locations is "sneaker store"-"tea shop"-"lounge".

[0087] Among them, when the user has multiple preference information, the order of the multiple destinations is sorted according to the weights of the multiple preference information to determine the navigation order of the multiple destination locations. At this time, the priority of each preference information is determined by the weight of the multiple preference information, so as to determine the priority order among the multiple destination locations, thereby determining the navigation order of the multiple destination locations. Optionally, the weight of "sneaker store" is 50%, the weight of "tea shop" is 30%, and the weight of "lounge" is 20%. The weights are compared according to the weight of "sneaker store", the weight of "tea shop" and the weight of "lounge", and the priority order among the multiple destination locations is sorted according to the weight of "sneaker store", the weight of "tea shop" and the weight of "lounge", so as to determine the navigation order of the multiple destination locations. In the process of sorting the destination locations, the destination locations are sorted from large to small or from small to large according to the weight of each destination location. For example, when the weight is larger, it indicates that the user has a greater preference for the destination. In the process of sorting the destinations, the destinations are sorted from large to small according to their weights. That is, when navigating, the destination with the larger weight is prioritized as the destination of the navigation route.

[0088] In another embodiment of the present application, the sequence of multiple destination locations is adjusted based on the user's preference information to facilitate customized navigation to suit the user's preference. Optionally, the user's preference information may be the shortest distance, the shortest time, the least crowds, etc.

[0089] In addition, step S133, determining a plurality of navigation routes based on the arrival order and the current position;

[0090] In an embodiment of the present application, the arrival order and the current position are used as reference factors for starting to determine the multiple navigation routes, and the combination of the multiple navigation routes is affected by different arrival orders.

[0091] Step S134, determining an optimal navigation route according to the plurality of navigation routes and the three-dimensional map;

[0092] In an embodiment of the present application, crowd flow information corresponding to the three-dimensional map is collected so as to determine the distribution of people in each area in the three-dimensional map based on the crowd flow information, thereby determining whether each area is crowded according to the number of people in each area. If the number of people in an area exceeds a preset number of people, the area is in a crowded state, and the optimal navigation route is adjusted. According to avoiding the crowded area, the navigation route of the wearable device is adjusted based on the restrictions of multiple crowded areas (such as avoiding the crowded area in the navigation route). At this time, multiple navigation routes are determined based on the arrival order and the current position, so as to determine the optimal navigation route according to the multiple navigation routes and the three-dimensional map, so that the user navigates based on the optimal navigation route, thereby guiding the movement of the user using the head-mounted device through the optimal navigation route, thereby improving the navigation service of the head-mounted device to the user, and thus improving the user experience.

[0093] For the area in the three-dimensional map, crowd flow information is obtained, and the corresponding focus content is determined by analyzing the crowd flow information, so as to determine the corresponding area in the three-dimensional map according to the focus content in the crowd flow information. In another embodiment, the three-dimensional area can be divided into regions to obtain the areas in the three-dimensional map, and then whether it is in a crowded state can be determined according to the crowd flow in each area in the three-dimensional map within a preset time.

[0094] In another embodiment of the present application, after determining the navigation route based on the three-dimensional map, the current position and the destination position, the navigation method of the head mounted device further includes: collecting the user's eye features and determining the current position of the eye features; determining the position corresponding to the display information based on the current position of the eye features, wherein the display information includes the navigation information in the navigation route and / or the surrounding store information; if the current position of the eye features changes within a preset time, determining the position change of the eye features; and adjusting the position of the display information based on the position change of the eye features. Optionally, the navigation information is the navigation route, and the store information is the store name or the sales product information of the store.

[0095] Among them, the head-mounted device presents a navigation route to the user so that the user can move along the navigation route. The head-mounted device collects the user's eye features and identifies the center of the user's eye features so as to determine the current position of the eye features, thereby determining the user's visual direction, so as to adjust the position corresponding to the display information according to the user's visual direction.

[0096] At this time, the direction of the user's eye feature is the user's visual direction, and the position of the displayed information is adjusted based on the position change of the eye feature, thereby ensuring that the position of the displayed information corresponds to the user's visual direction, thereby ensuring that the user views the position of the displayed information.

[0097] Further, the position corresponding to the display information is determined based on the current position of the eye feature, wherein the display information includes navigation information in the navigation route and / or surrounding store information, so that the current position of the eye feature triggers the adjustment of the position corresponding to the display information, and ensures that the user's visual direction corresponds to the position corresponding to the display information, so as to view the display information. Optionally, if the current position of the eye feature is in the upper left position, the position corresponding to the display information is the upper left position, and the user's eye feature is provided to look directly at it.

[0098] At this time, if the current position of the eye feature changes within the preset time, the position change amount of the eye feature is determined; the position of the displayed information is adjusted based on the position change amount of the eye feature, so that the position of the displayed information is adjusted by the position change amount of the eye feature, thereby realizing dynamic adjustment of the position of the displayed information, further ensuring that the user's visual direction corresponds to the position corresponding to the displayed information, thereby realizing viewing of the displayed information. Optionally, if the position change amount of the eye feature is 5 mm to the right, the position of the displayed information moves 5 mm to the right.

[0099] In another embodiment of the present application, after determining the navigation route based on the three-dimensional map, the current location and the destination location, the navigation method of the head-mounted device also includes: obtaining the type of user wearing the head-mounted device, and display information, wherein the display information includes the navigation information in the navigation route and / or the surrounding store information; if the user type is a blind person, the display information is output in a non-visual manner.

[0100] The type of user wearing the head-mounted device is obtained to facilitate the determination of the type of user wearing the head-mounted device. At this time, the type of user wearing the head-mounted device can be a blind person, a deaf-mute person, etc. If the user type is a blind person, the display information is output in a non-visual manner. The display information is output in the form of sound and heard by the blind person, so as to navigate the blind person, thereby improving the user adaptability of the head-mounted device, and is suitable for different application scenarios, so as to adjust the output of the display information of the head-mounted device for different user types. Among them, the display information includes navigation information in the navigation route and / or surrounding store information.

[0101] In another embodiment of the present application, after determining the navigation route based on the three-dimensional map, the current location and the destination location, the navigation method of the head mounted device further includes: receiving the number of customers sent by the target terminal corresponding to the destination location; determining the number of people in line based on the number of customers; and transmitting a reminder message if the number of people in line is less than a preset threshold of the number of people in line. Optionally, the target terminal corresponding to the destination location may be a controller of a store's call center.

[0102] The head-mounted device is associated with the target terminal corresponding to the destination location so that the head-mounted device and the target terminal corresponding to the destination location are communicated and connected. At this time, the head-mounted device is used to transmit a queuing signal to the target terminal corresponding to the destination location based on the head-mounted device, so that subsequent users can go to the destination location to eat. Secondly, the head-mounted device receives the number of customers sent by the target terminal corresponding to the destination location, and determines the number of people in line based on the number of customers, so as to inform the user of the number of people in line, and the head-mounted device obtains the number of people in line in real time. If the number of people in line is less than the preset number of people in line (i.e., the number of people in line) threshold, a reminder message is transmitted, and the user is informed that he needs to go to the destination location, thereby improving the interactive effect of the head-mounted device, and the head-mounted device is bound to the target terminal corresponding to the destination location, thereby reminding the user to move to the destination location.

[0103] If the number of people in queue is greater than a preset threshold value of the number of people in queue, the number of people in queue is transmitted, and the queuing time is estimated based on the number of people in queue to facilitate the transmission of the queuing time. Optionally, the queuing time is estimated based on the number of people in queue, and the queuing time can be comprehensively estimated based on the dining time of each customer.

[0104] The following describes an apparatus embodiment of the present application, which can be used to execute the navigation method of the head mounted device in the above embodiment of the present application. For details not disclosed in the apparatus embodiment of the present application, please refer to the embodiment of the navigation method of the head mounted device in the above embodiment of the present application.

[0105] Figure 5 A block diagram of a navigation device for a head mounted device according to an embodiment of the present application is shown.

[0106] Reference Figure 5 As shown, a navigation device of a head mounted device according to an embodiment of the present application includes:

[0107] An acquisition module 210, configured to acquire a current position of a head mounted device and multimedia data collected by the head mounted device;

[0108] A map module 220, configured to determine a three-dimensional map based on the current location and the multimedia data;

[0109] The route module 230 is used to determine a navigation route based on the three-dimensional map, the current location and the destination location.

[0110] In one embodiment of the present application, the map module 220 is further used to: receive a plane map sent by a location terminal corresponding to the current location;

[0111] Creating corresponding stereo features based on the multimedia data;

[0112] A three-dimensional map is determined according to the three-dimensional features and the planar map.

[0113] In one embodiment of the present application, the map module 220 is further used to: determine a characteristic area based on an area of ​​the planar map;

[0114] If the feature information of the three-dimensional feature is consistent with the feature information of the corresponding feature area, a three-dimensional map is determined based on the three-dimensional feature and the feature area.

[0115] In one embodiment of the present application, the route module 230 is further used to: obtain user preference information;

[0116] Determine the order of arrival between the destination locations according to the user's preference information and the destination locations;

[0117] determining a plurality of the navigation routes based on the arrival order and the current location;

[0118] An optimal navigation route is determined based on the multiple navigation routes and the three-dimensional map.

[0119] In one embodiment of the present application, the route module 230 is further used to: collect eye features of the user and determine the current position of the eye features;

[0120] Determining a location corresponding to display information based on the current location of the eye feature, wherein the display information includes navigation information in the navigation route and / or surrounding store information;

[0121] If the current position of the eye feature changes within a preset time, determining the amount of position change of the eye feature;

[0122] Adjust the position of the displayed information based on the position change of the eyeball feature

[0123] In one embodiment of the present application, the route module 230 is further used to: receive the number of customers sent by the target terminal corresponding to the destination location;

[0124] Determining the number of people in line based on the number of customers;

[0125] If the number of people in the queue is less than the preset threshold number of people in the queue, a reminder message is transmitted.

[0126] In one embodiment of the present application, the route module 230 is further used to: obtain the type of user wearing the head mounted device, and display information, wherein the display information includes navigation information in the navigation route and / or surrounding store information;

[0127] If the user type is a blind person, the display information is output in a non-visual manner.

[0128] Figure 6 A schematic diagram of the structure of a computer system suitable for implementing a head mounted device according to an embodiment of the present application is shown.

[0129] It should be noted that Figure 6 The computer system of the head mounted device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0130] like Figure 6As shown, the computer system includes a central processing unit (CPU) 301, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 302 or the program loaded from the storage part 308 to the random access memory (RAM) 303, such as executing the method described in the above embodiment. In RAM 303, various programs and data required for system operation are also stored. CPU 301, ROM 302 and RAM 303 are connected to each other through bus 304. Input / output (I / O) interface 305 is also connected to bus 304.

[0131] The following components are connected to the I / O interface 305: an input section 306 including a keyboard, a mouse, etc.; an output section 307 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker; a storage section 308 including a hard disk, etc.; and a communication section 309 including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication section 309 performs communication processing via a network such as the Internet. A drive 310 is also connected to the I / O interface 305 as needed. A removable medium 311, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 310 as needed so that a computer program read therefrom is installed into the storage section 308 as needed.

[0132] In particular, according to an embodiment of the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a computer program for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication section 309, and / or installed from a removable medium 311. When the computer program is executed by a central processing unit (CPU) 301, various functions defined in the system of the present application are executed.

[0133] It should be noted that the computer-readable medium shown in the embodiment of the present application may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, - but not limited to - an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by an instruction execution system, device or device or used in combination with it. In the present application, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, wherein a computer-readable computer program is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, which may send, propagate, or transmit programs for use by or in conjunction with an instruction execution system, apparatus, or device. The computer program contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0134] The flowchart and block diagram in the accompanying drawings illustrate the possible architecture, functions and operations of the system, method and computer program product according to various embodiments of the present application. Wherein, each box in the flowchart or block diagram can represent a module, a program segment, or a part of the code, and the above-mentioned module, program segment, or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0135] The units involved in the embodiments described in this application may be implemented by software or hardware, and the units described may also be set in a processor. The names of these units do not, in some cases, constitute limitations on the units themselves.

[0136] As another aspect, the present application also provides a computer-readable medium, which may be included in the head-mounted device described in the above embodiment; or may exist independently without being assembled into the head-mounted device. The above computer-readable medium carries one or more programs, and when the above one or more programs are executed by a head-mounted device, the head-mounted device implements the method described in the above embodiment.

[0137] It should be noted that, although several modules or units of the equipment for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present application, the features and functions of two or more modules or units described above can be embodied in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into being embodied by multiple modules or units.

[0138] Through the description of the above implementation methods, it is easy for those skilled in the art to understand that the example implementation methods described here can be implemented by software or by combining software with necessary hardware. Therefore, the technical solution according to the implementation methods of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, a touch terminal, or a network device, etc.) to execute the method according to the implementation methods of the present application.

[0139] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the embodiments disclosed herein. The present application is intended to cover any variations, uses or adaptations of the present application, which follow the general principles of the present application and include common knowledge or customary technical means in the art that are not disclosed in the present application.

[0140] It should be understood that the present application is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.

Claims

1. A navigation method for a head mounted device, characterized in that: include: Acquire the current position of the head mounted device and the multimedia data collected by the head mounted device; Determining a three-dimensional map based on the current location and the multimedia data; A navigation route is determined based on the three-dimensional map, the current location and the destination location.

2. The method according to claim 1, characterized in that The destination location includes at least one, and determining a navigation route based on the three-dimensional map, the current location, and the destination location includes: Obtain user preference information; Determine the order of arrival between the destination locations according to the user's preference information and the destination locations; determining a plurality of the navigation routes based on the arrival order and the current location; An optimal navigation route is determined based on the multiple navigation routes and the three-dimensional map.

3. The method according to claim 1, characterized in that The determining of the three-dimensional map based on the current position and the multimedia data includes: receiving a plan map sent by a location terminal corresponding to the current location; Creating corresponding stereo features based on the multimedia data; A three-dimensional map is determined according to the three-dimensional features and the planar map.

4. The method according to claim 3, characterized in that The determining of the three-dimensional map according to the three-dimensional features and the plane map includes: determining a characteristic region based on the region of the planar map; If the feature information of the three-dimensional feature is consistent with the feature information of the corresponding feature area, a three-dimensional map is determined based on the three-dimensional feature and the feature area.

5. The method according to claim 1, characterized in that After determining the navigation route based on the three-dimensional map, the current location and the destination location, the navigation method of the head mounted device further includes: Collecting eye features of the user and determining the current position of the eye features; Determining a location corresponding to display information based on the current location of the eye feature, wherein the display information includes navigation information in the navigation route and / or surrounding store information; If the current position of the eye feature changes within a preset time, determining the amount of position change of the eye feature; The position of the displayed information is adjusted based on the amount of position change of the eye feature.

6. The method according to claim 1, characterized in that After determining the navigation route based on the three-dimensional map, the current location and the destination location, the navigation method of the head mounted device further includes: receiving the number of customers sent by a target terminal corresponding to the destination location; Determining the number of people in line based on the number of customers; If the number of people in the queue is less than the preset threshold number of people in the queue, a reminder message is transmitted.

7. The method according to claim 1, characterized in that After determining the navigation route based on the three-dimensional map, the current location and the destination location, the navigation method of the head mounted device further includes: Acquire a user type wearing the head mounted device and display information, wherein the display information includes navigation information in the navigation route and / or surrounding store information; If the user type is a blind person, the display information is output in a non-visual manner.

8. A navigation device for a head mounted device, characterized in that: include: An acquisition module, used to acquire the current position of the head mounted device and the multimedia data collected by the head mounted device; A map module, configured to determine a three-dimensional map based on the current location and the multimedia data; A route module is used to determine a navigation route based on the three-dimensional map, the current location and the destination location.

9. A computer readable medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the navigation method of the head mounted device according to any one of claims 1 to 7 is implemented.

10. A head mounted device, characterized in that: include: one or more processors; A storage device for storing one or more programs, which, when executed by the one or more processors, enables the one or more processors to implement the navigation method of the head-mounted device as described in any one of claims 1 to 7.

Images