Apparatus and method for recommending information to a user during navigation - Patents.com

Abstract

To provide a device and a method for recommending information to a user while a navigation is being given.SOLUTION: The device includes: a generation unit for generating personalization scene information showing an intention of a user about a current navigation on the basis of user data on the user while the current navigation is being given; and a determination unit for determining information to recommend to the user while the navigation is being given, on the basis of the personalization scene information. Selecting an information entry and outputting the entry on the basis of the personalization scene information allows a user to acquire useful information efficiently.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to the field of navigation, and more particularly to providing and displaying information during navigation. [Background technology]

[0002] Navigation technology has become a common technology in people's daily life and greatly assists people in their daily outings. Currently, navigation technology can not only be used to accurately plan a route from a user's current location to a destination selected by the user, but can also provide the user with additional information, such as information about the destination, the surroundings of the destination, or places of interest along the way, to assist the user in making a selection.

[0003] However, conventional navigation devices and navigation software usually display this additional information to each user searching for the destination under any conditions without individual differences, and some can recommend different information to each user based on the user's history data. For example, they can read the food preferences entered by the user on, for example, social software and recommend different restaurants to each user, or read the performance information reserved by the user on, for example, a ticket sales site and recommend the reserved performance facility to the user as the navigation destination. Some of this information may not match the user's true intention regarding the current navigation. For example, a user who likes Chinese food may try Western food at any time.

[0004] It is therefore desirable to provide further improved navigation. Summary of the Invention [Problem to be solved by the invention]

[0005] The present invention provides an apparatus and method for recommending information to a user during navigation, which can provide the user with information that is useful to the user or that is of greater interest to the user by determining an intention to initiate a current navigation for each user and personally recommending information that is closely associated with the user's intention regarding the current navigation. [Means for solving the problem]

[0006] According to one aspect of the present invention, there is provided an apparatus for recommending information to a user during a navigation period, the apparatus comprising: a generator for generating personalized scene information indicative of an intention of the user with respect to the current navigation period based on user data related to the user during the current navigation period, and a determiner for determining information to be recommended to the user during the current navigation period based on the personalized scene information.

[0007] According to another aspect of the present invention, there is provided a method for recommending information to a user during a navigation period, the method comprising: generating personalized scene information indicative of an intention of the user with respect to the current navigation period based on user data related to the user during a current navigation period, and determining information to recommend to the user during the current navigation period based on the personalized scene information.

[0008] Furthermore, according to another aspect of the present invention, there is provided a computer storage medium having stored thereon computer readable instructions which, when executed by a processor, cause the processor to perform a method according to each embodiment of the present invention. Effect of the Invention

[0009] According to each embodiment of each aspect of the present invention, by receiving user data related to a user during a current navigation period, i.e., user data occurring during the current navigation, personalized scene information that can indicate the user's intention to start the current navigation can be generated, for example, by artificial intelligence based on a machine learning algorithm. The personalized scene information is related to a specific scene related to an activity or event that the user intends to perform or participate in through the current navigation, and can reflect or indicate the user's intention to start the current navigation, such as outdoor play, going out and dining, participating in parent-child activities, visiting an exhibition, etc. Based on such personalized scene information, information recommended to the user can be closely associated with the user's true intention during the current navigation period. In other words, the information output to the user is not static information that does not differ for different users or static information that does not differ for different navigation operations of the same user, but dynamic information that is personalized for each different navigation of each user, so that the user can receive maximum benefit from the obtained information.

[0010] Those skilled in the art will realize still further advantages of the present invention upon reading and understanding the following detailed description. [Brief description of the drawings]

[0011] [Figure 1] 1 shows a block diagram of an apparatus for recommending information to a user during navigation according to an embodiment of the present invention. [Diagram 2] 2 shows a flowchart of a method for recommending information to a user during navigation according to an embodiment of the present invention; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] FIG. 1 shows a block diagram of an apparatus 100 for recommending information to a user during navigation according to an embodiment of the present invention.

[0013] The device 100 comprises a generating unit 101 for generating personalized scene information based on user data 10 relating to the user during the current navigation, the personalized scene information indicating the user's intention regarding the current navigation. The personalized scene information may include scene information at any time in the current navigation process, which may indicate the user's intention regarding the current navigation, and / or scene information representing an activity that the user intends to perform or an event that the user intends to participate in through the current navigation. It is understood that the scene information of the activity that the user intends to perform or an event that the user intends to participate in can be derived based on the scene information at any time in the current navigation process. For example, if the scene information at any time in the current navigation process is that two adults, one man and one woman, and one child are chatting happily in a car, it is assumed that the user's intention regarding the current navigation is a parent-child activity, so it can be determined that the scene information to be performed or participated in represents a parent-child activity scene.

[0014] User data 10 relating to the user during the current navigation should be understood relative to the user's historical data, which is distinct from historical data the user generated or uploaded prior to the current navigation. It is understood that a user does not only refer to the person operating the navigation device or driving the vehicle, but may also include all people participating in the current outing, e.g., all people in the vehicle.

[0015] In one embodiment, the user data 10 includes user state data representative of a user's state during a current navigation session, which may include user profile data and / or user behavior data.

[0016] The user profile data includes basic data of users participating in the current navigation, such as the number of users participating in the navigation for going out, the age group, sex, appearance, and / or current preferences of each user. The user profile data can be acquired, for example, from real-time sensing data. The real-time sensing data is, for example, image data and / or voice data acquired by a sensor. The sensor can include an image acquisition device such as a camera capable of acquiring image data of the user including not only still image data but also video data. Furthermore, the sensor can include a voice acquisition device such as a microphone capable of acquiring voice data of the user. In addition, the number of users, the gender of each user, the approximate age group, appearance, and / or current preferences of each user can be derived from the image data and / or voice data of the user. The user profile data can be obtained by performing image processing such as image segmentation and template matching on the acquired image data, or by performing voice processing such as voice recognition and semantic analysis on the acquired voice data. For example, information such as the number of users, whether each user is an adult or a child, the gender of each user, and whether the user is currently wearing work clothes or casual clothes can be determined from the image data. Also, the voice data can analyze the current user preferences; for example, the user may have clearly expressed an intention to go out for Western food during the conversation.

[0017] The user behavior data may indicate the behavior of a user participating in a current navigation, including the user's current facial expression, tone of voice, etc., for example, whether the user's current facial expression is cheerful or stern, whether the user's current tone of voice is happy or somber, etc. The user behavior data may also be obtained by performing image processing such as image segmentation and template matching on the acquired image data, or by performing voice processing such as voice recognition and semantic analysis on the acquired voice data.

[0018] The generator 102 may generate personalized scene information based on user state data including user profile data and / or user behavior data, for example, using a model trained with a machine learning algorithm.

[0019] For example, based on the user state data indicating that adults and children are present in the car at the same time, all of them are wearing casual clothes and have cheerful expressions, it can be determined that the user's intention regarding the current navigation is to go out for parent-child activities; based on the user state data indicating that multiple female friends are present in the car and they look fashionable, it can be determined that the user's intention regarding the current navigation is to go shopping; based on the user state data indicating that multiple male friends are present in the car and they are wearing sportswear, it can be determined that the user's intention regarding the current navigation is to go out for sports.

[0020] In one embodiment, the user data 10 may include destination data related to the user's current navigation destination. The destination data may be directly input by the user, and may be a specific location such as the Forbidden City, or may be a general term for a location such as a park or a restaurant. The generating unit 101 may generate personalized scene information indicating an intention regarding the current navigation based on the destination data, for example, in combination with the user's history data. For example, if the user inputs the Palace Museum as the destination and it is determined from the history data that the user likes to see exhibitions of ancient coins, personalized scene information indicating that the user would like to go to the Palace Museum to see the exhibition of ancient coins may be generated. If such an exhibition is held at the Forbidden City, the user may be notified of the relevant information by push notification.

[0021] While the above examples are given without being limiting, in some cases different types of user data 10 may be selected to determine the personalized scene information, and different weights may be assigned to these different types of user data to determine the personalized scene information, for example, a higher weight value may be assigned to data determined to be indicative of the user's current preferences.

[0022] Furthermore, the generating unit 101 can generate personalized scene information based on the user data 10 together with the user history data 11 .

[0023] For example, information such as the age, gender, occupation, and hobby of each user can be directly extracted from each user's social software, and combined with the real-time sensed user data 10, the personalized scene information indicating the user's intention can be more accurately determined. For example, if the current user data 10 indicates that all people are currently wearing sportswear, and the history data of all people shows that their hobbies are all basketball, it can be more accurately determined that the user's intention regarding the current navigation is to play basketball.

[0024] It will be appreciated that sensors such as cameras, microphones, etc. may be included in the device 100 so as to form part of the device 100. Alternatively, these sensors may be separate from the device 100, for example, in-vehicle sensors or sensors integrated into a mobile device.

[0025] The apparatus 100 comprises a decision unit 102 for determining, based on the personalized scene information, information to be recommended to the user during the current navigation session.

[0026] In one embodiment, the recommended information includes information about a current navigation destination, which is determined based on the user's personalized scene information.

[0027] The information about the current navigation destination may include attributes of the recommended navigation destination based on the user's personalized scene information. For example, if the navigation destination is a historical spot, the user's personalized scene information indicates that the user is interested in history, and the intention is determined to be to understand the history of the spot, and the attributes of the navigation destination may include an introduction to the history of the spot. Also, if the navigation destination is a shopping center, the user's intention is determined to purchase children's clothes, and the attributes of the recommended navigation destination may be information about a store selling children's clothes in the shopping center, etc.

[0028] In addition, the information on the navigation destination may further include a commercial service index of the navigation destination recommended based on the user's personalized scene information. For example, in the case of a specific shopping center, the status of each shopping center nearby (e.g., in the same city) may be integrated to present the dining index (ranking), shopping index (ranking), entertainment index (ranking), etc. for the specific shopping center. In the case of a spot or park, its leisure index, parent-child index, sports index, etc. may be presented. For example, if it is determined that the user's intention is parent-child activities, a parent-child index may be presented.

[0029] In addition, the information about the navigation destination may further include an event occurring at the navigation destination recommended based on the user's personalized scene information. It is understood that temporary events typically occur at navigation destinations. For example, for navigation destinations such as museums, exhibition halls, etc., different time periods may correspond to different exhibitions. Shopping centers may hold promotional activities such as limited-time sales. For example, as described above, if the user's personalized scene information indicates that the user wants to see an exhibition of old coins, information about such an exhibition held at a museum may be recommended to the user.

[0030] The information about the navigation destination may further include places of interest and information about the places of interest in the vicinity of the navigation destination that are recommended based on the user's personalized scene information. For example, in the case of a commercial center, there may be multiple shopping centers in one area, and when a user searches for one of the shopping centers, other nearby shopping centers and their attributes, their commercial service indexes, and one or more of the events occurring there may also be included in the information to be recommended based on the user's personalized scene information.

[0031] The determination unit 102 can recommend one or more of the above information for each different situation based on personalized scene information indicating the user's intention regarding the current navigation. For example, when the navigation destination is a shopping center, the determination unit 102 can determine the restaurant and food index related to Western food in the shopping center as the information to be recommended based on the user's intention to go out to eat Western food, and can recommend other restaurants and food index related to Western food located in the vicinity of the shopping center. In addition, when the navigation destination is a spot, the determination unit 102 can determine the leisure index and parent-child index of the spot as the information to be recommended based on the intention to reflect a parent-child trip. Alternatively, when the navigation destination is only the name of one road, the determination unit 102 can determine the location of a library in the vicinity of the navigation destination and its opening hours as the information to be recommended based on the intention to reflect a desire to go to study.

[0032] This avoids the user being inundated with unnecessary information about numerous destinations. For example, if the user wants to go to a shopping center for dinner, various promotional information, shopping store information, parent-child activity information, etc. about the shopping center will not be recommended to the user.

[0033] In one embodiment, the recommended information includes information about the user's current location, which can be obtained, for example, by a Global Positioning System (GPS).

[0034] For example, when a user is out and about, especially when on a road trip, the user usually does not want to miss any scenic or entertainment events along the way, so the information about the user's current location includes information about places of interest that are in the vicinity of the user's current location while driving.

[0035] The information about the user's current location is similarly determined by the determining unit 102 based on the personalized scene information. For example, if the personalized scene information indicates an intention of an outdoor parent-child trip, a playground on the way can be recommended to the user. If the personalized scene information indicates an intention of participating in outdoor sports for young people, information such as a mountain on the way and the sports index of the mountain can be recommended to the user. Or, if the personalized scene information indicates an intention of eating, a restaurant on the way can be recommended to the user.

[0036] Even if the places of interest around the current location are the same, the recommended information differs depending on the personalized scene information that indicates the user's current intention. For example, for the same spot, if the personalized scene information shows that the user is an elderly person and that his / her current intention is to understand history, information about war ruins, for example, at this spot is recommended, whereas if the personalized scene information shows that the user is a young person and that his / her current intention is to sightsee, information about natural scenery at this spot is recommended.

[0037] In one embodiment, the device 100 further includes an output unit 103. For example, the output unit 103 may include a screen display or a speaker. The output unit 103 can output the determined recommendation information to a user at a predetermined timing.

[0038] For example, if the navigation plan indicates that it will take four hours to reach a certain spot, the specified timing can be set to two hours later, and information about the spot can be broadcast to the user while driving. This allows the user to understand interesting information about the spot and also relieves boredom during long trips.

[0039] The determination unit 102 can also determine a predetermined timing for outputting the determined recommendation information based on the user behavior data. For example, if the user behavior data indicates that the driver is silent for a long time, it can reflect that the driver feels tired or bored. In this case, the output unit 103 (e.g., an audio broadcasting system of a navigation device) can broadcast information that can arouse the driver's interest, thereby alleviating the driver's sense of fatigue or boredom. Alternatively, if the user behavior data indicates that a child is sleeping in the car, the output unit 103 disables all output functions that may disturb the child's rest, such as audio broadcasting. Note that the user behavior data is similarly obtained from image data and / or audio data of the user.

[0040] It will be understood that the output unit 103 may be included in the device 100 so as to form a part of the device 100. Alternatively, the output unit 103 may be a separate component from the device 100, for example, a display and / or speaker for an in-vehicle device, a display and / or speaker for a mobile device, etc.

[0041] In one embodiment, the generator 101 may also generate personalized scene information together with the background information 12 to indicate the current navigation intention.

[0042] The context information 12 may include information that may reflect the user's current context, such as date and time information (eg, holidays) and / or weather conditions.

[0043] For example, if the user data 10 about the user during the current navigation period indicates that a parent and a child are present in the car at the same time, each user is wearing casual clothing suitable for sports, and the tone of voice is pleasant, and the background information 12 indicates that the current date and time is a holiday and the weather is fine, personalized scene information reflecting the user's intention to go on an outdoor parent-child trip can be generated based on the user data (parent, child, sportswear, pleasant tone of voice) and background information (holiday, fine weather). Similarly, if it is determined that a parent and a child are present in the car at the same time, personalized scene information reflecting the user's intention to participate in an indoor parent-child activity can be generated based on the background information that the weather is cloudy. Similarly, if it is determined that a parent and a child are present in the car at the same time, based on the background information that dinner time is approaching, an intention to go out for a meal as a family, rather than an intention to go on a trip, can be estimated.

[0044] It is also expected that the corresponding recommendation information is determined based on both the background information 12 and the personalized scene information indicating the user's intention regarding the current navigation, which is generated by the generating unit 101. For example, if the user's personalized scene information indicates that the user's intention is parent-child activities, but the current background information indicates that the weather is cloudy, information regarding indoor parent-child activities can be recommended to the user.

[0045] In a further embodiment, the generating unit 101 may generate personalized scene information indicating the intention regarding the current navigation together with vehicle and / or traffic information (not shown). For example, if the vehicle information indicates that the car is in good condition and has a sufficient oil supply, it can be inferred that the user intends to go to a spot of interest far from the current location. Also, if the traffic information indicates that the road conditions to a certain spot on the way are bad, it can be inferred that the user intends not to stop at the spot.

[0046] Preferably, the vehicle and / or traffic information can be used by the determination unit 102 to determine information to be recommended to the user. For example, when the personalized scene information determined by the generation unit 101 indicates that the user's intention regarding the current navigation is a parent-child activity, the determination unit 102 can pre-determine recommended information based on the personalized scene information, and then further determine the recommended information to be finally shown to the user based on the vehicle and / or traffic information.

[0047] It is understood that one or more of the above-mentioned embodiments may be combined. For example, the personalized scene information may be generated based on any combination of the user data 10 and the background information 12, the vehicle information, the traffic information and / or the history data 11, or the background information, the vehicle information, the traffic information and / or the history data may be further filtered after pre-determining the recommendation information, and finally used to determine the recommendation information to be shown to the user.

[0048] Those skilled in the art will appreciate that one or more of the above-mentioned generating unit 101, determining unit 102 and output unit 103 may be implemented as computer-readable instructions stored in a computer-readable medium that control corresponding hardware devices. The functions of each of the above units may be realized by a processor, and the execution of the corresponding computer-readable instructions may cause the processor to perform the corresponding functions.

[0049] Although the device for recommending information to a user during navigation has been described above mainly with reference to the generating unit 101 and the determining unit 102, it is understood that the device can be realized as a navigation device in general. Of course, the above-mentioned units of the device may be realized as part of car navigation by the units in a vehicle. Alternatively, the functions of the generating unit 101 and the determining unit 102 may be realized by a cloud device.

[0050] FIG. 2 shows a flow chart illustrating a method 200 for recommending information to a user during navigation according to one embodiment of the present invention.

[0051] At 210, personalized scene information is generated based on user data about the user during the current navigation, the personalized scene information being indicative of an intent of the user with respect to the current navigation.

[0052] At 220, information to be recommended to the user during the current navigation session is determined based on the personalized scene information.

[0053] At 230, the determined information is output to the user at a predetermined timing.

[0054] It is understood that the method of the present application has the same or similar embodiments as the device of the present application.

[0055] The process of the method illustrated in Figure 2 may be realized by a processor executing corresponding instructions, which may be stored in any suitable computer-readable medium.

[0056] Although the method of the present invention has been described above with reference only to the embodiment shown in FIG. 2, the operations included in the above embodiment are not limited and can be deleted, combined, modified, divided and / or recombined as necessary to add / modify / delete corresponding functions.

[0057] The apparatus and methods of the present invention have been described above with reference to various embodiments. These embodiments may include certain features, structures, or characteristics, but not all embodiments necessarily include the particular features, structures, or characteristics. Also, some embodiments may have some or all of the features described for other embodiments, or features not described for other embodiments.

[0058] Each feature in different embodiments or examples may be combined with some features included and other features excluded to accommodate various different applications. The above description and drawings show an example of an embodiment. Those skilled in the art will understand that one or more of the described elements may be combined to form a single functional element. Alternatively, some elements may be divided into multiple functional elements. Elements of any one embodiment may be added to another embodiment. For example, the order of the process described herein is not limited to the form described herein and may be changed. Also, the operations of any flowcharts do not have to be performed in the order shown, and not all operations necessarily have to be performed. Also, operations that are not dependent on other operations may be performed in parallel with other operations. The scope of the embodiment is not limited to these specific examples. Also, various changes in the order of operations, product configurations, and structural differences are possible, regardless of whether they are explicitly described in the specification. [Explanation of symbols]

[0059] 10 User Data 11 Historical Data 12 Background information 100 devices 101 Generation part 102 Decision Section 103 Output section

Claims

1. 1. An apparatus for recommending information to a user during navigation, comprising: a generating unit for generating personalized scene information indicative of an intention of the user regarding the current navigation based on user data regarding the user during the current navigation; a determination unit for determining information to be recommended to the user during the current navigation period based on the personalized scene information; the user data includes user state data indicative of a state of the user during the current navigation; The information to be recommended to the user is information about a destination of the current navigation or a place of interest in the vicinity of the current location, and for the same destination or the place of interest in the vicinity of the current location, the information to be recommended to the user determined by the determination unit based on different personalized scene information is different. An apparatus comprising:

2. The information to be recommended to the user includes commercial service indexes of places of interest around a destination or a current location, and the determining unit determines different types of commercial service indexes of the same destination or places of interest around the current location according to different personalized scene information.

2. The apparatus of claim 1 .

3. An output unit is further provided for outputting the determined information to the user at a predetermined timing.

3. The apparatus according to claim 2 .

4. The determination unit determines the predetermined timing based on user behavior data indicating a behavior of the user during the current navigation period.

4. The apparatus according to claim 3.

5. The user state data includes user profile data and / or user behavior data; The generation unit further generating the user profile data and / or the user behavior data based on image data and / or voice data of the user acquired during the current navigation period; generating the personalized scene information according to a predefined model based on the user profile data and / or the user behavior data; 2. The apparatus of claim 1 .

6. The generation unit further generates the personalized scene information based on background information and / or history data of the user.

6. Apparatus according to any one of claims 1 to 5.

7. 1. A method for recommending information to a user during navigation, comprising: generating, executed by a processor, personalized scene information indicative of an intention of the user regarding the current navigation based on user data regarding the user during the current navigation; determining, executed by a processor, information to recommend to the user during the current navigation period based on the personalized scene information; the user data includes user state data indicative of a state of the user during the current navigation; The information to be recommended to the user is information about a place of interest in the vicinity of the current navigation destination or current location, and for the same destination or place of interest in the vicinity of the current location, the information to be recommended to the user determined based on different personalized scene information is different. A method comprising:

8. The information to be recommended to the user includes commercial service indexes of places of interest around a destination or a current location, and different types of commercial service indexes of the places of interest around the same destination or current location are determined according to different personalized scene information; 8. The method of claim 7.

9. and outputting the determined information to the user at a predetermined timing.

9. The method of claim 8.

10. determining the predetermined timing based on user behavior data indicative of a behavior of the user during the current navigation period, the determining step being executed by a processor; 10. The method of claim 9.

11. The user state data includes user profile data and / or user behavior data; generating the user profile data and / or the user behavior data based on image data and / or audio data of the user acquired during the current navigation period, the image data and / or audio data being executed by a processor; and generating the personalized scene information according to a predetermined model based on the user profile data and / or the user behavior data, the method being executed by a processor.

8. The method of claim 7.

12. generating the personalized scene information based on background information and / or historical data of the user, the generating step being executed by a processor.

12. The method according to any one of claims 7 to 11.

13. A computer storage medium having stored thereon computer readable instructions which, when executed by a processor, cause the processor to perform the method of any one of claims 7 to 12.

Images